KR20220056046A - Method for measuring individual exercise amount using augmented reality interactive sports apparatus - Google Patents

Abstract

The present invention relates to a method for measuring an individual exercise amount using an augmented reality (AR) interactive sports apparatus. More specifically, the method is implemented by an AR interactive sports apparatus controlling an interaction between content and a user by tracking the user's motion with a lidar sensor. The method comprises the following steps: (1) receiving a signal detected by a lidar sensor unit for laser-scanning a plane having a predetermined height from the ground; (2) estimating the number of steps of the user by using the received signal; and (3) measuring the amount of exercise of the user from the estimated number of steps by using a preset reference value. According to the present invention, the user's exercise amount is measured from the number of the user's steps estimated by using the signal detected by the lidar sensor unit, and thus the amount of exercise of the user who does sports without wearing a separate device can be measured. In addition, signals detected by at least two lidar sensors are used, and thus each user's motion can be tracked quickly and accurately and the amount of exercise can be measured even when a plurality of users use sports content at the same time.

Description

Method of measuring individual exercise amount using augmented reality interactive sports device

The present invention relates to a method for measuring individual exercise amount, and more particularly, to a method for measuring individual exercise quantity using an augmented reality interactive sports device.

As interest in health increases, portable biometric information measuring devices are being developed and widely distributed. In particular, a form worn on the wrist in the form of a band is most widely used, and may be in the form of a small disc or a square plate inserted into a sports vest. Such a biometric information measuring device is a wearable device worn on the body, and includes a heart rate sensor, an acceleration sensor, a pulse sensor, and the like, and may collect various information such as a heart rate, a pulse rate, a moving distance, and a moving trajectory.

However, since these portable biometric information measuring devices have to be worn on the body, they often feel uncomfortable depending on the wearer, and because they are expensive, there is a risk of damage or loss due to intense sports activities or carelessness, so it is burdensome for many users to use becomes this In addition, in group sports in which several users participate together, the process of providing each participant with a biometric information measuring device and having them wear it and collecting it again is cumbersome, and it is impossible to have all participants individually equipped with a biometric information measuring device. There are limits.

On the other hand, with the development of science, physical activity of modern people is decreasing, and lack of exercise is occurring in most modern people. In particular, the population corresponding to adult diseases such as obesity is continuously increasing. In addition, as outdoor activities are restricted due to rapid weather changes, environmental pollution, fine dust, and infectious diseases, interest in exercise that enables sufficient physical activity indoors is increasing.

Accordingly, technology has been developed that allows you to enjoy sports indoors using virtual or augmented reality. As a related prior art, Patent Publication No. 10-2020-0082990 (Title of the invention: fitness management method through VR sports) and the like have been disclosed.

However, the conventional technology for enjoying sports using virtual reality has a limitation in that it is difficult to obtain a sufficient exercise effect due to inconvenient operation because the VR device must be worn on the head. In addition, fitness or VR sports are not suitable for cultivating the cooperative spirit of children and adolescents because they are limited in their use for the purpose of improving physical strength and education of children and adolescents, and are usually performed alone.

Therefore, there is a need to develop a technology capable of providing various information related to the amount of exercise by measuring the amount of exercise without wearing a separate device while multiple users enjoy sports together.

The present invention has been proposed to solve the above problems of the previously proposed methods, and by measuring the user's exercise amount from the user's step number estimated using the signal detected by the lidar sensor unit, without wearing a separate device. It can measure the amount of exercise of a user who engages in sports with the bare body, and since it uses the signals detected by at least two LiDAR sensors, it is possible to quickly and accurately track each user's motion and measure the amount of exercise even when multiple users are using sports content at the same time. An object of the present invention is to provide a method for measuring individual exercise amount using an augmented reality interactive sports device.

A method for measuring individual exercise amount using an augmented reality interactive sports device according to a feature of the present invention for achieving the above object,

As a method of measuring individual exercise amount,

Implemented by an augmented reality interactive sports device that tracks user motion using lidar sensors to control interaction between content and users,

(1) receiving a signal sensed by the lidar sensor unit for laser scanning a plane of a predetermined height from the ground;

(2) estimating the number of steps of the user using the received signal; and

(3) It is characterized in that it comprises the step of measuring the amount of exercise of the user using a preset reference value from the estimated number of steps.

Preferably, in step (2),

(2-1) detecting the number and position of the user's feet using the received signal; and

(2-2) estimating the number of steps of the user by tracking the detected change in the number and position of the user's feet.

More preferably, in the step (2-2),

Estimate the number of steps by comparing the number and position of the feet according to the previous laser scanning with the number and position of the feet according to the current laser scanning,

The step (2-2) is,

(2-2-1) comparing the number of feet according to the previous laser scanning with the number of feet according to the current laser scanning;

(2-2-2) if the number of two feet is different as a result of the comparison in step (2-2-1) and the number of feet according to the current laser scanning is greater than the number of feet according to the previous laser scanning, counting by one step;

(2-2-3) if the number of two feet is the same as a result of the comparison in step (2-2-1), comparing the foot position according to the previous laser scanning with the foot position according to the current laser scanning; and

(2-2-4) If the position of the two feet is different as a result of the comparison of the step (2-2-3), the method may include counting as one step.

Preferably, in step (2),

If the distance between the two sprites representing the user's foot position provided by the augmented reality interactive sports device is wider than a predetermined value, the number of steps may be estimated using the distance between the two sprites and the preset movement distance per step.

Preferably, in step (3),

Using the moving distance per step and calories consumed per step, the total exercise distance and total calories consumed may be calculated.

More preferably, after step (3),

(4) may further include the step of displaying the exercise amount including the exercise time, the total exercise distance, and the total consumed calories in a graph according to the exercise date and time to provide.

Preferably, the augmented reality interactive sports device comprises:

a projector unit for projecting an image for sports content on a floor surface;

a lidar sensor unit installed toward the projection direction of the projector unit;

a motion tracking unit for tracking the user's motion by recognizing the position of the user using the lidar sensor unit; and

The sports contents are outputted through the projector unit to provide the sports contents to the user based on augmented reality, and the interaction between the sports contents and the user is controlled using the user motion tracked by the motion tracking unit, and the motion tracking It may include a control unit for measuring the amount of exercise of the user based on the number and position of the user's feet tracked by the unit.

More preferably, the lidar sensor unit,

It may include at least two or more lidar sensors spaced apart from each other so that a portion of the scanning area overlaps.

According to the individual exercise amount measurement method using the augmented reality interactive sports device proposed in the present invention, by measuring the user's exercise amount from the user's step number estimated using the signal detected by the lidar sensor unit, the bare body without wearing a separate device can measure the amount of exercise of a user who plays sports, and by using signals detected by at least two LiDAR sensors, it is possible to quickly and accurately track each user's motion and measure the amount of exercise even when multiple users are using sports content at the same time. .

1 is a diagram illustrating a flow of a method for measuring individual exercise amount using an augmented reality interactive sports device according to an embodiment of the present invention.
2 is a view showing the appearance of an augmented reality interactive sports apparatus for a method of measuring individual exercise amount using an augmented reality interactive sports apparatus according to an embodiment of the present invention.
3 is a diagram illustrating the configuration of an augmented reality interactive sports apparatus for a method of measuring individual exercise amount using an augmented reality interactive sports apparatus according to an embodiment of the present invention.
4 is a diagram illustrating a detailed flow of step S200 in a method for measuring individual exercise amount using an augmented reality interactive sports device according to an embodiment of the present invention.
5 is a diagram illustrating an algorithm for estimating the number of steps in step S220 in a method for measuring individual exercise amount using an augmented reality interactive sports device according to an embodiment of the present invention.
6 is a diagram illustrating a detailed flow of step S220 in a method for measuring individual exercise amount using an augmented reality interactive sports device according to an embodiment of the present invention.
7 is a view for explaining the estimation of the number of steps using a sprite interval in step S200 of a method for measuring individual exercise using an augmented reality interactive sports device according to an embodiment of the present invention.
8 is a diagram illustrating, for example, an exercise report screen provided in step S400 of a method for measuring individual exercise amount using an augmented reality interactive sports device according to an embodiment of the present invention.
9 is a diagram illustrating, for example, a state in which an exercise report is provided to a trainer in step S400 of a method for measuring individual exercise amount using an augmented reality interactive sports device according to an embodiment of the present invention.
10 is a diagram illustrating a structure of a single lidar sensor in a method for measuring individual exercise amount using an augmented reality interactive sports device according to an embodiment of the present invention.
11 is a diagram illustrating a dual lidar sensor structure in a method for measuring individual exercise amount using an augmented reality interactive sports device according to an embodiment of the present invention.

Hereinafter, preferred embodiments will be described in detail so that those of ordinary skill in the art can easily practice the present invention with reference to the accompanying drawings. However, in describing the preferred embodiment of the present invention in detail, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. In addition, the same reference numerals are used throughout the drawings for parts having similar functions and functions.

In addition, throughout the specification, when a part is 'connected' with another part, it is not only 'directly connected' but also 'indirectly connected' with another element interposed therebetween. include In addition, "including" a certain component means that other components may be further included, rather than excluding other components, unless otherwise stated.

1 is a diagram illustrating a flow of a method for measuring individual exercise amount using an augmented reality interactive sports apparatus according to an embodiment of the present invention. As shown in FIG. 1 , in the method for measuring individual exercise amount using an augmented reality interactive sports device according to an embodiment of the present invention, receiving a signal detected by a lidar sensor unit (S100), using the received signal The step of estimating the number of steps of the user (S200), and the step of measuring the amount of exercise using a preset reference value from the estimated number of steps (S300) may be implemented, and the amount of exercise according to the date and time of the exercise is displayed in a graph and provided It may be implemented by further including the step (S400) of doing.

2 is a view showing the appearance of an augmented reality interactive sports apparatus 100 for a method for measuring individual exercise amount using the augmented reality interactive sports apparatus 100 according to an embodiment of the present invention, and FIG. 3 is an embodiment of the present invention. It is a diagram showing the configuration of the augmented reality interactive sports apparatus 100 for a method for measuring individual exercise amount using the augmented reality interactive sports apparatus 100 according to an embodiment.

The method for measuring individual exercise amount using the augmented reality interactive sports apparatus 100 according to an embodiment of the present invention is an augmented reality interactive sports apparatus ( 100), and as shown in FIGS. 2 and 3 , the augmented reality interactive sports apparatus 100 includes a main body 110 , a projector unit 120 , a lidar sensor unit 130 , and motion. It may be configured to include a tracking unit 140 , a sensor connection unit 150 , a control unit 160 , a communication unit 170 , a display unit 180 , and a speaker unit 190 . That is, in the method of measuring individual exercise amount using the augmented reality interactive sports device 100 according to an embodiment of the present invention, the lidar sensor unit 130 laser scans a plane of a predetermined height from the ground and moves the detected signal. The tracking unit 140 and the control unit 160 receive the transmission, and the control unit 160 may be implemented by performing steps S100 to S400. Each configuration of the augmented reality interactive sports apparatus 100 will be described in detail later.

Hereinafter, each step of the individual exercise amount measurement method using the augmented reality interactive sports apparatus 100 according to an embodiment of the present invention will be described in detail with reference to FIGS. 1 to 3 . Each step may be implemented by the augmented reality interactive sports device 100 . Hereinafter, for convenience of description, a subject performing each step may be omitted.

In step S100, a signal sensed by the lidar sensor unit 130 for laser scanning a plane having a predetermined height from the ground may be received. The lidar sensor unit 130 may be configured to include at least two or more lidar sensors 130a and 130b, where the lidar sensor emits a laser pulse and reflects the light from the surrounding target object. It is a device that accurately draws the surroundings by measuring the distance to the object. More specifically, the lidar sensor unit 130 may include at least two lidar sensors 130a and 130b spaced apart from each other so that a part of the scanning area overlaps, and may accurately detect the positions of several users. The configuration and operation of the lidar sensor unit 130 will be described in detail later in the description of the augmented reality interactive sports device 100 .

On the other hand, the predetermined height at which the signal received in step S100 is sensed is about 5 cm, and may be a height at which the number and position of the feet can be detected.

In step S200, the number of steps of the user may be estimated using the received signal. That is, in step S200 , the number of steps of the user may be counted using the signal detected by the lidar sensor unit 130 .

4 is a diagram illustrating a detailed flow of step S200 in a method for measuring individual exercise amount using the augmented reality interactive sports apparatus 100 according to an embodiment of the present invention. As shown in FIG. 4 , step S200 of the method for measuring individual exercise amount using the augmented reality interactive sports apparatus 100 according to an embodiment of the present invention is to detect the number and position of the user's feet using the received signal. It may be implemented including the step (S210) and the step (S220) of estimating the number of steps of the user by tracking the detected number of feet and changes in the position of the user's feet.

In step S210, the number and position of the user's feet may be detected using the received signal. That is, the number of feet of a specific user and the location of the feet of each foot may be determined from the detection signal of the lidar sensor unit 130 . At this time, the number of feet (F) is 2 when both feet are on the ground (F=2), 1 when one foot is lifted by walking or running, etc. (F=1), and both feet are lifted while running or jumping It may be 0 (F=0) when The foot position P may extract the position value for each foot.

In step S220, it is possible to estimate the number of steps of the user by tracking changes in the detected number of feet and positions of the user's feet. More specifically, in step S220, the number of steps can be estimated by comparing the number of feet (F1) and position (P1) according to the previous laser scanning with the number of feet (F2) and position (P2) according to the current laser scanning. However, when the number of feet increases to one or two, or when the number of feet is the same but the foot position value is changed, it is recognized as one step, and the number recognized as one step can be accumulated to count the total number of steps.

5 is a diagram illustrating an algorithm for estimating the number of steps in step S220 in a method for measuring individual exercise using the augmented reality interactive sports apparatus 100 according to an embodiment of the present invention, and FIG. 6 is an embodiment of the present invention. In the method of measuring the amount of individual exercise using the augmented reality interactive sports device 100 according to the following, it is a diagram illustrating a detailed flow of step S220. As shown in FIG. 6 , step S220 of the method for measuring individual exercise amount using the augmented reality interactive sports device 100 according to an embodiment of the present invention is the number of feet according to the previous laser scanning and the number of feet according to the current laser scanning. Comparing the steps (S221), if the number of feet according to the current laser scanning is greater than the number of feet according to the previous laser scanning as a result of the comparison of steps S221, counting in one step (S222), step S221 As a result of the comparison, if the number of feet is the same, comparing the position of the foot according to the previous laser scanning with the position of the foot according to the current laser scanning (S223) S224) may be implemented.

In step S221, the number of feet according to the previous laser scanning (F1) and the number of feet according to the current laser scanning (F2) may be compared.

In step S222, if, as a result of the comparison of step S221, the number of two feet is different, and the number of feet according to the current laser scanning (F2) is greater than the number of feet (F1) according to the previous laser scanning (F1<F2), it can be counted as one step there is. As shown in Figure 5, if the number of feet according to the current laser scanning (F2) is less than or equal to the number of feet (F1) according to the next or previous laser scanning after counting in 1 step (if F1 < F2 is not), the current By using the number of feet (F2) according to laser scanning as the reference number of feet (F1), it can be applied to the next laser scanning.

In step S223 , if the number of two feet is the same as a result of the comparison in step S221 , the foot position P1 according to the previous laser scanning and the foot position P2 according to the current laser scanning may be compared.

In step S224, if the position of the two feet is different as a result of the comparison in step S223, one step may be counted. As shown in FIG. 5 , after counting in one step, the foot position P2 according to the current laser scanning may be used as the reference foot position P1 to be applied to the next laser scanning.

On the other hand, in step S200, if the distance between the two sprites representing the user's foot position provided by the augmented reality interactive sports device 100 is wider than a predetermined value, the number of steps using the distance between the two sprites and the preset movement distance per step can be estimated.

7 is a diagram for explaining the estimation of the number of steps using sprite intervals in step S200 of the method for measuring individual exercise amount using the augmented reality interactive sports apparatus 100 according to an embodiment of the present invention. As shown in FIG. 7 , the augmented reality interactive sports apparatus 100 places sprites (Sprite-A, Sprite-B) indicating the point where the user's foot is to be located according to the sports content through the projector unit 120 on the floor surface. can be displayed At this time, if the distance between Sprite-A and Sprite-B is long and the movement takes several steps, the number of steps may be estimated using the distance between the two sprites and the preset movement distance per step in step S200. In the example shown in Fig. 7, if the interval between Sprite-A and Sprite-B is 360 cm, and the preset movement distance per step is 60 cm, the movement from Sprite-A to Sprite-B is a total of 6 steps. can be estimated.

As described above, step S200 of the individual exercise amount measurement method using the augmented reality interactive sports device 100 according to an embodiment of the present invention is provided by the number of steps of the user using the lidar sensor unit 130 and sports content. By using all of the number of steps using sprites, even if tracking failure by the lidar sensor unit 130 occurs, it is possible to accurately estimate the number of steps through mutual complementation.

In step S300, the user's exercise amount may be measured using a preset reference value from the estimated number of steps. More specifically, in step S300 , the total exercise distance and the total calories consumed may be calculated using the movement distance per step and calories consumed per step. That is, the preset reference value may be a movement distance per step or calories consumed per step.

Here, the stride length of an adult is usually a value obtained by subtracting 100 cm from the height, and when the height is 160 cm, the stride length can be regarded as 60 cm. Considering the use of adolescents, the average height of the user may be regarded as 160 cm, and the movement distance per step used in step S300 may be set to 60 cm. According to an embodiment, the height of each user may be registered in advance, the average stride length may be estimated by subtracting 100 cm from the height of the corresponding user, and the estimated average stride length may be used as the movement distance per step of the user.

In addition, since the calorie consumption of an adult is usually about 350 kcal per 10,000 steps, it can be seen as 0.035 kcal per step. When playing sports content provided by the augmented reality interactive sports device 100, the user shows an exercise behavior closer to running rather than walking, so the calorie consumption per step may be preset to 0.05 kcal.

Meanwhile, the preset reference values, moving distance per step and calories consumed per step, may be set differently using information such as height, weight, and gender of individual users.

In step S400, the exercise amount including the exercise time, total exercise distance, and total calories consumed according to the exercise date and time may be displayed and provided as a graph. In this case, in step S400 , the exercise report in which the amount of exercise is displayed as a graph may be output to the display unit 180 of the augmented reality interactive sports apparatus 100 , and may be provided through a terminal of each user.

8 is a diagram illustrating, for example, an exercise report screen provided in step S400 of a method for measuring an individual exercise amount using the augmented reality interactive sports apparatus 100 according to an embodiment of the present invention. As shown in FIG. 8 , in step S400 of the individual exercise amount measurement method using the augmented reality interactive sports apparatus 100 according to an embodiment of the present invention, exercise time, exercise distance, and calories consumed (calories consumed) according to the exercise date and time. ), an exercise report displayed as a graph may be provided to the display unit 180 or a user's terminal so that the change can be easily checked.

9 is a diagram illustrating, for example, a state in which an exercise report is provided to a trainer in step S400 of a method for measuring an individual exercise amount using the augmented reality interactive sports apparatus 100 according to an embodiment of the present invention. As shown in FIG. 9 , in step S400 of the individual exercise amount measurement method using the augmented reality interactive sports apparatus 100 according to an embodiment of the present invention, the augmented reality interactive sports apparatus 100 and the trainer terminal 200 are Through communication, the trainer may check each user's exercise report through the trainer terminal 200 .

That is, the augmented reality interactive sports apparatus 100 may provide each user's exercise report to the trainer terminal 200 through the communication unit 170 . The trainer installs the application on the terminal, receives and checks the user's exercise report from the augmented reality interactive sports device 100, and recommends sports content suitable for each user or coaches exercise posture, exercise time, etc. Training data can provide

Here, the user's terminal or the trainer terminal 200 may be implemented as an electronic device. Electronic devices include smartphones, tablet personal computers (PCs), mobile phones, video phones, e-book readers, desktop PCs, laptop PCs, netbook computers, workstations, It may include at least one of a server, a personal digital assistant (PDA), a media box, a game console, an electronic dictionary, or a wearable device, and the wearable device is an accessory type (eg, a watch, a ring, a bracelet, Anklets, necklaces, eyeglasses, contact lenses, or head-mounted-devices (HMDs), integral fabrics or garments (such as electronic garments), body-mounted (such as skin pads or tattoos) , or at least one of an implantable circuit In various embodiments, the electronic device is not limited to the aforementioned devices, and may be a combination of two or more of the aforementioned devices.

Hereinafter, with reference to FIGS. 2 and 3 , each configuration of the augmented reality interactive sports apparatus 100 for a method of measuring individual exercise amount using the augmented reality interactive sports apparatus 100 according to an embodiment of the present invention will be described in detail. to do it

The main body 110 may be a frame constituting the body of the augmented reality interactive sports apparatus 100 , and may include a computer device including the control unit 160 on its inner surface. The body 110 may have a rectangular parallelepiped shape as shown in FIG. 2 , but a specific shape or shape may be variously implemented. According to an embodiment, by implementing the augmented reality interactive sports device 100 as a mobile device installed at the bottom of the main body 110 and further including at least one auxiliary wheel for movement assistance, it is possible to freely move the place as needed to perform sports You can also play content.

The projector unit 120 may project an image for sports content on the floor surface. As shown in FIG. 2 , the projector unit 120 is provided on the front side of the main body 110 , and may project an image for sports content on the floor surface. In this case, the image for the sports content may include a sprite that displays the position of the user's foot according to the progress of the sports content. In front of the main body 110, the user may be provided with sports content based on augmented reality, and the projector may be installed by adjusting the direction to project the image on the floor instead of the wall.

Also, the projector 120 may project a rectangular projection area on the floor surface. In this way, by fully utilizing the floor surface using the projector unit 120, various sports contents can be provided by utilizing a much wider projection area than when using a display device such as a monitor, mobile terminal, or TV. For example, the projected area may be 4.5m x 2.6m in size. Meanwhile, the projector unit 120 may project the image by correcting the distortion so that the shape of the projection area is not distorted into a trapezoid or a rhombic shape but is a right-angled rectangle.

The lidar sensor unit 130 may be installed toward the projection direction of the projector unit 120 . That is, in order to recognize a motion of a user using sports content in the projection area, the lidar sensor unit 130 may be disposed to cover the projection area. In this case, the lidar sensor included in the lidar sensor unit 130 may be RP Lidar A3, and the laser scanning range may be about 20 m.

In particular, the lidar sensor unit 130 may include at least two lidar sensors spaced apart from each other so that a portion of the scanning area overlaps. For example, as shown in FIG. 2 , the lidar sensor unit 130 may include two lidar sensors 130a and 130b. More specifically, the lidar sensor unit 130 receives the optical signal focused by the light transmitting module for generating and irradiating the laser, the light receiving module for focusing the optical signal scattered by the user's body, and the light receiving module It may be configured to include a light sensing module for sensing.

The motion tracking unit 140 may track the user's motion by recognizing the user's location using the lidar sensor unit 130 . That is, the user's motion can be tracked using the optical signal detected by the optical sensing module. More specifically, the motion tracking unit 140 may use the lidar sensor unit 130 to recognize the position of the user's foot at a predetermined point from the ground, and track the user's motion by tracking the change in the position of the user's foot. That is, the lidar sensor unit 130 can detect the presence (number of feet) and the position of the user's feet by laser scanning a plane at a height of about 5 cm from the ground, and the motion tracking unit 140 changes the position of the user's feet. can be tracked as user motion.

As a conventional user motion tracking method, sensing using a camera has been widely used. For example, a high-speed camera sensor, a 3D depth camera sensor, a Kinetic camera sensor, or the like may be used. The high-speed camera sensor can be used for virtual reality exercise, etc. In order to process data, continuous tracking is impossible, it must be used by one person at a fixed location, and there are limitations that require a separate object. Since the 3D depth camera sensor detects and uses a change value at a specific depth, an event must be generated at a specific depth, only a small number of 1 to 10 people can use it at the same time, and there is a limitation that a separate object is required. . The Kinect camera sensor detects the motion of a subject. Due to the camera angle of view, the sensing range is narrow, so you have to exercise in a fixed position, so the range of activity is narrow, and there is a limit that only one person can use it at a time.

The augmented reality interactive sports device 100, which can solve the problems of the prior art as described above, includes the lidar sensor unit 130 and the motion tracking unit 140, so that only the body is required without wearing a separate object or device. You can enjoy augmented reality sports, and the range of motion tracking is wide, so you can move around and exercise by using the floor surface including the projection area sufficiently. In addition, since the lidar sensor unit 130 can track the positions of 1 to 30 people at the same time, it can be applied to group sports, thereby making it fun to exercise together and helping to cultivate a sense of cooperation.

The sensor connection unit 150, one end is connected to the side surface of the lower end of the main body 110 and the other end is connected to the lidar sensor unit 130, so that the lidar sensor unit 130 is a predetermined distance from the main body 110 They can be connected so as to be spaced apart as much as possible. More specifically, as shown in FIG. 2 , the sensor connection part 150 may be connected to both sides of the body 110 in the form of a bar, and the length of the sensor connection part 150 is about 80 to 120 cm, more specifically can be 100 cm. In addition, depending on the embodiment, the sensor connection part 150 is connected to the side of the bottom of the main body 110 by a hinge structure, so that when not in use or when moving, the sensor connection part 150 can be folded and stored or moved conveniently.

Meanwhile, the lidar sensor unit 130 may include two lidar sensors 130a and 130b spaced apart from both sides of the lower end of the body 110 by a predetermined distance, in this case, the two lidar sensors 130a. , 130b) may be respectively connected to both sides of the lower end of the body 110 through the sensor connection unit 150 . In particular, in the augmented reality interactive sports apparatus 100, by tracking the user's motion using two lidar sensors 130a and 130b, it is possible to quickly and accurately track a plurality of users.

10 is a diagram illustrating a single lidar sensor structure in a method for measuring individual exercise using the augmented reality interactive sports device 100 according to an embodiment of the present invention, and FIG. 11 is an augmented reality according to an embodiment of the present invention. It is a diagram showing the structure of a dual lidar sensor in a method for measuring individual exercise amount using the real interactive sports device 100 . In the individual exercise amount measurement method using the augmented reality interactive sports apparatus 100 according to an embodiment of the present invention, the augmented reality interactive sports apparatus 100 uses a single lidar sensor as shown in FIG. 10 for user motion Tracking may be performed, but as shown in FIG. 11 , if two lidar sensors 130a and 130b are used, tracking failure due to the relative positions of users is avoided, and the positions of several users can be accurately identified without interference.

In other words, when a lidar sensor is used, a laser scanning shadow is generated, and an object located in the shade cannot be detected. In the single lidar sensor structure, if the positions of the two users do not overlap, there is no problem in tracking the motion of each user. becomes impossible

On the other hand, in the case of using two lidar sensors (dual lidar sensor structure), the laser scanning shadow area by the first lidar sensor 130a is scanned by the second lidar sensor 130b, so the interference Motion tracking of multiple users at the same time can be performed without That is, as shown in FIG. 11 , even if Player B is located in the laser scanning shadow of the first lidar sensor 130a of Player A, the motion of Player B can be tracked by the second lidar sensor 130b. there is.

Meanwhile, the lidar sensor unit 130 may be configured to include at least two or more lidar sensors installed to face each other toward the projection area of the projector unit 120 . When the space for sports content is wide and the number of users playing at the same time increases to 20 or more, as shown in FIGS. failure may occur. In the present invention, in order to prevent this, at least two or more lidar sensors may be installed to face each other.

That is, the number and arrangement of lidar sensors may be variously implemented according to the width and shape of the space. For example, two lidar sensors can be installed side-by-side or opposite to each other, with three lidar sensors placed two on one side and one on the other side of the projection area, one on the other side. It can be placed between two on the sides, or four LiDAR sensors can be placed two on one side and two on the other side so that two pairs of LiDAR sensors facing each other are placed side by side. As such, if a portion of the scanning area of each lidar sensor overlaps each other, so that the user's motion tracking can be accurately performed, the specific arrangement method may be varied.

The controller 160 outputs sports content through the projector unit 120 to provide sports content to the user based on augmented reality, but uses the user motion tracked by the motion tracking unit 140 to interact between the sports content and the user. The action is controlled, and the amount of exercise of the user can be measured based on the number and position of the user's feet tracked by the motion tracking unit 140 . That is, the controller 160 converts the user motion tracked by the motion tracking unit 140 into an input signal of the sports content so that the user and the sports content can interact, and transmits it, and measures the amount of exercise based on the user motion. there is.

The communication unit 170 may communicate with the trainer terminal 200 , receive an input signal from the trainer terminal 200 , and transmit it to the control unit 160 . In addition, the communication unit 170 may provide the user's exercise report to the trainer terminal 200 so that sports content suitable for the user is provided by the trainer's selection. According to an embodiment, the communication unit 170 may transmit the exercise report to the terminal of the corresponding user. Here, the communication unit 170 is a Wi-Fi (Wireless Fidelity) capable of Internet access, a mobile radio communication network, a satellite communication network, Bluetooth (Bluetooth), Wibro (Wireless Broadband Internet), 3G/4G/5G It may be understood that various wireless communication schemes including (3/4/5th Generation Mobile Telecommunication) and Long Term Evolution (LTE) are applied.

The display unit 180 is provided on the front of the main body 110, receives a sports content selection signal, and outputs play information related to sports content, in particular, an exercise report of the corresponding user as shown in FIG. 9 . . That is, as shown in FIGS. 2 and 9 , the display unit 180 may be located on the front side of the main body 110 , and the user can read various information and select sports contents, etc. It can be implemented as a screen.

The speaker unit 190 may output a sound related to sports content. The speaker may be installed on the front or side of the main body 110 , and the volume may be adjusted through the display unit 180 .

Meanwhile, the display unit 180 and the speaker unit 190 may output a real-time trainer image received by the communication unit 170 from the trainer terminal 200 . That is, by outputting the real-time trainer image to the display unit 180 and the speaker unit 190 , the user and the trainer can provide or receive a training service remotely without direct face-to-face contact. To this end, a camera may be provided on the front side of the body 110 to photograph a user using sports content, and the captured image may be transmitted to the trainer terminal 200 using the communication unit 170 .

As described above, according to the individual exercise amount measurement method using the augmented reality interactive sports device 100 proposed by the present invention, the number of steps of the user estimated using the signal detected by the lidar sensor unit 130 is By measuring the amount of exercise, it is possible to measure the amount of exercise of a user who engages in sports without wearing a separate device, and by using the signals detected by at least two LiDAR sensors, it is possible to quickly and accurately You can track the user's motion and measure the amount of exercise.

Meanwhile, the present invention may include a computer-readable medium including program instructions for performing operations implemented in various communication terminals. For example, the computer-readable medium includes magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD_ROM and DVD, and floppy disks. It may include magneto-optical media and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like.

Such a computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. In this case, the program instructions recorded on the computer-readable medium may be specially designed and configured to implement the present invention, or may be known and available to those skilled in the art of computer software. For example, it may include not only machine language code such as generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like.

Various modifications and applications of the present invention described above are possible by those skilled in the art to which the present invention pertains, and the scope of the technical idea according to the present invention should be defined by the following claims.

100: augmented reality interactive sports device
110: body
120: projector unit
130: lidar sensor unit
130a: first lidar sensor
130b: second lidar sensor
140: motion tracking unit
150: sensor connection
160: control unit
170: communication department
180: display unit
190: speaker unit
200: trainer terminal
S100: step of receiving a signal detected by the lidar sensor unit
S200: estimating the number of steps of the user using the received signal
S210: Step of detecting the number and position of the user's feet using the received signal
S220: A step of estimating the number of steps of the user by tracking the number of detected feet and changes in the position of the feet
S221: Comparing the number of feet according to the previous laser scanning and the number of feet according to the current laser scanning
S222: If, as a result of the comparison of step S221, the number of two feet is different and the number of feet according to the current laser scanning is greater than the number of feet according to the previous laser scanning, counting by one step
S223: Comparing the foot position according to the previous laser scanning with the foot position according to the current laser scanning if the number of two feet is the same as a result of the comparison in step S221
S224: If the position of the two feet is different as a result of the comparison of step S223, counting as one step
S300: Step of measuring the momentum using a preset reference value from the estimated number of steps
S400: A step of displaying and providing the amount of exercise according to the date and time of the exercise as a graph

Claims (8)

As a method of measuring individual exercise amount,
Implemented by the augmented reality interactive sports device 100 that tracks the user motion using a lidar sensor to control the interaction between the content and the user,
(1) receiving a signal sensed by the lidar sensor unit 130 for laser scanning a plane of a predetermined height from the ground;
(2) estimating the number of steps of the user using the received signal; and
(3) Measuring the amount of exercise of the user by using a preset reference value from the estimated number of steps, an individual exercise amount measuring method using the augmented reality interactive sports device (100), characterized in that it comprises the step of:
The method of claim 1, wherein in step (2),
(2-1) detecting the number and position of the user's feet using the received signal; and
(2-2) A method for measuring individual exercise amount using the augmented reality interactive sports device 100, characterized in that it includes the step of estimating the number of steps of the user by tracking changes in the detected number and position of the user's feet .
The method of claim 2, wherein in step (2-2),
By comparing the number and position of the feet according to the previous laser scanning with the number and position of the feet according to the current laser scanning, the number of steps is estimated,
The step (2-2) is,
(2-2-1) comparing the number of feet according to the previous laser scanning with the number of feet according to the current laser scanning;
(2-2-2) if the number of two feet is different as a result of the comparison in step (2-2-1) and the number of feet according to the current laser scanning is greater than the number of feet according to the previous laser scanning, counting by one step;
(2-2-3) if the number of two feet is the same as a result of the comparison in step (2-2-1), comparing the foot position according to the previous laser scanning with the foot position according to the current laser scanning; and
(2-2-4) If the position of the two feet is different as a result of the comparison in step (2-2-3), using the augmented reality interactive sports device 100, characterized in that it includes the step of counting in one step How to measure individual exercise volume.
The method of claim 1, wherein in step (2),
If the distance between the two sprites representing the user's foot position provided by the augmented reality interactive sports device 100 is wider than a predetermined value, estimating the number of steps using the distance between the two sprites and the preset movement distance per step A method of measuring individual exercise amount using the augmented reality interactive sports device 100, characterized in that.
The method of claim 1, wherein in step (3),
A method of measuring an individual exercise amount using the augmented reality interactive sports device 100, characterized in that the total exercise distance and the total consumed calories are calculated by using the moving distance per step and the calories consumed per step.
The method of claim 5, wherein after step (3),
(4) Individual exercise amount using the augmented reality interactive sports device 100, characterized in that it further comprises the step of displaying and providing the amount of exercise including the exercise time, the total exercise distance, and the total consumed calories in a graph according to the exercise date and time How to measure.
According to claim 1, wherein the augmented reality interactive sports device 100,
Projector unit 120 for projecting an image for sports content on the floor surface;
a lidar sensor unit 130 installed toward the projection direction of the projector unit 120;
a motion tracking unit 140 for tracking the user's motion by recognizing the location of the user using the lidar sensor unit 130; and
The sports contents are outputted through the projector unit 120 to provide the sports contents to the user based on augmented reality, but interaction between the sports contents and the user using the user motion tracked by the motion tracking unit 140 . Augmented reality interactive sports apparatus 100, characterized in that it comprises a control unit 160 for controlling the user and measuring the amount of movement of the user based on the number and foot position of the user's feet tracked by the motion tracking unit 140 A method of measuring individual exercise amount using
According to claim 7, wherein the lidar sensor unit 130,
An individual exercise amount measurement method using the augmented reality interactive sports device 100, characterized in that it includes at least two or more lidar sensors spaced apart from each other so that a part of the scanning area overlaps.

Images