WO2017217725A1

WO2017217725A1 - User recognition content providing system and operating method for same

Info

Publication number: WO2017217725A1
Application number: PCT/KR2017/006112
Authority: WO
Inventors: 권찬영
Original assignee: (주)블루클라우드
Priority date: 2016-06-13
Filing date: 2017-06-13
Publication date: 2017-12-21
Also published as: KR20170140726A; KR101860753B1

Abstract

Disclosed are a user recognition content providing system and an operating method for same. The user recognition content providing system comprises: an interface screen provision unit which projects an interface screen toward a space where a user is located; a movement recognition sensor unit which recognizes the movements of a user; and a control unit which, when the user places their foot on the interface screen, compares the interface screen and the location of the user's foot, and, if the user's knee that corresponds to the foot placed on the interface screen has been extended and then bent, generates a specific event according to the result of a comparison of the location of the foot corresponding to the user's extended and then bent knee and the interface screen.

Description

User-recognized content providing system and its operation method

The present invention relates to a user-recognized content providing system and a method of operating the same. In particular, a user recognizes a user to generate a predetermined event according to a bending motion of a knee by a projector projecting an interface screen and a motion recognition sensor recognizing a user's motion. A content providing system and an operation method thereof.

Everyone is aware of the importance of exercise in recent years as health and well-being has increased. However, due to time and space constraints, it is not easy to regularly visit a gym or gym.

In this regard, a movement system using electronic devices in which virtual space or augmented reality is implemented has recently been in the spotlight. However, these prior arts suggest a device or a method for providing a realistic experience to a user by providing content forming a virtual space, but an additional tool must be worn on the user's body to recognize the user's motion. There is a hassle, and there is a problem that does not recognize the user's motion directly and does not actively respond to the user's motion. Accordingly, there is a demand for a technology capable of operating the exercise system with simple and convenient operation while providing realistic interactive content.

An object of the present invention is to provide a user-recognized content providing system and a method of operating the same, which can generate a predetermined event according to the bending motion of the knee by the projector unit projecting the interface screen and the motion recognition sensor unit recognizes the user's motion. do.

In order to achieve the above object, the user recognition content providing system according to an embodiment of the present invention, the interface screen providing unit for projecting the interface screen toward the space where the user is located, the operation recognition to recognize the user's operation When the sensor unit and the user raises their feet on the interface screen and keeps their knees bent for the first selection time, the position of the foot corresponding to the bent knee of the user is compared with the interface screen for a predetermined event. It characterized in that it comprises a control unit for generating a.

In order to achieve the above object, the user recognition content providing system according to another embodiment of the present invention, the interface screen providing unit for projecting the interface screen toward the space in which the user is located, the operation recognition for recognizing the operation of the user When the sensor unit and the user put the foot on the interface screen, the position of the user's foot and the interface screen is compared, and the user's knee corresponding to the foot placed on the interface screen is bent and stretched. The controller may further include a controller configured to generate a predetermined event according to a result of comparing the position of the foot corresponding to the user's bent knee with the interface screen.

Preferably, the user recognition content providing system may further include a display unit configured to display the interface screen or a content screen corresponding to the predetermined event under the control of the controller.

Also preferably, the control unit may determine whether the user's knee is bent according to the position of the user's foot, knee and pelvis measured by the motion recognition sensor unit.

In order to achieve the above object, the operation method of the user-recognized content providing system according to an embodiment of the present invention, the interface screen providing unit projecting the interface screen toward the space where the user is located, the motion recognition sensor unit Recognizing the motion of the user, and when the user keeps the foot on the interface screen and bends the knee for the first selection time, the controller controls the position of the foot corresponding to the bent knee of the user. And generating a predetermined event in comparison with the screen.

In order to achieve the above object, the operation method of the user-recognized content providing system according to another embodiment of the present invention, the interface screen providing unit projecting the interface screen toward the space in which the user is located, the motion recognition sensor unit Recognizing a user's motion, when the user puts the foot on the interface screen, the control unit compares the position of the user's foot and the interface screen, and corresponding to the foot placed on the interface screen And when the user's knee is bent and stretched, the control unit generates a predetermined event according to a result of comparing the position of the foot corresponding to the user's bent and stretched knee with the interface screen.

Preferably, when the user's bent knee is not extended, when the user raises his foot on the interface screen and keeps his knees bent for the first selection time, the controller corresponds to the user's bent knee. The method may further include generating a predetermined event by comparing the position of the foot with the interface screen.

Also preferably, when the bent knee of the user is not extended, when the height of at least one of the bent knee of the user and the foot corresponding to the bent knee of the user is increased, the control unit may be the bent knee of the user. The method may further include generating a predetermined event according to a result of comparing the position of the foot corresponding to the interface screen with the position of the foot.

Also, when the bent knee of the user is not extended, when the height of at least one of the pelvis, the spine, and the shoulder of the user rises, the controller may display the position of the foot corresponding to the bent knee of the user on the interface screen. The method may further include generating a predetermined event according to the result of the comparison.

Also preferably, when the bent knee of the user is not extended, the cumulative change amount of at least one of the position of the bent knee of the user, the position of the pelvis of the user, and the position of the shoulder of the user may be measured and accumulated. When the amount of change exceeds a preset threshold, the controller may further include generating a predetermined event according to a result of comparing the position of the foot corresponding to the bent knee of the user with the interface screen.

Also preferably, when the state in which the user places the foot on the interface screen is maintained for a second selection time, the controller compares the position of the foot placed on the interface screen with the interface screen. To generate a predetermined event.

Also, preferably, the controller may include at least one of a position of the interface screen providing unit, a direction in which the interface screen providing unit projects the interface screen, a bottom surface of a space in which the interface screen is projected, and a position of the motion recognition sensor unit. In consideration of this, the position of the foot corresponding to the bent knee of the user may be compared with the interface screen.

In order to achieve the above object, the computer-readable recording medium according to an embodiment of the present invention is a computer-readable recording medium that stores a program for performing an operation method of the user recognition content providing system. It features.

The user recognition content providing system and its operation method according to an embodiment of the present invention as described above, the projector generates a predetermined event according to the bending operation of the knee by projecting the interface screen and the motion recognition sensor unit recognizes the user's motion. It can be effected.

In addition, the user recognition content providing system and its operation method according to an embodiment of the present invention as described above, a simple and effective exercise operation without the hassle of having to wear additional tools on the user's body to recognize the user's motion Through the user recognition content providing system can be operated.

In addition, the user recognition content providing system and the operation method according to an embodiment of the present invention as described above, by effectively determining the user's choice of a specific object by various combinations of the position of the user's foot and the knee bending operation, The success rate of object selection can be maximized.

1 is a view showing a user recognition content providing system according to an embodiment of the present invention.

2 is a flowchart illustrating a method of operating a user recognition content providing system according to an embodiment of the present invention.

3 is a flowchart illustrating a method of operating a system for providing a user recognition content according to another embodiment of the present invention.

4A to 4C are diagrams illustrating a use state of a system for providing user recognition content according to an embodiment of the present invention.

5 is a flowchart illustrating a method of operating a user recognition content providing system according to another exemplary embodiment of the present invention.

6 is a flowchart illustrating a method of operating a user recognition content providing system according to another embodiment of the present invention.

7 is a flowchart illustrating a method of operating a user recognition content providing system according to another embodiment of the present invention.

8 is a flowchart illustrating a method of operating a user recognition content providing system according to another embodiment of the present invention.

9 is a flowchart illustrating a method of operating a user recognition content providing system according to another embodiment of the present invention.

10 is a diagram illustrating an interface screen projected by a user recognition content providing system according to an exemplary embodiment.

DETAILED DESCRIPTION In order to fully understand the present invention, the operational advantages of the present invention, and the objects achieved by the practice of the present invention, reference should be made to the accompanying drawings which illustrate preferred embodiments of the present invention and the contents described in the drawings.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Like reference numerals in the drawings denote like elements.

1 is a view showing a user recognition content providing system according to an embodiment of the present invention. The user recognition content providing system according to the present exemplary embodiment will be described with reference to an exercise system that recognizes a user's motion, selects an exercise menu, and provides exercise content corresponding to the selected menu. Referring to FIG. 1, the user recognition content providing system 10 according to an exemplary embodiment may include a motion recognition sensor unit 200, an interface screen providing unit 300, and a display unit 400. Although not shown in FIG. 1, the user recognition content providing system 10 further includes a controller (100 of FIG. 4A) that provides an exercise program by controlling the motion recognition sensor unit 200 and the interface screen providing unit 300. can do.

The user-recognized content providing system 10 according to an embodiment of the present invention projects the interface screen of a desired exercise program on the floor through the interface screen providing unit 300, thereby providing various contents desired by the user as one content providing system. You can run an exercise program. That is, the user recognition content providing system 10 according to an embodiment of the present invention displays the interface screen of the exercise program based on the interactive content that guides the user's operation through the interface screen providing unit 300. When the user takes a certain operation, the motion recognition sensor unit 200 may detect the user's movement and transfer the same to the control unit 100. The controller 100 may recognize coordinate information of main points (hands, feet, heads, and joints) of the user detected by the motion recognition sensor unit 200 to determine whether the motion program matches the motion of the user. The controller 100 may provide a workout environment in which the user feels the same as reality by synchronizing the motion program with the user's movement.

The exercise program projected to the user's exercise space by the interface screen providing unit 300 induces human sense and cognition based on ICT (Information and Communication Technology) to expand the experience and emotion similar to the reality, Objects, people, and virtual objects can be based on immersive interactive content that interacts. The realistic interactive content includes a virtual object for inducing an action to be taken by a user according to an exercise program (for example, when the arm is bent in the buffy exercise, which is one of the whole body movements that bends and runs, the hand should touch the floor). Coordinate information) and information on the order, the interval of change of the coordinates, and the like. The coordinate information may be optimally provided to the user according to the user's age, gender, physical fitness, exercise amount, exercise program under training, and the like. The exercise program stores a sequence of a user's exercise motion, and the controller 100 may output a sequence of the exercise action of the stored program through the interface screen providing unit 300. The sequence may be stored in various forms such as a table form, a markup language in XML form, and a data structure.

The motion recognition sensor unit 200 may recognize a user's motion in the front exercise space. The motion recognition sensor unit 200 may include at least one camera, a depth camera, an infrared sensor, or a combination thereof to detect the user and the user's movement from the front. Meanwhile, a plurality of motion recognition sensors 200 may be installed around the user (front, rear, left and right) to generate a multi-view image to recognize the user's motion. That is, the motion recognition sensor unit 200 may detect the user's motion space in three-dimensional or multi-view. The motion recognition sensor unit 200 transmits the collected user, user's motion and spatial information to the control unit 100 to provide a more realistic three-dimensional motion interface optimized for the user and enable precise user's motion recognition. The camera may be a camera that captures a left image and a right image to generate a 3D image, and may be regarded as implementing a multiview using a plurality of cameras. In addition, data about the parallax of the left and right images may be extracted from the depth value of the depth camera or the 3D image, and used to convert the distance from the object. If the distance is close, the depth value is large, and if the distance is far, the depth value is used.

For example, the motion recognition sensor unit 200 transmits infrared rays to a human body within a recognition range, and then detects infrared signals reflected from the human body, thereby displaying important joint parts of the human body as a plurality of points (for example, 20 points). In this way, the movement, speed, and position of the human body can be recognized. In addition, the motion recognition sensor unit 200 may separate one person by a method such as recognizing a person at the closest distance when several people are located within a recognition range, and separately separating several people. It can also be recognized. As an example, the motion recognition sensor unit 200 may be implemented by a "Kinect" device of Microsoft Corp. capable of motion capture and voice recognition, and generated by the motion recognition sensor unit 200. The motion recognition signal is digital data for indicating the motion and position of the human body detected by the motion recognition sensor unit 200. For example, the position information and depth of a plurality of points representing the important joint parts of the detected human body ( Depth) may include information.

The interface screen providing unit 300 may project the interface screen toward the space where the user is located. As an example, the interface screen providing unit 300 may include a projector unit 310 and a reflecting unit 320. The interface screen providing unit 300 may project an enlarged image sufficiently in a place where a sufficient projection distance is not secured, such as a low ceiling, and project an image according to an exercise program at the same position even with a change in height.

The projector unit 310 may project an interface screen for executing an exercise program based on sensory interactive content to the reflector 320. The projector 310 may exchange data with the controller 100 through a wired or wireless interface of various methods such as HDMI, RGB, BNC, and Wireless HD. The projector unit 310 may project an interface screen for an exercise program based on immersive interactive content to the reflector 320 through a connection with the controller 100. The position and the projection angle of the projector 310 may be variously changed in order to adjust the size and position of the projected interface screen according to the type of exercise program. As an example, the projector 310 may be moved up, down, left and right and rotated 360 degrees through a rail or bracket.

The reflector 320 may reflect the interface screen projected from the projector 310 and reflect the bottom of the exercise space of the user. The reflector 320 may be formed of any one of a flat mirror, a convex mirror, a concave mirror, or an atypical mirror, and according to an embodiment, a bottom surface on which the interface screen is projected from the projector 310 according to the type and characteristic of the exercise program. You can adjust the size of the exercise space by adjusting the throwing distance. For example, when the reflector 320 is implemented as a planar mirror, the projection distance is twice as large as the distance between the planar mirrors in the projector 310 than when directly projected onto the bottom surface of the projector 310. Increased effect can be obtained. In addition, when the reflecting unit 320 is implemented as a convex mirror, the distance between the convex mirror and the distance according to the magnification of the convex mirror in the projector unit 310 is greater than when the projector unit 310 is directly projected onto the bottom surface. The effect of increasing the projection distance can be obtained. In addition, when the reflecting unit 320 is implemented as a concave mirror, the projection distance is shorter than when the projector unit 310 is directly projected on the bottom surface, but the image projected by the projector unit 310 concentrates the light projected in a bright place. There is an effect that can be obtained. In addition, when the reflecting unit 320 is implemented as an atypical mirror, the projection distance may be increased to secure an enlarged virtual motion space, and may be generated because the angle reflected by the mirror is not perpendicular to the floor surface. You can also correct distortion on the screen. As one example, the reflector 320 may be applied to the acrylic or plastic by applying a paint having a higher reflection coefficient than a general mirror so that distortion of the image according to the distance to be projected does not occur.

In addition, the reflector 320 may move up, down, left, and right or rotate to adjust an angle reflected back and forth or left and right. As an example, the reflector 320 may be moved up, down, left and right and rotated 360 degrees through a rail or bracket. Through this, even after installation of the user-recognized content providing system 10, the position where the interface screen of the exercise program is projected may be variously changed according to the surrounding environment to be exercised.

Meanwhile, although FIG. 1 shows that the reflecting unit 320 is formed as one reflective mirror, this is merely an example. The reflecting unit 320 includes a plurality of reflecting mirrors to display the interface screen between the reflecting mirrors. By arranging to reflect, the projection distance between the projector 310 and the bottom surface can be further extended. As an example, the projector unit 310 is installed in the lower portion of the user recognition content providing system 10, and a few reflective mirrors are zigzag in the middle, and then configured to be finally projected onto the floor surface through the reflective mirrors installed on the ceiling. Can be.

In addition, the interface screen providing unit 300 may include a plurality of projectors 310. In this case, by outputting a plurality of screens through different reflecting units 320, the image effects may be generated to overlap each other or to be adjacently output.

Meanwhile, as another embodiment, the interface screen providing unit 300 may omit the reflection unit 320 so that the interface screen projected by the projector 310 may be directly projected onto the floor.

The display 400 may display the interface screen or display a content screen corresponding to a predetermined event generated by the controller 100 under the control of the controller 100. The display unit 400 may output a result of the user's motion recognized by the motion recognition sensor unit 200, and may display information about the motion and the result of the user's exercise according to the user's position or direction change during the exercise. You can output The display unit 400 displays information including exercise amount information, user information, exercise evaluation and results, calorie information consumed, personal health information, confirmation of one's exercise contents, or a combination thereof according to the user's movement. By checking during or after the exercise, the user may provide an environment in which the user can exercise more efficiently.

The controller 100 may recognize a user detected by the motion recognition sensor unit 200, extract registered user information, and prepare an exercise program to be provided to the user. The control unit 100 uses the interface screen providing unit 300 to display an interface screen composed of virtual objects of an exercise program generated based on realistic interactive content based on user information downloaded through a wired / wireless interface unit (not shown). Can be provided to The controller 100 may recognize the user's motion through the motion recognition sensor unit 200 to recognize the user's motion in the actual exercise program according to the sequence of the exercise motion including the start and the end of the exercise program. In addition, the controller 100 may provide a more realistic three-dimensional interface screen optimized for the user environment based on three-dimensional stereoscopic information on the motion space detected by the motion recognition sensor unit 200.

The controller 100 may project the user's exercise motion and body recognition state onto the floor through the interface screen providing unit 300 so that the user can immediately know. The control unit 100 may accurately recognize a user's motion through the motion recognition sensor unit 200, and the user's motion recognized by the motion recognition sensor unit 200 with the correct reference motion provided by the corresponding exercise program. By comparing the motions in real time, if the user's motion does not match the reference motion, the corrected body image is displayed together with the posture correction message through the interface screen providing unit 300 or the display unit 400. It can lead to accurate movement. When the exercise motion screen is changed by the motion recognition of the user, the controller 100 may notify the motion recognition time by providing motion evaluation information to the user using sound effects or screen effects at the moment of motion recognition.

The controller 100 may compare the position of the foot corresponding to the bent knee of the user with the interface screen when the user raises the foot on the interface screen and maintains the bent knee for the first selection time. Can trigger an event. That is, when the motion recognition sensor unit 200 recognizes the user's motion and maintains the user's knee bent on one leg for the first selection time, the controller 100 may be placed on the user's bent knee on the interface screen. An event of a button corresponding to the position of the corresponding foot may be generated. As an example, the first selection time may be set to 2 seconds.

In another embodiment, when the user raises both feet on the interface screen and bends both knees, the control unit 100 sets the first selection time when the user raises one foot on the interface screen and bends the knee. It can be set shorter than the first selection time in the case. As an example, the first selection time in this case may be set to 1.7 seconds. In relation to the user-recognized content providing system 10 according to an embodiment of the present invention, the user may be able to define a specific button on an interface screen by bending his knee in terms such as “quick selection”. The selection time can be defined in terms such as "quick selection time".

In another embodiment, if the user's knee is bent after the user puts the foot on the interface screen, the controller 100 compares the position of the foot corresponding to the bent knee of the user with the interface screen. To generate a predetermined event.

In another embodiment, when the user puts his foot on the interface screen, the controller 100 compares the position of the foot of the user with the interface screen and corresponds to the foot placed on the interface screen. When the user's knee is bent and stretched, a predetermined event may be generated according to a result of comparing the position of the foot corresponding to the user's bent knee with the interface screen. That is, when the motion recognition sensor unit 200 recognizes the user's motion and the user bends and straightens the knee of one leg, the controller 100 corresponds to the position of the foot corresponding to the user's bent and extended knee on the interface screen. Can trigger an event of a button. This will be further described with reference to FIGS. 3 and 4A to 4C.

As an example, the control unit 100 may determine whether the user's knee is bent according to the position of the user's foot, knee, and pelvis measured by the motion recognition sensor unit 200. That is, as described above, since the motion recognition sensor unit 200 may display important joint parts of the human body as a plurality of points (for example, 20 points), the user may compare the position and angle of the foot, knee, and pelvis of the user. It can be determined whether the knee of the person is bent.

In addition, the control unit 100, the position of the interface screen providing unit 300, the direction in which the interface screen providing unit 300 projects the interface screen, the bottom surface of the space on which the interface screen is projected and the operation recognition The position of the foot corresponding to the bent knee of the user may be compared with the interface screen in consideration of at least one of the positions of the sensor unit 200. In order for the control unit 100 to accurately determine the button corresponding to the position of the foot corresponding to the user's bent knee on the interface screen, the relative position of the interface screen providing unit 300 and the motion recognition sensor unit 200 and the interface screen This is because information such as projection angle and direction should be taken into account. That is, the controller 100 synchronizes the motion recognition sensor unit 200 with the interface screen providing unit 300 to recognize the spatial coordinates of the interface screen providing unit 300 and the motion recognition sensor unit 200 projecting the interface screen. It can provide a synchronization process for.

In addition, the user recognition content providing system 10 according to an embodiment of the present invention, the posture information including the height or inclination of the user recognition content providing system 10 or a combination thereof is detected and transmitted to the controller 100. It may further include a posture detection unit (not shown). The controller 100 controls the interface screen providing unit 300 based on location information such as height and inclination from the bottom of the space to automatically correct the size, distance, and position of the image projected into the virtual exercise space. Can be. That is, the controller 100 may control the size, distance, and position of the image projected in the virtual space to be always the same even if the height or inclination of the user recognition content providing system 10 is changed.

The controller 100 may automatically adjust the exercise intensity according to the user's movement, gender, age, physical fitness, condition, and the like. The controller 100 automatically increases the response speed of the exercise program when the user operates faster and faster in response to the speed at which the user executes the exercise program. On the other hand, if the speed decreases, the controller 100 slows the response speed of the exercise program and optimizes the exercise. It can provide an interface.

On the other hand, the user-recognized content providing system 10 according to an embodiment of the present invention is connected to a remote management system (not shown) by wire or wirelessly, the age, gender, physical strength, exercise amount of each individual user, exercise program, etc. The apparatus may further include a wired / wireless interface unit (not shown) that provides a network interface to download various user information and realistic interactive content.

The remote management system may store and manage the exercise information of each individual in a database (not shown) connected to the remote management system, and provide the exercise program to the user-recognized content providing system 10 according to an embodiment of the present invention. Or an exercise program produced by the user. The user recognition content providing system 10 according to an exemplary embodiment of the present invention may download the exercise program from the remote management system based on user information and information on an exercise space, and may be stored in the controller 100. You can also use realistic interactive content-based exercise programs.

The user-recognized content providing system 10 according to an embodiment of the present invention recognizes a user in real time, and transmits and receives the user's exercise information in the remote management system by transmitting and receiving the user's information and spatial information with the remote management system. It can be managed seamlessly. The user recognition content providing system 10 according to an embodiment of the present invention and the remote management system are automatically seamlessly linked to each other to perform health care through the user's personal information and exercise information without a user's separate operation. It will be possible. The user-recognized content providing system 10 according to an embodiment of the present invention may continuously manage data such as average exercise amount, intensity, exercise period, etc. for each user to manage exercise history. Accordingly, the user can check and effectively manage athletic performance without time and space constraints.

The wired / wireless interface unit may communicate with an external device including a smart terminal, a remote controller, and a dedicated terminal through a wireless communication network including IrDA, Bluetooth, UWB and ZigBee. The wired / wireless interface may receive an exercise program from the external device, or control the operation of the interface screen providing unit 300 based on the control signal. Users can remotely adjust the size, distance and position of the image projected into the virtual exercise space by using a smart terminal such as a smart phone, a tablet PC, etc. or an external device including a remote controller or a dedicated control terminal through a wireless communication network. Can be. As described above, in case of using an external device, in addition to hardware control for adjusting the size, distance, and position of an image, software control such as changing an exercise program to be executed or increasing an exercise level in the exercise program may be possible.

In addition, the user recognition content providing system 10 according to an embodiment of the present invention may further include a power supply (not shown). The power supply unit may supply power to components such as the control unit 100, the motion recognition sensor unit 200, the interface screen providing unit 300, and the display unit 400. The power supply unit may receive power from the outside using a power cable and supply the power to the component, or may be implemented as a rechargeable internal battery to supply power to the component.

2 is a flowchart illustrating a method of operating a user recognition content providing system according to an embodiment of the present invention. The operation method 20 of the user recognition content providing system illustrated in FIG. 2 may be performed by the user recognition content providing system 10 according to an embodiment of the present invention.

Referring to FIG. 2, in the operation method 20 of a user-recognized content providing system according to an exemplary embodiment, the interface screen providing unit 300 projects an interface screen toward a user's exercise space (S21). It may include.

Next, the operation method 20 of the user recognition content providing system according to an embodiment of the present invention, the motion recognition sensor unit 200 may include a step (S22) of recognizing the operation of the user.

Next, the operation method 20 of the user-recognized content providing system according to an embodiment of the present invention, the control unit when the user keeps the foot on the interface screen and bent knees for a first selection time, Comparing the position of the foot corresponding to the bent knee of the user with the interface screen 100 may generate a predetermined event (S23).

For example, the controller 100 analyzes the position of the user's foot, knee, and pelvis measured by the motion recognition sensor unit 200 to determine an angle formed by the user's foot, knee, and pelvis at a first reference angle ( Example: 90 degrees) or less, it can be determined that the user's knee is bent. When the controller 100 recognizes that the user maintains the bent knee of one leg for the first selection time by the motion recognition sensor 200, the position of the foot corresponding to the bent knee of the user on the interface screen Can trigger an event of a button that matches

In addition, the control unit 100, when the user raises both feet on the interface screen and bends both knees, the first selection time is the first time when the user raises one foot on the interface screen and bent knees 1 It can be set shorter than the selection time.

In addition, the operation method 20 of the user-recognized content providing system according to an embodiment of the present invention, when the user bends the knee corresponding to the foot placed on the button after placing the foot on a particular button on the interface screen, A predetermined event may be generated by comparing the position of the foot corresponding to the bent knee of the user with the interface screen. That is, the controller 100 may determine whether the user's knee is bent after the user places a foot on a specific button on the interface screen. In addition, when the user bends the knee while keeping the foot on a specific button on the interface screen, the controller 100 compares the position of the foot corresponding to the bent knee of the user with the interface screen to perform a predetermined event. Can be generated.

As an example, when the user selects a button to bend his knees as the push-up button, the control unit 100 displays a screen corresponding to the push-up exercise program through the display unit 400 to allow the user to push-ups. In accordance with an embodiment, the interface screen providing unit 300 may also project a screen associated with a push-up exercise to the floor.

3 is a flowchart illustrating a method of operating a system for providing a user recognition content according to another embodiment of the present invention. The operation method 30 of the user recognition content providing system illustrated in FIG. 3 may be performed by the user recognition content providing system 10 according to an embodiment of the present invention.

Referring to FIG. 3, in operation 30 of a user-recognized content providing system according to another exemplary embodiment, the interface screen providing unit 300 projects an interface screen toward a user's exercise space (S31). It may include.

Next, the operation method 30 of the user recognition content providing system according to another embodiment of the present invention may include the step (S32) of the motion recognition sensor unit 200 to recognize the user's operation.

Next, in operation 30 of the user-recognized content providing system according to another embodiment of the present invention, when the user places a foot on the interface screen, the control unit 100 determines the position of the foot and the user's foot. Comparing the interface screen (S33) may be included.

That is, the control unit 100 may know the position of the user's foot through the motion recognition sensor unit 200, and determine which button is selected by the user on the interface screen projected by the interface screen providing unit 300. have.

Next, the operation method 30 of the user recognition content providing system according to another embodiment of the present invention, when the user's knee corresponding to the foot placed on the interface screen is bent and stretched, the control unit 100 The method may include generating a predetermined event according to a result of comparing the position of the foot corresponding to the curved knee of the user with the interface screen (S34).

For example, the controller 100 analyzes the position of the user's foot, knee, and pelvis measured by the motion recognition sensor unit 200 to determine an angle formed by the user's foot, knee, and pelvis at a first reference angle ( For example, 90 degrees) or less, it may be determined that the user's knee is bent. If the angle formed by the user's foot, knee, and pelvis is greater than or equal to a second reference angle (eg, 150 degrees), the user's knee is determined to be stretched. can do. When the user recognizes that the user's bent knee is extended by the motion recognition sensor unit 200, the controller 100 may generate an event of a button corresponding to the position of the foot corresponding to the bent knee of the user on the interface screen. .

As an example, the controller 100 may determine whether the user's knee is bent and stretched after the user places a foot on a specific button on the interface screen. In addition, when the user bends the knee while keeping the foot on a specific button on the interface screen, the controller 100 compares the position of the foot corresponding to the bent and extended knee of the user with the predetermined interface event. Can be generated.

Referring to FIG. 4A, the interface screen providing unit 300 of the user recognition content providing system 10 according to an exemplary embodiment of the present invention may project the interface screen S on the floor where the user is located. As shown in FIG. 4A, the interface screen S may include a plurality of buttons B. However, the interface screen S may be changed in various forms. According to an embodiment, there may be a preparation position where a footprint is displayed on the interface screen S, and selectable exercise program buttons may be displayed on the interface screen S when the user moves to the preparation position.

Referring to FIG. 4B, the user may select one of the buttons B on the interface screen S, put his feet up, and bend his knees. That is, the user may bend the knee while moving to the ready position by selecting any one of the front buttons (B) to put the foot. When the user puts the foot on a specific button (B) on the interface screen, the control unit 100 can detect the button (B) put the foot through the motion recognition sensor unit 200, the user bends the knee The recognition sensor unit 200 may detect it.

In the operation method 20 of the user-recognized content providing system according to an exemplary embodiment of the present invention described above with reference to FIG. 2, the user touches any one button B on the interface screen S as shown in FIG. 4B. When the raised and bent knees are maintained for the first selection time, it is determined that the button corresponding to the position of the foot corresponding to the bent knee of the user is selected and a predetermined event can be executed.

Referring to FIG. 4C, the user may extend the knee bent in FIG. 4B with one foot on the selection button to clearly indicate his agency. In the operation method 30 of the user-recognized content providing system according to another exemplary embodiment of the present invention described above with reference to FIG. 3, when the user bends the knee as shown in FIG. It is determined that the button corresponding to the position of the foot corresponding to the knee is selected, and a predetermined event can be executed.

On the other hand, according to an embodiment, the user may select two buttons with both legs or bend both knees of the legs to select two buttons. Accordingly, the user may issue a command by combining the two buttons.

5 is a flowchart illustrating a method of operating a user recognition content providing system according to another exemplary embodiment of the present invention. The operation method 40 of the user recognition content providing system illustrated in FIG. 5 may be performed by the user recognition content providing system 10 according to an embodiment of the present invention.

Referring to FIG. 5, in operation 40 of a user-recognized content providing system according to another exemplary embodiment, the interface screen providing unit 300 projects an interface screen toward a user's exercise space (S41). ), When the motion recognition sensor unit 200 recognizes the user's motion (S42) and when the user puts his foot on the interface screen, the control unit 100 determines the position of the user's foot and the interface screen. Comparing may include the step (S43). Since the steps S41, S42, and S43 are similar to the steps S31, S32, and S33 described above with reference to FIG. 3, a detailed description thereof will be omitted.

Next, the operation method 40 of the user recognition content providing system according to another embodiment of the present invention, when the user's knee corresponding to the foot placed on the interface screen is bent and stretched (S44-> YES) The control unit 100 may include generating a predetermined event according to a result of comparing the position of the foot corresponding to the user's bent knee with the interface screen (S45). Since step S45 is similar to step S34 described above with reference to FIG. 3, a detailed description thereof will be omitted.

According to another embodiment of the present invention, a method 40 for operating a user-recognized content providing system includes: when the user's bent knee is not extended (S44-> NO), the user raises a foot on the interface screen. If the bent knee is maintained for the first selection time, the controller 100 further includes generating a predetermined event by comparing the position of the foot corresponding to the bent knee of the user with the interface screen (S46). can do.

That is, if the user raises the foot on the interface screen and keeps the knees bent without extending the knee for more than the first selection time, the controller 100 selects a button corresponding to the position of the foot corresponding to the bent knee of the user. It can be determined that the predetermined event is generated.

6 is a flowchart illustrating a method of operating a user recognition content providing system according to another embodiment of the present invention. The operation method 50 of the user recognition content providing system illustrated in FIG. 6 may be performed by the user recognition content providing system 10 according to an exemplary embodiment.

Referring to FIG. 6, in operation 50 of a user-recognized content providing system according to another exemplary embodiment, the interface screen providing unit 300 projects an interface screen toward a user's exercise space (S51). ), When the motion recognition sensor unit 200 recognizes the user's motion (S52) and when the user puts his foot on the interface screen, the control unit 100 determines the position of the foot of the user and the interface screen. Comparing may include the step (S53). The steps S51, S52, and S53 are similar to the steps S31, S32, and S33 described above with reference to FIG.

Next, the operation method 50 of the user recognition content providing system according to another embodiment of the present invention, when the user's knee corresponding to the foot placed on the interface screen is bent and stretched (S54-> YES) The controller 100 may generate a predetermined event according to a result of comparing the position of the foot corresponding to the user's bent knee with the interface screen (S55). Since step S55 is similar to step S34 described above with reference to FIG. 3, a detailed description thereof will be omitted.

Operation method 50 of the user recognition content providing system according to another embodiment of the present invention, when the bent knee of the user is not extended (S54-> NO), the bent knee of the user and the bent of the user Generating a predetermined event according to a result of comparing the position of the foot corresponding to the bent knee of the user with the interface screen when the height of at least one of the feet corresponding to the true knee rises (S56) ) May be further included.

In other words, the user may be unable to detect that the user's knee is bent and stretched due to the state of the user's clothes and the surrounding environment. According to another embodiment of the present invention, step S56 of the method 50 of operating the user recognition content providing system may be performed.

When the user bends the knees and does not straighten the foot, the control unit 100 increases the height of at least one of the height of the knee joint and the height of the foot by more than a predetermined distance. As admitted, step S56 may be performed. As an example, when the height of the user's knee rises a certain distance, the controller 100 may recognize the knee as if the knee is normally extended.

7 is a flowchart illustrating a method of operating a user recognition content providing system according to another embodiment of the present invention. The operation method 60 of the user recognition content providing system illustrated in FIG. 7 may be performed by the user recognition content providing system 10 according to an embodiment of the present invention.

Referring to FIG. 7, steps S61, S62, S63, S64, and S65 included in a method 60 of operating a user-recognized content providing system according to another embodiment of the present invention are described with reference to FIG. 6. Since it is similar to the steps S53, S54 and S55, detailed description thereof will be omitted.

According to another embodiment of the present invention, the method 60 for operating a user-recognized content providing system includes at least one of the user's pelvis, spine, and shoulders when the user's bent knee is not extended (S64-> NO). If the height of the control unit 100 may further include generating a predetermined event according to a result of comparing the position of the foot corresponding to the bent knee of the user with the interface screen (S66).

In other words, the user may be unable to detect that the user's knee is bent and stretched due to the state of the user's clothes and the surrounding environment. According to another embodiment of the present invention, step S66 of the operation method 60 of the user recognition content providing system may be performed.

The control unit 100, when the user is bent knees, but the foot is not fully stretched, if the height of at least one of the user's pelvis, spine and shoulder rises more than a certain distance, even if the knee is not fully extended, the knee is normally You can perform the S66 step by admitting as unfolded. As an example, when the height of the user's pelvis and shoulders rises at the same time, the controller 100 may recognize the knees as if they were normally extended.

8 is a flowchart illustrating a method of operating a user recognition content providing system according to another embodiment of the present invention. The operation method 70 of the user recognition content providing system illustrated in FIG. 8 may be performed by the user recognition content providing system 10 according to an embodiment of the present invention.

Referring to FIG. 8, steps S71, S72, S73, S74, and S75 included in a method 70 of operating a user-recognized content providing system according to another embodiment of the present invention are described with reference to FIG. 6. Since it is similar to the steps S53, S54 and S55, detailed description thereof will be omitted.

Operation method of the user recognition content providing system according to another embodiment of the present invention (70), when the bent knee of the user is not extended (S74-> NO), the position of the bent knee of the user, the user The cumulative change amount of at least one of the position of the pelvis and the position of the shoulder of the user is measured, and if the cumulative change amount exceeds a preset threshold, the controller 100 adjusts the position of the foot corresponding to the bent knee of the user. The method may further include generating a predetermined event according to a result of comparing with the interface screen (S76).

That is, it may not be detected that the user's knee is bent and stretched due to the state of the user's clothes and the surrounding environment. At least one of the user's knee, pelvis, and shoulder may be detected while the user moves the body to select a button. When one cumulative position change amount exceeds a preset threshold, the step S76 may be performed by acknowledging that the knee is normally extended in order to compensate for the user's effort. The controller 100 may measure the cumulative position change amount by analyzing a user's motion detected by the motion recognition sensor unit 200. As an example, the cumulative position change may be measured while the user puts his foot on a specific button on the interface screen.

9 is a flowchart illustrating a method of operating a user recognition content providing system according to another embodiment of the present invention. The operation method 80 of the user recognition content providing system illustrated in FIG. 9 may be performed by the user recognition content providing system 10 according to an embodiment of the present invention. A method 80 of operating a user recognition content providing system according to another embodiment of the present invention illustrated in FIG. 9 combines the operation method of the user recognition content providing system described above with reference to FIGS. 3 and 6 to 8. will be.

Referring to FIG. 9, steps S81, S82, and S83 included in the operation method 80 of the user-recognized content providing system according to another embodiment of the present invention may be similar to the steps S51, S52, and S53 described above with reference to FIG. 6. Similar descriptions are omitted here.

According to another embodiment of the present invention, a method 80 for operating a user-recognized content providing system includes bending the user's knee corresponding to a foot placed on the interface screen (S84-> YES). The controller 100 may include generating a predetermined event according to a result of comparing the position of the foot corresponding to the bent knee of the user with the interface screen (S88).

Next, if the user's bent knee is not extended (S84-> NO), the operation method 80 of the user recognition content providing system according to another embodiment of the present invention, the user's bent knee and the When the height of at least one of the feet corresponding to the bent knee of the user rises (S85-> YES), step S88 may be performed.

Next, in the operation method 80 of the user recognition content providing system according to another embodiment of the present invention, the height of at least one of the bent knee of the user and the foot corresponding to the bent knee of the user does not increase. If not (S85-> NO), if the height of at least one of the pelvis, spine and shoulder of the user rises (S86-> YES) step S88 can be performed.

Next, the operation method 80 of the user recognition content providing system according to another embodiment of the present invention, when the height of at least one of the pelvis, spine and shoulder of the user does not rise (S86-> NO), If the cumulative change amount of at least one of the position of the bent knee of the user, the position of the pelvis of the user, and the position of the shoulder of the user is measured and the cumulative change amount exceeds a preset threshold (S87-> YES), the Step S88 may be performed. When the cumulative change amount does not exceed the preset threshold (S87-> NO), it can return to step S84 again.

A method 80 of operating a user recognition content providing system according to another embodiment of the present invention illustrated in FIG. 9 combines the operation method of the user recognition content providing system described above with reference to FIGS. 3 and 6 to 8. As such, the algorithm may be more sophisticated to not miss the user intended input.

Meanwhile, the order of the steps S85, S86, and S87 shown in FIG. 9 is exemplary and may be variously changed according to the embodiment. In addition, according to an embodiment, the steps S46 described with reference to FIG. 5 may also be combined with the steps S85, S86, and S87. Also, in steps S84, S85, S86, and S87, the result may be determined within a predetermined time set by the controller 100 in advance.

On the other hand, the operating method of the user-recognized content providing system according to the present invention, a computer that stores a program for performing the operation method of the user-recognized content providing system according to an embodiment of the present invention described above with reference to FIGS. It may be performed by a readable recording medium. In addition, the operation method of the user recognition content providing system according to the present invention is performed by a computer program stored in a medium in order to execute the operation method of the user recognition content providing system described above with reference to FIGS. 2 to 9 in combination with hardware. Can be. It is possible to implement the operation method of the user-recognized content providing system according to the present invention as computer-readable codes on a computer-readable recording medium. Computer-readable recording media include any type of recording device that stores data that can be read by a computer system. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, and floppy. Disk, optical data storage, and the like. The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.

On the other hand, the order of the steps shown in Figures 2 to 9 are exemplary and may be variously changed in a range that does not lose the effects of the present invention, specific steps may be omitted depending on the embodiment.

As illustrated in FIG. 10, the interface screen may include a ready position where a footprint is displayed, and buttons corresponding to various exercise programs may be displayed. The screen illustrated in FIG. 10 is an example, and the layout, configuration, interface, and detailed operation of the screen may be variously changed.

On the other hand, with respect to the operation method of the user-recognized content providing system according to an embodiment of the present invention described above with reference to FIGS. 2 to 9, the control unit 100, the user puts a foot on the interface screen When the released state is maintained for the second selection time, the user may generate a predetermined event by comparing the position of the foot placed on the interface screen with the interface screen. As an example, the second selection time may be set to 3 seconds and longer than the first selection time. That is, the controller 100 may determine that the corresponding button is selected even when the user keeps the foot on the specific button for more than the second selection time in addition to the operation of bending the knee when the user selects the button on the interface screen. .

In another embodiment, when the user puts two feet on a specific button on the interface screen, the control unit 100 sets the second selection time when the user puts one foot on a specific button on the interface screen. It can be set shorter than the second selection time. In connection with the user-recognized content providing system 10 according to an embodiment of the present invention, the user may keep the user's foot on a specific button on the interface screen for a second selection time to select a specific button, and “slow selection”. The second selection time may be defined in terms such as “slow selection time”.

As described above, according to various embodiments described in the present invention, the user's selection of a specific object by various combinations of the position of the user's foot, the bending motion of the knee, and the blood of the knee and the holding time in each movement are variously combined. Can effectively understand the will. Accordingly, the success rate of object selection by the user can be maximized.

As described above, the user-recognized content providing system according to an exemplary embodiment of the present invention has been described with reference to an exercise system that recognizes a user's motion, selects an exercise menu, and provides exercise content corresponding to the selected menu. . However, the present invention is not limited thereto, and the present invention can be applied to an advertisement device that selects various advertisements by displaying an interface screen in a space where the user is located, and selecting a menu displayed on the interface screen. . Also, the present invention can be applied to a rehabilitation medical device that provides various rehabilitation operations by projecting an interface screen in a space where a user is located and selecting a menu projected on an interface screen by a user who needs rehabilitation.

Various embodiments described herein can be implemented by hardware, middleware, microcode, software and / or combinations thereof. For example, various embodiments may include one or more application specific semiconductors (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs). ), Processors, controllers, microcontrollers, microprocessors, other electronic units designed to perform the functions presented herein, or a combination thereof.

Also, for example, various embodiments may be embedded in or encoded on a computer-readable medium containing instructions. Instructions embedded in or encoded on a computer-readable medium may cause a programmable processor or other processor to perform a method, for example, when the instructions are executed. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. The storage medium may be any available medium that can be accessed by a computer. For example, such computer-readable media may include RAM, ROM, EEPROM, CD-ROM, or other optical disk storage media, magnetic disk storage media or other magnetic storage devices, or instructions for accessing the desired program code by a computer or It can include any other medium that can be used to carry or store in the form of data structures.

Such hardware, software, firmware, etc. may be implemented within the same device or within separate devices to support the various operations and functions described herein. In addition, the components, units, modules, components, etc., described herein as "parts" may be implemented separately or separately as discrete but interoperable logic devices. The depiction of different features for modules, units, etc. is intended to highlight different functional embodiments and does not necessarily mean that they must be realized by individual hardware or software components. Rather, functionality associated with one or more modules or units may be performed by separate hardware or software components or integrated into common or separate hardware or software components.

Although the operations are shown in the drawings in a specific order, it should not be understood that these operations are performed in the specific order shown, or sequential order, to achieve the desired result, or that all illustrated actions need to be performed. . In some circumstances, multitasking and parallel processing may be advantageous. Moreover, the division of various components in the above-described embodiments should not be understood as requiring such division in all embodiments, and the described components are generally integrated together into a single software product or packaged into multiple software products. It should be understood that it can.

Although the present invention has been described with reference to the embodiments shown in the drawings, this is merely exemplary, and it will be understood by those skilled in the art that various modifications and equivalent other embodiments are possible. Therefore, the true technical protection scope of the present invention will be defined by the technical spirit of the appended claims.

The user recognition content providing system and its operation method according to embodiments of the present invention can be used in the industry related to the user recognition content providing system.

Claims

An interface screen providing unit projecting an interface screen toward a space where a user is located;

A motion recognition sensor unit recognizing a motion of the user; And

A control unit for generating a predetermined event by comparing the position of the foot corresponding to the bent knee of the user with the interface screen when the user raises the foot on the interface screen and keeps the knee bent for the first selection time User-recognized content providing system comprising a.
An interface screen providing unit projecting an interface screen toward a space where a user is located;

A motion recognition sensor unit recognizing a motion of the user; And

When the user puts his foot on the interface screen, the position of the user's foot is compared with the interface screen, and when the user's knee corresponding to the foot placed on the interface screen is bent and stretched, the user And a control unit for generating a predetermined event according to a result of comparing the position of the foot corresponding to the bent and extended knee of the interface screen.
The system of claim 1, wherein the user recognition content providing system comprises:

And a display unit configured to display the interface screen or a content screen corresponding to the predetermined event under the control of the controller.
The method of claim 3, wherein the control unit,

And determining whether the user's knee is bent according to the positions of the user's feet, knees, and pelvis measured by the motion recognition sensor unit.
Projecting the interface screen toward the space in which the interface screen providing unit is located;

Recognizing a motion of the user by a motion recognition sensor unit; And

When the user raises his foot on the interface screen and keeps his knees bent for the first selection time, the controller generates a predetermined event by comparing the position of the foot corresponding to the bent knee of the user with the interface screen. Operating method of the user-recognized content providing system comprising a step of making.
Projecting the interface screen toward the space in which the interface screen providing unit is located;

Recognizing a motion of the user by a motion recognition sensor unit;

When the user puts his foot on the interface screen, comparing the position of the foot of the user with the interface screen by the controller; And

When the user's knee corresponding to the foot placed on the interface screen is bent and stretched, the controller generates a predetermined event according to a result of comparing the position of the foot corresponding to the user's bent and extended knee with the interface screen. Operating method of the user-recognized content providing system comprising a step of making.
The method of claim 6,

If the user's bent knee is not extended, if the user raises his foot on the interface screen and keeps his knees bent for the first selection time, the controller controls the position of the foot corresponding to the user's bent knee. And generating a predetermined event in comparison with the interface screen.
The method of claim 6,

When the bent knee of the user is not extended, when the height of at least one of the bent knee of the user and the foot corresponding to the bent knee of the user increases, the control unit positions the foot corresponding to the bent knee of the user. And generating a predetermined event according to the result of comparing the interface screen with the interface screen.
The method of claim 6,

When the curved knee of the user is not extended, when the height of at least one of the pelvis, the spine, and the shoulder of the user increases, the controller compares the position of the foot corresponding to the curved knee of the user with the interface screen. And generating a predetermined event according to the operation of the content providing system.
The method of claim 6,

When the bent knee of the user is not extended, the cumulative change amount of at least one of the position of the bent knee of the user, the position of the pelvis of the user, and the position of the shoulder of the user is measured so that the cumulative change amount is a preset threshold. Exceeding, generating a predetermined event according to a result of comparing the position of the foot corresponding to the bent knee of the user with the interface screen; Way.
The method according to any one of claims 5 to 10, wherein the control unit,

If the user has placed the foot on the interface screen is maintained for a second selection time, the position of the foot placed on the interface screen by the user compared to the interface screen to generate a predetermined event A method of operating a user recognition content providing system.
The method according to claim 5 or 6, wherein the control unit,

And determining whether the user's knee is bent according to the positions of the user's feet, knees, and pelvis measured by the motion recognition sensor unit.
The method according to claim 5 or 6, wherein the control unit,

In consideration of at least one of a position of the interface screen providing unit, a direction in which the interface screen providing unit projects the interface screen, a bottom surface of a space in which the interface screen is projected, and a position of the motion recognition sensor unit, the user's bent knee And comparing and analyzing the position of the corresponding foot with the interface screen.
A computer-readable recording medium having stored thereon a program for performing the method of operating the user-recognized content providing system according to any one of claims 5 to 10.