WO2016204334A1 - Exercise system based on immersive interactive contents and method therefor - Google Patents

Exercise system based on immersive interactive contents and method therefor Download PDF

Info

Publication number
WO2016204334A1
WO2016204334A1 PCT/KR2015/007424 KR2015007424W WO2016204334A1 WO 2016204334 A1 WO2016204334 A1 WO 2016204334A1 KR 2015007424 W KR2015007424 W KR 2015007424W WO 2016204334 A1 WO2016204334 A1 WO 2016204334A1
Authority
WO
WIPO (PCT)
Prior art keywords
exercise
user
information
interactive content
motion
Prior art date
Application number
PCT/KR2015/007424
Other languages
French (fr)
Korean (ko)
Inventor
권찬영
정상권
권선주
Original Assignee
(주)블루클라우드
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by (주)블루클라우드 filed Critical (주)블루클라우드
Publication of WO2016204334A1 publication Critical patent/WO2016204334A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/63—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/30—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]

Definitions

  • the present invention relates to an exercise system and a method based on the sensational interactive content, and more particularly, it is similar to reality by interacting with a person and an object, a person and a virtual object by inducing a human sense and perception in an augmented virtual space.
  • Sensitive interactive content can be used as a solution to such temporal and spatial constraints.
  • the present invention provides a motion system that can feel the same as the reality by providing realistic interactive content that extends the experience and emotion similar to the real by inducing human senses and perception in the augmented virtual space based on such realistic interactive content. And how to do that.
  • Korean Patent Laid-Open No. 2013-0061538 (2013.06.11.) Relates to a virtual reality-based content providing device and a method thereof, and a user's movement in a wearable display and a training environment.
  • the present invention is characterized in that it provides a virtual reality-based content providing apparatus and method for providing realistic augmented reality content to the user based on the response.
  • Korea Patent No. 1461817 (2014.11.13.) Relates to a realistic bike simulator system, a virtual reality interlocking with a bicycle simulator including a lighting device, a wind device, a vibration device, a reverse device in conjunction with a virtual space (Virtual Reality) relates to a realistic content-based bicycle simulator system that allows a user to experience the feeling of a user riding a real bicycle outdoors indoors through content.
  • Korean Patent Application Publication No. 2013-0116886 (October 24, 2013) relates to an automated personal training method and system for monitoring a user performing an exercise and generating a virtual shadow representing the user's avatar and an appropriate form of the exercise.
  • a system, method, apparatus, and computer readable medium for determining a degree of overlap between a virtual avatar and a virtual shadow and generating a feedback score based on the degree of overlap.
  • the present invention was created to solve the above problems, causing human sensation and perception in an augmented virtual space to interact with humans and objects, humans and virtual objects to expand the experience and emotion similar to real life It is an object of the present invention to provide an exercise system and a method based on the sensory interactive content that maximizes the exercise effect by providing interactive content.
  • the present invention does not require the installation of additional sensors or the auxiliary exercise equipment on the user's body to recognize the user's motion using the sensational interactive content, and automatically recognizes the user and the user's exercise space. Therefore, the object of the present invention is to provide an exercise system and a method of exercising anytime, anywhere, regardless of time and place.
  • an object of the present invention is to provide an exercise system and a method for a user to exercise while feeling the same as the reality through the exercise program based on the realistic interactive content.
  • an exercise system based on realistic interactive content provides a user with an exercise space and a projector for guiding an operation according to an exercise program; A motion recognition sensor for detecting a user's movement in the exercise space provided by the projector; And an exercise control device controlling the projector and the motion recognition sensor to provide an exercise program.
  • the exercise control device may further include an exercise interface providing unit for providing an exercise interface for guiding a user's operation of an exercise program through a projector, an operation recognition unit for detecting a user's movement according to the guide from at least one motion recognition sensor; And a system synchronization unit for synchronizing the user's movement with the exercise interface, wherein the exercise program is a realistic interactive content that allows the user's movement and the exercise interface to feel the same.
  • an exercise interface providing unit for providing an exercise interface for guiding a user's operation of an exercise program through a projector, an operation recognition unit for detecting a user's movement according to the guide from at least one motion recognition sensor;
  • a system synchronization unit for synchronizing the user's movement with the exercise interface, wherein the exercise program is a realistic interactive content that allows the user's movement and the exercise interface to feel the same.
  • the exercise system based on the immersive interactive content is characterized in that the user interface can be adaptively accelerated or decelerated according to the movement of the user, so that the user can automatically adjust the pace according to his or her physical fitness.
  • the exercise system based on the immersive interactive content displays the exercise amount information, user information, exercise evaluation and results, calories burned information, personal health information, confirmation of one's exercise contents or a combination thereof according to the user's movement.
  • the display unit may further include a display unit which the user can check during or after the exercise.
  • the exercise system based on the immersive interactive content is characterized in that it further comprises a wired and wireless interface to manage the exercise information of each individual, or to provide or receive an exercise program through a remote management system.
  • the exercise system based on the realistic interactive content recognizes the user in real time through the wired / wireless interface unit, and seamlessly manages the user's exercise information in the remote management system by transmitting and receiving the user's information and spatial information with the remote management system. Characterized in that.
  • the exercise providing method based on the sensational interactive content provides a exercise space to the user through the projector, the projection step of guiding the operation according to the exercise program; A motion detection step of detecting a user's movement in an exercise space provided by the projector through a motion recognition sensor; And a motion control step of controlling the projector and the motion recognition sensor through a motion control device to provide a workout program.
  • the exercise control step is a motion interface providing step of providing a user interface for guiding the user's motion for the exercise program through the projector, motion recognition to detect and recognize the user's movement according to the guidance from the at least one motion recognition sensor And a system synchronization step of synchronizing the movement of the user with the exercise interface, wherein the exercise program is a realistic interactive content that allows the user's movement and the exercise interface to feel the same.
  • the method for providing an exercise system based on the sensuous interactive content is characterized in that the user interface can be automatically accelerated or decelerated according to the movement of the user so that the user can automatically adjust the pace according to his or her physical fitness. .
  • the method for providing an exercise system based on the immersive interactive contents may include exercise amount information, user information, exercise evaluation and results, calories burned information, personal health information, confirmation of one's exercise contents, or a combination thereof. It is characterized in that it further comprises a display step that the user can check during or after the exercise.
  • the method for providing an exercise system based on the sensational interactive contents may further include a wired / wireless communication step of managing individual exercise information, providing or receiving an exercise program through a remote management system.
  • the method for providing an exercise system based on the immersive interactive contents recognizes a user in real time through the wired / wireless communication step, and transmits the user's exercise information in the remote management system by transmitting and receiving the user's information and spatial information with the remote management system. It is characterized by seamless management.
  • the present invention relates to an exercise system and a method based on the sensational interactive contents, which induces human senses and perceptions in an augmented virtual space to interact with humans and objects, and humans and virtual objects to create a realistic experience and emotion.
  • realistic interactive content that expands, through this, users can feel the same as reality and provide an environment where they can exercise regardless of time and place, thereby improving health.
  • FIG. 1 is a conceptual diagram illustrating an operation of an exercise system based on sensory interactive content according to an embodiment of the present invention.
  • FIG. 2 is a block diagram of a motion control apparatus in an exercise system based on sensory interactive content according to an embodiment of the present invention.
  • FIG. 3 is a flowchart illustrating an operation process of an exercise system based on sensory interactive content according to an embodiment of the present invention.
  • FIG 4 is an exemplary view showing a sidestep exercise through an exercise system based on immersive interactive content according to an embodiment of the present invention.
  • FIG 5 is an exemplary view showing a buffy exercise through an exercise system based on sensory interactive content according to an embodiment of the present invention.
  • FIG. 1 is a conceptual diagram illustrating an operation of an exercise system based on sensory interactive content according to an embodiment of the present invention.
  • a projector 300 which provides an exercise space to a user of the exercise system 10 based on immersive interactive content, and guides an operation according to an exercise program, the user in the exercise space provided by the projector It comprises a motion recognition sensor 200 for detecting and recognizing the movement of the movement and the exercise control device 100 for controlling the projector and the motion recognition sensor to provide an exercise program.
  • the exercise system 10 based on the immersive interactive content according to the present invention can execute various exercise programs desired by a user by using one exercise system by projecting an exercise interface of a desired exercise program with a projector using the floor as an exercise space. Provide an exercise interface to help
  • the exercise system 10 based on the realistic interactive content of the present invention having these technical features supports a projector, a motion sensor, and synchronized motion thereof to implement an enhanced virtual space, and allows a user to perform the enhanced virtual space. It allows you to enjoy exercise programs based on various interactive content in the space.
  • the operation of the exercise system 10 based on the immersive interactive content displays an exercise program based on the immersive interactive content that guides the user's operation through the projector 300 in the user's exercise space, and the user moves the exercise program.
  • the motion recognition sensor 200 detects the user's movement and delivers it to the exercise control device (100).
  • the exercise control device 100 synchronizes the movement of the exercise program and the user to provide an exercise environment in which the user feels the same as reality.
  • the user can review the exercise contents in real time through the monitor 400 installed on the front, connected to the remote management system 20 by wired or wireless, user information management of the exercise system based on realistic interactive content, exercise program update, etc. You can be provided with remote management. Therefore, the motion control apparatus 100 outputs a result (image captured by a camera) of the content projected by the projector through the monitor and the user's operation by the motion recognition sensor 200. In addition, the monitor serves to output in real time the recording information on the result of the user exercise through the exercise control device (100).
  • the exercise program projected to the user's exercise space by the projector 300 induces human senses and perceptions based on ICT to expand the experience and emotion similar to the real world, and the interaction between people and objects and between people and virtual objects. Based on immersive interactive content. That is, the exercise program stores a sequence of the user's exercise motion, and the exercise control apparatus 100 outputs the sequence of the exercise operation of the stored program through the projector.
  • the sequence may be stored in various forms such as a table form, a markup language in XML form, and a data structure.
  • the stored program is interpreted by the motion control apparatus 100 and output through the projector.
  • the motion recognition sensor 200 is composed of at least one camera, a depth camera, an infrared sensor, or a combination thereof to detect the user and the user's movement from the front. Meanwhile, a plurality of motion recognition sensors may be installed around the user (front, rear, left and right) to generate a multi-view image to recognize the user's motion. That is, the user's motion space can be detected in three-dimensional or multi-view.
  • the collected user, the user's motion and spatial information is transmitted to the motion control device 100 to provide a more realistic three-dimensional motion interface optimized for the user and enables precise user's motion recognition.
  • the camera may be a camera that captures a left image and a right image to generate a 3D image, and may be regarded as implementing a multiview using a plurality of cameras.
  • data about the parallax of the left and right images may be extracted from the depth value of the depth camera or the 3D image, and used to convert the distance from the object. If the distance is close, the depth value is large, and if the distance is far, the depth value is used.
  • the realistic interactive content needs to touch a floor when a user bends an arm in a buffy exercise, which is one of the whole body movements that bends and runs, in order to induce an action to be taken by a user according to an exercise program. It contains coordinate information, order, interval of change of coordinates, and so on.
  • the coordinate information is optimized for the user according to the user's age, gender, physical fitness, exercise amount, exercise program under training, and the like.
  • the sensory interactive content composed of the virtual object including the coordinate information is projected by the projector to the user's motion space, and when the user moves according to the virtual object, the user's motion detected by the motion recognition sensor Based on the coordinate information to evaluate whether the user has taken the posture correctly.
  • the motion recognition sensor recognizes the user's main points (hands, feet, heads, joints) based on the coordinate information for rapid processing of the data and evaluates whether the motion program matches the motion of the user.
  • the monitor 400 displays the exercise amount information, the user information, the exercise evaluation and results, the calorie information consumed, the individual's health information, the user's exercise contents, or a combination thereof according to the user's movement. It can be checked later, so that the user can exercise more efficiently.
  • the remote management system 20 stores and manages each individual's exercise information in a database 30 connected to the native management system, and provides an exercise program to an exercise system based on each realistic interactive content or produced by a user. Exercise programs can be provided.
  • FIG. 2 is a block diagram of a motion control apparatus in an exercise system based on sensory interactive content according to an embodiment of the present invention.
  • the exercise control apparatus 100 includes a wired / wireless interface unit 110, an operation recognition unit 120, an exercise interface providing unit 130, a system synchronization unit 140, and a display unit 150. It is configured to include.
  • the wired / wireless interface unit 110 is wired or wirelessly connected to the remote management system 20 to download various user information and realistic interactive content such as age, gender, physical fitness, exercise amount, and exercise program of each individual user. To provide a network interface. In addition, the user can input or modify user information or upload the exercise program produced by each user to the remote management system 20. In addition, by providing a wired or wireless interface with the motion recognition sensor 200, the project 300, the monitor 400 and the like to support the interworking.
  • the exercise program based on the immersive interactive content can be produced by the user directly through the exercise system based on the immersive interactive content according to the present invention, and the exercise program thus produced is stored and distributed on a storage medium or distributed through the Internet. Can be.
  • the exercise program may be stored in a remote management system, and may be provided as an exercise system based on each individual sensory interactive content. Therefore, the remote management system can manage the exercise information of each individual, it is possible to maintain and manage the exercise program provided or received through the wired and wireless interface unit.
  • the exercise system based on realistic interactive content can recognize the user in real time, and can seamlessly manage the user's exercise information in the remote management system by transmitting and receiving the user's information and spatial information with the remote management system. Without the user's separate operation, the exercise system and the remote management system based on the sensational interactive contents can be linked automatically and seamlessly to perform health care through the user's personal information and exercise information.
  • the motion recognition unit 120 first has a function of recognizing a user sensed by the at least one motion recognition sensor 200, extracting registered user information, and preparing an exercise program to be provided to the user.
  • the user's motion is recognized to recognize the motion of the user's actual exercise program according to the sequence of the exercise motion including the start and the end of the exercise program.
  • the user and the user's movement are detected from the front through the information input from the motion recognition sensor 200 composed of at least one camera, depth camera, infrared sensor, or a combination thereof.
  • the user's motion may be recognized through a multi-view image input from the plurality of motion recognition sensors installed around the user (front, rear, left and right). In other words, it performs a function of detecting the user's motion space in three-dimensional or multi-view.
  • the motion recognition unit 120 performs precise user motion recognition through the collected user, user's motion and spatial information.
  • the distance from the object is converted using parallax of the left and right images or the depth value, which uses the principle that the depth value is large when the distance is close and the depth value is small when the distance is far.
  • the immersive interactive content includes a virtual object for inducing an action to be taken by a user according to an exercise program (for example, when bending an arm in a buffy exercise, which is one of the whole body movements by bending the arm). It contains coordinate information, order, and interval of change of coordinates.
  • the coordinate information is optimized for the user according to the user's age, gender, physical fitness, exercise amount, exercise program under training, and the like.
  • the sensory interactive content composed of virtual objects including the coordinate information is projected by the projector to the user's motion space, and when the user moves according to the virtual object, the motion recognition unit 120 recognizes the motion. Based on the user's motion detected by the sensor, the user's posture is correctly evaluated according to the coordinate information.
  • the motion recognition unit 120 recognizes the user's main points (hands, feet, head, joints) based on the coordinate information for rapid processing of the data and evaluates whether the motion program and the user's motion match.
  • the exercise interface providing unit 130 provides an exercise interface composed of virtual objects of an exercise program generated based on realistic interactive content based on user information downloaded through the wired / wireless interface unit 110.
  • the exercise interface providing unit 130 provides a more realistic three-dimensional exercise interface optimized for the user environment based on the three-dimensional stereoscopic information about the user's exercise space sensed by the motion recognition sensor 200.
  • the exercise interface providing unit 130 provides an interface for interacting with the user according to the sequence of the exercise program through the projector to induce the user's operation, and also includes the start and end of the exercise program according to the user's operation. It is responsible for accepting user actions.
  • the system synchronization unit 140 synchronizes the motion recognition sensor 200 with the projector 300 to provide a synchronization process for recognizing the spatial coordinates of the projector and the motion recognition sensor that projects the motion interface, and the user during the exercise. The movement according to the position or direction change of the interworking with the motion interface to operate.
  • system synchronization unit 140 may be configured to adaptively accelerate or decelerate the motion interface according to the user's movement, to set the pace of the exercise interface according to the gender or age of the user, and also to the user's physical fitness and physical condition. Therefore, the pace of the exercise interface can be automatically adjusted and adjusted.
  • the response of the exercise interface is automatically accelerated.
  • the response speed of the exercise interface is slowed down to provide the user with an optimized exercise interface. .
  • the display unit 150 monitors information including exercise amount information, user information, exercise evaluation and results, calories burned information, personal health information, confirmation of one's exercise contents, or a combination thereof according to user's movement. ) So that the user can check during or after the exercise to provide an environment in which the user can exercise more efficiently.
  • FIG. 3 is a flowchart illustrating an operation process of an exercise system based on sensory interactive content according to an embodiment of the present invention.
  • the motion recognition sensor 200 recognizes a user based on image data of the user and extracts user information (S110).
  • the user information may allow the system to recognize the user by inputting the tag information or ID of the individual.
  • the face pattern recognition technology can be used to recognize the user based on the image taken by the camera provided in the motion recognition sensor, and the user can simply recognize the user through the barcode, RFID, etc. that the user wears or carries. It is possible.
  • the user extracts information on the exercise space to be exercised (S120).
  • the exercise program to be provided to the user based on the user information and the information on the exercise space extracted in the step S110 and step S120 is downloaded from the remote management system 20 through the wired / wireless interface unit 110 or a self-executing interface is made.
  • an exercise interface based on the sensuous interactive content optimized for the user and the user's exercise space is projected on the floor or the wall of the user's exercise space by the projector 300 (S140).
  • the exercise program is detected by detecting the user's movement recognized as the start of the exercise through the exercise interface loaded by the projector (S150).
  • the user's motion is recognized in real time by at least one motion recognition sensor installed in front, rear, left and right of the user (S160).
  • step S140 the operation interface provided in step S140 and the user's motion recognized in step S160 are synchronized (S170).
  • step S170 On the basis of the information synchronized in step S170 it is determined whether the movement speed of the user and the moving (play) speed of the virtual object of the exercise interface (S180). This is because the physical strength is different for each user, and even the same user needs to adjust the intensity and speed of the exercise according to the user's condition. Therefore, the present invention is characterized in that the motion interface is adaptively accelerated or decelerated according to the user's movement, and the pace can be automatically adjusted according to the user's physical fitness.
  • the speed of the movement interface is adjusted adaptively to the user's pace (S190).
  • the user's movement speed and the speed of the movement interface are appropriate, the user exercises according to the virtual object of the exercise interface, and the user's exercise accuracy is evaluated according to the exercise program. It is fed back so that it can be accurately retried (S200).
  • the method for providing an exercise system based on the sensuous interactive contents includes providing an exercise interface for guiding a user's operation of an exercise program through a projector (S110 to S140), at least one or more motion recognition Motion recognition step (S150 ⁇ S160) for detecting the user's movement according to the guidance from the sensor, and the system synchronization step (S170) for synchronizing the user's movement with the exercise interface, the exercise program is a user's movement It is a realistic interactive content that makes the and the sports interface feel the same.
  • the exercise interface is adaptively accelerated or decelerated according to the user's movement, so that the user can automatically adjust the pace according to his or her physical fitness, and the exercise amount information, user information, exercise evaluation and
  • the display apparatus further includes a display step (not shown) that the user can check during or after the exercise by displaying the calorie information consumed, the health information of the individual, checking his / her exercise contents or a combination thereof.
  • the method further includes a wired / wireless communication step (not shown) for managing the exercise information of each individual through the remote management system, or providing or receiving an exercise program.
  • the present invention recognizes the user in real time, and transmits and receives the user's information and spatial information with the remote management system to enable seamless management of the user's exercise information in the remote management system.
  • FIG 4 is an exemplary view showing a sidestep exercise through an exercise system based on immersive interactive content according to an embodiment of the present invention.
  • the sidestep is an exercise derived from a method of climbing a slope by skiing, and is based on realistic interactive content that mimics the sidestep of a ski that must continuously climb up as the person walks up across the slope as illustrated in FIG. 4.
  • the user's step is displayed as a virtual object on the floor of the exercise space by the projector, and the user follows a realistic side-step exercise by following it.
  • the user's exercise screen is displayed on the monitor installed in front of the user to check the accuracy of the movement in real time to exercise.
  • the exercise program starts. From this time, the user performs the exercise according to the corresponding exercise sequence provided by the exercise program. The result of the exercise is displayed on the monitor so that the user can directly check how much accurate step the user has stepped on, so that the result can be displayed on the screen.
  • FIG 5 is an exemplary view showing a buffy exercise through an exercise system based on sensory interactive content according to an embodiment of the present invention.
  • Buffy exercise is one of the whole body exercises to bend and run arms is one of the fast and very effective fitness and diet exercise.
  • a virtual object is displayed on the floor by the projector based on the sensuous interactive content including buffy motion to fit the width at which the user should bend the arm, and the user follows the whole body motion accordingly. Will be done.
  • the exercise speed can be increased by flexibly adjusting the speed at which the user should bend the arm according to the user's physical fitness according to the user's gender, age, physical fitness, and physical condition.
  • the exercise information may be output to the floor through the projector.
  • the present invention relates to an exercise system and a method based on the sensuous interactive contents, which induces human senses and perceptions in an augmented virtual space, whereby a person interacts with an object and a person with a virtual object.
  • a person interacts with an object and a person with a virtual object.

Abstract

The present invention relates to an exercise system based on immersive interactive contents and a method therefor and, more particularly, to providing an exercise system and a method therefor, wherein human senses and recognitions are induced in an augmented virtual space, and interaction between a human and a thing or between a human and a virtual object is enabled, thereby providing immersive interactive contents that expand sensitivity and experiences, which are similar to reality, such that the user has the same feeling as in the real world.

Description

실감형 인터랙티브 콘텐츠에 기반한 운동시스템 및 그 방법An exercise system based on immersive interactive content and its method
본 발명은 실감형 인터랙티브 콘텐츠에 기반한 운동시스템 및 그 방법에 관한 것으로, 더 상세하게는 증강된 가상공간에서 인간의 감각과 인지를 유발하여 사람과 사물, 사람과 가상의 오브젝트가 인터랙션함으로써 실제와 유사한 경험 및 감성을 확장하는 실감형 인터랙티브 콘텐츠를 제공하여, 사용자가 현실과 동질감을 느끼며 운동할 수 있는 운동시스템과 이를 이용한 운동 제공 방법을 제시하고자 한다.The present invention relates to an exercise system and a method based on the sensational interactive content, and more particularly, it is similar to reality by interacting with a person and an object, a person and a virtual object by inducing a human sense and perception in an augmented virtual space. By providing realistic interactive content that extends experience and emotion, we will present an exercise system that enables users to exercise while feeling the same as reality and a method of providing exercise using the same.
오늘날 성인병이 과거 어느 때보다 더 증가하고 있다. 성인병을 예방하기 위해서는 규칙적인 운동은 매우 중요하다. 하지만 대부분의 사람들이 신체 단련의 중요성을 알고 있지만 시간과 공간적인 제약 때문에 규칙적으로 체육관이나 헬스클럽을 찾아 운동을 하기는 쉽지 않다. 이러한 시간적, 공간적 제약의 해결방안으로 실감형 인터랙티브 콘텐츠가 활용될 수 있다.Today, adult illness is increasing more than ever before. Regular exercise is very important to prevent adult diseases. However, most people know the importance of fitness, but due to time and space constraints it is not easy to regularly visit a gym or gym. Sensitive interactive content can be used as a solution to such temporal and spatial constraints.
먼저 실감형 콘텐츠는 ICT(Information and Communication Technology)를 기반으로 인간의 감각과 인지를 유발하여 실제와 유사한 경험 및 감성을 확장하기 위해서, 스포츠, 오락, 문화, 방송, 교육, 의료 등 다양한 분야에서 보고, 듣고, 만지고, 공감하는 체험형 콘텐츠이다. 특히, 사람과 사물, 사람과 가상의 오브젝트가 인터랙션하는 콘텐츠를 ‘실감형 인터랙티브 콘텐츠’라고 한다.First, realistic content is reported in various fields, such as sports, entertainment, culture, broadcasting, education, and medical, in order to induce human senses and perceptions based on ICT (Information and Communication Technology) to expand the experience and emotions that are similar to the real world. Experienced content that listens, touches, and empathizes. In particular, the content that a person interacts with, a person, and a virtual object is called "realistic interactive content."
따라서 본 발명은 이러한 실감형 인터랙티브 콘텐츠에 기반하여 증강된 가상공간에서 인간의 감각과 인지를 유발하여 실제와 유사한 경험 및 감성을 확장하는 실감형 인터랙티브 콘텐츠를 제공하여 현실과 동질감을 느낄 수 있는 운동시스템과 그 방법을 제안하고자 한다.Accordingly, the present invention provides a motion system that can feel the same as the reality by providing realistic interactive content that extends the experience and emotion similar to the real by inducing human senses and perception in the augmented virtual space based on such realistic interactive content. And how to do that.
이러한 기술적 내용과 관련한 기존의 선행기술문헌으로, 한국공개특허 제2013-0061538호(2013.06.11.)는 가상현실 기반 콘텐츠 제공장치 및 그 방법에 관한 것으로, 착용형 디스플레이와 트레이닝 환경에서의 사용자 움직임에 대한 반응에 기반하여 사용자에게 현실감 있는 증강현실 콘텐츠를 제공하기 위한 가상현실 기반 콘텐츠 제공장치 및 그 방법을 제공 하는 것을 특징으로 하는 발명이다.As an existing prior art document related to the technical content, Korean Patent Laid-Open No. 2013-0061538 (2013.06.11.) Relates to a virtual reality-based content providing device and a method thereof, and a user's movement in a wearable display and a training environment. The present invention is characterized in that it provides a virtual reality-based content providing apparatus and method for providing realistic augmented reality content to the user based on the response.
또한, 한국등록특허 제1461817호(2014.11.13.)는 실감형 자전거 시뮬레이터 시스템에 관한 것으로, 조명장치, 바람장치, 진동장치, 가상공간과 연동하는 역감장치를 포함하는 자전거 시뮬레이터와 연동하는 가상현실(Virtual Reality) 콘텐츠를 통해 사용자가 실제 자전거를 실외에서 주행할 때의 느낌을 실내에서 체감할 수 있는 실감형 콘텐츠 기반 자전거 시뮬레이터 시스템에 관한 것이다.In addition, Korea Patent No. 1461817 (2014.11.13.) Relates to a realistic bike simulator system, a virtual reality interlocking with a bicycle simulator including a lighting device, a wind device, a vibration device, a reverse device in conjunction with a virtual space (Virtual Reality) relates to a realistic content-based bicycle simulator system that allows a user to experience the feeling of a user riding a real bicycle outdoors indoors through content.
또한 한국공개특허 제2013-0116886호(2013.10.24.)는 자동화된 개인 훈련 방법 및 시스템에 관한 것으로, 운동을 수행하는 사용자를 모니터링하고 사용자의 아바타와 운동의 적절한 폼을 나타내는 가상 그림자를 생성하도록 된 시스템, 방법, 장치 및 컴퓨터 판독 가능 매체로 구성되며 가상 아바타와 가상 그림자 간의 중첩도를 판정하고 중첩도를 기초로 피드백 스코어를 생성하도록 하는 것을 특징으로 하는 발명이다.In addition, Korean Patent Application Publication No. 2013-0116886 (October 24, 2013) relates to an automated personal training method and system for monitoring a user performing an exercise and generating a virtual shadow representing the user's avatar and an appropriate form of the exercise. And a system, method, apparatus, and computer readable medium for determining a degree of overlap between a virtual avatar and a virtual shadow and generating a feedback score based on the degree of overlap.
상기 선행기술문헌들은 비록 가상공간을 형성하는 콘텐츠를 제공하여 사용자에게 현실감 있는 체험을 할 수 있도록 하는 장치나 방법에 대해서 제시하고 있으나, 사용자의 동작을 인식하기 위해 사용자의 몸에 추가적인 도구를 착용해야하는 번거로움과 바이크와 같은 보조 운동기구가 필요하고, 사용자와 사용자의 운동 공간을 고려한 운동프로그램에 대한 제시나 시사가 없고, 사용자의 동작을 직접 인식하지 못하여 사용자의 동작에 능동적으로 대응하지 못하는 문제점이 있다.Although the prior art documents suggest a device or a method for providing a content that forms a virtual space to provide a realistic experience to a user, an additional tool must be worn on the user's body to recognize the user's motion. There is a need for auxiliary exercise equipment such as hassle and bike, and there is no suggestion or suggestion about exercise program considering the user and the user's exercise space, and it is not able to recognize the user's motion directly and actively respond to the user's motion. have.
본 발명은 상기와 같은 문제점을 해결하기 위해 창작 된 것으로서, 증강된 가상공간에 인간의 감각과 인지를 유발하여 사람과 사물, 사람과 가상의 오브젝트가 인터랙션 함으로써 실제와 유사한 경험 및 감성을 확장하는 실감형 인터랙티브 콘텐츠를 제공하여, 운동효과를 극대화하는 실감형 인터랙티브 콘텐츠에 기반한 운동시스템 및 그 방법을 제공하는 것을 목적으로 한다.The present invention was created to solve the above problems, causing human sensation and perception in an augmented virtual space to interact with humans and objects, humans and virtual objects to expand the experience and emotion similar to real life It is an object of the present invention to provide an exercise system and a method based on the sensory interactive content that maximizes the exercise effect by providing interactive content.
또한 본 발명은 상기 실감형 인터랙티브 콘텐츠를 이용하여 사용자의 동작을 인식하기 위해 별도로 사용자의 신체에 추가적인 센서의 설치나 보조 운동기구를 조작할 필요가 없이, 순전히 사용자와 사용자의 운동공간을 자동으로 인식하여 시간과 장소에 구애됨이 없이 언제 어디서나 운동할 수 있는 운동시스템 및 그 방법을 제공하는 것을 목적으로 한다.In addition, the present invention does not require the installation of additional sensors or the auxiliary exercise equipment on the user's body to recognize the user's motion using the sensational interactive content, and automatically recognizes the user and the user's exercise space. Therefore, the object of the present invention is to provide an exercise system and a method of exercising anytime, anywhere, regardless of time and place.
또한 본 발명은 상기 실감형 인터랙티브 콘텐츠에 기반한 운동프로그램을 통해서, 사용자가 현실과 동질감을 느끼며 운동할 수 있는 운동시스템과 그 방법을 제공하는 것을 목적으로 한다.In addition, an object of the present invention is to provide an exercise system and a method for a user to exercise while feeling the same as the reality through the exercise program based on the realistic interactive content.
이와 같은 목적을 달성하기 위해 본 발명의 일 실시예에 따른 실감형 인터랙티브 콘텐츠에 기반한 운동시스템은 사용자에게 운동공간을 제공하고, 운동프로그램에 따른 동작을 안내하는 프로젝터; 상기 프로젝터가 제공한 운동공간에서 사용자의 움직임을 감지하기 위한 동작인식센서; 및 상기 프로젝터와 상기 동작인식센서를 제어하여 운동프로그램을 제공하는 운동제어장치;를 포함하는 것을 특징으로 한다.In order to achieve the above object, an exercise system based on realistic interactive content according to an embodiment of the present invention provides a user with an exercise space and a projector for guiding an operation according to an exercise program; A motion recognition sensor for detecting a user's movement in the exercise space provided by the projector; And an exercise control device controlling the projector and the motion recognition sensor to provide an exercise program.
또한 상기 운동제어장치는 프로젝터를 통해서 운동프로그램에 대한 사용자의 동작을 안내하는 운동인터페이스를 제공하는 운동인터페이스제공부, 적어도 하나 이상의 동작인식센서로부터 상기 안내에 따른 사용자의 움직임을 감지하는 동작인식부, 상기 사용자의 움직임을 상기 운동인터페이스와 동기화하는 시스템동기화부;를 포함하며, 상기 운동프로그램은 사용자의 움직임과 운동인터페이스가 상호 동질감을 느끼도록 하는 실감형 인터랙티브 콘텐츠인 것을 특징으로 한다.The exercise control device may further include an exercise interface providing unit for providing an exercise interface for guiding a user's operation of an exercise program through a projector, an operation recognition unit for detecting a user's movement according to the guide from at least one motion recognition sensor; And a system synchronization unit for synchronizing the user's movement with the exercise interface, wherein the exercise program is a realistic interactive content that allows the user's movement and the exercise interface to feel the same.
또한 상기 실감형 인터랙티브 콘텐츠에 기반한 운동시스템은 상기 사용자의 움직임에 따라 운동인터페이스가 적응적으로 가속 혹은 감속되도록 하여, 사용자로 하여금 자신의 체력에 따라 페이스를 자동적으로 조절할 수 있는 것을 특징으로 한다.In addition, the exercise system based on the immersive interactive content is characterized in that the user interface can be adaptively accelerated or decelerated according to the movement of the user, so that the user can automatically adjust the pace according to his or her physical fitness.
또한 상기 실감형 인터랙티브 콘텐츠에 기반한 운동시스템은 상기 사용자의 움직임에 따른 운동량 정보, 사용자 정보, 운동 평가 및 결과, 소모된 칼로리 정보, 개인의 헬스 정보, 자신의 운동내용 확인 또는 이들의 조합을 표시하여 사용자가 운동도중이나 운동후에 확인할 수 있는 디스플레이부를 더 포함하는 것을 특징으로 한다.In addition, the exercise system based on the immersive interactive content displays the exercise amount information, user information, exercise evaluation and results, calories burned information, personal health information, confirmation of one's exercise contents or a combination thereof according to the user's movement. The display unit may further include a display unit which the user can check during or after the exercise.
또한 상기 실감형 인터랙티브 콘텐츠에 기반한 운동시스템은 원격관리시스템을 통해서 각 개인의 운동정보를 관리하거나, 운동프로그램을 제공하거나 제공받을 수 있도록 하는 유무선인터페이스부를 더 포함하는 것을 특징으로 한다.In addition, the exercise system based on the immersive interactive content is characterized in that it further comprises a wired and wireless interface to manage the exercise information of each individual, or to provide or receive an exercise program through a remote management system.
또한 상기 실감형 인터랙티브 콘텐츠에 기반한 운동시스템은 상기 유무선인터페이부를 통해 실시간으로 사용자를 인식하고, 해당 사용자의 정보와 공간정보를 상기 원격관리시스템과 송수신하여 사용자의 운동정보를 원격관리시스템에서 심리스하게 관리하는 것을 특징으로 한다.In addition, the exercise system based on the realistic interactive content recognizes the user in real time through the wired / wireless interface unit, and seamlessly manages the user's exercise information in the remote management system by transmitting and receiving the user's information and spatial information with the remote management system. Characterized in that.
아울러 본 발명의 또 다른 일 실시예에 따른 실감형 인터랙티브 콘텐츠에 기반한 운동 제공 방법은 프로젝터를 통해서 사용자에게 운동공간을 제공하고, 운동프로그램에 따른 동작을 안내하는 프로젝션 단계; 동작인식센서를 통해서 상기 프로젝터가 제공한 운동공간에서 사용자의 움직임을 감지하는 동작감지 단계; 및 운동제어장치를 통해서 상기 프로젝터와 상기 동작인식센서를 제어하여 운동프로그램을 제공하는 운동제어 단계;를 포함하는 것을 특징으로 한다.In addition, the exercise providing method based on the sensational interactive content according to another embodiment of the present invention provides a exercise space to the user through the projector, the projection step of guiding the operation according to the exercise program; A motion detection step of detecting a user's movement in an exercise space provided by the projector through a motion recognition sensor; And a motion control step of controlling the projector and the motion recognition sensor through a motion control device to provide a workout program.
또한 상기 운동제어 단계는 프로젝터를 통해서 운동프로그램에 대한 사용자의 동작을 안내하는 운동인터페이스를 제공하는 운동인터페이스제공 단계, 적어도 하나 이상의 동작인식센서로부터 상기 안내에 따른 사용자의 움직임을 감지하여 인식하는 동작인식 단계 및 상기 사용자의 움직임을 상기 운동인터페이스와 동기화하는 시스템동기화 단계를 포함하며, 상기 운동프로그램은 사용자의 움직임과 운동인터페이스가 상호 동질감을 느끼도록 하는 실감형 인터랙티브 콘텐츠인 것을 특징으로 한다.In addition, the exercise control step is a motion interface providing step of providing a user interface for guiding the user's motion for the exercise program through the projector, motion recognition to detect and recognize the user's movement according to the guidance from the at least one motion recognition sensor And a system synchronization step of synchronizing the movement of the user with the exercise interface, wherein the exercise program is a realistic interactive content that allows the user's movement and the exercise interface to feel the same.
또한 상기 실감형 인터랙티브 콘텐츠에 기반한 운동시스템 제공 방법은 상기 사용자의 움직임에 따라 운동인터페이스가 적응적으로 가속 혹은 감속되도록 하여, 사용자로 하여금 자신의 체력에 따라 페이스를 자동적으로 조절할 수 있는 것을 특징으로 한다.In addition, the method for providing an exercise system based on the sensuous interactive content is characterized in that the user interface can be automatically accelerated or decelerated according to the movement of the user so that the user can automatically adjust the pace according to his or her physical fitness. .
또한 상기 실감형 인터랙티브 콘텐츠에 기반한 운동시스템 제공 방법은 상기 사용자의 움직임에 따른 운동량 정보, 사용자 정보, 운동 평가 및 결과, 소모된 칼로리 정보, 개인의 헬스 정보, 자신의 운동내용 확인 또는 이들의 조합을 표시하여 사용자가 운동도중이나 운동후에 확인할 수 있는 디스플레이단계를 더 포함하는 것을 특징으로 한다.In addition, the method for providing an exercise system based on the immersive interactive contents may include exercise amount information, user information, exercise evaluation and results, calories burned information, personal health information, confirmation of one's exercise contents, or a combination thereof. It is characterized in that it further comprises a display step that the user can check during or after the exercise.
또한 상기 실감형 인터랙티브 콘텐츠에 기반한 운동시스템 제공 방법은 원격관리시스템을 통해서 각 개인의 운동정보를 관리하거나, 운동프로그램을 제공하거나 제공받을 수 있도록 하는 유무선통신 단계를 더 포함하는 것을 특징으로 한다.In addition, the method for providing an exercise system based on the sensational interactive contents may further include a wired / wireless communication step of managing individual exercise information, providing or receiving an exercise program through a remote management system.
또한 상기 실감형 인터랙티브 콘텐츠에 기반한 운동시스템 제공 방법은 상기 유무선통신 단계를 통해 실시간으로 사용자를 인식하고, 해당 사용자의 정보와 공간정보를 상기 원격관리시스템과 송수신하여 사용자의 운동정보를 원격관리시스템에서 심리스하게 관리하는 것을 특징으로 한다.In addition, the method for providing an exercise system based on the immersive interactive contents recognizes a user in real time through the wired / wireless communication step, and transmits the user's exercise information in the remote management system by transmitting and receiving the user's information and spatial information with the remote management system. It is characterized by seamless management.
본 발명은 실감형 인터랙티브 콘텐츠에 기반한 운동시스템 및 그 방법에 관한 것으로, 증강된 가상공간에 인간의 감각과 인지를 유발하여 사람과 사물, 사람과 가상의 오브젝트가 인터랙션함으로써 실제와 유사한 경험 및 감성을 확장하는 실감형 인터랙티브 콘텐츠를 제공하고, 이를 통해서 사용자가 현실과 동질감을 느끼며 시간과 장소에 구애 받지 않고 운동할 수 있는 환경을 제공함으로써, 건강을 증진시키는 효과가 있다.The present invention relates to an exercise system and a method based on the sensational interactive contents, which induces human senses and perceptions in an augmented virtual space to interact with humans and objects, and humans and virtual objects to create a realistic experience and emotion. By providing realistic interactive content that expands, through this, users can feel the same as reality and provide an environment where they can exercise regardless of time and place, thereby improving health.
도 1은 본 발명의 일 실시예에 따른 실감형 인터랙티브 콘텐츠에 기반한 운동시스템의 동작을 설명하기 위한 개념도이다.1 is a conceptual diagram illustrating an operation of an exercise system based on sensory interactive content according to an embodiment of the present invention.
도 2는 본 발명의 일 실시예에 따른 실감형 인터랙티브 콘텐츠에 기반한 운동시스템에서 운동제어장치의 블록도이다.2 is a block diagram of a motion control apparatus in an exercise system based on sensory interactive content according to an embodiment of the present invention.
도 3은 본 발명의 일 실시예에 따른 실감형 인터랙티브 콘텐츠에 기반한 운동시스템의 동작 과정을 나타내는 흐름도이다.3 is a flowchart illustrating an operation process of an exercise system based on sensory interactive content according to an embodiment of the present invention.
도 4는 본 발명의 일 실시예에 따른 실감형 인터랙티브 콘텐츠에 기반한 운동시스템을 통한 사이드스텝 운동을 보여주는 예시도이다.4 is an exemplary view showing a sidestep exercise through an exercise system based on immersive interactive content according to an embodiment of the present invention.
도 5는 본 발명의 일 실시예에 따른 실감형 인터랙티브 콘텐츠에 기반한 운동시스템을 통한 버피운동을 보여주는 예시도이다.5 is an exemplary view showing a buffy exercise through an exercise system based on sensory interactive content according to an embodiment of the present invention.
이하, 첨부한 도면을 참조하여 본 발명의 바람직한 실시 예를 설명함으로써, 본 발명을 상세히 설명한다. 각 도면에 제시된 동일한 참조부호는 동일한 부재를 나타낸다. 또한 본 발명의 실시 예들에 대해서 특정한 구조적 내지 기능적 설명들은 단지 본 발명에 따른 실시 예를 설명하기 위한 목적으로 예시된 것으로, 다르게 정의되지 않는 한, 기술적이거나 과학적인 용어를 포함해서 여기서 사용되는 모든 용어들은 본 발명이 속하는 기술 분야에서 통상의 지식을 가진 자에 의해 일반적으로 이해되는 것과 동일한 의미를 가지고 있다. 일반적으로 사용되는 사전에 정의되어 있는 것과 같은 용어들은 관련 기술의 문맥상 가지는 의미와 일치하는 의미를 가지는 것으로 해석되어야 하며, 본 명세서에서 명백하게 정의하지 않는 한, 이상적이거나 과도하게 형식적인 의미로 해석되지 않는다.Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Like reference numerals in the drawings denote like elements. In addition, specific structural to functional descriptions of the embodiments of the present invention are only illustrated for the purpose of describing the embodiments according to the present invention, and unless otherwise defined, all terms used herein including technical or scientific terms These have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art, and are not construed in ideal or excessively formal meanings unless expressly defined herein. Do not.
도 1은 본 발명의 일 실시예에 따른 실감형 인터랙티브 콘텐츠에 기반한 운동시스템의 동작을 설명하기 위한 개념도이다.1 is a conceptual diagram illustrating an operation of an exercise system based on sensory interactive content according to an embodiment of the present invention.
도 1에 도시된 바와 같이, 실감형 인터랙티브 콘텐츠에 기반한 운동시스템(10)의 사용자에게 운동공간을 제공하고, 운동프로그램에 따른 동작을 안내하는 프로젝터(300), 상기 프로젝터가 제공한 운동공간에서 사용자의 움직임을 감지하여 인식하기 위한 동작인식센서(200) 및 상기 프로젝터와 상기 동작인식센서를 제어하여 운동프로그램을 제공하는 운동제어장치(100)를 포함하여 구성된다.As shown in FIG. 1, a projector 300 which provides an exercise space to a user of the exercise system 10 based on immersive interactive content, and guides an operation according to an exercise program, the user in the exercise space provided by the projector It comprises a motion recognition sensor 200 for detecting and recognizing the movement of the movement and the exercise control device 100 for controlling the projector and the motion recognition sensor to provide an exercise program.
여기서 본 발명에 따른 상기 실감형 인터랙티브 콘텐츠에 기반한 운동시스템(10)은 바닥을 운동공간으로 하여 프로젝터로 원하는 운동프로그램의 운동인터페이스를 투사함으로써, 하나의 운동시스템으로 사용자가 원하는 다양한 운동프로그램을 실행할 수 있도록 운동인터페이스를 제공한다.Here, the exercise system 10 based on the immersive interactive content according to the present invention can execute various exercise programs desired by a user by using one exercise system by projecting an exercise interface of a desired exercise program with a projector using the floor as an exercise space. Provide an exercise interface to help
상기 바닥에 프로젝터를 통해서 운동인터페이스를 투사하여 실감형 인터랙티브 콘텐츠에 기반한 운동프로그램을 구현한 것은, 본 발명에서 착안한 핵심적인 기술적 사상으로 종래의 경우와 같이 사용자의 동작을 인식하기 위해 사용자의 몸에 추가적인 도구를 착용해야하는 번거로움과 바이크와 같은 보조 운동기구의 필요성을 제거한 것이다.Implementing an exercise program based on immersive interactive content by projecting an exercise interface through the projector on the floor is a core technical idea conceived by the present invention to the user's body to recognize the user's motion as in the conventional case. This eliminates the hassle of wearing additional tools and the need for assistive devices like bikes.
이러한 기술적 특징을 가진 본 발명의 실감형 인터랙티브 콘텐츠에 기반한 운동시스템(10)은 프로젝터, 동작감지센서 및 이들의 동기화된 동작을 지원하여 한층 증강된 가상공간을 구현하고, 사용자로 하여금 상기 증강된 가상공간에서 다양한 실감형 인터랙티브 콘텐츠에 기반한 운동프로그램을 즐길 수 있도록 한다.The exercise system 10 based on the realistic interactive content of the present invention having these technical features supports a projector, a motion sensor, and synchronized motion thereof to implement an enhanced virtual space, and allows a user to perform the enhanced virtual space. It allows you to enjoy exercise programs based on various interactive content in the space.
즉, 상기 실감형 인터랙티브 콘텐츠에 기반한 운동시스템(10)의 동작은 프로젝터(300)를 통해 사용자의 동작을 안내하는 실감형 인터랙티브 콘텐츠에 기반한 운동프로그램을 사용자의 운동공간에 표시해 주고, 사용자가 운동프로그램에 따라 동작을 취하면 이를 동작인식센서(200)가 사용자의 움직임을 감지하여 상기 운동제어장치(100)에 전달해준다. 상기 운동제어장치(100)는 상기 운동프로그램과 사용자의 움직임을 동기화시켜 사용자가 현실과 동질감을 느낄 수 있는 운동환경을 제공한다.That is, the operation of the exercise system 10 based on the immersive interactive content displays an exercise program based on the immersive interactive content that guides the user's operation through the projector 300 in the user's exercise space, and the user moves the exercise program. When the motion is taken according to the motion recognition sensor 200 detects the user's movement and delivers it to the exercise control device (100). The exercise control device 100 synchronizes the movement of the exercise program and the user to provide an exercise environment in which the user feels the same as reality.
또한 사용자는 전면에 설치된 모니터(400)를 통해 운동내용을 실시간으로 리뷰할 수 있으며, 원격관리시스템(20)에 유무선으로 연결되어 실감형 인터랙티브 콘텐츠에 기반한 운동시스템의 사용자 정보관리, 운동프로그램 업데이트 등의 원격관리를 제공받을 수 있다. 따라서 상기 운동제어장치(100)는 상기 모니터를 통해서 프로젝터로 투사되는 내용과 사용자의 동작을 동작인식센서(200)로 인식한 결과(카메라로 촬영한 이미지)를 출력한다. 또한 상기 모니터는 사용자가 상기 운동제어장치(100)를 통해서 운동한 결과에 대한 기록정보를 실시간으로 출력하는 역할을 수행한다.In addition, the user can review the exercise contents in real time through the monitor 400 installed on the front, connected to the remote management system 20 by wired or wireless, user information management of the exercise system based on realistic interactive content, exercise program update, etc. You can be provided with remote management. Therefore, the motion control apparatus 100 outputs a result (image captured by a camera) of the content projected by the projector through the monitor and the user's operation by the motion recognition sensor 200. In addition, the monitor serves to output in real time the recording information on the result of the user exercise through the exercise control device (100).
상기 프로젝터(300)에 의해 사용자의 운동공간에 투사되는 운동프로그램은 ICT를 기반으로 인간의 감각과 인지를 유발하여 실제와 유사한 경험 및 감성을 확장하고, 사람과 사물, 사람과 가상의 오브젝트가 인터랙션을 하는 실감형 인터랙티브 콘텐츠에 기반한다. 즉, 상기 운동프로그램은 사용자의 운동동작에 대한 시퀀스를 저장하고 있으며, 상기 운동제어장치(100)는 저장하고 있는 프로그램의 운동동작에 대한 시퀀스를 프로젝터를 통해서 출력하도록 한다. 상기 시퀀스는 테이블 형태, XML 형태의 마크업 언어(markup language), 데이터 구조와 같은 다양한 형태로 저장될 수 있다. 이렇게 저장된 프로그램은 상기 운동제어장치(100)에 의해서 해석되어 프로젝터를 통해서 출력되는 것이다.The exercise program projected to the user's exercise space by the projector 300 induces human senses and perceptions based on ICT to expand the experience and emotion similar to the real world, and the interaction between people and objects and between people and virtual objects. Based on immersive interactive content. That is, the exercise program stores a sequence of the user's exercise motion, and the exercise control apparatus 100 outputs the sequence of the exercise operation of the stored program through the projector. The sequence may be stored in various forms such as a table form, a markup language in XML form, and a data structure. The stored program is interpreted by the motion control apparatus 100 and output through the projector.
상기 동작인식센서(200)는 적어도 하나 이상의 카메라, 뎁쓰 카메라, 적외선 센서 또는 이들의 조합으로 구성되어서 사용자와 사용자의 움직임을 전방에서 감지한다. 한편 사용자의 주위(전후좌우)에 복수의 상기 동작인식센서가 설치되어 멀티뷰 이미지를 생성하여 사용자의 동작을 인식할 수도 있다. 즉, 사용자의 운동공간을 3차원의 입체적 혹은 멀티뷰로 감지할 수 있다. 이렇게 수집된 사용자, 사용자의 움직임 및 공간 정보를 상기 운동제어장치(100)에 전송하여 사용자에게 최적화된 보다 생동감 있는 입체적인 운동인터페이스를 제공하고 정밀한 사용자의 동작인식을 가능케 한다. 상기 카메라는 3차원 영상을 생성하기 위해서 좌영상 및 우영상을 촬영하는 카메라일 수 있으며, 복수의 카메라를 이용하여 멀티뷰를 구현하는 것으로 볼 수도 있다. 또한 뎁쓰 카메라의 뎁쓰값이나 3차원 영상에서 좌우영상의 시차에 대한 데이터를 추출하여, 오브젝트와의 거리를 환산하는데 활용할 수 있다. 거리가 가까우면 뎁쓰값이 크고, 거리가 멀면 뎁쓰값이 작게 되는 원리를 이용한 것이다.The motion recognition sensor 200 is composed of at least one camera, a depth camera, an infrared sensor, or a combination thereof to detect the user and the user's movement from the front. Meanwhile, a plurality of motion recognition sensors may be installed around the user (front, rear, left and right) to generate a multi-view image to recognize the user's motion. That is, the user's motion space can be detected in three-dimensional or multi-view. The collected user, the user's motion and spatial information is transmitted to the motion control device 100 to provide a more realistic three-dimensional motion interface optimized for the user and enables precise user's motion recognition. The camera may be a camera that captures a left image and a right image to generate a 3D image, and may be regarded as implementing a multiview using a plurality of cameras. In addition, data about the parallax of the left and right images may be extracted from the depth value of the depth camera or the 3D image, and used to convert the distance from the object. If the distance is close, the depth value is large, and if the distance is far, the depth value is used.
상기 실감형 인터랙티브 콘텐츠에는 운동프로그램에 따라 사용자가 취해야 할 동작을 유도하기 위한 가상의 오브젝트(예를 들어 팔을 굽혀다가 뛰는 전신 운동의 하나인 버피운동에서 팔을 굽혀을 때의 바닥에 손이 닿아야 하는 부분)에 대한 좌표정보와 순서, 좌표의 변화 간격등에 관한 정보를 담고 있다. 이 좌표정보는 사용자의 나이, 성별, 체력, 운동량, 훈련 중인 운동프로그램 등에 따라 사용자에 최적화되어 제공된다.The realistic interactive content needs to touch a floor when a user bends an arm in a buffy exercise, which is one of the whole body movements that bends and runs, in order to induce an action to be taken by a user according to an exercise program. It contains coordinate information, order, interval of change of coordinates, and so on. The coordinate information is optimized for the user according to the user's age, gender, physical fitness, exercise amount, exercise program under training, and the like.
상기 좌표정보를 포함하는 가상의 오브젝트로 구성된 실감형 인터랙티브 콘텐츠를 프로젝터에 의해 사용자의 운동공간에 투사되고, 사용자는 상기 가상의 오브젝트에 따라 운동을 하면, 상기 동작인식센서에 의해 감지된 사용자의 동작을 바탕으로 상기 좌표정보에 따라 사용자가 정확히 자세를 취하였는지 평가하게 된다.The sensory interactive content composed of the virtual object including the coordinate information is projected by the projector to the user's motion space, and when the user moves according to the virtual object, the user's motion detected by the motion recognition sensor Based on the coordinate information to evaluate whether the user has taken the posture correctly.
상기 동작인식센서는 데이터의 신속한 처리를 위해 상기 좌표정보를 중심으로 사용자의 주요 포인트(손, 발, 머리, 관절)를 인식하여 운동프로그램과 사용자의 동작이 일치하는지 평가한다.The motion recognition sensor recognizes the user's main points (hands, feet, heads, joints) based on the coordinate information for rapid processing of the data and evaluates whether the motion program matches the motion of the user.
상기 모니터(400)에는 사용자의 움직임에 따른 운동량 정보, 사용자 정보, 운동 평가 및 결과, 소모된 칼로리 정보, 개인의 헬스 정보, 자신의 운동내용 확인 또는 이들의 조합을 표시하여 사용자가 운동도중이나 운동 후에 확인할 수 있도록 하여 사용자가 보다 효율적으로 운동할 수 있는 환경을 제공한다.The monitor 400 displays the exercise amount information, the user information, the exercise evaluation and results, the calorie information consumed, the individual's health information, the user's exercise contents, or a combination thereof according to the user's movement. It can be checked later, so that the user can exercise more efficiently.
또한 상기 원격관리시스템(20)은 각 개인의 운동정보를 원결관리시스템에 연결된 데이터베이스(30)에 저장하여 관리하고, 운동프로그램을 각 실감형 인터랙티브 콘텐츠에 기반한 운동시스템에 제공하거나 사용자에 의해 제작된 운동프로그램을 제공받을 수 있다.In addition, the remote management system 20 stores and manages each individual's exercise information in a database 30 connected to the native management system, and provides an exercise program to an exercise system based on each realistic interactive content or produced by a user. Exercise programs can be provided.
도 2는 본 발명의 일 실시예에 따른 실감형 인터랙티브 콘텐츠에 기반한 운동시스템에서 운동제어장치의 블록도이다.2 is a block diagram of a motion control apparatus in an exercise system based on sensory interactive content according to an embodiment of the present invention.
도 2에 도시된 바와 같이, 운동제어장치(100)는 유무선인터페이스부(110), 동작인식부(120), 운동인페이스제공부(130), 시스템동기화부(140), 디스플레이부(150)를 포함하여 구성된다.As shown in FIG. 2, the exercise control apparatus 100 includes a wired / wireless interface unit 110, an operation recognition unit 120, an exercise interface providing unit 130, a system synchronization unit 140, and a display unit 150. It is configured to include.
상기 유무선인터페이스부(110)는 상기 원격관리시스템(20)에 유선 혹은 무선으로 연결되어 사용자 각 개인의 나이, 성별, 체력, 운동량, 훈련 중인 운동프로그램 등 다양한 사용자 정보와 실감형 인터랙티브 콘텐츠를 다운로드 받을 수 있도록 네트워크 인터페이스를 제공하는 것이다. 또한 역으로 사용자 정보의 입력, 수정 또는 사용자 각자가 제작한 운동프로그램을 상기 원격관리시스템(20)에 업로드할 수 있다. 또한 상기 동작인식센서(200), 프로젝트(300), 모니터(400) 등과의 유무선 인터페이스를 제공하여 서로 연동하도록 지원한다.The wired / wireless interface unit 110 is wired or wirelessly connected to the remote management system 20 to download various user information and realistic interactive content such as age, gender, physical fitness, exercise amount, and exercise program of each individual user. To provide a network interface. In addition, the user can input or modify user information or upload the exercise program produced by each user to the remote management system 20. In addition, by providing a wired or wireless interface with the motion recognition sensor 200, the project 300, the monitor 400 and the like to support the interworking.
상기 실감형 인터랙티브 콘텐츠에 기반한 운동프로그램은 본 발명에 따른 실감형 인터랙티브 콘텐츠에 기반한 운동시스템을 통해서 직접 사용자에 의해서 제작될 수 있으며, 이렇게 제작된 운동프로그램은 저장매체에 저장되어 유통되거나 인터넷을 통해서 유통될 수 있다. 아울러 상기 운동프로그램은 원격관리시스템에 저장되어, 각각의 개별적인 실감형 인터랙티브 콘텐츠에 기반한 운동시스템으로 제공될 수도 있다. 따라서 원격관리시스템은 각 개인의 운동정보를 관리할 수 있으며, 유무선인터페이스부를 통해서 운동프로그램을 제공하거나 제공받아 이를 유지 및 관리할 수 있다.The exercise program based on the immersive interactive content can be produced by the user directly through the exercise system based on the immersive interactive content according to the present invention, and the exercise program thus produced is stored and distributed on a storage medium or distributed through the Internet. Can be. In addition, the exercise program may be stored in a remote management system, and may be provided as an exercise system based on each individual sensory interactive content. Therefore, the remote management system can manage the exercise information of each individual, it is possible to maintain and manage the exercise program provided or received through the wired and wireless interface unit.
또한 실감형 인터랙티브 콘텐츠에 기반한 운동시스템은 실시간으로 사용자를 인식하고, 해당 사용자의 정보와 공간정보를 상기 원격관리시스템과 송수신하여 사용자의 운동정보를 원격관리시스템에서 심리스하게 관리하는 것이 가능하다. 사용자가 별도의 조작을 할 필요 없이 실감형 인터랙티브 콘텐츠에 기반한 운동시스템과 원격관리시스템이 연동하여 자동으로 심리스하게 사용자의 개인정보와 운동정보를 통해서 건강관리를 수행할 수 있게 되는 것이다.In addition, the exercise system based on realistic interactive content can recognize the user in real time, and can seamlessly manage the user's exercise information in the remote management system by transmitting and receiving the user's information and spatial information with the remote management system. Without the user's separate operation, the exercise system and the remote management system based on the sensational interactive contents can be linked automatically and seamlessly to perform health care through the user's personal information and exercise information.
상기 동작인식부(120)는 먼저 상기 적어도 하나 이상의 동작인식센서(200)에 의해 감지된 사용자를 인식하여 등록된 사용자 정보를 추출하고, 사용자에게 제공될 운동프로그램을 준비하는 기능을 구비한다. 또한 사용자의 동작을 인식하여 운동프로그램의 시작과 종료를 포함한 운동동작에 대한 시퀀스에 따라 사용자의 실제 운동프로그램에서의 동작을 인식하게 된다.The motion recognition unit 120 first has a function of recognizing a user sensed by the at least one motion recognition sensor 200, extracting registered user information, and preparing an exercise program to be provided to the user. In addition, the user's motion is recognized to recognize the motion of the user's actual exercise program according to the sequence of the exercise motion including the start and the end of the exercise program.
더욱 구체적으로는 적어도 하나 이상의 카메라, 뎁쓰 카메라, 적외선 센서 또는 이들의 조합으로 구성된 동작인식센서(200)로부터 입력되는 정보를 통해서 사용자와 사용자의 움직임을 전방에서 감지한다. 한편 사용자의 주위(전후좌우)에 설치된 복수의 상기 동작인식센서로부터 입력된 멀티뷰 이미지를 통해서 사용자의 동작을 인식할 수도 있다. 즉, 사용자의 운동공간을 3차원의 입체적 혹은 멀티뷰로 감지하는 기능을 수행한다. 또한 동작인식부(120)는 이렇게 수집된 사용자, 사용자의 움직임 및 공간 정보를 통해서 정밀한 사용자의 동작인식을 수행한다. 또한 좌우영상의 시차를 이용하거나 뎁쓰값을 통해서 오브젝트와의 거리를 환산하며, 이는 거리가 가까우면 뎁쓰값이 크고, 거리가 멀면 뎁쓰값이 작게 되는 원리를 이용한 것이다.More specifically, the user and the user's movement are detected from the front through the information input from the motion recognition sensor 200 composed of at least one camera, depth camera, infrared sensor, or a combination thereof. Meanwhile, the user's motion may be recognized through a multi-view image input from the plurality of motion recognition sensors installed around the user (front, rear, left and right). In other words, it performs a function of detecting the user's motion space in three-dimensional or multi-view. In addition, the motion recognition unit 120 performs precise user motion recognition through the collected user, user's motion and spatial information. In addition, the distance from the object is converted using parallax of the left and right images or the depth value, which uses the principle that the depth value is large when the distance is close and the depth value is small when the distance is far.
이전에 설명한 바와 같이, 상기 실감형 인터랙티브 콘텐츠에는 운동프로그램에 따라 사용자가 취해야 할 동작을 유도하기 위한 가상의 오브젝트(예를 들어 팔을 굽혀다가 뛰는 전신 운동의 하나인 버피운동에서 팔을 굽혀을 때의 바닥에 손이 닿아야 하는 부분)에 대한 좌표정보와 순서, 좌표의 변화 간격 등에 관한 정보를 담고 있다. 이 좌표정보는 사용자의 나이, 성별, 체력, 운동량, 훈련 중인 운동프로그램 등에 따라 사용자에 최적화되어 제공된다.As described previously, the immersive interactive content includes a virtual object for inducing an action to be taken by a user according to an exercise program (for example, when bending an arm in a buffy exercise, which is one of the whole body movements by bending the arm). It contains coordinate information, order, and interval of change of coordinates. The coordinate information is optimized for the user according to the user's age, gender, physical fitness, exercise amount, exercise program under training, and the like.
상기 좌표정보를 포함하는 가상의 오브젝트로 구성된 실감형 인터랙티브 콘텐츠가 프로젝터에 의해 사용자의 운동공간에 투사되고, 사용자는 상기 가상의 오브젝트에 따라 운동을 하면, 상기 동작인식부(120)는 상기 동작인식센서에 의해 감지된 사용자의 동작을 바탕으로 상기 좌표정보에 따라 사용자가 정확히 자세를 취하였는지 평가하게 된다.The sensory interactive content composed of virtual objects including the coordinate information is projected by the projector to the user's motion space, and when the user moves according to the virtual object, the motion recognition unit 120 recognizes the motion. Based on the user's motion detected by the sensor, the user's posture is correctly evaluated according to the coordinate information.
또한 상기 동작인식부(120)는 데이터의 신속한 처리를 위해 상기 좌표정보를 중심으로 사용자의 주요 포인트(손, 발, 머리, 관절)를 인식하여 운동프로그램과 사용자의 동작이 일치하는지 평가한다.In addition, the motion recognition unit 120 recognizes the user's main points (hands, feet, head, joints) based on the coordinate information for rapid processing of the data and evaluates whether the motion program and the user's motion match.
상기 운동인터페이스제공부(130)는 상기 유무선인터페이스부(110)를 통해 다운로드한 사용자 정보를 바탕으로 실감형 인터랙티브 콘텐츠에 기반하여 생성된 운동프로그램의 가상 오브젝트로 구성된 운동인터페이스를 제공한다. 또한 상기 운동인터페이스제공부(130)는 상기 동작인식센서(200)에 의해 감지된 사용자의 운동공간에 대한 3차원의 입체적 정보를 바탕으로 사용자 환경에 최적화된 보다 생동감 있는 입체적인 운동인터페이스를 제공한다.The exercise interface providing unit 130 provides an exercise interface composed of virtual objects of an exercise program generated based on realistic interactive content based on user information downloaded through the wired / wireless interface unit 110. In addition, the exercise interface providing unit 130 provides a more realistic three-dimensional exercise interface optimized for the user environment based on the three-dimensional stereoscopic information about the user's exercise space sensed by the motion recognition sensor 200.
따라서 상기 운동인터페이스제공부(130)는 프로젝터를 통해서 운동프로그램의 시퀀스에 따른 사용자와의 인터랙션을 위한 인터페이스를 제공하여 사용자의 동작을 유도하고, 또한 사용자의 동작에 따라 운동프로그램의 시작과 종료를 포함한 사용자의 동작을 받아들이는 역할을 수행한다.Therefore, the exercise interface providing unit 130 provides an interface for interacting with the user according to the sequence of the exercise program through the projector to induce the user's operation, and also includes the start and end of the exercise program according to the user's operation. It is responsible for accepting user actions.
상기 시스템동기화부(140)는 상기 동작인식센서(200)와 프로젝터(300)를 동기화하여, 운동인터페이스를 투사해 주는 프로젝터와 동작인식센서의 공간좌표 인식에 대한 동기화 프로세스를 제공하고, 운동 중 사용자의 위치나 방향 변화에 따른 움직임을 상기 운동인터페이스와 연동이 되어 동작하도록 한다.The system synchronization unit 140 synchronizes the motion recognition sensor 200 with the projector 300 to provide a synchronization process for recognizing the spatial coordinates of the projector and the motion recognition sensor that projects the motion interface, and the user during the exercise. The movement according to the position or direction change of the interworking with the motion interface to operate.
또한 상기 시스템동기화부(140)는 사용자의 움직임에 따라 운동인터페이스가 적응적으로 가속 혹은 감속되도록 하여, 사용자의 성별이나 나이에 따라 운동인터페이스의 페이스를 설정 할 수 있으며, 또한 사용자의 체력, 컨디션에 따라 운동인터페이스의 페이스가 자동적으로 적응하여 조절되도록 할 수 있다.In addition, the system synchronization unit 140 may be configured to adaptively accelerate or decelerate the motion interface according to the user's movement, to set the pace of the exercise interface according to the gender or age of the user, and also to the user's physical fitness and physical condition. Therefore, the pace of the exercise interface can be automatically adjusted and adjusted.
즉, 사용자가 운동프로그램을 수행하는 스피드에 반응하여 점점 빠르게 동작하면 자동적으로 운동인터페이스의 반응을 가속시키고, 반면에 스피드가 느려지면 운동인터페이스의 반응 속도를 천천히 하여 사용자에게 최적화된 운동인터페이스를 제공한다.That is, if the user moves faster and faster in response to the speed at which the exercise program is executed, the response of the exercise interface is automatically accelerated. On the other hand, if the speed is lowered, the response speed of the exercise interface is slowed down to provide the user with an optimized exercise interface. .
상기 디스플레이부(150)는 사용자의 움직임에 따른 운동량 정보, 사용자 정보, 운동 평가 및 결과, 소모된 칼로리 정보, 개인의 헬스 정보, 자신의 운동내용 확인 또는 이들의 조합을 포함한 정보를 상기 모니터(400)에 표시하도록 하여 사용자가 운동도중이나 운동 후에 확인할 수 있도록 하여 사용자가 보다 효율적으로 운동할 수 있는 환경을 제공한다.The display unit 150 monitors information including exercise amount information, user information, exercise evaluation and results, calories burned information, personal health information, confirmation of one's exercise contents, or a combination thereof according to user's movement. ) So that the user can check during or after the exercise to provide an environment in which the user can exercise more efficiently.
도 3은 본 발명의 일 실시예에 따른 실감형 인터랙티브 콘텐츠에 기반한 운동시스템의 동작 과정을 나타내는 흐름도이다.3 is a flowchart illustrating an operation process of an exercise system based on sensory interactive content according to an embodiment of the present invention.
도 1 내지 도 3을 참조하여 설명하면, 먼저 상기 동작인식센서(200)에 의해 사용자에 대한 이미지 데이터를 바탕으로 사용자를 인식하여 사용자 정보를 추출한다(S110). 아울러 사용자 정보는 사용자가 개인의 태그정보나 ID를 입력함으로써 시스템이 인식할 수 있도록 할 수도 있다. 즉, 동작인식센서에 마련된 카메라를 통해서 촬영된 이미지를 바탕으로 사용자를 인식하기 위해 안면패턴인식 기술을 사용할 수 있으며, 간단하게 사용자가 착용하거나 휴대하고 있는 바코드, RFID 등을 통해서 사용자를 인식하는 것도 가능하다.Referring to FIGS. 1 to 3, first, the motion recognition sensor 200 recognizes a user based on image data of the user and extracts user information (S110). In addition, the user information may allow the system to recognize the user by inputting the tag information or ID of the individual. In other words, the face pattern recognition technology can be used to recognize the user based on the image taken by the camera provided in the motion recognition sensor, and the user can simply recognize the user through the barcode, RFID, etc. that the user wears or carries. It is possible.
그리고 사용자가 운동하고자 하는 운동공간에 대한 정보를 추출한다(S120).Then, the user extracts information on the exercise space to be exercised (S120).
상기 S110단계와 S120단계에서 추출된 사용자 정보와 운동공간에 대한 정보를 바탕으로 사용자에게 제공될 운동프로그램을 상기 유무선인터페이스부(110)를 통해 상기 원격관리시스템(20)으로부터 다운로드하거나 자체 운동인터페이스제공부(130)에 저장되어 있는 실감형 인터랙티브 콘텐츠를 로딩하여 준비한다(S130). The exercise program to be provided to the user based on the user information and the information on the exercise space extracted in the step S110 and step S120 is downloaded from the remote management system 20 through the wired / wireless interface unit 110 or a self-executing interface is made. Prepare by loading the realistic interactive content stored in the study 130 (S130).
상기 S130 단계에서 사용자와 사용자의 운동공간에 최적화된 실감형 인터랙티브 콘텐츠에 기반한 운동인터페이스가 상기 프로젝터(300)에 의해 사용자의 운동공간의 바닥이나 벽에 투사되어 제공된다(S140).In operation S130, an exercise interface based on the sensuous interactive content optimized for the user and the user's exercise space is projected on the floor or the wall of the user's exercise space by the projector 300 (S140).
이후 상기 프로젝터에 의해 로딩된 운동인터페이스를 통해 운동의 시작으로 인식되는 사용자의 움직임을 감지하여 운동프로그램이 시작된다(S150).Thereafter, the exercise program is detected by detecting the user's movement recognized as the start of the exercise through the exercise interface loaded by the projector (S150).
이후 상기 사용자의 전후좌우에 적어도 하나 이상 설치된 동작인식센서에 의해 사용자의 동작이 실시간으로 인식된다(S160).Thereafter, the user's motion is recognized in real time by at least one motion recognition sensor installed in front, rear, left and right of the user (S160).
이후 상기 S140단계에서 제공된 운동인터페이스와 상기 S160단계에서 인식된 사용자의 동작을 동기화한다(S170).Thereafter, the operation interface provided in step S140 and the user's motion recognized in step S160 are synchronized (S170).
상기 S170단계에서 동기화된 정보를 바탕으로 사용자의 동작속도와 운동인터페이스의 가상 오브젝트의 진행(플레이)속도의 매칭여부를 판단하다(S180). 이는 사용자마다 체력이 다르고, 같은 사용자라고 해도 사용자의 컨디션에 따라 운동의 강도와 속도가 조절될 필요성이 있기 때문이다. 따라서 본 발명은 사용자의 움직임에 따라 운동인터페이스가 적응적으로 가속 혹은 감속되도록 하여, 사용자의 체력에 따라 페이스를 자동적으로 조절할 수 있는 것을 특징으로 한다.On the basis of the information synchronized in step S170 it is determined whether the movement speed of the user and the moving (play) speed of the virtual object of the exercise interface (S180). This is because the physical strength is different for each user, and even the same user needs to adjust the intensity and speed of the exercise according to the user's condition. Therefore, the present invention is characterized in that the motion interface is adaptively accelerated or decelerated according to the user's movement, and the pace can be automatically adjusted according to the user's physical fitness.
만약 사용자의 동작속도가 운동인터페이스의 진행속도와 맞지 않는다면 사용자의 페이스에 적응적으로 운동인터페이스의 진행속도가 조절된다(S190).If the user's motion speed does not match the progress speed of the exercise interface, the speed of the movement interface is adjusted adaptively to the user's pace (S190).
반면에 사용자의 동작속도와 운동인터페이스의 진행속도가 적절하다면 사용자가 운동인터페이스의 가상 오브젝트에 따라 운동을 하게 되고, 운동프로그램에 따라 사용자의 운동 정확도에 대한 평가가 매겨지며 정확도가 떨어진 동작들은 부분적으로 정확하게 재시도 할 수 있도록 피드백된다(S200).On the other hand, if the user's movement speed and the speed of the movement interface are appropriate, the user exercises according to the virtual object of the exercise interface, and the user's exercise accuracy is evaluated according to the exercise program. It is fed back so that it can be accurately retried (S200).
이후 운동의 종료로 인식되는 사용자의 움직임을 감지하면 운동이 종료된다(S210).After detecting the user's movement recognized as the end of the exercise (S210).
따라서 본 발명에 따른 실감형 인터랙티브 콘텐츠에 기반한 운동시스템 제공 방법은, 프로젝터를 통해서 운동프로그램에 대한 사용자의 동작을 안내하는 운동인터페이스를 제공하는 운동인터페이스제공 단계(S110~S140), 적어도 하나 이상의 동작인식센서로부터 상기 안내에 따른 사용자의 움직임을 감지하는 동작인식 단계(S150~S160), 및 상기 사용자의 움직임을 상기 운동인터페이스와 동기화하는 시스템동기화 단계(S170)를 포함하며, 상기 운동프로그램은 사용자의 움직임과 운동인터페이스가 상호 동질감을 느끼도록 하는 실감형 인터랙티브 콘텐츠이다.Therefore, the method for providing an exercise system based on the sensuous interactive contents according to the present invention includes providing an exercise interface for guiding a user's operation of an exercise program through a projector (S110 to S140), at least one or more motion recognition Motion recognition step (S150 ~ S160) for detecting the user's movement according to the guidance from the sensor, and the system synchronization step (S170) for synchronizing the user's movement with the exercise interface, the exercise program is a user's movement It is a realistic interactive content that makes the and the sports interface feel the same.
여기서 상기 사용자의 움직임에 따라 운동인터페이스가 적응적으로 가속 혹은 감속되도록 하여, 사용자로 하여금 자신의 체력에 따라 페이스를 자동적으로 조절할 수 있으며, 상기 사용자의 움직임에 따른 운동량 정보, 사용자 정보, 운동 평가 및 결과, 소모된 칼로리 정보, 개인의 헬스 정보, 자신의 운동내용 확인 또는 이들의 조합을 표시하여 사용자가 운동도중이나 운동후에 확인할 수 있는 디스플레이단계(미도시)를 더 포함한다.Here, the exercise interface is adaptively accelerated or decelerated according to the user's movement, so that the user can automatically adjust the pace according to his or her physical fitness, and the exercise amount information, user information, exercise evaluation and As a result, the display apparatus further includes a display step (not shown) that the user can check during or after the exercise by displaying the calorie information consumed, the health information of the individual, checking his / her exercise contents or a combination thereof.
또한 상기 원격관리시스템을 통해서 각 개인의 운동정보를 관리하거나, 운동프로그램을 제공하거나 제공받을 수 있도록 하는 유무선통신 단계(미도시)를 더 포함한다.The method further includes a wired / wireless communication step (not shown) for managing the exercise information of each individual through the remote management system, or providing or receiving an exercise program.
특히, 본 발명은 실시간으로 사용자를 인식하고, 해당 사용자의 정보와 공간정보를 상기 원격관리시스템과 송수신하여 사용자의 운동정보를 원격관리시스템에서 심리스하게 관리하는 것이 가능하도록 한다.In particular, the present invention recognizes the user in real time, and transmits and receives the user's information and spatial information with the remote management system to enable seamless management of the user's exercise information in the remote management system.
도 4는 본 발명의 일 실시예에 따른 실감형 인터랙티브 콘텐츠에 기반한 운동시스템을 통한 사이드스텝 운동을 보여주는 예시도이다.4 is an exemplary view showing a sidestep exercise through an exercise system based on immersive interactive content according to an embodiment of the present invention.
상기 사이드스텝은 스키를 타고 비탈길을 오르는 방법에서 유래된 운동으로, 도 4에 예시된 바와 같이 비탈길을 가로질러 위로 걸음을 옮기면서 계속 꾸준하게 올라가야 하는 스키의 사이드스텝을 모방한 실감형 인터랙티브 콘텐츠에 기반하여 상기 프로젝터에 의해 운동공간의 바닥에 사용자가 옮겨야 할 걸음이 가상 오브젝트로 표시되고, 사용자는 이를 따라함으로써 현실감 있는 사이드스텝 운동을 하게 되는 것이다. 또한 사용자의 전면에 설치된 모니터에 사용자의 운동화면이 디스플레이됨으로써 동작의 정확도를 실시간 확인하며 운동할 수 있다.The sidestep is an exercise derived from a method of climbing a slope by skiing, and is based on realistic interactive content that mimics the sidestep of a ski that must continuously climb up as the person walks up across the slope as illustrated in FIG. 4. The user's step is displayed as a virtual object on the floor of the exercise space by the projector, and the user follows a realistic side-step exercise by following it. In addition, the user's exercise screen is displayed on the monitor installed in front of the user to check the accuracy of the movement in real time to exercise.
먼저 사용자는 프로젝터를 통해서 바닥이나 벽 혹은 스크린에 표시된 시작 사인을 손이나 발로 터치하면 운동프로그램이 시작하게 되고, 이때부터 운동프로그램이 제공하는 해당 운동 시퀀스에 따라 사용자는 운동을 수행한다. 운동을 수행한 결과는 모니터에 출력하여 직접 확인할 수 있도록 함으로써, 사용자가 얼마나 정확한 동작으로 사이드스텝을 밟았는지, 그 결과를 화면에 출력하여 확인할 수 있도록 한다.First, when the user touches the start sign displayed on the floor, wall, or screen by hand or foot through the projector, the exercise program starts. From this time, the user performs the exercise according to the corresponding exercise sequence provided by the exercise program. The result of the exercise is displayed on the monitor so that the user can directly check how much accurate step the user has stepped on, so that the result can be displayed on the screen.
도 5는 본 발명의 일 실시예에 따른 실감형 인터랙티브 콘텐츠에 기반한 운동시스템을 통한 버피운동을 보여주는 예시도이다.5 is an exemplary view showing a buffy exercise through an exercise system based on sensory interactive content according to an embodiment of the present invention.
버피운동은 팔을 굽혀다가 뛰는 전신 운동의 하나로 빠르고 아주 효과적인 체력 강화 및 다이어트 운동법 중에 하나이다. 도 5에 예시된 바와 같이 버피운동을 포함하는 실감형 인터랙티브 콘텐츠에 기반하여 상기 프로젝터에 의해 바닥에 사용자가 팔을 굽혀다가 뛰어야할 너비에 맞추어 가상 오브젝트가 표시되고, 사용자는 이를 따라함으로써 전신 운동을 하게 되는 것이다. 또한 도 3에서 설명된 바와 같이 사용자의 체력에 따라 팔을 굽혀다가 뛰어야 하는 스피드를 사용자의 성별, 나이, 체력, 컨디션에 따라 적응적으로 조절되도록 함으로써 운동효과를 높일 수 있다.Buffy exercise is one of the whole body exercises to bend and run arms is one of the fast and very effective fitness and diet exercise. As shown in FIG. 5, a virtual object is displayed on the floor by the projector based on the sensuous interactive content including buffy motion to fit the width at which the user should bend the arm, and the user follows the whole body motion accordingly. Will be done. In addition, as illustrated in FIG. 3, the exercise speed can be increased by flexibly adjusting the speed at which the user should bend the arm according to the user's physical fitness according to the user's gender, age, physical fitness, and physical condition.
사용자가 엎드려 운동을 하는 경우, 사용자가 모니터를 통해서 운동정보를 확인할 수 없기 때문에, 프로젝터를 통해서 바닥에 운동정보를 출력할 수도 있다.When the user is lying down to exercise, since the user cannot check the exercise information through the monitor, the exercise information may be output to the floor through the projector.
이상에서 설명한 바와 같이, 본 발명은 실감형 인터랙티브 콘텐츠에 기반한 운동시스템 및 그 방법에 관한 것으로, 증강된 가상공간에 인간의 감각과 인지를 유발하여 사람과 사물, 사람과 가상의 오브젝트가 인터랙션 함으로써 실제와 유사한 경험 및 감성을 확장하는 실감형 인터랙티브 콘텐츠를 제공하여 현실과 동질감을 느끼며 장소에 구애 받지 않고 운동할 수 있어 건강을 증진시키는 효과가 있다.As described above, the present invention relates to an exercise system and a method based on the sensuous interactive contents, which induces human senses and perceptions in an augmented virtual space, whereby a person interacts with an object and a person with a virtual object. By providing realistic interactive content that extends the experience and emotion similar to that, the user can feel the same as reality and can exercise anywhere, thereby improving health.
이상으로 본 발명은 도면에 도시된 실시예를 참고로 하여 설명되었으나, 이는 예시적인 것에 불과하며, 당해 기술이 속하는 분야에서 통상의 지식을 가진 자라면 이로부터 다양한 변형 및 균등한 타 실시예가 가능하다는 점을 이해할 것이다. 따라서 본 발명의 기술적 보호범위는 아래의 특허청구범위에 의해서 판단되어야 할 것이다.Although the present invention has been described with reference to the embodiments illustrated in the drawings, this is merely exemplary, and various modifications and equivalent other embodiments are possible for those skilled in the art to which the art pertains. I will understand the point. Therefore, the technical protection scope of the present invention will be determined by the claims below.

Claims (10)

  1. 사용자에게 운동공간을 제공하고, 운동프로그램에 따른 동작을 안내하는 프로젝터;A projector to provide a user with an exercise space and to guide an operation according to an exercise program;
    상기 프로젝터가 제공한 운동공간에서 사용자의 움직임을 감지하기 위한 동작인식센서; 및A motion recognition sensor for detecting a user's movement in the exercise space provided by the projector; And
    상기 프로젝터와 상기 동작인식센서를 제어하여 운동프로그램을 제공하는 운동제어장치;를 포함하는 것을 특징으로 하는 실감형 인터랙티브 콘텐츠에 기반한 운동시스템.And an exercise control device for controlling the projector and the motion recognition sensor to provide an exercise program.
  2. 청구항 1에 있어서,The method according to claim 1,
    상기 운동제어장치는,The motion control device,
    프로젝터를 통해서 운동프로그램에 대한 사용자의 동작을 안내하는 운동인터페이스를 제공하는 운동인터페이스제공부;An exercise interface providing unit providing an exercise interface for guiding a user's operation of the exercise program through the projector;
    적어도 하나 이상의 동작인식센서로부터 상기 안내에 따른 사용자의 움직임을 감지하여 인식하는 동작인식부; 및A motion recognition unit for detecting and recognizing a user's movement according to the guide from at least one motion recognition sensor; And
    상기 사용자의 움직임을 상기 운동인터페이스와 동기화하는 시스템동기화부;를 포함하며,It includes; System synchronization unit for synchronizing the movement of the user with the exercise interface,
    상기 운동프로그램은 사용자의 움직임과 운동인터페이스가 상호 동질감을 느끼도록 하는 실감형 인터랙티브 콘텐츠인 것을 특징으로 하는 실감형 인터랙티브 콘텐츠에 기반한 운동시스템.The exercise program is an exercise system based on immersive interactive content, characterized in that the interactive content for the user's motion and the interface feels a sense of mutual interaction.
  3. 청구항 2에 있어서,The method according to claim 2,
    상기 실감형 인터랙티브 콘텐츠에 기반한 운동시스템은,The exercise system based on the realistic interactive content,
    상기 사용자의 움직임에 따라 운동인터페이스가 적응적으로 가속 혹은 감속되도록 하여, 사용자로 하여금 자신의 체력에 따라 페이스를 자동적으로 조절할 수 있는 것을 특징으로 하는 실감형 인터랙티브 콘텐츠에 기반한 운동시스템.Motion system based on the interactive content, characterized in that the user interface is automatically accelerated or decelerated according to the movement of the user, so that the user can automatically adjust the pace according to his or her physical strength.
  4. 청구항 2에 있어서,The method according to claim 2,
    상기 실감형 인터랙티브 콘텐츠에 기반한 운동시스템은,The exercise system based on the realistic interactive content,
    상기 사용자의 움직임에 따른 운동량 정보, 사용자 정보, 운동 평가 및 결과, 소모된 칼로리 정보, 개인의 헬스 정보, 자신의 운동내용 확인 또는 이들의 조합을 표시하여 사용자가 운동도중이나 운동후에 확인할 수 있는 디스플레이부;를 더 포함하는 것을 특징으로 하는 실감형 인터랙티브 콘텐츠에 기반한 운동시스템.Display that the user can check during or after exercise by displaying the exercise amount information, user information, exercise evaluation and results, calories burned information, individual health information, his / her exercise contents check or a combination thereof according to the user's movement An exercise system based on immersive interactive content, characterized in that it further comprises a.
  5. 청구항 2에 있어서,The method according to claim 2,
    상기 실감형 인터랙티브 콘텐츠에 기반한 운동시스템은,The exercise system based on the realistic interactive content,
    원격관리시스템을 통해서 각 개인의 운동정보를 관리하거나, 운동프로그램을 제공하거나 제공받을 수 있도록 하는 유무선인터페이스부;를 더 포함하며,It further includes a wired and wireless interface unit to manage the exercise information of each individual through a remote management system, to provide or receive an exercise program,
    실시간으로 사용자를 인식하고, 해당 사용자의 정보와 공간정보를 상기 원격관리시스템과 송수신하여 사용자의 운동정보를 원격관리시스템에서 심리스하게 관리하는 것을 특징으로 하는 실감형 인터랙티브 콘텐츠에 기반한 운동시스템.Recognizing a user in real time, and sends and receives the user's information and spatial information with the remote management system to seamlessly manage the user's exercise information in the remote management system based on realistic interactive content.
  6. 프로젝터를 통해서 사용자에게 운동공간을 제공하고, 운동프로그램에 따른 동작을 안내하는 프로젝션 단계;A projection step of providing an exercise space to a user through a projector and guiding an operation according to an exercise program;
    동작인식센서를 통해서 상기 프로젝터가 제공한 운동공간에서 사용자의 움직임을 감지하는 동작감지 단계; 및A motion detection step of detecting a user's movement in an exercise space provided by the projector through a motion recognition sensor; And
    운동제어장치를 통해서 상기 프로젝터와 상기 동작인식센서를 제어하여 운동프로그램을 제공하는 운동제어 단계;를 포함하는 것을 특징으로 하는 실감형 인터랙티브 콘텐츠에 기반한 운동 제공 방법.And a motion control step of controlling the projector and the motion recognition sensor through a motion control device to provide a workout program.
  7. 청구항 6에 있어서,The method according to claim 6,
    상기 운동제어 단계는,The motion control step,
    프로젝터를 통해서 운동프로그램에 대한 사용자의 동작을 안내하는 운동인터페이스를 제공하는 운동인터페이스제공 단계;Providing an exercise interface for providing an exercise interface for guiding a user's operation of the exercise program through the projector;
    적어도 하나 이상의 동작인식센서로부터 상기 안내에 따른 사용자의 움직임을 감지하여 인식하는 동작인식 단계; 및A motion recognition step of detecting and recognizing a movement of the user according to the guide from at least one motion recognition sensor; And
    상기 사용자의 움직임을 상기 운동인터페이스와 동기화하는 시스템동기화 단계;를 포함하며,And a system synchronization step of synchronizing the movement of the user with the exercise interface.
    상기 운동프로그램은 사용자의 움직임과 운동인터페이스가 상호 동질감을 느끼도록 하는 실감형 인터랙티브 콘텐츠인 것을 특징으로 하는 실감형 인터랙티브 콘텐츠에 기반한 운동 제공 방법.The exercise program is a method for providing an exercise based on immersive interactive content, characterized in that the user's motion and the interface is immersive interactive content to feel the same.
  8. 청구항 7에 있어서,The method according to claim 7,
    상기 실감형 인터랙티브 콘텐츠에 기반한 운동 제공 방법은,The exercise providing method based on the realistic interactive content,
    상기 사용자의 움직임에 따라 운동인터페이스가 적응적으로 가속 혹은 감속되도록 하여, 사용자로 하여금 자신의 체력에 따라 페이스를 자동적으로 조절할 수 있는 것을 특징으로 하는 실감형 인터랙티브 콘텐츠에 기반한 운동 제공 방법.The motion interface is adaptively accelerated or decelerated according to the movement of the user, so that the user can automatically adjust the pace according to his or her physical fitness.
  9. 청구항 7에 있어서,The method according to claim 7,
    상기 실감형 인터랙티브 콘텐츠에 기반한 운동 제공 방법은,The exercise providing method based on the realistic interactive content,
    상기 사용자의 움직임에 따른 운동량 정보, 사용자 정보, 운동 평가 및 결과, 소모된 칼로리 정보, 개인의 헬스 정보, 자신의 운동내용 확인 또는 이들의 조합을 표시하여 사용자가 운동도중이나 운동후에 확인할 수 있는 디스플레이단계를 더 포함하는 것을 특징으로 하는 실감형 인터랙티브 콘텐츠에 기반한 운동 제공 방법.Display that the user can check during or after exercise by displaying the exercise amount information, user information, exercise evaluation and results, calories burned information, individual health information, his / her exercise contents check or a combination thereof according to the user's movement Exercise providing method based on immersive interactive content, characterized in that it further comprises a step.
  10. 청구항 7에 있어서,The method according to claim 7,
    상기 실감형 인터랙티브 콘텐츠에 기반한 운동 제공 방법은,The exercise providing method based on the realistic interactive content,
    원격관리시스템을 통해서 각 개인의 운동정보를 관리하거나, 운동프로그램을 제공하거나 제공받을 수 있도록 하는 유무선통신 단계;를 더 포함하며,It further comprises a wired and wireless communication step to manage the exercise information of each individual through a remote management system, or to provide or receive an exercise program,
    실시간으로 사용자를 인식하고, 해당 사용자의 정보와 공간정보를 상기 원격관리시스템과 송수신하여 사용자의 운동정보를 원격관리시스템에서 심리스하게 관리하는 것을 특징으로 하는 실감형 인터랙티브 콘텐츠에 기반한 운동 제공 방법.Recognizing a user in real time, and by transmitting and receiving the user's information and spatial information with the remote management system to seamlessly manage the user's exercise information in the remote management system based on the realistic interactive content.
PCT/KR2015/007424 2015-06-19 2015-07-17 Exercise system based on immersive interactive contents and method therefor WO2016204334A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020150087388A KR20160150215A (en) 2015-06-19 2015-06-19 An exercising system based on augmented interactive contents and the method thereof
KR10-2015-0087388 2015-06-19

Publications (1)

Publication Number Publication Date
WO2016204334A1 true WO2016204334A1 (en) 2016-12-22

Family

ID=57545912

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2015/007424 WO2016204334A1 (en) 2015-06-19 2015-07-17 Exercise system based on immersive interactive contents and method therefor

Country Status (2)

Country Link
KR (1) KR20160150215A (en)
WO (1) WO2016204334A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023124855A1 (en) * 2021-12-31 2023-07-06 华为技术有限公司 Display method, terminal, rowing machine and communication system

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101962578B1 (en) * 2018-07-31 2019-07-17 김종범 A fitness exercise service providing system using VR
KR102299381B1 (en) * 2019-09-11 2021-09-06 노진석 Augmented reality training system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08334845A (en) * 1995-06-09 1996-12-17 Sony Corp Image display device
KR20100044588A (en) * 2008-10-22 2010-04-30 주식회사 한국액센 System for managing personal exercise history of digital muscular exerciser
KR101026686B1 (en) * 2010-01-27 2011-04-07 주식회사 미디어프론트 System and method for interactive stereoscopic image process, and interactive stereoscopic image-processing apparatus
KR20110108713A (en) * 2010-03-29 2011-10-06 동서대학교산학협력단 Tangible simulator based large-scale interactive game system and method thereof
KR20130068575A (en) * 2011-12-15 2013-06-26 한국전자통신연구원 Method and system for providing interactive augmented space

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08334845A (en) * 1995-06-09 1996-12-17 Sony Corp Image display device
KR20100044588A (en) * 2008-10-22 2010-04-30 주식회사 한국액센 System for managing personal exercise history of digital muscular exerciser
KR101026686B1 (en) * 2010-01-27 2011-04-07 주식회사 미디어프론트 System and method for interactive stereoscopic image process, and interactive stereoscopic image-processing apparatus
KR20110108713A (en) * 2010-03-29 2011-10-06 동서대학교산학협력단 Tangible simulator based large-scale interactive game system and method thereof
KR20130068575A (en) * 2011-12-15 2013-06-26 한국전자통신연구원 Method and system for providing interactive augmented space

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023124855A1 (en) * 2021-12-31 2023-07-06 华为技术有限公司 Display method, terminal, rowing machine and communication system

Also Published As

Publication number Publication date
KR20160150215A (en) 2016-12-29

Similar Documents

Publication Publication Date Title
US8963828B2 (en) Information inputting device, information outputting device and method
Caserman et al. A survey of full-body motion reconstruction in immersive virtual reality applications
Velloso et al. MotionMA: Motion modelling and analysis by demonstration
WO2017217725A1 (en) User recognition content providing system and operating method for same
JP2009297240A (en) Learning support apparatus and method
WO2018030734A1 (en) 3d simulation method and apparatus
KR101909693B1 (en) Fitness system providing virtual fitness trainer based on augmented reality
KR20170010157A (en) Method for guiding actions of an user in interactive exercise programs and the apparatus thereof
WO2020040363A1 (en) Method and device for guiding motion using 4d avatar
CN108572728B (en) Information processing apparatus, information processing method, and program
WO2016204334A1 (en) Exercise system based on immersive interactive contents and method therefor
KR20160061557A (en) System and method for assisting ambulatory rehabilitation using projected image
WO2015020396A1 (en) Motion recognition method and apparatus
TWI739551B (en) Guiding equipment for fitness
WO2022145563A1 (en) User-customized exercise training method and system
Zhou Role of human body posture recognition method based on wireless network Kinect in line dance aerobics and gymnastics training
CN117148977A (en) Sports rehabilitation training method based on virtual reality
WO2021117927A1 (en) Play experience system and physical development status acquisition method using same
Jan et al. Augmented Tai-Chi chuan practice tool with pose evaluation
US20220143467A1 (en) Automatic control of a single or multi-directional treadmill
KR102302900B1 (en) Motion analysis system for ballet teaching
JP2021097990A (en) Method for controlling training apparatus
WO2021133073A1 (en) Multi-modal interface-based haptic device
TWI533238B (en) A Movement detection and judgment device and method
Krukowski et al. User Interfaces and 3D Environment Scanning for Game-Based Training in Mixed-Reality Spaces

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15895721

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 13/04/2018)

122 Ep: pct application non-entry in european phase

Ref document number: 15895721

Country of ref document: EP

Kind code of ref document: A1