KR20170047807A - System and method for virtual fitness experience - Google Patents

System and method for virtual fitness experience Download PDF

Info

Publication number
KR20170047807A
KR20170047807A KR1020150148322A KR20150148322A KR20170047807A KR 20170047807 A KR20170047807 A KR 20170047807A KR 1020150148322 A KR1020150148322 A KR 1020150148322A KR 20150148322 A KR20150148322 A KR 20150148322A KR 20170047807 A KR20170047807 A KR 20170047807A
Authority
KR
South Korea
Prior art keywords
information
exercise
mediator
user
virtual
Prior art date
Application number
KR1020150148322A
Other languages
Korean (ko)
Other versions
KR101972472B1 (en
Inventor
백성욱
이정중
이미영
구본우
정재형
박준렬
Original Assignee
세종대학교산학협력단
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 세종대학교산학협력단 filed Critical 세종대학교산학협력단
Priority to KR1020150148322A priority Critical patent/KR101972472B1/en
Publication of KR20170047807A publication Critical patent/KR20170047807A/en
Application granted granted Critical
Publication of KR101972472B1 publication Critical patent/KR101972472B1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/22—Social work or social welfare, e.g. community support activities or counselling services
    • H04N5/225—

Landscapes

  • Business, Economics & Management (AREA)
  • Tourism & Hospitality (AREA)
  • Health & Medical Sciences (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Child & Adolescent Psychology (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A system for experience of virtual fitness comprises: fitness equipment; a plurality of display modules which display virtual content for a user who uses the fitness equipment; a plurality of agents which collect fitness information of a user who excercised on the fitness mechanism, and provide virtual content divided into the display modules; and a mediator which generates and controls virtual content. In this case, the mediator receives the fitness information collected from the agents, generates virtual content on the basis of the received fitness information, divides the generated virtual content, and transmits the virtual content to the agents connected to the display modules to display the virtual content generated in the display modules. The fitness information includes information about a driving speed of the fitness equipment or information about a movement direction of a user on the fitness equipment.

Description

SYSTEM AND METHOD FOR VIRTUAL FITNESS EXPERIENCE [0001]

The present invention relates to a system and method for a virtual fitness experience.

Recently, a virtual fitness experience service capable of providing virtual fitness based on a mixed reality space expression technique based on a recognized operation and recognizing an operation using a pressure sensor and a camera device is increasing. Conventional mixed reality space representation technologies use a head mounted display (HMD) or the like. In addition, conventional mixed real space representation technology is mainly focused on augmented reality experience or simple motion recognition and visualization based on a three-dimensional camera.

However, the hybrid reality space expression technology using the head-mounted display may cause physical maladjustment such as nausea and dizziness of the user, and there is a problem that it is painful and inconvenient due to the weight of the device such as the head-mounted display. In addition, it is difficult to accurately recognize and classify the sensing information obtained in real time in the mixed reality space expression technology based on the three - dimensional camera, and there is a disadvantage that frequent errors occur in the matching process of the recognized data and the predetermined data.

Moreover, this conventional technique acquires the activity data of the user based on the head-mounted display and the three-dimensional camera, so that there is a limit to the kind of data to be obtained. In addition, the conventional art must minimize and simplify the data to be used in expressing mixed reality space. Therefore, the conventional technology has a limitation in providing a virtual fitness experience service with immersive feeling.

In this regard, Korean Patent Registration No. 10-1508204 (entitled " Running Machine Providing a Virtual Running Racing Experience ") discloses a running machine that provides a virtual running race experience. Specifically, Belt, a control coupled to the front and rear ends of the running belt to provide the user with a virtual running racing experience through the display, based on the driving state of the display and running belt surrounding the front, top and rear of the running belt do.

SUMMARY OF THE INVENTION The present invention provides a system and a method for providing a virtual fitness experience for displaying a virtual content to a user using a fitness device.

It should be understood, however, that the technical scope of the present invention is not limited to the above-described technical problems, and other technical problems may exist.

As a technical means for achieving the above technical object, a virtual fitness experience system according to the first aspect of the present invention includes a plurality of display modules for displaying a virtual content to a user using a fitness device, a fitness device, A plurality of agents for collecting the exercise information and providing the divided virtual contents to the display module, and a mediator for generating and controlling the virtual contents. At this time, the mediator receives the exercise information collected from the plurality of agents, generates the virtual content based on the received exercise information, divides the generated virtual content, and stores the generated virtual content in the plurality of display modules To the agent connected to the plurality of display modules. And the motion information includes information on the driving speed of the exercise apparatus or information on the movement direction of the user on the exercise apparatus.

Further, the mediator in the virtual fitness experience system according to the second aspect of the present invention includes a communication module for performing data communication with a plurality of agents, a memory for storing the virtual content creation and control program, and a processor for executing a program stored in the memory do. At this time, according to the execution of the program, the processor receives the exercise information performed by the user using the exercising device collected from the agent connected to the exercise device through the communication module, based on the received exercise information, Divides the generated virtual contents so as to correspond to the plurality of display modules, and delivers the divided virtual contents to the plurality of display modules and the plurality of display modules so that the plurality of divided virtual contents are displayed on the plurality of display modules. And the motion information includes information on the driving speed of the exercise apparatus or information on the movement direction of the user on the exercise apparatus.

A method for providing virtual contents in a virtual fitness experience system according to a third aspect of the present invention includes the steps of: a step in which a mediator receives exercise information performed by a user using a fitness device from an agent connected to a fitness device among a plurality of agents, ; After the step of receiving the exercise information, generating, by the mediator, the virtual content based on the received exercise information; Dividing each of the generated virtual contents by a mediator after the step of generating virtual contents; And delivering the generated virtual content to a plurality of display modules and displaying the generated virtual content to a plurality of display modules. At this time, the exercise information includes information on the driving speed of the exercise apparatus or information on the movement direction of the user on the exercise apparatus.

Since the present invention provides virtual contents using a plurality of display modules through a plurality of agents and a mediator, it is possible to provide a user who uses the virtual contents with a virtual reality having a high sense of realism or immersion.

In addition, since the present invention can receive various kinds of motion information and control information through a plurality of agents and a mediator through a fitness device, a camera device, a mobile device, and an input device to generate virtual contents, Appropriate virtual content can be provided. The present invention can provide virtual fitness contents that can interact with a user by mixing video data, motion information, and control information obtained in real time from one or more devices through a plurality of agents and a mediator.

1 is an exemplary diagram of a virtual fitness experience system according to an embodiment of the present invention.
2 is a block diagram of a virtual fitness experience system in accordance with an embodiment of the present invention.
3 is an exemplary view of virtual content displayed on a plurality of display modules according to an embodiment of the present invention.
4 is a block diagram of a program of a mediator and agent according to an embodiment of the present invention.
5 is a block diagram of a mediator according to an embodiment of the present invention.
6 is a flowchart of a method of providing virtual contents in a virtual fitness experience system according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when a part is referred to as "including " an element, it does not exclude other elements unless specifically stated otherwise.

The following is a description of a virtual fitness experience system 100 according to an embodiment of the present invention, with reference to FIGS.

1 is an exemplary diagram of a virtual fitness experience system 100 in accordance with an embodiment of the present invention. 2 is a block diagram of a virtual fitness experience system 100 in accordance with an embodiment of the present invention.

The virtual fitness experience system 100 according to an exemplary embodiment of the present invention includes a plurality of display modules 110, a fitness device 130, a plurality of agents 150, and a mediator 160. In addition, the virtual fitness experience system 100 may include a plurality of camera devices 120, a mobile device 140, and an input device 220.

In the virtual fitness experience system 100, the plurality of display modules 110 provide virtual content for a virtual fitness experience to a user using the fitness device 130. [ The virtual contents displayed by each of the plurality of display modules 110 are generated by the mediator 160 and then transmitted to the plurality of display modules 110 through the agent 150. That is, the plurality of display modules 110 receive and display the virtual contents received from the mediator 160 through the plurality of display modules 110 and the agents 150 connected to the plurality of display modules 110, respectively. The plurality of display modules 110 are controlled by the control information received from the mediator 160 through the plurality of display modules 110 and the agents 150 connected to the plurality of display modules 110. At this time, the plurality of display modules 110 included in the virtual fitness experience system 100 can display different virtual contents.

The plurality of camera devices 120 collect image data of a user using the virtual fitness experience system 100 or a fitness device 130 used by the user. At this time, the plurality of camera devices 120 may be a general camera device, a three-dimensional camera device, an infrared camera device, and the like, but is not limited thereto. In addition, the plurality of camera devices 120 may be coupled to the display module 110.

The exercise device 130 is a device that the user directly uses in the virtual fitness experience system 100. At this time, the exercise device 130 may be an exercise bicycle, a treadmill, a rowing machine, or the like, but is not limited thereto. The exercise device 130 is connected to the agent 150 to collect the user's exercise information and control information. In addition, the exercise device 130 transmits the exercise information and the control information of the user to the mediator 160 through the agent 150.

At this time, the exercise device 130 may include one or more input devices 220 that can collect exercise information and control information of the user using the exercise device 130. [ For example, if the exercise device 130 is an exercise bike, as shown in FIG. 1, the exercise device 130 may include an input device 220, such as a handle controller 131 and a pedal accelerator control device 132 have. That is, the steering wheel controller 131 and the pedal accelerator system controller 132 generate and transmit user's motion information and control information to the agent 150 directly connected or connected through the exercise device 130. The input device 220 such as the handle controller 131 and the pedal accelerator control device 132 may be directly connected to the MIDI airer 160 to transmit motion information and control information. However, the concrete structure of the exercise device 130 corresponds to the embodiment, and the present invention is not limited thereto, and can be variously modified.

The mobile device 140 may collect movement information and control information of the user. The mobile device 140 may transmit the collected exercise information and control information to the mediator 160. That is, the mobile device 140 collects movement information and control information of the user using the sensor module included in the mobile device 140, and transmits the virtual information to the display module 110 through the mediator 160, Can be controlled.

The agent 150 is connected to the exercise device 130 and the plurality of display modules 110. The agent 150 collects motion information and control information of the user through the plurality of camera devices 120 combined with the exercise device 130, the plurality of display modules 110, and the plurality of display modules 110, do. The agent 150 transmits the collected exercise information and control information to the mediator 160. Also, the virtual content segmented from the mediator 160 is received and displayed on the plurality of display modules 110.

The mediator 160 receives one or more motion information and control information of the user from the plurality of agents 150. The mediator 160 may receive motion information and control information through the input device 220 directly connected to the mobile device 140 and the mediator 160. The mediator 160 integrates the user's one or more motion information and control information received from the plurality of agents 150, the mobile device 140 and the input device 220. The mediator 160 generates virtual contents based on the integrated motion information, and divides the generated virtual contents so as to be displayed on the plurality of display modules 110. The mediator 160 transmits the divided virtual content to the agent 150 connected to the plurality of display modules 110 so as to display the divided virtual contents.

As described above, the virtual fitness experience system 100 according to an embodiment of the present invention can provide virtual contents to a user using the exercise device 130, as shown in FIG.

3 is an exemplary view of virtual content displayed on a plurality of display modules 110 according to an embodiment of the present invention.

The virtual fitness experience system 100 according to an embodiment of the present invention collects the user's exercise information and control information through the plurality of agents 150 and transmits the collected exercise information and control information to the mediator 160 do. The virtual fitness experience system 100 also collects movement information and control information of the additional user through the mobile device 140 and the input device 220 and transmits it to the mediator 160. [ The virtual fitness experience system 110 generates virtual contents via the mediator 160 according to the transmitted exercise information and control information, and divides the generated virtual contents so as to be displayed on the plurality of display modules. As shown in FIG. 3, the virtual fitness experience system 110 displays the divided virtual contents from the mediator 160 through the agent 150, which receives the divided virtual contents, from the connected display module 110.

At this time, the mediator 160 and the plurality of agents 150 may be a computing device including a communication module, a memory, and a processor, respectively. At this time, the mediator 160 and the plurality of agents 150 may be implemented by different devices, respectively. Alternatively, a plurality of mediators 160 and a plurality of agents 150 may be implemented in software, respectively, and loaded in the same apparatus.

The mediator 160 may perform data communication with the plurality of agents 150, the mobile device 140, and the input device 220 through the communication module. The plurality of agents 150 performs data communication with the motion device 130, the plurality of display modules 110, the camera device 120 coupled with the display module 110, and the mediator 160 through the communication module can do.

The mediator 160 and the processors of the plurality of agents 150 can perform their respective roles, respectively, based on the information processing and control programs stored in the memory. The programs respectively stored in the mediator 160 and the plurality of agents 150 will be described with reference to FIG.

4 is a block diagram of a program of the mediator 160 and the agent 150 according to an embodiment of the present invention.

The program stored in the mediator 160 includes a control module 400, a virtual content segmentation module 410, an information calculation and merging module 420 and an information transmission and reception module 430.

At this time, the control module 400 determines whether or not to execute the virtual content displayed on the plurality of display modules 110, control such as the playback speed adjustment, based on the control information received from the mobile device 140 and the input device 220 Information can be managed. At this time, the control information may be received from the mobile device 140 and the input device 220 via the information transmission / reception module 430, and then processed by the information operation and merging module 420. The control information is also used for status control and drive control for the exercise device 130 and the plurality of camera devices 120 connected to the agent 150 based on the control information received from the mobile device 140 and the input device 220. [ It is possible to manage control information such as control.

The virtual content segmentation module 410 can generate virtual content based on the user's motion information and control information processed from the information calculation and merging module 420. [ In addition, the virtual content segmentation module 410 may divide the virtual content generated through the information transmission / reception module 430 into a plurality of display modules 110 for display.

The information operation and merging module 420 performs operations on a plurality of motion information and control information received from the mobile device 140, the plurality of agents 150 and the input device 220 through the information transmission / Perform a merge, and create a global data model.

The information transmission / reception module 430 may receive motion information and control information from the mobile device 140, the plurality of agents 150, and the input device 220. The information transmission / reception module 430 may transmit the generated virtual content to the agent 150 connected to the display module 110 so that the virtual content is displayed on the plurality of display modules 110.

The program stored in the agent 150 includes a recognition module 440, a control module 450, a visualization module 460, and an information transmission / reception module 470.

The recognition module 440 analyzes the data received from the exercise device 130 and the plurality of camera devices 120 connected to the agent 150 to generate motion information or control information. To this end, the recognition module may process the received data to generate a local data model. At this time, the data may be received from the exercise device 130 and the plurality of camera devices 120 through the information transmission / reception module 470.

The control module 450 can control the plurality of display modules 110, the plurality of cameras 120 and the exercise device 130 based on the control information received from the mediator 160. [ At this time, the control information may be received by the information transmission / reception module 470 from the mediator 160 and transmitted.

The visualization module 460 can visually visualize the virtual content received from the mediator 160 through the information transmission / reception module 470. At this time, in order to display the virtual contents in the plurality of display modules 110, the virtual contents can be visualized based on the pre-stored local data model and the motion information and control information received from the information transmission / reception module 470 . In addition, the visualization module 460 can transmit visualized virtual contents to be displayed on the plurality of display modules 110 through the information transmission / reception module 470.

The information transmission and reception module 470 may receive motion information and control information from a plurality of display modules 110, a plurality of cameras 120, and a fitness device 130 connected to the agent 150. In addition, the information transmission / reception module 470 may transmit motion information and control information to the mediator 150, and may transmit the virtualized contents to the plurality of display modules 110.

The concrete contents of the virtual fitness experience system 100 will be described with reference to FIG. 2 as an example.

2, the virtual fitness experience system 100 according to an exemplary embodiment of the present invention includes a fitness device 130, first to third display modules 200, 201 and 202, To fourth agents 210, 211, 212, and 213, and a mediator 160. [ The virtual fitness experience system 100 may also include a mobile device 140, a camera device 120, and an input device 220. At this time, the camera device 120 may be combined with the second display module 201. However, since the virtual fitness experience system 100 of FIG. 2 is only an embodiment of the present invention, the present invention is not limited to FIG.

In addition, the first to fourth agents 210, 211, 212, and 213 according to an embodiment of the present invention are distinguished for convenience. Therefore, the first to fourth agents 210, 211, 212, and 213 may be different devices, respectively. Alternatively, a plurality of agents 150 among the first to fourth agents 210, 211, 212, and 213 may be installed in one apparatus, 200, 201, 202, and a mediator 160, and the like.

For example, the first to third agents 200, 201, and 202 may be implemented in software and installed in one agent computing device. That is, the agent computing device may be connected to the first to third display modules 200, 201, and 202 and the mediator 160. Upon receiving the divided virtual content from the mediator 160, the agent computing device transmits the virtual content from the first display module to the third display module 200, through the first to third agents 210, 211, and 212, 201, and 202, respectively.

Meanwhile, the mediator 160 collects the exercise information collected by the plurality of agents 150. Specifically, the fourth agent 213 connected to the exercise device 130 can collect exercise information performed by the user on the exercise device 130 through the exercise device 130. At this time, the exercise information may be collected through the fourth agent 213 after receiving through the exercise device 130. [ In addition, the exercise information may be collected in the exercise device 130 and transmitted to the fourth agent 213.

The fourth agent 213 generates a local data model based on the collected exercise information, and transmits the collected exercise information to the mediator 160. The motion information may include information on the driving speed for the exercise device 130 or information on the direction of movement of the user on the exercise device 130. [

At this time, the local data model may be generated based on the motion information and control information collected by the agent 150, and then stored in the agent 150. That is, the fourth agent 213 may update or newly generate a pre-stored local data model based on the collected exercise information to generate a local data model.

When the mediator 160 receives the exercise information from the fourth agent 213, the mediator 160 may generate a global data model based on the received exercise information. As with the agent 150, the global data model may be generated by the mediator 160 and then pre-stored in the mediator 160. That is, the mediator 160 may update or create a previously stored global data model to generate a global data model.

Further, the mediator 160 generates the virtual content based on the exercise information received from the fourth agent 213. [ At this time, the generated virtual content may be generated after the virtual content being displayed to the current user. In order to maximize the effect of the user exercising through the exercise device 130, the virtual content may be generated based on a virtualized space formed by three-dimensional modeling, which is similar to the actual real space.

The mediator 160 generates the virtual content and then generates the divided virtual content so that the virtual content generated in the first to third display modules 200, 201, and 202 can be displayed. At this time, the divided virtual contents can be synchronously displayed on the divided screen of the virtual contents so that they can be simultaneously displayed on the plurality of display modules.

The mediator 160 transmits the divided virtual contents to the first to third agents 210, 211, and 212 to be displayed on the first to third display modules 200, 201, and 202.

The first to third agents 210, 211, and 212 receiving the divided virtual contents can visualize the virtual contents based on the regional data model previously stored in each agent. As shown in FIG. 3, the first to third agents 210, 211, and 212 can display visualized virtual contents on the first to third display modules 200, 201, and 202, respectively.

Referring again to FIG. 3, the first to third display modules 200, 201, and 202 may display the divided virtual contents, respectively. For example, the first display module 200 may display a virtual content in which a current speed, a current position, a usage time, and a movement state of the user on the virtual content are expressed in a dashboard form. The second display module 201 can display virtual contents including the foreground viewed from the front of the exercise device 130. [ The third display module 202 may display the virtual content including the mini-map for the entire virtual content.

As described above, the virtual contents generated by the mediator 160 may have different images and information displayed on the display module 110, respectively. In addition, the virtual content displayed on each display module 110 may include additional information such as a dashboard and a mini-map. In this way, the virtual content can be divided and displayed on each of the plurality of display modules 110, thereby providing a sense of realism and immersion to the user.

Meanwhile, the mediator 160 may receive the motion information or the control information of the user collected in the mobile device 140, and may generate the virtual content based on the received motion information or control information.

Specifically, the mobile device 140 may collect motion information or control information based on the sensor module included in the mobile device 140. [ At this time, the sensor module may be an accelerometer sensor, a gyroscope sensor, a geomagnetic sensor, a motion sensor, and the like, but is not limited thereto. In addition, the control information may be information such as playback control such as playback, pause, stop and playback speed adjustment of the virtual content, directional control of the virtual content, and the like. The mobile device 140 may collect motion information or control information and then transmit the motion information or control information collected to the mediator 160.

When the mobile device 140 transmits the collected exercise information or control information to the mediator 160, the mediator 160 may receive the user's exercise information or the user's control information collected by the mobile device 140. The mediator 160 may generate a global data model and generate virtual content based on the motion information or control information collected from the mobile device 140. [

In addition, the mediator 160 may collect motion information or control information of the user collected through the plurality of camera apparatuses 120.

Specifically, the plurality of camera devices 120 can generate image data for the user and the exercise device 130. [ The plurality of camera devices 120 may transmit image data generated by the second agent 211 of the second display module 210 to which the plurality of camera devices 210 are coupled. At this time, the plurality of camera devices 120 may be a plurality of general camera devices or a three-dimensional camera device including an infrared sensor module, an RGB sensor module, and a depth sensor module.

That is, the second agent 211 can receive image data from the plurality of camera devices 120. [ The second agent 211 may merge the image data received from the plurality of camera devices 120 or may analyze the image data to generate motion information or control information. At this time, the second agent 211 extracts features from the image data received from the plurality of camera devices 120, and extracts motion information or control information through image analysis or image recognition of the extracted features can do. The second agent 211 may transmit the generated motion information or control information to the mediator 160.

For example, if the exercise device 130 is an exercise bicycle, the second agent 211 may use the handle inclination degree of the gesture included in the user's image data on the exercise bicycle and the image data of the exercise bicycle Direction, or the like to generate motion information or control information.

The mediator 160 can receive motion information or control information of the user based on the image data collected by the plurality of camera devices 120 from the second agent 211. [ The mediator 160 can generate a global data model based on the exercise information collected from the plurality of camera devices 120 and generate the virtual content.

In addition, the mediator 160 may receive the motion information or the control information of the user collected from the input device 220.

Specifically, the input device 220 may collect motion information or control information of the user. The input device 220 may transmit the collected motion information or control information to the mediator 160. The mediator 160 may receive the user's exercise information or the user's control information collected by the input device 220 from the input device 220 and may use it to generate the virtual content.

As such, the mediator 160 may receive motion information or control information from a plurality of devices, such as the exercise device 130, the mobile device 140, the plurality of camera devices 120, and the input device 220. When the mediator 160 receives motion information or control information from a plurality of devices, the mediator 160 may combine the motion information or control information collected from the plurality of devices, and generate the global data model and the virtual content.

5, a mediator 160 according to an embodiment of the present invention will be described.

5 is a block diagram of a mediator 160 according to an embodiment of the present invention.

The mediator 160 generates virtual content and provides a virtual fitness experience to the user through a plurality of displays. In this case, the mediator 160 includes a communication module 500, a memory 510, and a processor 520.

The communication module 500 performs data communication with a plurality of agents 150. In addition, the communication module 500 may perform data communication with the mobile device 140 and the input device 220.

Specifically, the communication module 500 can receive motion information or control information collected from the exercise device 130 and the plurality of camera devices 120, which are transmitted through the plurality of agents 150. In addition, the communication module 500 may receive motion information or control information collected from the mobile device 140 and the input device 220. The communication module 500 can transmit the virtual content to the plurality of display modules 110 through the plurality of agents 150.

The memory 510 stores a program for creating and controlling virtual contents. At this time, the memory 510 collectively refers to a non-volatile storage device that keeps stored information even when power is not supplied, and a volatile storage device that requires power to maintain stored information.

The processor 520 executes the program stored in the memory 510. The processor 520 executes a program on the exercise device 130 by the user using the exercise device 130 collected from the agent 150 connected to the exercise device 130 via the communication module 500 And receives one exercise information. At this time, the motion information includes information on the driving speed of the exercise device 130 or information on the movement direction of the user on the exercise device 130.

The processor 520 then generates the virtual content based on the received exercise information. The processor 520 divides the generated content so as to correspond to the plurality of display modules 110, respectively. The processor 520 transmits the divided virtual contents to the agent 150 connected to the plurality of display modules 110 through the communication module 500 so as to be displayed on the plurality of display modules 110.

Next, with reference to FIG. 6, a virtual content providing method of the virtual fitness experience system 100 according to an embodiment of the present invention will be described.

6 is a flowchart of a virtual content providing method of the virtual fitness experience system 100 according to an embodiment of the present invention.

The mediator 160 in the virtual fitness experience system 100 may be configured such that the user using the exercise device 130 from the agent 150 connected to the exercise device 130 among the plurality of the agents 150 performs the exercise And receives exercise information (S600). At this time, the motion information includes information on the driving speed of the exercise device 130 or information on the movement direction of the user on the exercise device 130.

After receiving the exercise information, the mediator 160 generates the virtual content based on the received exercise information (S610).

In addition, the mediator 160 generates the virtual content, and then divides the generated virtual content (S620). At this time, the mediator 160 may divide the virtual content so that the virtual content corresponds to the plurality of display modules 110 to be displayed. In addition, the mediator 160 may divide the virtual content so as to include a sync point so that the plurality of display modules 110 can be simultaneously displayed.

The mediator 160 divides the virtual content and transmits the virtual content to the agent 150 connected to the plurality of display modules 110 in order to display the virtual content generated in the plurality of display modules 110 in operation S630.

The agent 150 connected to the plurality of display modules 110 may display the virtual contents in the plurality of display modules 110 after receiving the divided virtual contents from the mediator 160.

In the virtual fitness experience system 100, motion information or control information can be generated from the mobile device 140, the plurality of camera devices 120, and the input device 220 as well as the exercise device 130.

As described above, the mobile device 140 and the input device 220 of the virtual fitness experience system 100 can collect the user's exercise information or control information. The mobile device 140 and the input device 220 may transmit motion information or control information to the mediator 160, respectively.

In addition, the mediator 160 can collect motion information of the user through the plurality of camera devices 120. [

Specifically, when the image data is collected through the plurality of camera devices 120, the agent 150 connected to the plurality of camera devices 120 receives the collected image data from the plurality of camera devices 120, . The agent 150 connected to the plurality of camera devices 120 may generate motion information of the user based on the analyzed image data, and may transmit the generated motion information of the user to the mediator 160. The agent 150 connected to the plurality of camera devices 120 may be an agent 150 connected to the display module 110 coupled with the plurality of camera devices 120.

The mediator 160 receives motion information or control information from the mobile device 140 and the input device 220 and the agent 150 connected to the plurality of camera devices 120 and generates motion information or control information based on the received motion information or control information Virtual content can be created.

The virtual fitness experience system 100 and the method according to an embodiment of the present invention provide virtual contents using a plurality of display modules 110 through a plurality of agents 150 and a mediator 160, It is possible to provide a virtual content having a high sense of realism or immersive feeling to a user who uses the content.

The virtual fitness experience system 100 and its method also include a fitness instrument 130, a plurality of camera devices 120, a mobile device 140 and an input device (not shown) via a plurality of agents 150 and a mediator 160 220 to receive various kinds of motion information and control information to generate virtual contents, so that it is possible to provide virtual contents suitable for the current exercise state of the user. In particular, the virtual fitness experience system 100 and its method combine video data, motion information, and control information obtained in real time from one or more devices, via a plurality of agents 150 and mediators 160, It is possible to provide virtual fitness contents that can operate.

One embodiment of the present invention may also be embodied in the form of a recording medium including instructions executable by a computer, such as program modules, being executed by a computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, the computer-readable medium may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes any information delivery media, including computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transport mechanism.

While the methods and systems of the present invention have been described in connection with specific embodiments, some or all of those elements or operations may be implemented using a computer system having a general purpose hardware architecture.

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

100: virtual fitness experience system 110 display module
120: camera device 130: exercise equipment
131: Handle controller 132: Pedal accelerometer control device
140: mobile device 150: agent
160: The mediator

Claims (12)

In a virtual fitness experience system,
Fitness equipment,
A plurality of display modules for displaying a virtual content to a user using the exercise device,
A plurality of agents collecting exercise information performed by the user on the exercise machine and providing the divided virtual contents to the display module,
And a mediator for generating and controlling the virtual content,
The mediator receives the collected exercise information from the plurality of agents,
Generates a virtual content based on the received exercise information,
Dividing the generated virtual contents into respective ones of the plurality of display modules, and transmitting the generated virtual contents to the plurality of display modules,
Wherein the exercise information includes information on a driving speed of the exercise apparatus or information on a movement direction of the user on the exercise apparatus. The method according to claim 1,
Wherein the mediator generates the divided virtual content to include a synchronization point that allows the display modules to be simultaneously displayed. The method according to claim 1,
Further comprising a mobile device,
Wherein the mediator receives one of movement information of the user and control information of the user from the mobile device,
Wherein the mobile device collects at least one of the movement information of the user and the control information of the user, and transmits the collected information to the mediator. The method according to claim 1,
Further comprising a plurality of camera devices coupled to the display module and collecting image data,
Wherein the mediator receives motion information of the user collected from the plurality of camera devices via an agent connected to the plurality of cameras among the plurality of cameras,
Wherein the agent connected to the plurality of camera devices analyzes the image information collected from the plurality of camera devices, generates the exercise information, and transmits the generated exercise information to the mediator. The method according to claim 1,
Further comprising an input device,
Wherein the mediator receives at least one of exercise information and control information collected from the input device. In a mediator in a virtual fitness experience system,
A communication module for performing data communication with a plurality of agents,
The virtual content creation and control program is stored in the memory and
A processor for executing a program stored in the memory,
Wherein the processor receives, through the communication module, exercise information performed by a user using the exercising device collected from an agent connected to the exercise device on the exercise device,
The virtual content is divided into a plurality of display modules corresponding to the plurality of display modules based on the received motion information, and the plurality of divided virtual contents are displayed on the plurality of display modules, To an agent connected to the display module,
Wherein the exercise information includes information on a driving speed of the exercise machine or information on a direction of movement of the user on the exercise machine. A method for providing virtual contents in a virtual fitness experience system,
The exercise of the exercise performed by the user using the exercise machine from the agent connected to the exercise machine among the plurality of agents by the mediator;
After the step of receiving the exercise information, the mediator generating virtual content based on the received exercise information;
After the step of generating the virtual content, dividing each of the generated virtual contents by the mediator; And
And delivering the generated virtual content to an agent connected to the plurality of display modules so that the generated virtual content is displayed on a plurality of display modules after each step of dividing the virtual contents,
Wherein the movement information includes information on a driving speed of the exercise apparatus or information on a movement direction of the user on the exercise apparatus. 8. The method of claim 7,
The step of generating the virtual content
And generating the divided virtual content so as to include a synchronization point enabling the plurality of display modules to be simultaneously displayed. 8. The method of claim 7,
Further comprising the step of receiving, before the step of generating the virtual content, at least one of the user's exercise information and the user's control information collected by the mobile device,
Wherein the step of generating the virtual content is to generate the virtual content based on at least one of the motion information of the user and the control information of the user collected by the mobile device,
Wherein the mobile device collects at least one of the movement information of the user and the control information of the user, and transmits the collected information to the mediator. 8. The method of claim 7,
Before the step of generating the virtual content,
Further comprising the step of the mediator receiving motion information of the user collected from the plurality of camera devices through an agent connected to a plurality of camera devices among the plurality of cameras,
The plurality of camera devices being coupled to the display module and collecting image data,
Wherein the agent connected to the plurality of camera devices analyzes the image information collected from the plurality of camera devices, generates the motion information, and transmits the generated motion information to the mediator. 8. The method of claim 7,
Before the step of generating the virtual content,
Wherein the mediator further comprises receiving at least one of exercise information and control information collected from an input device. A computer-readable recording medium recording a program for performing the method according to any one of claims 7 to 11 on a computer.
KR1020150148322A 2015-10-23 2015-10-23 System and method for virtual fitness experience KR101972472B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150148322A KR101972472B1 (en) 2015-10-23 2015-10-23 System and method for virtual fitness experience

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150148322A KR101972472B1 (en) 2015-10-23 2015-10-23 System and method for virtual fitness experience

Publications (2)

Publication Number Publication Date
KR20170047807A true KR20170047807A (en) 2017-05-08
KR101972472B1 KR101972472B1 (en) 2019-04-25

Family

ID=60164179

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150148322A KR101972472B1 (en) 2015-10-23 2015-10-23 System and method for virtual fitness experience

Country Status (1)

Country Link
KR (1) KR101972472B1 (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003241639A (en) * 2002-02-15 2003-08-29 Sharp Corp Virtual space simulation device
KR20090048207A (en) * 2007-11-09 2009-05-13 광주과학기술원 System and method for integrating multiple display devices
KR20090122875A (en) * 2008-05-26 2009-12-01 (주)다림시스템 Real-time virtual realrity sports platform apparutus using feedback motion base and power feedback health equipments
US20130169527A1 (en) * 1997-08-22 2013-07-04 Timothy R. Pryor Interactive video based games using objects sensed by tv cameras
KR20140133373A (en) * 2013-05-11 2014-11-19 계명대학교 산학협력단 Exercising system and method based on motion capture using user movement patterns
KR20150070469A (en) * 2013-12-16 2015-06-25 (주) 앙클 Health System Using Smart Bicycle Application
KR20150111428A (en) * 2014-03-21 2015-10-06 주식회사 플러 Digital signage apparatus and operating method thereof

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130169527A1 (en) * 1997-08-22 2013-07-04 Timothy R. Pryor Interactive video based games using objects sensed by tv cameras
JP2003241639A (en) * 2002-02-15 2003-08-29 Sharp Corp Virtual space simulation device
KR20090048207A (en) * 2007-11-09 2009-05-13 광주과학기술원 System and method for integrating multiple display devices
KR20090122875A (en) * 2008-05-26 2009-12-01 (주)다림시스템 Real-time virtual realrity sports platform apparutus using feedback motion base and power feedback health equipments
KR20140133373A (en) * 2013-05-11 2014-11-19 계명대학교 산학협력단 Exercising system and method based on motion capture using user movement patterns
KR20150070469A (en) * 2013-12-16 2015-06-25 (주) 앙클 Health System Using Smart Bicycle Application
KR20150111428A (en) * 2014-03-21 2015-10-06 주식회사 플러 Digital signage apparatus and operating method thereof

Also Published As

Publication number Publication date
KR101972472B1 (en) 2019-04-25

Similar Documents

Publication Publication Date Title
US20180357978A1 (en) Method and devices used for implementing augmented reality interaction and displaying
TWI786701B (en) Method and system for eye tracking with prediction and late update to gpu for fast foveated rendering in an hmd environment and non-transitory computer-readable medium
JP6431198B2 (en) Head mounted display, method for tracking movement of head mounted display, and storage medium
US10871934B2 (en) Virtual content displayed with shared anchor
US10617963B2 (en) Method and system for controlling virtual reality attraction
US20150138065A1 (en) Head-mounted integrated interface
US20180143693A1 (en) Virtual object manipulation
US11278810B1 (en) Menu placement dictated by user ability and modes of feedback
CN106454322A (en) VR Image processing system and method thereof
US11687159B2 (en) VR sickness reduction system, head-mounted display, VR sickness reduction method, and program
CN109314800B (en) Method and system for directing user attention to location-based game play companion application
US10437055B2 (en) Master device, slave device, and control method therefor
US20210060433A1 (en) System and Method for Creation and Control of Interactive User Interfaces
US20230267664A1 (en) Animation processing method and apparatus, electronic device and storage medium
KR101972472B1 (en) System and method for virtual fitness experience
EP4036690A1 (en) Information processing device, information processing method, server device, and program
CN112558759A (en) Education-based VR (virtual reality) interaction method, interaction development platform and storage medium
JP5660573B2 (en) Display control apparatus, display control method, program, and recording medium
CN109144234A (en) Virtual reality system and its control method with external tracking and built-in tracking
EP4086102B1 (en) Navigation method and apparatus, electronic device, readable storage medium and computer program product
US20210385299A1 (en) Method and apparatus for augmented reality interaction and presentation
WO2024024037A1 (en) Image processing for generating augmented reality image
JP7027753B2 (en) Information processing equipment and programs
JP2010284258A (en) Game device and game program
CN114089890A (en) Vehicle driving simulation method, device, storage medium and program product

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
AMND Amendment
E601 Decision to refuse application
AMND Amendment
X701 Decision to grant (after re-examination)