WO2014200342A1

WO2014200342A1 - Video overlay system

Info

Publication number: WO2014200342A1
Application number: PCT/NL2014/050379
Authority: WO
Inventors: Martin SMITS
Original assignee: Tacx B.V.
Priority date: 2013-06-12
Filing date: 2014-06-11
Publication date: 2014-12-18
Also published as: NL2010957C2

Abstract

The present invention relates to a computer program for generating a video image on a display, which is connected, during use, to a computer, which computer comprises a processor and a memory coupled to the processor, where in the computer program comprises instructions, which, after being loaded in the memory, enable the processor to: -data exchange with a fitness device that is connected to the computer via communicative coupling during a training session, -data exchange with the display, which, during use, is connected to the computer via communicative coupling, for display of a pre-recorded video of a training course, such as a walking course in case of a treadmill or a bicycle course in case of a bicycle trainer, characterized by instructions for displaying on the display an overlay on the video image of the current position of a current user of the fitness device in the training course.

Description

Video overlay system

The present invention relates to a computer program for generating a video image on a display, which is connected, during use, to a computer, which computer comprises a processor and a memory coupled to the processor, wherein the computer program comprises instructions, which, after being loaded in the memory, enable the processor to:

- data exchange with a fitness device that is connected to the computer via communicative coupling during a training session,

- data exchange with the display, which, during use, is connected to the computer via communicative coupling, for display of a pre-recorded video of a training course, such as a walking course in case of a treadmill or a bicycle course in case of a bicycle trainer.

From the Dutch patent publication L1019154 C2 a fitness device is known in the form of a bicycle trainer with a frame that is adapted for placing a bicycle therein, which frame is provided with an adjustable brake member that is in frictional contact with a driven wheel of the bicycle, when a bicycle is placed in the frame. The bicycle is equipped with means for connection with a computer with an attached image monitor for displaying a bicycle path. Furthermore, the brake member can be connected to the computer for configuring the brake member in dependence of the current position in the bicycle course shown on the image monitor.

L1019154 C2 also describes an assembly of a first and a second bicycle trainer, wherein the computer of the first bicycle trainer is arranged for communicative coupling with the computer of the second bicycle trainer, and in such a way that the image monitor of both the first and the second bicycle trainer shows the position of the users of both bicycle trainers, in the bicycle course, and that the brake members of the first and the second bicycle trainer can be configured in accordance with those positions.

Other types of fitness devices and associated computer programs are also known, that, during a training session, display a moving video image or video of the route to be followed from the perspective of the first person. This video image or the video concerns a previously made video recording of the training course and the surroundings thereof to offer the user a simulation of the training course which is as lifelike as possible - although 'static' (i.e. being only a sequence of frames).

A disadvantage of the known fitness devices and associated computer programs is that the presentation of the training course, such as a walking route or a bicycle route, to the user, leaves to be desired, especially since the video is 'static'. This undermines the 'authenticity sensation' of the fitness device. In addition, it is relatively difficult for the user to optimize the results of his training work.

It is therefore an object of the invention to provide a computer program, wherein the presentation of the training course to be traveled by the user is improved.

It is a further object of the invention to provide a computer program wherein the authenticity sensation of the fitness device is improved.

A still further object of the invention is to provide a computer program that allows the user to optimize the results of his training work.

To this end, the computer program according to the invention is characterized by instructions for displaying on the display an overlay on the video image of the current position of a current user of the fitness device in the training course, wherein data concerning a previous training session of a previous user of the fitness device or a real life training session of the previous user are read from a database, wherein the data includes at least the progression of the position of the previous user in the training course during the previous training session, wherein the progression is displayed during the current session in the overlay or instructions, which, after being loaded into memory, enable the processor to data exchange between the computer of the fitness device of the current user and a computer from another fitness device of another user, via communicative coupling, wherein the data at least comprises sharing the current positions of the current and other users in the training process, wherein the current position of the other user is shown in the overlay of the training process of the current user.

In the context of this patent application "overlay" is to be taken as a computer- generated text, graph, or in a general sense, graphical information that is superimposed on a moving video image.

By displaying an overlay on the video image of the current position of the user in the bicycle course, wherein the overlay displays the position of the previous or other user in the same training course, it is achieved that the authenticity sensation is improved. The overlay also gives the user the ability to optimize the results of his training work, because the user can better respond to e.g. changes in the position, velocity or accelerations or decelerations of any previous or other user in the training course.

The fitness device can concern a trainer for walking, like a treadmill, a bicycle trainer, or similar devices. The data with regard to the previous training session may be read out, for example, from a file or a database in which the data from the previous training session are stored.

Preferably, positional information regarding the position of the current user in the course is to be obtained by studying the course through a database with GPS- information, to obtain 3D GPS-coordinates for the whole of the course. The retrieval of GPS-coordinated can be done well after the recording of the static video, allowing the invention to be used with videos that have been recorded a long time ago. The position of the current user in the course (the distance covered) and the speed of the current user are represented in the static video by respectively the frame (number) and frame rate. The frame and frame rate are preferably to be calculated based on the speed of rotation of the driven wheel multiplied by its outer diameter. According to the invention, the current frame displayed by the static video can then be complemented by the video overlay, which then e.g. utilizes the GPS-information to display additional information. Thus, the additional information can be gathered long after the static (perhaps originally analogue) video has been recorded, to be (graphically) combined therewith at a later stage (i.e. fully independent of the video recording). This allows a current user to keep using his favorite static course video, without having to buy new software, including a newly recorded video. Furthermore, this decreases the burden on both the user as well as the software developer, since only an upgrade to the video overlay system is necessary.

An embodiment relates to a computer program, characterized by instructions, which, after being loaded into memory, enable the processor to exchange data between the computer of the fitness device of the current user and a computer from another fitness device of another user, via communicative coupling, wherein the data exchange comprises at least exchanging the current positions of the current and other users in the training course, in which the current position of the other user is shown in the overlay of the training course of the current user. The authenticity thrill of the training session, is thus increased, because the users, just like for example in a walking course or bicycle course actually to be driven, will experience the psychological pressure of the presence of other users, such as runners or cyclists, and this in 'real time'.

Most importantly, according to the invention the video overlay allows the display of the position and performance of other users in the (static) video in a graphical way. This may concern a wide range of variables, as will be explained below. Preferably, such data is processed directly by the software on the computer of the users, instead of via an intermediate server.

An embodiment relates to a computer program characterized by instructions that display the position of the previous or other user in the overlay of the training course of the current user by means of a first icon, if the previous or other user is situated ahead of the current user in the training course and a second icon when the previous or another user is behind the current user in the training course. This gives the current user a relatively simple but effective representation of the position of the other or previous user. Obviously, many shapes, colors and the like are conceivable to display the above- mentioned icons.

An embodiment relates to a computer program characterized by instructions that show an acceleration of the previous or other user in the overlay of the training course of the current user to view by means of a first graphical indicator, when the first or other user accelerates with respect to the current user in the training course and a second graphical indicator, when the previous or other user slows down relative to the current user in the training course. Again, the authenticity sensation is thus increased.

An embodiment relates to a computer program, characterized by instructions for data exchange with an adjustable brake member of a fitness device in the form of a bicycle trainer, which is connected to the computer during a training session, via communication coupling, which brake member is mounted in a frame of the bicycle trainer, which frame is suitable for the placing of a bicycle therein, wherein the brake member in friction contact with a driven wheel of the bicycle, when a bicycle is placed in the frame, wherein the brake member can be configured in dependence of the current position in the bicycle course of the current user as shown on the display.

An embodiment relates to a computer program characterized by instructions for processing, and displaying in the overlay a rotation speed of the driven wheel of the bicycle as measured by a measuring means. Thus, the user of the bicycle trainer can immediately see on the display how many revolutions the drive wheel is doing per unit of time. In addition, other related variables related to the training session, such as the rotational speed of the crankshaft and the cadence, can be derived from the rotation speed and, if desired, can also be displayed on the display by means of the overlay.

An embodiment relates to a computer program, characterized by instructions for calculating and displaying the current speed in the training course in the overlay based on the rotation speed. On the basis of the measured rotation speed, the speed in the training course can be calculated and displayed in an advantageous manner by multiplication thereof with the outer diameter of the driven wheel.

An embodiment relates to a computer program, characterized by instructions for calculating and displaying the distance covered in the training course based on the rotation speed in the overlay. Based on the speed calculated by the computer program, the distance covered in the bicycle course can advantageously be established and displayed.

An embodiment relates to a computer program, characterized by instructions for displaying, in the overlay, a horizon line in the training course. Thus, the user of the bicycle trainer can see if the road has a slope, i.e. goes up or goes down.

An embodiment relates to a computer program, characterized by instructions for calculating and displaying in the overlay a current resistance of the brake member, the slope of the training course at the location of the current position in the training course, the current time or the current rate of climb or descent. By displaying the resistance of the brake member the user gets current information about the resistance that he or she has to overcome. By displaying the slope, the user directly gets information about if he or she is climbing or descending. By displaying the climb or descent rate, the user obviously knows how fast he or she climbs or descends. On the basis of this climb or descent rate, the computer program can further increase the resistance of the brake member to for example mimic lower or higher concentrations of oxygen at altitude.

An embodiment relates to a computer program characterized by instructions that display in the training course of the current user, in the overlay, the difference in the positions of the current and the previous or other user to view by means of a time difference expressed numerically. Thus, the current user can directly see how much time he or she is ahead or lags behind with respect to the other or previous user. An embodiment relates to a computer program characterized by instructions wherein the overlay displays a marker, that marks a part of the training course still to be covered in relation to the current position of the current user in the training course (i.e. the course outline). The marker can comprise, for example, a line, for example a colored line, such as a white line, or a dotted line, and the like. Geographic information in respect of the training course can be obtained from a known-per-se database with geographical information. This geographical information forms the basis for calculating and correctly displaying the marking in the video image or video. Preferably, the line, i.e. the course outline, is displayed over the road surface in the video, especially the centre line of the road surface. More preferably, the users (including the current user or first user) are displayed on this course outline. Furthermore, it is conceivable that data concerning the previous or other user(s), such as at least his or her progression on the course, is obtained in 'real life', i.e. in a real life training session, and not through a training session by the previous or other user on the fitness device. The previous or other user therein may be required to cover the full distance of the real life training course in person, with e.g. a data recorder, such as a GPS-device, to record the necessary data. In exceptional cases, if desired, the current user can train with the other user in real time, in real life.

Another aspect of the invention relates to a data carrier, which comprises the above-mentioned computer program.

Yet another aspect of the invention relates to a computer, suitable for reading out the above-mentioned data storage medium and the execution of the above-mentioned computer program, wherein the computer is suitable for communicative coupling and exchange of data with the fitness device, and communicative coupling, and data exchange with the display.

Another aspect of the invention relates to a data carrier, comprising a computer program according to any one of the above-mentioned embodiments.

The invention additionally relates to an assembly of a fitness device, an aforementioned computer and a display, wherein the fitness device is connected to the computer via communicative coupling to allow data exchange with the computer, which is connected, during use, to the display via communicative coupling, which computer comprises a processor and a memory coupled to the processor, wherein the computer comprises a computer program with instructions, which, after being loaded in memory, enable the processor to:

data exchange with the fitness device,

data exchange with the display for displaying a pre-recorded video of a training course, such as a walking course in case of a treadmill or a bicycle course in case of a bicycle trainer, characterized by instructions for displaying on the display an overlay on the video image of the current position of a current user of the fitness device in the training course, wherein data concerning a previous training session of a previous user of the fitness device are read from a database, wherein the data includes at least the progression of the position of the previous user in the training course during the previous training session, wherein the progression is displayed during the current session in the overlay or instructions, which, after being loaded into memory, enable the processor to data exchange between the computer of the fitness device of the current user and a computer from another fitness device of another user, via communicative coupling, wherein the data at least comprises sharing the current positions of the current and other users in the training course, wherein the current position of the other user is shown in the overlay of the training course of the current user.

An embodiment relates to an aforementioned assembly associated with a first user, connected to another aforementioned assembly associated with a second user, wherein the computers of both assemblies are configured to exchange data with each other via a data connection, such as via Internet, regarding the training sessions of the first and the second user.

An embodiment relates to an aforementioned assembly, wherein the fitness device is a bicycle trainer.

The invention will be explained in more detail on the basis of an exemplary embodiment by means of the figures in which:

Figure 1 is a schematic view of an exemplary embodiment of a general bicycle trainer arrangement and

Figure 2 shows an embodiment of a video overlay in which a variety of variables related to the training session are shown.

Figure 1, reference numeral 1 shows an embodiment of a fitness device in the form of a general bicycle trainer arrangement. The bicycle trainer 1 comprises a frame 2, which is adapted for the placing therein of a bicycle 3. Frame 2 is thereby provided with a brake member 4 which, when a bicycle 3 is placed in the frame 2, is in frictional contact with the driven rear wheel 5 of the bicycle 3.

The bicycle trainer 1 further includes a computer 6 having a display connected to the computer 6 in the form of an image monitor 7 for displaying the progression of a bicycle course. Instead of the image monitor 7 displayed, various types of displays can be used, such as flat-screen displays, with variable display diagonal. The computer 6 can of course be provided with a read device for reading a record carrier on which the computer program according to the invention could be stored. Alternatively, the computer program could be downloaded for example through the Internet. The above mentioned brake member 4 is connected to the computer 6 for configuring the braking function of the brake member 4 in dependence of a current position, which the user (virtually) occupies in the bicycle course as shown, as displayed on the image monitor 7.

The frame is further equipped with a rotation sensor 8, which for example may be coupled to the front fork 9 of the bicycle 3 as shown in Figure 1. The computer 6 is connected to the rotation sensor 8, which may for example be a potentiometer, for registering a course change desired by a user of the bicycle trainer 1, which the user indicates by rotation of the wheel 10.

The computer 6 is further arranged to process this course change measured with the rotation sensor 8 in the course of the bicycle course as shown on the image monitor.

The brake member 4 is preferably built together with a measuring means for measuring the speed of rotation of the driven rear wheel 5 of the cycle 3, and the computer 6 is preferably adapted for the processing of this speed in the bicycle course as shown on the image monitor 7.

In the embodiment shown, the brake member 4 is an electro-mechanical brake member, which can also act as a measuring means for measuring the rotation speed of the driven rear wheel 5 of the cycle 3.

In order to increase the sensation of authenticity an assembly of two or more bicycle trainers 1 is preferably used. Such an assembly is characterized in that the computers of the first bicycle trainer and the second bicycle trainer are communicatively coupled to each other, such that the image monitors of the first bicycle trainer and the second bicycle trainer show the position of the users of the two exercise bicycles in the bicycle course, and that the brake members of the two bicycle trainers are set in accordance with these positions.

The computers of the first and second bicycle trainer can be coupled via Internet. In this way, even users who are far away from each other can train together in a competition setting.

After a first user has covered the bicycle course, his course data are loaded into the computer of the trainer of the other user, who then can perform his training work against virtual opponents at an appropriate time, and can follow the progression of the first user on his television monitor. Of course, it is also possible to let the users carry out training work against each other 'real-time'.

Note that many variations are possible on the bicycle trainer arrangement described above. For example, the rotation sensor 8 may for example also be arranged to engage the tread of the front wheel of the bicycle 3, instead of only on the front fork 9. Instead of a bicycle trainer, a treadmill can also be used for example to simulate a walking course.

Figure 2 shows an embodiment of a video overlay in which a variety of variables related to the training session are shown, including the marker according to the invention. Figure 2 shows an sample image of a video image of the bicycle course and the video overlay 14 displayed thereon by executing the instructions of the computer program, The video image of the bicycle course includes a video recording made previously with a video camera, preferably from the perspective of the first person, the playback speed of which depends on the (virtual) speed of the bicycle 3 on the bicycle trainer 1.

The video overlay 14 as shown includes a training info bar 15 extending horizontally at the bottom of the sample image. In this training info bar 15 some of the training-session-related variables are displayed. From left to right, the following variables are shown in the training info bar: the (virtual) current cycling speed 25, the actual resistance 26 of the brake member 4, the speed of rotation 27 of the drive wheel, the cadence 28, the local slope 29, the distance 30 and the current time 31.

At the top of the sample image a position bar 16 extends horizontally. From left to right the position bar 16 shows respectively the total distance 23 of the bicycle course and at the right side thereof a portion 24 with numeric representations of the time differences between the various users. An important aspect of the invention relates to the display 14 of a marking line 21 by the video overlay, which marks a distance of the bicycle course still to be covered in relation to the current position in the bicycle course.

Another aspect of interest of the invention relates to data exchange between the computer 6 of the trainer of a first user and a computer with a bicycle trainer of a second user, via a communication link, wherein the data exchange at least comprises the current positions of the first and second users in the bicycle course, wherein the actual position of the second user is displayed in the overlay 14 of the bicycle course of the first user.

The instructions of the computer program according to the invention facilitate that the current position of the second user 17 is displayed in the overlay 14 of the bicycle course of the first user using a first icon 17 in the form of an inverted triangle in a first color. A third user is represented by a triangle 18 in the usual orientation, in a first color different from the second color. Fourth, respectively fifth, users are located before the first user in the bicycle path respectively and are also represented by triangles 19, 20 in the usual orientation, also in the second color. However, these triangles 19, 20 are solid triangles, as opposed to the triangle 18, which displays the third user, because the third user is located behind the first user in the bicycle course. Obviously, several variations on the methods here described are possible to display the users in the bicycle course. In an advantageous manner, the computer program may include instructions for displaying the name or initials of the user above the respective triangles 18, 19, 20, such as the initials 22 of the second user 17.

In addition, the computer program preferably includes instructions such that the overlay 14 displays a horizon line (not shown) in the bicycle course.

On the right side of the sample image a further meter 32 is shown for displaying a current climb or descent rate so the user can see immediately whether he or she climbs or descends.

It will be understood that the above description is intended to illustrate the operation of preferred embodiments of the invention and not to limit the scope of the invention. Based on the description above, many variations will be evident to one skilled in the art, that are within the inventive concept and the scope of the present invention. As already mentioned, the invention can also be applied to a fitness device in the form of a treadmill or similar training devices. List of reference numerals

1. Bicycle trainer arrangement

2. Frame

3. Bicycle

4. Brake member

5. Rear bicycle wheel

6. Computer.

7. Image monitor

8. Rotation sensor

9. Fork

10. Handlebars

1 1. Sensor

12. Pedal

13. Control means

14. Video overlay

15. Training info bar

16. Position bar

17. Icon for displaying position of second user in bicycle course

18. Icon for displaying position of third user in bicycle course

19. Icon for displaying position of fourth user in bicycle course

20. Icon for displaying position of fifth user in bicycle course

21. Marking line

22. Name or initials of the second user

23. Total distance of bicycle course

24. Portion of position bar with a numeric representation of time differences

25. Actual bicycle speed

26. Actual resistance of brake member

27. Rotational speed of driven wheel

28. Cadence

29. Slope

30. Distance covered 31. Actual time

32. Meter for display of actual climb or descent rate

5

Claims

1. Computer program for generating a video image on a display (7), which is connected, during use, to a computer (6) which computer comprises a processor and a memory coupled to the processor, wherein the computer program comprises instructions, which, after being loaded in memory, enable the processor to:

data exchange with a fitness device (1) that is connected to the computer via communicative coupling during a training session,

data exchange with the display, which, during use, is connected to the computer via communicative coupling, for display of a pre-recorded video of a training course, such as a walking course in case of a treadmill or a bicycle course in case of a bicycle trainer,

characterized by instructions for displaying on the display (7) an overlay (14) on the video image of the current position of a current user of the fitness device (1) in the training course, wherein data concerning a previous training session of a previous user (17, 18, 19, 20) of the fitness device or a real life training session of the previous user are read from a database, wherein the data includes at least the progression of the position of the previous user in the training course during the previous training session, wherein the progression is displayed during the current session in the overlay or instructions, which, after being loaded into memory, enable the processor to data exchange between the computer of the fitness device of the current user and a computer from another fitness device of another user (17, 18, 19, 20), via communicative coupling, wherein the data at least comprises sharing the current positions of the current and other users in the training course, wherein the current position of the other user is shown in the overlay of the training course of the current user.

2. Computer program according to claim 1, characterized by instructions that display the position of the previous or other user in the overlay of the training course of the current user by means of a first icon (19, 19, 20), if the previous or other user is situated ahead of the current user in the training course and a second icon (18) when the previous or another user is behind the current user in the training course.

3. Computer program according to claim 1 or 2, characterized by instructions that show an acceleration of the previous or other user in the overlay of the training course of the current user to view by means of a first graphical indicator, when the first or other user accelerates with respect to the current user in the training course and a second graphical indicator, when the previous or other user slows down relative to the current user in the training course. Again, the authenticity sensation is thus increased.

4. Computer program according to any one of the preceding claims, characterized by instructions for data exchange with an adjustable brake member (4) of a fitness device (1) in the form of a bicycle trainer, which is connected to the computer during a training session, via communicative coupling, which brake member is mounted in a frame (2) of the bicycle trainer, which frame is suitable for the placing of a bicycle (3) therein, wherein the brake member in friction contact with a driven wheel (5) of the bicycle, when a bicycle is placed in the frame, wherein the brake member can be configured in dependence of the current position in the bicycle course of the current user as shown on the display.

5. Computer program according to claim 4, characterized by instructions for processing, and displaying in the overlay a rotation speed of the driven wheel of the bicycle as measured by a measuring means (27).

6. A computer according to claim 5, characterized by instructions for calculating and displaying the current speed (25) in the training course in the overlay based on the rotation speed.

7. A computer according to claim 5 or 6, characterized by instructions for calculating and displaying the distance (30) covered in the training course based on the rotation speed in the overlay.

8. Computer program according to any one of the preceding claims, characterized by instructions for displaying, in the overlay, a horizon line in the training course.

9. Computer program according to any one of claims 4-8, characterized by instructions for calculating and displaying in the overlay a current resistance (26) of the brake member, the slope (29) of the training course at the location of the current position in the training course, the current time (31) or the current rate of climb or descent (32).

10. Computer program according to any one of the preceding claims, characterized by instructions that display in the training course of the current user, in the overlay, the difference in the positions of the current and the previous or other user to view by means of a time difference (24) expressed numerically.

11. Computer program according to any one of the preceding claims, characterized by instructions wherein the overlay displays a marker (21), that marks a part of the training course still to be covered in relation to the current position of the current user in the training course.

12. Data carrier, comprising a computer program according to any one of the preceding claims.

13. Computer, suitable for reading out the carrier according to claim 12 and the execution of the computer program according to any one of the claims 1-12, wherein the computer is suitable for communicative coupling and exchange of data with the fitness device (1), and communicative coupling, and data exchange with the display.

14. Assembly of a fitness device (1), a computer (6) according to claim 13 and a display (7), wherein the fitness device (1) is connected to the computer (6) via communicative coupling to allow data exchange with the computer (6), which is connected, during use, to the display (7) via communicative coupling, which computer comprises a processor and a memory coupled to the processor, wherein the computer comprises a computer program with instructions, which, after being loaded in memory, enable the processor to:

- data exchange with the fitness device (1),

data exchange with the display for displaying a pre-recorded video of a training course, such as a walking course in case of a treadmill or a bicycle course in case of a bicycle trainer, characterized by instructions for displaying on the display (7) an overlay (14) on the video image of the current position of a current user of the fitness device (1) in the training course, wherein data concerning a previous training session of a previous user (17, 18, 19, 20) of the fitness device are read from a database, wherein the data includes at least the progression of the position of the previous user in the training course during the previous training session, wherein the progression is displayed during the current session in the overlay or instructions, which, after being loaded into memory, enable the processor to data exchange between the computer of the fitness device of the current user and a computer from another fitness device of another user (17, 18, 19, 20), via communicative coupling, wherein the data at least comprises sharing the current positions of the current and other users in the training course, wherein the current position of the other user is shown in the overlay of the training course of the current user.

15. Assembly according to claim 14 associated with a first user, connected to another assembly according to claim 14 associated with a second user, wherein the computers (6) of both assemblies are configured to exchange data with each other via a data connection, such as via Internet, regarding the training sessions of the first and the second user.

16. Assembly according to claim 14 or 15, wherein the fitness device (1) is a bicycle trainer.