DE10101977A1 - Using data for simulation involves using data formed or derived from time-resolved data detected during real event to visually reconstruct event as environment for object simulation - Google Patents

Abstract

The method involves using data formed or derived from time-resolved data detected during a real event to visually reconstruct the event and using the reconstruction as the environment for a simulation of an object carried out by a computer program that enables entries for controlling the behavior of the object. Independent claims are also included for the following (1) a method of simulating an object (2) a computer, especially an Internet server or computer with Internet access (3) a computer program for implementing the method.

Description

The invention relates to the use of data for a simulation Simulation processes, a computer and a computer program.

A use of data coming out during a real event Event data recorded in a time-resolved manner are formed for a visual recon The event is structured, for example, on television broadcasts of a sporting event. Here, time is resolved with a camera Image data (event data) recorded and for a screen output (visual Reconstruction) of the sporting event.

One method is in the field of computer games or video games to simulate an object in an environment using a computer programs known, the computer program inputs for tax The behavior of the object allows the simulation to be taken into account control input according to simulation rules and a Provides visualization of the simulation. In such simulation games is often tried to make a certain environment as natural as possible play. Furthermore, to achieve the most realistic Impression simulation rules used, the physical law liquids of a corresponding real object in a corresponding one real environment are approximated.

The object of the invention is the known use of data for a visual reconstruction of an event and the known method for Develop simulation of an object in an environment such that the  Reconstruction or simulation more interesting and therefore more appealing is.

To solve this task, use of the data according to An claim 1, a method for simulation according to claim 2, a computer according to claim 13 and a computer program according to claim 14 beaten.

The use according to the invention is characterized in that the Reconstruction as an environment for one using a computer program performed simulation of an object in this environment is, the computer program inputs to control the behavior least of the object allows the simulation taking into account the Control inputs according to simulation rules that the event and / or the object are adapted, and a visualization of the simula tion provides.

The method for simulation according to the invention is characterized by this net that as an environment a visual reconstruction of a real event ses is used, the reconstruction is based on data from event data recorded in a time-resolved manner during the event or are derived, and the simulation rules of the event and / or the Object are adjusted.

According to the invention, the users of the simulation are able to real life events actually taking place or events that have already taken place in a virtual reality of simulation to relive or witness true to the original. The essential is for this Use of data generated based on a real event as the basis for a reconstruction of the simulation environment. The The simulation created in this way is related to a real event and appeals to users who are not interested in a simple visual  Reconstruction of a real event as well as a simulation without Are related to reality. The simulation can e.g. B. as a computer game or as Program designed to view the event in detail.

The simulation rules determine the object's reaction to tax typed. Adapting these rules to the object means that the Type of the simulated object, the possible actions or the behavior of the Defines or restricts the object. Is the object for example about a pedestrian, "flying" is not part of the repertoire possible actions (otherwise, if the object is a pilot or an airplane). An adaptation of the simulation rules to that Event means that the behavior of the simulated object is not full contradict the behavior of a corresponding real one Object in the type of event in question. For example to simulate a submarine in a body of water, that is Movement of the object to the spatial extent of the water limited.

In principle, the invention can be used for any event. However, it is particularly preferably a sports event, such as a sporting competition. In this case, the user of the Simula tion not only witness the event, but represented by the simu object, even "participate" in the competition.

For such inclusion of the simulation user, events from Sports where the actions of real participants are very different from depend on the actions of other participants and / or the participants directly interact with each other (e.g. football, tennis, martial arts etc.) in the Usually unsuitable. For such sporting events it is the simulated object preferably around a "virtual observer" of the event ses, its spatial position and / or orientation by the tax inputs selected can be varied, with the visualization of the  Simulation of the impression from the perspective of this virtual observer represents. For example, the user can play a simulated soccer game the virtual observer before taking a penalty behind the gate We were running to see the real penalty from this position ben.

For the participation of the simulation user in sporting events Sports in which the real participants in the Act essentially independently of each other, such as sports where it is about achieving a low fair value (especially races, e.g. Ski races, motorcycle races, car races etc.) or a high score value (e.g. golf, bowling / bowling, archery etc.). Also at such sports, the simulated object may be one act pure observer. Beyond that, however, it is in particular easily possible the participation of the object in the simulation provided. If usually at the event in question only one participant acts at a certain time (e.g. ski jumping), so can in the simulation, the object represents an additional participant who is inserted anywhere in the sequence of participants. If several Participants act simultaneously (e.g. snowboard races with two parallel ones Slopes or car races of Formula 1), the object can e.g. B. one of the replace real participants or one that does not exist in reality Represent participants. The latter option is preferred if the type of Event an (albeit minor) interaction between the part enables participants (e.g. car racing). This avoids unrealistic ones Impressions in the simulation due to the error of a real one Participant who influenced the behavior of the other participants.

The real event is preferred in its temporal and spatial Process recorded. For this, the data can provide information about the position and / or orientation of real objects involved in the event (e.g. soccer players, racing cars, golf balls etc.) over time  Event. For the reconstruction, z. B. a step-by-step recording of position coordinates of real objects.

The accuracy of the data determines the achievable accuracy of the Simula tion. In many cases it is sufficient if the amount of data used just enough to get the essential parts of the real event reconstruct.

The data are preferably formed on a time grid which is associated with identical to a time grid of the time-resolved acquisition of event data can be. Furthermore, the data can be formed for a spatial grid, with the spatial expansion of the spatial grid for data reduction can be restricted from the outset to an area that is suitable for the real objects of the event is accessible. If the simulation is not is carried out simultaneously or with a slight time lag, d. H. if there is sufficient time for data preparation, the area to be covered by a grid after an evaluation that of the real objects in the course of the event actually be occupied space can only be determined retrospectively.

Position information and orientation information can be, for example, as Time series information is formed, e.g. B. in the form of a table in which the columns stand for the individual participants or real objects and the Lines stand for discrete times in the course of the event.

Alternatively, data can also be generated from which in the Simula tion such time-resolved position or orientation information can be generated. For example, the time course of the Position of a golf ball that has been knocked down can be reconstructed from data which only indicate the tee speed and angle. such Data-reduced formats are possible precisely because the real Er event known (physical) laws follows. Alternatively or  In addition, interpolation methods can also be used in the simulation be realistic in order to make movements between "bases" realistic to reconstruct.

Furthermore, the data can provide information about changes that cannot be changed over time Contain properties of real objects involved in the event. Such properties can e.g. B. be: color of racing cars; course a race track or a code that retrieves the course of the race stretch allowed from a database at the time of simulation; Status a football pitch etc. This information can be used for the true to the original Reconstruction of the simulation environment will be essential. Independently of this, such information can be as realistic as possible The experience of the event is advantageous due to the simulation rules be taken into account. In this case, the behavior of the simulated depends Object not only depending on the tax input of the user, but also of properties recorded on the real event. For example, it could in a reconstructed soccer game with a simulated observer happen that this virtual observer fails to timely an aspired observer position because the observer through the Tax input of the user was accelerated too violently, so that this on slipped and fell on the wet football pitch.

Furthermore, the data can provide information about spatially resolved and / or contain time-resolved properties of the real environment of the event This information can also be advantageous during the reconstruction the simulation environment (e.g. housing backdrop) as well as the Simula tion of the object (e.g. interaction with other objects) be done. When simulating a car race, for example, in the data includes information about where and when the track was wet during the event. Then this can both the visualization and the behavior of the simulated object influence.  

The event data recorded time-resolved during the event can in the simplest case, the data used for the event reconstruction form so that the event collected during the course of the event data is available without the need for post-processing hen. The data thus formed can e.g. B. as a data packet using digital Data networks very quickly worldwide authorized users to use for suitable simulation software can be made available. The Ver Spread of the recorded and possibly processed data is over all common data carriers and telecommunication channels possible. Especially the Internet appears to be important for this. However, the event data can also be recorded completely first and then for generation processing of the data derived therefrom.

Event data can, for example, be recorded by means of at least one Camera arranged stationary in the real environment of the event and / or at least one arranged on a real object of the event DGPS (Differential Global Positioning System) device and / or a sensor distributed in the real environment of the event arrangement. These detection devices are especially for detection of time-resolved position information. With a GPS on direction, for example, the desired data from the event Data are derived by rasterizing the GPS data be subjected. When recording the event with one or more Cameras can be used for image evaluation methods known per se to determine the positions and, if required, orientations of real objects in the course of the event from the image data extract. This and also other of the information to be recorded Suitable means of registration can of course be combined the. In some cases, manual processing of the Event dates may be appropriate. A particularly simple procedure results when exactly the data required for the reconstruction is recorded and be saved, such as B. in the case of GPS position detection.  

The computer program that carries out the simulation can run on run an Internet server, the control inputs of the or Users are transmitted over the Internet to the Internet server. A such use of the data or such a simulation method has the advantage that a computer with high Computing capacity to create a particularly realistic simulation can be provided and the users of the simulation less can use sophisticated equipment. The simulation can also who is executed simultaneously or at least promptly with the real event the. Finally, there is the advantage that several users use the same Simu lation because the Internet server for such groups of Users can run a common simulation. At a For example, car races can have two, three or more additional virtu All racing cars will be provided by this majority of users can be controlled simultaneously. In the latter case, the user could computer game is not just a direct test of strength with the Deliver world elite of the respective sport, but at the same time with predetermined other simulation users.

In an alternative, the computer program can run on a computer Internet access expire using data from an internet server the internet will be transmitted. In this embodiment, too Real-time simulation possible, with no transfer of the visualization the simulation takes place over the Internet. Rather, this is local to User generated. This brings advantages when it comes to the highest possible Visualization quality works.

The computer program and / or the data can also be stored on a memory ch Medium such as a CD-ROM, a floppy disk or the like provides or disseminated. With saved on a storage medium To a certain extent, data becomes "event preserves" for the user provided, which a multiple reconstruction and thus reliving  of events, the concrete course of the recon structure of the same real event is still varied remains because it depends on the specific tax input of the user remains.

The computer program provides at least a visualization of the simulation of the virtual object in the reconstructed environment. Prefers the computer program also provides sound data for the output of a realisti noise level ready. Such sound data can be completely independent generated by the real background noise, for example, can correspond to Appropriate methods are used, as in known Compu games are used. In a further development of the invention however, the event data also provided time-resolved audio information included with which a reconstruction of real noise backdrop for the simulation can be performed. Such noise information is another example of the above spatially resolved and / or time resolved properties of the real event Surroundings. This enables a multimedia reliving of events achieve.

The computer program preferably allows visualization of the simula tion from the perspective of the object. A simulation can do the same the background of the virtual object within the Consider the event environment and the corresponding location-dependent Provide acoustic impression.

It is further preferred that the computer program have a visualization allowed from at least one other perspective where the virtual Object is visible. For example, one or more predefined ones Perspectives on user control inputs can be selected (Side view, perspective view, bird's eye view etc.). A per Spotting overall view can also be freely selectable  his. In a further preferred embodiment, the compu The program fixes the virtual object at the position of a real object, especially one moving in the course of the event object. For example, the simulation user can use his virtual object at a soccer game in the role of a striker bet and experience or relive the game from their perspective.

It is advantageous if the simulation rules of the computer program take into account at least one information contained in the data. Though a simulation of the Ob carried out using the technology known from computer games become. However, taking such data into account, the simula make it even more interesting and varied. In the data contained position information of those moved during the event Objects can be used in this way, for example, from the simulation rules that if there is a fear of a collision between the virtual object and one of the real objects in the simulation speaking exemptions are activated in a more realistic Way to prevent such a collision. For example, in this case the connection between control input and behavior of the virtual len object can be modified appropriately or in the reconstruction of the Movement of an actual object before a temporary change be taken. This could be the virtual one in a car racing simulation Racing car drifting outwards in a curve (exception rule) to make room to create for the real object approaching from behind or it could at a soccer game to avoid a collision of a virtual observer ters with soccer a temporary deviation of the simulated Bewe be provided for football. Even in the event of a collision completely different exception rules or a termination of the simulation process be provided. Another example of considering in the Information contained in the data is a simulation of an award ceremony after a sporting competition, where the virtual  Object is honored. For this the information contained in the data (e.g. time value, point value) about real objects with corresponding information compare the virtual object.

The computer according to the invention is programmed for an implementation of the method according to the invention, for example as Internet server on which the simulation computer program runs as Internet server that provides the data over the Internet or as a compu ter with Internet access, on which one to carry out the above A suitable simulation program runs and the data on the Internet broadcast.

In the computer program according to the invention, which is on a memory stored medium, are program code means for a Implementation of a method according to the invention included. From that includes in particular the program described above, which the Carries out simulation, but also a program that the communica tion with an Internet server on which the simulation program expires.

The invention is described below with the aid of exemplary embodiments Further described with reference to the accompanying schematic drawings ben. They represent:

Fig. 1, the acquisition of event data for an event by means of three cameras as well as an arranged distributed plurality of sensors,

Fig. 2, the acquisition of event data in a car race with the aid of a GPS system,

Figure 3 of the diene. The processing of event data and distribution on prepared data over the Internet and using Speicherme,

Fig. 4 visualizations of the event of Fig. 1 in different perspectives, and

Fig. 5 visualizations of the event of Fig. 2 from different perspectives.

In the following description of exemplary embodiments analog components labeled with the same reference numbers and it is mainly based on the differences from already described management forms received.

Fig. 1 shows a real event 10 with two real participants 12, 14, which move during the course of the event over a floor area 18. The real objects 12 , 14 are, for example, soccer players on a soccer field 18 .

During the event 10 , time-resolved image and sound data are recorded by three video cameras 20 , 22 and 24 as well as data on the positions of the objects 12 , 14 by a sensor arrangement 26 arranged in the bottom area 18 and forwarded at 40 as event data.

Fig. 2 shows a detail of a car race 10 a with one of the real participant racing cars 12 a on a road 13 a of the ground 18 a. The time-resolved acquisition of event data is carried out: here by a DGPS device consisting of GPS receivers 30 a with a downstream radio transmission device 31 a for transmitting the vehicle position to each racing car, a radio reception device 32 a, which transmits the radio signals transmitted by the vehicle and a Receives radio signal from a stationary GPS receiver 34 a with a downstream radio transmitter 35 a in order to increase the accuracy of the GPS position detection to a few centimeters. The racing in the sequence in the radio receiving device 32 a collected position data is forwarded at 40a.

In both of the examples described above, the event data serve as the reason lay for a reconstruction of the event.

FIG. 3 illustrates two variants of a use according to the invention of data which are formed from event data (for example those from FIG. 1 or 2) or are derived by postprocessing.

Event data arriving at 42 c are fed to a computer 44 c, which processes this data, for example converts it into a suitable data format (space-time raster) and saves it. In the case of video image data, an image evaluation for extracting position data of the real objects is carried out before the storage. A first use is to store the processed data on a storage medium, here a CD-ROM 46 c, and to make them available for use in a simulation program described below for users.

Another use is the transmission of the data to a computer 48 c installed as an Internet server, which makes the data available over the Internet 50 c for users of the simulation software. This enables the data to be used in a very timely and worldwide manner in the event. Access to the data is preferably password-protected, so that only certain users can access the data.

In Fig. 3 one recognizes a computer with a keyboard 52 c 54 c, a game input unit 56 c (joystick, steering wheel, etc.) and a monitor 58 c.

A computer program for simulating at least one object in an environment runs on the computer 52 c, the computer program permitting inputs for controlling the behavior of the object via the devices 54 c, 56 c, carrying out the simulation taking into account such control inputs in accordance with simulation rules and Video and audio data generated, which are presented to the user by means of the monitor 58 c or by means of a sound card with connected speakers (not shown).

The simulation of an object in an environment based on simulation rules is known per se from the field of video or computer games, so that the details of the simulation need not be discussed in more detail here. In known simulations, the program itself specifies a specific simulation environment and the movement of virtual objects operating in it. In known games, the events taking place in this environment are either calculated by algorithms during the runtime of the program or are programmed in to occur in a particular state. These events are often controlled by random generators. The peculiarity of the simulation program running on the computer 52 c now consists in the fact that an interface for "mixing" at least one virtual object into a simulation environment exists, the simulation environment being based on data that are made available to the computer program separately, here via the Internet 50 c. These data are formed or derived from event data recorded during a real event, for example the event data described above, and allow the real event to be reconstructed in order to use this reconstruction as a simulation environment.

Fig. 4 shows an example of how an output on the monitor 58 c Visua capitalization of a simulation of the real state shown in Fig. 1 from might see. In Fig. 4 left, the computer program outputs a visualization of the situation from the perspective of a virtual object, which is on the floor area 18 and in front of the real object 12 . Accordingly, an image 12d of the real object 12 is visible in the simulation. By corresponding control inputs via the keyboard 54 c and / or the joystick 56 c, the user can now move the virtual object according to the simulation rules seen before, so that, for. B. the situation shown in Fig. 4 in the middle occurs, in which Fig. 12d, 14d of both real objects 12 , 14 appear in the visualization. If the user now uses control inputs to select a representation of the event from above, the monitor output shown on the right in FIG. 4 results, on which the virtual object 16 d is also visible.

FIG. 5 shows conceivable visualizations at a specific point in time of the event shown in FIG. 2, to the left from the perspective of a virtual vehicle driver of a virtual vehicle 16 e, in the middle from a position slightly above and behind the virtual vehicle 16 e and to the right from an oblique perspective. In addition, the computer program also allows a simulation with a viewer position that is permanently connected to one of the real objects.

FIG. 3 also shows a computer 62 c equipped with Internet access of another user, to whom the same data is made available by Internet server 48 c. In an alternative imple mentation form allow the c on the computers 52, 62 c running Pro programs, a communication via the Internet 50 c such that both computers same simulation runs, wherein the two users are each assigned at least one virtual object. This version enables two or more users to interact interactively within the same simulation environment based on real data. The users of the simulation find themselves in a course that is not exclusively calculated by algorithms or determined by random generators or predetermined by statistical processes. Rather, it is involved in the course of an event that actually takes place or an event that actually took place. Depending on the specific design of the simulation program, the participant can simply participate in this event without influencing the actual process or generating a deviation from reality, which are realized by the above-mentioned exceptions.

A connection of the computers 52 c, 62 c to create a common simulation environment can also be established via a local network or a direct connection instead of through the Internet 50 c. This offers advantages in terms of data transfer rates and thus allows simulation with even greater detail.

In a departure from the exemplary embodiment shown in FIG. 3, the simulation computer program can also run on the Internet server 48 c, in which case the Internet 50 c is used to transmit the control inputs of the users to the Internet server 48 c and in response then transfer visualization data back to the computers 52 c, 62 c of the users. In this case, the computer 48 c is set up in terms of program technology for carrying out a simulation based on real data, taking into account control inputs via the Internet and the output of visualization data of the simulation via the Internet, which are directly suitable for a graphic output or from which such Graphics output can be generated.

Claims (14)

1. Use of data which are formed or derived from event data ( 40 ) acquired during a real event ( 10 ) in a time-resolved manner for a visual reconstruction of the event, characterized in that the reconstruction serves as the environment for a simulation carried out by means of a computer program an object ( 16 ) is used in this environment, the computer program permitting inputs for controlling the behavior of the object ( 16 ), the simulation carrying out the simulation taking into account the control inputs according to simulation rules which govern the event ( 10 ) and / or the object ( 16 ) are adapted, and a visualization of the simulation provides. 2. Method for simulating an object ( 16 ) in an environment by means of a computer program, the computer program allowing inputs to control the behavior of the object ( 16 ), carrying out the simulation taking into account the control inputs according to simulation rules and providing a visualization of the simulation, characterized in that a visual reconstruction of a real event ( 10 ) is used as the environment, the reconstruction being based on data formed or derived from event data ( 40 ) recorded during the event in a time-resolved manner, and the simulations regulate the event ( 10 ) and / or the object ( 16 ) are adapted. 3. Use or method according to claim 1 or 2, wherein the event ( 10 ) is a sporting event. 4. Use or method according to any one of the preceding claims, wherein the data th information about the position and / or orientation of in the event (10) participating real OBJEK (12, 14) included in the time course of the event (10). 5. Use or method according to one of the preceding claims, wherein the data contain information about properties that are unchangeable over time of real objects ( 18 , 13 , 12 , 14 ) involved in the event ( 10 ). 6. Use or method according to one of the preceding claims, wherein the data contain information about spatially resolved and / or temporally resolved properties of the real environment ( 18 , 13 ) of the event. 7. Use or method according to one of the preceding claims, wherein the event data ( 40 ) are recorded by means of at least one camera ( 20 , 22 , 24 ) arranged in the real environment of the event ( 10 ) and / or at least one on one real object ( 12 a) of the event ( 10 a) arranged DGPS device ( 30 a, 31 a) and / or a sensor arrangement ( 26 ) arranged distributed in the real environment of the event ( 10 ). 8. Use or method according to any one of the preceding claims, wherein the computer program runs on an Internet server ( 48 c) and the control information is transmitted over the Internet ( 50 c). 9. Use or method according to any one of the preceding claims, wherein the computer program runs on a computer ( 52 c, 62 c) with Internet access and the data are transmitted over the Internet ( 50 c). 10. Use or method according to any one of the preceding claims, wherein the computer program and / or the data on a storage medium ( 46 c) are provided stored. 11. Use or method according to one of the preceding claims, wherein the computer program allows visualization of the simulation from the perspective of the object ( 16 ). 12. Use or method according to one of the preceding an sayings, the simulation rules of the computer program take into account at least one information contained in the data gene. 13. Computer, in particular Internet server ( 48 c) or computer ( 52 c, 62 c) with Internet access, programmed for implementing a method according to one of claims 1 to 12. 14. Computer program with program code means for implementation of a method according to one of claims 1 to 12.