AU2011380291A1 - Apparatus and method for analyzing sensor data - Google Patents

Abstract

An apparatus for detecting an event of interest, comprises a first primitive event detector (8b) for generating a stream of first primitive events (10b) using a sensor data stream (4), the sensor data stream (4) carrying raw data at a sensor data rate, the raw data being as- sociated to one or more properties determined for multiple observed objects (72) using one or more sensors, wherein a data rate of the stream of first primitive events (10b) is lower than the sensor data rate as well as a second primitive event detector (8c) for gen¬ erating a stream of different second primitive events (10c) using the sensor data stream (4), wherein a data rate of the stream of the second primitive events (10c) is lower than the sensor data rate. An event detector (16) is operable to determine the event of interest using the streams (10b, 10c) of the first and second primitive events.

Description

WO 2013/064174 PCT/EP2011/069166 1 Apparatus and Method for analyzing sensor data Embodiments of the present invention generally relate to the analysis of sensor data and, 5 in particular, to apparatuses and methods for analyzing sensor data being provided at a high sensor data rate. Background 10 Wireless sensor networks of various technologies may be used for locating purposes, such as locating or tracking humans and/or other objects. Here, "locating" means the de tection or determination of a geographical location or position, while tracking means lo cating at short time intervals such as to be able to follow the position and other kinematic variables of a moving observed object. Some specialized locating or position tracking 15 systems may be used for locating players and other objects (e.g. a ball) in sport events, such as, for example, soccer, American football, rugby, tennis, etc. When analyzing the gathered geographic location or positioning data of players and/or a ball it becomes possible to derive statistical information related to the whole sports event, 20 for example a soccer match, or related to individual teams or players. Such derived statis tical information may be interesting for various reasons. On the one hand, there are vari ous commercial interests as certain statistics and their analysis may be of particular rele vance for spectators in a stadium and/or in front of a television set at home. Hence, providing certain statistics may raise more interest in sport events. On the other hand, 25 statistical data derived from the raw positioning data may as well be used for training purposes. Here, an opponent and/or the behavior of the own team may be analyzed as well as the performance and/or health condition of individual players. The aforementioned locating or position tracking systems may be based on various tech 30 nologies. For example, location information may be determined based on the evaluation of wireless radio signals and/or magnetic fields. For this purpose transmitters and/or re ceivers, generally also denoted as sensors, may be placed at the individual objects (e.g.

WO 2013/064174 PCT/EP2011/069166 2 players, ball, etc.) to be located by the system. Corresponding reception and/or transmis sion devices may also be mounted to predetermined locations around a geographical area of interest, as e.g. a soccer field. An evaluation of signal strengths, signal propagation times, and/or signal phases, just to name a few possible technical alternatives, may then 5 lead to sensor data streams indicative of the geographic position or location of individual players or objects at different time instants. A location data sample may be associated with a time stamp indicating at which time an object was located at the observed or de tected geographic position or location. As combined information, kinematic data, like velocity (speed), acceleration, etc. may as well be provided in addition to the location 10 data comprising, for example, x-, y-, and z-coordinates. In the sequel of this specification the location and/or kinematic data delivered by the localization sensor system will also be referred to as raw (sensor) data. In a particular example of a wireless tracking system people or objects may be equipped 15 with tiny transmitters, which may be embedded in footwear, uniforms and balls and whose signals are picked up by a number of antennas placed around an area under obser vation as for example a soccer field. Receiver units process the collected signals and de termine their Times of Arrival (ToA). Based on a calculation of the differences in propa gation delay, each transmitter's position is determined continuously to track all objects 20 under observation. In one particular example, the transmitters operate in the 2.4 GHz band to be globally license free, while the individual transmitters are distinguished using CDMA (Code Division Multiple Access) techniques. However, tracking an object in a sports game with an appropriate accuracy easily pro 25 duces a large amount of sensor data. For example, tracking a ball of a soccer game with an accuracy of roughly 3cm may require to estimate the position of the ball up around 2000 times per second, assuming a maximum speed of the ball of about 150km/h, which appears to be reasonable for soccer. However, other sports such as tennis or baseball cer tainly would require higher sampling or estimation rates. Moreover, not only the ball is to 30 be tracked in a soccer game where tracking the 22 players is equally important. Since tracking with the above mentioned system is principally feasible with an accuracy of 1 cm, it may also be desirable to use more than one tracking sensor per player, to not only derive his position but also his posture in order to be able to decide on offside situations WO 2013/064174 PCT/EP2011/069166 3 or the like. Equipping two teams and the necessary play equipment for a soccer match with a reasonable amount of sensors may result in up to 50000 position data samples or raw data samples per second that is the associated sensor data stream may have a sensor data rate of 50000 per second. 5 Analyzing such type of sensor data requires simultaneous knowledge on the raw data of multiple or all sensors at each decision making, since each incident to be analyzed or since each conclusion to be drawn requires knowledge on a different subset of the sen sors raw data. That is, in a conventional analysis framework all data needs to be distrib 10 uted to all analyzing entities in parallel, which is not feasible if the number of analyzing entities increases in order to analyze the data with respect to multiple aspects. To even accomplish this task in real time or close to real time is completely out of reach in those systems. However, this may be required in order to indicate offside positions in a soccer game or to answer similar time critical questions in the course of another sports game. 15 It is therefore required to provide a concept to analyze sensor data streams more effi ciently in order to extract information of interest. Summary 20 According to an embodiment of the invention, this is achieved by the use of an analysis framework for analyzing the raw data portions being transmitted in a sensor data stream at a sensor data rate. The analysis framework comprises an input layer comprising at least two or more primitive event detectors for generating at least a first and second 25 stream of primitive events using exclusively the sensor data stream as an input and one or more event layers comprising one or more event detectors for detecting an event of inter est, wherein any one of the one or more event detectors uses only the streams of the first and the second primitive events or a stream of other events as provided by another one of the event detectors as an input. That is, the analysis framework follows an event based 30 hierarchical analysis approach, where interdependent events are determined or detected at different hierarchical levels of dependency.

WO 2013/064174 PCT/EP2011/069166 4 An event may generally be defined to be an instantaneous occurrence of interest at a point of time. In general, an event is associated with a change of a related sensed quanti ty. An event may be a primitive event derived in the hierarchical base or input layer, such that a primitive event is directly based on sensor data (e.g. the kinematic data provided 5 by a tracking system) and hence may indicate a change of the related sensed quantity. An event of interest is an event of a higher hierarchical order that is it is dependent on other events or primitive events, or more generally on previously detected other events. In an other view, an event or a primitive event comprises information derived by applying a certain decision making criterion to another event or to the raw data. 10 An event based approach may provide for the possibility to analyze the underlying data in a parallelized manner with multiple processing nodes communicating over a network. This is particularly the case since the sensor data stream with its high data rate only needs to be provided to the primitive event detectors in the input layer, where they are pro 15 cessed to determine primitive events which are typically determined with a lower data rate. For the higher layers, primitive events are the basis for the analysis such that the sensor data stream does not have to be distributed to all decision making entities or event detectors. This makes the analysis of larger sets of position data at all possible. 20 Moreover, the reduced data rate of the input events for the event detectors in the higher hierarchy layers provides for the possibility to parallelize the processing, for example by distributing the event detectors and/ or the primitive event detectors to different CPUs or computers within an analysis framework consisting of several CPUs or computing nodes. The reduced event data rates even provide for the possibility to communicate the occur 25 rence of events via conventional networks, such as for example over an Ethernet based LAN (Local Area Network) without limiting the performance of the analysis framework even when a close to real time analysis is required. As compared to the raw data, only the fact that a decision making criterion of an event detector has been met (that is, that the event occurred) may be transmitted as an event information between interrelated event 30 detectors. This may additionally help to keep the amount of data exchanged between event detectors low, since the length of each individual message is shorter than the length of a single raw data sample. That is, not only the number of data packets per time may be kept low but also the size of the transmitted data packets. In further embodiments, the WO 2013/064174 PCT/EP2011/069166 5 exchanged event data may also comprise information about two, three or more possible states the event detector has determined. That is, a determined event or primitive event may contain more than a binary YES/NO information. 5 According to a further embodiment of the invention, the above object is achieved by an apparatus for detecting an event of interest, the apparatus comprising a first primitive event detector for generating a stream of first primitive events using the sensor data stream and a second primitive event detector for generating a stream of different second primitive events using the sensor data stream, wherein a data rate of each of the streams 10 of the first primitive events and the second primitive events is lower than the sensor data rate. An event detector is operable to determine the event of interest using the streams of the first and second primitive events. An event detector can thus base its decisions on primitive events occurring at a lower data rate and thus perform its analysis without the need to access the high data rate sensor data stream directly. 15 With this respect the term data rate is to be understood not only as an instantaneous data rate but also as a mean data rate, which is as an average of the instantaneous data rate over a certain time interval. Depending on the chosen set of primitive events, it may oc cur that a certain primitive event is determined with the sensor data rate for a short time 20 period. However, the mean data rate of the primitive event over the time of the observa tion, e.g. the time of a soccer match, may be much lower. According to some embodiments of the invention, the primitive event detectors are oper able to exclusively use kinematic data as the raw data in order to provide real time analy 25 sis of tracking data for sports events or the like. Kinematic data may be an arbitrary sub set of position information, velocity information or acceleration information of an ob served object. The data may be provided in a 1-, 2- or 3- dimensional space, such that the kinematic variables used herein shall be understood as being either vectors or scalars, depending on the chosen implementation. In further embodiments, the primitive event 30 detectors may furthermore derive velocity- and/ or acceleration information themselves from the provided position information, such that the sensors may be simple tracking or positioning devices or the like.

WO 2013/064174 PCT/EP2011/069166 6 The hierarchical analysis is based on an appropriate choice of base events, such as to be able to derive any basic information needed for all higher order decisions. According to one embodiment, a proximity- event is generated as a primitive event when 5 position information of a first observed object and of a second observed object indicates that the second observed object is within a predetermined neighborhood of the first ob served object. The neighborhood may, depending on the observed event or sports game, be a complex shaped volume or be defined by the distance between the first observed object and the second observed object. Proximity may be used as an input for numerous 10 further event detections, as for example to answer the question whether a player/ batter or other equipment was possibly hitting a ball or another observed object. According to a further embodiment, a remote- event is generated as a primitive event when position information of a first observed object and of a second observed object in 15 dicate that the second observed object is outside of a predetermined neighborhood of the first observed object. According to a further embodiment, a direction changed- event is generated as a primi tive event when a change of a velocity (direction or quantity) or an acceleration of an 20 observed object exceeds a predetermined threshold. This criterion may generally be use ful in sports- or tracking applications. Depending on the observed sport, however, the height of the threshold may be different. The threshold may therefore be different for different kinds of sports or even varying during the course of a single game to account for changing environmental conditions, such as for example the occurrence of rain. 25 According to a further embodiment, an idle- event is generated as a primitive event, when the velocity of an observed object falls below a predetermined threshold to indicate that the object is passive or not moving. According to some embodiments, the idle event is only generated when the velocity of the observed object stays below the predetermined 30 threshold for at least a predetermined minimum duration. According to a further embodiment, an active- event is generated as a primitive event, when a velocity of an observed object exceeds a predetermined threshold. According to WO 2013/064174 PCT/EP2011/069166 7 some embodiments, the active- event is only generated when the velocity of the observed object stays above the predetermined threshold for at least a predetermined minimum duration. 5 According to a further embodiment, a line crossing- event is generated as a primitive event, when at least one component of a position information of an observed object ex ceeds or falls below a predetermined threshold. 10 Brief description of the Figures Some embodiments of apparatuses and/or methods will be described in the following by way of example only, and with reference to the accompanying figures, in which 15 Fig. 1 shows a schematic view of an analysis framework for analyzing sensor data streams; Fig. 2 schematically shows a block diagram of an embodiment of a method for detecting an event of interest using a sensor data stream; 20 Fig. 3 schematically shows an example for an event detection scheme in order to detect a shot on a goal in a soccer game; Fig. 4 schematically shows an example for an event detection scheme in order to 25 detect a double pass in a soccer game; Fig. 5 schematically shows events allowing to efficiently determine the presence of an observed object in a predetermined area; and 30 Fig. 6 schematically shows an embodiment of an event detector. Figure 1 schematically shows an analysis framework 2 for analyzing raw data portions being transmitted in a sensor data stream 4 at a sensor data rate to identify at least one WO 2013/064174 PCT/EP2011/069166 8 event of interest. The raw data portion is associated to one or more properties determined for an observed object using one or more sensors. In the present and the following em bodiments it is assumed that the raw data comprise only kinematic variables of observed players and of a ball of a soccer match. 5 An input layer 6 of the framework 2 comprises several primitive event detectors 8a - 8e for generating a stream of primitive events using exclusively the sensor data stream 4 as an input. That is, only the primitive event detectors 8a - 8e of the input layer of the anal ysis framework 2 receive the raw data at the high sensor data rate as an input. 10 A first primitive event detector 8b and a second primitive event detector 8c generate a first stream of primitive events 10b and a second stream of primitive events 10c using exclusively the sensor data stream 4 as an input. The sensor data stream 4 may be pro vided using any suitable technique such as an Ethernet Network using copper or fiber 15 links or any other wired or wireless technology, using standardized or custom communi cation protocols. The analysis framework 2 comprises two event layers 12 and 14, each comprising event detectors for detecting events of interest, wherein the event detectors of the event layers 20 12 and 14 use only the streams provided by the primitive event detectors or of other event detectors of event layers 12 or 14 as an input. For example, event detector 16 de termines an event of interest using the streams 1Ob and 1Oc of the first and second primi tive event detectors 8b and 8c. Stream 10b is also provided to a further event detector 18. It goes without saying that further arbitrary interdependencies are possible. For the sake 25 of clarity, however, only few dependencies or connections are illustrated here. The links between the event detectors may be implemented using wired Ethernet connec tions or using any other network link based on an arbitrary technology known in the art. The individual event detectors may be running as different software processes on differ 30 ent computing nodes or some of them may be running on the same node. The event de tectors may also be implemented as dedicated or programmable hardware or the like. With this respect, the dependencies between the event detectors shown in Fig. 1 shall be understood as both, a representation for a physical hardware link or for a logical link in- WO 2013/064174 PCT/EP2011/069166 9 dicating a flow of information or a dependency of on event detector from another. Figure 2 schematically shows an embodiment of a method for detecting an event of inter 5 est using a sensor data stream 4 carrying raw data at a sensor data rate, the raw data being associated to one or more properties determined for multiple observed objects using one or more sensors. In a first primitive event generation step 20, a stream of first primitive events 22 is gen 10 erated, wherein a data rate of the stream of first primitive events 22 is lower than the sen sor data rate. In a second primitive event generation step 24, a stream of second primitive events 26 is generated, wherein a data rate of the stream of the second primitive events 26 is lower than the sensor data rate. 15 In an event generation step 28 the event of interest 30 is determined, using the streams 22 and 26 of the first and second primitive events. It is to be noted that the first and second event generation steps 20 and 24 may be performed in any arbitrary order, that is the par ticular events of the of first second stream of primitive events which are used to deter mine an event of interest 30 do not necessarily have to be created or delivered at the same 20 time. To this end, event detectors may, for example, be implemented as state machines as it will be shown in figure 6 below. 25 Figures 3 to 5 discussed below show some embodiments of appropriately chosen primi tive events to be used to derive higher order events of interest for a soccer match. Figures 3 and 4 show examples of analysis frameworks for analyzing position infor mation of players and a ball in a soccer game to identify numerous events of interest. It 30 may be noted that the illustrative embodiments of figures 3 and 4 may not show all inter relations and links between the event detectors or the decision making entities of the in dividual hierarchical levels. Figures 3 and 4 are mainly intended to clarify the hierar chical approach and particularly how few base events may be used to analyze the data to WO 2013/064174 PCT/EP2011/069166 10 derive rather complex information from few primitive events. Figure 3 shows an example of an analysis framework for analyzing position information of players and a ball in a soccer game to identify a blocked shot on a the goal as an event 5 of interest. In the input layer of the framework, a "direction changed- event" 40 is detect ed for the ball, for example by comparing a provided acceleration with a threshold or by computing first and second derivatives of position data of the ball in order to conclude on the change of direction of the ball. Furthermore, a line crossing event 42 is generated or derived, indicating that the ball had crossed a predetermined virtual line on the playfield. 10 Based on the line crossing event 42, the ball is identified to be in a particular region, gen erating a region event 44. The identification of a particular region is elaborated on in more detail in the description of figure 5. From the presence of the ball inside the play field, it can be concluded that the observed ball is the active ball 46, which is the ball 15 actively used for playing and not a spare ball stored outside of the playfield. Is near events 48 for player and ball as well as for ball and goal allow to draw the conclusion that the direction change of the ball indicated by the direction changed- event 40 was due to a particular player who hit the ball, which is signaled by a corresponding event 50. In the same way it is concluded that the shot was directed to the goal by event 52. Addition 20 al subsequent is near events for the ball and the goal keeper further allow concluding that the shot was blocked and that the no goal was achieved by the player hitting the ball. As apparent from figure 3, the final complex information is gathered from only few but ap propriately chosen primitive events. 25 Figure 4 shows an example of an analysis framework for analyzing position information of players and a ball in a soccer game to identify a double pass between two players. The determination which particular player hit the ball is performed as already explained with respect to figure 3. Furthermore, a change of the sign of a velocity or of a component of a velocity vector of the ball may be used to determine a peak height event 56 for the ball, 30 which may indicate that the ball had been shot and not only dribbled. The Begin and End of possession 58 of the ball may be determined from the proximity event 48, indicating that the ball is close to a particular player. The fact that a particular player is in control of the ball, as denoted by reference numeral 60, can be derived from the information that the WO 2013/064174 PCT/EP2011/069166 11 ball receives several accelerations, when one and the same player is in possession of the ball. A pass 62 can be determined by using the information that one player lost posses sion, while another player achieved possession of the ball, while the ball has been played in between, which in turn is detected by the height event 56. Finally, a double pass 64 5 may be determined by 2 subsequent passes between the same players. Again, the com plex information determined or analyzed in figure 4 is based on only few appropriately chosen and defined primitive events. Figure 5 illustrates how the information that a ball 72 is located within a particular region 10 74 of the playfield may be gathered from just one type of primitive events in a particular ly efficient manner. The underlying primitive event is a line crossing event indicating that the ball has crossed a straight line virtually projected on the playfield in order to subdivide it into numerous regions. The region 72 is formed by 4 straight lines 76 to 82, intersecting at right angles such as to form a rectangular region 74. Using a cartesian co 15 ordinate system as indicated in figure 5, this may be practically achieved by determining, whether a component of a position vector of the ball exceeds or falls below a predeter mined threshold. However, it may be noted that also other arbitrary geometries for the observed regions according to the embodiments described herein are possible. The de termination, whether a line has been crossed or not may then require different calcula 20 tions, such as for example the determination of a determinate. Using a conventional approach to determine, whether the ball 72 is located inside region 74 would require to iterate over all regions of the playfield and to determine the relative position of the ball with respect to each edge of the region. That is, for example, a deter 25 minate had to be computed for each of the 4 edges of region 74 in order to conclude that the ball 72 is inside the region 74 when all determinates share the same sign. Performing this kind of analysis for, say, 2000 ball positions per second would hardly be feasible in real time. 30 Using an embodiment of the invention, however, the determination of the position of the ball may be based on a primitive "line crossing- event" determined for each of the lines used to subdivide a playfield into multiple regions, as for example lines 76 to 80, which provide the border of region 74. For each of the lines, a line crossing event or a relative WO 2013/064174 PCT/EP2011/069166 12 position event is determined, when the ball crosses the line. As illustrated in fig. 5, the ball changes its position from a previous position 84 to its present position in region 74. That is, a primitive event detector associated to line 82 would change its output state or, in other words, generate a line crossing- event. 5 When, however, the primitive event detector associated to line 82 generates the line crossing element, an event generator receiving this event and in addition thereto the events determined by the primitive event detectors associated to lines 76, 78 and 80 will be able to generate an event indicating that ball 72 is now in region 74. The event detec 10 tor could, for example, be implemented as a state machine, as shown in more detail in figure 6. As compared to the conventional approach the computational load to determine the position of the ball with respect to predetermined regions, as for example with respect to the penalty area, may decrease by a considerable amount. 15 In other words, a conventional approach would require, for each defined region: for each straight border segment of the region: calculate a determinate for the position of the observed object; compare the calculated determinates to conclude, whether the object is within the area or not. 20 To the contrary, using an embodiment of the invention, one may define a number k of lines in order subdivide the playfield into a number n of regions, as, for example, illus trated in figure 5. The detection may then be performed as follows: 25 Start k primitive event detectors, each associated to one line, in order to deter mine, as a primitive event, whether the ball is on a first or a second side of the line. Start n Event detectors, to determine an event indicating that the ball is inside its 30 associated region, wherein each event detector is connected with the primitive event detectors associated to the lines bordering the region associated with the event detector. Determine an event with the event detector, when all connected primitive event WO 2013/064174 PCT/EP2011/069166 13 detectors provide corresponding information. Figure 6 schematically illustrates a possible implementation of an event detector 100 as a state machine. The state machine is depending on 4 input events or input quantities A, B, 5 C, and D, which may, for example, be provided by one or more primitive event detectors. When the state machine arrives at state 102 the state machine or the event detector gener ates or determines its associated event of interest, which naturally depends on the inputs to the event detector. The state machine is initialized with its starting configuration 104. Upon occurrence of event A, the state machine transits into state 106 from where it trans 10 its to state 108 upon occurrence of event B. After occurrence of event C the state ma chine transits to its final state 102 and determines its associated event. From both states 106 and 108 the machine is reinitialized to its starting configuration 104 upon event D, which may be interpreted as a reset signal or the like. It should be noted that, according to the specific implementation of figure 6, the order of the occurrence of the signals A to 15 C is of importance to arrive at the final state 102. However, alternative implementations of state machines may be used, where the order of arrival of input events is irrelevant. Generally, using state machines as event detectors may allow implementing these in hardware, which may decrease the computational load in the analysis framework and speed up the overall processing. 20 Although only described for a subset of events of interest, arbitrary further events of in terest may be determined on the basis of the primitive events. Further Events of interest may, for example, be single passes from one player to another, double passes, shots on the goal, dribblings, free kicks, kick-offs or corner kicks. 25 It goes without saying that, although illustrated primarily with respect to a soccer match, further embodiments of the invention may be used in any other kind of sports game, such as for example basketball, handball, a game of volleyball, rugby, American Football, ice hockey, field hockey, polo, baseball, tennis, golf and the like. 30 The description and drawings merely illustrate the principles of the invention. It will thus be appreciated that those skilled in the art will be able to devise various arrangements that, although not explicitly described or shown herein, embody the principles of the in- WO 2013/064174 PCT/EP2011/069166 14 vention and are included within its spirit and scope. Furthermore, all examples recited herein are principally intended expressly to be only for pedagogical purposes to aid the reader in understanding the principles of the invention and the concepts contributed by the inventor(s) to furthering the art, and are to be construed as being without limitation to 5 such specifically recited examples and conditions. Moreover, all statements herein recit ing principles, aspects, and embodiments of the invention, as well as specific examples thereof, are intended to encompass equivalents thereof Functional blocks denoted as "means for ... " (performing a certain function) shall be 10 understood as functional blocks comprising circuitry that is adapted for performing a certain function, respectively. Hence, a "means for s.th." may as well be understood as a "means being adapted or operable for s.th.". A means being adapted for performing a certain function does, hence, not imply that such means necessarily is performing said function (at a given time instant). 15 Functions of various elements shown in the figures, including any functional blocks may be provided through the use of dedicated hardware, as e.g. a processor, as well as hard ware capable of executing software in association with appropriate software. When pro vided by a processor, the functions may be provided by a single dedicated processor, by a 20 single shared processor, or by a plurality of individual processors, some of which may be shared. Moreover, explicit use of the term "processor" or "controller" should not be con strued to refer exclusively to hardware capable of executing software, and may implicitly include, without limitation, digital signal processor (DSP) hardware, network processor, application specific integrated circuit (ASIC), field programmable gate array (FPGA), 25 read only memory (ROM) for storing software, random access memory (RAM), and non volatile storage. Other hardware, conventional and/or custom, may also be included. It should be appreciated by those skilled in the art that any block diagrams herein repre sent conceptual views of illustrative circuitry embodying the principles of the invention. 30 Similarly, it will be appreciated that any flow charts, flow diagrams, state transition dia grams, pseudo code, and the like represent various processes which may be substantially represented in computer readable medium and so executed by a computer or processor, whether or not such computer or processor is explicitly shown.

WO 2013/064174 PCT/EP2011/069166 15 Furthermore, the following claims are hereby incorporated into the Detailed Description, where each claim may stand on its own as a separate embodiment. While each claim may stand on its own as a separate embodiment, it is to be noted that - although a dependent 5 claim may refer in the claims to a specific combination with one or more other claims other embodiments may also include a combination of the dependent claim with the sub ject matter of each other dependent claim. Such combinations are proposed herein unless it is stated that a specific combination is not intended. Furthermore, it is intended to in clude also features of a claim to any other independent claim even if this claim is not 10 directly made dependent to the independent claim. Particularly, when a dependent claim is referring to an encoder or a sender, the corresponding feature of the related decoder or receiver shall herewith also be included and part of the disclosure of the description. It is further to be noted that methods disclosed in the specification or in the claims may 15 be implemented by a device having means for performing each of the respective steps of these methods. Further, it is to be understood that the disclosure of multiple steps or functions disclosed in the specification or claims may not be construed as to be within the specific order. 20 Therefore, the disclosure of multiple steps or functions will not limit these to a particular order unless such steps or functions are not interchangeable for technical reasons. Furthermore, in some embodiments a single step may include or may be broken into mul tiple substeps. Such substeps may be included and part of the disclosure of this single 25 step unless explicitly excluded.

Claims (26)

1. Apparatus for detecting an event of interest (30; 102), comprising: 5 A first primitive event detector (8b) for generating a stream of first primitive events (10b) using a sensor data stream (4), the sensor data stream (4) carrying raw data at a sensor data rate, the raw data being associated to one or more properties determined for multiple observed objects (72) using one or more sensors, wherein a data rate of the stream of first primitive events (10b) is lower than the sensor data rate; 10 A second primitive event detector (8c) for generating a stream of different second primi tive events (10c) using the sensor data stream (4), wherein a data rate of the stream of the second primitive events (10c) is lower than the sensor data rate; and 15 An event detector (16; 100) operable to determine the event of interest (30; 102) using the streams (10b, 10c) of the first and second primitive events.

2. The apparatus according to claim 1, wherein the first and second primitive event detectors (8b, 8c) are operable to exclusively use kinematic data as the raw data. 20

3. The apparatus according to claim 2, wherein the kinematic data comprises posi tion information, velocity information and acceleration information of an observed ob ject. 25

4. The apparatus according to any of the previous claims, wherein the first and se cond primitive event detectors (8b, 8c) are operable to exclusively use the sensor data stream (4) as an input.

5. The apparatus according to any of the previous claims, wherein a proximity 30 event is generated as the first or the second primitive event when position information of a first observed object and of a second observed object indicates that the second observed object is within a predetermined neighborhood of the first observed object. WO 2013/064174 PCT/EP2011/069166 17

6. The apparatus according to claim 5, wherein the predetermined neighborhood is defined by a predetermined maximum distance between the first observed object and the second observed object. 5

7. The apparatus according to any of the previous claims, wherein a remote- event is generated as the first or the second primitive event when position information of a first observed object and of a second observed object indicates that the second observed ob ject is outside of a predetermined neighborhood of the first observed object. 10

8. The apparatus according to any of the previous claims, wherein a direction changed- event is generated as the first or the second primitive event when a change of a velocity or an acceleration of an observed object exceeds a predetermined threshold. 15

9. The apparatus according to any of the previous claims, wherein an idle- event is generated as the first or the second primitive event, when a velocity of an observed object falls below a predetermined threshold.

10. The apparatus according to claim 9, wherein the idle- event is only generated 20 when the velocity of the observed object falls below the predetermined threshold for at least a predetermined minimum duration.

11. The apparatus according to any of the previous claims, wherein an active- event is generated as the first or the second primitive event, when a velocity of an observed object 25 exceeds a predetermined threshold.

12. The apparatus according to claim 11, wherein the active- event is only generated when the velocity of the observed object exceeds the predetermined threshold for at least a predetermined minimum duration. 30

13. The apparatus according to any of the previous claims, wherein a line crossing event is generated as the first or the second primitive event, when a component of a posi- WO 2013/064174 PCT/EP2011/069166 18 tion information of the first or the second observed object exceeds or falls below a prede termined threshold.

14. The apparatus according to any of the previous claims, wherein a hit- event is 5 detected as the event of interest (30; 102) when the first primitive event detector (8b) detects a proximity event for the first object and the second object and when the second primitive event detector (8c) detects a direction change event for the second object, the hit event indicating that the second object was hit by the first object. 10

15. The apparatus according to any of the previous claims, further comprising a fur ther event detector (18) for detecting a further event of interest (30; 102) using the first primitive event and the event of interest.

16. The apparatus according to claim 15, wherein an object possession event is gen 15 erated as the further event of interest (30; 102) when a proximity event is detected by the first primitive event detector (8b) and when a hit event is detected by the event detector (16).

17. The apparatus according to claim 15, wherein an object loss event is generated as 20 the further event of interest (30; 102) when a remote event is detected by the first primi tive event detector (8b) and when a hit event is detected by the event detector (16).

18. The apparatus according to of the previous claims, wherein the event detector (16; 100) is implemented as a state machine (100). 25

19. Method for detecting an event of interest (30; 102), comprising: Generating a stream of first primitive events (10b; 20) using a sensor data stream (4), the sensor data stream (4) carrying raw data at a sensor data rate, the raw data being associat 30 ed to one or more properties determined for multiple observed objects using one or more sensors, wherein a data rate of the stream of first primitive events (10b; 20) is lower than the sensor data rate; WO 2013/064174 PCT/EP2011/069166 19 generating a stream of different second primitive events (10c; 26) using the sensor data stream (4), wherein a data rate of the stream of the second primitive events (10c; 26) is lower than the sensor data rate; and 5 determining the event of interest (30; 102) using the streams of the first and second prim itive events.

20. An analysis framework for analyzing raw data portions being transmitted in a sensor data stream (4) at a sensor data rate to identify at least one event of interest (30; 10 102), each raw data portion being associated to one or more properties determined for an observed objects using one or more sensors, the analysis framework comprising: An input layer (6) comprising at least two or more primitive event detectors (8a - 8e) for generating at least a first (10b) and second (10c) stream of primitive events using exclu 15 sively the sensor data stream (4) as an input; and one or more event layers (12, 14) comprising one or more event detectors (16, 18) for detecting an event of interest (30; 102), wherein any one of the one or more event detec tors (16, 18) uses only the streams of the first and the second primitive events (18b, 10c) 20 or a stream of other events as provided by another one of the event detectors (16) as an input.

21. The analysis framework of claim 20, wherein the one or more event detectors of the one or more event layers (12, 14) are connected with the at least two or more primi 25 tive event detectors (8b, 8c) of the input layer (6) via a network.

22. The analysis framework of claim 21, wherein the network is a wired network.

23. The analysis framework of claim 21 or 22, wherein a communication in the net 30 work is based on the Internet Protocol.

24. The analysis framework of any of claims 20 to 24, wherein a data rate of the first and second streams of primitive events (10b, 10c) is lower than the sensor data rate. WO 2013/064174 PCT/EP2011/069166 20

25. The analysis framework of any of claims 20 to 24, wherein first and second primitive event detectors (8b, 8c) are operable to exclusively use kinematic data of an observed object as the raw data. 5

26. Computer program for performing, when running on a computer, the method of claim 19. 10 15