EP2747853A1

EP2747853A1 - Apparatus for capturing tennis play data

Info

Publication number: EP2747853A1
Application number: EP12756066.2A
Authority: EP
Inventors: Christian Züger
Original assignee: Kitris AG
Current assignee: Kitris AG
Priority date: 2011-08-26
Filing date: 2012-08-23
Publication date: 2014-07-02
Also published as: CN103857446A; WO2013029191A1; US20140206481A1; CN103857446B; CH705403A1

Abstract

An apparatus (10) for capturing tennis play data is preferably in the form of an apparatus which can be worn on the body of the player, particularly with an armband (12) on an arm of the player. By way of example, it comprises a voice recognition device with a microphone and particularly also motion sensors or further sensors. The sensors can record and later evaluate data from the player which are relevant to tennis play.

Description

Apparatus for recording tennis game data

Reference to related applications

This application claims the benefit of Swiss Patent Application No. 1397/11 of Aug. 26, 2011, the entire contents of which are hereby incorporated by reference.

Background of the invention

The invention relates to a device for detecting tennis game data according to the preamble of claim 1. Furthermore, the invention relates to a tennis game detection device according to claim 24, a data processing program according to claim 29 and a data carrier containing such a program. State of the art

A device of the type mentioned is known from WO 2009/033298. The device shown there allows to input the tennis game speech inputs into the device, which are then evaluated by means of speech analysis to at least the points of the

Recognize game and to be able to view the score. The device shown there enables the continuous voice input. The device described in the cited document allows the delivery of unexecuted speech signals to a base station, but may also be designed so that the speech recognition and the evaluation takes place up to the score display in the device itself.

Presentation of the invention The invention is based on the object to improve such a device.

This object is achieved in the aforementioned device with the characterizing features of claim 1.

The fact that the device detects a plurality of data acquisition devices that record different data, the game can be better detected and subsequently evaluated. In particular, two and preferably more than two data acquisition devices from the group speech acquisition device with microphone, ball impact detection device, motion sensor device, key input device and physiology sensor device are provided in the device. Preferably, the device is worn on the player's arm, particularly similar to a wristwatch.

Preferably, the voice input is possible only after a previous activation, whereby error detection of the speech signals, with which the player enters the game or the points obtained, are significantly reduced. Furthermore, the power consumption can be reduced if the speech recognition is activated only temporarily.

In one embodiment, the activating means is a finger-operated switch or button. In another embodiment, the activation means may be formed by a motion sensor in the device. It is thus possible to move the device, for example, by making a single or two-fold rotary motion with the wrist or, for example, with the finger to knock on the device to unlock by this movement or movements of the device, the voice input device so that they are the subsequent game relevant Voice input allowed. This manual release (first criterion) can be combined with a special trigger voice command (second criterion) for release, so that only when both criteria are present the (further) voice input for the actual Player record is released. There are six different activation options for voice input with the actuatable switch / button and the motion sensor as well as the voice input, in that one of three second options (language, motion sensor or second operation of the switch / button) follows the operation of the switch / button. The results also at the beginning with the motion sensor or the turning or knocking. Thus, each player can select the most appropriate activation for the speech input. An activating means in the form of another sensor, for example a reed contact, can also be provided, which can be actuated by a means provided by the player or provided on the tennis racket, ie in the example mentioned by a permanent magnet fixed to the racket.

It is preferred that by the control of the device different manually inputable operating sequences and following the manual input first voice input are recognizable, the manual sequence and the voice input in combination are recognizable as an assignment indicating whether the input for the player or for whose opponents takes place. Furthermore, it is preferred that the control is set up in such a way that a voice input made after the assignment can be checked for correctness in relation to the assignment of player or opponent.

The activation of the speech recognition thus serves, as mentioned, on the one hand the reduction of the energy requirement, on the other hand the "unambiguous" assignment of points to a player. This is done by activating as a sequence (be it by pressing a button or turning the arm or tapping) simply or twice (simply pressing the button or pressing the button twice). Depending on the activation sequence, a linguistic trigger command is expected or recognized by the controller. In one case (sequence with a single press or Rotary movement / knocking) that for "point player", in the other case that for "point opponent". The commands can, for example, each comprise three commands which already contain detailed information on the type of point (winner, forced error, un-forced error) and at the same time serve to check the point assignment by the activation. Only when the activation sequence (eg press once) and the voice command (eg green win) match, the points are assigned. This applies both to the simple form of pressing a button and to activation by turning or tapping. The idea behind this is that an accidental press of the button or the rotary movement or the knocking could take place and this should be prevented with the above-mentioned double check or verification.

Instead of or in addition to voice input, a key input device may be provided which provides keys for predetermined play or beat information that would otherwise be input via voice input, so that the input is made by operating the corresponding key or combination of multiple keys.

It is further preferred that the device comprises a vibration generator which can be activated to confirm receipt and / or recognition of voice input. Thus, the player can be confirmed the successful entry, without having to look at the display of the device.

The invention is further based on the object to capture game information even better and to relieve the player of voice inputs.

This object is achieved in a preferred embodiment of the device mentioned above in that the device is equipped with a motion sensor device, which is configured in particular for detecting and storage of tennis striking movements of the player. It is thus possible that in the below-described tennis game detection device (BASE) an evaluation device is provided which allows the detection of tennis striking movements of the player. This can instead be done in a higher-level computer (SERVER), especially if no BASE is provided. However, it is also possible for the detection and evaluation to take place already in the device itself, so that the data read out from the device already contain the evaluated motion sensor signals and not just the raw data of the motion sensors, although this is the preferred variant.

By detecting a strike by the player in the device, it is possible, on the one hand, to further improve the input by voice by checking the plausibility of the input with the beat information. Furthermore, the completeness of the game data can be fundamentally improved, even if beat information can be stored and associated with the course of the game. Depending on the extent and accuracy of the beat information determined by the sensors, in particular by comparing previously stored sensor signals for known beats with the current sensor signals in the BASE and / or in the SERVER and / or in the device, the possibility arises of recognizing Sensor signal patterns and the generation of precise beat information such as stroke type, forehand or backhand, spin etc.

Preferably, the device is a device that can be worn on an arm of the player and configured in such a way that either striking movements on the striking arm of the player or on the player's non-striking arm are recognizable. The sensor signals occurring at the non-impact arm are also characteristic for the movement of the impact arm and thus for the impact, even if they differ from the sensor signals on the impact arm. The ability to choose by the player allows him to personal preference to wear the device on the beater arm or the non-impact arm. Instead of wearing on the arm The device may also be designed to be worn on the upper body of the player, in particular with a chest strap, or on the head of the player. In these cases, other sensor signals are produced during typical player strokes, which is taken into account in the evaluation. On the one hand, the device or software program carrying out the evaluation must allow an input which indicates how the device has been worn and, on the other hand, the device or the program must be equipped with corresponding motion sensor data libraries or tables in which the for the typical

Beats resulting sensor data are stored. This can be player-independent sensor data that has been determined on a collective of players and has been stored. However, in addition or instead, player-dependent sensor data can be stored, which must first be recorded. In particular, the motion sensor device used in the device for generating the beat information comprises acceleration sensors. Furthermore, preferably also gyroscopic sensors and preferably also orientation sensors, which are also referred to as compass sensors. Thus, accelerations in all directions and rotations can be detected, which are characteristic of the impact movement. In addition, with the orientation sensors, the orientation of the player can be detected depending on the tennis court. The sensor signals can be compared by the device with previously stored in it, characteristic of a particular impact sensor data ranges, from which the device can determine the current impact. This can preferably also be done only in a higher-level computer (SERVER) and / or in a tennis game detection device (BASE), to which the data or the un-evaluated motion sensor data are read. The synchronization of all data is readily possible via a common timeline. The above statements also apply to an embodiment in which the device is arranged in the tennis racket. In this case, the device may be arranged in the grip of the racquet. An arrangement in the frame and / or in the clothing, the latter similar to a vibration damper in the fabric, may also be provided. This in addition to a partial arrangement in the handle or only in the fabric or the frame. It can also be provided that the device is worn as described on the body, but that a

Part of the device is disposed in or on the racquet and communicates wirelessly with the body-worn portion of the device.

It is further preferred that the device is designed to generate and store a ball signal (and possibly also to combine the motion sensor device data with the ball signal), which signals the impact of the tennis ball on the tennis racket of the player. As a rule, the ball signal is then linked to the other information or data from the device only in the tennis game detection device (BASE) or in the higher-level computer (SERVER). This, too, preferably takes place via the common time line or the time information which is added to the data. This allows a further improvement of the beat detection, since the sensor data can be checked for agreement, in particular temporal agreement, with the ball signal. Preferably, the ball signal is generated in the device itself, so that no external sensor is necessary for it. However, the device can also be designed to receive an externally generated ball signal, e.g. a ball signal delivered by the tennis racket. In this case, the device and the tennis racket are connected to each other via a near field radio link.

The ball signal generated in the device is preferably formed in such a way that via a microphone in the front Direction of the impact is detected acoustically and is evaluated by an evaluation device of the device as a ball signal. In this case, a second microphone can be used, which is not identical to the microphone for voice input. In particular, however, a detection of the ball signal is provided with the same microphone, which is also provided for the voice input.

It is further preferred that not only the ball signal is detected and evaluated, which results from the impact of the ball on the racket of the player with the device, but also that a ball signal is generated, indicating the previous impact of the ball on the tennis court. The impact of the ball can also be detected acoustically by the microphone. It is also preferable that a ball signal is generated when the opponent hits the ball. This signal can also be generated by acoustic detection of the corresponding noise. If the corresponding ball signals are displayed during the evaluation of the game information on a timeline, then conclusions can be drawn about the game.

As stated, it is preferred that the invention comprises at least one orientation sensor (compass sensor). This can e.g. be formed by an integrated circuit LSM303DLH type of the company STI Microelectronics. It is thus possible to determine the orientation / orientation of the player relative to the tennis court, since the orientation of the tennis court is known and fixed.

The device may further be configured to detect the heart rate of the player by being configured to receive a signal from a known heart rate sensor. Further or instead of the heart rate, other physiological data can be detected, in particular with a physiological sensor for detecting the oxygen saturation of the blood and / or with a physiological sensor for measuring the sweat and / or with a physiological sensor for measuring the blood pressure. The invention is further based on the object to improve the basically known base station, so that more information is available.

This object is achieved by a tennis game detection device of the aforementioned type, which additionally comprises at least one laser scanner, by which at least the impact position of one of the players on the tennis court is detectable when placing the tennis game evaluation device at a tennis court.

By additionally recording the position of the player on the court, the information for the players can be further improved.

It is preferred that the tennis game detection device is configured to synchronize the beat position with the data signals received from the device. By bringing together the data from the player-worn device and the player's location, which is best achieved through a common timeline of information, the player can be given an even better analysis after the game.

It is further preferred if the tennis game detection device comprises at least one video camera for receiving at least one half of the tennis court, in particular comprising two video cameras for receiving both halves of the tennis court. This allows to record the course of the game. If the time line is used for video recording as well as for the data from the device and the position determination, the player can be provided with very accurate analyzes. This in particular if, preferably, the at least one video camera can be controlled by the position signal of the at least one laser scanner, such that focused player recordings can be generated. A video camera with so-called PTZ function (Pan / Tilt / Zoom) allows tracking of the player. The invention is further the task. Basically, to provide a data processing program that improves the analysis of the tennis game. This is achieved by a data processing program which is designed for processing the data of a tennis game detection device and by which game point information from the device and video information on time information can be linked and video sequences are displayed in dependence on Spielpunktresults.

Brief description of the drawings

Exemplary embodiments of the inventions will be explained in more detail below with reference to the figures. It shows

Figure 1 is a block diagram of a device according to an embodiment of the invention;

FIG. 2 shows a frontal view of an embodiment of the device; and

Figure 3 is a schematic representation of a tennis court and the device and the tennis game detection device. Ways to carry out the invention

Figure 1 shows a block diagram of a preferred example of the device. This electronic circuit is e.g. housed in a housing, as shown as an example in Figure 2. This embodiment shown there has a housing similar to a sports watch and a watch strap, so that the device can be worn on the arm of the tennis player. For the functionality of the device in speech recognition can in principle to the aforementioned WO

2009/033289, the contents of which are hereby incorporated by reference. The block diagram of the device shows a processor 1. This executes all calculation and control functions. In particular, the processor

In order to recognize voice commands, preference is given to using a so-called "natural language processor" which is based on a digital signal processor (DSP) Such processors are known to the person skilled in the art and commercially available, eg a processor NLP-5x from Sensory Such processors allow the connection of an analog microphone 2 which is available for voice input by the player and control buttons are provided, one of which is a special control button 13 (Figure 2, where also three side buttons 3 are shown) which activates speech recognition in the processor, as previously explained, ie, if the player presses the button 13 included in the box 3 in Figure 1, the voice recording of the processor 1 is activated so that the player can score his points - and / or beat description so that it can be analyzed and converted to digital data or in accordance with the above-described sequences or with the thus possible differentiation of speech input concerning the player and the opponent. For the type of voice input, reference is again made to WO 2009/033298, which shows one possibility. Instead of or in addition to voice input, it is also possible to enter specific points or beat descriptions via correspondingly provided keys on the device. Accordingly, the microphone for the speech input will be omitted. If the voice input is omitted, a CPU other than the named one may be used. An optical display is denoted by 4 in the block diagram and may be, for example, an OLED display. In FIG. 2, the display provided in the housing 10 is designated by 14. A memory 5 may be formed by a flash memory module or a secure digital memory card (SD card). at According to a preferred embodiment, the device has motion sensors by means of which it can detect the striking movement of the player. In the example shown, acceleration sensors 6 and gyroscopic sensors 7 are provided for this purpose, which supply corresponding signals for all axes and which are connected to the processor 1, which receives the sensor signals and at least stores them. The evaluation of these data usually takes place later, when the data is read from the device (eg in a tennis game detection device (BASE) 30 (Figure 3) or in a SERVER 35). However, the evaluation could already take place in the device itself. For the evaluation, it is provided in particular that (in the case of the device by the processor 1) the sensor data resulting from a specific impact of the player is compared with a table (in the case of the device in the memory 5) containing typical value ranges for the typical tennis beats , These values have been determined empirically and then stored. However, corresponding algorithms can also be provided which can be based, in particular, on the empirically determined data. In this way, in particular from the empirical values, it can be concluded simply and quickly from the sensor signals, without great computational effort, what a player's stroke was. Acceleration sensors are commercially available and, for example, a 3-axis sensor circuit of the type LIS3DH can be used. As gyroscopic sensors 7, with which the angular velocity of the impact movement can determine, for example, a 3-axis sensor circuit of the type L3G4200D be called. Combined acceleration and gyroscope sensor circuits are also available on the market which may be used, eg a LSM320HAY30 sensor. As an orientation sensor or compass sensor, which can determine the orientation of the player relative to the tennis court, For example, a 3-axis sensor circuit of the type

LSM303DLHC be called.

According to a preferred embodiment of the device, the latter can detect and store the beat information both when the player is wearing the device on the striking arm and when the player is wearing the device on the non-striking arm. It is communicated to the processor 1 by the player via the keys 3, which choice the player wishes to make. When reading out the data, this information is then read out, so that the tennis game detection device 30 and / or the server 35 can consult corresponding tables which are suitable for the choice of the striking arm or the non-striking arm. If tables are consulted from the memory 5 of the device, the procedure is accordingly dependent on the choice made previously. It has been found that sensor signals which are characteristic of a specific impact also result in the arm other than the striking arm. As mentioned, the device may also (alternatively or additionally) be worn on the upper body, e.g. with a chest strap, or designed to be worn on the player's head. In this case as well, the location of the wear on the body can be entered on the device, so that it is clear for the evaluation of the signals at what kind of wear they were generated. As mentioned, the device can also be arranged completely or partially in the player's racket.

It is further preferred if the device can detect and possibly also take into account a ball signal which indicates that the player has hit a ball with his bat. This can be done in the

Bat a sensor be present, the signal is taken over into the device, for example via the interface 15. However, it is preferred that the device detects the ball signal itself. This is done in particular via the microphone of the device, which detects the impact of the ball acoustically. This can also be another microphone 8 be provided, which absorbs the noise that occurs during contact between the tennis racket and tennis ball, so that it can be detected by the processor. The preferred embodiment with acoustic detection allows a very good detection of a shock. In the same way, the impact of the ball on the tennis court and the encounter of the ball with the opponent's racket can be detected.

Furthermore, it is preferred if the device allows a vibratory feedback to the carrier, so in particular with key inputs and / or voice inputs. For this purpose, a vibration motor 9 is provided. The device can have a USB interface 16 and / or a wireless interface, in particular a Bluetooth interface 15, in particular via a Bluetooth low-energy interface.

FIG. 2 shows the device 10 in a preferred embodiment as an arm-worn device with a wristband 12.

Figure 3 shows schematically a tennis court 20 with the two halves 21 and 22. The player 23 carries a device 10 on the non-impact arm, which is shown in the figure by the device 10 shown in large size and the arrow to the arm. The speech bubble 24 and the rectangles 25 and 26 are intended to symbolize the voice input by the player, the voice recording by the microphone and the speech analysis by the processor 1.

With the device 10 alone, it is possible to record the important information of a tennis game, as has been described. In this case, the device is read by a computer 40 and the data is transmitted to the server 35. There the mentioned evaluations can be made from the raw data. As an additional element, however, a tennis game detection device 30 may be provided. Subsequently, both cases are considered. The device 10 is referred to as KIT, the tennis game Detecting device 30 as BASE. Furthermore, a server 35 is mentioned on which runs a data processing program according to the invention. This server will be referred to as SERVER below. The program could also run on the Tennis Game Detector 30 (BASE) and evaluate the data from the device 10 there.

Distinction of two cases

Case A - BASE 30 not available

Case B - BASE 30 available

Case A

KIT 10 works autonomously. All collected data is downloaded via USB to any computer 40 and uploaded from there to the SERVER 35.

Case B

KIT 10 works with BASE 30.

A connection is established between a KIT 10 and a BASE 30. If a match is initialized on the KIT (generation of a unique match ID), the match ID is transmitted to BASE and the time is synchronized. BASE then collects additional information such as video signals and position data of the players.

The match data collected by BASE (own and transmitted by KIT) will be transmitted in whole or in part live to the SERVER, depending on the quality of the existing internet connection.

If the Internet connection is not available, the data collected after match / tournament ends is physically connected to a third party device (for example, by removing the removable disk / hard disk in the case of the BASE), from where the data relay to the SERVER takes place.

The procedure described in Case A for uploading the data from the KIT to the SERVER remains unchanged.

Function server / third party devices (PC, laptop,

Smartphone) On the server, the data processing, evaluation, etc. takes place. The management of the matches is also web-based. A login allows the user to access his matches and match data. As far as necessary, only software for simplified data upload is installed locally on the device.

The server has different services (web applications) such as publication of live match data, coaching function, preparation of statistics, etc.

KIT

Description of the main functions

Off Court

Clock mode

KIT can be worn as a watch and has the usual applications that has a watch.

Pre-match mode

To prepare for a match, a new match ID is first generated. This is formed on the basis of device number, player information, etc. In a next step, the player must tell the KIT if he wears KIT on the batting arm or the non-batting arm. Subsequently, the relevant information about a match can be recorded via a graphical interface (GUI) (tournament number, match mode (two winning sets with tiebreak in the third set), name opponent, temperature, etc). This can be done either via the function keys or via voice recording (at least partially with voice recognition). Alternatively, the data can also be recorded on a third-party device (laptop, smartphone, etc.) and transferred via USB to the KIT.

Walk On Court

As soon as the player enters the field and a BASE is available, he can use the function keys 3 to pair with the BASE.

On Court

Activation match mode After the play-in phase, immediately before the start of the game, the player starts the match tracking program via the function keys 3. KIT then only needs the information, which player in the first game opens. KIT switches to match mode. Speech recognition is enabled but still paused. All sensors and the microphone for the ball signal are activated.

Match mode

Capture point information / speech recognition

When a point is completed, the player captures the point information in the depth he wants (minimum information to maximum information).

To do this, it first activates speech recognition. This is done either via the Hauptbutton 13 or a rotary motion of the wrist or by knocking with one hand to the other. The KIT recognizes the rotational movement due to the motion sensors, in particular the gyroscopic sensors or recognizes the knocking due to the sensors 6 and the microphone 2 or 8 as a predefined "motion / noise pattern" and activates speech recognition.

Pressing the main button once (or turning it once or tapping it) means "point for the player." Twice pressing / turning or tapping (within one second) means "point for the opponent."

Depending on the command (point for player or opponent), the speech recognition software opens another trigger command vocabulary set. This consists of only six words. The six words stand for the player in the case of the point

Point for players by throwing the ball;

- Point for player by forced mistake of

Opponent;

- point by player through unforced error of the opponent;

Point for the player by an ace; - point for the player by a service wizard;

- Point for the player by a double error of the opponent.

If the opponent has made the point, the corresponding vocabulary set is called by pressing / tapping twice. The six words stand for

- Point by opponent by throwing the ball;

- Point for opponent by forced mistake of the

player;

- Point by opponent by unforced error of the

Player;

Point for the opponent by an ace;

Point for the opponent by a service winner;

- Point for the opponent by a double mistake of the player.

Limiting the vocabulary to six unique trigger words maximizes the likelihood of detection, even at different volumes, distances to the microphone, and heart rate / breathing. This is even more so, as the vocabulary can be trained in the set-up phase of KIT (after purchase)

(Speaker Dependent). Although KIT comes with an already high-quality vocabulary (Speaker Independent), it can then be trained for even higher recognition rates depending on the speaker.

KIT expects a point confirmation for the player by one of the six commands after pressing the main button once. If this confirmation does not occur within three seconds, the speech recognition is closed and an error message appears in the display. The process must now be repeated as described above.

If the speech recognition has detected a correct command within the three seconds, a confirmation by display takes place. The display will show for a announce a symbol for point players as well as the last command. Subsequently, the scorecard display is updated.

Crucial for the overall system is the correct assignment of points to the player and the opponent. The double-checking system (Knob / Turn or Knock and corresponding trigger command) minimizes false detection and is less than 0.1%, which is excellent in speech recognition applications.

After correctly recognizing a trigger term, KIT also opens the vocabulary set for the detailed information about the beat. Speech recognition remains active for 5 seconds. If there is no recognition of further terms from this vocabulary, the speech recognition is closed again. If a command is detected, this information is saved with the point information. The commands for the detailed information (for example, forehand / backhand, volley, spin, stop ball, etc.) can be spoken in any order. The system can independently assign the information to a category.

Record Mode

If the player wants to record a personal comment on a certain point, a game, etc., he can activate the recording mode by pressing a button 3 for two seconds. If the speech recognition mode is active, it will be deactivated and the recording mode will be activated. The display will show the message "Speak now." He can now speak his comment for a maximum of 10 seconds.The recording mode stops either when the 10 seconds have been reached, which is signaled by a vibration signal, or by pressing the X key again automatically switches to the result display and KIT returns to the normal match mode If the player wants to record a comment again, he must repeat the process.

Microphone "Ball Impact"

KIT can have two microphones. That for speech recognition, which is activated only on request and a microphone to measure the impact of the ball on the racket (and possibly on the pitch and the opponent). This second microphone is constantly active and detects all sounds. Preferably, both functions can be met with a microphone, but the signals are evaluated only on request or when activated as voice inputs.

The detected ball signals and also the voice signals (which together may be referred to as audio data) are preferably stored as digital data locally on the KIT or additionally transmitted in the presence of a connection to the BASE. This method saves a lot of storage space compared to storing the audio files (for postprocessing) and massively reduces the amount of data to be transmitted if there is a connection to the BASE.

sensors

In the KIT, various motion sensors are integrated in the motion sensor device.

a) Accelerometers (Accelerometer / Accelerometer)

b) Gyroscopic sensors

c) Orientation sensors (compass sensors) Acceleration sensors

An acceleration sensor detects the linear acceleration in the x, y or z axis. From this, the translational motion can be calculated.

Gyroscopic sensor

A rotation rate sensor measures the angular velocity about the x, y or z axis. From this, the rotational movement can be calculated. In particular, this sensor can also be used to detect the rotational movement of the wrist in order to activate the device and can therefore replace the below-mentioned live analysis for knocking.

Orlentierungssensor To determine the orientation of the player relative to the tennis court, a magnetic field sensor (compass sensors) can additionally be used. In Figure 1, the compass sensor is denoted by 7 '.

The values determined by the sensors are constantly stored locally on the KIT, or additionally transmitted if there is a connection to the BASE.

Live analysis "knocking" on KIT or turning

In order to be able to detect the above-described "knocking" (with one hand on the other - carrying the KIT) or turning, a rough initial analysis takes place on the KIT.

This checks for very specific movement patterns and checks in the presence of such movement patterns, whether an appropriate noise pattern is given. As far as this is the case, as described above, a corresponding trigger vocabulary is opened and the speech recognition is activated.

Data transmission to BASE

All recorded data is transmitted to the BASE via a wireless technology, preferably via Bluetooth Low Energy, if there is a connection to the BASE.

Thereby a data buffering takes place. If data can not be transmitted for a short time, they are temporarily stored on the KIT and transmitted again if the connection is intact.

BASE

The BASE fulfills various functions:

• Digital or manual result display • Data recording from KIT

• Data storage of data KIT / BASE

• Forwarding of selected data to SERVER with existing Internet connection

• Laser position measurement of the player and the opponent. This can be a so-called 2D laser. Also 3D laser can be used. The laser is shown schematically and designated 32.

• Video recordings

two static cameras 33 for recording the two halves of the space

two PTZ cameras 34, which are controlled by the device 30 via the laser 32

As a laser for position measurement of the player position with respect to the Tennispielerfassungsvorrichtung 30 can be used in particular "scanning laser" as they are also commercially available for robot applications, for example, a laser scanner from SICK type LMS 111-10100 can be used, which is a measuring distance from 0.5 m to 20 m and has a viewing angle of 270 degrees Such and similar lasers have a scanning frequency of 25 Hz or 50 Hz and detect any object, including tennis players with an angular resolution of 0.5 degrees and an accuracy of + Thus, the position of the player during the game can be detected and stored over time so that the position information can be linked to the data from the at least one device 10. Thus, it can be determined where the player is just before reaching a point, for example, also where it was when the ball signal of the sensor was generated The position information can also be linked to the voice inputs. This can also be done first in the server

As static video cameras 33, one camera per half seat can be used. For example, commercially available cameras from Sony or Clover Electronics can be used. For the cameras 34, which the players can track based on the laser position detection controlled by the BASE 30 (so-called pan / tilt / zoom cameras), corresponding commercially available cameras from the company DLink or Sony or Panasonic available from the computer of the BASE 30 via a Interface (eg Ethernet or RS-422) can be operated so that the camera follows the player. The computer of the base knows due to the laser measurement by means of the laser 31, the position of the player / or the player and can control the camera accordingly. This gives video data of the whole place and also more specific video data for each player. Their evaluation is preferably carried out only in the server 35 and not already in the device 30, although this is also possible.

In the following, data analysis in the server is described in more detail. The data on the player position and optionally the video data preferably originate from a tennis game detection device, as described. However, this data could also come from a separate laser measuring device or from a separate video camera device. This is not significant for the combination of this data with the data from the device 10, provided that the laser position data and / or the video data are provided with the same time information or time line as the data from the device 10, so that for the running on the server Program the assignment of the data to each other is possible.

SERVER - Data analysis

The server 35 performs various functions such as

· Data recording and storage of transmitted

Data (KIT or BASE)

• Synchronization of BASE and KIT data • Data evaluation and processing

• dissemination of information

«Performing match analyzes / processing statistics

The most important function is the data synchronization and processing, which is described in more detail below.

All existing data is provided with a time stamp, so that they can be synchronized or synchronized. Step 1 - Evaluation of the motion sensor data

By means of an analysis software possible strokes are extracted from the thousands of movement data by scanning for stored movement patterns. For each potential hit event determined, a timestamp is set for the most likely hit (ball hits racket - peak in the movement curve).

In addition, the movement data are depth-analyzed. It is logged for each possible impact event, what a stroke and in what execution it could have been (for example, forehand volley or backhand basic strike slice).

Step 2 - Synchronization with microphone data The microphone data has already been pre-filtered on the KIT. The determined impact sound data are now synchronized with the data from the motion sensors. The result is a draft of a hit event table, where the possible beat events from both sources (sensors / microphone) are recorded chronologically.

In addition, the microphone data are depth-analyzed.

It is logged for each possible impact event, what a blow it might have been due to the thresholds, in particular possible surcharges are extracted.

Step 3 - Synchronization of the two results Filtering of the possible impact events is now carried out with the aim of eliminating false events. All events which have no match within a time bandwidth of approx. 0.5 seconds are deleted from the beat event list. If the motion sensors register a service movement but the microphone does not detect a ball impact, this event is cleared. Probably it was a "dry exercise" or a false detection of the sensors. This results in an adjusted impact event table, which is supplemented per beat with the impact attributes of the previous analyzes.

Step 4 - Evaluation of Speech Recognition Now the speech recognition data are evaluated, looking primarily for the point information. This is unique and can only be A or B For each event, a timestamp "point" is set on the timeline and at the same time the result is calculated, which can be calculated based on the rules of the game and the information on who started the service

Point information is therefore always supplemented by the result and the service information.

In addition, for each record, if any, further information from speech recognition or voice recording may be stored (e.g., swirl information, etc.).

Step 5 - Synchronization Beat Event Table with Speech Recognition Data

The first point is called first.

Starting from this timestamp, the backlash table is searched backwards until the last service is found. If the player is not serving, the last return must be found.

If this service or return is found, further information about the point is calculated and stored:

^■ Start of the ball change (time stamp)

^■ Length of the ball change

Based on the service, it is calculated how long the rally took or how many times the ball was hit by the player (the opponent must have beaten the same number of times).

^■ 1. / 2. service

Starting from the last service, it is determined whether there is yet another service stored in the impact event table. If not, it was a 1st service. If yes, it may have been either a second service or the first service had touched the edge of the network and had to be repeated. If there is no information about the service of the speech recognition, it is presumed to have been a second service due to the probability.

^■ Ace / Service Winner or Double Error

If after the service no further hit event for this rally is found in the table, this means (in case the KIT player served) that the opponent could not return the ball. The reason for this is taken from the information of speech recognition (slap, forced error, forced error). If the hit was hit, it's either an ace or a service winner. If the point is e.g. When the opponent has been hit and two service events have been detected and an Unqualified Error has been recorded in speech recognition, it is probably a double fault.

»If not found, the starting command" Who Serves "is searched for as the start of the first rally and recorded as the beginning of the rally (time stamp).

Now the process is repeated for each additional point. A deviation exists only in case of not finding the service or the return. Then the starting point is not taken as the reference point, but the time stamp of the last point information. There are no further calculations.

Step 6 - Synchronization position data

The position data recorded by the BASE are synchronized with the point information on the server in time, and the position information is included in the beat event table as additional information.

Step 7 - Video Sync The videos recorded by the 4 cameras are provided with the Match-ID on the server and synchronized exactly in time.

Step 8 - Calculating the Point Video Sequence The four video files will be in one next

Step synchronized with the point information, where at each point a start time (time stamp of the impact minus 5 seconds) and end time (time stamp of the last impact event within a point / ball change plus 5 seconds) is set. This makes it possible to control the corresponding video sequence at any point in the later match analysis.

Live result calculation on KIT

An immediate result calculation based on the speech recognition data (point information player or opponent) already takes place at the KIT. Due to the choice of game regulations (eg 2 winning sets, tie-break in the 3rd set) and information on who started the service, the KIT can calculate the current result continuously thanks to the integrated tennis score and give feedback to the player hand back. At the same time, this result will be transmitted to BASE if it exists and will be transmitted to the server as result (with the corresponding match ID) if the internet connection is available. This provides the information within a few seconds on any website (such as tournament websites, Facebook, Twitter, etc.) or apps available.

Movement Pattern Library (Player Independent) A variety of motion patterns are stored on the server. In the analysis of motion sensor data from the KIT, the analysis software checks if there is a match of a registered motion with one or more stored motion patterns. If this is the case, the motion pattern that has the greatest match is chosen. This is then logged as a hit event in the hit event table (with all stored details such as forehand / backhand, Swirl, etc.) - In the movement pattern library, swipe patterns are stored for right- and left-handed people, for double or one-handed forward and / or backhand strokes. The motion pattern library includes both patterns of strokes in which the KIT is worn on the whip arm as well as the non-whip arm. Similar to speech recognition, these are "player independent" swipe patterns, and to improve the recognition rate and accuracy, the player can use the KIT on the server to create their own swipe movement library.

Individual movement pattern library (player dependent)

The player can use the Personal Strike Pattern mode during training with the KIT to create custom flicks in his personal movement pattern library.

The player is first asked to provide general information: forehand - one-handed, double-handed, backhand - one-handed, double-handed, KIT with or without arms, left or right-handed. The entries are made via the function keys.

After that he is systematically by possible

Blowing movements performed for recording. If he e.g. If he selects the topspin of Topspin, he must make 10 strikes in a row, which will be recorded. If he thinks the punches are good, he saves them. Then he continues with the next beat pattern.

After the training session, he loads the recorded data via USB onto his computer and from there to the server. The server then deposits these swipe patterns in the player's personal library.

If an analysis of the movement data of a match takes place at a later point in time, the analysis software checks as a priority whether personal movement patterns are present and a match is given. Only if no agreement can be established, the system checks secondarily whether there is a match with a beat pattern of the player-independent library.

The invention thus relates to a device for detecting tennis game data, wherein the device is configured as a device that can be worn on the body of a player or at most as a wholly or partly arranged in / on the racket, characterized in that the device is a multiple number of data acquisition devices for detecting different tennis game-specific data. Preferably, at least two, preferably more than two, of the group speech detection device with a microphone, ball impact detection device, motion sensor device, key input device for beat information, physiology sensor device are provided as data acquisition devices.

It is further preferred that the device is designed as a device that can be worn on the player's arm, or that the device is designed as a device that can be worn on the chest of the player, or that the device is configured as a device that can be worn on the player's head. The device may comprise the speech recognition device with a microphone, by which voice inputs of the player can be detected and evaluated and is characterized in that the voice input device comprises an activatable by the player activation means by the activation of voice inputs can be entered or at its non-activation voice inputs are not entered ,

Furthermore, the device can be characterized in that the speech recognition unit is designed to recognize a speaker-dependent vocabulary and / or to recognize a speaker-independent vocabulary.

Further, it is preferable that the manually different by the control of the device manually inputable operating sequences and following the manual input first recognizable speech input, wherein the manual sequence and the speech input in combination are recognizable as an assignment indicating whether the input is made for the player or for his opponent. It is further preferred that the controller is set up in such a way that a voice input made after the assignment can be checked for correctness in relation to the assignment of player or opponent. The activating means may be a finger-operated switch or button.

The activation means can be formed by a motion sensor in the device, which is designed such that thereby a rotation of the wrist or a tapping on the device is recognizable as activation.

Further, the apparatus may comprise a vibration generator operable to confirm receipt and / or recognition and / or non-recognition of voice inputs by the controller of the apparatus. Furthermore, the device can have a visually readable display, in particular an alphanumeric display, which can be actuated by the controller of the device for confirming the receipt and / or the recognition and / or the non-recognition of voice inputs. Furthermore, the device can have a visually readable display, which can be controlled by the controller of the device for displaying the game result, wherein the controller is configured in particular for calculating and displaying the result based on the voice inputs evaluated by the controller.

The device preferably comprises a motion sensor device for detecting tennis striking movements of the player and is designed to store the motion sensor data. One to three acceleration sensors are provided in the motion sensor device and in particular additionally one to three gyroscopic sensors and in particular additionally one to three compass sensors. When the device is a device wearable on an arm of the player, it is preferred that the device is configured with a selection input means for inputting whether strokes are received and stored on the player's strike arm or the player's non-strike arm and / or or the device is a device wearable on the chest of the player and / or a device wearable on the player's head and provided with a selection input means permitting the entry of the carrying position into the device.

It can be provided that the control of the device for evaluating the motion sensor signals is designed, in particular for comparing the motion sensor signals with stored in a memory of the device sensor signal value tables. Further, it is preferred that the device is configured to store a ball signal that signals the impact of a tennis ball on the tennis racket of the player, possibly additionally the impact of the ball on the tennis court and / or on the opponent's racket.

The ball signal can be generated in the device and / or the device can be designed to receive an externally generated ball signal. Preferably, the ball signal can be generated by a sensor in the device, in particular in that the impact of the ball can be detected acoustically via a microphone of the device and can be evaluated by a detection device of the device as a ball signal. It is possible that the device has two microphones, one of which is intended for the detection of the ball impact and the other for voice input, and in particular that the microphone for the ball impact is constantly receptive and the microphone for voice input only by an activation by the player receptive is. Preferably, only one microphone is provided and thus the same microphone is used for the voice inputs and for the acoustic detection of the respective ball impact. The device can be designed with a physiological sensor for detecting the heart rate of the player, and / or with a physiological sensor for detecting the oxygen saturation of the blood and / or a physiological sensor for measuring perspiration and / or a physiological sensor for measuring blood pressure.

The control of the device can be designed for the evaluation of at least two, in particular three and in particular four of the data acquisition devices. It is preferred that the device has at least one interface, which is designed for dispensing stored data from the data acquisition devices and / or for outputting evaluation results from the data of the data acquisition devices, wherein the

In particular, the interface is a wireless interface.

Furthermore, a tennis game detection device may be provided, comprising a computer and designed to receive and process the data signals from at least one of the devices described. The tennis game detection device may comprise at least one laser scanner, by which at least the impact position of one of the players on the tennis court can be determined when placing the tennis game evaluation device at a tennis court. The tennis game detection device may be configured to synchronize the determined beat position with the recorded and / or generated data signals from the device carried by the player. Furthermore, the tennis game detection device may include at least one video camera for receiving at least one video camera

Include half of the tennis court and in particular include two video cameras for receiving both halves of the tennis court. The at least one video camera can be controllable by the position signal of the at least one laser scanner, such that focused player recordings can be generated. Further, the invention relates to a Datenverarbei ^¬ processing program, which is designed for processing the data from at least one of the devices described in that it is designed for processing and combining data from at least two of the data acquisition devices of the apparatus. The data processing program can be designed to process and combine motion sensor information and / or orientation sensor information and / or ball signal information from the device as a function of game point results. The data processing program can contain at least one library of sensor signals which contains tables of characteristic sensor signals from sensors, in particular motion sensors, of the device and tennis game information associated with the characteristic sensor signals, in particular information about the type of impact. The data processing program may be designed so that the library contains both characteristic motion sensor signals of the beat arm movement containing tables and tables of characteristic motion sensor signals of the non-impact arm, and that the program is designed to evaluate information from the device, which indicates whether the device has been worn on the beater arm or on the non-beater arm during player acquisition.

Preferably, the library contains at least one table of characteristic motion sensor signals for supporting the device on the player's chest, or contains at least one table of characteristic motion ^sensor signals for supporting the device on the player's head, or contains characteristic motion ^sensor signals the device is arranged wholly or partly in the racket. The library preferably contains player-independent tables containing pre-stored motion sensor signals, and the library contains player-dependent tables into which movement movements typical of a single player are stored. sensor signals are stored. Preferably, the data processing program is further configured for processing player position data, in particular from a tennis game detection device, and / or for processing video information, in particular from a tennis game detection device.

Claims

claims

1. Apparatus for recording tennis game data, the apparatus being designed as a device which can be worn on the player's body and / or as a wholly or partially arranged racket, characterized in that the device comprises a plurality of data acquisition devices for detecting different tennis-specific data.

2. Device according to claim 1, characterized in that as data acquisition means at least two, preferably more than two, from the group speech detection device with a microphone, ball Schlagerfassungseinrichtung, motion sensor device, key input device for beat information, Physiologiesensoreinrichtung are provided.

3. Device according to claim 1 or 2, characterized in that the device is designed as a wearable on the arm of the player device or that the device is designed as a wearable on the chest of the player device or that the device as one on the head of the player portable device is designed, or that the device is designed as a arranged in the handle and / or in the frame and / or in the clothing of the racquet device.

4. Device according to one of claims 1 to 3 comprising the speech recognition device with a microphone through which voice inputs of the player can be detected and evaluated, characterized in that the

Voice input device comprises a player-operable activation means, by its activation

Voice inputs can be entered or at whose non-activation speech inputs can not be entered.

5. Apparatus according to claim 4, characterized in that the speech recognition unit for recognizing a speaker-dependent vocabulary and / or for the recognition tion of a speaker-independent vocabulary is configured.

6. Apparatus according to claim 4 or 5, characterized in that by the control of different manually inputable operating sequences and following the manual input first voice input are recognizable, wherein the manual sequence and the voice input in combination are recognizable as an assignment indicating whether the input for the player or for his opponent takes place.

7. The device according to claim 6, characterized in that the controller is set up such that an after the assignment of voice input on their accuracy against the assignment of players or

Opponent is testable.

8. Device according to one of claims 4 to 7, characterized in that the activating means is an actuatable by finger pressure switch or button.

9. Device according to one of claims 4 to 8, characterized in that the activating means is formed by a motion sensor in the device, which is designed such that thereby a rotation of the device or a knock on the device is recognizable as activation.

10. Device according to one of claims 1 to

9, characterized in that the device comprises a vibration generator which can be actuated by the control of the device for confirmation of the receipt and / or the recognition and / or the Nichtenken- tion of speech inputs.

11. Device according to one of claims 1 to

10, characterized in that it has a visually readable display, in particular an alphanumeric see-display, which of the control of the device for confirming the receipt and / or recognition and / or the non-recognition of voice input is actuated.

12. Device according to one of claims 1 to 11, characterized in that it has a visually legible display which can be controlled by the control of the device for displaying the game result, the controller in particular for calculating and displaying the result based on the configured by the controller evaluated voice inputs.

13. Device according to one of claims 2 to

12, characterized in that the device comprises the motion sensor device for detecting tennis striking movements of the player and is configured to store the motion sensor data.

14. The device according to claim 13, characterized in that the motion sensor device comprises one to three acceleration sensors and in particular additionally one to three gyroscopic sensors and in particular additionally one to three compass sensors.

15. Device according to one of claims 1 to

14, wherein the device is a wearable on one arm of the player device, characterized in that the device is configured with a Wahleingabemittel that can be entered by whether blows on the club of the player or the non-impact arm of the player are recorded and stored and / or that the device is a device wearable on the chest of the player and / or a device which can be worn on the player's head and is provided with a selection input means which allows the entry of the carrying position into the device.

16. Device according to one of claims 1 to

15, characterized in that the control is designed for the evaluation of motion sensor signals, in particular for the comparison of motion sensor signals stored in a memory of the device sensor signal value tables.

17. The device according to one of claims 1 to 16, characterized in that the device is configured to store a ball signal which signals the impact of a tennis ball on the tennis racket of the player and in particular that the device further for storing a ball signal for the impact of the tennis ball on the tennis court and / or for the impact of the tennis ball on the opposing tennis racket is designed.

18. The device according to claim 17, characterized in that the ball signal can be generated in the device and / or that the device for receiving an externally generated ball signal is configured.

19. The device according to claim 17 or 18, character- ized in that the ball signal by a

Sensor can be generated in the device, in particular by a microphone of the device, the impact of the ball is acoustically detectable and evaluated by a detection device of the device as a ball signal or as one of the various ball signals.

20. The device according to claim 19, characterized in that it comprises two microphones, one of which is provided for the detection of the ball impact and the other for voice input, and in particular that the microphone for the ball impact is constantly receptive and the microphone for voice input only by a Activation by the player is receptive, or that the device has only one microphone which is always receptive to the ball impact and recording ready for voice input only by an activation by the player.

21. Device according to one of claims 1 to 20, characterized in that it is designed with a physiological sensor for detecting the heart rate of Spier lers, and / or with a physiological sensor for detecting the oxygen saturation of the blood and / or with a physiological Sensor for welding measurement and / or with a physiological sensor for blood pressure measurement.

22. Device according to one of claims 1 to

21, characterized in that the control for evaluating at least two, in particular three and in particular four of the data acquisition devices is configured.

23. Device according to one of claims 1 to

22, characterized in that it has at least one interface which is stored for dispensing

Data from the data acquisition devices is designed and / or for delivery of evaluation results from the data of the data acquisition devices, wherein the

In particular, the interface is a wireless interface.

24. A tennis game detection apparatus comprising a computer and configured to receive and process the data signals from at least one device according to one of claims 1 to 23.

25. Tennis game detection device according to claim 24, comprising at least one laser scanner, by means of which, when the tennis game evaluation device is placed at a tennis court, at least the striking position of one of the players on the tennis court is detectable.

26. Tennis game detection device according to claim 25, characterized in that it is designed to synchronize the determined impact position with the recorded and / or generated data signals from the device carried by the player.

27. Tennis game detection device according to one of claims 24 to 26 comprising at least one video camera for receiving at least one half of the tennis court, in particular comprising two video cameras for receiving both halves of the tennis court.

28. Tennis game detection device according to claim 25 and 27, characterized in that the mini- at least one video camera can be controlled by the position signal of the at least one laser scanner, such that focused player recordings can be generated.

29. A data processing program, which is designed for processing the data from at least one device according to one of claims 1 to 23, in that it is designed for processing and combining data from at least two of the data acquisition devices of the device.

30 data processing program according to claim 29, characterized in that it is designed for processing and combination of motion sensor information and / or orientation sensor information and / or ball signal information and / or physiological sensor information from the device as a function of Spielpunktresultaten.

31. Data processing program according to claim 29 or 30, characterized in that it contains at least one library of sensor signals containing tables of characteristic sensor signals from sensors, in particular movement sensors, the device and the characteristic sensor signals associated with tennis game information, in particular information about the nature of the blow ,

32. A data processing program according to claim 31, characterized in that the library contains both tables containing characteristic movement sensor signals of the beat arm movement and tables of characteristic motion sensor signals of the non-impact arm, and in that the program is designed to evaluate information from the device which indicates Whether the device has been worn on the beater arm or on the non-beater arm during player acquisition.

A data processing program according to claim 31, characterized in that the library comprises at least one table of characteristic motion sensor signals for supporting the device on the chest of the player or that the library contains at least one table of characteristic motion sensor signals for carrying the device on the player's head, or that the library contains at least one table of characteristic motion sensor data in racket-mounted sensors.

34. A data processing program according to any one of claims 31 to 33, characterized in that the library contains player-independent tables containing prestored motion sensor signals, and that the library contains player-dependent tables in which motion sensor signals characteristic of a single player are stored.

35. Data processing program according to one of claims 29 to 34, characterized in that it is further configured for processing player position data, in particular from a tennis game detection device (30), and / or for processing video information, in particular from a tennis game detection device.

36. A data carrier containing a data processing program according to one of claims 29 to 35.