GB2588978A

GB2588978A - Device for a person with a visual impairment to follow a sporting event

Info

Publication number: GB2588978A
Application number: GB1918533.9A
Authority: GB
Inventors: Gomez De Quero Del Castillo Javier
Original assignee: Havas Worldwide Spain SA
Current assignee: Havas Worldwide Spain SA
Priority date: 2019-11-14
Filing date: 2019-12-16
Publication date: 2021-05-19
Anticipated expiration: 2039-12-16
Also published as: GB2588978B; GB201918533D0

Abstract

A device for a person with a visual impairment to follow a sporting event comprises a movable element (6, Figs 2 & 3) representative of a ball which is driven by a movement unit with motors to deform a region of an elastic surface 2 representative of a playing field, making it detectable to the touch. A processor obtains positional information about a play, for a given time interval, converts the information to movement of the movable element in the elastic surface 2 and coordinates data referring to an audio signal associated with the play in a synchronised manner. A panel 11 has a connection 12 for earphones. The elastic surface 2 may be interchangeable with a surface representative of a different sporting playing field.

Description

DEVICE FOR A PERSON WITH A VISUAL IMPAIRMENT TO FOLLOW A SPORTING EVENT

DESCRIPTION

Technical Field of the Invention

The present invention is comprised in the field of electronic devices to help and assist persons with visual impairments.

The invention enables, by using the images of the match, a person to follow a match through touch and sound.

State of the Art The use is known in the state of the art of image processing platforms which, based on the images captured in real time while a match is taking place, perform the analysis and statistics of the images, providing additional information about the position of the players, the position of the ball, the team that has the ball, the time each team has the ball, the distance run by each player, etc., such as, for example, the platform known as Mediacoach. This information is usually superimposed on a screen in order to enhance the experience of the audience following the match.

There are over 285 million people worldwide suffering from visual impairments who cannot follow images of sporting broadcasts. Current technology is not developed so that persons with visual impairments have the option of enjoying a sporting event.

Brief Description of the Invention

The present invention has been conceived in view of the limitations observed in the state of the art and it has the object of enabling persons with visual impairments to follow a match wherein there is a mobile element around which the game is played.

The invention relates to a device which receives information about the sporting event and reproduces the plays in a tactile and audible manner. This is achieved by means of a movable element, the movement of which along an elastic surface, which represents the playing field or court, can be perceived by touch and by means of a spoken phrase describing the play that is underway.

Depending on the type of sport, the movable element is associated with the mandatory object used in that sport. So as to not make the disclosure complex, the term ball will be used in the present description although it should be interpreted in a general, non-limiting manner as that mandatory object of a sport used (e.g., moved) by the participants thereof. It should thus be understood that the term ball also encompasses an inflatable ball, puck, weight, shuttlecock, etc. Additionally, the movements of the movable element are synchronised with an audio signal associated with said play. The plays can thereby be 10 followed together by a person with vision problems by means of the sense of touch and sound.

With respect to the field or court wherein the sporting event is taking place, it is usually divided into two parts. Such is the case with football, rugby, volleyball, basketball, handball, hockey, tennis, badminton, American football, etc. Opponents participating in said sporting event fight over the ball on the field. However, the invention can be applied without limitation to different types of playing fields, for example, sporting events wherein the field is not necessarily divided into two parts, each associated with an opponent. Such would be the case of racquetball, or even some disciplines within track and field, such as hammer throw, discus throw, etc., as well as for baseball or golf. Logically, for each specific sport, the surface of the device associated with the field would change in order to be duly represented. It is also indifferent if the opponents form a team with several people or if it is just one person.

The manner of representing the playing field including its possible parts 25 and/or sections is by means of raised lines marked on the surface so as to be identified by touch. Optionally, it is possible to make different types of lines have a different feel.

With respect to the information used by the device, it can be obtained by processing the images taken of the sporting event. Said processing obtains information about the initial location, final location and the location during the play of the ball on the field occurring in a given time interval. With this information, the device synchronises the audio signal associated with said play and can reproduce it at the same time as the mobile element moves along the surface, such that the movement of the ball in said play is emulated.

In some embodiments of the device of the invention, the processing is performed previously by an external play analysis and processing platform. This involves considerable computational savings and fewer demands for performance and features in the processor and in the associated electronics of 5 the device of the invention. Connection means for connecting to said platform enable said information to be obtained. A connection can be arranged additionally or alternatively in order to read a storage memory with the previously saved information obtained from the platform or by means of another method. Said platforms known in the state of the art perform a diverse analysis 10 on the plays which the present invention can advantageously utilise even though the sporting event would not be watched live since it is necessary to wait for said information to be available. Generally, the platform includes information about the position of the ball on the actual field. This information must be transferred to the surface simulating the field in the device.

The processor of the device processes the information so as to obtain data referring to the initial location, final location and location during the play of the ball on the surface of the device in a series of time intervals. The processing includes analysing and locating the movements of the inflatable ball along the playing field, an association of each of these locations in time, synchronisation with the spoken phrase, and, if the device is capable of reproducing additional information, these elements are likewise associated.

Depending on the play, it is possible for the time interval to involve a substantial movement of the ball from what is known as an initial position at the beginning of the time interval, successive intermediate positions, and a final position at the end of the time interval.

Alternatively, other embodiments incorporate a more complex processing of the emission signal so as to enable a broadcast with minimal delay, almost in real time.

The device of the invention comprises a movement unit with electromechanical means to move the movable element along the surface and make it follow a path emulating the ball on the playing field. The path can be implemented in several ways. For example, one option is to follow a straight line. For example, another more realistic although more complex option is to make an extrapolation generating intermediate location points of the inflatable ball which adapt to usability and can improve understanding of the play by blind users.

In summary, the movements of the movable element can be detected by touch on a surface emulating the playing field and at the same time the correspondingly synchronised audio signal makes it possible for a blind person to follow the sporting event.

At this point, it should be pointed out that the invention can work with any data source and receive the information generated by it and, therefore, broadcast any type of game, such as football, basketball, tennis, etc. In conclusion, the object of the present invention is a device for a person with a visual impairment to follow a sporting event, including an elastic surface representative of a playing field; a movable element representative of the ball, with the movable element designed to deform a region of the surface making it detectable to the touch; a movement unit with motors to move the movable element along the elastic surface; processing means, for example a processor or similar electronic component, to obtain information about a play, wherein said information comprises, for a given time interval, data referring to the position of a ball on the playing field and data referring to an audio signal associated with the play, wherein the processor can convert the information about the play into data referring to the movement of the movable element in the elastic surface, and furthermore to coordinate said movement with the audio signal associated with the play in a synchronised manner.

Optionally, the processor can obtain the information about a play through a connection with an external platform.

Optionally, the processor can obtain the information about a play by pre-processing the audiovisual signal.

Optionally, it can further comprise an audio output connection to emit the audio signal associated with the play.

Optionally, the elastic surface comprises raised lines representative of a

playing field.

Optionally, the elastic surface can be disassembled so as to switch to a different playing field.

Optionally, the movement unit can generate a vibration signal depending on vibration activation data present in the information about a play. By creating different vibration signals associated with different events, communication with the user can be extended.

Optionally, the processor can generate an acoustic indication signal depending on acoustic indication activation data present in the information about a play.

Optionally, the device is autonomous by means of the incorporation of a preferably rechargeable battery to provide electrical energy to the components.

Optionally, the movable element has a base to which a non-pointed projection is attached having a rounded shape at the end thereof so as not to pierce the elastic surface when it exerts pressure.

Brief Description of Figures

To complement the description that is being made and for the purpose of helping to better understand the features of the invention, a set of drawings is attached to said description in which the following has been depicted in an illustrative and non-limiting manner Figure 1 shows a perspective view of the outside of an embodiment of the device of the invention for a football field.

Figure 2 shows an example of following the position of the inflatable ball 20 by means of the hand of the user for one embodiment of the device of the invention.

Figure 3 shows a cross-sectional perspective view of the detail of the movable element in relation to the elastic surface corresponding to the playing field.

Figure 4 shows a functional block diagram for an embodiment of the device of the invention.

Detailed Description of the Invention

In a more detailed manner, different aspects of the invention are schematically provided in the different figures in a non-limiting manner.

Figure 1 shows a perspective view of a possible embodiment of the outside of the device 1 of the invention for the case of football. A surface 2 representative of this playing field can be observed. The choice of material for the surface has been made after testing with different groups of people with a varying degree of visual impairment and sensitivity to touch. It has been found that a good material for manufacturing the surface 2 can be a rigid clot with a moderate and limited component of elasticity (neoprene knit-or Ponte Roma knit-type type with slightly variable composition margins close to 97% polyester and spandex). Generally, a smooth, sliding, durable, elastic material would be suitable. On the surface 2, raised lines 3 can be distinguished to represent different areas of the playing field. The raised lines 3 are preferably achieved by using embroidery thread, however, they could be made in other ways. The user can thus know the location of the play. The dotted line shows the path 5 of the movable element (not shown), according to a possible path of the inflatable ball during the actual play. A set of buttons 10 can be seen which serve as an interface for controlling the different implemented functions. In one embodiment, a first button emits a spoken phrase with the operating instructions, while the remaining buttons 10 serve to reproduce a play. In one embodiment, this surface 2 can be exchanged so as to thus allow different sports to be

represented with their own playing field.

An on button 14 and a connection panel 11 of the device are shown on one side. The panel 11 includes a connection for earphones 12 (for example, an audio jack) a connection (for example, a USB port) for an external storage memory 13, a connection for electrical power. In some embodiments, the device may have a battery; in other embodiments, it may require a connection to the power grid by means of the cable 4.

Figure 2 shows a view of an example of following the position of the ball with the touch of the hand of the user on the movable element 6 on the surface 2 with the raised lines 3 delimiting the areas of the playing field.

Figure 3 shows a cross-sectional perspective view of the detail of the movable element 6 in relation to the elastic surface 2. The movable element 6 is made up of a pedestal or base 8 and a tooth or projection 7 ending in a spherical shape so as to not damage the surface 2. Shafts 9 which serve to move the movable element 6 with the aid of motors (not shown) can also be seen.

Figure 4 shows a functional block diagram for an example of device 1 according to the invention. A processor 20 is seen which receives information about the position in a time interval of the ball on the playing field and the associated audio. This information can come from a platform 16 and/or from a 35 storage memory 17 including the previously obtained information. The processor 20 has an audio signal processing unit 19 and a position processing unit 18. Both units are coupled with a synchronisation unit 21. The processor 20 provides two sets of instructions in a coordinated manner. A first set of instructions refers to the reproduction of the sound associated with the movement of the movable element 6 over the course of a time interval. A second set of instructions refers to the processor 20 converting the information about the position of the ball on the actual playing field into position coordinates of the surface 2 which a movement unit 22 is in responsible for applying to the movable element 6 by means of the action of motors 23 which are incorporated with a two-shaft mechanism including high-strength aluminium rails. The movement unit 22 uses dual drive techniques to ensure perfect perpendicularity between shafts 9. It likewise uses bearings on rubber bands which provide smooth travel as well as a very low noise level. It reduces the need for maintenance while the service life and durability increase. Limit switches can be included both at the start point and at the end point of each shaft. It is thus guaranteed that the mechanics will never perform movements that are not allowed or are out of range.

A very important aspect is to ensure correct coordination of the audio and the precise movement of the movable element 6. For correct synchronisation of 20 movements and sound, the motors mechanically coupled to the movable element are coordinated with the audio of the play.

The movements of the ball can be edited either automatically or manually through a visual editing tool so as to obtain and store in a memory 17 the position of the ball (x, y) at various moments in time of the video sequence of the play together with other additional information (for example, identifier of the sporting event, teams, name of plays, date, etc.). The processor 20 can read this information when the memory 17 is connected to the connection 13. Controllers in the motors 23 prevent the motors from being pushed too far (trying to reach a point they cannot reach) if there is a position error. The 30 controllers detect this situation in advance and abort the movement by stopping the motors 23 immediately without causing faults or strange noises.

In a more complex embodiment, the processor 20 can have audiovisual signal processing means in order to obtain the mentioned information in real time, although the performance and capacity requirements for the processor 20 35 are much higher. With the supplied information, the processor 20 converts the coordinates of the actual field to the surface 2 and obtains the corresponding audio to synchronise it. The processor 20 thereby sends orders to the motor responsible for moving the movable element 6 and reproducing the corresponding audio through a speaker (internal or external), earphones or the like. For this purpose, it can have an audio output connection 12.

With respect to the loading of the plays, this can be done automatically by leaving it connected to a memory (for example a pen drive) with the plays at the start when starting up the device.

Another one of the improvements that can be implemented refers to the optimised configuration for achieving efficient energy consumption. For example, the current levels of the motors are adjusted to minimum levels in order to reduce losses due to heat of the motors 23 and, accordingly, the loss of energy, by reducing power consumption. It can be complemented with controlling the execution of the motors 23 so as to reduce noise and energy consumption of the motors while they are not moving. With specific controllers for the motors 23, the passage of current to the reels thereof is controlled such that they are only kept active right before it is necessary for them to move. Power consumption and the temperature inside the equipment are thereby reduced.

One improvement that can be implemented refers to the emulation of more realistic movements in the attempt to emulate vector movements, speed and acceleration of the ball. Aspects such as curves, acceleration and other pre-programmed gestures of the ball must therefore be considered so they can be executed when they are detected. For example, if in the data points supplied to the processor 20 are included under an identifier they can be associated with a type of specific path of the movable element 6. Linear interpolation algorithms can be used to create curves between the key points of the plays obtaining a more faithful reproduction of actual movements.

Reference numbers 1 Device 2 Surface 3 Raised lines 4 Power cable 35 5 Path 6 Movable element 7 Projection 8 Base 9 Shafts 10 Control buttons 11 Connection panel 12 Audio output connection 13 Connection for storage memory 14 On/Off button 15 Connection for power supply 16 Platform 17 External storage memory 18 Position processing unit 19 Audio signal processing unit 20 Processor 21 Synchronisation unit 22 Movement unit 23 Motors

Claims

CLAIMS1. A device for a person with a visual impairment to follow a sporting event, characterised in that it comprises: an elastic surface (2) representative of a playing field; a movable element (6) representative of the ball, wherein the movable element (6) is configured to deform a region of the surface (2) making it detectable to the touch; a movement unit (22) with motors (23) configured to move the movable element (6) along the elastic surface (2); a processor (20) configured to obtain information about a play, wherein said information comprises, for a given time interval, data referring to the position of a ball on the playing field and data referring to an audio signal associated with the play, wherein the processor (20) is configured to convert the information about the play into data referring to the movement of the movable element (6) in the elastic surface (2), and furthermore to coordinate said movement with the audio signal associated with the play in a synchronised manner.
2. The device for following a sporting event according to claim 1, wherein the processor (20) obtains the information about a play through a connection with an external platform (16).
3 The device for following a sporting event according to claim 1, wherein the processor (20) obtains the information about a play by pre-processing the audiovisual signal.
4. The device for following a sporting event according to any one of the preceding claims, further comprising an audio output connection to emit the 30 audio signal associated with the play.
5. The device for following a sporting event according to any one of the preceding claims, wherein the elastic surface (2) comprises raised lines (3) representative of a playing field.
6. The device for following a sporting event according to claim 5, wherein the elastic surface (2) can be disassembled so as to change to a different playing field.
7. The device for following a sporting event according to any one of the preceding claims, wherein the movement unit (22) is configured to generate a vibration signal depending on vibration activation data present in the information about a play.
8. The device for following a sporting event according to any one of the preceding claims, wherein the processor (20) is configured to generate an acoustic indication signal depending on acoustic indication activation data present in the information about a play.
9. The device for following a sporting event according to any one of the preceding claims, comprising a battery to provide electrical energy.
10. The device for following a sporting event according to any one of the preceding claims, wherein the movable element (6) comprises a base (8) and a projection (7) with a non-pointed shape attached to the base.