JP2020095699A - Visually impaired person-purpose information presentation system - Google Patents

Abstract

To provide a visually impaired person-purpose information presentation system that can make an information presentation so that a visually impaired person can enjoy sports competitions, having an excited feeling of presence.SOLUTION: According to a visually impaired person-purpose information presentation system 1, a video camera 2 is configured to take a soccer athletic field F, and a processing device 3 is configured to: acquire, by image recognition, a position or shape of a field outer edge being a stationary object, positions of all players of two teams being a playing athlete, and a position of a soccer ball being the stationary object; map the stationary object, playing athlete and dynamic object to an information presentation field having the athletic field F turned to a similar figure at an arbitrary rate to thereby generate an information presentation map; and reproduce the information presentation map on a pin display 4 allowing the visually impaired person to grasp information on a two-dimensional space by touching.SELECTED DRAWING: Figure 1

Description

The present invention relates to an information presentation system for visually impaired persons who presents spatial information that enables visually impaired persons to enjoy sports competitions and the like.

When a visually impaired person wants to watch a sports competition such as soccer or baseball, the visually impaired person (hereinafter referred to as a sighted person) cannot visually enjoy it on a visual monitor (such as a television) used for watching sports. Therefore, visually impaired people are obliged to watch sports such as listening to sports broadcasts of radio broadcasts and grasping the flow of the game from the live voice by utilizing the auditory function which is a residual function. However, since the live commentary by announcers and the like does not necessarily convey the progress of the sports competition, it may not be a satisfying game for the visually impaired.

In this way, when the appropriate information presentation is different from that of a normal person such as a visually impaired person or a hearing impaired person, a variety of presentation methods prepared in advance are selected according to the situation of the individual's physical ability, and An invention has been proposed that presents contents such as relays in an easy-to-understand manner (see, for example, Patent Document 1). In the invention described in Patent Document 1, a part of the original content such as a live commentary is replaced with an alternative presentation content such as a hitting sound that is audibly easy to understand to assist visually impaired people in watching sports or the like. It can be presented as enjoyable content.

JP, 2007-184740, A

However, the invention described in Patent Document 1 only adds auditory information that complements live voice of sports or the like, or partially replaces it with live voice. It is not presented to the visually impaired. For example, when watching soccer, you can feel the presence of the game by following the movements of the players and the soccer ball, but you can tell the trends of the main players and the movement paths of the soccer ball to the visually impaired by using only real-time audio information. It is difficult to convey.

Therefore, it is an object of the present invention to provide an information presentation system for visually impaired persons who can present information so that visually impaired persons can enjoy sports competitions with a sense of presence.

In order to solve the above-mentioned problems, the present invention provides an image capturing unit capable of acquiring spatial information of a sports competition performed as a player moves in a competition field that can be regarded as a plane, as an image including at least the competition field. Fixed object information acquisition means for extracting at least the position and shape of a fixed object necessary for the progress of the competition from the image acquired by the imaging means, and a competitor for acquiring the position information of the competitor competing in the competition field. Position information acquisition means and an information presentation field that is similar in shape to the competition field at an arbitrary ratio are set, and an information presentation map in which the fixed object and the athlete are mapped at corresponding positions of the information presentation field are generated. The information presentation map generation means and the information presentation map generated by the information presentation map generation means are reproduced by a spatial information presentation device that the visually impaired person can experience, and the visually impaired person positions the athlete in the competition field. The feature is that the information can be recognized by the spatial information presentation device.

In the above-mentioned configuration, the imaging means acquires images including a competition field as moving images at predetermined time intervals, and presents the movement information of the athlete accompanying the progress of the competition to the visually impaired by the spatial information presentation device. Characterize.

It is characterized in that a movement history recording means for recording the position information of the athlete in time series is provided every time the information presentation map is generated based on the moving image acquired by the imaging means.

In the above configuration, there is provided condition management support means for generating support information useful for condition management of the athlete based on the movement history information of the athlete recorded in the movement history recording means.

In the above configuration, the spatial information presentation device is a two-dimensional tactile element that can be converted into an off state in which the tactile pin does not project from the reference surface and an on state in which the tactile pin projects from the reference surface, at equal intervals. The feature is that the pin display arranged on the surface is used to inform the player's position by the tactile pin in the ON state.

In the above configuration, when there is a dynamic object that moves in the competition field during a sports competition, it is provided with dynamic object position information acquisition means for acquiring position information of the dynamic object, and the information presentation map generation means is The present invention is characterized in that an information presentation map that is mapped including a dynamic object is generated.

In the above-mentioned configuration, the imaging means acquires an image including a competition field as a moving image at a predetermined time interval, and the spatial information presentation device provides the visually impaired person with movement information of the athlete and the dynamic object as the competition progresses. It is characterized by presenting.

In the above configuration, a movement history recording means for recording position information of the athlete and the dynamic object in time series is provided every time an information presentation map is generated based on the moving image acquired by the imaging means. To do.

In the above configuration, the apparatus further comprises condition management support means for generating support information useful for condition management of the athlete based on the movement history information of the athlete or the dynamic object recorded in the movement history recording means. To do.

In the above configuration, the spatial information presentation device is a two-dimensional tactile element that can be converted into an off state in which the tactile pin does not project from the reference surface and an on state in which the tactile pin projects from the reference surface, at equal intervals. The feature is that the pin display arranged on the surface is used to notify the position of the player and the position of the dynamic object by the tactile pin in the ON state.

In the above configuration, when there are a plurality of athletes in the competition field during a sports competition, the vibration states of the tactile pins are made different so that each athlete can be identified.

In the above configuration, when there are a plurality of teams of a plurality of athletes in the competition field during a sports competition, the vibration states of the tactile pins are made different so that each team can be identified.

ADVANTAGE OF THE INVENTION According to this invention, the sport information competition which a player moves in a competition field which can be considered to be a plane is simplified by the information presentation map which mapped the athlete in the information presentation field, and a spatial information presentation device is provided. Through the information presentation map, the visually impaired person can experience it. As a result, the visually impaired person can know the position and movement of the athlete in the competition field as spatial information, and can enjoy the sports competition with a sense of realism.

It is a schematic structure figure showing an embodiment of an information presentation system for visually impaired persons. (A) is explanatory drawing about an example of camera arrangement|positioning which images the competition field F. FIG. (B) is an external view of the captured image P including the target competition field F. (A) is an image figure which extracts only the part of the competition field F from the picked-up image P. (B) is an image diagram in which the competition field Pf extracted from the photographed image P is corrected to a distortion-free competition field shape to be an information presentation field. (C) maps the players of the first and second teams who are competitors, such as the field outer edge and the center line, which are fixed objects, and the soccer ball, which is a dynamic object, to the appropriate positions of the information presentation field. It is an image figure of an information presentation map. It is a structure explanatory view of a pin display. It is a display method explanatory view of a pin display.

Next, an embodiment of an information presentation system for the visually impaired according to the present invention will be described with reference to the accompanying drawings. Although the information presentation system for visually impaired persons of the present embodiment presents information suitable for visually impaired persons to enjoy sports competitions, the subject is not limited to information presentation of sports competitions. The information presenting system of this configuration can be applied to any field in which it is desired to present the position, movement path, etc. of a person or an object in a space that can be regarded as a plane as spatial information. It is also possible to use it as an information presentation system for simplifying spatial information and communicating it to a sighted person in an easy-to-understand manner.

FIG. 1 shows an embodiment of an information presentation system 1 for the visually impaired. For example, a video camera 2 that captures an image of the competition field F, a processing device 3 that processes the image to generate simplified spatial information, and the spatial information generated by the processing device 3 is visually sensed as a tactile sensation of a finger. And a pin display 4 for the disabled to experience. The position of the athlete in the competition field F can be specified by the processing device 3 having image recognition technology, but the athlete position information acquisition means 5 (detailed later) that does not require image processing technology is separately provided. May be. In addition, the information processed by the processing device 3 can be output to and displayed on a visual display device 6 (a display such as a television or the screen of a smartphone) for the sighted person.

The video camera 2 is an imaging unit that can acquire spatial information of a sports competition that is performed with a player's movement in the competition field F that can be regarded as a plane, as an image including at least the competition field F. It should be noted that if an image including the competition field F is acquired as a moving image at a predetermined time interval (for example, 30 fps or more), the moving image can be acquired with the same level of smoothness as that of a television broadcast, but it is possible to present information for the visually impaired Therefore, practically, about 1 fps is considered to be sufficient. For example, the image acquisition of the video camera 2 is performed at a standard 30 fps or 60 fps, and the processing device 3 records the moving image as a competition moving image and generates an information presentation map every 30 frames or 60 frames. You can

Here, an example of a case where a soccer court (short side×long side: 45 to 90 m×90 to 120 m) is set as the competition field F and the video camera 2 captures an image is shown in FIG. Soccer is a game in which a player and a ball move on a rectangular court that can be regarded as a plane. Therefore, if the two-dimensional spatial information that simplifies the position of the player and the ball on the court is used, It is possible to grasp the progress of the game. For that purpose, it is necessary to acquire a soccer court as a two-dimensional surface without distortion and accurately reproduce the positions of the player and the ball on the court. In a stadium with a canopy like a dome stadium, you may be able to shoot a soccer court from directly above, but in a normal stadium, you need to use large-scale equipment to shoot a soccer court from directly above. It is necessary and not realistic at all.

Therefore, in the present embodiment, the camera support 7 is erected at a position about 15 m away from the center of one short side, and the video camera 2 is set on the top of the camera support 7 (height of about 7 m). did. The installation position of the video camera 2 is an example. The detailed installation position of the video camera 2 is not particularly limited as long as the image P (see FIG. 2B) including the entire range of the competition field F can be captured. When taking a moving image with the video camera 2, it is desirable that the shooting position of the video camera 2 is stably fixed and does not easily move under the influence of wind or the like. Therefore, the structure of the camera support 7 is a simple pole. A tripod structure that is resistant to lateral external force and twist is preferable to the structure.

The image P captured by the video camera 2 is supplied to the image processing unit 31 of the processing device 3, and the simplified two-dimensional information of the stadium F is acquired by using a known image recognition technique or the like. First, as shown in FIG. 3A, only the portion corresponding to the competition field F is extracted from the image P as a competition field image Pf. In order to extract this competition field image Pf, the image processing unit 31 uses four lines that are the outer edges of the soccer court (the left and right side lines, the front goal line connecting both ends of the side line, and the back goal line). Specify. Note that the image P captured by the video camera 2 is likely to include distortion and the like due to the lens. Therefore, before performing the extraction processing of the competition field image Pf, the image P is subjected to distortion correction and the like. It is desirable to keep it.

In the trapezoidal image range extracted as the competition field image Pf (see FIG. 3B), fixed objects (soccer court outer edge line, center line, center mark, etc.), athletes (players of both teams) ), the information of the dynamic object (soccer ball) is included. Therefore, the image processing unit 31 is provided with a fixed object information acquisition unit 31a, a player position information acquisition unit 31b, and a dynamic object position information acquisition unit 31d. These information groups (fixed object information, athlete position information, dynamic object position information) are supplied to the information presentation map generation means 32.

The information display map generation means 32 generates the information display map 8 (see FIG. 3C) in which various information in the competition field F is simplified, and the pin display control means 33 controls the pin display. 4, the information presentation map is reproduced by the unevenness of the pin. As a result, the visually impaired person can grasp the two-dimensional spatial information such as the positions of the player and the ball in the competition field F in a short time by touching the information presentation map of the pin display 4. Also, if the information presentation map on the pin display 4 is updated in a short time of about 1 second, the visually impaired person can grasp the movement status of the player and the ball only by the tactile information of the fingers, and can play soccer with a realistic feeling. It becomes possible to watch.

The information group (fixed object information, athlete position information, dynamic object position information) acquired by the image processing unit 31 can also be supplied to the competition database 34 and stored as a competition history. For example, the movement history of each player during a match or the movement history of a dynamic object is recorded in the movement history recording means 34a, and fixed object information or the like in the competition field F in which the competition is held is stored in the competition field information storage means 34b. Record. Then, if the movement history recorded in the movement history recording means 34a and the competition field information recorded in the competition field information storage means 34b are linked and supplied to the information presentation map generation means 32, the information presentation map is reproduced in time series. can do. That is, according to the information presentation system 1 for visually impaired persons of the present embodiment, the past competition content can be reproduced on the pin display 4 like a video image.

Here, an example of image processing by the image processing unit 31 will be described. First, the fixed object information acquisition means 31a has a function of extracting the position and shape of the fixed object necessary for the progress of the competition. The competition field image Pf cut out from the image P can be analyzed by the perspective drawing method with the vanishing point determined by the position and orientation of the video camera 2 as a reference. Therefore, if the competition field image Pf is deformed and matched with the virtual field frame Fr having the same aspect ratio as the soccer court, the position and shape of the side line, the center line, etc. drawn on the field surface can be changed. A reproduced field image is reproduced.

In the case of a soccer court, as shown in FIG. 3C, an outer edge line L1 surrounded by a pair of side lines and a pair of goal lines, a center line L2 that bisects the court at the center, a center circle L3, and a goal area. The position and shape of the division line L4 can be extracted. In an actual soccer court, since more lines and marks are drawn on the court, it is possible to extract all of them as fixed objects. However, if all the fixed objects that can be extracted are included in the information presentation map 8, it is feared that the information becomes excessive and the visually impaired person cannot grasp the information. Therefore, the fixed objects should be appropriately narrowed down and used. desirable.

However, in order to recognize the entire area of the soccer court, the outer edge line L1 is an essential fixed object. For example, if the display area of the pin display 4 is approximately the same as the aspect ratio of the soccer court, the outer edge of the display area of the pin display 4 can be set to the outer edge line L1, and therefore the outer edge line L1 is represented by the unevenness of the pin. It has the advantage of not being necessary. Since the goal G, which is an important fixed object in soccer, is placed outside the soccer court, when the goal G is included in the information presentation map 8 as one of the fixed objects, the soccer displayed on the pin display 4 is displayed. The work coat becomes smaller. If the display area of the pin display 4 is sufficiently large, that is all right, but if you want to display the entire soccer court in the display area of the pin display 4, only the two points indicating the opening position of the goal G should be represented by pins. May be.

The competitor position information acquisition means 31b has a function of acquiring position information of the competitors competing in the competition field F. When recognizing a player from the image P, an image P having a resolution sufficient to extract the players in the back of the soccer court is required, but the image P is acquired by a high resolution video camera such as 4K or 8K. By performing pre-processing such as noise removal, players can be extracted with high accuracy. Further, when soccer is set as a sports competition for providing information, it is necessary to identify not only the position of each player on the competition field but also the team to which each player belongs. If a uniform that can be identified for each team is worn, the team to which the player belongs can be identified by image recognition. If the uniforms and colors of the uniforms worn by both teams are similar and erroneous recognition is likely to occur, the recognition rate can be increased by using identification markings such as a band and armband.

When position information of a player in the competition field F is acquired from the image P, if the player first cuts out the competition field image Pf, a part of the player may be cut off from the image and may not be recognized as a competitor. is there. Therefore, the image recognition of the athlete is performed on the image P, the point on the field where each athlete stands is pointed as the athlete's position, and the virtual field frame Fr is cut out to the competition field image Pf. To match. Thus, the position information of each player can be specified as a point on the information presentation map 8. For example, as shown in FIG. 3C, the positions of the players T1a to T1f belonging to the first team and the players T2a to T2f belonging to the second team in the soccer court can be specified and mapped to appropriate places in the field. Of.

In addition, when identifying the position of the athlete from the image P acquired by the video camera 2, there is a possibility that the player on the back side may be hidden by the player in front and cannot be recognized, and the player may fall or crouch down. There is also concern that it may be difficult for the athlete to recognize. Therefore, the athlete position information acquisition unit 31b caches past athlete position information such as the previous time or the last time before, and predicts the movement direction and speed from the past athlete position information to predict the action, and the temporary competition. The person's position may be pointed. Further, in order to identify each player on the competition field by image recognition of the race number and the uniform number, it is necessary to obtain the image P capable of identifying the race numbers of all the athletes every time. However, it is practically impossible to acquire the image P that can identify all the players as individual players each time. Therefore, an individual player is identified by image-recognizing the number of each player on the field before the start of the match, and during the match, the position of each player and the individual player in the next image P based on the behavior prediction of each player. You may make it match with and specify a competitor's position information.

Alternatively, all the competitors may have GPS position sensors 51, and the competitor position information acquisition means 5 may be used in which the position information from each position sensor 51 is received by the sensor receiver 52 (broken line in FIG. 1). ). For example, by instructing the sensor receiver 52 to acquire the athlete position information at the timing when the video camera 2 acquires the image for information presentation map generation, the athlete position information at that time is used as the information presentation map generation means 32. It is supplied to the competition database 34. As described above, if all the players have the position sensor 51, the position information of each player can be surely grasped during the competition, and the ID of each position sensor 51 and the individual player can be linked in advance. By setting, you can accurately record who, when, and where each team was. Since the position information obtained by the position sensor 51 is in the geographic coordinate system (latitude/longitude), the geographic coordinate system of the reference position of the competition field F (for example, the center mark at the center of the court, the corner areas at the four corners, etc.) in advance. Must be stored in the processing device 3 as known information.

When the above-mentioned athlete position information acquisition means 5 is used, a considerable number of expensive position sensors 51 must be prepared, which may cause a considerable cost increase. If the means 31b is used, there is an advantage that the cost can be suppressed. Further, when the player position information acquisition means 5 is used, the position sensor 51 may be damaged during the match and the player may disappear from the data record. Therefore, if the player information acquisition means 31b for identifying the position of the player from the image P acquired by the video camera 2 is also provided, it is possible to cope with the loss of player data and to improve the reliability of the entire system. Can be increased.

The dynamic object position information acquisition unit 31c has a function of acquiring position information of a dynamic object when there is a dynamic object that moves in a competition field during a sports competition. When soccer is set as a sports competition for information provision, the only dynamic object that moves in the competition field is a soccer ball. When the position information of the soccer ball is acquired, image recognition processing is performed on the image P, a point on the field where the spherical soccer ball is located is pointed as the position of the dynamic object, and it is cut out to the competition field image Pf and virtual To match the typical field frame Fr. Thus, the position information of the soccer ball B can be specified as a point on the information presentation map 8 and can be mapped to a proper place in the field.

Since the soccer ball is smaller than the player, it is desirable to acquire an image P with sufficient resolution to identify the position of the soccer ball by image recognition. Also, if the soccer ball is not seen in the image P behind the player, or if it is not seen as a ball, it may be kicked up and in the air. It is difficult to continue image recognition. Therefore, the dynamic object position information acquisition means 31c may cache past ball position information such as the last time or the last time before, and point the temporary ball position from the past ball position information. Further, since the movement of the soccer ball is closely related to the movement of the player, the cache of the player position information may be used to predict the ball position information in consideration of the action of the player. For example, if there is no player around the soccer ball from the past player position information, it can be predicted that the soccer ball is moving in the previous moving direction and speed. On the other hand, if the soccer ball was recognized near the player last time, but only this player can be confirmed this time, it is highly possible that the soccer ball is under the control of the corresponding player. The provisional ball position may be set on the back side of the corresponding player without predicting the movement of the ball in the moving direction and speed.

Further, the position information of the soccer ball may be acquired by a method other than image recognition. For example, a beacon oscillator is built into a soccer ball, beacons from the soccer ball are received by three or more beacon receivers, and the beacon transmission source is geometrically determined from the delay amount of the reception time of each receiver. , Specify the position of the soccer ball. The use of this soccer ball position detection method has the advantage that the soccer ball will not be undetectable and that the plane coordinates on the playing field can be accurately specified even when the soccer ball is kicked up and in the air. ..

As described above, the information presentation map generation unit 32 that receives the information group acquired by the image processing unit 31 sets the information presentation field that is similar to the competition field at an arbitrary ratio. Fixed objects (outer edge line L1), athletes (first team players T1a to T1f and second team players T2a to T2f), and dynamic objects (soccer ball B) are mapped to corresponding positions in this information presentation field. The information presentation map 8 as shown in FIG. 3C is generated. Upon receiving the information presentation map 8 from the information presentation map generation means 34, the pin display control means 33 specifies a pin position for reproducing the information presentation map 8 and outputs a control signal to the pin display 4.

The pin display 4 is one of the space presentation devices that presents spatial information to visually impaired persons by the sense of touch of fingers. The pin display 4 has a display area 42 formed on one surface (an upper surface in FIG. 4) of an arbitrary housing 41. The display area 42 is a touch that can be converted into an off state in which the tactile pins 422 do not project from the reference surface 421a that is outside the substantially flat tactile panel 421, and an on state in which the tactile pins project from the reference surface 421a. This is a structure in which the intelligences 423 are arranged on a two-dimensional surface at equal intervals. The pin insertion holes 421b provided in the tactile panel 421 have a point-to-point pitch of about 2 mm, which corresponds to the resolution of the skin sensation.

In the pin display 4, there are various methods for driving the tactile pin 422. For example, the tactile pin 422 is projected from the reference surface 421a or is flush with the reference surface 421a by using the characteristic of the piezo element that is extended by controlling energization. Can be pulled back to. Since the piezo element has a good elongation reactivity, for example, the on/off change of the tactile pin 422 can be realized at 50 Hz. Therefore, if the information presentation map 8 is generated in real time based on the moving image acquired by the video camera 2 at 30 fps, the pin display 4 can present spatial information in real time. However, even if the display update of the pin display 4 is performed at 30 fps, it is difficult to recognize all the changes by searching for the change with fingers. Therefore, in reality, the information update of about 1 fps to 2 fps is sufficient. Conceivable.

Also, by changing the ON/OFF change cycle of the tactile pin 422, it is possible to cause the tactile pin 422 to vibrate at different frequencies. That is, when the ON/OFF cycle of the tactile pin 422 is shorter than the update cycle of the information presentation map 8, it can be used as one of the information that can be identified without the information presentation map 8. Therefore, if the vibration frequencies of the athlete and the dynamic object mapped on the information presentation map 8 generated by the information presentation map generation means 32 are changed, the visually impaired person can distinguish them from the vibration state of the tactile pin 422. Is possible. In addition, the players of the first team are the first group, the players of the second team are the second group, and the vibration frequencies of the first group and the second group are changed so that the visually impaired can identify the two teams. It becomes possible. For example, if the information presentation map 8 is reproduced on the pin display 4 with the ball B set to 0 Hz, the first team players T1a to T1f set to 5 Hz, and the second team players T2a to T2f set to 10 Hz, the visually impaired person can feel the tactile sensation of the fingers. It is possible to understand the movement status of the players and the ball for each team based on only the information, and it becomes possible to watch soccer with a sense of realism.

Since the pin display 4 is provided with the operation unit 43 that can be operated by the user, the operation of the operation unit 43 may be used to make a request for enlargement/reduction of the display content. For example, if it is possible to detect whether or not the tactile pin 422 has been intentionally pressed by a pressure sensitive sensor or the like, the user can press an arbitrary position in the display area 42 of the pin display 4 to press the pressed position. Can be recognized as the user's selection point. Therefore, when the user selects any point in the display area 42 to select a point and operates the enlargement button or the reduction button from the operation unit 43, an operation request for enlarging/reducing the selected point may be issued to the processing device 3. It will be possible. The operation request from the pin display 4 is input to the pin display control means 33, and a control signal converted into a pin array for enlarging/reducing the selection point portion of the information presentation map 8 is output to the pin display 4. As a result, the display area 42 of the pin display 4 is updated with information according to the user's request. When enlarging/reducing the information presentation map 8, the pin display control unit 33 requests the information presentation map generation unit 32 to create an information presentation map corresponding to the resolution, and an object having a size corresponding to the resolution is requested. The information presentation map may be regenerated by the competitor.

Furthermore, when the tactile pins 422 of the pin display 4 are turned on/off, a plurality of tactile pins 422 can be simultaneously activated to represent a ball or a pin. For example, as shown in FIG. 5, the ball position is represented by a cross shape, and further, the player is made to have a characteristic by simultaneously raising one or a plurality of tactile pins 422. It is also possible to prompt recognition of the type indicated by the pin.

There is also a method of displaying a rectangle for confirming the positional relationship of the tactile pins 422 representing the player by connecting the tactile pins 422 representing the player together. It is difficult for visually impaired people who use Braille to recognize the position by touching scattered tactile pins 422 such as players and balls. By displaying the rectangle, even if the finger display roughly scans the pin display, the finger comes into contact with the line, and if the line is traced, it is possible to reach the player position as the rectangular vertex. In addition, the rectangular shape represents a soccer formation, which is a presentation method for visually impaired spectators to know the formation. In addition, it can be used as a tool for visually impaired soccer players to confirm the formation.

As a method of creating the above-mentioned rectangle, as shown in FIG. 5, a tactile pin 422 representing a player is surrounded by a circumscribing circle, and when the circumscribing circle is reduced, a portion in contact with the tactile pin 422 is set as an apex. It may be created by forming a polygon.

Further, if the pin display 4 allows the user to select points, it is also possible to give voice information about the fixed object, the player, and the dynamic object in the information presentation map 8 being displayed. For example, when the user selects and designates a fixed object, an athlete, or a dynamic object in the information presentation map 8 and operates the voice request button, the name associated with the selected object or the name of the selected player. And so on can be read out in a synthetic voice. In this way, the information which cannot be understood only by the spatial information presented on the pin display 4 can be known by the user's own operation, which is highly convenient.

As described above, according to the information presentation system for the visually impaired, the spatial information of the sports competition which is performed in the competition field that can be regarded as a plane can be simplified and presented as the spatial information that the visually impaired can experience. Therefore, it becomes possible to enjoy sports competition with a sense of realism.

In the information presentation system 1 for visually impaired persons of the present embodiment, soccer is applied as a sports game for presenting spatial information, but of course ball games such as baseball, rugby, ice hockey, water polo, and badminton, as well as athletics and swimming ( It can be applied to watching sports in general, in which a player moves on a competition field that can be regarded as a plane, such as a sports competition without dynamic objects). Furthermore, the information presentation system 1 for visually impaired persons can be applied to watch sports such as horse racing, bicycle racing, boat racing, and auto racing.

Further, in the information presentation system 1 for visually impaired persons of the present embodiment, the pin display 4 is used as a space presentation device for visually impaired persons, but any device that allows visually impaired persons to experience spatial information may be used. For example, it can be replaced. For example, the information presentation map may be reproduced by a tactile display that gives a tactile sensation by the protruding pressure of air instead of the pin. Alternatively, the information presentation map can be reproduced by a VR device that gives a feeling of touching a virtual object in the virtual space when it is attached to the body.

Furthermore, the information presentation system 1 for visually impaired persons of the present embodiment not only presents spatial information of sports and various competitions to visually impaired persons, but also utilizes various information acquired for presenting spatial information. Thus, it is possible to provide useful information not only to visually impaired persons but also to sighted persons. For example, since the movement history recording means 34a of the competition database 34 records the movement history of each athlete, it can be used for condition management of the athlete by appropriately processing this information. To this end, the processing device 3 according to the present embodiment is provided with condition management support means 35 (shown by a broken line in FIG. 1) capable of receiving history information from the competition database 34 and processing the history information.

From the history information recorded in the movement history recording means 34a (information on a certain player in a certain match), the moving distance for one second can be known from the position at a certain time point and the position one second before. If this moving distance is divided by the time (1 second), the moving speed [m/s] at that time can be obtained. If this moving speed is high, the player has moved fast. That is, if the moving speed is a high value, it can be interpreted as a dash, and if it is a small value, it can be interpreted as a jog. By counting the number of times a competitor moves at a high speed, the number of dashes made during one match can be known. Furthermore, the dash time during one match can be found by summing the durations of the athletes' high moving speeds. Therefore, the condition management support means 35 obtains the dash count and dash time and presents them to the sighted person on the visual display device 6. Athletes with a large number of dashes and long dash durations may be more tired than those without them. Fatigue can lead to injury, so for athletes with a significant number of sprints and a long dash duration, take appropriate action (condition management) such as "rest the next match" or "hear your condition". , Can be performed based on history information. The dash count and dash time obtained by the condition management support means 35 may be output to the pin display 4 via the pin display control means 33. This is because condition management is effective even for athletes with visual impairment.

Further, from the history information recorded in the movement history recording means 34a (information of a certain athlete in a certain match), the sum of the player trajectories in which all the movement positions are made continuous is the total movement distance in one match. I can make sense. Athletes with a large total distance of travel may be more tired than those without. Therefore, the condition management support means 35 obtains the total moving distance during one match and presents it to the sighted person on the visual display device 6. Fatigue can lead to injury, so for those athletes whose total distance traveled is significantly long, take action measures (condition management), such as "resting the next match" and "hearing your physical condition," based on historical information. Can be done by The total movement distance obtained by the condition management support means 35 may be output to the pin display 4 via the pin display control means 33. This is because condition management is effective even for athletes with visual impairment.

Further, the information presentation system 1 for visually impaired persons according to the present embodiment can be used as a play feedback tool or a self-learning tool for athletes with visual impairment. Ordinary athletes (sighted eyes) can learn and play by watching videos of their own play and reference play, whereas visually impaired athletes can learn by watching videos. I can't. Therefore, I can not know whether my play is good or bad, I can not fix even if there is a problem because I can not confirm the success or failure of the shoot, I can not learn by watching the model play, I am efficient mastery I had the problem of not having the opportunity to do it. However, since the information presentation system for visually impaired persons 1 according to the present embodiment records the history information of the game in the competition database 34, an information presentation map can be generated based on the history information and reproduced on the pin display 4. .. That is, even a visually impaired athlete can grasp the spatial information of his or her own play or reference play, so the information presentation system 1 for visually impaired persons uses the play feedback tool for self-learning for the visually impaired athlete. It becomes a tool.

The information presentation system for the visually impaired according to the present invention has been described above based on the embodiment, but the present invention is not limited to this embodiment, and unless the configuration described in the claims is changed. It covers all feasible information presentation systems for the visually impaired as a scope of rights.

1 Information provision system for persons with disabilities 2 Video camera 3 Processing device 31 Image processing unit 31a Fixed object information acquisition means 31b Athlete position information acquisition means 31c Dynamic object position information acquisition means 32 Information presentation map generation means 33 Pin display control means 4 Pin display F competition field

Claims (12)

An imaging means capable of acquiring spatial information of a sports competition that is performed with the movement of a competitor in a competition field that can be regarded as a plane, as an image including at least the competition field,
Fixed object information acquisition means for extracting at least the position and shape of the fixed object necessary for the progress of the competition from the image acquired by the imaging means;
Athlete position information acquisition means for acquiring position information of an athlete competing in the competition field,
An information presentation map generation means for setting an information presentation field having a similar shape to the competition field at an arbitrary ratio, and generating an information presentation map in which the fixed object and the athlete are mapped at corresponding positions of the information presentation field, ,
The information presentation map generated by the information presentation map generation means is reproduced by a spatial information presentation device that can be visually sensed by the visually impaired person, and the visually impaired person uses the spatial information presentation device to position information of the athlete in the competition field. An information presentation system for the visually impaired, which is characterized by making it possible to recognize it. The imaging means acquires an image including a competition field as a moving image at a predetermined time interval,
The information presentation system for the visually impaired according to claim 1, wherein the spatial information presentation device presents the movement information of the athlete with the progress of the competition to the visually impaired. The visual history according to claim 2, further comprising a movement history recording means for recording the position information of the athlete in time series every time the information presentation map is generated based on the moving image acquired by the imaging means. Information presentation system for people with disabilities. The condition management support means for generating support information useful for condition management of the athlete based on the movement history information of the athlete recorded in the movement history recording means is provided. Information presentation system for people with disabilities. The spatial information presentation device, tactile elements that can be converted into an off state in which the tactile pins do not project from the reference surface and an on state in which the tactile pins project from the reference surface are arranged in a two-dimensional surface at equal intervals. Using the pin display,
The information presentation system for a visually impaired person according to any one of claims 1 to 4, wherein the position of the athlete is notified by a tactile pin in an ON state. When there is a dynamic object that moves in the competition field during a sports competition, a dynamic object position information acquisition means for acquiring the position information of the dynamic object is provided,
The information presentation system for a visually impaired person according to claim 1, wherein the information presentation map generation means generates an information presentation map that is mapped by including a dynamic object. The imaging means acquires an image including a competition field as a moving image at a predetermined time interval,
7. The system for presenting information for visually impaired persons according to claim 6, wherein the spatial information presenting device presents the movement information of the athlete and the dynamic object with the progress of the competition to the visually impaired persons. 8. A movement history recording means for recording position information of a competitor and a dynamic object in time series every time an information presentation map is generated based on a moving image acquired by the image pickup means. Information presentation system for the visually impaired as described in. The condition management support means for generating support information useful for condition management of the athlete based on the movement history information of the athlete or the dynamic object recorded in the movement history recording means. Information presentation system for the visually impaired as described in. The spatial information presentation device, tactile elements that can be converted into an off state in which the tactile pins do not project from the reference surface and an on state in which the tactile pins project from the reference surface are arranged in a two-dimensional surface at equal intervals. Using the pin display,
The information presentation system for the visually impaired according to any one of claims 6 to 9, wherein the position of the athlete and the position of the dynamic object are notified by a tactile pin in an ON state. 11. When there are a plurality of athletes in the competition field during a sports competition, the vibration states of the tactile pins are made different so that each athlete can be identified. Information provision system for the visually impaired. 6. When there are a plurality of teams of a plurality of athletes in a competition field during a sports competition, the tactile pins have different vibration states so that each team can be identified. 10. The information providing system for the visually impaired according to 10.