CN113301260A

CN113301260A - Eagle eye system for track and field competition

Info

Publication number: CN113301260A
Application number: CN202110723440.XA
Authority: CN
Inventors: 许大政; 李晓斌; 董晨; 张军辉
Original assignee: Tsing I Beijing Technology Co ltd
Current assignee: Tsing I Beijing Technology Co ltd
Priority date: 2021-06-29
Filing date: 2021-06-29
Publication date: 2021-08-24

Abstract

Embodiments of the present disclosure describe an eagle eye system for track and field competitions, comprising: a capture device in which a plurality of cameras are arranged on a track and field race in a preset layout; a storage device configured to store video data; a master control device; and a display device. The master control device includes: a command transmitting module configured to issue a trigger command; a configuration selection module including a plurality of preset configurations and configured to receive a trigger command from the trigger module and select a corresponding configuration from the plurality of preset configurations based on the received trigger command; a camera control module configured to adjust respective cameras of the plurality of cameras based on the selected respective configurations; and a data processing module configured to process the video data stored by the storage device. According to this eagle eye system of disclosing can be applicable to the track and field competition field, and quick, accurate and timely feedback match scene.

Description

Eagle eye system for track and field competition

Technical Field

The present embodiments relate generally to an eagle eye system, and more particularly to an eagle eye system for track and field competitions.

Background

The track and field competition field is large, and a plurality of events can be simultaneously played on the field. Each game item requires a live sanction, but there is often a dispute for the live sanction by the sanctioned. In the prior track and field competition, a manual arbitration technical video recording link is added, for example, track players step on a left boundary, relay area external transmission batons and the like leave traces, and a basis is provided for the judgment of the competition. However, in the manual arbitration video recording, the storage card of the video data needs to be sent to a fixed place for playing, and then whether the foul behavior exists can be judged, and the manual video recording counting is difficult to achieve the fast, accurate and timely field penalty so as to adapt to the match requirement. In addition, rather than playing a single game of volleyball, soccer, basketball, table tennis, and the like, there are multiple games that require the arbitration or eagle eye system to meet the needs of the various games.

Therefore, in the field of track and field competition, a need exists for a 'fast, accurate and timely' arbitration eagle eye system.

Disclosure of Invention

According to one aspect of the present disclosure, there is provided an eagle eye system for use in a track and field game, the track and field game including a plurality of game items, comprising: a collection device comprising a plurality of cameras arranged on a track and field race course according to a preset layout; a storage device including at least one storage server and configured to store video data captured by the camera; a master control device; and a display device configured to display the video data processed by the data processing module. The main control device comprises: a command transmitting module configured to issue a trigger command indicating that one of a plurality of game items is to be played on a track and field game field; a configuration selection module including a plurality of preset configurations, and configured to receive the trigger command from the trigger module and select a corresponding configuration from the plurality of preset configurations based on the received trigger command, the plurality of preset configurations corresponding to the plurality of game items one-to-one; a camera control module configured to adjust respective cameras of the plurality of cameras to match an upcoming game item and to perform data acquisition based on the selected respective configurations; and a data processing module configured to process the video data stored by the storage device.

In some embodiments of the present disclosure, the preset layout is designed according to the location of various game items on the track and field event, and the trigger command is issued manually by a user or automatically by a master device according to the event schedule.

In some embodiments of the present disclosure, each of the plurality of preset configurations includes a number of at least one of the plurality of cameras adapted to the configuration, and a pose, a focal length, and an exposure amount of each of the at least one camera.

In some embodiments of the disclosure, the data processing module comprises: a timestamp marking module configured to receive input from a user to mark a timestamp on a current frame of the video data, wherein the input is performed when the user observes an athlete infraction in a frame of the video played by a display; and a video capture module configured to store one frame of video data tagged with the timestamp and several frames before and after the frame of video data as a target video based on the tagged timestamp.

In some embodiments of the disclosure, the data processing module further comprises: a first tracking module configured to process video captured by a first particular camera to track a first target object, wherein the first target object is one or more athletes playing a game; and an electronic magnification module configured to electronically magnify the tracked first target object and transmit the electronically magnified image to a display, wherein the first specific camera acquires data at a fixed pose and focal length or acquires data at a variable pose and focal length.

In some embodiments of the present disclosure, the camera control module comprises: a synchronous trigger circuit configured to synchronously trigger at least two cameras of the plurality of cameras for synchronous acquisition; wherein the timestamp marking module is configured to receive input from a user to mark timestamps on video data captured by the at least two cameras.

In some embodiments of the present disclosure, the acquisition device further comprises: a switch configured to receive data collected by the plurality of cameras and transmit the data to a storage device; the switch receives data collected by a first part of cameras in the plurality of cameras in a wired mode and receives data collected by a second part of cameras in the plurality of cameras in a wireless mode.

In some embodiments of the disclosure, the data processing module further comprises: a second tracking module configured to process video captured by a second particular camera to track a second target object, the second target object being a game instrument on the playing field; and an electronic magnification module configured to electronically magnify the tracked second target object and transmit the electronically magnified image to the display, wherein the second specific camera acquires data at a fixed pose and focal length or acquires data at a variable pose and focal length.

In some embodiments of the present disclosure, the eagle eye system for track and field competition further comprises: and a converter configured to convert the HDMI image information from the storage device into SDI image information and transmit it to the master device.

The eagle eye system for the track and field competition can be suitable for various competitions on the track and field competition field, the eagle eye system can convert parameters of corresponding acquisition devices according to different competitions, so that the eagle eye system is suitable for different competitions, labor cost is saved, a plurality of workers are not required to shoot near each competition field respectively, cooperation of the acquisition devices, the storage device and the main control device of the eagle eye system is enabled, real-time and accurate competition feedback is achieved, and arbitration requirements are met.

It should be understood that the statements herein reciting aspects are not intended to limit the critical or essential features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.

Drawings

The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. In the drawings, like or similar reference characters designate like or similar elements.

Fig. 1 shows a schematic view of an eagle eye system for track and field competition according to one embodiment of the present disclosure.

Fig. 2 illustrates a view of a master device according to one embodiment of the present disclosure.

Fig. 3 shows a schematic block diagram of an example device used to implement embodiments of the present disclosure.

Detailed Description

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.

In describing embodiments of the present disclosure, the terms "include" and its derivatives should be interpreted as being inclusive, i.e., "including but not limited to. The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The terms "first," "second," and the like may refer to different or the same object. Other explicit and implicit definitions are also possible below.

In the description of embodiments of the present disclosure, references to "an embodiment" or "some embodiments" are intended to indicate that a particular configuration, structure, or characteristic described in connection with the embodiments is included in at least some embodiments. Thus, phrases such as "in an embodiment" or "in some embodiments" that may be present in one or more points of the present description do not necessarily refer to the same embodiments. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

The eagle eye system for track and field competition according to the present disclosure will be described in more detail below with reference to the accompanying drawings.

As shown in fig. 1, track fields typically include a plurality of zones, and some important zones are indicated by numbers in fig. 1, for example, zone 1 generally indicates the end points of long and short runs, and the vicinity of zone 1 may indicate the start points of games such as 400 meters, 800 meters, 4 meters by 100 meters, 4 meters by 400 meters, and 10000 meters. Area 2 generally represents the start of a 1500 meter game. The curves preceding region 1 and region 2 generally represent the first curve. Area 3 generally represents the start of a 200 and 5000 meter race and area 4 generally represents the start of a 100 and 110 meter race. The curve between region 3 and region 4 generally represents the second curve. The area enclosed by the first turn is the area 5 where the javelin game is played in the middle portion of the area 5 as shown in fig. 1, the shot and pitch (e.g., discus and hockey) game is generally played in the upper area of the area 5 as shown in fig. 1, the shot and jump game is generally played in the lower area of the area 5 as shown in fig. 1, and the area 7 is the landing area for the thrown discus, shot, hockey, and javelin. The area enclosed by the second curve is the area 6 where the javelin game is played in the middle of the area 6 as shown in fig. 1, the shot and pole jump game is generally played in the upper area of the area 6 as shown in fig. 1, the shot game is generally played in the lower area of the area 6 as shown in fig. 1 and also includes the run-up area for the pole jump, and the area 7 is the landing area for the thrown shot, javelin, etc. Zone 8 is the playing field for the third jump and the long jump, and zone 9 is the starting point for the 3000 m game.

As shown in fig. 1, some of the cameras are off-site cameras 101 arranged on the outside of the field, and some of the cameras are on-site cameras 102 arranged on the areas 5 and 6. As shown in fig. 1, there may be more cameras placed near areas 1 and 4. The plurality of cameras may be uniformly arranged for the first curve and the second curve. A plurality of cameras may be arranged uniformly for the areas 5 and 6. As shown in fig. 1, the off-site camera 101 on the outside of the field may be connected to the memory by wire. The on-site cameras 102 inside the venue may be wirelessly connected to the memory, but considering the difficulty of wirelessly connecting to transmit a larger video stream, it is contemplated to reduce the number of on-site cameras 102. In this case, in the case where it is necessary to photograph a match in the areas 5 and 6, the appropriate off-board cameras 101 may be varied in orientation and focal length so that these off-board cameras 101 can photograph the areas 5 and 6, thus reducing the number of on-board cameras 102 and thus reducing the amount of data transmitted wirelessly.

Those skilled in the art will appreciate that the camera positions and the number of cameras in each area as shown in fig. 1 are merely illustrative of camera layouts and numbers. The number of the off-site cameras 101 and the on-site cameras 102 may be increased or decreased and the layout of the cameras may be changed according to actual situations and needs. The layout and number of these cameras can be set in advance before the game is played.

As shown in fig. 1, the eagle eye system includes a master control device 107, and the master control device 107 may include a memory, so that the data collected by the

cameras

101 and 102 may be directly transmitted to the memory of the master control device 107. However, considering the huge amount of data and the need for the memory of the master control device 107 to handle other tasks, in the embodiment shown in fig. 1, it is preferable that the eagle eye system further comprises a storage device, which may comprise at least one memory 103, the off-board camera 101 is connected to the memory 103 by wire as shown in fig. 1, the off-board camera 101 transfers the collected data to the switch 105 through a network cable or the like, and then the switch 105 transfers the collected data to the memory 103. The on-site camera 102 is wirelessly connected to the memory 103 via the wireless base station 104, thereby transferring the acquired data to the memory 103. As shown in fig. 1, the solid lines represent wired connections and the dashed lines represent wireless connections.

The master device 107 may be directly connected to these memories 103. However, the HDMI information transmitted by the memory 103 is not well suited for long distance transmission, so as shown in fig. 1, the master device 107 may also be connected to the memory 103 through the converter 106. The converter 106 can convert the HDMI-format image information stored in the memory 103 into SDI-format image information, which is more convenient for remote transmission. Therefore, by adding the converter 106, the memory 103 can be arranged closer to the

cameras

101 and 102, thereby alleviating the problem of transmission blocking due to a long distance in the wireless transmission of video data and the wired transmission of video data. The SDI image information after converted by the converter 106 may be transmitted to the main control device 107 using a long network cable, and the main control device 107 may be disposed in a center room distant from the field of play.

The master control device 107 processes the data transmitted by the converter 106. Meanwhile, the master control device 107 may also issue a command to adjust the

cameras

101 and 102, the data amount of which is small, and the command may be transmitted to the wireless base station in a wireless manner, as shown in fig. 1, to be transmitted to the respective cameras. In the center control room, a plurality of indoor displays 108 may be further provided to display the video data processed through the main control device 107, and the number of the indoor displays 108 corresponds to the number of the plurality of cameras. In addition, the relevant referees, coaches and athletes can also watch the videos processed by the master control device 107 through the terminal devices 109 such as a notebook computer, a mobile phone and a PAD.

The master control device 107 will be described in detail below with reference to fig. 2. As shown in fig. 2, the master control device 107 includes a command transmission module 201, a configuration selection module 202, a camera control module 203, and a data processing module 204. Each module will be described in detail below.

The command transmission module 201 is configured to issue a trigger command. The trigger command indicates that one of a plurality of events is to be performed on the track and field game. The user may issue the trigger command through an input device, such as a keyboard or mouse. The trigger command may also be issued automatically by the master control device 107, for example, a list of times for the competition may be compiled before the competition starts, and after a certain time has elapsed, the master control device 107 issues a trigger command that the particular competition is to be played.

The configuration selection module 202 includes a plurality of preset configurations, each configuration corresponding to one of the games, which are preset before the start of the game, and when a game is played, the preset configuration matching the game is directly called. Each configuration includes parameters such as which cameras need to be turned on for the upcoming game, and the orientation of each of these turned on cameras, which may include pitch, yaw, and roll, the focal length of each camera, and the exposure. The configuration selection module 202 is configured to receive a trigger command from the trigger module and select a corresponding configuration from a plurality of preset configurations based on the received trigger command.

The camera control module 203 is configured to adjust the respective cameras, which refer to those cameras corresponding to the selected configuration, based on the selected configuration, including turning the cameras on or off, adjusting the orientation of the cameras, adjusting the focal length of the cameras, and adjusting the exposure of the cameras, among other parameters. To enable multiple cameras to acquire data simultaneously, the camera control module 203 further includes a synchronization trigger circuit 2031 configured to synchronously trigger multiple cameras so that they can acquire simultaneously, thereby enabling multiple cameras to acquire the same area simultaneously from multiple angles.

The data processing module 204 is configured to process video data stored by the storage device. The processing that the data processing module 204 can perform includes time stamping, capturing a video of interest, tracking a target object, and electronically magnifying the tracked target object.

To timestamp the video, the data processing module 204 includes a timestamp marking module 2041. When a user observes a possible foul of the athlete in a video played on a display, the input may be performed using a mouse, a voice recognition device, or the like, such that the timestamp marking module 2041 leaves a timestamp on the frame of the video that is currently being played indicating the foul. It has been described in the foregoing that multiple cameras can simultaneously capture data, and multiple timestamps can be calibrated on multiple displayed videos. The data processing module 204 further includes a video capture module 2042, and the video capture module 2042 can capture several frames before the frame and several frames after the frame with the time stamp based on the time stamp marked, and store the captured several frames as evidence short video. The referee can quickly locate the point of a foul by looking at these short videos or by looking at the timestamps that the videos are broadcast, without having to browse through all of the videos to determine the point of the foul.

To track a target object, the data processing module 204 may include a tracking module 2043 that may track a variety of different objects, such as athletes, game instruments, and the like. The tracking or detection can be realized based on a target detection deep neural network such as yolo. After the user selects the target object to be tracked, the tracking module 2043 may automatically track the target object in real time. In addition, the video intercepting module 2042 can intercept the tracked relevant frames of the target object to be saved as the evidence video. For example, the tracking module 2043 may track a person who is running a long distance race of 800 meters or more, which is tracking across cameras. The tracking module 2043 may also track a group that is running a sprint race that is 800 meters or less, which is also a cross-camera tracking. The tracking module 2043 may also track a group playing a 100 or 110 meter game, and the tracked video data may be video captured by a camera placed near the endpoint, so the tracking need not be cross-camera tracking. For example, when a javelin game is performed, a dispute usually exists about the landing point of a javelin, videos of the javelin game can be shot through a plurality of cameras, so that tracking of the javelin is also cross-camera tracking, the javelin is tracked in the whole process of the javelin game, the landing point of the javelin is accurately tracked, and frames near the landing point exist as arbitration evidence.

When a camera photographs a tracking object, the target object is generally small when the target object is far from the camera, and the target object is large when the target object is near the camera. In order to enable the tracked object to be displayed on the display in a suitable and substantially fixed size, the data processing module further comprises an electronic magnification module 2044 which is tracked to electronically magnify the tracked target object so that the tracked object is displayed on the display substantially in an equivalent size.

Fig. 3 illustrates a schematic block diagram of an example device 300 that may be used to implement embodiments of the present disclosure. The apparatus 300 may be used to implement the master control device 107 of fig. 1. As shown, device 300 includes a Central Processing Unit (CPU)301 that may perform various appropriate actions and processes in accordance with computer program instructions stored in a Read Only Memory (ROM)302 or loaded from a storage unit 308 into a Random Access Memory (RAM) 303. In the RAM 303, various programs and data required for the operation of the device 300 can also be stored. The CPU 301, ROM 302, and RAM 303 are connected to each other via a bus 304. An input/output (I/O) interface 305 is also connected to bus 304.

Various components in device 300 are connected to I/O interface 305, including: an input unit 306 such as a keyboard, a mouse, or the like; an output unit 307 such as various types of displays, speakers, and the like; a storage unit 308 such as a magnetic disk, optical disk, or the like; and a communication unit 309 such as a network card, modem, wireless communication transceiver, etc. The communication unit 309 allows the device 300 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.

The processing unit 301 executes the above-described processing modules, such as any one of the processing modules 201 to 204 and the

modules

2041 and 2044. For example, in some embodiments, any of the modules 201-204, and the modules 2041-2044 may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as the storage unit 308. In some embodiments, part or all of the computer program may be loaded and/or installed onto device 300 via ROM 302 and/or communication unit 309. When the computer program is loaded into the RAM 303 and executed by the CPU 301, one or more of any of the modules 201 to 204, and

modules

2041 and 2044 described above may be executed. Alternatively, in other embodiments, the CPU 301 may be configured to execute any of the modules 201-204, and the modules 2041-2044 by any other suitable means (e.g., by way of firmware).

The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: a Field Programmable Gate Array (FPGA), an Application Specific Integrated Circuit (ASIC), an Application Specific Standard Product (ASSP), a system on a chip (SOC), a load programmable logic device (CPLD), and the like.

Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

Further, while operations are depicted in a particular order, this should be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single implementation. Conversely, various features that are described in the context of a single implementation can also be implemented in multiple implementations separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

Claims

1. An eagle eye system for use in an athletic competition, the athletic competition including a plurality of play items, comprising:

a collection device comprising a plurality of cameras arranged on a track and field race course according to a preset layout;

a storage device including at least one storage server and configured to store video data captured by the camera; and

a master control device comprising:

a command transmission module configured to issue a trigger command indicating that one of a plurality of game items is to be played on a track and field game field;

a configuration selection module including a plurality of preset configurations, and configured to receive the trigger command from the trigger module and select a corresponding configuration from the plurality of preset configurations based on the received trigger command, the plurality of preset configurations corresponding to the plurality of game items one-to-one;

a camera control module configured to adjust respective cameras of the plurality of cameras to match an upcoming game item and to perform data acquisition based on the selected respective configurations; and

a data processing module configured to process video data stored by the storage device; and

a display device configured to display the video data processed by the data processing module.

2. The eagle eye system for track and field competitions of claim 1,

the preset layout is designed according to the positions of various game items on the track and field competition field, an

The trigger command is issued manually by the user or automatically by the master control device in accordance with the event schedule.

3. The eagle eye system for track and field competitions of claim 1 wherein each configuration of the plurality of preset configurations includes a number of at least one of the plurality of cameras that is adapted to that configuration, and a pose, focal length, and exposure of each of the at least one camera.

4. The eagle eye system for track and field competitions of claim 1 wherein said data processing module comprises:

a timestamp marking module configured to receive an input from a user to mark a timestamp on a current frame of video data, wherein the input is performed when the user observes an athlete infraction in a frame of video played by a display; and

and the video intercepting module is configured to store one frame of video data marked with the timestamp and a plurality of frames before and after the frame of video data as the target video based on the marked timestamp.

5. The eagle eye system for an athletic competition according to claim 1, wherein the data processing module further comprises:

a first tracking module configured to process video captured by a first particular camera to track a first target object, wherein the first target object is one or more athletes playing a game; and

an electronic magnification module configured to electronically magnify the tracked first target object and transmit the electronically magnified image to a display,

wherein the first particular camera acquires data at a fixed pose and focal length or acquires data at a variable pose and focal length.

6. The eagle eye system for an athletic competition according to claim 4, wherein the camera control module includes:

a synchronous trigger circuit configured to synchronously trigger at least two cameras of the plurality of cameras for synchronous acquisition;

wherein the timestamp marking module is configured to receive input from a user to mark timestamps on video data captured by the at least two cameras.

7. The eagle eye system for an athletic competition according to claim 1, wherein the collection device further comprises:

a switch configured to receive data collected by the plurality of cameras and transmit the data to a storage device;

the switch receives data collected by a first part of cameras in the plurality of cameras in a wired mode and receives data collected by a second part of cameras in the plurality of cameras in a wireless mode.

8. The eagle eye system for an athletic competition according to claim 1, wherein the data processing module further comprises:

a second tracking module configured to process video captured by a second particular camera to track a second target object, the second target object being a game instrument on the playing field; and

an electronic magnification module configured to electronically magnify the tracked second target object and transmit the electronically magnified image to a display,

wherein the second particular camera acquires data at a fixed pose and focal length or acquires data at a variable pose and focal length.

9. The eagle eye system for track and field competitions of claim 1, further comprising: a converter configured to convert the HDMI image information from the storage device into SDI image information and transmit it to the master device.