JP6965975B2 - Video processing equipment, multi-camera system, video processing method, and video processing program - Google Patents

Description

The present invention relates to a video processing apparatus, a multi-camera system, a video processing method, and a video processing program.

A multi-camera system is known in which an object is photographed by a plurality of cameras and a plurality of images are displayed on a display unit (see, for example, Patent Document 1). Such a multi-camera system may also be used to film a game of competition in which a player moves freely on the field or court, such as soccer, American football, basketball, handball, and the like.

JP-A-2002-171499

In the above-mentioned multi-camera system, it is required to shorten the time for selecting a predetermined image from a plurality of images displayed on the display unit.

The present invention has been made in view of the above, and provides a video processing device, a video processing method, and a video processing program capable of shortening the time for selecting a predetermined video from a plurality of videos displayed on a display unit. The purpose is.

The video processing device according to the present invention has a video display control unit that displays images of a game field taken by a plurality of cameras side by side on a display unit, and a predetermined portion of the plurality of images displayed on the display unit. When a setting area is set, a setting area information acquisition unit that acquires setting area information indicating the range of the setting area, and when a plurality of players enter the setting area in the video, the plurality of players who have entered the setting area. The approach information acquisition unit that acquires the approach information including the approach time and the approach position for each player who entered the set area, and the exit time when the plurality of players exited from the set area. An exit information acquisition unit that acquires exit information including an exit position for each player who has exited from the set area, and a virtual straight line that passes through the set area based on at least one of the entry information and the exit information. Based on the virtual straight line setting unit set for each player who has entered the setting area, the position of the virtual straight line, and the positions of the plurality of cameras, each of the virtual straight lines is displayed from the plurality of images displayed on the display unit. It includes a video selection unit that selects one or more of the videos.

The multi-camera system according to the present invention includes a plurality of cameras that shoot the game field from different angles, a display unit that can display images taken by the plurality of cameras, and the above-mentioned image processing device that processes the images. To be equipped with.

In the image processing method according to the present invention, images of a game field taken by a plurality of cameras are displayed side by side on a display unit, and a predetermined setting area is provided in a part of the plurality of images displayed on the display unit. When set, the setting area information indicating the range of the setting area is acquired, and when a plurality of athletes enter the setting area in the video, the approach time and the approach position of the plurality of athletes who have entered are determined. The entry information including the entry information is acquired for each player who has entered the set area, and when the plurality of players leave the set area, the exit information including the exit time and the exit position of the plurality of players is set. Acquiring for each player who has left the area, and setting a virtual straight line passing through the set area for each player who has entered the set area based on at least one of the entry information and the exit information. This includes selecting one or more of the images for each of the virtual lines from the plurality of images displayed on the display unit based on the positions of the virtual straight lines and the positions of the plurality of cameras.

The video processing program according to the present invention includes a process of displaying images of a game field shot by a plurality of cameras side by side on a display unit, and a predetermined setting area in a part of the plurality of images displayed on the display unit. When set, the process of acquiring the set area information indicating the range of the set area, and when a plurality of athletes enter the set area in the video, the approach time and the approach position of the plurality of athletes who have entered are set. The process of acquiring the entry information including the entry information for each player who has entered the set area, and when the plurality of players have left the set area, the exit information including the exit time and the exit position of the plurality of players is set. A process of acquiring each player who has left the area, and a process of setting a virtual straight line passing through the set area for each player who has entered the set area based on at least one of the entry information and the exit information. A computer is made to execute a process of selecting one or more of the images for each virtual line from a plurality of images displayed on the display unit based on the positions of the virtual straight lines and the positions of the plurality of cameras. ..

According to the present invention, it is possible to shorten the time for selecting a predetermined image from a plurality of images displayed on the display unit.

FIG. 1 is a diagram showing an example of a multi-camera system according to the present embodiment. FIG. 2 is a functional block diagram showing an example of the multi-camera system according to the present embodiment. FIG. 3 is a diagram showing an example of an image displayed on the display unit according to the present embodiment. FIG. 4 is a diagram schematically showing an example of a setting area according to the present embodiment. FIG. 5 is a diagram showing an example of entry information and exit information according to the present embodiment. FIG. 6 is a diagram showing an example of a virtual straight line setting operation according to the present embodiment. FIG. 7 is a data table showing an example of information stored in the storage unit according to the present embodiment. FIG. 8 is a flowchart showing an example of the operation of the multi-camera system according to the present embodiment. FIG. 9 is a diagram showing the position of a virtual straight line in the game field according to the present embodiment. FIG. 10 is a diagram showing an example of highlighting according to the present embodiment. FIG. 11 is a diagram showing a setting operation of a virtual straight line according to a modified example. FIG. 12 is a diagram showing a setting operation of a virtual straight line according to a modified example. FIG. 13 is a diagram showing a setting operation of a virtual straight line according to a modified example.

Hereinafter, embodiments of a video processing apparatus, a multi-camera system, a video processing method, and a video processing program according to the present invention will be described with reference to the drawings. The present invention is not limited to this embodiment. In addition, the components in the following embodiments include those that can be easily replaced by those skilled in the art, or those that are substantially the same.

FIG. 1 is a diagram showing an example of the multi-camera system 100 according to the first embodiment. The multi-camera system 100 is installed in the game field 1 where sports games are played. In the present embodiment, soccer will be described as an example of sports, but the present invention is not limited to this, and examples thereof include outdoor sports such as American football, rugby, baseball, and athletics, and indoor sports such as basketball and handball. May be good. In the game field 1, for example, the field 3 is installed on the ground 2. Field 3 is partitioned by line 4. Line 4 includes a side line 5, an end line 6, a center line, a penalty area line, a goal line, and the like. The position coordinates of the game field 1 are set in advance. The position coordinates can be set by measuring with a known measuring device such as a laser sensor. The position information can be expressed using, for example, the X coordinate and the Y coordinate. The X-axis shown in FIG. 1 is set parallel to, for example, the end line 6. The Y-axis shown in FIG. 1 is set parallel to, for example, the side line 5. The settings of the X-axis and the Y-axis are not limited to the above.

FIG. 2 is a functional block diagram showing an example of the multi-camera system 100. As shown in FIGS. 1 and 2, the multi-camera system 100 includes a camera 10, an input unit 20, a display unit 30, and a video processing device 40.

A plurality of cameras 10 are provided. In the present embodiment, for example, a case where six cameras are provided will be described as an example. Hereinafter, when the six cameras 10 are described without distinction, they are described as the cameras 10, and when the six cameras 10 are described separately, they are described with different reference numerals from the cameras 11 to 16. do. The number of cameras 10 is not limited to 6, and may be 5 or less, or 7 or more. The plurality of cameras 10 take pictures so that at least two or more cameras 10 capture the same point in the game field 1 within the angle of view.

Cameras 11 and 12 are arranged outside one side line 5a with respect to the field 3. Cameras 13 and 14 are arranged outside the other side line 5b with respect to the field 3. The camera 15 is arranged outside the one end line 6a with respect to the field 3. The camera 16 is arranged outside the other end line 6b with respect to the field 3. The cameras 11 to 16 have the position coordinates associated with the position coordinates of the game field 1. The position coordinates of the cameras 11 to 16 can be stored in, for example, a storage unit 60 described later. In addition, at least one of the cameras 11 to 16 or a camera separate from the cameras 11 to 16 may be arranged above the game field 1, and the game field 1 may be photographed from above, for example.

The input unit 20 can perform a predetermined input operation for inputting information. As the input unit 20, for example, an input device such as a touch panel is used. In this case, the input unit 20 is provided integrally with the display unit 30 described later. As the input unit 20, a button, a lever, a dial, a switch, or another input device may be used in addition to the touch panel or in place of the touch panel. The input unit 20 outputs an instruction signal corresponding to a predetermined input operation.

The display unit 30 has a display panel such as a liquid crystal panel. The display unit 30 displays various information including characters and images. The display unit 30 can display, for example, an image taken by each camera 10, an input operation image for performing a touch operation by the input unit 20, and the like. When the touch operation is performed on the area corresponding to the image for input operation displayed on the display unit 30 on the surface of the touch panel, the input unit 20 provides the position information of the area where the touch operation is performed. Outputs a predetermined instruction signal including.

The image processing device 40 performs image display processing for displaying the image captured by the camera 10 on the display unit 30. As shown in FIG. 2, the image processing device 40 has a control unit 50 and a storage unit 60.

The control unit 50 controls each unit of the camera 10, the input unit 20, and the display unit 30. The control unit 50 has a processing device such as a CPU (Central Processing Unit) and a storage device such as a RAM (Random Access Memory) and a ROM (Read Only Memory). The control unit 50 includes a video display control unit 51, a setting area information acquisition unit 52, an entry information acquisition unit 53, an exit information acquisition unit 54, a virtual straight line setting unit 55, a video selection unit 56, and a highlight display. It has a control unit 57.

Video information captured by a plurality of cameras 10 is input to the video display control unit 51. The video display control unit 51 outputs the input video information to the display unit 30 and displays the input video information side by side on the display unit 30 as a video. Further, the video display control unit 51 stores the input video in the storage unit 60. In this case, the image display control unit 51 stores each image in the storage unit 60 in association with time information such as the shooting time.

FIG. 3 is a diagram showing an example of an image displayed on the display unit 30. As shown in FIG. 3, in the present embodiment, the display unit 30 displays six images 70 taken by the above six cameras 10 side by side. Hereinafter, when the six images 70 are described without distinction, they will be described as the images 70, and when the six images 70 are described separately, they will be described with different reference numerals from those of the images 71 to 76. .. The number of display units 30 may be two or more.

When a predetermined setting area is set in a part of a plurality of images 70 displayed on the display unit 30, the setting area information acquisition unit 52 acquires the setting area information indicating the range of the setting area.

FIG. 4 is a diagram schematically showing an example of a setting area. As shown in FIG. 4, the setting area A is set in a part of the image 70. The setting area A can be input by the user by the input unit 20. For example, the user may directly draw and set the setting area A in the image 70 by the input unit 20, or the user may select from a preset shape. When the shape of the setting area A is preset to a circle, an ellipse, a triangle, a rectangle, or the like, the user inputs the center position and the dimensions (diameter, one side length, etc.) of the setting area A by the input unit 20 or the like. It is possible to set a setting area A having a designated dimension in a range centered on a designated center position.

When the setting area A is set in the video 70, the setting area information acquisition unit 52 calculates the setting area information indicating the range of the setting area A. The set area information can be obtained as a function indicating an area on a plane by, for example, two variables X and Y in the coordinate system shown in FIG. For example, the setting area information acquisition unit 52 calculates the setting area information based on the position of the outer line of the setting area A in the image 70 and the position coordinates set in the game field 1 by image processing or the like. The setting area information acquisition unit 52 sets the setting area A as a closed area. Therefore, when the area drawn by the user, for example, is not closed, the setting area information acquisition unit 52 may be set as a closed area by supplementing a straight line or a curved line. Further, the setting area information acquisition unit 52 calculates the center of gravity position G of the setting area A. The setting area information acquisition unit 52 stores the calculated setting area information and the center of gravity position G in, for example, a storage unit 60.

When a player enters the set area A in the video 70, the approach information acquisition unit 53 acquires the approach information including the approach time and the approach position of the specific player who is the first player to enter the set area A. When the specific player leaves the set area A, the exit information acquisition unit 54 acquires the exit information including the exit time and the exit position of the specific player.

FIG. 5 shows an example in which the specific player P enters the set area A and then exits from the set area A. The approach information acquisition unit 53 determines whether or not a player has entered the set area A, and when the player enters the set area A, detects the player who first entered the set area A as the specific player P. After detecting the specific player P, the approach information acquisition unit 53 does not have to determine whether or not the player has entered the set area A. Further, the approach information acquisition unit 53 obtains the approach time when the specific player P enters the set area A and the position information of the approach position I. The approach information acquisition unit 53 obtains the time information associated with each video 70 as the approach time. As a result, the approach time and the time in the video 70 are associated with each other. The approach information acquisition unit 53 may separately generate tag information that associates the acquired approach time with the time in the video 70. The approach information acquisition unit 53 calculates the X coordinate and the Y coordinate as the position information of the approach position I. The approach information acquisition unit 53 stores the acquired approach information in the storage unit 60. When a player other than the specific player P enters the set area A, the approach information acquisition unit 53 does not perform an operation of calculating the approach information.

Further, when the specific player P exits from the set area A, the exit information acquisition unit 54 obtains the exit time and the position information of the exit position E. The exit information acquisition unit 54 obtains the time associated with each video 70 as the exit time. As a result, the exit time and the time in the video 70 are associated with each other. The exit information acquisition unit 54 may separately generate tag information that associates the acquired exit time with the time in the video 70. The exit information acquisition unit 54 calculates the X coordinate and the Y coordinate as the position information of the exit position E. The exit information acquisition unit 54 stores the acquired exit information in the storage unit 60. When a player other than the specific player P leaves the set area A, the exit information acquisition unit 54 does not perform an operation of requesting the exit information.

The virtual straight line setting unit 55 sets a virtual straight line passing through the setting area A based on at least one of the entry information and the exit information. FIG. 6 is a diagram showing an example of setting one virtual straight line. As shown in FIG. 6, the virtual straight line setting unit 55 sets the virtual straight line L passing through the setting area A. The virtual straight line setting unit 55 bisects the angle IG formed by, for example, the line segment IG connecting the center of gravity position G and the entry position I of the setting area A and the line segment EG connecting the center of gravity position G and the exit position E. The line can be set as a virtual straight line L. When this virtual straight line L is set, the virtual straight line setting unit 55 sets a line segment connecting the entry position I and the center of gravity position G and a line segment connecting the exit position E and the center of gravity position G, and sets the line segment. Find the bisector of the angle between the segments. The setting example of the virtual straight line L is not limited to this.

The image selection unit 56 selects one or more images 70 from the plurality of images 70 displayed on the display unit 30 based on the positions of the virtual straight lines and the positions of the plurality of cameras 10. The image selection unit 56 may select, for example, one or more cameras 10 among the plurality of cameras 10 in ascending order of distance from the virtual straight line L. Further, the image selection unit 56 may select one or more cameras 10 among the plurality of cameras 10 in ascending order of the angle formed by the optical axis of the camera 10 and the virtual straight line L. The image selection unit 56 selects the image 70 captured by the detected camera 10.

The highlight display control unit 57 highlights one or more images selected by the image selection unit 56 among the plurality of images displayed on the display unit 30.

The storage unit 60 has storage such as a hard disk drive or a solid state drive. An external storage medium such as a removable disk may be used as the storage unit 60. The storage unit 60 stores an operating system for video processing, various programs for controlling the operations of the camera 10, the input unit 20, and the display unit 30, various programs for processing in the video processing device 40, data, and the like. ..

In addition, the storage unit 60 stores the video processing program according to the present embodiment. In this video processing program, a process of displaying the images of the game field shot by the plurality of cameras 10 side by side on the display unit 30 and a predetermined setting area are set in a part of the plurality of images 70 displayed on the display unit 30. If so, the process of acquiring the set area information indicating the range of the set area, and when the player enters the set area in the video 70, the approach information including the approach time and the approach position of the player who first entered is acquired. Based on the process, the process of acquiring exit information including the exit time and exit position of the player when the player who first entered the set area exits the set area, and at least one of the entry information and the exit information. , One or more images 70 are selected from the plurality of images 70 displayed on the display unit 30 based on the process of setting the virtual straight line passing through the setting area and the positions of the virtual straight lines and the positions of the plurality of cameras 10. The video processing apparatus 40 is made to execute the processing to be performed.

Further, the storage unit 60 includes a video storage unit 61, a setting area information storage unit 62, an entry information storage unit 63, an exit information storage unit 64, a highlight display information storage unit 65, and a player information storage unit 66. Have.

The video storage unit 61 is input with the video information output from the video display control unit 51. The video storage unit 61 stores the input video information. The video storage unit 61 stores, for example, video information in association with time information.

The setting area information storage unit 62 is input with the setting area information acquired by the setting area information acquisition unit 52. The setting area information storage unit 62 stores the input setting area information.

The approach information storage unit 63 is input with the approach information acquired by the approach information acquisition unit 53. The approach information storage unit 63 stores the input approach information.

The exit information storage unit 64 is input with the exit information acquired by the exit information acquisition unit 54. The exit information storage unit 64 stores the input exit information.

The highlight display information storage unit 65 stores the display data of the highlight display and the display program to be displayed on the display unit 30.

The player information storage unit 66 stores player information for identifying a player who participates in a game held in the game field 1. The player information includes, for example, affiliation information such as the team, position, and uniform number to which the player belongs, and physical information such as face, height, and weight. In addition, the player information storage unit 66 stores information about a specific player who first enters the setting area A.

FIG. 7 is a data table showing an example of information stored in the storage unit 60. As shown in FIG. 7, the storage unit 60 stores, for example, a plurality of setting areas A1, A2, A3, ..., Which are set by the user. The storage unit 60 stores the set area information stored in the set area information storage unit 62, the approach information (entry time, approach position) stored in the entry information storage unit 63, and the exit stored in the exit information storage unit 64. The information (exit time, exit position) and the specific player stored in the player information storage unit 66 are stored in association with each other. The storage unit 60 may store tag information such as tag information for associating the entry time with the time of the video 70 and tag information for associating the exit time with the time of the video 70.

Next, the operation of the multi-camera system 100 configured as described above will be described. In the following description, a game in the game field 1 is photographed by a plurality of cameras 10, the captured image is stored in the image storage unit 61, and then the image stored in the image storage unit 61 is reproduced and displayed on the display unit 30. The case is taken as an example, but the case is not limited to this. FIG. 8 is a flowchart showing an example of the operation of the multi-camera system 100 according to the present embodiment. As shown in FIG. 8, the image display control unit 51 acquires images taken by the plurality of cameras 10 from the image storage unit 61 and displays them on the display unit 30 (step S10).

Next, when the predetermined setting area A is set in a part of the plurality of images 70 displayed on the display unit 30, the setting area information acquisition unit 52 acquires the setting area information indicating the position of the setting area A. (Step S20). In step S20, the setting area information acquisition unit 52 determines whether or not the setting area A has been input to the plurality of images 70 displayed on the display unit 30. When the input unit 20 determines that the setting area A has been input, the setting area information acquisition unit 52 acquires the position information indicating the range of the input setting area A as the setting area information.

After the set area information is acquired, the approach information acquisition unit 53 acquires the approach information including the approach time and the approach position of the specific player who first entered when the player enters the set area A in the video 70 ( Step S30). In step S30, the approach information acquisition unit 53 determines whether or not a player has entered the set area A by, for example, image processing. When the approach information acquisition unit 53 determines that the player has first entered the set area A, the approach information acquisition unit 53 detects the player who first entered as the specific player P. The approach information acquisition unit 53 acquires information on the specific player P by extracting information such as the face and uniform number of the specific player P by image processing or the like and collating it with the player information stored in the player information storage unit 66. do. In addition, the approach information acquisition unit 53 acquires approach information including the approach time and the approach position when the specific player P enters the set area A.

When the specific player leaves the set area A after the specific player enters the set area A, the exit information acquisition unit 54 acquires the exit information including the exit time and the exit position of the specific player (step S40). .. In step S40, the exit information acquisition unit 54 determines whether or not the specific player has exited from the setting area A by, for example, image processing. When the exit information acquisition unit 54 determines that the specific player has left the set area A, the exit information acquisition unit 54 acquires the exit information including the exit time and the exit position of the specific player leaving the set area A.

Next, the virtual straight line setting unit 55 sets the virtual straight line L passing through the setting area A based on at least one of the entry information and the exit information (step S50). In the present embodiment, the virtual straight line setting unit 55 sets the virtual straight line L using the entry position I and the exit position E. Therefore, in step S50, the virtual straight line setting unit 55 first determines whether or not the specific player has left the setting area A, and when the specific player has left the setting area A, sets the virtual straight line L. .. In this case, the virtual straight line setting unit 55 has a bisector IG formed by a line segment IG connecting the center of gravity position G and the entry position I of the setting area A and a line segment EG connecting the center of gravity position G and the exit position E. The bisector is set as a virtual straight line L.

The image selection unit 56 selects one or more images 70 from the plurality of images 70 displayed on the display unit 30 based on the positions of the virtual straight lines L and the positions of the plurality of cameras 10 (step S60). In step S60, the image selection unit 56 selects, for example, the camera 10 having the shortest distance from the virtual straight line L among the plurality of cameras 10. Then, the image selection unit 56 selects the image 70 captured by the detected camera 10.

FIG. 9 is a diagram showing the position of the virtual straight line L in the game field 1. As shown in FIG. 9, in the present embodiment, the virtual straight line L is set at a position where it passes through, for example, the center of gravity position G of the setting area A and overlaps with the camera 14. In this case, the image selection unit 56 selects, for example, the camera 14 having the shortest distance from the virtual straight line L. Then, the image selection unit 56 selects the image 74 captured by the selected camera 14.

When the image 74 is selected, the image display control unit 51 sets the scene from the entry time when the specific player P enters the setting area A to the exit time when the specific player P leaves the setting area A in the image 74. Is displayed on the display unit 30. The video display control unit 51 makes the entry time and exit time stored in the entry information storage unit 63 and the exit time stored in the exit information storage unit 64 correspond to the time of the video 74 stored in the video storage unit 61. , The scene from the entry time to the exit time is extracted from the video 74. Then, the video display control unit 51 causes the display unit 30 to display the extracted scene.

When displaying the extracted scene, the highlight display control unit 57 highlights the extracted scene. The highlight display control unit 57 performs highlight display by selecting and displaying the display data stored in the highlight display information storage unit 65, or executing a display program or the like. By this process, the display unit 30 displays the extracted scenes from the entry time to the exit time among the images 74 selected by the image selection unit 56 by highlight display.

FIG. 10 is a diagram showing an example of highlight display. As shown in FIG. 10, in the present embodiment, the selected image 74 is displayed on the display unit 30 larger than the other images 70 (71 to 73, 75, 76). The highlight display example is not limited to this, and may be a display that makes the outer edge of the image 70 stand out, or an icon or the like that points to the selected image 74.

As described above, the image processing device 40 according to the present embodiment is displayed on the image display control unit 51 and the display unit 30 for displaying the images 70 of the game field 1 taken by the plurality of cameras 10 side by side on the display unit 30. When a predetermined setting area A is set in a part of a plurality of images 70, the setting area information acquisition unit 52 for acquiring the setting area information indicating the position of the setting area A and the setting area A in the image 70 When a player enters, the approach information acquisition unit 53 which acquires the approach information including the approach time and the approach position of the specific player who first entered, and when the specific player leaves the set area A, the exit time when the specific player leaves. The exit information acquisition unit 54 that acquires exit information including the exit position, the virtual straight line setting unit 55 that sets the virtual straight line L passing through the setting area A based on at least one of the entry information and the exit information, and the virtual The image selection unit 56 is provided to select one or more images 70 from the plurality of images 70 displayed on the display unit 30 based on the position of the straight line L and the positions of the plurality of cameras 10.

When the specific player enters and exits the setting area A, the image processing device 40 automatically selects one or more images 70 based on at least one of the entry information and the exit information, so that the movement of the specific player P The image 70 that can be easily identified can be selected in a short time. As a result, it is possible to shorten the time for selecting a predetermined image 70 from which the movement of the specific player can be easily discriminated from the plurality of images 70 displayed on the display unit 30.

Further, in the video processing device 40 according to the present embodiment, the video display control unit 51 displays the scene from the entry time to the exit time among the video 74 selected by the video selection unit 56 on the display unit 30, so that the video is displayed. Of the 74, the user's desired scene can be extracted and displayed.

Further, since the video processing device 40 according to the present embodiment further includes a highlight display control unit 57 that highlights the scene displayed on the display unit 30, the user can easily display the extracted scene of the video 74. You can find it. As a result, it is possible to shorten the time for the user to find the extracted scene of the image 74 from the plurality of images 70 displayed on the display unit 30.

Further, in the video processing device 40 according to the present embodiment, the virtual straight line setting unit 55 is a line segment connecting the center of gravity position G and the entry position I of the setting area A and a line segment connecting the center of gravity position G and the exit position E. The bisector of the angle between the two is set as the virtual straight line L. As a result, it is possible to select the camera 10 that captures the movement of the specific player P from entering the setting area A to exiting from a suitable direction.

Further, since the video processing device 40 according to the present embodiment includes the storage unit 60 for storing the video 70, the setting area information, the entry information, and the exit information, the control unit 50 and the control unit 50 can be used without using an external storage unit or the like. It is possible to perform linked processing at high speed and stably.

The technical scope of the present invention is not limited to the above-described embodiment, and modifications can be made as appropriate without departing from the spirit of the present invention. For example, in the above-described embodiment, the virtual straight line setting unit 55 has an angle IGE formed by a line segment connecting the center of gravity position G and the entry position I of the setting area A and a line segment connecting the center of gravity position G and the exit position E. The mode in which the bisector of the above is set as a virtual straight line L has been described as an example, but the present invention is not limited to this.

FIG. 11 is a diagram showing a setting operation of a virtual straight line according to a modified example. As shown in FIG. 11, the virtual straight line setting unit 55 may set a straight line connecting the entry position I and the exit position E as a virtual straight line LA. In this case, the camera 10 arranged in front of the direction in which the specific player P moves can be selected.

FIG. 12 is a diagram showing a setting operation of a virtual straight line according to a modified example. As shown in FIG. 12, the approach information acquisition unit 53 acquires the approach direction DB in which the specific player P enters the set area A as the approach information. Then, the virtual straight line setting unit 55 passes the approach position I and sets a straight line parallel to the approach direction DB as the virtual straight line LB. In this case, the camera 10 arranged in front of the approach direction in which the specific player P enters the set area A can be selected.

FIG. 13 is a diagram showing a setting operation of a virtual straight line according to a modified example. As shown in FIG. 13, the exit information acquisition unit 54 acquires the exit direction DC in which the specific player P exits from the setting area A as the exit information. Then, the virtual straight line setting unit 55 passes through the exit position E and sets a straight line parallel to the exit direction DC as the virtual straight line LC. In this case, the camera 10 arranged in front of the exit direction in which the specific player P exits the setting area A can be selected.

Further, in the above-described embodiment, the virtual straight line setting unit 55 has been described by exemplifying a case where the virtual straight line L extends to both sides with respect to the center of gravity position G, but the present invention is not limited to this. For example, the virtual straight line setting unit 55 may set the virtual straight line L so as to extend only from the center of gravity position G to the side where the angle of the angle IGE is wide. Further, the virtual straight line setting unit 55 may set the virtual straight line L so as to extend only from the center of gravity position G to the side where the angle of the angle IGE becomes a narrow angle. The virtual straight line setting unit 55 may set a plurality of virtual straight lines L obtained by different methods at the same time.

Further, in the above embodiment, the case where the image selection unit 56 selects one camera 10 (camera 14) based on the virtual straight line L and selects the image 70 (image 74) has been described as an example. Not limited to this. For example, the image selection unit 56 selects a plurality of cameras 10 based on the virtual straight line L, and then selects an image 70 having a long time for recognizing the specific player P from the images 70 taken by the selected plurality of cameras 10. You may. That is, the image selection unit 56 may select a plurality of images 70 in stages, and may use the virtual straight line L in one of the selection stages.

Further, in the above embodiment, the video processing device 40 has been described with reference to an example in which the video 74 selected by the video selection unit 56 is displayed on the display unit 30 by the video display control unit 51, but the present invention is not limited thereto. .. For example, the image processing device 40 may store the image 74 selected by the image selection unit 56 in the storage unit 60 without displaying it in the display unit 30. In this case, the video processing device 40 may extract the scenes from the entry time to the exit time and store them in the storage unit 60.

Further, in the above embodiment, the approach information acquisition unit 53 has described the mode of acquiring the approach information of the specific player P who first entered the setting area A as an example, but the present invention is not limited to this. For example, the approach information acquisition unit 53 may acquire the approach information of the player who has entered the set area A second in addition to the approach information of the specific player P.

Similarly, in the above-described embodiment, the exit information acquisition unit 54 has described the mode of acquiring the exit information of the specific player P who has exited from the setting area A as an example, but the present invention is not limited to this. For example, the exit information acquisition unit 54 may acquire the exit information when the player who has entered the set area A second exits, in addition to the exit information of the specific player P.

In this way, the entry information acquisition unit 53 and the exit information acquisition unit 54 may acquire the entry information and exit information of a plurality of athletes. In this case, the virtual straight line setting unit 55 sets the virtual straight line based on the entry information and the exit information of a plurality of athletes. This virtual straight line may be one or two or more.

When the number of virtual straight lines is two or more, the image selection unit 56 can select an image based on two or more virtual straight lines. In this case, one or more images may be selected for each virtual straight line, or one or more images may be selected for each of a plurality of virtual straight lines.

A, A1, A2, A3 ... Setting area, E ... Exit position, G ... Center of gravity position, I ... Entry position, L, LA, LB, LC ... Virtual straight line, P ... Specific player, DB ... Entry direction, DC ... Exit Direction, EG, IG ... line, 1 ... game field, 2 ... ground, 3 ... field, 4 ... line, 5,5a, 5b ... sideline, 6,6a, 6b ... end line, 10,11-16 ... Camera, 20 ... Input unit, 30 ... Display unit, 40 ... Video processing device, 50 ... Control unit, 51 ... Video display control unit, 52 ... Setting area information acquisition unit, 53 ... Entrance information acquisition unit, 54 ... Exit information acquisition Unit, 55 ... Virtual straight line setting unit, 56 ... Video selection unit, 57 ... Highlight display control unit, 60 ... Storage unit, 61 ... Video storage unit, 62 ... Setting area information storage unit, 63 ... Entry information storage unit, 64 ... Exit information storage unit, 65 ... Highlight display information storage unit, 66 ... Player information storage unit, 70, 71-76 ... Video, 100 ... Multi-camera system.

Claims (5)

An image display control unit that displays the images of the game field shot by multiple cameras side by side on the display unit,
When a predetermined setting area is set in a part of the plurality of images displayed on the display unit, a setting area information acquisition unit that acquires setting area information indicating the range of the setting area, and a setting area information acquisition unit.
When a plurality of athletes enter the set area in the video, an approach information acquisition unit that acquires approach information including the approach time and approach position of the plurality of athletes who have entered the set area for each athlete who has entered the set area.
When the plurality of athletes have exited from the set area, an exit information acquisition unit that acquires exit information including the exit time and exit position of the plurality of athletes for each player who has exited from the set area.
A virtual straight line setting unit that sets a virtual straight line passing through the set area for each player who has entered the set area based on at least one of the entry information and the exit information.
An image including a video selection unit that selects one or more of the images for each virtual straight line from a plurality of the images displayed on the display unit based on the positions of the virtual straight lines and the positions of the plurality of cameras. Processing equipment. The video processing device according to claim 1, wherein the video display control unit displays a scene from the entry time to the exit time of the video selected by the video selection unit on the display unit. With multiple cameras that shoot the game field from different angles,
A display unit that can display images taken by multiple cameras,
A multi-camera system including the video processing apparatus according to claim 1 or 2, which processes the video. Displaying the video of the game field shot by multiple cameras side by side on the display,
When a predetermined setting area is set in a part of the plurality of images displayed on the display unit, the setting area information indicating the range of the setting area can be acquired.
When a plurality of athletes have entered the set area in the video, the approach information including the approach time and the approach position of the plurality of athletes who have entered is acquired for each athlete who has entered the set area.
When the plurality of players have left the set area, the exit information including the exit time and the exit position of the plurality of players has been acquired for each player who has left the set area.
Based on at least one of the entry information and the exit information, a virtual straight line passing through the set area is set for each player who has entered the set area.
An image processing method including selecting one or more of the images for each virtual line from a plurality of images displayed on the display unit based on the positions of the virtual straight lines and the positions of the plurality of cameras. .. The process of displaying the video of the game field shot by multiple cameras side by side on the display unit,
When a predetermined setting area is set in a part of the plurality of images displayed on the display unit, a process of acquiring setting area information indicating the range of the setting area and a process of acquiring the setting area information indicating the range of the setting area.
When a plurality of athletes have entered the set area in the video, the process of acquiring the approach information including the approach time and the approach position of the plurality of athletes who have entered the set area for each athlete who has entered the set area.
When the plurality of players have left the set area, a process of acquiring exit information including the exit time and the exit position of the plurality of players for each player who has left the set area.
A process of setting a virtual straight line passing through the set area for each player who has entered the set area based on at least one of the entry information and the exit information.
A computer is made to execute a process of selecting one or more of the images for each virtual line from a plurality of images displayed on the display unit based on the positions of the virtual straight lines and the positions of the plurality of cameras. Video processing program.

Images