WO2021192768A1 - 球技映像解析装置、球技映像解析方法、及び、コンピュータプログラム - Google Patents

球技映像解析装置、球技映像解析方法、及び、コンピュータプログラム Download PDF

Info

Publication number
WO2021192768A1
WO2021192768A1 PCT/JP2021/006500 JP2021006500W WO2021192768A1 WO 2021192768 A1 WO2021192768 A1 WO 2021192768A1 JP 2021006500 W JP2021006500 W JP 2021006500W WO 2021192768 A1 WO2021192768 A1 WO 2021192768A1
Authority
WO
WIPO (PCT)
Prior art keywords
mask
area
image
ball
moving body
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/006500
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
純子 上田
優麻 齋藤
井村　康治
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Intellectual Property Management Co Ltd
Original Assignee
Panasonic Intellectual Property Management Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panasonic Intellectual Property Management Co Ltd filed Critical Panasonic Intellectual Property Management Co Ltd
Publication of WO2021192768A1 publication Critical patent/WO2021192768A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/292—Multi-camera tracking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the ball game image analysis device disclosed in Patent Document 1 detects an image of a ball, which is an example of a moving body used in a ball game, from captured images using a predetermined image analysis technique, and the detected image of the ball.
  • the movement trajectory of the ball is specified based on the time change of the position.
  • the ball game video analysis system 1 is a system that analyzes an image of a ball game play (hereinafter referred to as a “photographed image”) and analyzes the movement locus of a moving body used in the ball game.
  • volleyball which is one of the ball games
  • the ball game video analysis system 1 is not limited to volleyball, and can be applied to various ball games such as soccer, baseball, table tennis, basketball, tennis, rugby, American football, lacrosse, badminton, and ice hockey.
  • the moving body targeted by the ball game video analysis system 1 is typically a ball.
  • the moving body targeted by the ball game video analysis system 1 is not limited to a ball, and may have a shape that does not fit the concept of a "ball” such as a badminton shuttle or an ice hockey puck.
  • the mask setting unit 102 is a UI (hereinafter referred to as “mask UI”) 300 (hereinafter referred to as “mask UI”) 300 (hereinafter referred to as “mask UI”) 300 (FIG. 3, FIG. 5 to 7) is generated and output to the operation terminal 20.
  • the mask area 301 indicates an area in the captured image 200 in which the ball image is not detected. For example, the user inputs the mask area 301 so as to surround the image of the fake ball through the mask UI 300.
  • the mask setting unit 102 provides the identification information of the camera 3 that captured the captured image 200 and the mask information indicating the position and size of the set mask area 301.
  • the mask area setting information 210 is written in association with each other. The details of the mask UI 300 will be described later (see FIGS. 5 to 7).
  • the mask area 301A is input to the image of the fake ball Q1 included in the captured image 200A of the camera 3A, and the mask area 301B is included in the image of the fake ball Q2 included in the captured image 200B of the camera 3B.
  • the intersecting three-dimensional space is expressed as the intersection space P. ..
  • the mask prohibition area related information 304B (expressed as “3B-1" in FIG. 7) including the identification information of the camera 3B and the mask identification information of the mask area 301B is placed in the vicinity of the mask prohibition area 302 of the captured image 200C of the camera 3C. indicate.
  • the mask setting unit 102 sets a mask recommended area for the ball estimation image.
  • the mask recommended area indicates an area for which the setting of the mask area 301 is recommended.
  • the mask setting unit 102 sets the mask recommended area so as to surround the ball estimation image with a square or a circle.
  • a first mask recommended area is set in the captured image 200 of one of the cameras 3A, 3B, 3C, and 3D (hereinafter referred to as “first camera”), and the camera 3A
  • first camera the second mask recommended area
  • second camera another camera
  • third camera the setting of the mask recommended area is prohibited in the area related to the first mask recommended area and the second mask recommended area.
  • a mask prohibited area may be set.
  • the mask setting unit 102 does not have to set the mask recommended area in the captured image 200 of the third camera so that at least a part of the mask prohibited area overlaps.
  • the ball estimation image detection unit 104 detects the ball estimation image from the captured images 200A, 200B, 200C, and 200D received from the cameras 3A, 3B, 3C, and 3D (S201).
  • the mask setting unit 102 outputs the mask UI 300 to the operation terminal 20 (S203).
  • the user operates, for example, the mask UI 300 to instruct the display of the captured image 200 of a certain camera 3 (S204).
  • the mask setting unit 102 displays the photographed image 200 on which the mask recommended area is superimposed (S205).
  • the user only needs to select the mask recommended area set for the fake ball image from the automatically set mask recommended areas, so that the mask area 301 can be set efficiently. ..
  • the mask setting unit 102 detects a common ball estimation image from all of a plurality of (for example, 4) captured images 200 (frame images) extracted at predetermined intervals (for example, 10 frame intervals), the mask setting unit 102 sets the same.
  • a mask recommended area corresponding to the detected ball estimation image may be set in the camera 3 in which the captured image 200 is captured.
  • the CPU 1003 copies the program stored in the storage device 1007 to the RAM 1006, and sequentially reads and executes the instructions included in the program from the RAM 1006, whereby the functions of the above devices are realized.
  • the ball game image analysis device (100) includes a receiving unit (101) for receiving a captured image (200) from a plurality of cameras (3) installed at different positions capable of photographing a ball game, and a captured image.
  • the image of the ball which is an example of a moving body for ball games, is detected from the mask setting unit (102) that sets the mask area (301) in the area input by the user in the above and the area that does not include the mask area in the captured image. It is provided with an analysis unit (103) that identifies a three-dimensional position of the ball based on the position of the image of the ball detected from at least two captured images.
  • the user cannot set the mask area in the mask prohibited area. Therefore, it is possible to prevent the problem that the analysis unit cannot detect the image of the true ball from at least two captured images and cannot specify the three-dimensional position of the ball.
  • the user can visually recognize the mask prohibited area in the third captured image.
  • the user can visually recognize the camera in which the mask area is set, which causes the mask prohibited area to be set.
  • the user can easily display the captured image in which the mask area that caused the mask prohibited area is set is set.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Image Analysis (AREA)
  • Closed-Circuit Television Systems (AREA)
PCT/JP2021/006500 2020-03-26 2021-02-19 球技映像解析装置、球技映像解析方法、及び、コンピュータプログラム Ceased WO2021192768A1 (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020-056129 2020-03-26
JP2020056129A JP7442089B2 (ja) 2020-03-26 2020-03-26 球技映像解析装置、球技映像解析方法、及び、コンピュータプログラム

Publications (1)

Publication Number Publication Date
WO2021192768A1 true WO2021192768A1 (ja) 2021-09-30

Family

ID=77891427

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/006500 Ceased WO2021192768A1 (ja) 2020-03-26 2021-02-19 球技映像解析装置、球技映像解析方法、及び、コンピュータプログラム

Country Status (2)

Country Link
JP (1) JP7442089B2 (https=)
WO (1) WO2021192768A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119090972A (zh) * 2024-08-14 2024-12-06 上海人工智能创新中心 针对隔网球类运动的技战术能力监测、分析系统和方法

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7466919B2 (ja) * 2021-09-28 2024-04-15 京楽産業．株式会社 遊技機
EP4270940B1 (en) * 2022-04-26 2024-10-30 Axis AB Ptz masking control

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006040199A (ja) * 2004-07-30 2006-02-09 Nippon Hoso Kyokai <Nhk> 映像オブジェクト抽出装置、映像オブジェクト軌跡合成装置、その方法及びそのプログラム
JP2007133660A (ja) * 2005-11-10 2007-05-31 Nippon Hoso Kyokai <Nhk> 多視点映像合成装置及び多視点映像合成システム

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3798978A4 (en) 2018-05-21 2021-08-04 Panasonic Intellectual Property Management Co., Ltd. BALL GAME VIDEO ANALYSIS DEVICE AND BALL GAME VIDEO ANALYSIS METHOD

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006040199A (ja) * 2004-07-30 2006-02-09 Nippon Hoso Kyokai <Nhk> 映像オブジェクト抽出装置、映像オブジェクト軌跡合成装置、その方法及びそのプログラム
JP2007133660A (ja) * 2005-11-10 2007-05-31 Nippon Hoso Kyokai <Nhk> 多視点映像合成装置及び多視点映像合成システム

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119090972A (zh) * 2024-08-14 2024-12-06 上海人工智能创新中心 针对隔网球类运动的技战术能力监测、分析系统和方法

Also Published As

Publication number Publication date
JP2021157406A (ja) 2021-10-07
JP7442089B2 (ja) 2024-03-04

Similar Documents

Publication Publication Date Title
JP7289080B2 (ja) 球技映像解析装置、及び、球技映像解析方法
US11270522B1 (en) Systems and methods for facilitating display of augmented reality content
CN105519097B (zh) 用于显示画中画的系统、装置和方法
US20170171570A1 (en) Information processing apparatus, information processing method, and computer-readable storage medium
EP2426641B1 (en) System and method of image augmentation
JP6720587B2 (ja) 映像処理装置、映像処理方法および映像処理プログラム
US20180122078A1 (en) Methods and Systems for Generating Stitched Video Content From Multiple Overlapping and Concurrently-Generated Video Instances
WO2021192768A1 (ja) 球技映像解析装置、球技映像解析方法、及び、コンピュータプログラム
US20210390721A1 (en) Display control apparatus, display control method, and storage medium
US11257282B2 (en) Methods and apparatus to detect collision of a virtual camera with objects in three-dimensional volumetric model
KR102475994B1 (ko) 정보 처리장치, 정보 처리방법 및 기억매체
US11831853B2 (en) Information processing apparatus, information processing method, and storage medium
CN105678802A (zh) 辨识二维影像产生三维信息的方法
EP2662829B1 (en) System and method of book leaf tracking
US20250037322A1 (en) Image processing apparatus, method for image processing, and storage medium
CN112070795A (zh) 运动员跟踪方法及系统
JP5687670B2 (ja) 表示制御システム、ゲームシステム、表示制御装置、及びプログラム
EP2668983B1 (en) Apparatus and method of augmenting video
WO2019070011A1 (ja) 移動体追跡装置及び移動体追跡方法
KR101879368B1 (ko) 구기 스포츠에서의 이벤트 영상 제공 시스템 및 이를 이용한 인/아웃 판단 방법
WO2021016904A1 (en) Multiple camera jersey number recognition
JP7429887B2 (ja) 球技映像解析装置、球技映像解析方法、及び、コンピュータプログラム
CN110226324B (zh) 信息处理设备和信息处理方法
Lee et al. A vision-based mobile augmented reality system for baseball games
JP7300668B2 (ja) プレイ分析装置、及び、プレイ分析方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21774910

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21774910

Country of ref document: EP

Kind code of ref document: A1