WO2019115445A1 - Appareil et procédé d'interprétation de séquences d'images - Google Patents

Appareil et procédé d'interprétation de séquences d'images Download PDF

Info

Publication number
WO2019115445A1
WO2019115445A1 PCT/EP2018/084135 EP2018084135W WO2019115445A1 WO 2019115445 A1 WO2019115445 A1 WO 2019115445A1 EP 2018084135 W EP2018084135 W EP 2018084135W WO 2019115445 A1 WO2019115445 A1 WO 2019115445A1
Authority
WO
WIPO (PCT)
Prior art keywords
marker
processing unit
view
field
images
Prior art date
Application number
PCT/EP2018/084135
Other languages
English (en)
Inventor
Vigen BADALYAN
Original Assignee
Vivaro Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivaro Ltd filed Critical Vivaro Ltd
Priority to EP18826977.3A priority Critical patent/EP3724851A1/fr
Publication of WO2019115445A1 publication Critical patent/WO2019115445A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G06T7/248—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30221—Sports video; Sports image

Definitions

  • the present invention relates to the interpretation and/or analysis of sequences of images, especially in the field of live sports.
  • the invention is especially useful relative to stadium sports such as tennis, soccer and the like but is not limited to this application. Indeed, the applicant believes that the underlying technology could be applied in a wide range of technical fields beyond that of live sports. Nonetheless, the invention will be described with a focus on live sports.
  • Live sporting events may attract a significant following, and are often well-attended by people at the stadium itself as well as via live television broadcasts and subsequent edited highlights or review shows.
  • a wide variety of statistics is collected during such sporting events. Such statistics may relate to, for example, the distance a particular athlete has run during a soccer match or the number of aces served during a tennis match.
  • Some of the information collected during an event may be collated by automated means but some information requires manual recordal by a person in the stadium or watching a live feed. Such a person is sometimes referred to as a“scout”.
  • a“scout” Such a person is sometimes referred to as a“scout”.
  • a single scout may be insufficient to provide suitable recordal of desired information.
  • WO 01/41884 of Sherry and Hawkins discloses an arrangement which is implemented especially in cricket, which monitors the actual path of a ball and aims to extrapolate such a path with so as to predict a would-be future flight of the ball.
  • the present invention is directed to a system to record information about events comprising at least one image source adapted to provide a series of photographic images of a field of view to a processing unit, the processing unit being adapted to identify and locate a marker within one or more photographic images provided thereto and provide a location of said marker relative to the field of view, and wherein the processing unit is further adapted to derive and record a translation of said marker within the field of view between two or more images comprising the said series of images.
  • the present invention enables movement of a marker to be tracked between images.
  • the two or more images may be substantially subsequent to each other within the said series. If the images are provided sequentially in time, movement of a marker may be tracked with respect to time.
  • the field of view is known. More preferably, the field of view is pre-determined and substantially does not vary over time.
  • the image source may comprise a camera.
  • the marker may represent a physical object located within the field of view of the camera.
  • the system of the present invention may enable location and movement of a physical object within the field of view to be tracked over time.
  • the processing unit may be adapted to identify and locate more than one marker within each photographic image.
  • the processing unit is preferably adapted to derive and record translations of each marker within the field of view between two or more images comprising the said series of images.
  • the image source may comprise more than one camera. Provision of more than one camera may enable location and movement information to be derived in more dimensions. For example, this may be achieved by triangulation.
  • the said field of view may alternatively or further be provided with a co-ordinate system such as axes or a grid.
  • a co-ordinate system may supplement a single-camera arrangement or a plural-camera arrangement to provide improved location information.
  • the marker or markers may be relatively simple image artefacts forming part of an image provided by the camera or cameras. Alternatively, they may be formed of one or more complex arrangements of image artefacts.
  • a correspondence between a marker and a physical object may be provided by the processing unit or by an external unit. Such a correspondence may be provided by a machine learning apparatus.
  • correspondences may be between a complex image artefact and an object forming part of a sporting event such as a ball or a player or a sports implement such as a raquet or bat.
  • Correspondences may be derived, for example, by identification of a shape of an object or by a proxy such as an indicium displayed on an object. For example a player may have a number or other indicium displayed on his or her clothing, the indicium being capable of being recognised by the processing unit.
  • the system of the present invention may be able to track the movement of a physical object over time during a sporting event.
  • the processing unit may be adapted to provide a description of a derived translation of a marker.
  • a description may be in a geometric or mathematical or computer-readable form, or in a linguistic form.
  • a geometric description may be a path along which a marker is travelling.
  • a linguistic description may be provided which is understandable by humans.
  • the system of the present invention may be adapted to provide an output which describes in a suitable form the movement of an object within a field of view.
  • a field of view may be the playing area of a sport, or some other location.
  • the system of the present invention may comprise more than one camera to provide more than one image of the field of view from differing points-of-view.
  • the system may be able to derive and record a translation of a marker in more than one dimension.
  • a description of a derived translation may have components in more than one dimension. This may be useful for providing an indication of certain events, for example a ball going out of play in many sports or a player being off-side in soccer.
  • the processing unit identifies a marker by recognising aspects of the shape or other features of the marker within one or more photographic images. While it is known from WO 01/41884 of Sherry and Hawkins for a system to identify pixels within an image relating to a ball, the present invention is able to identify and locate more complex markers by utilising machine learning.
  • a processing unit may be trained to identify aspects and elements of a particular marker by providing data sets to the processing unit including representations of the marker in question.
  • the processing unit is adapted to identify common and varying aspects of the said marker so that when provided with a further image the processing unit has a reasonable chance of correctly identifying the said marker.
  • a processing unit may be further developed by an iterative process in which a marker or markers which was or were not correctly identified may be manually identified by a human operator to provide for a better chance of the processing unit correctly identifying a respective marker in a further image provided thereto.
  • the system of the present invention may comprise at least one microphone connected to the processing unit, the processing unit being adapted to identify a sound marker. By identifying a sound marker, the processing unit may be able to supplement or verify an identification and/or location of a marker in a photographic image.
  • the system of the present invention may further be adapted to provide an output suitable for a display.
  • a display screen may be provided as part of the system or may be extrinsic - for example provided by a viewer connected remotely to the system of the present invention.
  • a possible further use of the present invention may be to provide a graphical representation of a recent movement path of the marker within the field of view. For example, as a marker moves within the field of view, such a movement path may be graphically represented as a trail on a display apparatus. In such a way, a display of an event in progress may be augmented. Thus, a viewer of an event in progress may be able to follow the event more fully. This may be especially useful in a fast-moving sport such as hockey, wherein the“puck” may be provided with a trail on a display screen to allow viewers to keep track of the game as it occurs.
  • Figure 1 shows an extract from a display image 100 showing a portion of a hockey pitch 102.
  • a puck 104 is moving across the pitch 102.
  • the system adds a graphical trail 106 to the display image 100.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Image Analysis (AREA)

Abstract

L'invention concerne un système destiné à enregistrer des informations concernant des événements, dans lequel au moins une source d'image est conçue pour fournir une série d'images photographiques d'un champ de vision à une unité de traitement, l'unité de traitement est conçue pour identifier et localiser un marqueur dans une ou plusieurs images photographiques fournies à celle-ci et pour fournir un emplacement dudit marqueur par rapport au champ de vision, et l'unité de traitement est en outre conçue pour dériver et enregistrer une traduction dudit marqueur dans le champ de vision entre deux images ou plus comprenant ladite série d'images.
PCT/EP2018/084135 2017-12-12 2018-12-10 Appareil et procédé d'interprétation de séquences d'images WO2019115445A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP18826977.3A EP3724851A1 (fr) 2017-12-12 2018-12-10 Appareil et procédé d'interprétation de séquences d'images

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB1720652.5 2017-12-12
GBGB1720652.5A GB201720652D0 (en) 2017-12-12 2017-12-12 Apparatus and method for interpreting image sequences

Publications (1)

Publication Number Publication Date
WO2019115445A1 true WO2019115445A1 (fr) 2019-06-20

Family

ID=61007315

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2018/084135 WO2019115445A1 (fr) 2017-12-12 2018-12-10 Appareil et procédé d'interprétation de séquences d'images

Country Status (3)

Country Link
EP (1) EP3724851A1 (fr)
GB (1) GB201720652D0 (fr)
WO (1) WO2019115445A1 (fr)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001041884A1 (fr) 1999-12-10 2001-06-14 Roke Manor Research Limited Processeurs vidéo pour poursuite de balle dans un jeu de balle

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001041884A1 (fr) 1999-12-10 2001-06-14 Roke Manor Research Limited Processeurs vidéo pour poursuite de balle dans un jeu de balle

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
LAGE MARCOS ET AL: "StatCast Dashboard: Exploration of Spatiotemporal Baseball Data", IEEE COMPUTER GRAPHICS AND APPLICATIONS, IEEE SERVICE CENTER, NEW YORK, NY, US, vol. 36, no. 5, 1 September 2016 (2016-09-01), pages 28 - 37, XP011624055, ISSN: 0272-1716, [retrieved on 20160928], DOI: 10.1109/MCG.2016.101 *
TAKAHASHI MASAKI ET AL: "Real-Time Ball Position Measurement for Football Games Based on Ball's Appearance and Motion Features", 2015 11TH INTERNATIONAL CONFERENCE ON SIGNAL-IMAGE TECHNOLOGY & INTERNET-BASED SYSTEMS (SITIS), IEEE, 23 November 2015 (2015-11-23), pages 287 - 294, XP032860715, DOI: 10.1109/SITIS.2015.46 *

Also Published As

Publication number Publication date
EP3724851A1 (fr) 2020-10-21
GB201720652D0 (en) 2018-01-24

Similar Documents

Publication Publication Date Title
JP6580045B2 (ja) 映像制作物を作るための方法及びシステム
RU2498404C2 (ru) Способ и устройство для генерирования регистрационной записи события
GB2575843A (en) Method and system for generating an image
US8675021B2 (en) Coordination and combination of video sequences with spatial and temporal normalization
US20180137363A1 (en) System for the automated analisys of a sporting match
US8538233B2 (en) Automatic camera identification from a multi-camera video stream
WO2002071334A2 (fr) Procédé et système d'analyse pour le sport
Chowdhury et al. Application of computer vision in cricket: Foot overstep no-ball detection
JP6030072B2 (ja) 動くオブジェクトの動きベクトルに基づく比較
KR20000064088A (ko) 스포츠 영상 분석 방송 시스템 및 방법
US20220292766A1 (en) Three-dimensional rendering of sporting event from two-dimensional video stream
WO2019115445A1 (fr) Appareil et procédé d'interprétation de séquences d'images
CN114302234B (zh) 一种空中技巧快速包装方法
AU2007237231B2 (en) Player Position Validation Interface
EP2943934B1 (fr) Procédé d'enregistrement et de reproduction d'une suite d'événements
GB2589904A (en) A device, computer program and method
Xie et al. Object tracking method based on 3d cartoon animation in broadcast soccer videos
Chao et al. 3D ball trajectory reconstruction of a ballistic shot from a monocular basketball video
AU2015101938A4 (en) Assessment of sporting incidents
Gade et al. The (Computer) Vision of Sports: Recent Trends in Research and Commercial Systems for Sport Analytics
Goenetxea et al. Capturing the sporting heroes of our past by extracting 3D movements from legacy video content
WO2019115441A1 (fr) Caméras et leurs agencements
Koch et al. Evaluation of visual position estimation in beach volleyball.
Ishii et al. Image Analysis Technologies to Realize “Dream Arenas”
DE102020117372A1 (de) Verfahren und System zur automatischen Analyse von Sportveranstaltungen

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18826977

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2018826977

Country of ref document: EP

Effective date: 20200713