WO2013030634A4 - Virtual advertising platform - Google Patents

Virtual advertising platform Download PDF

Info

Publication number
WO2013030634A4
WO2013030634A4 PCT/IB2012/000363 IB2012000363W WO2013030634A4 WO 2013030634 A4 WO2013030634 A4 WO 2013030634A4 IB 2012000363 W IB2012000363 W IB 2012000363W WO 2013030634 A4 WO2013030634 A4 WO 2013030634A4
Authority
WO
WIPO (PCT)
Prior art keywords
dimensional
data feed
digital video
digital
image
Prior art date
Application number
PCT/IB2012/000363
Other languages
French (fr)
Other versions
WO2013030634A1 (en
Inventor
Karel Paul STEPHAN
Original Assignee
Rocks International Group Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from GBGB1114938.2A external-priority patent/GB201114938D0/en
Priority claimed from GBGB1119612.8A external-priority patent/GB201119612D0/en
Priority claimed from US13/405,015 external-priority patent/US9013553B2/en
Priority to EP12708388.9A priority Critical patent/EP2751782A1/en
Priority to CN201280052863.2A priority patent/CN103907137A/en
Priority to JP2014527750A priority patent/JP2014532202A/en
Priority to KR1020147008559A priority patent/KR20140061481A/en
Application filed by Rocks International Group Pte Ltd filed Critical Rocks International Group Pte Ltd
Priority to TW101107936A priority patent/TW201310986A/en
Publication of WO2013030634A1 publication Critical patent/WO2013030634A1/en
Publication of WO2013030634A4 publication Critical patent/WO2013030634A4/en
Priority to IN2368/CHENP/2014A priority patent/IN2014CN02368A/en
Priority to HK14113107.7A priority patent/HK1199533A1/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2021—Shape modification

Abstract

In embodiments, a virtual advertising platform may use a three- dimensional mapping algorithm to insert a virtual image within a digital video stream. The virtual advertising platform may apply a three-dimensional mapping algorithm to the virtual digital image, wherein the three-dimensional mapping algorithm causes the virtual digital image to be recomposited within a plurality of frames within a received two-dimensional digital data feed in place of a spatial region within the two- dimensional data feed. The mapping algorithm may enable application of analogous geometric changes to the virtual digital image that are present in the spatial region within the plurality of video frames within the two-dimensional digital video data feed, and may send the recomposited digital data feed for display to a user, wherein the recomposited digital data feed is a virtualized digital data feed that includes the virtual digital image in place of the spatial region.

Claims

38 AMENDED CLAIMS received by the International Bureau on 25 March 2013 (25.03.2013).
1. A system for using three-dimensional simulation to quantify the spatial alteration of a region of a two-dimensional digital video image caused by movement of the region between a first and a second video frame, the system comprising a computer having a non-transitory computer readable medium having stored thereon instructions which, when executed by a processor of the computer, causes the processor to perform the steps of:
receiving a request from a user to view a two-dimensional digital video data feed from the Internet;
receiving a two-dimensional digital video data feed from the Internet;
constructing a three-dimensional simulation of the two-dimensional digital video data feed within a simulation environment based at least in part on applying geometric surfaces over a plurality of spatial regions within frames of the two-dimensional digital video data feed, wherein the plurality of spatial regions are defined at least in part by a coordinate mapping of the two-dimensional digital video data feed;
mapping a spatial region, among the plurality of spatial regions, within a first video frame to the spatial region's location with a second video frame, wherein the second video frame was captured in a time subsequent to the first frame, by performing the steps of:
Step One: selecting the spatial region within the a first video frame based at least in part on mapping coordinates of the spatial region within the two-dimensional video data feed;
Step Two: identifying geometric changes to the spatial region within preceding and subsequent video frames by quantifying the differences between the applied geometric surfaces of the spatial region within the first video frame and the applied geometric surfaces in the preceding and subsequent video frames; and
Step Three: summarizing the quantified differences as a three-dimensional mapping metric; iteratively processing each of a plurality of video frames within the two-dimensional digital video feed by performing Steps One, Two, and Three to create a plurality of three-dimensional mapping metrics; and further comprising: summarizing quantitative associations among the plurality of three-dimensional mapping metrics as a three-dimensional mapping algorithm, wherein the three-dimensional mapping algorithm defines at least in part three-dimensional geometric position data that enables application of geometric changes to the spatial region inherent in the plurality of video frames to a virtual digital video image that is not present in the two-dimensional digital video data feed.
2. Further comprising the system of claim 1, wherein the virtual digital video image is an advertisement that is inserted into the spatial region of the two-dimensional digital data feed, replacing the spatial region, and the two-dimensional digital video image is recomposited as a new virtual digital video feed.
3. The system of claim 1, wherein the virtual digital image is altered to include elements of the frame and at least one additional effect selected from the group consisting of a lighting effect, a shadow effect and a specular effect .
4. The system of claim 1, wherein the digital video feed is received from a live event.
5. The system of claim 1, wherein the digital video feed is received from a stored digital video medium.
6. The system of claim 1, wherein the spatial region comprises a heterogeneous region with a characteristic structure.
7. The system of claim 1, wherein the locations of the spatial regions are encoded in metadata for the two-dimensional digital video data feed.
8. The system of claim 8, wherein the selection of the spatial region is further based on a correlation between mapping coordinates of the spatial region with a known spatial characteristic that is stored within a data facility that is associated with the three-dimensional simulation environment.
9. The system of claim 8, wherein the known spatial characteristic is an advertising logo.
10. The system of claim 8, wherein the known spatial characteristic is on an article of clothing.
11. A system for using a three-dimensional mapping algorithm to insert a virtual image within an internet-based video stream, the system comprising a computer having a non-transitory computer readable medium having stored thereon instructions which, when executed by a processor of the computer, causes the processor to perform the steps of:
receiving a request from a user to view a two-dimensional digital video data feed from the Internet;
selecting a virtual digital image;
applying a three-dimensional mapping algorithm to the virtual digital image, wherein the three- dimensional mapping algorithm causes the virtual digital image to be recomposited within a plurality of frames within the two-dimensional digital data feed in place of a spatial region within the two- dimensional data feed, and wherein the three-dimensional mapping algorithm enables application of analogous geometric changes to the virtual digital image that are present in the spatial region within the plurality of video frames within the two-dimensional digital video data feed; and
sending the recomposited digital data feed for display to the user, wherein the recomposited digital data feed is a virtualized digital data feed that includes the virtual digital image in place of the spatial region.
12. The system of claim 11, wherein the request is accompanied by at least one datum relating to a characteristic of the user and the selection of the virtual digital image is based at least in part on a relevance to the datum.
13. The system of claim 12, wherein the spatial region comprises a heterogeneous region.
14. The system of claim 12, wherein the virtual digital image is an advertising logo that is relevant to at least a portion of the two-dimensional digital video feed.
15. The system of claim 14, wherein the virtual digital image is altered to include an additional effect selected from the group consisting of a specular effect, a lighting effect and a shadow effect.
16. The system of claim 11, wherein a location of the spatial region is encoded in metadata for the two- dimensional digital video data feed.
17. The system of 16, further comprising using the metadata to determine the location of the spatial region in the recomposited digital data feed for display to the user.
18. A system for using a three-dimensional mapping algorithm to insert a virtual image within a two- dimensional digital video feed to interpolate video data to replace corrupted digital video data, the system comprising a computer having a non-transitory computer readable medium having stored thereon instructions which, when executed by a processor of the computer, causes the processor to perform the steps of:
receiving a request from a user to view a two-dimensional video data feed from the Internet; receiving a two-dimensional digital video data feed from the Internet, wherein a spatial region within the plurality of frames within the two-dimensional video data feed includes a partial depiction of an advertisement due to corrupted digital video data;
using an image metrics algorithm to compute a relevance of uncorrupted digital video data within the spatial region to a set of stored digital video images;
identifying a stored digital video image based at least in part on the computed relevance;
selecting a virtual digital image based at least in part on the identified stored digital video image;
applying a three-dimensional mapping algorithm to the virtual digital image, wherein the three- dimensional mapping algorithm causes the virtual digital image to be recomposited within a plurality of frames within the two-dimensional digital data feed in place of the spatial region within the two- dimensional data feed, and wherein the three-dimensional mapping algorithm enables application of analogous geometric changes to the virtual digital image that are present in the spatial region within the plurality of video frames within the two-dimensional digital video data feed; and 42
sending the recomposited digital data feed for display to a user, wherein the recomposited digital data feed is a virtualized digital data feed that includes the virtual digital image in place of the spatial region.
19. Further comprising the system of claim 18, wherein the virtual digital image is a completed version of the partial image, wherein the virtual digital image is created based at least in part on interpolated digital video data using the stored digital video image.
20. The system of claim 18, wherein the corrupted digital video data is caused at least in part by a physical deformation of an object depicted within the two-dimensional digital video data feed.
PCT/IB2012/000363 2011-08-31 2012-02-27 Virtual advertising platform WO2013030634A1 (en)

Priority Applications (7)

Application Number Priority Date Filing Date Title
EP12708388.9A EP2751782A1 (en) 2011-08-31 2012-02-27 Virtual advertising platform
CN201280052863.2A CN103907137A (en) 2011-08-31 2012-02-27 Virtual advertising platform
JP2014527750A JP2014532202A (en) 2011-08-31 2012-02-27 Virtual advertising platform
KR1020147008559A KR20140061481A (en) 2011-08-31 2012-02-27 Virtual advertising platform
TW101107936A TW201310986A (en) 2011-08-31 2012-03-08 Virtual advertising platform
IN2368/CHENP/2014A IN2014CN02368A (en) 2011-08-31 2014-03-28 Virtual advertising platform
HK14113107.7A HK1199533A1 (en) 2011-08-31 2014-12-31 Virtual advertising platform

Applications Claiming Priority (8)

Application Number Priority Date Filing Date Title
GB1114938.2 2011-08-31
GBGB1114938.2A GB201114938D0 (en) 2011-08-31 2011-08-31 The Chameleon project
SG2011066339A SG188016A1 (en) 2011-08-31 2011-09-14 The chameleon project
SG201106633-9 2011-09-14
GBGB1119612.8A GB201119612D0 (en) 2011-11-14 2011-11-14 The chameleon project
GB1119612.8 2011-11-14
US13/405,015 2012-02-24
US13/405,015 US9013553B2 (en) 2011-08-31 2012-02-24 Virtual advertising platform

Publications (2)

Publication Number Publication Date
WO2013030634A1 WO2013030634A1 (en) 2013-03-07
WO2013030634A4 true WO2013030634A4 (en) 2013-05-23

Family

ID=48482163

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2012/000363 WO2013030634A1 (en) 2011-08-31 2012-02-27 Virtual advertising platform

Country Status (7)

Country Link
EP (1) EP2751782A1 (en)
JP (1) JP2014532202A (en)
KR (1) KR20140061481A (en)
CN (1) CN103907137A (en)
HK (1) HK1199533A1 (en)
TW (1) TW201310986A (en)
WO (1) WO2013030634A1 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9013553B2 (en) 2011-08-31 2015-04-21 Rocks International Group Pte Ltd. Virtual advertising platform
US10664687B2 (en) * 2014-06-12 2020-05-26 Microsoft Technology Licensing, Llc Rule-based video importance analysis
CN116883521A (en) * 2015-12-14 2023-10-13 松下电器（美国）知识产权公司 Three-dimensional data encoding method, decoding method, encoding device, and decoding device
US10489979B2 (en) * 2016-12-30 2019-11-26 Facebook, Inc. Systems and methods for providing nested content items associated with virtual content items
TWI669661B (en) * 2017-06-08 2019-08-21 合盈光電科技股份有限公司 People Statistics System
KR101966384B1 (en) * 2017-06-29 2019-08-13 라인 가부시키가이샤 Method and system for image processing
CN110309214B (en) * 2018-04-10 2023-06-23 腾讯科技（深圳）有限公司 Instruction execution method and equipment, storage medium and server thereof
US11605227B2 (en) * 2018-09-04 2023-03-14 Pandoodle Corporation Method and system for dynamically analyzing, modifying, and distributing digital images and video
TWI701642B (en) * 2019-04-25 2020-08-11 國立臺北大學 Virtual advertisement replacing method and electronic device

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8572639B2 (en) * 2000-03-23 2013-10-29 The Directv Group, Inc. Broadcast advertisement adapting method and apparatus
US7206434B2 (en) * 2001-07-10 2007-04-17 Vistas Unlimited, Inc. Method and system for measurement of the duration an area is included in an image stream
JP2006014200A (en) * 2004-06-29 2006-01-12 Nomura Research Institute Ltd Advertisement video embedding system
US20060244757A1 (en) * 2004-07-26 2006-11-02 The Board Of Trustees Of The University Of Illinois Methods and systems for image modification
JPWO2006103955A1 (en) * 2005-03-29 2008-09-04 パイオニア株式会社 Advertisement display device, advertisement display method, and advertisement display program
US7994930B2 (en) * 2006-10-30 2011-08-09 Sony Ericsson Mobile Communications Ab Product placement
GB0809631D0 (en) * 2008-05-28 2008-07-02 Mirriad Ltd Zonesense
US20110107368A1 (en) * 2009-11-03 2011-05-05 Tandberg Television, Inc. Systems and Methods for Selecting Ad Objects to Insert Into Video Content

Also Published As

Publication number Publication date
EP2751782A1 (en) 2014-07-09
JP2014532202A (en) 2014-12-04
CN103907137A (en) 2014-07-02
KR20140061481A (en) 2014-05-21
TW201310986A (en) 2013-03-01
HK1199533A1 (en) 2015-07-03
WO2013030634A1 (en) 2013-03-07

Similar Documents

Publication Publication Date Title
WO2013030634A4 (en) Virtual advertising platform
US20230274510A1 (en) Augmented reality content rendering via albedo models, systems and methods
JP2022524683A (en) Systems and methods for rendering real-world objects using depth information
KR20220009393A (en) Image-based localization
US10223839B2 (en) Virtual changes to a real object
US20160142644A1 (en) Surveillance systems and image processing methods thereof
US20150062010A1 (en) Pointing-direction detecting device and its method, program and computer readable-medium
JP2019503528A5 (en)
JP2014123376A5 (en)
US10943365B2 (en) Method and system of virtual footwear try-on with improved occlusion
WO2012155279A3 (en) Silhouette-based pose estimation
CN110555358A (en) method and apparatus for detecting and identifying features in an AR/VR scene
JP2013242757A5 (en)
JP2016514865A (en) Real-world analysis visualization
CN111868738B (en) Cross-device monitoring computer vision system
JP2012238041A5 (en)
CN114329747A (en) Building digital twin oriented virtual and real entity coordinate mapping method and system
US11847552B2 (en) Pipeline with processor including neural network for rendering artificial reality
US20170330384A1 (en) Product Image Processing Method, and Apparatus and System Thereof
JP2016105279A (en) Device and method for processing visual data, and related computer program product
US20170363936A1 (en) Image processing apparatus, image processing method, and program
WO2006115716A3 (en) System and method of visible surface determination in computer graphics using interval analysis
JP2019512781A (en) Method for reconstructing 3D multi-viewpoint by feature tracking and model registration.
JP2017512997A5 (en)
US20190197700A1 (en) Systems and methods to track objects in video

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12708388

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase in:

Ref document number: 2014527750

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase in:

Ref country code: DE

ENP Entry into the national phase in:

Ref document number: 20147008559

Country of ref document: KR

Kind code of ref document: A