WO2018065549A1 - Appareil, dispositif, système, et procédé - Google Patents

Appareil, dispositif, système, et procédé Download PDF

Info

Publication number
WO2018065549A1
WO2018065549A1 PCT/EP2017/075416 EP2017075416W WO2018065549A1 WO 2018065549 A1 WO2018065549 A1 WO 2018065549A1 EP 2017075416 W EP2017075416 W EP 2017075416W WO 2018065549 A1 WO2018065549 A1 WO 2018065549A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
client device
content
marker
program elements
Prior art date
Application number
PCT/EP2017/075416
Other languages
English (en)
Inventor
Andrew Graham
Ariff QULI
Dana SOLTANI
Vikrum JOSHI
Patrick HILLER
Michael Harris
Brian MORALES
Ryan Schmaltz
Original Assignee
Blippar.Com Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Blippar.Com Limited filed Critical Blippar.Com Limited
Publication of WO2018065549A1 publication Critical patent/WO2018065549A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440245—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4318—Generation of visual interfaces for content selection or interaction; Content or additional data rendering by altering the content in the rendering process, e.g. blanking, blurring or masking an image region
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/4508—Management of client data or end-user data
    • H04N21/4516—Management of client data or end-user data involving client characteristics, e.g. Set-Top-Box type, software version or amount of memory available
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8166—Monomedia components thereof involving executable data, e.g. software
    • H04N21/8193—Monomedia components thereof involving executable data, e.g. software dedicated tools, e.g. video decoder software or IPMP tool

Definitions

  • the present invention relates to an apparatus, device, system and method for providing specific data to a client device dependent on sensed input to the device.
  • embodiments of the present invention relate to delivering augmented reality content to a client device dependent on an image in a camera feed of the client device.
  • an advertisement hereinafter also referred to as an "ad”, “advert” or “AD"
  • an “application” also termed hereinafter “app”
  • the webpage or mobile device app sends a request to an ad server to serve an ad to it.
  • Serving an ad in this sense means sending an actual picture or video making up the ad, i.e. what the viewer sees as the ad and also termed the "creative", back to the web page or mobile app before the web page fully loads on the device or into the application.
  • the webpage or mobile app supplies a number of data points to the ad server. These might include any one or more of the following non-exhaustive list:
  • IDFA Android Advertising ID
  • IDFA is a so-called Advertising Identifier which is a unique identity for each device running an iOS operating system. Such information may be referred to as client metadata as it concerns information relating to a client device and its use.
  • client metadata Such information may be referred to as client metadata as it concerns information relating to a client device and its use.
  • the ad server Based on one or more of the data points, the ad server identifies an advertiser from a pool of advertisers who are interested to show an ad to the device corresponding to the data. In an automated programmatic model this is done based on some form of a second price auction. Once the ad server decides which advertiser gets the ad opportunity, a corresponding creative is sent to the web page or mobile app. The web page or mobile app displays the creative to the user thereby effecting service of the ad.
  • HTML5/JavaScript based creative instead of a simple static image or video file. This is the basis of the interactive ads.
  • the HTML5/JavaScript creative is a self-contained unit that can render itself inside the container on the page or inside the mobile app. There is no additional input needed.
  • the present invention provides a server apparatus, comprising a processor resource and a memory comprising program elements operative to configure said processor to control said server apparatus to:
  • an AR initiate instruction to AR player program elements loaded onto a client device to initiate rendering of said AR content over said marker in a camera feed.
  • the present invention provides a method of operating a server, comprising:
  • Embodiments in accordance with first and or second aspects of the present invention provides for the delivery and execution of augmented reality (AR) advertisements to enhance the interactive use of a client device without the client device having to be pre- configured for augmented reality advertisement delivery.
  • the marker is an image of something associated with the content subject and or AR content, the AR content being appropriate for rendering, in particular 3-D-rendering, over the marker in the camera feed.
  • said image is transmitted over a communications network to an image recognition server apparatus to implement said image recognition to determine said presence of said marker in said image and receive a message indicative of said marker present in said image.
  • Transmitting the image to an image recognition server avoids the need to implement image recognition functionality on a server functioning as an augmented reality advertisement server.
  • image recognition may be centralised and in particular a specialist image recognition service may be utilised.
  • image recognition functionality may be implemented on server apparatus itself.
  • plural images from a camera feed are received by the server apparatus and determination of the presence of a marker is carried out for each of the more than one image.
  • plural images are transmitted over a communications network to an image recognition server apparatus to implement said image recognition to determine said presence of said marker in said plural images and receive a message indicative of said marker present in said plural images.
  • the server apparatus may be configured to receive a message from AR player program elements loaded onto a client device indicative of access permitted to a camera feed.
  • the AR player program itself may determine whether or not access to the camera feed is permitted and relay the result to the server.
  • non-AR content corresponding to said content subject may be transmitted to a client device for display via a display controller on a screen of a client device in the event that access to the camera feed is not permitted.
  • an ad may be served to a client device even though an AR operation is not possible.
  • the AR content that is sent to the device may be determined by detection of a specific marker from said camera feed of the said device.
  • the said image recognition server might be capable of identifying a very large number of said markers or real-world objects and the AR advertisement may be dynamically adjusted to what is being viewed through said device camera feed.
  • the server apparatus may be distributed over a communications network which utilises available server resource and also provides an element of redundancy in the event that there is a failure of any one or more physical devices.
  • said AR player program elements, image recognition and AR content are hosted on separate servers in order to take advantage of specific configurations and architecture is suitable for respective functions. For example, certain functions may require a large amount of memory or the ability to download large amounts of data and therefore require large bandwidth.
  • said AR player program elements and AR content may be comprised in a single or multiple files.
  • the server apparatus is configured to receive data indicative of interaction with said AR content, said interaction through said client device. In this way, appropriate user metrics may be received processing the success or not of a particular advertising campaign for example.
  • the server apparatus will receive one or more tracking pixels.
  • the present invention provides a client device, comprising:
  • a memory comprising program elements operative to configure said processor to control said device to:
  • the present invention provides a method for operating a client device, comprising:
  • Embodiments in accordance with the third and or fourth aspects of the present invention provide a client device environment in which augmented reality content such as augmented reality advertisements may be executed without any native or preconfigured software been loaded onto the client device.
  • augmented reality content such as augmented reality advertisements
  • any application running on a mobile client device may call an augmented reality ad server to implement the third and/or fourth aspect of the present invention.
  • the client device determines if access is permitted to said camera feed and initiates a request to receive said AR content if access is permitted to said camera feed.
  • AR content is only downloaded if it can be utilised. This saves on the use of bandwidth and also does not incur processing on the client device for something which may not be capable of being utilised.
  • the client device transmits device metadata indicative of the AR content handling capability of said device.
  • the client device may identify its functions, utilities and permissions utilising generally widely recognised data.
  • first, second, third and/or fourth aspects of the present invention may be implemented by way of a computer program, such a computer program is typically provided on a carrier medium.
  • Carrier media may be a different type but can include at least one of the following: a radio frequency signal, an optical signal, an electronic signal, a magnetic disc or tape, solid state memory, an optical disc, a magneto-optical disc, a computer disc, digital versatile disc and a blue-ray disc.
  • FIG. 1 illustrates a block diagram of an affinity server and data entities in accordance with an embodiment of the invention
  • FIG. 2 illustrates a block diagram of a communications device and network elements in accordance with an embodiment of the invention.
  • Figure 3 is a process control flow diagram for a system in accordance with the present invention. Description
  • an ad server decides to send an augmented reality (AR) creative in accordance with an embodiment of the present invention to a web page or application running on a mobile device
  • AR augmented reality
  • the content that is finally displayed to an ad viewer is not fully determined at the time the decision as to which creative to send is made.
  • the interaction of a user of a device on which the ad is viewed with the ad will depend on an extra sensory input: in the described embodiment - what is in the camera feed from the device camera lens.
  • the AR creative is sent to the user device and is configured to establish if it has access to the camera feed from the device camera. Not every browser on every Operating System (OS) allows access to the camera feed on a device. Also, not every mobile app has access to the camera feed. For example, a weather app probably does not have access to the mobile device camera feed but the photograph app does.
  • OS Operating System
  • a “container” may be considered to be an application program or subsystem in which the program building block typically known as a component is run, such as an iframe in an HTML document. If explicit user permission is needed to capture the camera feed, the AR creative displays on the display screen of the device a so-called “call to action".
  • the "call to action” could be an animation, video or a static image asking or informing a user to click or tap it to launch the AR ad.
  • an image from it is sent to an image recognition service (configured as an Application program Interface (API)) every couple of seconds or so.
  • API Application program Interface
  • the image recognition service identifies real world objects in an image supplied through the camera feed, for example, a logo, a face, a flower, a building, or a car of a specific make and model.
  • the ad experience is scripted to begin when a specific marker is identified in the camera feed such as a brand logo or a human face.
  • the AR content of the creative is downloaded and rendered over it creating an augmented reality experience.
  • network bandwidth is or may be limited, AR content might be downloaded prior to recognition of the marker.
  • This concept can be applied not only to existing mobile devices such as smartphones and tablets but also wearables that get a constant camera feed (e.g. so called smart glasses).
  • Figure 1 illustrates a network architecture 50 comprising an ad server 52 which may communicate with image recognition server 76 for recognition of objects in an image provided to it and a client device 100, such as a computing device or mobile device such as a smartphone, via a network 101.
  • a client device 100 such as a computing device or mobile device such as a smartphone
  • Other 3 rd party ad servers, 74 may also be able to communicate with ad server 52 to provide support services or operate independently thereof.
  • the network comprises content server 77 which provides augmented reality content and is accessible over a network 101 by advertisement servers 74 and 52, and client device 100.
  • the ad server 52 is a server dedicated to managing the delivery of AR ads to client devices 100.
  • the ad server 52 includes an ad server computing system 20 comprising a server network interface which communicates with clients over HTTP or HTTPS protocol 54; a server processor resource 56; and an interface module 58 for communication with an Ad operations manager or technician operating the ad server 52.
  • the ad server computing system 20 also includes memory 62 for storing program elements and data to implement various modules for storing data and content.
  • Memory 62 includes ad server management module 64 for managing serving requests for ads, determining which ad to transmit to a client and generally controlling the operation of server 52.
  • the ad server computing system 20 also comprises an AR content management module 66, comprising program elements for configuring processing resource 56 to manage requests and data received by the ad server 52 from a client device 100 and also transmit data and content to a requesting client device 100.
  • AR content management module 66 also includes program instructions operative when executed to provide overall management of the application and call respective modules as and when required, and in particular to deliver the right version of AR player and content when requested by client device 100 or client interface. Additionally, such instructions may also be input and output through the user interface 58.
  • AR content is stored in module 70 of memory store 62.
  • the various modules and resources of ad server computing system 20 communicate over bus 60.
  • Memory store 62 also comprises general memory, not shown, in which various data and information may be stored. For example, in accordance with an embodiment of the present invention a list of client device identities of client devices that allow access to their camera feed is stored. Inspection of such a list allows early determination of whether or not an augmented reality content element may be utilised by a client device 100.
  • the servers 52, 74, 76 and 77 are merely illustrative and other servers and network coupled devices may also communicate with the device 100 and server 52.
  • references to a network and communication made above should be construed broadly to include many types of network and networks of networks, including the public service telephone network where appropriate, cable systems, wireless networks and the Internet.
  • FIG. 2 illustrates a block diagram of communications device 100, according to one embodiment.
  • the communications device 100 is connectable via network connection 1 13 over a communications network 101 to a number of servers 52, 74 and 76.
  • the communications device 100 includes a computer memory 103, a processor 104, an RF (Radio Frequency) interface 105, a screen 106, a keyboard 107, a microphone 108 a speaker 109, a Bluetooth interface 1 10, an infrared interface 1 1 1 , connectors 1 12, a network interface 1 13, a digital camera 122 and a data bus 125.
  • RF Radio Frequency
  • a number of application programs 1 14 are stored in computer memory 103. Respective contacts databases 1 15 of the communication application programs 1 14 store details of the contacts that are associated with the respective communications application programs.
  • a communications application program 1 14 corresponding to an email mode of communication would include a contact database consisting of email addresses and contact identifiers.
  • the ad container 123 resides in one or more of the application programs 1 14.
  • the ad container communicates with the Ad server 74 through a communications interface 120 which is provided by the application program 1 14 or operating system of the client device 100.
  • Ad container 123 initiates an Ad request to the Ad server 74 for the download of an AR creative unit 1 18 which includes AR Player 1 18a.
  • the Ad request may be redirected to AR content distribution server 52.
  • AR Player 1 18a is configured to communicate with camera feed 121 and provide images from camera feed 121 to image recognition server 76.
  • AR player 1 18 also includes a 3D rendering engine which can render 3D AR content 1 19 on camera feed 121 when AR player 1 18a downloads 3D AR content from AR content distribution server 52 to ad container 123.
  • AR creative unit 1 8 comprises computer program elements, such as instructions, executable by processor resource 104 to configure it to perform the various functions and activities inside ad container 123 such as the capturing camera feed 12, 3D rendering 1 18b and communicating with Ad server 74, AR content distribution server 52 and image recognition server 74 through a communications interface 120 provided by the client device operation system.
  • a key handler 1 16 comprising a software module configured to respond to keyboard 1 10 generated events.
  • the key handler 1 6 provides appropriate inputs to the applications 1 14 and to a control module 1 17 that provides overall control of the processes leading to initiation of one or more applications 1 14 and ad containers 123.
  • the AR content relates to an interactive advertisement ("ad").
  • a client device 100 initiates a request, step 306, for an advertisement from within an application or web browser in accordance with the way in which the application is being executed or web page is being displayed by the web browser.
  • the request is communicated through network interface 1 13 and over communication network 101.
  • Client metadata usually accompanies such a request.
  • ad server management module 64 configures processor 56 to inspect the list of device identities known to provide access to the camera feed and stored in memory 62. If the decision, step 310, is "No" then process control flows to step 312 at which point the ad server management module 64 configures processor 56 to access a store of non-augmented reality advertisements and select one in accordance with the client metadata and/or other criteria for transmission through network interface 54 to client device 100.
  • Client device 100 receives the non-augmented reality advertising through network interface 1 13 and communication interface 120, and control module 1 17 configures processor 104 to display the non-augmented reality advertisement directly on the display screen 106, step 314.
  • process control flows to step 316 where ad server management module 64 is invoked which configures processor 56 to apply an advertisement selection procedure to determine which one of augmented reality (AR) advertisements stored AR content 70 is to be supplied to client device 100.
  • AR augmented reality
  • the client metadata may be utilised in the selection procedure to determine which AR advertisement is selected.
  • the AR advertisement may be created by a scripting language such as Blippar Augmented Reality Developer API which is available through https://blippar.com/en/products/augmented-reality-api.
  • the AR advertisement is optimized for serving as a rich media advertisement unit in accordance with the ad industry guidelines such as IAB HTML5 for Digital Advertising Guidelines.
  • the AR advertisement is hosted on server 52, which may be termed an advertisement server in that it handles requests for advertisements.
  • the AR advertisement zip file may be retrieved from a third party content distribution server 77.
  • Respective AR advertisements have a public URL which may be used to access it for downloading.
  • ad server management module 64 configures processor resource 56 to identify an AR player compatible with the identified client device 100 from the AR content module 70 and transmit computer program elements for that AR player or its public address to client device 100 through the client interface 54 and over network 101.
  • AR player 1 18a is based on HT L5 and JavaScript and follows IAB HTML5 for Digital Advertising Guidelines.
  • client device 100 receives the AR player program elements and stores them in the device as appropriate.
  • Process control for client device 100 then flows to step 322 at which the AR player 1 18a determines whether or not access is granted to the camera feed 121 for the camera 122 of client device 100. If the decision at step 324 is that access is denied to camera feed 121 AR player 1 18 a configures processor resource 104 to initiate a request for a non-augmented reality advertisement through communication interface 120 and network interface 1 13 to server 52 over network 101.
  • step 328 AR creative 1 18 configures processor resource 104 to transmit a request through communication interface 120, network interface 1 13 and over network 101 to server 52 for an AR advertisement.
  • the request for the AR advertisement is received at server 52, step 330 and ad server management module 64 configures processor resource 56 to transmit the AR advertisement selected from the AR content 70 at step 316 through API 54 over network 101 to client device 100.
  • client device 100 receives the augmented reality advertisement content and stores it locally on the device 100.
  • Process control for client device 100 then flows to step 336 at which AR player 1 18a configures processor resource 104 to capture images from camera feed 121 and transmit them through communication interface 120 and network interface 1 13 across network 101 to an image recognition service such as provided by image recognition server 76.
  • server 76 receives images and is configured to determine the presence of a marker image in the images received from client device 100.
  • the image recognition service such as image recognition server 76 transmits a message to client device 100 over network 101 to notify AR player 1 18a of the decision.
  • AR player 1 18a continues to capture consecutive images from camera feed 121 and transmit them through communication API 120 and network interface 1 13 across network 101 to image recognition server 76 until a marker image is positively identified in the image.
  • a user has control over their interaction with the AR advertisment and can terminate that interaction at any time. Using and advertisement for a wristwatch as an example; if a user initiates an AR advertisement by tapping on a "call to action" image while pointing to or then points the device camera to the sky or other space empty of a suitable marker, nothing will happen.
  • step 340 the decision at step 340 is "No"
  • step 336 the further images are sent from the camera feed to the server.
  • step 346 then step 342 provides a "Yes" decision and process control flows to step 354 where the process is stopped.
  • the marker image may be something that is recognised as being something the AR player can render AR content over.
  • the image recognition service e.g. image recognition server 76 notifies AR player 1 18a over network 101 of the presence of a marker image in the images provided to the server 76.
  • AR player 1 18a configures processor resource 104 to invoke 3D rendering engine 1 18b which configures processor resource 104 to render AR advertisement content over the marker present in camera feed 121. In this way, 3D contents in the AR advertisement can be placed within the image seen through the client device camera 122.
  • 3D rendering engine 1 18b may render a 3D image of the wristwatch over the image of the human wrist within the camera feed 121 and show various perspectives and views of the wristwatch as the human wrist is moved.
  • one or more marker images are defined for a particular AR advertisement and acts as a trigger to invoke 3D rendering of the AR content of an AR ad over that marker image in the camera feed.
  • a suitable message or dialogue box may be displayed instructing the user to view a particular item in order to capture an appropriate marker image in the image feed in order to initiate 3D rendering of the AR content.
  • client device 100 monitors user activity during playing of the AR advertisement reports various tracking metrics up to server 52, which receives the tracking metrics report, step 352, and stores it or forward it to appropriate storage location or entity for further processing.
  • 3D rendering engine 1 18b may be built based on any suitable 3D rendering program or software.
  • the 3D rendering engine is based on WebGL or web graphic library or other suitable 3D rendering engine.
  • the AR player instructs processor resource 104 to fire custom tracking pixels that track specific actions inside an AR advertisement, e.g. a specific button is tapped or user has rotated the phone to see a different view of the AR content.
  • These custom tracking pixels are defined by the developer of an AR content in accordance with the present invention and have to be embedded in the AR advertisement configuration.
  • the AR player 1 18a also configures processor resource 104 to fire third-party tracking pixels for delivery verification, demographic verification, and viewability. These tracking pixels are added to the AR advertisement configuration.
  • the AR player 1 18a can render an AR ad inside an HTML iframe or an MRIAD compatible mobile container.
  • a software-controlled programmable processing device such as a general purpose processor or special-purposes processor, digital signal processor, microprocessor, or other processing device, data processing apparatus or computer system
  • a computer program for configuring a programmable device, apparatus or system to implement the foregoing described methods, apparatus and system is envisaged as an aspect of the present invention.
  • the computer program may be embodied as any suitable type of code, such as source code, object code, compiled code, interpreted code, executable code, static code, dynamic code, and the like.
  • the instructions may be implemented using any suitable high-level, low-level, object-oriented, visual, compiled and/or interpreted programming language, such as C, C++, Java, BASIC, Perl, Matlab, Pascal, Visual BASIC, JAVA, ActiveX, assembly language, machine code, and so forth.
  • a skilled person would readily understand that term "computer” in its most general sense encompasses programmable devices such as referred to above, and data processing apparatus and computer systems in whatever format they may arise, for example, desktop personal computer, laptop personal computer, tablet, smartphone, smart glass, or other computing device.
  • the computer program is stored on a carrier medium in machine readable form
  • the carrier medium may comprise memory, removable or non-removable media, erasable or non-erasable media, writeable or re-writeable media, digital or analog media, hard disk, floppy disk, Compact Disk Read Only Memory (CD-ROM), Compact Disk Recordable (CD-R), Compact Disk Rewriteable (CD-RW), optical disk, magnetic media, magneto-optical media, removable memory cards or disks, various types of Digital Versatile Disk (DVD) subscriber identity module, tape, cassette solid-state memory.
  • the computer program may be supplied from a remote source embodied in the communications medium such as an electronic signal, radio frequency carrier wave or optical carrier waves.
  • the computer program may comprise more than instructions, for example parameters and of data for the computer program and as such a computer program may generally be referred to as comprising computer program elements in order to encompass such parameters, data and other things for the computer program.
  • any reference to "one embodiment” or “an embodiment” means that a particular element, feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment.
  • the appearances of the phrase “in one embodiment” or the phrase “in an embodiment” in various places in the specification are not necessarily all referring to the same embodiment.
  • the terms “comprises,” “comprising,” “includes,” “including,” “has,” “having” or any other variation thereof, are intended to cover a non-exclusive inclusion.
  • a process, method, article, or apparatus that comprises a list of elements is not necessarily limited to only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
  • “or” refers to an inclusive or and not to an exclusive or. For example, a condition A or B is satisfied by any one of the following: A is true (or present) and B is false (or not present), A is false (or not present) and B is true (or present), and both A and B are true (or present).
  • a webpage, or web page is document that is suitable for distribution over the World Wide Web and for display on web browsers.
  • a web browser is software that displays webpages on a display screen of a computer or mobile device such as a smartphone.
  • the webpage is the displayed aspect of a computer file typically written in a so- called "mark-up" language such as Hyper Text Markup Language (HTML) or similar language.
  • Web pages are available from web servers accessible over a network by network coupled computer or mobile devices.
  • Applications are computer programs generally designed to provide some form of user functionality such as a word processor function or a drawing function.
  • a mobile device When applied to mobile devices such as smart phones and tablets the term application may refer to such things as a word processor function but also refers to very specific functions for which a specific application may be invoked, for example a calculator function, a connection to a news website (a collection of webpages), a telephone function or text messaging function.
  • a mobile device is any device which does not require a wired connection to operate, either in terms of power or in communications connectivity.
  • a client device may be any device, mobile or not, that can communicate with a server apparatus over a communications channel, for example a network such as the Internet.
  • HTML5 used herein refers to the fifth version of the HTML standard available at https://html.spec.whatwq.org.
  • JavaScript refers to a web browser presentation language the standard for which may be found here: http://www.ecmainternational.org/publications/standards/Ecma-262.htm.
  • JPEG Joint Photographic Experts Group and details may be found here: https://j eg . org/jpeg/.
  • PNG PNG Specification which may be found here: https://www.w3.orq/TR/PNG/.
  • client metadata may be disclosed in the foregoing but embodiments in accordance with the invention are not limited to such examples or combinations thereof.
  • Other information or data concerning a client device, its use and the applications on it may also be utilised and may also be considered metadata.
  • client devices such as a mobile device or smartphone have been disclosed, client devices may also include wearable devices such as smart glasses, for example Google Glass®.
  • Other display devices may also be configured as client devices or to display information provided by client devices.
  • image recognition is conducted in an image recognition server, 76, separate from the ad server 52.
  • functionality of image recognition server 76 may be included in ad server 52 or distributed over a plurality of servers depending upon the requirements of the network architecture or implementation.
  • AR content has been described as originating on ad server 52 it may be provided by another ad server such as third-party ad server 74 or on a content distribution server configured for delivering AR content.

Abstract

L'invention concerne un appareil serveur (52) comprenant une ressource de processeur (56), et une mémoire contenant des éléments de programme pouvant être utilisés pour configurer la capacité de commande dudit processeur. L'appareil serveur (52) peut : recevoir des métadonnées client, d'un dispositif client (100); sélectionner un sujet de contenu pour une distribution à un dispositif client (100), en lien avec lesdites métadonnées client reçues; transmettre des éléments de programme de lecteur AR (118a) devant être chargés dans un dispositif client (100); transmettre un contenu AR (70) correspondant au dit sujet de contenu, à un dispositif client (100), en réponse à la détermination d'un accès autorisé à un enregistrement de caméra (122) de ce dispositif client (100); recevoir une image provenant d'un enregistrement de caméra (122), d'un dispositif client (100), et entrer ladite image dans un service de reconnaissance d'image (76) afin de déterminer la présence d'une image de marqueur dans ladite image; en réponse à la détermination de la présence dudit marqueur, transmettre une instruction de lancement AR à des éléments de programme de lecteur AR (118a) chargés dans un dispositif client (100), afin d'initier un rendu (348) dudit contenu AR (70) sur ledit marqueur dans un enregistrement de caméra (122).
PCT/EP2017/075416 2016-10-05 2017-10-05 Appareil, dispositif, système, et procédé WO2018065549A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201662404554P 2016-10-05 2016-10-05
US62/404,554 2016-10-05

Publications (1)

Publication Number Publication Date
WO2018065549A1 true WO2018065549A1 (fr) 2018-04-12

Family

ID=60162185

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2017/075416 WO2018065549A1 (fr) 2016-10-05 2017-10-05 Appareil, dispositif, système, et procédé

Country Status (1)

Country Link
WO (1) WO2018065549A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111242693A (zh) * 2020-01-16 2020-06-05 秒针信息技术有限公司 设备标识确定方法、装置、电子设备及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120116728A1 (en) * 2010-11-05 2012-05-10 Autodesk, Inc. Click to accept as built modeling
US20120263154A1 (en) * 2011-04-13 2012-10-18 Autonomy Corporation Ltd Methods and systems for generating and joining shared experience
US20140160161A1 (en) * 2012-12-06 2014-06-12 Patricio Barreiro Augmented reality application
US20140171116A1 (en) * 2012-12-14 2014-06-19 Anthony G. LaMarca Location-aware mobile application management
US20140340423A1 (en) * 2013-03-15 2014-11-20 Nexref Technologies, Llc Marker-based augmented reality (AR) display with inventory management

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120116728A1 (en) * 2010-11-05 2012-05-10 Autodesk, Inc. Click to accept as built modeling
US20120263154A1 (en) * 2011-04-13 2012-10-18 Autonomy Corporation Ltd Methods and systems for generating and joining shared experience
US20140160161A1 (en) * 2012-12-06 2014-06-12 Patricio Barreiro Augmented reality application
US20140171116A1 (en) * 2012-12-14 2014-06-19 Anthony G. LaMarca Location-aware mobile application management
US20140340423A1 (en) * 2013-03-15 2014-11-20 Nexref Technologies, Llc Marker-based augmented reality (AR) display with inventory management

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111242693A (zh) * 2020-01-16 2020-06-05 秒针信息技术有限公司 设备标识确定方法、装置、电子设备及存储介质
CN111242693B (zh) * 2020-01-16 2023-08-25 秒针信息技术有限公司 设备标识确定方法、装置、电子设备及存储介质

Similar Documents

Publication Publication Date Title
US11127046B1 (en) Tool for third-party creation of advertisements for a social networking system
US11112942B2 (en) Providing content via multiple display devices
KR102019410B1 (ko) 생성물의 랜딩 페이지에 기능적 확장들을 제공하는 방법들 및 시스템들
US10453092B1 (en) Content selection associated with webview browsers
US11871063B2 (en) Intelligent multi-device content distribution based on internet protocol addressing
US10229429B2 (en) Cross-device and cross-channel advertising and remarketing
US10862888B1 (en) Linking a forwarded contact on a resource to a user interaction on a requesting source item
US20150234796A1 (en) Creating, managing, and distributing dynamic content to smartphones
US20120257112A1 (en) System for Combining Video Data Streams into a Composite Video Data Stream
CN108574618B (zh) 基于社交关系链的推送信息展示方法及装置
US9743137B2 (en) Run-time SDK integration for connected video players
US20160249085A1 (en) Device, system, and method of advertising for mobile electronic devices
JP6767476B2 (ja) オンライン・システムによって選択されるコンテンツを、アプリケーションによって提示されるコンテンツを通じて、アプリケーションによって提示される追加コンテンツとともに提示すること
US20160261921A1 (en) Context based shopping capabilities when viewing digital media
US9113215B1 (en) Interactive advertising and marketing system
CN109168012B (zh) 用于终端设备的信息处理方法和装置
US10839409B1 (en) Augmented reality store and services orientation gamification
US20160104209A1 (en) Real time bidding system for applications
CN108574878B (zh) 数据交互方法及装置
US10108735B2 (en) System and method of embedded application tags
CN107690080B (zh) 媒体信息的播放方法和装置
CN115079884A (zh) 会话消息的显示方法、装置、设备及存储介质
CN110673886B (zh) 用于生成热力图的方法和装置
WO2018065549A1 (fr) Appareil, dispositif, système, et procédé
CN112565835A (zh) 视频内容的展示方法、客户端及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17787892

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205N DATED 15/07/2019)

122 Ep: pct application non-entry in european phase

Ref document number: 17787892

Country of ref document: EP

Kind code of ref document: A1