WO2023278487A1 - Predicting content views for locations at which no electronic content display is currently installed - Google Patents

Predicting content views for locations at which no electronic content display is currently installed Download PDF

Info

Publication number
WO2023278487A1
WO2023278487A1 PCT/US2022/035371 US2022035371W WO2023278487A1 WO 2023278487 A1 WO2023278487 A1 WO 2023278487A1 US 2022035371 W US2022035371 W US 2022035371W WO 2023278487 A1 WO2023278487 A1 WO 2023278487A1
Authority
WO
WIPO (PCT)
Prior art keywords
location
pois
data
particular location
machine learning
Prior art date
Application number
PCT/US2022/035371
Other languages
French (fr)
Inventor
Ionel-Alexandru Hosu
David J. Klein
Silas M. Toms
Han-En Eric Kung
Anna C.J. Bailey
Original Assignee
Volta Charging, Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Volta Charging, Llc filed Critical Volta Charging, Llc
Publication of WO2023278487A1 publication Critical patent/WO2023278487A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/812Monomedia components thereof involving advertisement data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254Management at additional data server, e.g. shopping server, rights management server
    • H04N21/2543Billing, e.g. for subscription services
    • H04N21/2547Third Party Billing, e.g. billing of advertiser

Definitions

  • the present invention relates to automated prediction mechanisms and, more specifically, to automated prediction of content views for locations at which no electronic content display is currently installed.
  • the public is constantly being exposed to content.
  • the mechanisms for exposing content can range from a plane pulling a banner across the sky to alerts sent to the users’ personal mobile devices.
  • the nature of the content itself may vary, from emergency announcements and public service messages, to entertainment content and advertisements.
  • Content may also be targeted towards a specific segment of the public.
  • a company may conduct a targeted advertising campaign to reach specific demographics that are more likely to be receptive to the company’s products and services.
  • One demographic of interest includes electric vehicle (EV) users, who may be targeted by companies selling solar power products and installation services, for example.
  • EV electric vehicle
  • One popular way to expose users to content is to display the content on an electronic content display (i.e. “panel”) that is within the view of the users.
  • Such panels have a variety of forms, including but not limited to LED and plasma display screens, video projector/screen combinations, touch sensitive display screens, etc.
  • Example uses of such panels include panels placed at each entrance to a mall to display an interactive map of the mall to enable users to quickly find their way to their desired destination.
  • panels may be placed on the tables at a restaurant to allow customers to view the menu, place orders, and even play games. Recently, it is even common to view content, while pumping gas, on panels built into or near gasoline pumps or EV charging stations (EVCS).
  • EVCS EV charging stations
  • EILs Existing Installation Locations
  • CILs Candidate Installation Locations
  • FIG. l is a block diagram illustrating a geographic region that has a set of existing installation locations (EILs) at which panels are already installed and a set of candidate installation locations (CILs) at which no panel is currently installed;
  • EILs existing installation locations
  • CILs candidate installation locations
  • FIG. 2 is a flowchart illustrating steps for predicting content exposure at candidate installation locations at which no panel is currently installed, according to an embodiment
  • FIG. 3 is a block diagram of a computer system upon which the techniques described herein may be implemented.
  • Techniques are described herein for predicting content exposure that will result from installing a panel at a CIL. Because no panel is currently present at the CIL, conventional auditing techniques are not available for determining the content exposure that would be produced by installing a panel at the CIL.
  • the techniques involve training a machine learning engine based on information obtained about EILs.
  • the information used to train the machine learning engine includes, for each EIL: (a) features of the EIL, and (b) exposure data that has been generated for the EIL.
  • the trained machine learning engine predicts the content exposure for a CIL based on the features of the CIL.
  • the machine learning engine may be used to predict the exposure data for each of multiple CILs that are being considered for the installation of a panel.
  • the location selection for panel may be performed based, at least in part, on the exposure data predicted for each of the multiple CILs under consideration.
  • FIG. 1 it is a block diagram illustrating a situation where three panels have already been installed, and five locations are being considered for the installation of a fourth panel.
  • the three panels are installed at existing installation locations 100, 102 and 104.
  • both location feature data and exposure data are known.
  • location features are known but exposure data is unavailable.
  • a machine learning engine is trained on the location features and exposure data for each of EILs 100, 102 and 104, as shall be described in detail hereafter.
  • the EILs and/or CILs considered in the machine learning engine may be filtered or otherwise limited to locations having at least one electric vehicle charging station (EVCS), which further includes at least one integrated panel or an externally connected wired or wireless panel for exposing content.
  • EVCS electric vehicle charging station
  • the EVCS is a device/entity at a point of interest, such as an EIL or CIL, which facilitates charging of an electric vehicle.
  • the EVCS may comprise various programs, modules, or software applications, including an operating system and software application.
  • the EVCS may receive actions comprising instructions, requests, notifications, and/or recommendations to execute or display from local storage, a wired or wireless intranet, or a remote server computer connected to a wide area network such as the Internet.
  • the actions may include instructions to expose or display content on the integrated or external panel of the EVCS.
  • Content exposure can be measured in a variety of ways.
  • the exposure metrics “monthly impressions” and “impressions per-content-play” shall be used in the examples given herein.
  • “Monthly impressions” generally refers to how many distinct users were exposed to content during a month.
  • “Impressions per-content-play” generally refers to how many distinct users were exposed to content each time the content was played. While examples shall be given herein using the “monthly impression” and “impressions per-content-play” metrics, the techniques described herein are not limited to any particular metrics for measuring content exposure.
  • content exposure metrics for EILs may be available from third-party auditing services.
  • an auditing service may employ a mechanism for determining the monthly impressions metric for content played on the panels at EILs.
  • similar content expose metrics may be predicted for CILs, and may be used as a factor in selecting at which CIL to install a panel.
  • a location for which “location features” are available is referred to herein as a Point-of-Interest or “ROG.
  • location features of EILs are used in combination with the content exposure metrics of the EILs (e.g. the monthly impression data from an auditing service) to train the machine learning engine. After the machine learning engine has been trained, location features of CILs are fed to the trained model to generate predictions of content exposure metrics for CILs.
  • content exposure metrics of the EILs e.g. the monthly impression data from an auditing service
  • location features of CILs are fed to the trained model to generate predictions of content exposure metrics for CILs.
  • both EILs and CILs qualify as POIs.
  • the location features of POIs may come from a variety of sources.
  • the location features used to train the machine learning engine to predict exposure metrics include features obtained from the US Census data, features available from public data sources, and features obtained from various third-party services, which may include features tracked from mobile device data, features derived from user interactions with devices located at POIs, or features gathered by other techniques.
  • the US Census aggregates data collection into “block groups”, where each block group corresponds to a specific geographic area.
  • the total population value for a POI is considered to be the total population number from the latest US Census for the block group that corresponds to the specific geographic area in which the POI resides.
  • the location features used to train the machine learning engine to predict exposure metrics of CIL include:
  • Estimated effectiveness of an advertising campaign associated with the projected content exposure which may be based on actual effectiveness determined from exposure data recorded for one or more similar EILs, wherein the exposure data may also include sales data.
  • an Advertising-to-Sales Ratio can be projected for the CIL based on exposure data, including sales data, recorded for one or more EILs having similar characteristics as the CIL.
  • This list of features is merely an example of the location features that may be used to train a machine learning engine to predict exposure metrics of CILs.
  • the techniques described herein are not limited to any particular location features, nor to any particular source of information about those features.
  • FIG. 2 it is a flowchart illustrating the general steps for predicting exposure metrics for CILs, according to an embodiment.
  • location features and exposure data for EILs are obtained.
  • the location features may be obtained from sources such as the US Census and various third-party services.
  • the exposure metrics for EILs may be obtained from various third-party auditing services.
  • step 202 the location feature and exposure data for an EIL is fed into the machine learning engine to train the model used by the machine learning engine.
  • Step 204 forms a loop, causing step 202 to be repeated for each EIL. After all EILs have been processed in this manner, the machine learning engine is trained, and control passes to step 206.
  • location feature data is obtained for a CIL.
  • the location feature data for the CIL may be obtained from the same sources that were used to obtain the feature data for the EILs.
  • the location feature data for the CIL is fed to the trained machine learning engine, causing the trained machine learning engine to output an exposure prediction for the CIL.
  • the exposure prediction may be, for example, the monthly impressions that would be produced if a panel were installed at the CIL in question. From the monthly impression prediction, other exposure data may be derived, such as the number of impressions per content play.
  • the machine learning engine may be retrained periodically to ensure the model produces the most accurate predictions possible. For example, steps 200-204 may be repeated in response to newly available census data, newly created POIs, new location data for existing POIs, and/or new exposure data for existing EILs.
  • a CIL may not map to a single POI for which location feature data is available.
  • a CIL may fall on the boundary between two census block groups.
  • a CIL may be surrounded by POIs, but not exactly correspond to any specific POI.
  • location feature data for such CILs is derived from the location feature data of the surrounding POIs.
  • the derived location feature data may be obtained by aggregating location feature data from the surrounding POIs.
  • the total population value for the CIL may be derived by taking the average of the total populations of the two census block groups.
  • the location feature data for the CIL may be derived by taking the average of the location feature data of those POIs.
  • the average may be weighted, giving greater weight to the location feature data from POIs that are closer to the CIL, and less weight to the location feature data from POIs that are farther from the CIL.
  • a neural network is trained to predict exposure data using the training data described above.
  • a RandomForestRegressor ensemble model is used.
  • the techniques described herein are implemented by one or more special-purpose computing devices.
  • the special-purpose computing devices may be hard-wired to perform the techniques, or may include digital electronic devices such as one or more application-specific integrated circuits (ASICs) or field programmable gate arrays (FPGAs) that are persistently programmed to perform the techniques, or may include one or more general purpose hardware processors programmed to perform the techniques pursuant to program instructions in firmware, memory, other storage, or a combination.
  • ASICs application-specific integrated circuits
  • FPGAs field programmable gate arrays
  • Such special-purpose computing devices may also combine custom hard-wired logic, ASICs, or FPGAs with custom programming to accomplish the techniques.
  • the special-purpose computing devices may be desktop computer systems, portable computer systems, handheld devices, networking devices or any other device that incorporates hard-wired and/or program logic to implement the techniques.
  • FIG. 3 is a block diagram that illustrates a computer system 300 upon which an embodiment of the invention may be implemented.
  • Computer system 300 includes a bus 302 or other communication mechanism for communicating information, and a hardware processor 304 coupled with bus 302 for processing information.
  • Hardware processor 304 may be, for example, a general-purpose microprocessor.
  • Computer system 300 also includes a main memory 306, such as a random-access memory (RAM) or other dynamic storage device, coupled to bus 302 for storing information and instructions to be executed by processor 304.
  • Main memory 306 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed by processor 304.
  • Such instructions when stored in non-transitory storage media accessible to processor 304, render computer system 300 into a special-purpose machine that is customized to perform the operations specified in the instructions.
  • Computer system 300 further includes a read only memory (ROM) 308 or other static storage device coupled to bus 302 for storing static information and instructions for processor 304.
  • ROM read only memory
  • a storage device 310 such as a magnetic disk, optical disk, or solid-state drive is provided and coupled to bus 302 for storing information and instructions.
  • Computer system 300 may be coupled via bus 302 to a display 312, such as a cathode ray tube (CRT), for displaying information to a computer user.
  • a display 312 such as a cathode ray tube (CRT)
  • cursor control 316 is Another type of user input device
  • cursor control 316 such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections to processor 304 and for controlling cursor movement on display 312.
  • This input device typically has two degrees of freedom in two axes, a first axis (e.g., x) and a second axis (e.g., y), that allows the device to specify positions in a plane.
  • Computer system 300 may implement the techniques described herein using customized hard-wired logic, one or more ASICs or FPGAs, firmware and/or program logic which in combination with the computer system causes or programs computer system 300 to be a special-purpose machine. According to one embodiment, the techniques herein are performed by computer system 300 in response to processor 304 executing one or more sequences of one or more instructions contained in main memory 306. Such instructions may be read into main memory 306 from another storage medium, such as storage device 310. Execution of the sequences of instructions contained in main memory 306 causes processor 304 to perform the process steps described herein. In alternative embodiments, hard-wired circuitry may be used in place of or in combination with software instructions.
  • Non-volatile media includes, for example, optical disks, magnetic disks, or solid-state drives, such as storage device 310.
  • Volatile media includes dynamic memory, such as main memory 306.
  • Common forms of storage media include, for example, a floppy disk, a flexible disk, hard disk, solid- state drive, magnetic tape, or any other magnetic data storage medium, a CD-ROM, any other optical data storage medium, any physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, NVRAM, any other memory chip or cartridge.
  • Storage media is distinct from but may be used in conjunction with transmission media.
  • Transmission media participates in transferring information between storage media.
  • transmission media includes coaxial cables, copper wire and fiber optics, including the wires that comprise bus 302.
  • transmission media can also take the form of acoustic or light waves, such as those generated during radio-wave and infra-red data communications.
  • Various forms of media may be involved in carrying one or more sequences of one or more instructions to processor 304 for execution.
  • the instructions may initially be carried on a magnetic disk or solid-state drive of a remote computer.
  • the remote computer can load the instructions into its dynamic memory and send the instructions over a telephone line using a modem.
  • a modem local to computer system 300 can receive the data on the telephone line and use an infra-red transmitter to convert the data to an infra-red signal.
  • An infra-red detector can receive the data carried in the infra-red signal and appropriate circuitry can place the data on bus 302.
  • Bus 302 carries the data to main memory 306, from which processor 304 retrieves and executes the instructions.
  • the instructions received by main memory 306 may optionally be stored on storage device 310 either before or after execution by processor 304.
  • Computer system 300 also includes a communication interface 318 coupled to bus 302.
  • Communication interface 318 provides a two-way data communication coupling to a network link 320 that is connected to a local network 322.
  • communication interface 318 may be an integrated services digital network (ISDN) card, cable modem, satellite modem, or a modem to provide a data communication connection to a corresponding type of telephone line.
  • ISDN integrated services digital network
  • communication interface 318 may be a local area network (LAN) card to provide a data communication connection to a compatible LAN.
  • LAN local area network
  • Wireless links may also be implemented.
  • communication interface 318 sends and receives electrical, electromagnetic, or optical signals that carry digital data streams representing various types of information.
  • Network link 320 typically provides data communication through one or more networks to other data devices.
  • network link 320 may provide a connection through local network 322 to a host computer 324 or to data equipment operated by an Internet Service Provider (ISP) 326.
  • ISP 326 in turn provides data communication services through the world wide packet data communication network now commonly referred to as the “Internet” 328.
  • Internet 328 The signals through the various networks and the signals on network link 320 and through communication interface 318, which carry the digital data to and from computer system 300, are example forms of transmission media.
  • Computer system 300 can send messages and receive data, including program code, through the network(s), network link 320 and communication interface 318.
  • a server 330 might transmit a requested code for an application program through Internet 328, ISP 326, local network 322 and communication interface 318.
  • the received code may be executed by processor 304 as it is received, and/or stored in storage device 310, or other non-volatile storage for later execution.
  • cloud computing is generally used herein to describe a computing model which enables on-demand access to a shared pool of computing resources, such as computer networks, servers, software applications, and services, and which allows for rapid provisioning and release of resources with minimal management effort or service provider interaction.
  • a cloud computing environment (sometimes referred to as a cloud environment, or a cloud) can be implemented in a variety of different ways to best suit different requirements.
  • a cloud environment in a public cloud environment, the underlying computing infrastructure is owned by an organization that makes its cloud services available to other organizations or to the general public.
  • a private cloud environment is generally intended solely for use by, or within, a single organization.
  • a community cloud is intended to be shared by several organizations within a community; while a hybrid cloud comprises two or more types of cloud (e.g., private, community, or public) that are bound together by data and application portability.
  • a cloud computing model enables some of those responsibilities which previously may have been provided by an organization's own information technology department, to instead be delivered as service layers within a cloud environment, for use by consumers (either within or external to the organization, according to the cloud's public/private nature).
  • the precise definition of components or features provided by or within each cloud service layer can vary, but common examples include: Software as a Service ( SaaS ), in which consumers use software applications that are running upon a cloud infrastructure, while a SaaS provider manages or controls the underlying cloud infrastructure and applications.
  • SaaS Software as a Service
  • PaaS Platform as a Service
  • PaaS provider manages or controls other aspects of the cloud environment (i.e., everything below the run-time execution environment).
  • IaaS Infrastructure as a Service
  • IaaS in which consumers can deploy and run arbitrary software applications, and/or provision processing, storage, networks, and other fundamental computing resources, while an IaaS provider manages or controls the underlying physical cloud infrastructure (i.e., everything below the operating system layer).
  • DBaaS Database as a Service
  • consumers use a database server or Database Management System that is running upon a cloud infrastructure
  • a DbaaS provider manages or controls the underlying cloud infrastructure, applications, and servers, including one or more database servers.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Databases & Information Systems (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

Techniques are described herein for predicting content exposure that will result from installing a panel at a location at which no panel is currently installed. The techniques involve training a machine learning engine based on information obtained about locations at which panels are already installed. The information used to train the machine learning engine includes, for each existing installation location: (a) features of the location, and (b) exposure data that has been generated for the location. When the machine learning engine has been trained, the trained machine learning engine predicts the content exposure for a location at which no panel has been installed based on the features of that location.

Description

INTERNATIONAL PATENT APPLICATION
FOR
PREDICTING CONTENT VIEWS FOR LOCATIONS AT WHICH NO ELECTRONIC CONTENT
DISPLAY is CURRENTLY INSTALLED
FIELD OF THE INVENTION
[0001] The present invention relates to automated prediction mechanisms and, more specifically, to automated prediction of content views for locations at which no electronic content display is currently installed.
BACKGROUND
[0002] The public is constantly being exposed to content. The mechanisms for exposing content can range from a plane pulling a banner across the sky to alerts sent to the users’ personal mobile devices. The nature of the content itself may vary, from emergency announcements and public service messages, to entertainment content and advertisements. [0003] Content may also be targeted towards a specific segment of the public. For example, a company may conduct a targeted advertising campaign to reach specific demographics that are more likely to be receptive to the company’s products and services. One demographic of interest includes electric vehicle (EV) users, who may be targeted by companies selling solar power products and installation services, for example. One popular way to expose users to content is to display the content on an electronic content display (i.e. “panel”) that is within the view of the users. Such panels have a variety of forms, including but not limited to LED and plasma display screens, video projector/screen combinations, touch sensitive display screens, etc.
[0004] Example uses of such panels include panels placed at each entrance to a mall to display an interactive map of the mall to enable users to quickly find their way to their desired destination. As another example, panels may be placed on the tables at a restaurant to allow customers to view the menu, place orders, and even play games. Recently, it is even common to view content, while pumping gas, on panels built into or near gasoline pumps or EV charging stations (EVCS).
[0005] The value of a panel is largely based on the number of users that will be exposed to (have the opportunity to view) the content played thereon. Thus, the panels located around Times Square in New York City are extremely valuable, while similar panels located in a remote mountain top would have very little value. Because it can be expensive to install and operate panels, it is important to select installation sites that will result in sufficient content exposures to make the investment worthwhile.
[0006] Unfortunately, it is much easier to ascertain the amount of content exposure a panel produces after the panel has been installed than when selecting an installation site for a new panel installation. For example, third party vendors may provide auditing services that estimate the amount of content exposure that occurs at existing panel locations. Locations at which panels have already been install are referred to herein as “Existing Installation Locations” or “EILs”.
[0007] Unfortunately, it is not particularly helpful to find out that a particular site results in unacceptably low content exposure after the investment has been made to install and operate a panel at the site. It would be vastly more useful to be able to accurately predict content exposure at sites for which no panel is currently installed, for the site selection process to be informed by such predictions. Sites at which no panel has been installed are referred to herein as “Candidate Installation Locations” or “CILs”.
[0008] The approaches described in this section are approaches that could be pursued, but not necessarily approaches that have been previously conceived or pursued. Therefore, unless otherwise indicated, it should not be assumed that any of the approaches described in this section qualify as prior art merely by virtue of their inclusion in this section. Further, it should not be assumed that any of the approaches described in this section are well- understood, routine, or conventional merely by virtue of their inclusion in this section.
BRIEF DESCRIPTION OF THE DRAWINGS [0009] In the drawings:
[0010] FIG. l is a block diagram illustrating a geographic region that has a set of existing installation locations (EILs) at which panels are already installed and a set of candidate installation locations (CILs) at which no panel is currently installed;
[0011] FIG. 2 is a flowchart illustrating steps for predicting content exposure at candidate installation locations at which no panel is currently installed, according to an embodiment; and
[0012] FIG. 3 is a block diagram of a computer system upon which the techniques described herein may be implemented. DET AILED DESCRIPTION
[0013] In the following description, for the purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be apparent, however, that the present invention may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to avoid unnecessarily obscuring the present invention.
I. General Overview
II. Content Exposure Metrics
III. Location Features
IV. Exposure Data Prediction Process
V. CILs For Which Location Feature Data Is Not Available
VI. The Machine Learning Engine
VII. Hardware Overview
VIII. Cloud Computing
I. General Overview
[0014] Techniques are described herein for predicting content exposure that will result from installing a panel at a CIL. Because no panel is currently present at the CIL, conventional auditing techniques are not available for determining the content exposure that would be produced by installing a panel at the CIL. The techniques involve training a machine learning engine based on information obtained about EILs. The information used to train the machine learning engine includes, for each EIL: (a) features of the EIL, and (b) exposure data that has been generated for the EIL.
[0015] When the machine learning engine has been trained using the features and exposure data from the EILs, the trained machine learning engine predicts the content exposure for a CIL based on the features of the CIL. The machine learning engine may be used to predict the exposure data for each of multiple CILs that are being considered for the installation of a panel. Thus, the location selection for panel may be performed based, at least in part, on the exposure data predicted for each of the multiple CILs under consideration.
[0016] Referring to FIG. 1, it is a block diagram illustrating a situation where three panels have already been installed, and five locations are being considered for the installation of a fourth panel. The three panels are installed at existing installation locations 100, 102 and 104. For each of the existing installation locations, both location feature data and exposure data are known. For each of the five candidate installation locations 106, 108, 110, 112 and 114, location features are known but exposure data is unavailable. To predict exposure information for CILs 106, 108, 110, 112 and 114, a machine learning engine is trained on the location features and exposure data for each of EILs 100, 102 and 104, as shall be described in detail hereafter.
[0017] In some implementations, the EILs and/or CILs considered in the machine learning engine may be filtered or otherwise limited to locations having at least one electric vehicle charging station (EVCS), which further includes at least one integrated panel or an externally connected wired or wireless panel for exposing content. The EVCS is a device/entity at a point of interest, such as an EIL or CIL, which facilitates charging of an electric vehicle. The EVCS may comprise various programs, modules, or software applications, including an operating system and software application. The EVCS may receive actions comprising instructions, requests, notifications, and/or recommendations to execute or display from local storage, a wired or wireless intranet, or a remote server computer connected to a wide area network such as the Internet. The actions may include instructions to expose or display content on the integrated or external panel of the EVCS.
II. Content Exposure Metrics
[0018] Content exposure can be measured in a variety of ways. For the purpose of explanation, the exposure metrics “monthly impressions” and “impressions per-content-play” shall be used in the examples given herein. “Monthly impressions” generally refers to how many distinct users were exposed to content during a month. “Impressions per-content-play” generally refers to how many distinct users were exposed to content each time the content was played. While examples shall be given herein using the “monthly impression” and “impressions per-content-play” metrics, the techniques described herein are not limited to any particular metrics for measuring content exposure.
[0019] In one embodiment, the impressions per-content-play metric can be computed directly from the monthly impression metric as follows. i p per content pl ay = (monthly_impressions) / 28/1000. which assumes 28 days in a month and 1000 content plays per day.
[0020] As mentioned above, content exposure metrics for EILs may be available from third-party auditing services. For example, an auditing service may employ a mechanism for determining the monthly impressions metric for content played on the panels at EILs. Using the techniques described herein, similar content expose metrics may be predicted for CILs, and may be used as a factor in selecting at which CIL to install a panel.
III. Location Features [0021] A location for which “location features” are available is referred to herein as a Point-of-Interest or “ROG. As mentioned above, location features of EILs are used in combination with the content exposure metrics of the EILs (e.g. the monthly impression data from an auditing service) to train the machine learning engine. After the machine learning engine has been trained, location features of CILs are fed to the trained model to generate predictions of content exposure metrics for CILs. Thus, in this scenario, both EILs and CILs qualify as POIs.
[0022] The location features of POIs may come from a variety of sources. For example, in one embodiment, the location features used to train the machine learning engine to predict exposure metrics include features obtained from the US Census data, features available from public data sources, and features obtained from various third-party services, which may include features tracked from mobile device data, features derived from user interactions with devices located at POIs, or features gathered by other techniques.
[0023] With respect to the features obtained from the US Census, the US Census aggregates data collection into “block groups”, where each block group corresponds to a specific geographic area. Thus, the total population value for a POI is considered to be the total population number from the latest US Census for the block group that corresponds to the specific geographic area in which the POI resides.
[0024] According to one embodiment, the location features used to train the machine learning engine to predict exposure metrics of CIL include:
• 'gte construction type' Gaussian transform encoding of the categorical feature construction type. A Gaussian transform is used to make the distribution of this feature resemble a Gaussian distribution.
• 'population male' The male population of the block group (from US Census)
• 'population total' The total population of the block group (from US Census)
• '>240' Number of people who spent 240 minutes or more at the POI
• '61-240' Number of people who spent between 61 and 240 minutes at the POI.
• 'ESTIMATED VISITOR COUNTS' Estimated number of visitors in a month for a given POI.
• 'num adults' The number of adults in the block group (from US Census)
• 'population female' The female population of the block group (from US Census)
• '<5' Number of people who spent 5 minutes or less minutes at the POI.
• 'RAW VISIT COUNT' The recorded number of visits at the POI. • Projected content exposure, or a projected number of audience impressions for a defined period and/or a specific time of day, day of week, month of year, season, holiday period, etc.
• Estimated effectiveness of an advertising campaign associated with the projected content exposure, which may be based on actual effectiveness determined from exposure data recorded for one or more similar EILs, wherein the exposure data may also include sales data. For example, an Advertising-to-Sales Ratio can be projected for the CIL based on exposure data, including sales data, recorded for one or more EILs having similar characteristics as the CIL.
[0025] This list of features is merely an example of the location features that may be used to train a machine learning engine to predict exposure metrics of CILs. The techniques described herein are not limited to any particular location features, nor to any particular source of information about those features.
IV. Exposure Data Prediction Process
[0026] Referring to FIG. 2, it is a flowchart illustrating the general steps for predicting exposure metrics for CILs, according to an embodiment. At step 200, location features and exposure data for EILs are obtained. As discussed above, the location features may be obtained from sources such as the US Census and various third-party services. The exposure metrics for EILs may be obtained from various third-party auditing services.
[0027] At step 202, the location feature and exposure data for an EIL is fed into the machine learning engine to train the model used by the machine learning engine. Step 204 forms a loop, causing step 202 to be repeated for each EIL. After all EILs have been processed in this manner, the machine learning engine is trained, and control passes to step 206.
[0028] At step 206, location feature data is obtained for a CIL. The location feature data for the CIL may be obtained from the same sources that were used to obtain the feature data for the EILs. At step 208, the location feature data for the CIL is fed to the trained machine learning engine, causing the trained machine learning engine to output an exposure prediction for the CIL. The exposure prediction may be, for example, the monthly impressions that would be produced if a panel were installed at the CIL in question. From the monthly impression prediction, other exposure data may be derived, such as the number of impressions per content play. [0029] The machine learning engine may be retrained periodically to ensure the model produces the most accurate predictions possible. For example, steps 200-204 may be repeated in response to newly available census data, newly created POIs, new location data for existing POIs, and/or new exposure data for existing EILs.
V. CILs For Which Location Feature Data Is Not Available
[0030] In some cases, a CIL may not map to a single POI for which location feature data is available. For example, a CIL may fall on the boundary between two census block groups. As another example, a CIL may be surrounded by POIs, but not exactly correspond to any specific POI. According to one embodiment, location feature data for such CILs is derived from the location feature data of the surrounding POIs. The derived location feature data may be obtained by aggregating location feature data from the surrounding POIs.
[0031] For example, in the case of a CIL that resides on the border between two census block groups, the total population value for the CIL may be derived by taking the average of the total populations of the two census block groups. Similarly, for a CIL that is surrounded by multiple POIs (e.g. POIs within a threshold distance of the CIL), the location feature data for the CIL may be derived by taking the average of the location feature data of those POIs.
In one embodiment, the average may be weighted, giving greater weight to the location feature data from POIs that are closer to the CIL, and less weight to the location feature data from POIs that are farther from the CIL.
VI. The Machine Learning Engine
[0032] The techniques described herein are not limited to any particular type of machine learning engine. For example, in one embodiment, a neural network is trained to predict exposure data using the training data described above. In an alternative embodiment, a RandomForestRegressor ensemble model is used.
VII. Hardware Overview
[0033] According to one embodiment, the techniques described herein are implemented by one or more special-purpose computing devices. The special-purpose computing devices may be hard-wired to perform the techniques, or may include digital electronic devices such as one or more application-specific integrated circuits (ASICs) or field programmable gate arrays (FPGAs) that are persistently programmed to perform the techniques, or may include one or more general purpose hardware processors programmed to perform the techniques pursuant to program instructions in firmware, memory, other storage, or a combination. Such special-purpose computing devices may also combine custom hard-wired logic, ASICs, or FPGAs with custom programming to accomplish the techniques. The special-purpose computing devices may be desktop computer systems, portable computer systems, handheld devices, networking devices or any other device that incorporates hard-wired and/or program logic to implement the techniques.
[0034] For example, FIG. 3 is a block diagram that illustrates a computer system 300 upon which an embodiment of the invention may be implemented. Computer system 300 includes a bus 302 or other communication mechanism for communicating information, and a hardware processor 304 coupled with bus 302 for processing information. Hardware processor 304 may be, for example, a general-purpose microprocessor.
[0035] Computer system 300 also includes a main memory 306, such as a random-access memory (RAM) or other dynamic storage device, coupled to bus 302 for storing information and instructions to be executed by processor 304. Main memory 306 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed by processor 304. Such instructions, when stored in non-transitory storage media accessible to processor 304, render computer system 300 into a special-purpose machine that is customized to perform the operations specified in the instructions.
[0036] Computer system 300 further includes a read only memory (ROM) 308 or other static storage device coupled to bus 302 for storing static information and instructions for processor 304. A storage device 310, such as a magnetic disk, optical disk, or solid-state drive is provided and coupled to bus 302 for storing information and instructions.
[0037] Computer system 300 may be coupled via bus 302 to a display 312, such as a cathode ray tube (CRT), for displaying information to a computer user. An input device 314, including alphanumeric and other keys, is coupled to bus 302 for communicating information and command selections to processor 304. Another type of user input device is cursor control 316, such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections to processor 304 and for controlling cursor movement on display 312. This input device typically has two degrees of freedom in two axes, a first axis (e.g., x) and a second axis (e.g., y), that allows the device to specify positions in a plane. [0038] Computer system 300 may implement the techniques described herein using customized hard-wired logic, one or more ASICs or FPGAs, firmware and/or program logic which in combination with the computer system causes or programs computer system 300 to be a special-purpose machine. According to one embodiment, the techniques herein are performed by computer system 300 in response to processor 304 executing one or more sequences of one or more instructions contained in main memory 306. Such instructions may be read into main memory 306 from another storage medium, such as storage device 310. Execution of the sequences of instructions contained in main memory 306 causes processor 304 to perform the process steps described herein. In alternative embodiments, hard-wired circuitry may be used in place of or in combination with software instructions.
[0039] The term “storage media” as used herein refers to any non-transitory media that store data and/or instructions that cause a machine to operate in a specific fashion. Such storage media may comprise non-volatile media and/or volatile media. Non-volatile media includes, for example, optical disks, magnetic disks, or solid-state drives, such as storage device 310. Volatile media includes dynamic memory, such as main memory 306. Common forms of storage media include, for example, a floppy disk, a flexible disk, hard disk, solid- state drive, magnetic tape, or any other magnetic data storage medium, a CD-ROM, any other optical data storage medium, any physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, NVRAM, any other memory chip or cartridge.
[0040] Storage media is distinct from but may be used in conjunction with transmission media. Transmission media participates in transferring information between storage media. For example, transmission media includes coaxial cables, copper wire and fiber optics, including the wires that comprise bus 302. Transmission media can also take the form of acoustic or light waves, such as those generated during radio-wave and infra-red data communications.
[0041] Various forms of media may be involved in carrying one or more sequences of one or more instructions to processor 304 for execution. For example, the instructions may initially be carried on a magnetic disk or solid-state drive of a remote computer. The remote computer can load the instructions into its dynamic memory and send the instructions over a telephone line using a modem. A modem local to computer system 300 can receive the data on the telephone line and use an infra-red transmitter to convert the data to an infra-red signal. An infra-red detector can receive the data carried in the infra-red signal and appropriate circuitry can place the data on bus 302. Bus 302 carries the data to main memory 306, from which processor 304 retrieves and executes the instructions. The instructions received by main memory 306 may optionally be stored on storage device 310 either before or after execution by processor 304.
[0042] Computer system 300 also includes a communication interface 318 coupled to bus 302. Communication interface 318 provides a two-way data communication coupling to a network link 320 that is connected to a local network 322. For example, communication interface 318 may be an integrated services digital network (ISDN) card, cable modem, satellite modem, or a modem to provide a data communication connection to a corresponding type of telephone line. As another example, communication interface 318 may be a local area network (LAN) card to provide a data communication connection to a compatible LAN. Wireless links may also be implemented. In any such implementation, communication interface 318 sends and receives electrical, electromagnetic, or optical signals that carry digital data streams representing various types of information.
[0043] Network link 320 typically provides data communication through one or more networks to other data devices. For example, network link 320 may provide a connection through local network 322 to a host computer 324 or to data equipment operated by an Internet Service Provider (ISP) 326. ISP 326 in turn provides data communication services through the world wide packet data communication network now commonly referred to as the “Internet” 328. Local network 322 and Internet 328 both use electrical, electromagnetic, or optical signals that carry digital data streams. The signals through the various networks and the signals on network link 320 and through communication interface 318, which carry the digital data to and from computer system 300, are example forms of transmission media. [0044] Computer system 300 can send messages and receive data, including program code, through the network(s), network link 320 and communication interface 318. In the Internet example, a server 330 might transmit a requested code for an application program through Internet 328, ISP 326, local network 322 and communication interface 318.
[0045] The received code may be executed by processor 304 as it is received, and/or stored in storage device 310, or other non-volatile storage for later execution.
VIII. Cloud Computing
[0046] The term "cloud computing" is generally used herein to describe a computing model which enables on-demand access to a shared pool of computing resources, such as computer networks, servers, software applications, and services, and which allows for rapid provisioning and release of resources with minimal management effort or service provider interaction.
[0047] A cloud computing environment (sometimes referred to as a cloud environment, or a cloud) can be implemented in a variety of different ways to best suit different requirements. For example, in a public cloud environment, the underlying computing infrastructure is owned by an organization that makes its cloud services available to other organizations or to the general public. In contrast, a private cloud environment is generally intended solely for use by, or within, a single organization. A community cloud is intended to be shared by several organizations within a community; while a hybrid cloud comprises two or more types of cloud (e.g., private, community, or public) that are bound together by data and application portability.
[0048] Generally, a cloud computing model enables some of those responsibilities which previously may have been provided by an organization's own information technology department, to instead be delivered as service layers within a cloud environment, for use by consumers (either within or external to the organization, according to the cloud's public/private nature). Depending on the particular implementation, the precise definition of components or features provided by or within each cloud service layer can vary, but common examples include: Software as a Service ( SaaS ), in which consumers use software applications that are running upon a cloud infrastructure, while a SaaS provider manages or controls the underlying cloud infrastructure and applications. Platform as a Service (PaaS), in which consumers can use software programming languages and development tools supported by a PaaS provider to develop, deploy, and otherwise control their own applications, while the PaaS provider manages or controls other aspects of the cloud environment (i.e., everything below the run-time execution environment). Infrastructure as a Service (IaaS), in which consumers can deploy and run arbitrary software applications, and/or provision processing, storage, networks, and other fundamental computing resources, while an IaaS provider manages or controls the underlying physical cloud infrastructure (i.e., everything below the operating system layer). Database as a Service ( DBaaS) in which consumers use a database server or Database Management System that is running upon a cloud infrastructure, while a DbaaS provider manages or controls the underlying cloud infrastructure, applications, and servers, including one or more database servers.
[0049] In the foregoing specification, embodiments of the invention have been described with reference to numerous specific details that may vary from implementation to implementation. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense. The sole and exclusive indicator of the scope of the invention, and what is intended by the applicants to be the scope of the invention, is the literal and equivalent scope of the set of claims that issue from this application, in the specific form in which such claims issue, including any subsequent correction.

Claims

CLAIMS What is claimed is:
1. A method comprising: producing a trained machine learning engine by training a machine learning engine to predict exposure data for locations at which panels are not currently installed; wherein training the machine learning engine is performed based, at least in part, on: location features for each existing installation location of a plurality of existing installation locations at which panels for displaying video content are already installed; and exposure data for each existing installation location of the plurality of existing installation locations; and causing the trained machine learning engine to predict content exposure for a particular location at which no panel is currently installed by providing, to the trained machine learning engine, location features for the particular location; wherein the method is performed by one or more computing devices.
2. The method of Claim 1 further comprising: obtaining, from a particular source, data for a particular location feature for a plurality of points of interests (POIs); wherein the plurality of POIs include POIs that correspond to the plurality of existing installation locations; wherein the plurality of POIs do not include any POI that corresponds to the particular location; wherein the plurality of POIs include a particular set of POIs that are within a threshold distance of the particular location; and deriving data for the particular location feature for the particular location based on data, for the particular location feature, from the particular set of POIs.
3. The method of Claim 2 wherein deriving data for the particular location feature for the particular location includes aggregating data, for the particular location feature, from the particular set of POIs.
4. The method of Claim 3 wherein aggregating data, for the particular location feature, from the particular set of POIs includes deriving a weighted average, wherein weight applied to the particular location feature for each POI in the particular set of POIs is based, at least in part, on distance of the POI from the particular location.
5. The method of Claim 1 wherein causing the trained machine learning engine to predict content exposure for the particular location includes causing the trained machine learning engine to predict monthly impressions that would occur if a panel were installed at an electric vehicle charging station (EVCS) of the particular location.
6. The method of Claim 1 wherein the location features include one or more statistics for a census block group that corresponds to an area in which the particular location is located.
7. The method of Claim 6 wherein the one or more statistics include total population for the census block group.
8. The method of Claim 1 further comprising: obtaining, from a particular source, data for a particular location feature for a plurality of points of interests (POIs); wherein the plurality of POIs include POIs that correspond to the plurality of existing installation locations; and wherein, for each existing installation location, the location features include one or more statistics relating to number of people that spent an amount of time at the POI, of the plurality of POIs, that corresponds to the existing installation location.
9. The method of Claim 1 further comprising: obtaining, from a particular source, data for a particular location feature for a plurality of points of interests (POIs); wherein the plurality of POIs include POIs that correspond to the plurality of existing installation locations; and wherein, for each existing installation location, the location features include a construction type associated with the POI, of the plurality of POIs, that corresponds to the existing installation location.
10. The method of Claim 1 further comprising: obtaining, from a particular source, data for a particular location feature for a plurality of points of interests (POIs); wherein the plurality of POIs include POIs that correspond to the plurality of existing installation locations; and wherein, for each existing installation location, the location features include one or more statistics relating to number of visits to the POI, of the plurality of POIs, that corresponds to the existing installation location.
11. The method of Claim 1 further comprising: causing the trained machine learning engine to predict content exposure for each candidate location, of a plurality of candidate locations, at which no panel is currently installed; and selecting a candidate location, from the plurality of candidate locations, at which to install a panel based, at least in part, on the content exposure predicted for each candidate location.
12. A system comprising: one or more processors; one or more storage devices operatively coupled to the processor; instructions, stored on the one or more storage devices, which, when executed by the one or more processors, cause: producing a trained machine learning engine by training a machine learning engine to predict exposure data for locations at which panels are not currently installed; wherein training the machine learning engine is performed based, at least in part, on: location features for each existing installation location of a plurality of existing installation locations at which panels for displaying video content are already installed; and exposure data for each existing installation location of the plurality of existing installation locations; and causing the trained machine learning engine to predict content exposure for a particular location at which no panel is currently installed by providing, to the trained machine learning engine, location features for the particular location.
13. The system of Claim 12 wherein the instructions further comprise instructions for: obtaining, from a particular source, data for a particular location feature for a plurality of points of interests (POIs); wherein the plurality of POIs include POIs that correspond to the existing installation locations; wherein the plurality of POIs do not include any POI that corresponds to the particular location; wherein the plurality of POIs include a particular set of POIs that are within a threshold distance of the particular location; and deriving data for the particular location feature for the particular location based on data, for the particular location feature, from the particular set of POIs.
14. The system of Claim 13 wherein deriving data for the particular location feature for the particular location includes aggregating data, for the particular location feature, from the particular set of POIs.
15. The system of Claim 14 wherein aggregating data, for the particular location feature, from the particular set of POIs includes deriving a weighted average, wherein weight applied to the particular location feature for each POI in the particular set of POIs is based, at least in part, on distance of the POI from the particular location.
16. The system of Claim 12 wherein causing the trained machine learning engine to predict content exposure for the particular location includes causing the trained machine learning engine to predict monthly impressions that would occur if a panel were installed at an electric vehicle charging station (EVCS) of the particular location.
17. The system of Claim 12 wherein the instructions further comprise instructions for: causing the trained machine learning engine to predict content exposure for each candidate location, of a plurality of candidate locations, at which no panel is currently installed; and selecting a candidate location, from the plurality of candidate locations, at which to install a panel based, at least in part, on the content exposure predicted for each candidate location.
18. The system of Claim 12 where the machine learning engine comprises a neural network.
19. The system of Claim 12 wherein the machine learning engine comprises a Random Forest Regressor ensemble model.
20. The method of Claim 1 wherein the location features include a projected effectiveness of an advertising campaign associated with the predicted content exposure, and wherein the exposure data of the plurality of existing installation locations includes sales data.
PCT/US2022/035371 2021-06-28 2022-06-28 Predicting content views for locations at which no electronic content display is currently installed WO2023278487A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US202163215725P 2021-06-28 2021-06-28
US63/215,725 2021-06-28

Publications (1)

Publication Number Publication Date
WO2023278487A1 true WO2023278487A1 (en) 2023-01-05

Family

ID=83004883

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2022/035371 WO2023278487A1 (en) 2021-06-28 2022-06-28 Predicting content views for locations at which no electronic content display is currently installed

Country Status (1)

Country Link
WO (1) WO2023278487A1 (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200134418A1 (en) * 2018-10-26 2020-04-30 Herman Miller, Inc. Space utilization measurement and modeling using artificial intelligence
US20200311601A1 (en) * 2019-03-29 2020-10-01 Optum, Inc. Hybrid rule-based and machine learning predictions

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200134418A1 (en) * 2018-10-26 2020-04-30 Herman Miller, Inc. Space utilization measurement and modeling using artificial intelligence
US20200311601A1 (en) * 2019-03-29 2020-10-01 Optum, Inc. Hybrid rule-based and machine learning predictions

Similar Documents

Publication Publication Date Title
US9824156B1 (en) Targeting of digital content to geographic regions
CN104508739B (en) Dynamic language model
US10636293B2 (en) Uncertainty modeling in traffic demand prediction
US9129219B1 (en) Crime risk forecasting
JP2021534499A (en) Mobile device location prediction system and method
US10278014B2 (en) System and method for using geo-blocks and geo-fences to predict mobile device locations
CN108446382B (en) Method and apparatus for pushed information
US10330487B1 (en) Enhanced geocoding
US20160104207A1 (en) Advertising campaign conversion systems and methods
CN104750768A (en) System for identifying, monitoring and ranking incidents from social media
US10693730B2 (en) Communication quality management
CN105493057A (en) Content selection with precision controls
US20200213805A1 (en) Systems and Methods for Calibrated Location Prediction
CN113283948A (en) Generation method, device, equipment and readable medium of prediction model
WO2022120065A1 (en) Systems and methods for predicting television viewership patterns for advanced consumer segments
KR20200102764A (en) Method, system and non-transitory computer-readable recording medium for providing information on value of real estate
KR101913307B1 (en) Method and apparatus for mediating optimization of advertising services
CN111681112A (en) Method and device for managing release strategy and electronic equipment
CN109947874A (en) Polymerization, device and the equipment of motion track
US20220343188A1 (en) Predicting content views for locations at which no electronic content display is currently installed
CN111123778B (en) Method and device for monitoring vehicle use condition and electronic equipment
CN113344660A (en) House source information processing method and device, electronic equipment and storage medium
WO2023278487A1 (en) Predicting content views for locations at which no electronic content display is currently installed
WO2022218068A1 (en) Material delivery method and apparatus, and device and medium
US20170124471A1 (en) Determining demand response impact scores and target customer group for energy saving events

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE