US20210326910A1 - System and method for optimizing an observation campaign in response to observed real-world data - Google Patents
System and method for optimizing an observation campaign in response to observed real-world data Download PDFInfo
- Publication number
- US20210326910A1 US20210326910A1 US17/217,442 US202117217442A US2021326910A1 US 20210326910 A1 US20210326910 A1 US 20210326910A1 US 202117217442 A US202117217442 A US 202117217442A US 2021326910 A1 US2021326910 A1 US 2021326910A1
- Authority
- US
- United States
- Prior art keywords
- observation
- campaign
- parameters
- observation campaign
- real
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 56
- 230000004044 response Effects 0.000 title claims abstract description 11
- 238000004891 communication Methods 0.000 claims abstract description 20
- 238000004458 analytical method Methods 0.000 claims description 28
- 238000013480 data collection Methods 0.000 claims description 10
- 230000008859 change Effects 0.000 claims description 7
- 238000010586 diagram Methods 0.000 description 15
- 230000006870 function Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 238000012545 processing Methods 0.000 description 6
- 238000007405 data analysis Methods 0.000 description 4
- 230000003467 diminishing effect Effects 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 230000000737 periodic effect Effects 0.000 description 2
- 238000011176 pooling Methods 0.000 description 2
- 230000001737 promoting effect Effects 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000003339 best practice Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000003749 cleanliness Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000000275 quality assurance Methods 0.000 description 1
- 238000007493 shaping process Methods 0.000 description 1
- 230000002618 waking effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0201—Market modelling; Market analysis; Collecting market data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
- G06F16/285—Clustering or classification
Definitions
- the data may also be best obtained within a narrow time window. For example, a restaurant owner checking on bathroom cleanliness may only desire to obtain the information for the first hour in which a restaurant is open, as after that, customers may have used the bathrooms extensively.
- merchants who sell goods and products through retailers often have guidelines, rules, and restrictions for how various retailers are to present and price the goods and products at the purchase location. For example, merchants may wish to negotiate with retailers for specific shelf space for the merchant's goods and products or the merchant may wish to disallow lowering of the retail price for the merchant's goods and products.
- FIG. 1 is a basic block diagram illustrating elements or components of an example system in which an embodiment of the subject matter disclosed herein may be implemented;
- FIG. 2 is a more detailed block diagram of the basic system of FIG. 1 illustrating elements or components of an example system in which an embodiment of the subject matter disclosed herein may be implemented;
- FIG. 3 is a data structure diagram illustrating parameters of an example observation campaign used in conjunction with the system of FIG. 2 according to an embodiment of the subject matter disclosed herein;
- FIG. 4 is a method flow diagram illustrating a method for optimizing an observation campaign through analysis of collected data using the example system of FIG. 2 according to an embodiment of the subject matter disclosed herein;
- FIG. 5 is a method flow diagram illustrating a method for pooling resources between observation campaigns through analysis of collected data using the example system of FIG. 2 according to an embodiment of the subject matter disclosed herein;
- FIG. 6 is a diagram illustrating elements or components that may be present in a computer device or system configured to implement a method, process, function, or operation in accordance with an embodiment.
- the systems and methods discussed herein may be directed to an observation platform for coordinators, merchants, retailers, and users to establish, utilize and fulfill an observation campaign suited to verify real-world implementations surrounding observable, standards, conditions, rules, guidelines, and/or restrictions.
- the observable data points may be part of an overall strategy in an observation campaign established by an observation campaign coordinator. Such a strategy may often involve determining data points like specific product placement, product pricing, and product incentives at the retail location.
- a user of this platform called an observer hereinafter, may use an application downloaded to and executing on a computing device, to identify specific observation campaign opportunities.
- An observation campaign may be a set of verifiable parameters that define specifics about an observation campaign strategy. These verifiable parameters may include specific observable and verifiable real-world data such as where a product is placed on a retail shelf, whether promotional materials are displayed with the product, inventory count, and product pricing.
- the user may collect the real-world data through various methods including, key entry, temperature observance, sound recording, video recording, barometric pressure observance, sound-pressure level observance and image capture (using one or more applications executing on a computing device, such as a mobile phone).
- the captured real-world data may then be uploaded to the observation platform in order to determine if the parameters of the observation campaign have been met (e.g., correct data, clear image, timely collection, and the like).
- the collected real-world may be further analyzed against various data metrics (e.g., success rate of observations, failure rate of observations, geographic data analysis, overall observation rate) in order to determine if any parameters of an observation campaign should be changed to address a data metrics issue (e.g., observation are not timely enough, observations are lacking in a specific geographic region).
- data metrics e.g., success rate of observations, failure rate of observations, geographic data analysis, overall observation rate
- Such analytical data may be used to improve parameters of an observation campaign to better achieve the observation goals.
- FIG. 1 is a basic block diagram illustrating elements or components of an example system 100 in which an embodiment of the subject matter disclosed herein may be implemented.
- a continuing example of a merchant-based observation campaign will be used.
- various real-world data points specific to a merchant that sells goods at retail locations will also be used in context.
- the coordinator of an observation campaign need not be a merchant with merchant-specific data points.
- a coordinator of an observation campaign may be a quality-assurance coordinator seeking to collect data about installations of observable projects, e.g., power transmission pole installations, bathroom conditions in public transit, traffic conditions, and the like.
- a coordinator of an observation campaign may be any individual, business, government agency, or entity that wishes to incentivize observers to collect real-world data from myriad locations.
- a coordinator of an observation campaign may be any individual, business, government agency, or entity that wishes to incentivize observers to collect real-world data from myriad locations.
- the remaining disclosure will use the merchant product and retail location example without limiting the interpretation or scope of the claims or specification.
- an observation platform 120 provides systems and methods for a merchant 110 to establish and implement an observation campaign for various observers 130 , 131 , and 132 to collect real world data about the observation campaign established by the merchant 110 .
- the merchant block 110 , the observation platform block 120 and each observer block 130 , 131 , and 132 may represent a separate computing device or group of computing devices. Further, the connections between these computing devices may be any communication link, such as the Internet, BlueToothTM wireless, direct serial link, and the like.
- the various computing device implementations and embodiments are discussed below.
- the observation platform 120 may be embodied in whole or in part as a computing system that includes one or more server computers configured in a cloud-based computing environment.
- Embodiments may take the form of a hardware implemented embodiment, a software implemented embodiment, or an embodiment combining software and hardware aspects. Further, various computing aspects of the underlying systems and methods may transcend any specific computing entity and the “block” diagram nature of FIG. 1 is intended to illustrate one embodiment.
- one or more of the operations, functions, processes, or methods described herein may be implemented by one or more suitable processing elements (such as a processor, microprocessor, CPU, controller, etc.) that are part of a client device, server, network element, or other form of computing or data processing device/platform and that is programmed with a set of executable instructions (e.g., software instructions), where the instructions may be stored in a suitable non-transitory data storage element.
- suitable processing elements such as a processor, microprocessor, CPU, controller, etc.
- a set of executable instructions e.g., software instructions
- one or more of the operations, functions, processes, or methods described herein may be implemented by a specialized form of hardware, such as a programmable gate array, application specific integrated circuit (ASIC), or the like. This detailed description is, therefore, not to be taken in a limiting sense.
- the subject matter may be implemented in the context of a “cloud” based computing environment typically used to develop and provide web services and business applications for end users. Further aspects of an exemplary implementation environment will be described with reference to FIGS. 2-5 below. Note that embodiments may also be implemented in the context of other computing or operational environments or systems, such as for an individual business data processing system, a private network used with a plurality of client terminals, a remote or on-site data processing system, another form of client-server architecture, and the like.
- the merchant computing device 110 may also be one or more of any number of computing device implementations.
- the merchant computing device 110 may be a personal computer or mobile computing device.
- the merchant computing device 110 may be communicatively coupled to the observation platform 120 through an Internet connection or other communication network.
- the merchant computing device 110 may be configured to execute a merchant observation application (not shown) that may provide various graphical user interfaces (GUIs) for a merchant to navigate and utilize the observation platform 120 , such as, for example, establishing an observation campaign.
- GUIs graphical user interfaces
- Each observer computing device 130 , 131 , and 132 may also be one or more of any number of computing device implementations.
- each observer computing device 130 , 131 , and 132 may be a mobile computing device.
- Each observer computing device 130 , 131 , and 132 may be communicatively coupled to the observation platform 120 through an Internet connection or other communication network.
- each observer computing device 130 , 131 , and 132 may be configured to execute an observer application (not shown) that may provide various GUIs for an observer to navigate and utilize the observation platform 120 , such as, for example, fulfilling an opportunity in an observation campaign.
- an observer application not shown
- FIG. 2 Various operations and parameters of the observer computing devices 130 , 131 , and 132 are also described further below with respect to FIG. 2 .
- FIG. 2 is a more detailed block diagram of the basic system of FIG. 1 illustrating elements or components of an example system 200 in which an embodiment of the subject matter disclosed herein may be implemented. Some elements of FIG. 1 are also shown in FIG. 2 and bear the same reference numerals.
- the observation platform 120 may be coupled to computer network 205 such as the Internet, just as observer computing device 130 , 132 , and 132 are also connected via the network 205 .
- computer network 205 such as the Internet
- observer computing device 130 , 132 , and 132 are also connected via the network 205 .
- observer 1 130 through observer n 132 indicates that any number of merchants may be shown as interfacing with the system 200 (whether such interfacing is discrete or collaborative). In this system 200 embodiment, more than one merchant computing device is shown.
- merchant computing devices 210 , 211 , and 212 may represent different merchants who may individually and independently craft observation campaigns on the observation platform 120 via the network 205 .
- a skilled artisan understands that the designation of merchant 1 210 through merchant n 212 indicates that any number of merchants may be shown as interfacing with the system 200 .
- Additional computing devices may also be communicatively coupled to the observation platform 120 via the computer network 205 .
- the system 200 may include a number of retailer computing devices 240 , 241 , and 242 .
- retailer 1 240 through retailer n 242 indicates that any number of merchants may be shown as interfacing with the system 200 .
- the system 200 may include computing devices associated with third party services 250 , private services 251 , and government services 252 .
- the observation platform 120 Prior to discussing the additional roles for these additional computing devices, the observation platform 120 as well as the observers' and merchants' roles are discussed next.
- one embodiment may include a user-based mobile computing device 130 (e.g., a mobile phone, a smart phone, a laptop computer, and handheld computer, a wearable computing device, an augmented reality device, and the like) configured to execute an observation application to coordinate observing and collecting of real-world data.
- the system may include an observation server computer 120 configured to send notifications that include one or more opportunities for observations of real-word data to the user-based mobile computing device 130 and configured to receive real world data observed and collected by the user-based mobile computing device 130 .
- the system may include a merchant-based computing device 210 communicatively coupled to the observation server computer 120 and configured to generate and control a campaign of opportunities sent by the observation server computer 120 .
- the observation platform 120 may be one or more computing devices configured to work as a server computing entity in a cloud-based computing environment to establish and facilitate observation campaigns for one or merchants.
- an observation campaign is a set of parameters established by a merchant using one or more inter-related applications operating in the system 200 and coordinated from the observation platform 120 .
- the observation campaign may include a number of parameters designed to encourage various remote users of an observation application (e.g., observers) to collect real-world data about products and goods for sale at various retail locations.
- a merchant that establishes an observation campaign using the observation platform 120 desires to know more about the retail locations and point of sale for goods and products in the marketplace. For example, a merchant may negotiate a deal to have products placed in specific eye-level locations on shelves at retail locations and may wish to verify that the products are, in fact, placed on eye-level shelves at the various retail locations.
- an observation campaign eliciting this kind of real-world data (e.g., digital images of the product for sale on eye-level shelves at a particular retail location)
- the merchant can incentivize observers (through compensation offered by the observation platform) to fulfill the requirements of the specific real-world data collection.
- the merchant may enable an observation campaign through a contract with a proprietor of the observation platform such that the observation platform then offers monetary compensation to one or more observers in exchange for a timely and meaningful collection of real-world data (e.g., a picture) of the merchant's product for sale at a specific retail location.
- real-world data e.g., a picture
- real-world data may refer to specific observable facts about anything of interest to the coordinator of the campaign.
- Real-world data may be data that can be collected in the real world (as opposed to data that may reside on a retailer's computer).
- real-world data may be a digital image of a product for sale at a retail location such that data may be gleaned from the image, such as product location on a shelf, product location in proximity to other products, product label facing outwards, product price can be seen, product price is correct, additional promotional material is proximate, and the like.
- Real-world data includes any observable verifiable data point collectable through any manner of sensing, recording, or observing.
- any merchant can use the observation platform to design an observation campaign to incentivize observers to collect very specific kinds of real-world data at very specific locations over very specific time frames.
- the merchant may establish observation opportunities based on a desired time frame; for example, a campaign may only have opportunities offered for a one-week time frame or just a few hours in any given day.
- the merchant may establish observation opportunities based on a desired location such as retail locations in a specific city or within 100 miles of a particular location.
- the merchant may establish observation opportunities based on a desired total number of observations—e.g., a cap of 10 different successful observations.
- Other campaign parameters are possible and discussed further below with respect to FIG. 3 .
- notifications may be sent as notifications to observers (via a smart phone application and the like). Such notifications may be influenced by geographic location of various observers (e.g., notifications are only sent to observers proximate to a desired observation retail location). Further, such notification may be influenced by a relative reputation of an observer (e.g., only the “best” observers receive certain opportunities).
- the observer may accept the opportunity and begin an observation. Some opportunities may have time limits for acceptance of the opportunity and/or time limits for fulfillment of an accepted opportunity.
- the observation may be simply sending the requested real-world data to the observation platform 120 for evaluation.
- the observation platform may include a module for determining 260 whether the received real-world data from any observer meets the requirements and parameters of an opportunity in an active observation campaign.
- the determination module 260 may be configured to determine if the received real-world data from the observer (e.g., sent from user-based mobile computing device) fulfills one or more criteria for data collection in the observation campaign opportunity. Such criteria may include timeliness, image quality, data applicability, data completeness and the like.
- a compensation module 261 may initiate compensation to the observer for successfully fulfilling an observation campaign opportunity. Such compensation may be financial or non-financial.
- the compensation module 261 may communicate with one or more third-party services to credit a bank account associated with the observers that fulfilled the opportunity. Further, the compensation module may also track total financial compensation to specific observers and communication said total to government services 252 on an annual or other periodic basis.
- the compensation module 261 may communicate with other private services 251 , such as social media or online retail, to provide non-financial remuneration to the observer. For example, the observer may qualify for discounts or privileges at third party locations (e.g., food coupons, gift cards, free entry into a sporting event, and the like).
- FIG. 3 is a data structure diagram illustrating parameters of an example observation campaign 300 used in conjunction with the system of FIG. 2 according to an embodiment of the subject matter disclosed herein.
- one or more merchants may establish and coordinate an observation campaign with several different configurable parameters.
- FIG. 3 is an illustration of a data structure of one embodiment of an observation campaign 300 . It is understood that the parameters shown in FIG. 3 are illustrative and any number of parameters (either greater of fewer than shown in FIG. 3 ) may be present. These parameters assist in shaping how observers will be incentivized to collect real world data in response to opportunities presented in the campaign 300 . It is also understood that certain identification and demographic parameters (such as merchant name, merchant product, bank data, and the like) may also be established with respect to the merchant. These are not discussed here as the focus of FIG. 3 is on the customizable parameters of an observation campaign 300 .
- a first parameter in which a merchant may customize an observation campaign 300 is a total cost outlay 310 .
- the merchant and the proprietor of the observation platform reach an agreement about the total cost of the observation campaign.
- the observation platform may then set specific compensation rates for successful observation in order to meet the needs of the established observation campaign.
- the merchant or the observation platform may choose to designate a maximum (or minimum) amount of financial compensation to be awarded to observers for successfully retrieving real-world data in fulfillment of an observation opportunity.
- This may be an aggregated amount on a per campaign basis. For example, a merchant may wish to collect data about as many product placements as possible until a threshold amount of money has been reached (in terms of financial compensation to all observers in an aggregate manner).
- This total may also be an aggregate cost outlay for non-financial outlay (e.g., a limit of 10 discount coupons awarded).
- the merchant may also configure a parameter associated with a total cost per observation 311 .
- the individual observation may be capped at a maximum amount of financial or non-financial compensation.
- the merchant may also define a minimum cost per observation and can establish a sliding scale for cost per observation according to a number of different variables. For example, the merchant may choose to pay more per observation for the first 10 observations and then drop the cost per observation. As another example, the cost per observation may be more during a particular time period, such as late night and then less during a different time period, such as morning. Thus, additional parameters regarding variable cost per transaction 317 may be configured.
- the merchant may configure a parameter associated with a total number of observations 312 . In this manner, each observation may be counted and once a limit has been reached, the campaign is suspended.
- the merchant may also define a minimum number of observations needed in order for a campaign to end at a time limit or within a time frame 313 .
- the merchant may establish a fixed time frame 313 in which the campaign must begin and end. For example, the merchant may choose to establish a time frame of June 1 st to June 30 th for which a total number of observations in limited to 1000. Once 1000 observations are reached, the campaign may end. Also, the merchant may establish 100 observations as a minimum threshold in which case, the campaign can only end on June 30 th if 100 observations are entered.
- the merchant may configure a parameter associated with a geographic limitation 314 of the campaign.
- geographic parameters may be established, such as a relative geographic limit of a state, city of country or an absolute geographic limit of within 500 miles of a specific location (company headquarters, for example).
- the merchant may configure a parameter associated with a diminishing cost per observation 315 , choosing to pay more for initial observations when compared to later observations.
- the parameters may be reversed to pay more for each additional observation after a certain threshold has been reached.
- the merchant may limit observers who can participate in a campaign to only observers who have reached a specific observer reputation score or ranking 316 .
- Additional parameters in a campaign may include failure parameters 318 that may suspend a campaign if a threshold of failed observations is entered or the real-world data collected in initial observations indicates that additional failures will be imminent or predictable. There may be restrictions on the type and quality of images received from observers based on image quality parameters 319 .
- the merchant may establish opportunity lockout parameters 320 for observers who accept an opportunity and then are given two hours of exclusivity to the opportunity to fulfill it.
- a merchant may define a successful campaign termination parameter 321 so that a campaign may end when a threshold number of successful observations has been reached or a statistically valid number of successful observations is reached.
- There are additional parameters that may be configured in an observation campaign 300 but are not discussed herein for brevity.
- FIG. 4 is a method flow diagram illustrating a method for optimizing an observation campaign through analysis of collected data using the example system of FIG. 2 according to an embodiment of the subject matter disclosed herein.
- An observation campaign may be established with a number of parameters chosen by the campaign coordinator to incentivize collection of real-world data that suits the needs of the campaign coordinator. However, in a complex incentive environment across a cloud platform involving many unrelated individuals, a great amount of guess work may be involved in initially establishing the parameters of the observation campaign. Thus, the campaign coordinator may also establish specific metrics with specific parameters in an effort to automatically modify the observation campaign in response to real-world data being collected and analyzed against one or more metrics.
- the observation campaign may establish a specific geographic location having a perimeter surrounding the map point (e.g., a radius of one mile surrounding a location.
- a radius of one mile surrounding a location may then receive an alert via an observation application executing on the observer's smart phone indicating that the observation opportunity is available.
- a metric may be established that tracks the number of observations over a set time period. Thus, if 24 hours pass without a single observation, this metric may be used to then change the one mile radius parameter by which observers are notified. For example, the radius may be increased to two miles or three miles.
- an observation campaign may be established providing opportunities to observers that offer a $5.00 payment in return for a valid observation. After a set period of time or after a set number of observations, the rate of successful observation over the time period may be analyzed against a metric. In an embodiment, the analysis may result in determining that the observation campaign is returning more observations that what is required for meaningful, statistical conclusions about the real-world data. As a result, the observation campaign parameter regarding payment offered per observation may be reduced from $5.00 to $3.00.
- the system and method may be established for the observation campaign platform to receive electronic communications from one or more remote computing devices (observer's smart phones, for example) wherein each electronic communication includes real-world data corresponding to parameters of an observation campaign.
- the observation campaign platform analyzes the received real-world data against a metric corresponding to one or more parameters and determines whether or not any parameter should be changed.
- metrics analysis of collected real-world data against parameters of an observation campaign that are globally illustrated in the general flow diagram of the method of FIG. 4 .
- the method of FIG. 4 may begin at step 402 where an observation campaign is established at an observation campaign platform.
- the observation campaign may be established by an observation campaign coordinator (for example, a merchant wishing to know about retail products offered for sale at retail locations) who may select a number of campaign parameters defining an overall observation campaign.
- Such an observation campaign may initially be defined by the nature of the real-world data to be collected at step 470 . That is, the coordinator may establish the real-world data to be collected as a digital image of a product for sale on a shelf.
- the campaign coordinator may then establish various parameters of the observation campaign at step 471 . A great number of parameters may be established including at least the parameters discussed above with respect to FIG. 3 .
- the campaign coordinator may establish various metrics for the various parameters of the observation campaign at step 472 .
- the various metrics provide tools for analysis of the collected real-world data such that parameters may be altered in response to the analysis.
- the campaign coordinator may establish various measurement thresholds at step 473 such that an established threshold is to be met before an analysis is triggered against a metric that may possibly alter a parameter. That is, a specific number of observations (e.g., a threshold of observations) may be needed before any meaningful analysis can be (or even should be) conducted such that the observation campaign parameters are altered.
- the observation campaign may be launched at step 404 .
- Launching the observation campaign may include storing all established settings, parameters, metrics and thresholds in a data store at or otherwise associated with the observation campaign platform.
- the observation campaign may be searchable by an observation application executing on remote mobile computers.
- electronic communications are sent to remote mobile computers that meet a specific set of criteria (e.g., within a geographic location, observer reputation score threshold, and the like).
- real-world data may be received and collected at step 406 .
- the real-world data may be initially analyzed at the observation campaign platform as to whether or not the received communication contains valid real-world data that can be used at query step 408 . For example, an assessment may be made to determine if a received digital image is in focus or captures the correct real-world data. As another example, meta data about the real-world data, such as timestamp, and IP address origination and path may be used to validate the received real-world data. If the real-world data is assessed to be valid, it may be then assimilated into a collection of real-world data for one or more observation campaigns at step 410 .
- a threshold in this context, may be defined at a specific number of observations since an observation campaign has been initiated or may be the passage of a specific amount of time since the beginning of a campaign. In other embodiments, the threshold may be a specific time interval, such as every 72 hours. In yet further embodiments, the threshold may be an accumulation of compensation value handed out to observers for successful observations. Still further, the threshold to be met may the combination of two or more thresholds (e.g., after the passage of at least 72 hours and the collection of 10 observations). Other thresholds scenarios are possible but not discussed further herein for brevity.
- the method may move to an analysis stage at step 416 .
- the method may loop back to a data collection step 406 until one or more thresholds are met.
- the collected data may be compared against a specific metric with regard to a specific parameter. Such a metric comparison and various examples of a metric are discussed further below. For now, if the metric used is met (e.g., the collected data shows that a parameter should change after the metric analysis) then the method moves to step 420 where one or more specific observation campaign parameters are changed.
- the method may loop back to a data collection step 406 until one or more thresholds are met again. Additionally, after the metric is analyzed, the specific threshold that was met to trigger the analysis may be reset (e.g., if the threshold was ten observations, then the new threshold would again be ten observations from this point in time).
- a metric may simply be any manner of measuring the quantity, quality, rate, usability, and the like of the real-world data.
- the metric may be a rate of successful observations given a specific time period or given a specific geographic location. A low success rate may lead to a parameter change requiring at least a certain level of reputation for an observer than can fulfill the opportunity. Similarly, if the success rate is rather high over a period of time, compensation per observation may be lowered as the campaign may be generating too much data to provide any meaningful insight beyond a first set of real-world world data (e.g., diminishing returns on value of duplicative data).
- the metric may be a failure rate for observations.
- the metric may be rate of data collection for a given geographic area or during specific hours of the day.
- a metric analysis may also delve deeper into collected data to analyze specific real-world data against specific geographic regions (e.g., a perimeter of 3 miles surrounding a city center), specific demographics (e.g., the business district) and a specific clustering of collected data (e.g., locations near most observers, time stamps during waking hours, and the like).
- the metric may be used to determine whether a specific parameter is to be changed in an observation campaign.
- various observation campaigns may also pool collected real-world data metric analysis to collectively change campaign parameters across multiple campaigns. This would allow unrelated observation campaigns to influence best practices for any observation campaign.
- globally assimilated campaign data may then lead to the establishment and updating of observation campaign templates having differently focused goals (e.g., fastest data collection, most reliable data collection, and the like). Such sharing of assimilated data analysis between campaigns is discussed next with respect to FIG. 5 .
- FIG. 5 is a method flow diagram illustrating a method for pooling resources between observation campaigns through analysis of collected data using the example system of FIG. 2 according to an embodiment of the subject matter disclosed herein.
- the method of FIG. 5 may begin at step 502 where an observation campaign is established at an observation campaign platform.
- the observation campaign may be established by an observation campaign coordinator who may select a number of campaign parameters defining an overall observation campaign.
- Such an observation campaign may initially be defined by the nature of the real-world data to be collected at step 570 . That is, the coordinator may establish the real-world data to be collected as a digital image of a product for sale on a shelf.
- the campaign coordinator may then establish various parameters of the observation campaign at step 571 .
- the campaign coordinator may establish various metrics for the various parameters of the observation campaign at step 572 .
- the various metrics provide tools for analysis of the collected real-world data such that parameters may be altered in response to the analysis.
- the campaign coordinator may establish various measurement thresholds at step 573 such that an established threshold is to be met before an analysis is triggered against a metric that may possibly alter a parameter. That is, a specific number of observations (e.g., a threshold of observations) may be needed before any meaningful analysis can be (or even should be) conducted such that the observation campaign parameters are altered.
- the campaign establishment steps may be repeated in simultaneous fashion for several concurrent observation campaigns.
- the observation campaigns may be launched at step 504 .
- launching the observation campaign may include storing all established settings, parameters, metrics and thresholds in a data store at or otherwise associated with the observation campaign platform.
- Each observation campaign may be searchable by observation application executing on remote mobile computers.
- electronic communications are sent to remote mobile computers that meet a specific set of criteria (e.g., within a geographic location, reputation score threshold, and the like).
- real-world data may be received and collected at step 506 .
- a query step 508 may determine if there are similar observation campaigns that may benefit from sharing analytics data that may be collected and assimilated. If this observation is to be a standalone observation campaign (e.g., no data sharing) then data may simply be collected at step 506 without regard to analytics or data sharing. However, if a newly launched observation campaign is to be included in a data sharing methodology, then specific parameters that define the nature of the data sharing may be set at step 510 . Further, the similar observation campaigns may also comingle available compensation to incentive observation by observers at step 512 .
- an assessment of one or more established thresholds may be queried at step 514 similar to the method discussed with respect to FIG. 4 . If a specific threshold is met at the query step 514 , the method may move to an analysis stage at step 516 . Of course, if a threshold is not met at the query step 514 , the method may loop back to a data collection step 506 until one or more thresholds are met. At the data analysis step 516 , the collected data may be compared against a specific metric with regard to a specific parameter. Such a metric comparison and various examples of a metric were discussed previously with respect to FIG. 4 .
- the method moves to step 520 where one or more specific observation campaign parameters are changed for each observation campaign in the grouping of campaigns. Again, if the metric analysis is negative at step 516 , then the method may loop back to a data collection step 506 until one or more thresholds are met again. Additionally, after the metric is analyzed, the specific threshold that was met to trigger the analysis may be reset (e.g., if the threshold was ten observations, then the new threshold would again be ten observations from this point in time).
- FIG. 6 is a diagram illustrating elements or components that may be present in a computer device or system configured to implement a method, process, function, or operation in accordance with an embodiment.
- the system, apparatus, methods, processes, functions, and/or operations for enabling efficient configuration and presentation of a user interface to a user based on the user's previous behavior may be wholly or partially implemented in the form of a set of instructions executed by one or more programmed computer processors such as a central processing unit (CPU) or microprocessor.
- CPU central processing unit
- microprocessor microprocessor
- Such processors may be incorporated in an apparatus, server, client or other computing or data processing device operated by, or in communication with, other components of the system.
- FIG. 6 is a diagram illustrating elements or components that may be present in a computer device or system 600 configured to implement a method, process, function, or operation in accordance with an embodiment.
- the subsystems shown in FIG. 6 are interconnected via a system bus 602 . Additional subsystems include a printer 604 , a keyboard 606 , a fixed disk 608 , and a monitor 610 , which is coupled to a display adapter 612 .
- Peripherals and input/output (I/O) devices which couple to an I/O controller 614 , can be connected to the computer system by any number of means known in the art, such as a serial port 616 .
- serial port 616 or an external interface 618 can be utilized to connect the computer device 600 to further devices and/or systems not shown in FIG. 6 including a wide area network such as the Internet, a mouse input device, and/or a scanner.
- the interconnection via the system bus 602 allows one or more processors 620 to communicate with each subsystem and to control the execution of instructions that may be stored in a system memory 622 and/or the fixed disk 608 , as well as the exchange of information between subsystems.
- the system memory 622 and/or the fixed disk 608 may embody a tangible computer-readable medium.
- any of the software components, processes or functions described in this application may be implemented as software code to be executed by a processor using any suitable computer language such as, for example, Java, JavaScript, C++ or Perl using, for example, conventional or object-oriented techniques.
- the software code may be stored as a series of instructions, or commands on a computer readable medium, such as a random access memory (RAM), a read only memory (ROM), a magnetic medium such as a hard-drive or a floppy disk, or an optical medium such as a CD-ROM.
- RAM random access memory
- ROM read only memory
- magnetic medium such as a hard-drive or a floppy disk
- optical medium such as a CD-ROM.
- Any such computer readable medium may reside on or within a single computational apparatus, and may be present on or within different computational apparatuses within a system or network.
Abstract
Systems, apparatuses, and methods for improving an observation campaign in response analytical data collected form observations. An observation campaign may be a set of campaign parameters designed to incentivize observers of real-world data to collect and send electronic communication of the collected real-world data to the observation platform. By analyzing the collected real-world data against one or more defined metrics, one or more parameters of the observation campaign may be changed in an effort to improve the collection of the real-world data. Further, the improved set of observation campaign parameters may be used to establish or improve observation campaign templates as well as improving similar bit unrelated observation campaign.
Description
- Individuals and businesses often desire to collect data about various situations that exist in the real-world. For example, a manufacturer of a product may wish to collect data about how the product is being displayed at a retail location. However, individuals and enterprises, and government and non-governmental agencies, often do not have the time and/or resources available to travel to myriad locations or employ agents to do so. This challenge becomes amplified as the time window for the information collection becomes more specific and/or the physical locations from which the information is to be collected grow in number or distance. For example, merchants in the delivery chain of products for retail sale, whether manufacturers, wholesalers, brokers, or the like, may need to determine if, when, how much, in what way or condition, or at what price their goods are being put in front of consumers. Another example might be a property or business owner that contracts for a periodic service about which they would like to validate the quality and completeness of service delivery. In short, the condition of physical locations or some physically observable condition at the locations is desirable data to observe, obtain, and document.
- Sometimes these needs for data occur in a predictable recurring pattern. The data may also be best obtained within a narrow time window. For example, a restaurant owner checking on bathroom cleanliness may only desire to obtain the information for the first hour in which a restaurant is open, as after that, customers may have used the bathrooms extensively. In another example, merchants who sell goods and products through retailers often have guidelines, rules, and restrictions for how various retailers are to present and price the goods and products at the purchase location. For example, merchants may wish to negotiate with retailers for specific shelf space for the merchant's goods and products or the merchant may wish to disallow lowering of the retail price for the merchant's goods and products.
- Individuals and business wishing to obtain observable real-world data may hire staff to ensure that the various standards, conditions, guidelines, rules, and/or restrictions are met. That is, employees or agents may travel to various locations at various times to observe and collect the real-world data with regard to various conditions, guidelines, rules, and/or restrictions in order to ensure satisfaction and compliance. Of course, such employees and agents can be expensive in terms of payroll and travel expenses. Therefore, organizations often must rely on others to follow the negotiated conditions, guidelines, rules, and restrictions. However, at times, those other actors often have little incentive to go to any great length to ensure that standards or conditions are met or to ensure compliance with applicable guidelines, rules, and/or restrictions. As a result, many businesses are unable to ensure that their standards, conditions, guidelines, rules, and/or restrictions are followed with regularity.
- Embodiments of the subject matter disclosed herein in accordance with the present disclosure will be described with reference to the drawings, in which:
-
FIG. 1 is a basic block diagram illustrating elements or components of an example system in which an embodiment of the subject matter disclosed herein may be implemented; -
FIG. 2 is a more detailed block diagram of the basic system ofFIG. 1 illustrating elements or components of an example system in which an embodiment of the subject matter disclosed herein may be implemented; -
FIG. 3 is a data structure diagram illustrating parameters of an example observation campaign used in conjunction with the system ofFIG. 2 according to an embodiment of the subject matter disclosed herein; -
FIG. 4 is a method flow diagram illustrating a method for optimizing an observation campaign through analysis of collected data using the example system ofFIG. 2 according to an embodiment of the subject matter disclosed herein; -
FIG. 5 is a method flow diagram illustrating a method for pooling resources between observation campaigns through analysis of collected data using the example system ofFIG. 2 according to an embodiment of the subject matter disclosed herein; and -
FIG. 6 is a diagram illustrating elements or components that may be present in a computer device or system configured to implement a method, process, function, or operation in accordance with an embodiment. - Note that the same numbers are used throughout the disclosure and figures to reference like components and features.
- The subject matter of embodiments disclosed herein is described here with specificity to meet statutory requirements, but this description is not necessarily intended to limit the scope of the claims. The claimed subject matter may be embodied in other ways, may include different elements or steps, and may be used in conjunction with other existing or future technologies. This description should not be interpreted as implying any particular order or arrangement among or between various steps or elements except when the order of individual steps or arrangement of elements is explicitly described.
- Embodiments will be described more fully hereinafter with reference to the accompanying drawings, which form a part hereof, and which show, by way of illustration, exemplary embodiments by which the systems and methods described herein may be practiced. These systems and methods may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will satisfy the statutory requirements and convey the scope of the subject matter to those skilled in the art.
- By way of overview, the systems and methods discussed herein may be directed to an observation platform for coordinators, merchants, retailers, and users to establish, utilize and fulfill an observation campaign suited to verify real-world implementations surrounding observable, standards, conditions, rules, guidelines, and/or restrictions. The observable data points may be part of an overall strategy in an observation campaign established by an observation campaign coordinator. Such a strategy may often involve determining data points like specific product placement, product pricing, and product incentives at the retail location. A user of this platform, called an observer hereinafter, may use an application downloaded to and executing on a computing device, to identify specific observation campaign opportunities. An observation campaign may be a set of verifiable parameters that define specifics about an observation campaign strategy. These verifiable parameters may include specific observable and verifiable real-world data such as where a product is placed on a retail shelf, whether promotional materials are displayed with the product, inventory count, and product pricing.
- Once an opportunity is identified and accepted, the user may collect the real-world data through various methods including, key entry, temperature observance, sound recording, video recording, barometric pressure observance, sound-pressure level observance and image capture (using one or more applications executing on a computing device, such as a mobile phone). The captured real-world data may then be uploaded to the observation platform in order to determine if the parameters of the observation campaign have been met (e.g., correct data, clear image, timely collection, and the like). If the collected and now uploaded real-world data is verified, then the collected real-world may be further analyzed against various data metrics (e.g., success rate of observations, failure rate of observations, geographic data analysis, overall observation rate) in order to determine if any parameters of an observation campaign should be changed to address a data metrics issue (e.g., observation are not timely enough, observations are lacking in a specific geographic region). Such analytical data may be used to improve parameters of an observation campaign to better achieve the observation goals. These and other aspects are described in greater detail below with respect to
FIGS. 1-6 . -
FIG. 1 is a basic block diagram illustrating elements or components of anexample system 100 in which an embodiment of the subject matter disclosed herein may be implemented. In the context ofFIG. 1 and other figures, a continuing example of a merchant-based observation campaign will be used. Thus, various real-world data points specific to a merchant that sells goods at retail locations will also be used in context. A skilled artisan understands that the coordinator of an observation campaign need not be a merchant with merchant-specific data points. For example, a coordinator of an observation campaign may be a quality-assurance coordinator seeking to collect data about installations of observable projects, e.g., power transmission pole installations, bathroom conditions in public transit, traffic conditions, and the like. In short, a coordinator of an observation campaign may be any individual, business, government agency, or entity that wishes to incentivize observers to collect real-world data from myriad locations. However, for ease of illustration and for consistent examples, the remaining disclosure will use the merchant product and retail location example without limiting the interpretation or scope of the claims or specification. - As discussed briefly above in an overview, an
observation platform 120 provides systems and methods for amerchant 110 to establish and implement an observation campaign forvarious observers merchant 110. In thissystem 100, themerchant block 110, theobservation platform block 120 and eachobserver block - The
observation platform 120 may be embodied in whole or in part as a computing system that includes one or more server computers configured in a cloud-based computing environment. Embodiments may take the form of a hardware implemented embodiment, a software implemented embodiment, or an embodiment combining software and hardware aspects. Further, various computing aspects of the underlying systems and methods may transcend any specific computing entity and the “block” diagram nature ofFIG. 1 is intended to illustrate one embodiment. For example, in some embodiments, one or more of the operations, functions, processes, or methods described herein may be implemented by one or more suitable processing elements (such as a processor, microprocessor, CPU, controller, etc.) that are part of a client device, server, network element, or other form of computing or data processing device/platform and that is programmed with a set of executable instructions (e.g., software instructions), where the instructions may be stored in a suitable non-transitory data storage element. In some embodiments, one or more of the operations, functions, processes, or methods described herein may be implemented by a specialized form of hardware, such as a programmable gate array, application specific integrated circuit (ASIC), or the like. This detailed description is, therefore, not to be taken in a limiting sense. - As alluded to, in some embodiments, the subject matter may be implemented in the context of a “cloud” based computing environment typically used to develop and provide web services and business applications for end users. Further aspects of an exemplary implementation environment will be described with reference to
FIGS. 2-5 below. Note that embodiments may also be implemented in the context of other computing or operational environments or systems, such as for an individual business data processing system, a private network used with a plurality of client terminals, a remote or on-site data processing system, another form of client-server architecture, and the like. - The
merchant computing device 110 may also be one or more of any number of computing device implementations. In one embodiment, themerchant computing device 110 may be a personal computer or mobile computing device. Themerchant computing device 110 may be communicatively coupled to theobservation platform 120 through an Internet connection or other communication network. Further, themerchant computing device 110 may be configured to execute a merchant observation application (not shown) that may provide various graphical user interfaces (GUIs) for a merchant to navigate and utilize theobservation platform 120, such as, for example, establishing an observation campaign. Various operations and parameters of themerchant computing device 110 are described further below with respect toFIG. 2 . - Each
observer computing device observer computing device observer computing device observation platform 120 through an Internet connection or other communication network. Further, eachobserver computing device observation platform 120, such as, for example, fulfilling an opportunity in an observation campaign. Various operations and parameters of theobserver computing devices FIG. 2 . -
FIG. 2 is a more detailed block diagram of the basic system ofFIG. 1 illustrating elements or components of anexample system 200 in which an embodiment of the subject matter disclosed herein may be implemented. Some elements ofFIG. 1 are also shown inFIG. 2 and bear the same reference numerals. In particular, theobservation platform 120 may be coupled tocomputer network 205 such as the Internet, just asobserver computing device network 205. A skilled artisan understands that the designation ofobserver 1 130 throughobserver n 132 indicates that any number of merchants may be shown as interfacing with the system 200 (whether such interfacing is discrete or collaborative). In thissystem 200 embodiment, more than one merchant computing device is shown. Thus,merchant computing devices observation platform 120 via thenetwork 205. A skilled artisan understands that the designation ofmerchant 1 210 throughmerchant n 212 indicates that any number of merchants may be shown as interfacing with thesystem 200. - Additional computing devices may also be communicatively coupled to the
observation platform 120 via thecomputer network 205. As will be discussed further below, thesystem 200 may include a number ofretailer computing devices retailer 1 240 throughretailer n 242 indicates that any number of merchants may be shown as interfacing with thesystem 200. Further, thesystem 200 may include computing devices associated with third party services 250,private services 251, andgovernment services 252. Prior to discussing the additional roles for these additional computing devices, theobservation platform 120 as well as the observers' and merchants' roles are discussed next. - By way of general overview of the system in
FIG. 2 , one embodiment may include a user-based mobile computing device 130 (e.g., a mobile phone, a smart phone, a laptop computer, and handheld computer, a wearable computing device, an augmented reality device, and the like) configured to execute an observation application to coordinate observing and collecting of real-world data. Further, the system may include anobservation server computer 120 configured to send notifications that include one or more opportunities for observations of real-word data to the user-basedmobile computing device 130 and configured to receive real world data observed and collected by the user-basedmobile computing device 130. Further yet, the system may include a merchant-basedcomputing device 210 communicatively coupled to theobservation server computer 120 and configured to generate and control a campaign of opportunities sent by theobservation server computer 120. - As briefly discussed above, the
observation platform 120 may be one or more computing devices configured to work as a server computing entity in a cloud-based computing environment to establish and facilitate observation campaigns for one or merchants. As used throughout this disclosure, an observation campaign is a set of parameters established by a merchant using one or more inter-related applications operating in thesystem 200 and coordinated from theobservation platform 120. The observation campaign may include a number of parameters designed to encourage various remote users of an observation application (e.g., observers) to collect real-world data about products and goods for sale at various retail locations. - A merchant that establishes an observation campaign using the
observation platform 120 desires to know more about the retail locations and point of sale for goods and products in the marketplace. For example, a merchant may negotiate a deal to have products placed in specific eye-level locations on shelves at retail locations and may wish to verify that the products are, in fact, placed on eye-level shelves at the various retail locations. By establishing an observation campaign eliciting this kind of real-world data (e.g., digital images of the product for sale on eye-level shelves at a particular retail location), the merchant can incentivize observers (through compensation offered by the observation platform) to fulfill the requirements of the specific real-world data collection. That is, the merchant may enable an observation campaign through a contract with a proprietor of the observation platform such that the observation platform then offers monetary compensation to one or more observers in exchange for a timely and meaningful collection of real-world data (e.g., a picture) of the merchant's product for sale at a specific retail location. This eliminates the need for the merchant to employ one or more individuals to travel to the retail location to verify such real-world data. - As used herein, the term real-world data may refer to specific observable facts about anything of interest to the coordinator of the campaign. Real-world data may be data that can be collected in the real world (as opposed to data that may reside on a retailer's computer). In one example, real-world data may be a digital image of a product for sale at a retail location such that data may be gleaned from the image, such as product location on a shelf, product location in proximity to other products, product label facing outwards, product price can be seen, product price is correct, additional promotional material is proximate, and the like. Real-world data includes any observable verifiable data point collectable through any manner of sensing, recording, or observing.
- In this manner, any merchant can use the observation platform to design an observation campaign to incentivize observers to collect very specific kinds of real-world data at very specific locations over very specific time frames. When designing an observation campaign, the merchant may establish observation opportunities based on a desired time frame; for example, a campaign may only have opportunities offered for a one-week time frame or just a few hours in any given day. Further, the merchant may establish observation opportunities based on a desired location such as retail locations in a specific city or within 100 miles of a particular location. Further yet, the merchant may establish observation opportunities based on a desired total number of observations—e.g., a cap of 10 different successful observations. Other campaign parameters are possible and discussed further below with respect to
FIG. 3 . - As opportunities for observation become active (that is, users of the observer application may be offered opportunities via the application) various observers may engage in the various opportunities. Opportunities may be sent as notifications to observers (via a smart phone application and the like). Such notifications may be influenced by geographic location of various observers (e.g., notifications are only sent to observers proximate to a desired observation retail location). Further, such notification may be influenced by a relative reputation of an observer (e.g., only the “best” observers receive certain opportunities).
- Once an opportunity is received, the observer may accept the opportunity and begin an observation. Some opportunities may have time limits for acceptance of the opportunity and/or time limits for fulfillment of an accepted opportunity. The observation may be simply sending the requested real-world data to the
observation platform 120 for evaluation. The observation platform may include a module for determining 260 whether the received real-world data from any observer meets the requirements and parameters of an opportunity in an active observation campaign. Thedetermination module 260 may be configured to determine if the received real-world data from the observer (e.g., sent from user-based mobile computing device) fulfills one or more criteria for data collection in the observation campaign opportunity. Such criteria may include timeliness, image quality, data applicability, data completeness and the like. - If the
determination module 260 determines that the received real-world data from an observer meets the requirements of an observation opportunity, (e.g., the opportunity has been fulfilled), then acompensation module 261 may initiate compensation to the observer for successfully fulfilling an observation campaign opportunity. Such compensation may be financial or non-financial. In one embodiment, thecompensation module 261 may communicate with one or more third-party services to credit a bank account associated with the observers that fulfilled the opportunity. Further, the compensation module may also track total financial compensation to specific observers and communication said total togovernment services 252 on an annual or other periodic basis. In other embodiments, thecompensation module 261 may communicate with otherprivate services 251, such as social media or online retail, to provide non-financial remuneration to the observer. For example, the observer may qualify for discounts or privileges at third party locations (e.g., food coupons, gift cards, free entry into a sporting event, and the like). -
FIG. 3 is a data structure diagram illustrating parameters of anexample observation campaign 300 used in conjunction with the system ofFIG. 2 according to an embodiment of the subject matter disclosed herein. As discussed above, one or more merchants (210-212 ofFIG. 2 ) may establish and coordinate an observation campaign with several different configurable parameters.FIG. 3 is an illustration of a data structure of one embodiment of anobservation campaign 300. It is understood that the parameters shown inFIG. 3 are illustrative and any number of parameters (either greater of fewer than shown inFIG. 3 ) may be present. These parameters assist in shaping how observers will be incentivized to collect real world data in response to opportunities presented in thecampaign 300. It is also understood that certain identification and demographic parameters (such as merchant name, merchant product, bank data, and the like) may also be established with respect to the merchant. These are not discussed here as the focus ofFIG. 3 is on the customizable parameters of anobservation campaign 300. - A first parameter in which a merchant may customize an
observation campaign 300 is atotal cost outlay 310. In this respect, the merchant and the proprietor of the observation platform reach an agreement about the total cost of the observation campaign. The observation platform may then set specific compensation rates for successful observation in order to meet the needs of the established observation campaign. Further, the merchant or the observation platform may choose to designate a maximum (or minimum) amount of financial compensation to be awarded to observers for successfully retrieving real-world data in fulfillment of an observation opportunity. This may be an aggregated amount on a per campaign basis. For example, a merchant may wish to collect data about as many product placements as possible until a threshold amount of money has been reached (in terms of financial compensation to all observers in an aggregate manner). This total may also be an aggregate cost outlay for non-financial outlay (e.g., a limit of 10 discount coupons awarded). - In addition to the total cost outlay, the merchant may also configure a parameter associated with a total cost per
observation 311. In this manner, the individual observation may be capped at a maximum amount of financial or non-financial compensation. The merchant may also define a minimum cost per observation and can establish a sliding scale for cost per observation according to a number of different variables. For example, the merchant may choose to pay more per observation for the first 10 observations and then drop the cost per observation. As another example, the cost per observation may be more during a particular time period, such as late night and then less during a different time period, such as morning. Thus, additional parameters regarding variable cost pertransaction 317 may be configured. - The merchant may configure a parameter associated with a total number of
observations 312. In this manner, each observation may be counted and once a limit has been reached, the campaign is suspended. The merchant may also define a minimum number of observations needed in order for a campaign to end at a time limit or within atime frame 313. Still further, the merchant may establish afixed time frame 313 in which the campaign must begin and end. For example, the merchant may choose to establish a time frame of June 1st to June 30th for which a total number of observations in limited to 1000. Once 1000 observations are reached, the campaign may end. Also, the merchant may establish 100 observations as a minimum threshold in which case, the campaign can only end on June 30th if 100 observations are entered. - The merchant may configure a parameter associated with a geographic limitation 314 of the campaign. Several geographic parameters may be established, such as a relative geographic limit of a state, city of country or an absolute geographic limit of within 500 miles of a specific location (company headquarters, for example). There may be additional parameters about limiting the number of observation within geographic regions or limiting the total cost outlay according to geographic region. Further yet, cost per observation may be configured on a per region basis (e.g., paying more for
region 1 than region 2). - The merchant may configure a parameter associated with a diminishing cost per observation 315, choosing to pay more for initial observations when compared to later observations. The parameters may be reversed to pay more for each additional observation after a certain threshold has been reached. Further, the merchant may limit observers who can participate in a campaign to only observers who have reached a specific observer reputation score or ranking 316.
- Additional parameters in a campaign may include
failure parameters 318 that may suspend a campaign if a threshold of failed observations is entered or the real-world data collected in initial observations indicates that additional failures will be imminent or predictable. There may be restrictions on the type and quality of images received from observers based onimage quality parameters 319. The merchant may establish opportunity lockout parameters 320 for observers who accept an opportunity and then are given two hours of exclusivity to the opportunity to fulfill it. Lastly, in this embodiment, a merchant may define a successfulcampaign termination parameter 321 so that a campaign may end when a threshold number of successful observations has been reached or a statistically valid number of successful observations is reached. There are additional parameters that may be configured in anobservation campaign 300, but are not discussed herein for brevity. -
FIG. 4 is a method flow diagram illustrating a method for optimizing an observation campaign through analysis of collected data using the example system ofFIG. 2 according to an embodiment of the subject matter disclosed herein. An observation campaign may be established with a number of parameters chosen by the campaign coordinator to incentivize collection of real-world data that suits the needs of the campaign coordinator. However, in a complex incentive environment across a cloud platform involving many unrelated individuals, a great amount of guess work may be involved in initially establishing the parameters of the observation campaign. Thus, the campaign coordinator may also establish specific metrics with specific parameters in an effort to automatically modify the observation campaign in response to real-world data being collected and analyzed against one or more metrics. - As but one example, the observation campaign may establish a specific geographic location having a perimeter surrounding the map point (e.g., a radius of one mile surrounding a location. In an embodiment, any observer that travels into the one mile radius region may then receive an alert via an observation application executing on the observer's smart phone indicating that the observation opportunity is available. However, a metric may be established that tracks the number of observations over a set time period. Thus, if 24 hours pass without a single observation, this metric may be used to then change the one mile radius parameter by which observers are notified. For example, the radius may be increased to two miles or three miles.
- As another example, an observation campaign may be established providing opportunities to observers that offer a $5.00 payment in return for a valid observation. After a set period of time or after a set number of observations, the rate of successful observation over the time period may be analyzed against a metric. In an embodiment, the analysis may result in determining that the observation campaign is returning more observations that what is required for meaningful, statistical conclusions about the real-world data. As a result, the observation campaign parameter regarding payment offered per observation may be reduced from $5.00 to $3.00.
- Thus, the system and method may be established for the observation campaign platform to receive electronic communications from one or more remote computing devices (observer's smart phones, for example) wherein each electronic communication includes real-world data corresponding to parameters of an observation campaign. The observation campaign platform then analyzes the received real-world data against a metric corresponding to one or more parameters and determines whether or not any parameter should be changed. There are a great number of further examples of metrics analysis of collected real-world data against parameters of an observation campaign that are globally illustrated in the general flow diagram of the method of
FIG. 4 . - The method of
FIG. 4 may begin atstep 402 where an observation campaign is established at an observation campaign platform. The observation campaign may be established by an observation campaign coordinator (for example, a merchant wishing to know about retail products offered for sale at retail locations) who may select a number of campaign parameters defining an overall observation campaign. Such an observation campaign may initially be defined by the nature of the real-world data to be collected atstep 470. That is, the coordinator may establish the real-world data to be collected as a digital image of a product for sale on a shelf. The campaign coordinator may then establish various parameters of the observation campaign atstep 471. A great number of parameters may be established including at least the parameters discussed above with respect toFIG. 3 . Further, the campaign coordinator may establish various metrics for the various parameters of the observation campaign atstep 472. The various metrics provide tools for analysis of the collected real-world data such that parameters may be altered in response to the analysis. Further yet, the campaign coordinator may establish various measurement thresholds atstep 473 such that an established threshold is to be met before an analysis is triggered against a metric that may possibly alter a parameter. That is, a specific number of observations (e.g., a threshold of observations) may be needed before any meaningful analysis can be (or even should be) conducted such that the observation campaign parameters are altered. - Once all real-world data settings, parameters, metrics and thresholds are established, the observation campaign may be launched at
step 404. Launching the observation campaign may include storing all established settings, parameters, metrics and thresholds in a data store at or otherwise associated with the observation campaign platform. The observation campaign may be searchable by an observation application executing on remote mobile computers. In other embodiments, electronic communications are sent to remote mobile computers that meet a specific set of criteria (e.g., within a geographic location, observer reputation score threshold, and the like). As observers respond to opportunities presented through the now published observation campaign, real-world data may be received and collected atstep 406. - As real-world data is collected, the real-world data may be initially analyzed at the observation campaign platform as to whether or not the received communication contains valid real-world data that can be used at
query step 408. For example, an assessment may be made to determine if a received digital image is in focus or captures the correct real-world data. As another example, meta data about the real-world data, such as timestamp, and IP address origination and path may be used to validate the received real-world data. If the real-world data is assessed to be valid, it may be then assimilated into a collection of real-world data for one or more observation campaigns atstep 410. - After assimilation (or after not assimilating in the case of invalid real-world data), an assessment of one or more established thresholds may be queried at
step 414. As discussed briefly above, a threshold, in this context, may be defined at a specific number of observations since an observation campaign has been initiated or may be the passage of a specific amount of time since the beginning of a campaign. In other embodiments, the threshold may be a specific time interval, such as every 72 hours. In yet further embodiments, the threshold may be an accumulation of compensation value handed out to observers for successful observations. Still further, the threshold to be met may the combination of two or more thresholds (e.g., after the passage of at least 72 hours and the collection of 10 observations). Other thresholds scenarios are possible but not discussed further herein for brevity. - If a specific threshold is met at the
query step 414, the method may move to an analysis stage atstep 416. Of course, if a threshold is not met at thequery step 414, the method may loop back to adata collection step 406 until one or more thresholds are met. At thedata analysis step 416, the collected data may be compared against a specific metric with regard to a specific parameter. Such a metric comparison and various examples of a metric are discussed further below. For now, if the metric used is met (e.g., the collected data shows that a parameter should change after the metric analysis) then the method moves to step 420 where one or more specific observation campaign parameters are changed. Again, if the metric analysis is negative atstep 416, then the method may loop back to adata collection step 406 until one or more thresholds are met again. Additionally, after the metric is analyzed, the specific threshold that was met to trigger the analysis may be reset (e.g., if the threshold was ten observations, then the new threshold would again be ten observations from this point in time). - Turning back to the metrics that are used to analyze the collected real-world data, a metric may simply be any manner of measuring the quantity, quality, rate, usability, and the like of the real-world data. For example, the metric may be a rate of successful observations given a specific time period or given a specific geographic location. A low success rate may lead to a parameter change requiring at least a certain level of reputation for an observer than can fulfill the opportunity. Similarly, if the success rate is rather high over a period of time, compensation per observation may be lowered as the campaign may be generating too much data to provide any meaningful insight beyond a first set of real-world world data (e.g., diminishing returns on value of duplicative data). In a similar manner, the metric may be a failure rate for observations.
- In further examples, the metric may be rate of data collection for a given geographic area or during specific hours of the day. A metric analysis may also delve deeper into collected data to analyze specific real-world data against specific geographic regions (e.g., a perimeter of 3 miles surrounding a city center), specific demographics (e.g., the business district) and a specific clustering of collected data (e.g., locations near most observers, time stamps during waking hours, and the like).
- In any metric analysis, once the metric is established, the metric may be used to determine whether a specific parameter is to be changed in an observation campaign. Further, various observation campaigns may also pool collected real-world data metric analysis to collectively change campaign parameters across multiple campaigns. This would allow unrelated observation campaigns to influence best practices for any observation campaign. Further, such globally assimilated campaign data may then lead to the establishment and updating of observation campaign templates having differently focused goals (e.g., fastest data collection, most reliable data collection, and the like). Such sharing of assimilated data analysis between campaigns is discussed next with respect to
FIG. 5 . -
FIG. 5 is a method flow diagram illustrating a method for pooling resources between observation campaigns through analysis of collected data using the example system ofFIG. 2 according to an embodiment of the subject matter disclosed herein. The method ofFIG. 5 may begin atstep 502 where an observation campaign is established at an observation campaign platform. As discussed above, the observation campaign may be established by an observation campaign coordinator who may select a number of campaign parameters defining an overall observation campaign. Such an observation campaign may initially be defined by the nature of the real-world data to be collected atstep 570. That is, the coordinator may establish the real-world data to be collected as a digital image of a product for sale on a shelf. The campaign coordinator may then establish various parameters of the observation campaign atstep 571. A great number of parameters may be established including at least the parameters discussed above with respect toFIG. 3 . Further, the campaign coordinator may establish various metrics for the various parameters of the observation campaign atstep 572. The various metrics provide tools for analysis of the collected real-world data such that parameters may be altered in response to the analysis. Further yet, the campaign coordinator may establish various measurement thresholds atstep 573 such that an established threshold is to be met before an analysis is triggered against a metric that may possibly alter a parameter. That is, a specific number of observations (e.g., a threshold of observations) may be needed before any meaningful analysis can be (or even should be) conducted such that the observation campaign parameters are altered. The campaign establishment steps may be repeated in simultaneous fashion for several concurrent observation campaigns. - Once each set of real-world data settings, parameters, metrics and thresholds are established for each respective observation campaigns (or at least two or more observation campaigns), the observation campaigns may be launched at step 504. As before, launching the observation campaign may include storing all established settings, parameters, metrics and thresholds in a data store at or otherwise associated with the observation campaign platform. Each observation campaign may be searchable by observation application executing on remote mobile computers. In other embodiments, electronic communications are sent to remote mobile computers that meet a specific set of criteria (e.g., within a geographic location, reputation score threshold, and the like). As observers respond to opportunities presented through the now published observation campaign, real-world data may be received and collected at
step 506. - In this method, after each observation campaign is launched at step 504, a
query step 508 may determine if there are similar observation campaigns that may benefit from sharing analytics data that may be collected and assimilated. If this observation is to be a standalone observation campaign (e.g., no data sharing) then data may simply be collected atstep 506 without regard to analytics or data sharing. However, if a newly launched observation campaign is to be included in a data sharing methodology, then specific parameters that define the nature of the data sharing may be set at step 510. Further, the similar observation campaigns may also comingle available compensation to incentive observation by observers atstep 512. - After assimilation (or after not assimilating in the case of invalid real-world data), an assessment of one or more established thresholds may be queried at
step 514 similar to the method discussed with respect toFIG. 4 . If a specific threshold is met at thequery step 514, the method may move to an analysis stage atstep 516. Of course, if a threshold is not met at thequery step 514, the method may loop back to adata collection step 506 until one or more thresholds are met. At thedata analysis step 516, the collected data may be compared against a specific metric with regard to a specific parameter. Such a metric comparison and various examples of a metric were discussed previously with respect toFIG. 4 . If the metric used is met (e.g., the collected data shows that a parameter should change after the metric analysis) then the method moves to step 520 where one or more specific observation campaign parameters are changed for each observation campaign in the grouping of campaigns. Again, if the metric analysis is negative atstep 516, then the method may loop back to adata collection step 506 until one or more thresholds are met again. Additionally, after the metric is analyzed, the specific threshold that was met to trigger the analysis may be reset (e.g., if the threshold was ten observations, then the new threshold would again be ten observations from this point in time). -
FIG. 6 is a diagram illustrating elements or components that may be present in a computer device or system configured to implement a method, process, function, or operation in accordance with an embodiment. In accordance with one or more embodiments, the system, apparatus, methods, processes, functions, and/or operations for enabling efficient configuration and presentation of a user interface to a user based on the user's previous behavior may be wholly or partially implemented in the form of a set of instructions executed by one or more programmed computer processors such as a central processing unit (CPU) or microprocessor. Such processors may be incorporated in an apparatus, server, client or other computing or data processing device operated by, or in communication with, other components of the system. As an example,FIG. 6 is a diagram illustrating elements or components that may be present in a computer device orsystem 600 configured to implement a method, process, function, or operation in accordance with an embodiment. The subsystems shown inFIG. 6 are interconnected via asystem bus 602. Additional subsystems include aprinter 604, akeyboard 606, a fixeddisk 608, and amonitor 610, which is coupled to adisplay adapter 612. Peripherals and input/output (I/O) devices, which couple to an I/O controller 614, can be connected to the computer system by any number of means known in the art, such as aserial port 616. For example, theserial port 616 or anexternal interface 618 can be utilized to connect thecomputer device 600 to further devices and/or systems not shown inFIG. 6 including a wide area network such as the Internet, a mouse input device, and/or a scanner. The interconnection via thesystem bus 602 allows one ormore processors 620 to communicate with each subsystem and to control the execution of instructions that may be stored in asystem memory 622 and/or the fixeddisk 608, as well as the exchange of information between subsystems. Thesystem memory 622 and/or the fixeddisk 608 may embody a tangible computer-readable medium. - It should be understood that the present disclosure as described above can be implemented in the form of control logic using computer software in a modular or integrated manner. Based on the disclosure and teachings provided herein, a person of ordinary skill in the art will know and appreciate other ways and/or methods to implement the present disclosure using hardware and a combination of hardware and software.
- Any of the software components, processes or functions described in this application may be implemented as software code to be executed by a processor using any suitable computer language such as, for example, Java, JavaScript, C++ or Perl using, for example, conventional or object-oriented techniques. The software code may be stored as a series of instructions, or commands on a computer readable medium, such as a random access memory (RAM), a read only memory (ROM), a magnetic medium such as a hard-drive or a floppy disk, or an optical medium such as a CD-ROM. Any such computer readable medium may reside on or within a single computational apparatus, and may be present on or within different computational apparatuses within a system or network.
- All references, including publications, patent applications, and patents, cited herein are hereby incorporated by reference to the same extent as if each reference were individually and specifically indicated to be incorporated by reference and/or were set forth in its entirety herein.
- The use of the terms “a” and “an” and “the” and similar referents in the specification and in the following claims are to be construed to cover both the singular and the plural, unless otherwise indicated herein or clearly contradicted by context. The terms “having,” “including,” “containing” and similar referents in the specification and in the following claims are to be construed as open-ended terms (e.g., meaning “including, but not limited to,”) unless otherwise noted. Recitation of ranges of values herein are merely indented to serve as a shorthand method of referring individually to each separate value inclusively falling within the range, unless otherwise indicated herein, and each separate value is incorporated into the specification as if it were individually recited herein. All methods described herein can be performed in any suitable order unless otherwise indicated herein or clearly contradicted by context. The use of any and all examples, or exemplary language (e.g., “such as”) provided herein, is intended merely to better illuminate embodiments and does not pose a limitation to the scope of the disclosure unless otherwise claimed. No language in the specification should be construed as indicating any non-claimed element as essential to each embodiment of the present disclosure.
- Different arrangements of the components depicted in the drawings or described above, as well as components and steps not shown or described are possible. Similarly, some features and sub-combinations are useful and may be employed without reference to other features and sub-combinations. Embodiments have been described for illustrative and not restrictive purposes, and alternative embodiments will become apparent to readers of this patent. Accordingly, the present subject matter is not limited to the embodiments described above or depicted in the drawings, and various embodiments and modifications can be made without departing from the scope of the claims below.
Claims (20)
1. A computer-based method, comprising:
receiving an electronic communication from one or more remote computing devices, each electronic communication including real-world data corresponding to at least one parameter that is part of an observation campaign to collect real-world data, the parameters of the real-world campaign stored in a memory and accessible by observation applications executing on the one or more remote computing devices;
analyzing the received real-world data against a metric corresponding to one or more parameters of the observation campaign; and
changing one or more parameters of the observation campaign stored in the memory in response to the received real-world data.
2. The computer-based method of claim 1 , further comprising updating the observation applications executing on the one or more remote computing devices in response to changing one or more parameters.
3. The computer-based method of claim 1 , further comprising establishing the parameters of the observation campaign at a server computer executing an observation campaign platform such that a campaign coordinator sets initial parameters of the observation campaign.
4. The computer-based method of claim 1 , further comprising establishing the metrics of the parameters of the observation campaign at a server computer executing an observation campaign platform such that a campaign coordinator sets initial metrics of the parameters of the observation campaign.
5. The computer-based method of claim 1 , further comprising receiving real-world data until a threshold is met prior to analyzing the collected real-world data against the metric.
6. The computer-based method of claim 5 , wherein the threshold further comprises a threshold amount of collected real-world data.
7. The computer-based method of claim 5 , wherein the threshold further comprises a threshold amount of time for collecting real-world data.
8. The computer-based method of claim 5 , further comprising resetting the threshold if the analysis of the collected real-world data results in changing one or more parameters in the observation campaign.
9. An observation campaign platform executing on one or more networked computers having one or more processors for executing computer instructions, the observation campaign platform comprising:
an observation coordination module configured to execute instructions for establishing an observation campaign having one or more parameters for collecting real-world data;
a data store coupled to the observation campaign module and configured to store the one or more parameters of the observation campaign;
a communication module coupled to the observation campaign module and configured to receive electronic communications from remote computing devices, the electronic communication including collected real-world data corresponding to the observation campaign;
an analysis module coupled to the observation campaign module and configured to analyze the received real-world data against a metric corresponding to one or more parameters of the observation campaign; and
an update module coupled to the observation campaign module and configured to change one or more parameters of the observation campaign stored in the data store in response to the analyzing of the real-world data.
10. The observation campaign platform of claim 9 , wherein the collected real-world data comprises a digital image.
11. The observation campaign platform of claim 9 , wherein the one or more parameters further comprise one of the group including: total cost outlay, total cost per observation, total number of observations, minimum observations, maximum observations, time limit for observations, time frame for observations, geographic limitation on observations, demographic limitation on observation, observer reputation score limitations, data quality parameters, image quality parameters, lockout parameters, exclusivity parameters, and failure parameters.
12. The observation campaign platform of claim 9 , wherein the metric comprises a success rate for observations.
13. The observation campaign platform of claim 9 , wherein the metric comprises a failure rate for observations.
14. The observation campaign platform of claim 9 , wherein the metric comprises a data collection rate.
15. The observation campaign platform of claim 9 , wherein the metric comprises a geographic region perimeter.
16. The observation campaign platform of claim 9 , wherein the metric comprises a clustering of time of observations.
17. The observation campaign platform of claim 9 , wherein the metric comprises a clustering of geographic locations of observations.
18. A cloud-based multi-user observation computing system, comprising:
a plurality of mobile computing devices each executing an observation application configured to communicate with one or more networked computers hosting observation opportunities;
a cloud-based observation platform executing on the one or more networked computers, the observation campaign platform including:
an observation coordination module configured to execute instructions for establishing an observation campaign having one or more parameters for collecting real-world data;
a data store coupled to the observation campaign module and configured to store the one or more parameters of the observation campaign;
a communication module coupled to the observation campaign module and configured to receive electronic communications from remote computing devices, the electronic communication including collected real-world data corresponding to the observation campaign;
an analysis module coupled to the observation campaign module and configured to analyze the received real-world data against a metric corresponding to one or more parameters of the observation campaign; and
an update module coupled to the observation campaign module and configured to change one or more parameters of the observation campaign stored in the data store in response to the analyzing of the real-world data.
19. A cloud-based multi-user observation computing system of claim 18 , wherein the observation campaign platform further comprises an update module coupled to the observation campaign module and configured to send electronic communications to the plurality of mobile computing device with updates to the parameters of the observation campaign in response to changing one or parameters of the observation campaign.
20. A cloud-based multi-user observation computing system of claim 18 , wherein the observation campaign platform further comprises a template module configured to assimilate collected real-world data to generates one or more observation campaign templates having one or more parameters based on one or more metrics.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/217,442 US20210326910A1 (en) | 2016-08-17 | 2021-03-30 | System and method for optimizing an observation campaign in response to observed real-world data |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/239,607 US10990986B2 (en) | 2016-08-17 | 2016-08-17 | System and method for optimizing an observation campaign in response to observed real-world data |
US17/217,442 US20210326910A1 (en) | 2016-08-17 | 2021-03-30 | System and method for optimizing an observation campaign in response to observed real-world data |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/239,607 Continuation US10990986B2 (en) | 2016-08-17 | 2016-08-17 | System and method for optimizing an observation campaign in response to observed real-world data |
Publications (1)
Publication Number | Publication Date |
---|---|
US20210326910A1 true US20210326910A1 (en) | 2021-10-21 |
Family
ID=61190749
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/239,607 Active 2037-01-22 US10990986B2 (en) | 2016-08-17 | 2016-08-17 | System and method for optimizing an observation campaign in response to observed real-world data |
US17/217,442 Pending US20210326910A1 (en) | 2016-08-17 | 2021-03-30 | System and method for optimizing an observation campaign in response to observed real-world data |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/239,607 Active 2037-01-22 US10990986B2 (en) | 2016-08-17 | 2016-08-17 | System and method for optimizing an observation campaign in response to observed real-world data |
Country Status (1)
Country | Link |
---|---|
US (2) | US10990986B2 (en) |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140372160A1 (en) * | 2013-06-14 | 2014-12-18 | Microsoft Corporation | Context-aware mobile crowdsourcing |
US20150161704A1 (en) * | 2013-12-10 | 2015-06-11 | Yahoo!Inc. | Crowdsourcing retail price and location method and system |
US20150178742A1 (en) * | 2013-12-20 | 2015-06-25 | Strum, Inc. | System and Method For The Facilitation of Real-time Customer, Employee and Stakeholder Engagement Through Managed Devices |
US20160171525A1 (en) * | 2014-12-16 | 2016-06-16 | OfferCraft, LLC | Smart rewards incentive system, client tools for implementing a smart rewards incentive system, and analytics engine |
US20160283973A1 (en) * | 2012-07-24 | 2016-09-29 | Corrie-Jones Company LLC | Marketing campaign using engagement value |
US20160350708A1 (en) * | 2015-05-28 | 2016-12-01 | Wal-Mart Stores, Inc. | System and method for inventory management |
US20180247321A1 (en) * | 2015-10-28 | 2018-08-30 | Fractal Industries, Inc. | Platform for management of marketing campaigns across multiple distribution mediums |
US20220092620A1 (en) * | 2015-06-26 | 2022-03-24 | Groupon, Inc. | Method, apparatus, and computer program product for merchant classification |
Family Cites Families (46)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6026387A (en) * | 1996-07-15 | 2000-02-15 | Kesel; Brad | Consumer comment reporting apparatus and method |
US6633851B1 (en) * | 1999-10-01 | 2003-10-14 | B-50.Com, Llc | Systems and methods for generating custom reports based on point-of-sale data |
US20030009373A1 (en) * | 2001-06-27 | 2003-01-09 | Maritz Inc. | System and method for addressing a performance improvement cycle of a business |
US7822816B2 (en) * | 2002-08-19 | 2010-10-26 | Macrosolve, Inc. | System and method for data management |
US20050149382A1 (en) * | 2003-12-24 | 2005-07-07 | Fenner John D. | Method for administering a survey, collecting, analyzing and presenting customer satisfaction feedback |
US20060167971A1 (en) | 2004-12-30 | 2006-07-27 | Sheldon Breiner | System and method for collecting and disseminating human-observable data |
US8751327B2 (en) | 2006-03-20 | 2014-06-10 | Amazon Technologies, Inc. | Facilitating content generation via messaging system interactions |
US20100171826A1 (en) | 2006-04-12 | 2010-07-08 | Store Eyes, Inc. | Method for measuring retail display and compliance |
US9208500B2 (en) | 2006-07-21 | 2015-12-08 | Microsoft Technology Licensing, Llc | Fixed position multi-state interactive advertisement |
US20080183552A1 (en) * | 2007-01-30 | 2008-07-31 | Pied Piper Management Company | Method for evaluating, analyzing, and benchmarking business sales performance |
US7949568B2 (en) | 2007-08-31 | 2011-05-24 | Accenture Global Services Limited | Determination of product display parameters based on image processing |
US10083420B2 (en) | 2007-11-21 | 2018-09-25 | Sermo, Inc | Community moderated information |
WO2009102728A1 (en) | 2008-02-11 | 2009-08-20 | Clearshift Corporation | Online work management system |
US8805110B2 (en) * | 2008-08-19 | 2014-08-12 | Digimarc Corporation | Methods and systems for content processing |
US8064896B2 (en) | 2009-03-09 | 2011-11-22 | Apple Inc. | Push notification service |
US20130282446A1 (en) | 2010-04-15 | 2013-10-24 | Colin Dobell | Methods and systems for capturing, measuring, sharing and influencing the behavioural qualities of a service performance |
CA2810752A1 (en) | 2010-04-26 | 2011-11-03 | Locationary, Inc. | System, method and computer program for creation or collection of information using crowd sourcing combined with targeted incentives |
US20120029978A1 (en) * | 2010-07-31 | 2012-02-02 | Txteagle Inc. | Economic Rewards for the Performance of Tasks by a Distributed Workforce |
US20120047008A1 (en) | 2010-08-17 | 2012-02-23 | Beezag Inc. | Selective Distribution Of Rewards |
US20120265574A1 (en) * | 2011-04-12 | 2012-10-18 | Jana Mobile, Inc. | Creating incentive hierarchies to enable groups to accomplish goals |
US20130018698A1 (en) * | 2011-07-14 | 2013-01-17 | Parnaby Tracey J | System and Method for Facilitating the Provision of Situation-Based Value, Service or Response |
US8821272B2 (en) | 2011-09-26 | 2014-09-02 | Andrew Jack Thomas | System and method of gamification of real-life events |
US9508082B1 (en) * | 2011-10-03 | 2016-11-29 | Groupon, Inc. | Offline location-based consumer metrics using online signals |
US20130132170A1 (en) | 2011-11-18 | 2013-05-23 | Cisco Technology, Inc. | System and method for generating proof of play logs in a digital signage environment |
US20130132987A1 (en) * | 2011-11-21 | 2013-05-23 | General Instrument Corporation | Offering tasks to users based on their competence and on their current activity |
US20140379399A1 (en) | 2012-04-17 | 2014-12-25 | Google Inc. | Method and System for Dynamically Determining Completion Status in a Human Intelligence System |
US20150032533A1 (en) | 2012-07-18 | 2015-01-29 | Simon Raab | System and method for click fraud protection |
US20140180772A1 (en) | 2012-12-04 | 2014-06-26 | Tutupata, Inc. | Finding objects or services utilizing a communication link to enlist the help of and reward third parties to help locate the desired object or service |
US20140343984A1 (en) * | 2013-03-14 | 2014-11-20 | University Of Southern California | Spatial crowdsourcing with trustworthy query answering |
US20140278850A1 (en) * | 2013-03-15 | 2014-09-18 | Vault Ventures Llc | Crowd sourcing business services |
US20140324555A1 (en) | 2013-04-25 | 2014-10-30 | Xerox Corporation | Methods and systems for evaluation of remote workers |
US9361353B1 (en) | 2013-06-27 | 2016-06-07 | Amazon Technologies, Inc. | Crowd sourced digital content processing |
EP3534318A1 (en) | 2013-09-26 | 2019-09-04 | Mark W. Publicover | Providing targeted content based on a user´s moral values |
US20150186953A1 (en) * | 2013-09-27 | 2015-07-02 | John Nicholas And Kristin Gross Trust U/A/D April 13, 2010 | Automated Tool for Property Assessment, Prospecting, and Targeted Marketing |
US20160027051A1 (en) * | 2013-09-27 | 2016-01-28 | Real Data Guru, Inc. | Clustered Property Marketing Tool & Method |
WO2015123751A1 (en) | 2014-02-21 | 2015-08-27 | Rna Labs Inc. | Systems and methods for automatically collecting user data and making a real-world action for a user |
US20150254593A1 (en) | 2014-03-10 | 2015-09-10 | Microsoft Corporation | Streamlined creation and utilization of reference human intelligence tasks |
US20170221156A1 (en) * | 2014-05-30 | 2017-08-03 | Mcrowdsourcing Canada Inc. | Actionable verifiable micro-crowd sourcing |
US20150347520A1 (en) * | 2014-06-02 | 2015-12-03 | Oracle International Corporation | Using crowdsourcing consensus to determine nutritional content of foods depicted in an image |
US20150356489A1 (en) | 2014-06-05 | 2015-12-10 | Microsoft Corporation | Behavior-Based Evaluation Of Crowd Worker Quality |
US20160180365A1 (en) | 2014-12-18 | 2016-06-23 | Boogoo Intellectual Property LLC | Instant Multimedia-Based Customer Feedback System |
US10043145B2 (en) * | 2015-06-01 | 2018-08-07 | International Business Machines Corporation | Just in time learning driven by point of sale or other data and metrics |
US10140641B2 (en) | 2015-08-17 | 2018-11-27 | Adobe Systems Incorporated | Methods and systems for assisting customers shopping at real-world shopping venues |
US20170249574A1 (en) | 2016-02-26 | 2017-08-31 | A2PS Consulting and Software LLC | System for monitoring of workflows capable of automatic task allocation and monitoring of resources |
US10277662B2 (en) * | 2016-05-12 | 2019-04-30 | International Business Machines Corporation | Photo request using a location identifier |
US20180293616A1 (en) | 2017-04-10 | 2018-10-11 | Adam Greenhood | System and methods for obtaining and compiling target consumer input from advertising media |
-
2016
- 2016-08-17 US US15/239,607 patent/US10990986B2/en active Active
-
2021
- 2021-03-30 US US17/217,442 patent/US20210326910A1/en active Pending
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160283973A1 (en) * | 2012-07-24 | 2016-09-29 | Corrie-Jones Company LLC | Marketing campaign using engagement value |
US20140372160A1 (en) * | 2013-06-14 | 2014-12-18 | Microsoft Corporation | Context-aware mobile crowdsourcing |
US20150161704A1 (en) * | 2013-12-10 | 2015-06-11 | Yahoo!Inc. | Crowdsourcing retail price and location method and system |
US20150178742A1 (en) * | 2013-12-20 | 2015-06-25 | Strum, Inc. | System and Method For The Facilitation of Real-time Customer, Employee and Stakeholder Engagement Through Managed Devices |
US20160171525A1 (en) * | 2014-12-16 | 2016-06-16 | OfferCraft, LLC | Smart rewards incentive system, client tools for implementing a smart rewards incentive system, and analytics engine |
US20160350708A1 (en) * | 2015-05-28 | 2016-12-01 | Wal-Mart Stores, Inc. | System and method for inventory management |
US20220092620A1 (en) * | 2015-06-26 | 2022-03-24 | Groupon, Inc. | Method, apparatus, and computer program product for merchant classification |
US20180247321A1 (en) * | 2015-10-28 | 2018-08-30 | Fractal Industries, Inc. | Platform for management of marketing campaigns across multiple distribution mediums |
Non-Patent Citations (2)
Title |
---|
Feld et al, How to Conduct Store Observations of Tobacco Marketing and Products, Feb. 2016 (Year: 2016) * |
Feld et al., How to Conduct Store Observations of Tobacco Marketing and Products, Feb. 2016 (Year: 2016) * |
Also Published As
Publication number | Publication date |
---|---|
US20180053196A1 (en) | 2018-02-22 |
US10990986B2 (en) | 2021-04-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20220058672A1 (en) | System and method for facilitating real-time feedback in response to collection of real-world data | |
US10972867B2 (en) | Location based discovery of real-time merchant device activity | |
JP6788667B2 (en) | Advertising lift measurement | |
US20210287237A1 (en) | System and method for correlating collected observation campaign data with sales data | |
US11941661B2 (en) | Method, apparatus, and computer program product for predicting web browsing behaviors of consumers | |
JP7357244B2 (en) | Store usage information distribution device, store usage information distribution system equipped with the same, and store usage information distribution method | |
EP2863355A1 (en) | Method and system for optimizing value of consumer offers | |
JP5820504B1 (en) | Analysis apparatus and analysis method | |
US11676162B2 (en) | Apparatus and method for enhanced message targeting | |
US9916563B1 (en) | Version recall for computerized catalog management | |
JP5914549B2 (en) | Information processing apparatus and information analysis method | |
US11488135B2 (en) | System and method for using user rating in real-world data observation campaign | |
US20230177544A1 (en) | Methods and systems for determining a travel propensity configured for use in the generation of a supply index indicative of a quality of available supply | |
US20210209622A1 (en) | System and method for collecting real-world data in fulfillment of observation campaign opportunities | |
US20210326910A1 (en) | System and method for optimizing an observation campaign in response to observed real-world data | |
US20210295366A1 (en) | System and method for coordinating a campaign for observers of real-world data | |
US20220044262A1 (en) | System and Method for Collecting Real-World Data Using a Location-Based Computing Device in Fulfillment of Observation Campaign Opportunities | |
WO2018098165A1 (en) | System and method for coordinating a campaign for observers of real-world data | |
US11620588B2 (en) | Methods and systems for determining alternative plans | |
US20140244357A1 (en) | Inducing Customer Store Visits Via Mobile Application | |
US11295343B1 (en) | System and apparatus for self-forming ad-hoc group promotions | |
TWM607278U (en) | Server side for generating customer recommendation list | |
CN117035876A (en) | Data object exchange method, device and server |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |