CN101395626A - Mobile query system and method based on visual cues - Google Patents
Mobile query system and method based on visual cues Download PDFInfo
- Publication number
- CN101395626A CN101395626A CNA2005800156447A CN200580015644A CN101395626A CN 101395626 A CN101395626 A CN 101395626A CN A2005800156447 A CNA2005800156447 A CN A2005800156447A CN 200580015644 A CN200580015644 A CN 200580015644A CN 101395626 A CN101395626 A CN 101395626A
- Authority
- CN
- China
- Prior art keywords
- image
- user
- mobile
- information
- response message
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
A mobile query and response system and method that is based on visual cues, in which a user captures and transmits an image with a networked mobile device such as a cell phone or PDA with image capture and transmission capabilities. Searchable records that include stored image data and response information associated with such data are provided. The image transmitted by the user is used to perform a search of the records, to find in the records an image that matches the transmitted image. If a match is found, the response information associated with the stored image data for the matching image is retrieved, and that response information is used to send a reply to the user.
Description
Technical field
The present invention relates to the people and carry out mutual field by using mobile enquiry system and visual image based on visual cues.
Background technology
The advertiser wishes their product/service of purchase of customer or may take certain other behaviors, as the direct response to advertisement.Yet, in most of the cases, between advertisement and client's behavior, do not have direct, appreciable contact.Therefore, for the advertiser, just be difficult to estimate the effect of their advertising campaign.
Summary of the invention
The present invention relates to the people and carry out mutual field by using mobile enquiry system and visual image based on visual cues.The visual cues that causes user interest can be the vision content from arbitrary form, such as advertisement, sign, mark and editorial (editorial), perhaps can be daily pursuits, such as flower, road sign, pet or people's face.Visual cues is a visual image, and it can comprise text and/or figure and/or things.Medium can have a variety of, such as magazine, newspaper, notice board, placard, catalogue, direct mail advertising, the packing of product, buildings, clothes or advertising balloon (blimp).Visual image can realize by variety of way, such as being printed on the paper or on the fabric, lighting backlight on display or utilizes electronic equipment as TV, and perhaps visual image can be a daily pursuits.
New-type mobile phone includes a lot of functions based on availability of wireless data services.These services make it possible to transmit text, audio frequency, image and video information between mobile phone and other system.The user of mobile phone can use the application that has improved equipment validity, such as receive message notifying, with friend's image sharing, play games and search music and listen.Camera phone has been introduced a kind of new information source collecting function that can use for the mobile phone user.
Mobile enquiry system of the present invention and method are used a kind of networking mobile device with embedded video camera, such as camera phone, the digital camera that has the PDA of integrated or additional cameras or have wireless data connectivity.The present invention also uses the wireless network data service.These services are based on the procotol of a component layers.It is general application that image information sends, and it utilizes these networks and is available for the user of camera phone.Image information sends application specifies, to be included in and will send to the message of remote equipment from wireless mobile apparatus from the digital picture (the normally recent photo of being taken by the user) of video camera, these remote equipments for example are friend and household, online individual photo album or online mobile site daily record (log).The user specifies the recipient by input recipient's Mobile Directory Number or e-mail address.The user can also be from individual contact list on its mobile device or the destination that communication identifier list is selected image information of knowing from being disposed, such as markd photo management server.The user's mobile phone number is included in the message of all transmissions, and this number also is available for recipient's subsequent contact, and this number is by similar message transmission, audio call or passable by advancing mobile site's content (pushing mobile web content).Those skilled in the art send service (MMS) as a kind of industry-standard protocol and service regulation with Multimedia Message, and it is used to send the message that includes text and view data and the digital content of other types.Server based on MMS also comprises gateway function, is used for linking to each other by coming to send the application and service device with standard the Internet message such as the agreement of SMTP.Modal is to realize that on MMS graphical messages sends, but some cellular carrier has based on the alternative implementation such as other Internet Protocols of SMTP or HTTP.
The present invention has also used the text message that can use for the mobile phone user on radio data network to send service.Those skilled in the art as a kind of industry-standard protocol and service regulation, are used to Short Message Service (SMS) to send and include text and such as the binary message of URL and the message of download/charging system.The server of SMS-Based also comprises gateway function, is used for sending the application and service device by the agreement such as SMTP with standard the Internet message and links to each other.
The image index system that includes the visual search algorithm provides a kind of mechanism, is used for storing a plurality of images and at search of this group image and the similar image of input picture.These systems provide the Search Results of rank order, and provide a raw score for each returns item.This mark is an indicator of degree of match.When the raw score of the item with highest level was low, these systems provided threshold mechanism, this mechanism can be used for determining when returning have the highest rank, the expression item coupling in fact of coupling.This threshold mechanism depends on the following fact, promptly the numerical difference between between the mark of two non-matching images on the probability much smaller than the numerical difference between between the mark of matching image and non-matching image.Based on the image applications type visual search system is adjusted.For example, at each the modulation visual search system in the following application: use brand mark (trademark logo) search of twotone image; Use the face recognition of grayscale image; Magazine advertising search based on coloured image.When following situation occurring, that is, automated system shows when optimum matching approaches threshold value, to optimum matching or the operator that makes final decision of not matching can replenish vision and search system.
Make the individual consumer can utilize configurable preference to set up the individual accounts and store the privatization of relevant user profile and the most frequently used ingredient that user's register system is internet website, these websites are such as e-commerce website, portal website (portal), press service, Home Banking etc.These systems are visited by the web browser by the user, and the initial registration and the maintenance of individual subscriber profile are provided.These systems provide suitable security and guarantee the secret of user profile.If configuration so then also can visit these systems by mobile Internet, use cell phone web browser.
The market automation system provides the ability of exploitation, execution, management and appraisal client target marketing program, and these programs comprise that the client of numeral and traditional form sells.Provide according to selected input variable and business rules and create equipment the customized responses of client's request.These systems manage both human and workflow robotization.Usually, response is the form of Email, snail mail and phone.One of business rules simplifies example is " the 38th page Swanson TV Dinners advertisement among the Life Magazine that publishes in August, 1972 having been carried out the mail answer person of preceding 1000 uniquenesses that mail replys; given them and " bought 2 reward vouchers that send 1 (2 for 1) ", and made them add the Disneyland prize drawing ".Mobile messaging transmitting function and such system are made up, make mobile sale can be included in the interesting possible realization mechanism.
On the website, create the practice that can reach ground consciousness and behavior daily record and be called as network log (web log) or blog (blog).Mobile web log is called mobile blog (moblog).When user input text and photographic images on mobile phone, and when uploading the data to specific blog, most typical is when sending the image information of correct addressing, has just created mobile blog.Blog and mobile blog can also include the link of the related content on the Internet.The people who safeguards blog or mobile blog is according to their preservation of thought and act record is embodied value.This record comprises content of multimedia more and more and links.The benefit of blog mechanism is growing with each passing day, because it makes that comprise additional information becomes and be more prone to.
A kind of general practice in the sales industry is that directly response is sold at commodity and service, and it is used to collect and individual consumer and information that they are relevant to the particular interest of product, service or incident, and influences their buying behavior.Directly the response marketing activity relates to cognitive foundation (awareness creation) or directly solicits (solicitation), and one or more response channel.Cognitive foundation can be adopted various ways.For example: directly send out mail, TV or blurbing, email message, print advertisements, placard or notice in magazine or newspaper.Also have a lot of possible response channel.For example: mail, phone, email message, retail shop visit, " bingo cards (bingo card) " and website.This activity can be included in the stimulation that carry out the responsiveness aspect of attempting to increase the target market.For example: contest, test, free sample and reward voucher.
Directly the purpose of response sale is to produce lead, promptly relevant with potential customer information.This information comprises at least one identifier at least, can subsequently relate to this client by this identifier.The type of identifier comprises that family expenses or business telephone number, family expenses or commercial address, Mobile Directory Number, e-mail address and the Internet chat screen claim.By utilizing one or more in these identifiers, the advertiser will take to make client to produce the technological means of purchase.In some cases, the purpose of these technological means is that brand " continues impression ", then is directly to solicit purchase in other cases.
The contest that requires client to participate in is the popular form of direct marketing.Program example based on visual cues is such: wherein requirement will be included in the picture such as the image of the special object of the packing of product, shop mark or mark, to participate in contest or brand sales promotion.Automated system (as disclosed herein all) receives the project of camera phone submission and handles picture material, returns the response of accepting or refusing this project to the user.When in image, finding object, do not refuse, and in response, how to participate in sales promotion to user notification.
Customer lead data also is used to improve the understanding of advertiser to the target market.In this case, can observe and analyze the additional information of collecting generally, with discovery mode (pattern) or trend from client.This additional information includes " hard data ", such as the personal information of age, sex and position, and " soft data ", such as favorite motion and time of seeing TV weekly.
Estimate the effect of direct response marketing activity by responsiveness.At various Mechanism Study responsiveness, and demonstrate these responsivenesses and alter a great deal, but under situation mostly all really in (be lower than target customers respond 1%) 1% below.In some cases, can estimate responsiveness exactly, for example, client directly responds specific Email and solicits.In other cases, can not determine that what prompting client responds, for example, company's network address that user capture is found on print advertisements has perhaps been bought certain two footwear at retail shop after two weeks.The value of medium and response channel can increase in the time can directly estimating responsiveness.
The advertiser uses literal, text, visual advertisements form and brand to come to stay lasting impression to client.Advertiser's expense is directly related with quantity.For example, the amount of the circulation of magazine or issuing point can be directly connected to the expense that the advertiser is provided with advertisement or poster.This expense is CPM by the medium quotation generally, or per thousand person-times of interview expenses (cost per thousandimpressions).The amount that is used to satisfy the CPM rate estimates not guarantee the quantity of person-time visit, and especially for the medium of given type, the amount data are as comparative statistics.When utilizing concrete statistic proof advertisement person-time visit to continue the long period, the value of this advertising media will increase.When utilize actual person-time visit concrete, when verifiable statistic is replenished the estimation total value of person-time visit, the value of advertising media also can increase.When static advertising such as magazine page or shopping mall's placard was connected with other medium, the value of advertising media can increase once more.
Print media advertisement and outdoor advertising generally include mobilization action (call-to-action).There is one group of method that is used to pass on the mobilization action.In some cases, mobilization is taken action disclosed and can not be misread, and such as " calling out this number today orders ", under other situation, message is then more ingenious.In most of advertisements of these forms, a kind of mechanism of existence is to make client produce interest to advertisement.Generally, this adopts the form of telephone number or network address.The people who wants to respond the mobilization action or want to search out more information relevant with product, service or incident must call out this number or seek other sources such as the website.Even common situation is people to be had interest and also can not respond, or because the response mechanism inconvenience, response mechanism does not provide people interested content, or because as time goes by, people have faded from memory wanting response.Mobile enquiry system of the present invention can make the user participate in when interest is excited, and the response based on the optional preference of user is provided, and provides value to the user.
Use to cross media sale (cross-mediamarketing) in advertisement and Brand management industry is being risen.In a lot of advertising campaigns, the sell by arranging goods (tin-in) between radio, TV, printing, direct mail advertising and internet media (media outlet) is very usual.Mobile phone is that be increased in the recent period may market in the ranks, from use text message to send to relate to client to inquire about to reward and visit information obvious.The mobile sale of simple mode is by send text or Multimedia Message to client advertisement to be appeared on the mobile phone.Similarly, Mobile business solution makes the user can use mobile web to buy from their mobile phone.
The wireless data service that is provided by wireless carriers is based on such as GSM/GPRS, CDMA/1xRTT, WiFi (802.11a/b/g), EDGE, CDMA2000, the agreement of WCDMA.Radio data network can also provide location-based service, wherein can determine mobile subscriber's position or definite user's bill postcode.
The invention is characterized in a kind of system and method, it can make the user use camera phone to show that they to the interest based on product, service, incident or the editorial content of visual cues, perhaps can make the user participate in including specific sales promotion or other activities of visual cues.To offer the user based on the response of expressed interest or participation.Visual cues needn't change for this reason.In general use, the user interested article are taken pictures and via wireless data service with image data transmission to the mobile enquiry server, the request of having reached is at the response of this visual cues or show that the user wants to participate in the effect of sales promotion.When the mobile enquiry server received inquiry, what the view data in the message was used to mate in the image index system consulted.The image index system preserves a plurality of images (saying it is the data of extracting exactly from described image), and be associated with each image response function arranged.The example that commercial affairs image index and vision are searched system comprises the Scene and LogoClassifier from Imagen Inc., Espion SDK from Idee Inc., from PixServe and the PixSearch of PixLogic, and from the ViPR of Evolution Robotics.Response can be generated and be directly delivered to the user automatically, perhaps triggers third party's action of representative of consumer.Typical response to the user is mobile text message, and this moves text message and thanks to the interest of user to product, the additional information relevant with product is provided simultaneously or can finds additional information wherefrom.The example that may respond of other types is: send Email or the snail mail that comprises product information to the user; Send the mobile multimedia advertisement of image or audio/video clips (clip) form to the user; Make the user participate in advertisement contest or prize drawing (sweepstakes); Send electronic coupons or paper coupons to the user; Send to the guidance of nearest retail shop or concrete location of incident to the user; Make the user be connected to the concrete purchase webpage on the Mobile business website and directly to buy product or service by change; For the user provides and the relevant information of current available best purchasing price on the Internet; For the user provides free sample; The user is voted or test; Be user's mobile phone calendar or other electronic calendars interpolation appointment or prompting; Make customer service represent the calling party; Perhaps in user's blog (blog) that is linked to corresponding online content or mobile blog (moblog), create a blog inlet.
In the advertising sector term, the inquiry from client by this mechanism is direct response channel.Because can obtain the additional information relevant, so the effect of the advertiser of direct response mechanism or medium and value are also increasing with client.The present invention regulation with all user inquirings all with log record in database.If additional messages can obtain, then also to charge to daily record.Example is rise date, the date of image taking, the shift position when asking, the user profiles (for example, age, sex, home address, work/school address, contact details) of Mobile Directory Number, request; And the respond style that provides.If response relates to afterwards mutual of user, for example, buy product, if then the available words of this mutual result also will be charged to daily record.Produce report from database then, the intensity of variation of the details that is used to provide relevant with client's interest and pattern.These reports are to create for specific medium and advertiser.For example, provide interest and the mutual relevant information that advertised product or the article of reading is produced with the reader at the report of magazine publisher.This information will include the consensus data who derives from database.Clue produces report and comprises and the relevant information of concrete reader of having inquired about particular advertisement.
In the time can discerning the medium in the source of asking as the user, the value of daily record and report mechanism can improve.For example, the advertiser often carries out simultaneously identical ad copy on several magazines or newspaper, yet publisher and advertiser are interesting to know that the user inquires about based on the advertisement on the niche publication.The invention provides a kind of operator scheme, wherein by journal surface is realized identification to this journals and periodicals number as the identifier of given period number of the edition.This mode class is similar to above-mentioned general vision prompting matching system, yet before the user showed employed this journals and periodicals number, normal inquiry will be returned wrong response message.Before the concrete page to magazine carried out normal queries, the user can at first ask based on the front cover of magazine.Similar with normal use, the user can take the picture of front cover and picture is sent to server.System utilizes text message to respond the user, shows that this magazine is identified and is supported, to proceed normal queries.This action will be created casual user's state in system, and from this user's subsequent query magazine title and issuing date is included in the journal entries that is produced.But support this operator scheme by in database, keeping magazine cover image data entries.Normal user inquiring can at first be searched for these, to determine whether User Status should be switched to different magazines.In this way, when the user is switched between different magazines, except asking new magazine as mentioned above, do not require and carry out special action.
The invention provides a kind of alternative means that is used to discern medium.In a kind of alternative means, service provides unique destination-address at the inquiry that is derived from such as the such specific medium of magazine or newspaper.This address can be e-mail address form or telephone number (comprising short code (short-codes)) form, the perhaps wherein replacement of any.
In second kind of alternative means, system infers most possible medium by following the tracks of and analyze given user's current and historical use pattern, wherein, analyzes many group pollings at coupling, and these mate is very or very unique concerning specific medium.For example, if coupling only produces a kind of source magazine, if if then and each inquiry in the only known set also all derive from this magazine issue, can infer that intensive in time these inquire about from this identical magazine.Existing under the multiple situation about may originate for all couplings in the set, then analyze this set at the source, this source is unique for whole group.Be used to support that other parameters of this inference process comprise the position that user's history is used pattern, the currency data that may originate, the issuing date that may originate, current inquiry.
In the third alternative means, medium are selected in the tabulation the interactive menu of user from its mobile phone.
If medium are outdoor, then Cha Xun date and position are used to place and the incident of initiating inquiry are carried out determining that accurately the date of this inquiry and position are used for discerning uniquely specific medium.
The present invention also provides the maintenance to the image index system.In system, add termly or deletion is used to support the view data of adaptation function.The medium that have that are associated with each image recording are originated and advertiser source (if words applicatory).The processing of inserting new ad copy has been guaranteed identical advertisement not to be duplicated in this system by at new advertisement existing database being searched first.Identical advertisement publishing is arrived under the situation of multiple magazine, can have the multiple medium source that is associated with this Imagery Data Recording.When the advertisement of identical out-of-home banner or placard style is illustrated in a plurality of position, then may there be a plurality of positions that are associated with this Imagery Data Recording.
The present invention also comprises following function, promptly, customization is at the response function of each query type (magazine advertising, editorial, outdoor posters, the packing of product etc.), and at each query-defined multiple possible response, and wherein Shi Ji response is that preference by the user decides.The service equipment of image index system is by defining the multiple possible respond style that is associated with each Imagery Data Recording, to support this customization.Possible respond style example is delivering method (Email, mobile text message, mobile multimedia message, mobile web connection, audio call, mailing or combination), and the search, prize drawing that is included in route explanation, reward voucher and the discount of the nearest retail shop search of registration, free sample and transmission automatically, establishment are with the blog inlet of the editorial content link of online magazine, be connected to the mobile content of first-selected mobile Internet retailer or transmission such as sound clip or figure in real time.Usually respond style is made up to define response function completely.This method is selected preference by making the user how respond dissimilar inquiries at server, with at each user that system is individualized.For example, at advertisement, send calendar reminding message with the Email form based on incident.Via mobile Internet on the Internet on the personal computer and web browser or the cell phone and mobile web browser, these preference are set by the services accounts webpage that signs in to the user.In some cases, these static preference can be by the user via mobile Internet, increase by mutual selection the in real time.Interactive examples by specific initial response prompting comprises participation test or ballot, plays game on line, the information of participating in specific sports, primary static preference is provided.The example of protocols that support to move mutual prompting is two-way SMS, WAP Push, WAPBookmarks and links with the SMS of WML or XHTML.
Make the user of service know the availability of any given medium.Example comprises: the specific editorial content of describing service; Based on the particular advertisement that the description of various medium is served, this particular advertisement is specific and unique for the service brand labeled identifier in the advertisement of being supported; Include the particular advertisement or the editorial content of the online version of magazine; Directly send to the message of user's mobile phone; Perhaps with cellular carrier and/or cell phone manufacturer's in partnership item sale.
Service-user can also use digital camera to come photographic images, and image is sent to personal computer, and this view data is sent to server via the Internet.This has similar effects with using mobile phone transmission inquiry.
Description of drawings
Purpose, feature and advantage that those skilled in the art expects other easily according to the following description and the accompanying drawing of preferred embodiment, wherein:
Fig. 1 is the synoptic diagram of the preferred embodiment of mobile enquiry system of the present invention;
Fig. 2 is the block diagram at the preferred embodiment of mobile enquiry server of the present invention;
Fig. 3 is the example at query note of the present invention;
Fig. 4 is the process flow diagram at answer processor of the present invention;
Fig. 5 is the figure that divides at address of service of the present invention.
Embodiment
In Fig. 1, mobile subscriber 120 sees visual cues (text and/or figure) 110 and uses 121 pairs of these visual cues of camera phone (camera phone) to take pictures.Mobile subscriber 120 uses mobile network 130 that picture is sent to mobile enquiry server 100.Mobile enquiry server 100 is handled this inquiry.If for mobile enquiry server 100, mobile subscriber 120 is unknown, and then response text message is sent to camera phone 121 via mobile Internet 130, notifies this mobile subscriber 120 how to register, to use mobile enquiry server 100.In some cases, owing to for registration mobile subscriber 120, only require user's mobile number, so initial picture message is just enough.If visual cues 110 is unknown for mobile enquiry server 100, then response text message is sent to camera phone 121 via mobile Internet 130, notify mobile subscriber 120 how to use mobile enquiry server 100, and where search the additional information relevant with the visual cues of current support.If visual cues 110 and mobile subscriber 120 are known for mobile enquiry server 100, then response text message is sent to camera phone 121 via mobile Internet 130, notify the mobile subscriber 120 these successful inquiring, indication simultaneously is by some actions of this querying triggering.In some cases, this response text message is the whole of response, and includes the full detail of realizing this inquiry.If the response message delivery that mobile subscriber 120 utilizes mobile enquiry server 100 to select else is selected, then this selection is available.In this case, send this response as email response, this email response has replaced text message response or as the additional response of text message response.This optional email response sends to mobile subscriber 120 by terminal 122 who accesses the Internet email services by mobile enquiry server 100 by the Internet 131.This email response in terms of content can be identical with the corresponding text message response, perhaps can also comprise additional or different contents.
Branch offices 140 gets in touch each expection client by postal and package delivery service 133, public switch telephone network 132, the Internet 131 and mobile network 130 usually.In the present invention, mobile subscriber 120 is individual client/expection clients, and triggers and the getting in touch of branch offices 140 by mobile enquiry server 100, to be realized successfully inquiry by mobile subscriber 120.Represent mobile subscriber's 120 and be variable, can include but not limited to sell directly to households, commercial affairs and content that information is provided at mobile subscriber 120 executive mode (fulfillment).Response modes is variable, can include but not limited to by voice, Internet chat, in addition by Email and text message, by digital multimedia, get in touch by website referral (referral) and by snail mail or parcel.
The action of taking or be automatically, or be interactively.Represent mobile subscriber 120 to carry out and need not auto-action that mobile subscriber 120 assists have multiple, can include, but are not limited to participate in prize drawing, to the signature of free sample, the signature of ordering to the signature of calendar reminding message, to magazine, to the gift register office add product, to individual shopping list add commodity, to clubber's signature, create the individual blog inlet that is linked to corresponding web site contents, the interest prompting of advertising message form in the Email.Interactive action request mobile subscriber 120 is by mobile network 130 and camera phone 121 or undertaken real-time or concluding a bargin of delaying by the Internet 131 and terminal 122, and interactive action can include but not limited to Mobile business, ecommerce, the online contest of participation, online ballot, online gambling and download mobile content such as the tinkle of bells and recreation.Alternatively, control is about some action of inquiry clearly if user expectation is based on inquiry, and then all auto-actions can work by interactive prompt command.The agenda of the mobile enquiry system that mobile subscriber 120 is experienced is by determining with the corresponding custom action-response record of each visual cues (customaction-response record) of mobile enquiry server 100 supports.Mobile subscriber 120 can set up individual preference by the preference interface 232 of mobile enquiry server 100 directly influences this behavior.
In Fig. 2, arrive that message handling device 210, user consult 220, preference consult 230 and image lookup 240 produce the query note 300 shown in Fig. 3 together, this query note 300 is sent to answer processor 250.Arrive message handling device 210 and receive query messages from mobile network 130.Query messages comprises following information at least: user's Mobile Directory Number, the digital picture of visual cues and transmitted the mobile network retailer's of this message designator.This information extracts and is used as query message data 310 and is sent to the user and consults 220 from message, it is included in the query note 300 of new establishment.Consult in 220 the user, Mobile Directory Number is used to search the user in mobile subscriber's registration data 221.If find the user, then the registration data at this user is added in the query note 300 as user contact infonnation 330.User account 320 also is added in the query note 300.If do not find the user, then user account 320 is empty.Then, the user consults 220 and consults the query note 300 that 230 translator units are finished to preference.Preference is consulted 230 preference of using this user account 320 to search this individual subscriber in mobile subscriber's preference data 231.These preference are added in the query note 300 as user preference 340.If user account 320 is empty, does not then carry out inquiry and simultaneously user's preference 340 is set to sky.Then, preference is consulted 230 query notes of finishing to image lookup 240 translator units 300.Image lookup 240 is used the digital picture that is included in the visual cues in the query message data 310, request optimum matching or do not have the indication of coupling from view data index 241.Visual cues ID350 at optimum matching is added in the query note 300.If there is not coupling, then visual cues ID350 is set to sky in query note 300.Then, image lookup 240 is sent to answer processor 250 with the query note of finishing.
Fig. 4 shows the control flow of access queries record 300 with the answer processor 250 of carrying out its task.This task is to determine and the transmission appropriate responsive, and produces suitable action (if any) based on mobile subscriber 120 inquiry, user's preference and action-response program data 251.Carry out these actions by branch offices 140.In order to trigger the execution of these actions, answer processor 250 is determined the types of action and user's contact details 330 is reformatted as default form.Then, transmit this data termly or in real time, perhaps can print and send data by mail or package delivery person by electronically such as the transmission of batch ftp file, Email or web service interface.Be included in the action-response program data 251 with branch offices 140 method for communicating, address and form.
When answer processor 250 determines that text message response should be sent to mobile subscriber 120, text message is addressed to mobile number in the query message data 310.In order to handle a plurality of independently mobile networks, search the Mobile Network Operator in the query message data 310, to determine which mobile network gateway server carries out route to text message.When answer processor 250 was determined email response to be sent to mobile subscriber 120, this Email was addressed to the e-mail address in the user contact infonnation 330.
Possible response provides the address from the physical location of the nearest particular retailer of mobile subscriber 120.If mobile subscriber 120 current location can reach from mobile network 130, then this position is used to calculate nearest retailer.If unreachable, if mobile subscriber 120 registration postcode then is provided by user's enrollment interface 222, then this postcode can be used in the user contact infonnation 330 by answer processor 250, and is used to calculate nearest retailer.If do not provide, if then can obtain mobile subscriber 120 bill postcode from mobile network 130, then this bill postcode can be used for calculating nearest retailer.If unavailable, then to indicate location-based response be impossible in the response that is produced, till providing the registration postcode by user's enrollment interface 222.Retail location is stored in the action-response program data 251, perhaps by using the Web service based on the Internet, is dynamically searched by answer processor 250.
Possible response is to make mobile subscriber 120 can use the Mobile business function of mobile phone 121, buys the product in the visual cues 110.In this case, this response provides direct link, and webpage is moved in the product purchase that is used to be linked to the Mobile business retailer of mobile subscriber's 120 first-selections.Directly link makes mobile subscriber 120 can walk around the step of seeking product of interest by mobile webpage.Be redirected if can carry out Mobile business at this inquiry, then answer processor 250 is determined according to action-response program data 251.If like this, and user preference 330 provides first-selected mobile Internet retailer, then the response that is generated comprises a link, and webpage is moved in the product purchase that is used to be linked to this mobile Internet retailer, and this link is searched from action-response program data 251.Then, mobile subscriber 120 has the right to choose of buying the product of indication in the visual cues 110.
Action response program maintenance equipment 252 is provided for creating, upgrading and delete the operation and maintenance function of action-response program data record.The shared public field of record in action-response program data 251 and the view data 242.This field is visual cues ID350.Action-response program data record has one or more corresponding record in view data 242, that is, a plurality of images can point to single responder.Use visual cues ID350 to search action-response program data record.
Image data maintenance facility 243 is provided for creating, the operation and maintenance function of renewal and deleted image data recording.Provide from the input of branch offices 140 with numeral or physical form, the input of physical form is scanned and converts to digital form by image data maintenance facility 140.To be used for the alternative input format of presentation video data, store in the view data 242 such as TIFF, PDF, EPS, DCS2, JPEG before, utilize view data index 241 that it is accepted and standardization.Unique ID that utilization is called as visual cues ID350 creates Imagery Data Recording, and wherein visual cues ID350 is used to provide link, is linked to the respective record in the responder data 251.When at least one corresponding action response program record is linked to new Imagery Data Recording, this new record is labeled as available, and can be used for making view data index 241 to mate.
Branch offices 140 can or utilize the specific medium such as the magazine of concrete name to use mobile enquiry system at specific promotion project.Fig. 5 shows and how to use search purposes way address 430 to come divide image data 242 and action-response program data 251.This provides by creating unique address and has managed and followed the tracks of the function of a plurality of programs based on branch offices.Inform to mobile subscriber 120, participate in certain sales promotion or utilize certain medium, should use ad hoc inquiry destination-address 430 for all communications.The inquiry that arrives message handling device 210 receptions is handled, from receive message, to extract the search purposes way address and it is added in query message data 310.Answer processor 250 uses the search purposes way address to select suitable view data part 410 and action-response program data part 420, and the two matches each other.The independent subregion of general address maintenance for the mobile enquiry server.Email address format and mobile network code form addressing scheme are all supported.Mobile network's numbering plan comprises " short code " addressing, and this also supports.
By mobile subscriber's 120 calling party enrollment interfaces 222 and user preference interface 232, with inputting contact information, personal information and operation preference information.General implementation is as internet website, and visits via terminal 122.Also can be implemented as the mobile Internet website and visit by mobile phone 121.Mobile subscriber 120 sometimes can visit these interfaces once more, additional information to be provided and to upgrade preference.In this way, mobile subscriber 120 can improve or reduce the rank of utilizing the mobile enquiry server to participate in.
Create also maintenance event daily record 261 to be used for the use of tracker.From all main processing element data are charged to daily record.By will guide such as client, the suitable data of advertisement performance, media capabilities, consensus data and user model is delivered to branch offices 140, the commercial object of event log 261 and 260 pairs of mobile enquiry servers of report preparing system provides support.Report generates 260 and comprises special-purpose tactful monitoring function, so that disclosing of personal data is restricted to prescribed level.
Although in some accompanying drawing (but not other accompanying drawings) concrete feature of the present invention has been shown, this can be combined with any or every other feature according to each feature of the present invention only from angle consideration easily.
Other embodiment expects for a person skilled in the art easily, and within the scope of following claim.
Claims (47)
1, a kind of method based on visual cues realization mobile enquiry and responding system, wherein the user utilizes the networking mobile device with image taking and sending function to take and send image, and this method comprises:
But searching record is provided, and these records comprise view data of being stored and the response message that is associated with these data;
Receive captured image from mobile device;
Use the image received to carry out the search of partial automation at least, in these records, to find the one or more images with the images match that is sent to record;
If the coupling of finding is then searched the response message that is associated with institute's storing image data of this matching image; And
Use this response message to send a reply to the user.
2, method according to claim 1, wherein said answer is sent to described mobile device.
3, method according to claim 1, wherein said equipment are mobile phone or PDA(Personal Digital Assistant).
4, method according to claim 1 also comprises and determines whether the user who sends the image that receives has been registered as the user before.
5, method according to claim 4, whether wherein definite user who sends the image that receives has been registered as the user before is based on the identifier that receives the networking mobile device of image from it.
Whether 6, method according to claim 4 had carried out registration before wherein user's answer being depended on the user at least in part.
7, method according to claim 4 also comprises the preference at this authorized user of determining preexist.
8, method according to claim 6, wherein response message comprises one group of predetermined queries response.
9, method according to claim 1, wherein response message comprises rule of origin information.
10, method according to claim 9, wherein said rule of origin information comprises IP address or street address.
11, method according to claim 1, wherein said response message comprise providing with the direct of webpage and link.
12, method according to claim 1, wherein said response message comprises product information.
13, method according to claim 1, wherein said response message comprises content supplier's information.
14, method according to claim 1, wherein said response message comprises content supplier's information.
15, method according to claim 1, wherein said response message comprises image information.
16, method according to claim 15, wherein said image information comprises video image.
17, method according to claim 15, wherein said image information comprises rest image.
18, method according to claim 1, wherein said response message comprises audio-frequency information.
19, method according to claim 1, wherein said answer comprise Email or snail mail message.
20, method according to claim 1, wherein said answer comprises telephone contact.
21, method according to claim 1, wherein said answer comprise with a plurality of of user gets in touch.
22, method according to claim 1, wherein said answer comprises the affirmation to the action of taking in response to described coupling.
23, method according to claim 21, wherein the action of being taked comprises and enteing the lists.
24, method according to claim 1, wherein said answer comprises the change game play.
25, method according to claim 1 also is included in the database information relevant with described inquiry is charged to daily record.
26, method according to claim 25, the information of wherein charging to daily record comprise the type of the date and time of the Mobile Directory Number of making a start, inquiry, the date and time of image taking, the place of sending inquiry, user profiles and the answer of doing.
27, method according to claim 25 also comprises from database producing report.
28, method according to claim 27, wherein said report comprises the consensus data.
29, method according to claim 27, wherein said report comprise and concrete image-related information.
30, method according to claim 1 also comprises discerning as the medium in source of the image that is taken.
31, method according to claim 30 wherein comprises and uses the publication front cover as recognition image discerning as the medium in source of the image that is taken.
32, method according to claim 31, wherein said user at first inquires about based on the publication front cover, can only inquire about based on the image in this publication then.
33, method according to claim 32, the wherein identifier of publication and all be stored in the Query Database based on the inquiry of the image in the publication.
34, method according to claim 30 wherein comprises at least the recent inquiry from the user is followed the tracks of and analyzed discerning as the medium in the image source of being taken.
35, method according to claim 34 wherein comprises also to discerning as the medium in the image source that is taken whether definite intensive in time recent inquiry originates from single medium.
36, method according to claim 34 wherein also comprises the place of determining recent inquiry to discerning as the medium in the image source that is taken.
37, method according to claim 30 wherein comprises that to discerning as the medium in the image source that is taken the user selects a source from a series of selections that are sent to mobile device.
38, method according to claim 30 wherein comprises date, the when and where of determining inquiry to discerning as the medium in the image source that is taken.
39, method according to claim 1, wherein said record also comprise at least one medium source.
40, according to the described method of claim 39, wherein said record also comprises advertiser's identifier.
41, method according to claim 1 also comprises making the user can select to reply preference.
42, method according to claim 1, wherein captured image comprises unique service identifier.
43, according to the described method of claim 42, wherein said unique service identifier is included in visual information very close with advertisement on the position.
44, method according to claim 1, wherein said equipment comprise digital camera and are used for sending based on the Internet equipment of camera review.
45, method according to claim 1, but also comprise maintenance searching record database.
46, according to the described method of claim 45, but wherein provide limited accass, to safeguard the record that is associated with this branch offices to the searching record database to branch offices.
47, a kind of mobile enquiry and responding system based on visual cues, wherein the user utilizes and has the networking mobile device photographic images of image taking and sending function, and sends images to system, and this system comprises:
But one or more search database, these databases comprise view data of being stored and the response message that is associated with these data, and wherein this database comprises the matching image identifying information;
The image lookup device is used to use the search of the image executive logging of reception, to find the image with the images match that sent in record;
The answer processor device, it searches the response message that is associated with institute's storing image data of this matching image in response to the image lookup device, and uses this response message to send a reply to the user.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US56285504P | 2004-04-16 | 2004-04-16 | |
| US60/562,855 | 2004-04-16 | ||
| US11/106,306 | 2005-04-14 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101395626A true CN101395626A (en) | 2009-03-25 |
Family
ID=40494867
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2005800156447A Pending CN101395626A (en) | 2004-04-16 | 2005-04-15 | Mobile query system and method based on visual cues |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101395626A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101847154A (en) * | 2010-02-26 | 2010-09-29 | 宇龙计算机通信科技(深圳)有限公司 | Method and system for inquiring information and method for mobile terminal to inquire information |
| CN103077248A (en) * | 2013-01-29 | 2013-05-01 | 俞天力 | Cloud picture processing method and system |
| CN107004005A (en) * | 2014-09-08 | 2017-08-01 | 热力学设计有限责任公司 | Customizable data management system |
| CN109716327A (en) * | 2016-09-08 | 2019-05-03 | Aiq私人股份有限公司 | The video capture frame of visual search platform |
| US10692096B2 (en) | 2013-03-15 | 2020-06-23 | Thermodynamic Design, Llc | Customizable data management system |
| CN115238324A (en) * | 2022-07-22 | 2022-10-25 | 珠海市鸿瑞信息技术股份有限公司 | Computer protection system and method based on management and use audit security |
| US11907966B2 (en) | 2013-03-15 | 2024-02-20 | Thermodynamic Design, Llc | Customizable data management system |
-
2005
- 2005-04-15 CN CNA2005800156447A patent/CN101395626A/en active Pending
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101847154A (en) * | 2010-02-26 | 2010-09-29 | 宇龙计算机通信科技(深圳)有限公司 | Method and system for inquiring information and method for mobile terminal to inquire information |
| CN103077248A (en) * | 2013-01-29 | 2013-05-01 | 俞天力 | Cloud picture processing method and system |
| CN103077248B (en) * | 2013-01-29 | 2016-08-03 | 俞天力 | A kind of high in the clouds image processing method and system |
| US10692096B2 (en) | 2013-03-15 | 2020-06-23 | Thermodynamic Design, Llc | Customizable data management system |
| US11620662B2 (en) | 2013-03-15 | 2023-04-04 | Thermodynamic Design, Llc | Customizable data management system |
| US11907966B2 (en) | 2013-03-15 | 2024-02-20 | Thermodynamic Design, Llc | Customizable data management system |
| US12014384B2 (en) | 2013-03-15 | 2024-06-18 | Thermodynamic Design, Llc | Customizable data management system |
| CN107004005A (en) * | 2014-09-08 | 2017-08-01 | 热力学设计有限责任公司 | Customizable data management system |
| US12062056B2 (en) | 2014-09-08 | 2024-08-13 | Thermodynamic Design, Llc | Customizable data management system |
| CN109716327A (en) * | 2016-09-08 | 2019-05-03 | Aiq私人股份有限公司 | The video capture frame of visual search platform |
| CN109716327B (en) * | 2016-09-08 | 2023-08-11 | 吴树城 | Video capturing framework for visual search platform |
| CN115238324A (en) * | 2022-07-22 | 2022-10-25 | 珠海市鸿瑞信息技术股份有限公司 | Computer protection system and method based on management and use audit security |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7707218B2 (en) | Mobile query system and method based on visual cues | |
| US11082506B2 (en) | Method and apparatus for dynamically presenting content using an interface for setting conditional network destinations | |
| US9405844B2 (en) | Method and apparatus for dynamically presenting content in response to user inputs | |
| US10305997B2 (en) | Method and apparatus for dynamically presenting content using an interface for setting conditional network destinations | |
| US9224157B2 (en) | Method and apparatus for presenting content in response to user inputs using dynamic intelligent profiling | |
| US20190215292A1 (en) | Electronically referring a contact without divulging contact data | |
| US9183315B2 (en) | Method and apparatus for dynamically presenting content in response to successive scans of a static code | |
| US20130191394A1 (en) | System and method for dynamically forming user groups | |
| US20100004980A1 (en) | Systems and methods for managing product and consumer information | |
| AU2007240016A1 (en) | System and method for distributing targeted content | |
| JP5930572B2 (en) | How to collect consumer information | |
| JP6977171B2 (en) | Receiving system and method of sample products for public relations {Receipt system and method of sample products to promote a goods} | |
| US20110045852A1 (en) | System and method utilizing camera-equipped cellular telephones | |
| US20130198004A1 (en) | System and method for providing content information via sms messaging | |
| KR20140089543A (en) | Identifying a same user of multiple communication devices based on web page visits, application usage, location, or route | |
| CN101438311A (en) | System and method for targeting print advertisements | |
| WO2011082115A1 (en) | Mobile device content server method and system | |
| CN101395626A (en) | Mobile query system and method based on visual cues | |
| US20120278150A1 (en) | Method Employing Two-Sided Promotion for Uniting Clients With Businesses | |
| US20030036960A1 (en) | Email transmitting method using computer interactive communication network and communication system thereof | |
| KR100396873B1 (en) | Method for managing a electronic card for a business marketing based on the internet | |
| US20090083124A1 (en) | Message transmission | |
| CN117114769A (en) | Advertisement delivery management method and system based on commodity two-dimension code | |
| KR20140129471A (en) | Message Transferring System and Method using Member-Data and Network Services | |
| KR20120125937A (en) | system and method for personalized information service with combining personalized multi-benefit |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Open date: 20090325 |