CN101789111A - Site advertisement and system for real-time interaction of electronic advertisement data - Google Patents

Site advertisement and system for real-time interaction of electronic advertisement data Download PDF

Info

Publication number
CN101789111A
CN101789111A CN200910244512A CN200910244512A CN101789111A CN 101789111 A CN101789111 A CN 101789111A CN 200910244512 A CN200910244512 A CN 200910244512A CN 200910244512 A CN200910244512 A CN 200910244512A CN 101789111 A CN101789111 A CN 101789111A
Authority
CN
China
Prior art keywords
picture
advertisement
database
place
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN200910244512A
Other languages
Chinese (zh)
Inventor
肖柏华
张琳波
王春恒
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Institute of Automation of Chinese Academy of Science
Original Assignee
Institute of Automation of Chinese Academy of Science
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Institute of Automation of Chinese Academy of Science filed Critical Institute of Automation of Chinese Academy of Science
Priority to CN200910244512A priority Critical patent/CN101789111A/en
Publication of CN101789111A publication Critical patent/CN101789111A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The invention discloses a site advertisement and a system for the real-time interaction of electronic advertisement data, wherein the system comprises that: a user utilizes a site advertisement picture-taking unit to take a picture of the site advertisement, a client reads and sends the picture of the site advertisement to an advertiser server; the advertiser server transfers the picture of the site advertisement to a picture content analyzing and retrieving unit; the picture content analyzing and retrieving unit retrieves a corresponding database picture in an advertisement picture database and returns related information in a commodity information database, to which the database picture in the retrieval result is corresponding, to the advertiser server; and the advertiser server sends the commodity information returned by the picture content analyzing and retrieving unit to the client. Since the picture content analyzing and retrieving unit combines picture content retrieval and word area detection with word identification, the stability and reliability of the system are enhanced; using mobile phone signals, the Internet can conveniently complete the interaction between users and advertisement providers and between users and advertisement companies in real-time.

Description

Advertisement of a kind of place and the mutual system of e-advertising data in real time
Technical field
The invention belongs to and pattern-recognition and technical field of information processing, relate to the real-time interaction system of advertisement of a kind of place and e-advertising, concrete is a kind of advertisement photograph processing method.
Background technology
Advertisement is for certain specific needs, by the medium of a definite form, openly transmits the publicity measures of information widely to the public.Advertisement has the branch of broad sense and narrow sense, and the broad sense advertisement comprises non-economy advertisement and economic advertisement.The non-economy advertisement refers to not to be the advertisement of purpose with the profit, claims the effect advertisement again, and its fundamental purpose is to promote; The narrow sense advertisement only refers to economic advertisement or commercial advertisement, the important means of communicate information between commodity producers, operator and the consumer normally, pass on brand uniqueness, distinct individual character to advocate with advertising, making commodity be able to set up certain with target consumer group gets in touch, enter consumer's the life and the visual field smoothly, reach the in-depth communication of soul with it, and establish certain impression and status in the heart, make brand become a significant symbol sign indicating number that has surcharge at it.Here said advertisement, we adopt the definition of national Advertisement Regulation Act to advertisement, that is, advertisement is meant that merchandising person or ISP assume charge, by introduce oneself the directly or indirectly commercial advertisement of commodity of being promoted or the service that is provided of certain media and form.
As far back as the initial stage in slave society, ancient Greek has just occurred in the world the earliest, the most original advertisement form, puffing advertising or peddle advertisement.After this, development along with commodity economy, progress of science and technology, advertisement form also makes rapid progress: the mark font size of going into business is to print advertisements such as newspaper, periodical, books, registers, from in the street, the buildings or the space on square, airport, station, harbour etc. set up a signpost, neon bulb, electronics display board, show window, lamp box, wall be to broadcasting, TV, film, video recording, magic lantern, all these have reflected this variation invariably.And the appearance of internet, the new era of having started advertisement especially.The electric network advertisement is as a kind of emerging advertisement form, along with Internet development is quietly risen and presented flourish gesture.Many companies competitively set up the network service of oneself, as, commodity homepage, forum (BBS), online trade platform etc., propagate self-image whereby and commodity displaying in face of whole world Internet user.At present, traditional advertisement form, as TV, magazine, leaflet, billboard etc., or the main flow form of advertisement.Yet, the electric network advertisement, because low price, range of publicity is wide, and form is lively, and interactive mode is flexible, and user search is convenient, the region restriction of no time, advantage such as real-time performance is good, the favor of be subjected to getting more and more users and businessman.In today of the extensive fast development in internet, by means of the prospect of the electric network advertisement of internet, more people are good.
Yet because human habits and customs and the intrinsic advantage of place advertisement, the electric network advertisement can not replace the status of place advertisement in people's life fully, but relative merits, long-term co-existence are arranged mutually.Such as, the place advertisement is owing to be subjected to the time of medium and the restriction of the space of a whole page, and its content can only be simplified literary writing by leaving out superfluous words, and gives top priority to what is the most important.Therefore, people can obtain the information of a large amount of different commodity in the endurable time; And when we when wherein certain commodity are interested, the information that the place advertisement provides and interactive etc. but can not satisfy our needs far away, at this time the web advertisement has just been brought into play its effect.But if the information that does not have the place advertisement to provide, in making us dazzled network information ocean, we also are difficult to or do not know and how on purpose look for oneself satisfied commodity and corresponding information.
Summary of the invention
In order to solve prior art problems, the purpose of this invention is to provide the novel advertisement form of a kind of comprehensive place advertisement and electric network advertisement advantage.The novel advertisement form has become advertiser's problem demanding prompt solution, yet successful advertisement culture is to press close to popular life, rather than ivory-towered high art.In quite long one period from now on, we face will still be these the two kinds of advertisements and the situation of depositing, and advertiser's needs be a kind of comprehensively place advertisement and electric network advertisement advantage, the system that is user-friendly to.
In order to reach described purpose, the present invention is intended to design advertisement of a kind of place and the mutual system of e-advertising data in real time, this system is made up of place advertisement picked-up unit, client, advertiser servers, analysis of image content and retrieval unit, information of goods information data storehouse and advertisement picture database, wherein:
Advertisement picked-up unit, place, the user takes the advertisement of interested place, obtains place advertisement picture;
Client is connected with place advertisement picked-up unit, and client reads place advertisement picture, and output place advertisement picture, the e-advertising information that real-time display ads merchant server returns; The user of client utilizes e-advertising information can dial manufacturer's phone of commodity in the advertisement of place interested, the operation of login merchandise news homepage;
Advertiser servers is connected with client, and the round-the-clock reception of advertiser servers is also exported the place advertisement picture that each client sends; The e-advertising information that advertiser servers reception image content analysis and retrieval unit return is also transmitted and is given client;
Analysis of image content is connected with advertiser servers, advertisement picture database and information of goods information data storehouse with retrieval unit, receive the place advertisement picture that advertiser servers provides, the retrieval database picture corresponding in the advertisement picture database with place advertisement picture, utilize the e-advertising information in the database picture index information of goods information data storehouse that obtains then, and e-advertising information is returned to advertiser servers;
The advertisement picture database is made of a large amount of e-advertising pictures, is taken, collects and upgraded by advertiser; The label of these database pictures comprises: the literal that occurs in the title of commodity, series, the picture; There is many-to-one index relative in merchandise news e-advertising information in database picture and the information of goods information data storehouse, to each width of cloth database picture, can index e-advertising information corresponding in the information of goods information data storehouse;
The information of goods information data storehouse is made of the information of commodity in the picture in the advertisement picture database; The information of the commodity in the information of goods information data storehouse comprises: sales promotion information, the commodity production of the title of commodity, the series number of commodity, the link of merchandise news homepage, commodity or producer's contact method is provided; There is the index relative of one-to-many in picture in merchandise news in the information of goods information data storehouse and the advertisement picture database; To each bar product information, can the picture in the width of cloth that guides or a few width of cloth advertisement picture database.
Beneficial effect of the present invention: compare with advertisement of existing place and electric network advertisement, this method has following characteristics:
1. compare with the place advertisement, the present invention can provide useful information more but non-magnanimity in real time according to user's interest.
2. compare with the electric network advertisement, the present invention can utilize the information of place advertisement to provide a direction to the user, and the user can be shot the arrow at the target in the ocean of information.
3. convenient, quick.In the advertisement of place, when the user was interested to certain commodity, the user need remember the name of commodity, the contact method of manufacturer or commodity homepage.Manual then inputted search engine could obtain the more detailed data of commodity, needs artificial input telephone number just can finish mutual with manufacturer.But, be subjected to the restriction in time and space, it is very inconvenient finishing this process.For example, before the television image of redirect fast, in the automobile that after billboard is at full speed, moves, correctly remember telephone number and web site name, man memory power has been proposed very big challenge.And place of the present invention advertisement and the mutual system of e-advertising data in real time, only need utilize mobile phone or other Portable Communications Units in the hand that interested billboard or TV screen are taken a pictures, can obtain whole advertising messages of target commodity, and can utilize modes such as phone, internet to realize real-time, interactive with manufacturer.
For a kind of user oriented utility system, the stability of system is very important.Because taken the visual angle, illumination condition, the influence that distance is far and near adds that the database picture itself has certain similarity, makes that the picture that only utilizes picture analysis retrieval to obtain might be the similar database picture from different producers; And the commodity of identical producer are owing to have great similarity in appearance, and the simple picture that utilizes image content is difficult to determine that user's interest is that a model on earth.And simple utilize picture character to extract and recognition system also is not enough.Be subjected to shooting angle equally, illumination condition, shooting distance, the influence of artistic font can allow place advertisement picture that literal is taken and know that this is own just very difficult.Even place advertisement picture shooting is more satisfactory, detect and all correct identification in following place advertisement picture of the advertisement background of complexity Chinese words, also be very unpractical.And system of the present invention has well solved this problem, and its comprehensive utilization is based on the advantage of retrieval of picture image content and text detection recognition system, and the system that makes has bigger stability and reliability.For example, for similar database picture, several words in the place advertisement picture character (as a word in the trade name, the price in the sales promotion information, telephone number) can help image content analysis and retrieval unit to navigate to above the correct database picture; We need not all to detect the reliability and stability that the interior literal of all place advertisement pictures of identification can greatly increase system results.
Description of drawings
Fig. 1 illustrates place of the present invention advertisement and the mutual system schematic of e-advertising data in real time;
Fig. 2 illustrates analysis of image content of the present invention and retrieval unit process flow diagram;
Fig. 3 illustrates the four directions of using in the word area detection of the present invention to rope primary (sobel) rim detection;
Fig. 4 illustrates the present invention's 5 * 5 smoothing filters.
Embodiment
Describe each related detailed problem in the technical solution of the present invention in detail below in conjunction with accompanying drawing.Be to be noted that described embodiment only is intended to be convenient to the understanding of the present invention, and it is not played any qualification effect.
The present invention is intended to design a kind of place advertisement and mutual system of e-advertising data in real time of practicality, catch the user interest information in the advertisement of place accurately, obtain the homepage of user's commodity interested in real time, similar commodity parameter relatively, the contact method of commodity forum (BBS) and manufacturer etc., and realize user and commodity, manufacturer in real time, information interaction easily.After the client of Load System on mobile phone and other any information communication device, the user can obtain unavailable electric network advertising message from the advertisement of place easily, and realization and supplier's real-time, interactive, value has a wide range of applications in actual life.Place of the present invention advertisement and the mutual system of e-advertising data in real time are made up of the Flame Image Process and the message transmitting procedure of a plurality of steps, and the structure of this system is seen Fig. 1.
This system is made up of place advertisement picked-up unit 1, client 2, advertiser servers 3, analysis of image content and retrieval unit 4, advertisement picture database 5 and information of goods information data storehouse 6, wherein:
Advertisement picked-up unit 1, place, the user takes the advertisement of interested place, obtains place advertisement picture; Client 2 is connected with place advertisement picked-up unit 1, and client 1 reads place advertisement picture, and output place advertisement picture, the e-advertising information that real-time display ads merchant server 3 returns; The user of client 2 utilizes e-advertising information can dial manufacturer's phone of commodity in the advertisement of place interested, the operation of login merchandise news homepage; Advertiser servers 3 is connected with client 2, and advertiser servers 3 round-the-clock receptions are also exported the place advertisement picture that each client 2 sends; The e-advertising information that advertiser servers 3 reception image content analyses and retrieval unit 4 return is also transmitted and is given client 2; Analysis of image content is connected with advertiser servers 3, advertisement picture database 5 and information of goods information data storehouse 6 with retrieval unit 4, receive the place advertisement picture that advertiser servers 3 provides, the retrieval database picture corresponding in advertisement picture database 5 with place advertisement picture, utilize the e-advertising information in the database picture index information of goods information data storehouse 6 that obtains then, and e-advertising information is returned to advertiser servers 5; Advertisement picture database 5 is made of a large amount of e-advertising pictures, is taken, collects and upgraded by advertiser; The label of these database pictures comprises: the literal that occurs in the title of commodity, series, the picture; There is many-to-one index relative in merchandise news e-advertising information in database picture and the information of goods information data storehouse 6, to each width of cloth database picture, can index e-advertising information corresponding in the information of goods information data storehouse 6; Information of goods information data storehouse 6 is made of the information of commodity in the picture in the advertisement picture database 5; The information of the commodity in the information of goods information data storehouse 6 comprises: sales promotion information, the commodity production of the title of commodity, the series number of commodity, the link of merchandise news homepage, commodity or producer's contact method is provided; There is the index relative of one-to-many in picture in merchandise news in the information of goods information data storehouse 6 and the advertisement picture database 5; To each bar product information, can the picture in the width of cloth of guiding to or a few width of cloth advertisement picture database 5.
Described place advertisement picked-up unit 1 is wherein a kind of of mobile phone, digital camera, the camera with camera function and the equipment with camera function, has and takes and store place advertisement picture function.
Described client 2 is installed in tool devices and handset having Internet, computing machine or other has above the equipment of function of surfing the Net; Described client 2 can read the place advertisement picture that advertisement picked-up unit 1 is preserved at any time, and sends to advertiser servers 3; Receive the also electronic article advertising message of display ads merchant server 3 transmissions in real time.
Described advertisement picture database 5 changes with the variation of place advertisement; For newly-built place advertisement, corresponding database picture is collected by advertiser, sets up newly-increased database picture and corresponding goods information index relation and preserves the database picture in advertisement picture database 5; To out-of-date place advertisement, the index relative between the corresponding out-of-date merchandise news in corresponding with it out-of-date database picture and the information of goods information data storehouse 6 in the releasing from advertisement picture database, and delete out-of-date database picture in the advertisement picture database 5.
Described information of goods information data storehouse 6 is real-time update with the change of advertisement picture database; The merchandise news of newly-established and advertising database Fig. 5 sheet being set up index relative deposits information of goods information data storehouse 6 in; Deletion has been disengaged the merchandise news of all index relatives from commodity information database 6.
Illustrate as Fig. 2, the structure of analysis of image content and retrieval unit 4, analysis of image content and retrieval unit 4 comprise picture picture analysis module 41 and picture character analysis module 42; Described picture material adopts retrieval of picture image content and the mode that literal analysis in the picture combines with analytic unit 4, has increased the accuracy of result for retrieval.
Picture picture analysis module 41 in described analysis of image content and the retrieval unit 4 comprises to the pre-service of database picture, to the expression in real time of place advertisement picture with to three links of database picture real time indexing;
The pretreated process of database picture comprises that database picture local features is extracted, code book generates and three steps are represented in the vectorization of database picture; Step 11: marking area also is described as 128 dimensional vectors with detected all marking areas in database picture local feature extraction employing yardstick invariant features conversion (SIFT) the detection database picture, is referred to as database picture local feature; Step 12: select a part of database picture local feature to carry out the k-mean cluster at random, generate k cluster centre and be referred to as code word, this k code word constitutes code book, and we select k=1000 here; Step 13: the database picture local feature that extracts all is mapped on the code word in the code book according to nearest neighbouring rule, adds up the number of times that all code words occur then in each width of cloth database picture, form code word occurrence number histogram; A dimension be the k=1000 histogram vectors to each width of cloth database picture correspondence like this; With the vector description of this histogram vectors, be referred to as database picture vector as the picture of database picture; These vectors are set up man-to-man index with generating these vectorial pictures, and these vectors are kept among the temporary folder T;
The expression in real time of place advertisement picture comprises place advertisement picture local features and extracts and two steps of place advertisement picture vectorization; Step 21: adopt identical mode described in the database picture pre-treatment step 11, extract place advertisement picture local feature; Step 22: adopt identical mode described in the database picture pre-treatment step 13, generate the vector description of current place advertisement picture;
Database picture real time indexing refers to the institute's directed quantity that calculates among the temporary folder T and the distance D (v between the place advertisement picture vector *, v i) be:
D ( v * , v i ) = Σ j = 1 N ( v * ( j ) - v i ( j ) ) 2 v * ( j ) + v i ( j )
Wherein, v *Refer to the vector description of place advertisement picture, v iBe the vector description of i width of cloth database picture correspondence in temporary folder T, v (j) refers to the numerical value of the j dimension of vector v.With the vector among the temporary folder T according to and place advertisement picture vector between from small to large series arrangement of distance; Because there is index relative one to one in database picture vector with the database picture in the temporary folder, therefore arrange R1, claim this to be arranged as the result for retrieval of picture picture analysis module 41 in analysis of image content and the retrieval unit 4 for one that has obtained the database picture.
Picture character analysis module 42 in described analysis of image content and the retrieval unit 4 comprises word area detection and two links of optical character identification (OCR) of place advertisement picture;
Place advertisement picture character zone is detected and is comprised that the conversion of picture gray-scale map, rim detection, connected domain analyzed for three steps; The gray-scale map conversion is about to three channel R, G, and the B coloured image is converted to gray level image Gray, passes through formula:
Gray=0.212671*R+0.715160*G+0.072169*B
Obtain the gray-scale map of place advertisement picture; Fig. 3 illustrates the four directions of using in the word area detection of the present invention to rope primary (sobel) rim detection, utilizes 0 °, and 45 °, 90 °, the Suo Bai of 135 ° of four directions (Sobel) detects son and does convolution with gray-scale map Gray, obtains the outline map E of four direction 0 °, E 45 °E 90 °E 135 °The outline map that finally obtains in the position (x, pixel value y) is: E (x, y)=max{E 0 °(x, y), E 45 °(x, y), E 90 °(x, y), E 135 °(x, y) }; On the outline map E that obtains, filtering reduces The noise to outline map E with 5 * 5 wave filters, as Fig. 4 the present invention's 5 * 5 smoothing filters is shown then; The big law of outline map utilization that obtains is carried out binaryzation; On the two-value picture that obtains, carry out morphology in the Flame Image Process and " close " operation, connect the edge that is disconnected; Utilize the mode of sliding window to calculate each some marginal density on every side, and the point that density is identical is formed connected domain; Remove too little or too thin connected domain; Remaining connected domain with similar connected domain size is merged, as the text candidates zone; Because the literal in the image varies in size, so text detection should carry out on a plurality of yardsticks, each yardstick, just different sliding window sizes, corresponding a series of candidate character region; These candidate character region are imported into optical character identification (OCR) unit then;
Optical character identification unit (OCR) detects after the input, reads in the candidate region, carries out optical character identification, and exports the literal that comprises in all candidate regions, is kept among the variable C.
The accuracy of the output result optimizing place advertisement picture picture of picture character analysis module 42 retrieval in described analysis of image content and the retrieval unit 4; Get preliminary search as a result among the R1 before M width of cloth database picture R2; To the i width of cloth database picture among the R2, can obtain the label information of described i width of cloth database picture, add up the number of times that each character in the described C variable occurs and add up in label, obtain the literal similarity s of i width of cloth database picture and place advertisement picture iIdentical mode can obtain the literal similarity of other database pictures and place advertisement picture among the R2; The literal similarity ω * s after the current location i of retrieval in the formation deducts weighting with i width of cloth database picture among the R2 iObtain new position i-ω * s i, ω is literal similarity weights; All database pictures among the R2 are resequenced the result for retrieval R3 after being optimized according to new position order from small to large; Get first width of cloth database picture among the R3, find corresponding merchandise news, return to advertiser servers 3 according to the index of merchandise news in database picture in the advertisement picture database 5 on the advertiser servers 3 and the information of goods information data storehouse 6.
Place of the present invention advertisement and electric network advertisement real-time interaction system roughly are described below: at first the user utilizes the interested place advertisement of place advertisement picked-up unit photographs to form place advertisement picture; Client reads place advertisement picture and by the internet place advertisement picture is sent to advertiser servers according to C/S (client/server) principle; Advertiser servers receives after the place advertisement picture, gives analysis of image content and retrieval unit with place advertisement picture; Analysis of image content and retrieval unit read place advertisement picture and according to described image are carried out the preliminary search result that the vectorization of place advertisement picture represents to form the database picture; While analysis of image content and described word area detection and the optical character identification (OCR) of carrying out of retrieval unit; The described OCR of the utilization recognition result of analysis of image content and retrieval unit is optimized the preliminary search result; Wherein database picture number is 100 in the R2, literal similarity weights ω=10; Analysis of image content and retrieval unit select to optimize first width of cloth database picture in the result for retrieval of back, utilize described advertisement picture database to obtain the merchandise news in the corresponding information of goods information data storehouse of first width of cloth database picture and return to advertiser servers with index relative between the information of goods information data storehouse.Advertiser servers sends to client by the internet with merchandise news according to C/S (client/server) principle after obtaining merchandise news that analysis of image content and retrieval unit return.Client receives after the merchandise news, is shown to the user for user's selection operation.
Advertisement of above-mentioned place and electric network advertisement real-time interaction system have the practicality and the using value of height.
The above; only be the embodiment among the present invention; but protection scope of the present invention is not limited thereto; anyly be familiar with the people of this technology in the disclosed technical scope of the present invention; can understand conversion or the replacement expected; all should be encompassed in of the present invention comprising within the scope, therefore, protection scope of the present invention should be as the criterion with the protection domain of claims.

Claims (9)

1. place advertisement and the mutual system of e-advertising data in real time, it is characterized in that, this system is made up of place advertisement picked-up unit, client, advertiser servers, analysis of image content and retrieval unit, information of goods information data storehouse and advertisement picture database, wherein:
Advertisement picked-up unit, place, the user takes the advertisement of interested place, obtains place advertisement picture;
Client is connected with place advertisement picked-up unit, and client reads place advertisement picture, and output place advertisement picture, the e-advertising information that real-time display ads merchant server returns; The user of client utilizes e-advertising information can dial manufacturer's phone of commodity in the advertisement of place interested, the operation of login merchandise news homepage;
Advertiser servers is connected with client, and the round-the-clock reception of advertiser servers is also exported the place advertisement picture that each client sends; The e-advertising information that advertiser servers reception image content analysis and retrieval unit return is also transmitted and is given client;
Analysis of image content is connected with advertiser servers, advertisement picture database and information of goods information data storehouse with retrieval unit, receive the place advertisement picture that advertiser servers provides, the retrieval database picture corresponding in the advertisement picture database with place advertisement picture, utilize the e-advertising information in the database picture index information of goods information data storehouse that obtains then, and e-advertising information is returned to advertiser servers;
The advertisement picture database is made of a large amount of e-advertising pictures, is taken, collects and upgraded by advertiser; The label of these database pictures comprises: the literal that occurs in the title of commodity, series, the picture; There is many-to-one index relative in merchandise news e-advertising information in database picture and the information of goods information data storehouse, to each width of cloth database picture, can index e-advertising information corresponding in the information of goods information data storehouse;
The information of goods information data storehouse is made of the information of commodity in the picture in the advertisement picture database; The information of the commodity in the information of goods information data storehouse comprises: sales promotion information, the commodity production of the title of commodity, the series number of commodity, the link of merchandise news homepage, commodity or producer's contact method is provided; There is the index relative of one-to-many in picture in merchandise news in the information of goods information data storehouse and the advertisement picture database; To each bar product information, can index the picture in a width of cloth or a few width of cloth advertisement picture database.
2. place as claimed in claim 1 advertisement and the mutual system of e-advertising data in real time, it is characterized in that, described place advertisement picked-up unit is wherein a kind of of mobile phone, digital camera, the camera with camera function and the equipment with camera function, has and takes and store place advertisement picture function.
3. place as claimed in claim 1 advertisement and the mutual system of e-advertising data in real time is characterized in that, described client is installed in tool devices and handset having Internet, computing machine or other has above the equipment of function of surfing the Net; Described client can read the place advertisement picture that advertisement picked-up unit is preserved at any time, and sends to advertiser servers; Receive the also electronic article advertising message of display ads merchant server transmission in real time.
4. place as claimed in claim 1 advertisement and the mutual system of e-advertising data in real time is characterized in that described advertisement picture database changes with the variation of place advertisement; For newly-built place advertisement, corresponding database picture is collected by advertiser, sets up newly-increased database picture and corresponding goods information index relation and preserves the database picture in the advertisement picture database; To out-of-date place advertisement, the index relative between the corresponding out-of-date merchandise news in corresponding with it out-of-date database picture and the information of goods information data storehouse in the releasing from advertisement picture database, and delete out-of-date database picture in the advertisement picture database.
5. place as claimed in claim 1 advertisement and the mutual system of e-advertising data in real time is characterized in that described information of goods information data storehouse is real-time update with the change of advertisement picture database; The merchandise news of newly-established and advertising database picture being set up index relative deposits the information of goods information data storehouse in; Deletion has been disengaged the merchandise news of all index relatives from the commodity information database.
6. place as claimed in claim 1 advertisement and the mutual system of e-advertising data in real time is characterized in that described analysis of image content and retrieval unit comprise picture picture analysis module and literal analysis module; Described picture material adopts retrieval of picture image content and the mode that literal analysis in the picture combines with analytic unit, has increased the accuracy of result for retrieval.
7. place as claimed in claim 6 advertisement and the mutual system of e-advertising data in real time, it is characterized in that the picture picture analysis module in described analysis of image content and the retrieval unit comprises to the pre-service of database picture, to the expression in real time of place advertisement picture with to three links of database picture real time indexing;
The pretreated process of database picture comprises that database picture local features is extracted, code book generates and three steps are represented in the vectorization of database picture;
Step 11: marking area also is described as 128 dimensional vectors with detected all marking areas in the database picture local feature extraction employing yardstick invariant features change detection database picture, is referred to as database picture local feature;
Step 12: select a part of database picture local feature to carry out the k-mean cluster at random, generate k cluster centre and be referred to as code word, this k code word constitutes code book;
Step 13: the database picture local feature that extracts all is mapped on the code word in the code book according to nearest neighbouring rule, adds up the number of times that all code words occur then in each width of cloth database picture, form code word occurrence number histogram; Each width of cloth database picture correspondence a histogram vectors like this; With the vector description of these histogram vectors, be referred to as database picture vector as the picture of database picture; These vectors are set up man-to-man index with generating these vectorial pictures, and these vectors are kept among the temporary folder T;
The expression in real time of place advertisement picture comprises place advertisement picture local features and extracts and two steps of place advertisement picture vectorization;
Step 21: adopt identical mode described in the database picture pre-treatment step 11, extract place advertisement picture local feature;
Step 22: adopt identical mode described in the database picture pre-treatment step 13, generate the vector description of current place advertisement picture;
Database picture real time indexing refers to the institute's directed quantity that calculates among the temporary folder T and the distance D (v between the place advertisement picture vector *, v i) be:
D ( v , v i * ) = Σ j = 1 N ( v * ( j ) - v i ( j ) ) 2 v * ( j ) + v i ( j )
Wherein, v *Refer to the vector description of place advertisement picture, v iBe i width of cloth database picture corresponding vector description in temporary folder T, v (j) refers to the numerical value of the j dimension of vector v, with the vector among the temporary folder T according to and place advertisement picture vector between distance series arrangement from small to large; Because there is index relative one to one in database picture vector with the database picture in the temporary folder, arranges R1, claim this to be arranged as the result for retrieval of analysis of image content and retrieval unit picture picture analysis module for one that has therefore obtained the database picture.
8. place as claimed in claim 1 advertisement and the mutual system of e-advertising data in real time, it is characterized in that the literal analysis module comprises word area detection and two links of optical character identification of place advertisement picture in the picture in described analysis of image content and the retrieval unit;
Place advertisement picture character zone is detected and is comprised that the conversion of picture gray-scale map, rim detection, connected domain analyzed for three steps; The gray-scale map conversion is about to three channel R, G, and the B coloured image is converted to gray level image Gray, passes through formula:
Gray=0.212671*R+0.715160*G+0.072169*B
Obtain the gray-scale map of place advertisement picture; Utilize 0 °, 45 °, 90 °, the Suo Bai of 135 ° of four directions (Sobel) detects son and does convolution with gray-scale map Gray, obtains outline map E0 ° of four direction, E 45 °E 90 °E 135 °The outline map that finally obtains in the position (x, pixel value y) is:
E(x,y)=max{E (x,y),E 45°(x,y),E 90°(x,y),E 135°(x,y)};
Then on the outline map E that obtains, with 5 * 5 wave filters to outline map E filtering; The big law of outline map utilization that obtains is carried out binaryzation; On the two-value picture that obtains, carry out morphology in the Flame Image Process and " close " operation, connect the edge that is disconnected; Utilize the mode of sliding window to calculate each some marginal density on every side, and the point that density is identical is formed connected domain; Remove too little or too thin connected domain; Remaining connected domain with similar connected domain size is merged, as the text candidates zone; The literal that varies in size in to image on a plurality of yardsticks detects, and each yardstick is the sliding windows of different sizes, corresponding a series of candidate character region; These candidate character region are imported into the optical character identification unit then;
The optical character identification unit detects after the input, reads in the candidate region, carries out optical character identification, and exports the literal that comprises in all candidate regions, is kept among the variable C.
9. place as claimed in claim 7 advertisement and the mutual system of e-advertising data in real time is characterized in that, the accuracy of the output result optimizing place advertisement picture picture retrieval of described analysis of image content and retrieval unit Chinese words analysis module; Get preliminary search as a result among the R1 before M width of cloth database picture R2; To the i width of cloth database picture among the R2, obtain the label information of described i width of cloth database picture, add up the number of times that each character in the described C variable occurs and add up in label, obtain the literal similarity s of i width of cloth database picture and place advertisement picture iIdentical mode can obtain the literal similarity of other database pictures and place advertisement picture among the R2; The literal similarity ω * s after the current location i of retrieval in the formation deducts weighting with i width of cloth database picture among the R2 iObtain new position i-ω * s i, ω is literal similarity weights; All database pictures among the R2 are resequenced the result for retrieval R3 after being optimized according to new position order from small to large; Get first width of cloth database picture among the R3, find corresponding merchandise news, return to advertiser servers according to the index of merchandise news in database picture in the advertisement picture database on the advertiser servers and the information of goods information data storehouse.
CN200910244512A 2009-12-30 2009-12-30 Site advertisement and system for real-time interaction of electronic advertisement data Pending CN101789111A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN200910244512A CN101789111A (en) 2009-12-30 2009-12-30 Site advertisement and system for real-time interaction of electronic advertisement data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN200910244512A CN101789111A (en) 2009-12-30 2009-12-30 Site advertisement and system for real-time interaction of electronic advertisement data

Publications (1)

Publication Number Publication Date
CN101789111A true CN101789111A (en) 2010-07-28

Family

ID=42532314

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200910244512A Pending CN101789111A (en) 2009-12-30 2009-12-30 Site advertisement and system for real-time interaction of electronic advertisement data

Country Status (1)

Country Link
CN (1) CN101789111A (en)

Cited By (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102385728A (en) * 2010-08-26 2012-03-21 微软公司 Advertising targeting based on image-derived metrics
CN102542958A (en) * 2010-12-10 2012-07-04 财团法人资讯工业策进会 Multimedia playing method and system
CN102982348A (en) * 2012-12-25 2013-03-20 百灵时代传媒集团有限公司 Identification method of advertisement image
CN103077248A (en) * 2013-01-29 2013-05-01 俞天力 Cloud picture processing method and system
CN103353875A (en) * 2013-06-09 2013-10-16 华中科技大学 Method and system for media interaction based on visible search
WO2014079327A1 (en) * 2012-11-21 2014-05-30 腾讯科技(深圳)有限公司 Information pushing method and system, digital tv receiving terminal and computer storage medium
CN104025610A (en) * 2011-12-28 2014-09-03 英特尔公司 Systems, methods and apparatus for providing content based on a collection of images
CN104133819A (en) * 2013-05-03 2014-11-05 腾讯科技(深圳)有限公司 Information retrieval method and information retrieval device
CN104933140A (en) * 2015-06-18 2015-09-23 上海融视广告传媒有限公司 Media interaction method based on image
CN105095483A (en) * 2015-08-14 2015-11-25 北京铭嘉实咨询有限公司 Image code recognition method and system
CN105335439A (en) * 2014-08-12 2016-02-17 上海基美文化传媒股份有限公司 Advertising board photo identification interaction method
CN105338217A (en) * 2014-08-12 2016-02-17 上海基美文化传媒股份有限公司 Advertisement derivation application locating and interacting method
CN105608230A (en) * 2016-02-03 2016-05-25 南京云创大数据科技股份有限公司 Image retrieval based business information recommendation system and image retrieval based business information recommendation method
CN105631726A (en) * 2015-12-17 2016-06-01 天津市安佳信科技发展股份有限公司 Intelligent city shopping inquiry system
CN105913104A (en) * 2016-04-13 2016-08-31 上海厚吉智能科技有限公司 Calligraphy code generating method, calligraphy code generating system, calligraphy code analyzing method, calligraphy code analyzing system and calligraphy code label
WO2016173180A1 (en) * 2015-04-29 2016-11-03 百度在线网络技术(北京)有限公司 Image-based information acquisition method and device
CN106384111A (en) * 2016-08-30 2017-02-08 五八同城信息技术有限公司 Picture detection method and device
CN107016562A (en) * 2015-11-16 2017-08-04 东芝泰格有限公司 Offer system and publicity offer method are provided
CN107784061A (en) * 2016-08-24 2018-03-09 百度(美国)有限责任公司 It is determined that the method and system and machine readable media of the content genres based on image
CN108921185A (en) * 2018-05-04 2018-11-30 广州图匠数据科技有限公司 A kind of shelf sales promotion information recognition methods based on image recognition, device and system
CN111275134A (en) * 2020-02-26 2020-06-12 上海明略人工智能(集团)有限公司 Image matching method and device, storage medium and electronic device
CN113191813A (en) * 2021-05-14 2021-07-30 贵州海普科技有限公司 Marketing system and method based on image recognition
CN114758216A (en) * 2022-05-05 2022-07-15 北京容联易通信息技术有限公司 Illegal advertisement detection method and system based on machine vision

Cited By (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102385728B (en) * 2010-08-26 2015-11-25 微软技术许可有限责任公司 Advertising objective based on the tolerance obtained from image is located
CN102385728A (en) * 2010-08-26 2012-03-21 微软公司 Advertising targeting based on image-derived metrics
US9183557B2 (en) 2010-08-26 2015-11-10 Microsoft Technology Licensing, Llc Advertising targeting based on image-derived metrics
CN102542958A (en) * 2010-12-10 2012-07-04 财团法人资讯工业策进会 Multimedia playing method and system
CN102542958B (en) * 2010-12-10 2013-11-27 财团法人资讯工业策进会 Multimedia playing method and system
CN104025610B (en) * 2011-12-28 2017-11-17 英特尔公司 For providing the system of content, method and apparatus based on a collection of image
CN104025610A (en) * 2011-12-28 2014-09-03 英特尔公司 Systems, methods and apparatus for providing content based on a collection of images
WO2014079327A1 (en) * 2012-11-21 2014-05-30 腾讯科技(深圳)有限公司 Information pushing method and system, digital tv receiving terminal and computer storage medium
US9596520B2 (en) 2012-11-21 2017-03-14 Tencent Technology (Shenzhen) Company Limited Method and system for pushing information to a client
CN102982348A (en) * 2012-12-25 2013-03-20 百灵时代传媒集团有限公司 Identification method of advertisement image
CN103077248A (en) * 2013-01-29 2013-05-01 俞天力 Cloud picture processing method and system
CN103077248B (en) * 2013-01-29 2016-08-03 俞天力 A kind of high in the clouds image processing method and system
CN104133819A (en) * 2013-05-03 2014-11-05 腾讯科技(深圳)有限公司 Information retrieval method and information retrieval device
CN103353875B (en) * 2013-06-09 2016-12-28 华中科技大学 Media interaction method based on visual search and system
CN103353875A (en) * 2013-06-09 2013-10-16 华中科技大学 Method and system for media interaction based on visible search
CN105338217A (en) * 2014-08-12 2016-02-17 上海基美文化传媒股份有限公司 Advertisement derivation application locating and interacting method
CN105335439A (en) * 2014-08-12 2016-02-17 上海基美文化传媒股份有限公司 Advertising board photo identification interaction method
WO2016173180A1 (en) * 2015-04-29 2016-11-03 百度在线网络技术(北京)有限公司 Image-based information acquisition method and device
US10296997B2 (en) 2015-04-29 2019-05-21 Baidu Online Network Technology (Beijing) Co., Ltd. Image-based information acquisition method and apparatus
CN104933140B (en) * 2015-06-18 2018-07-17 上海融视广告传媒有限公司 A kind of Media method based on image
CN104933140A (en) * 2015-06-18 2015-09-23 上海融视广告传媒有限公司 Media interaction method based on image
CN105095483A (en) * 2015-08-14 2015-11-25 北京铭嘉实咨询有限公司 Image code recognition method and system
CN107016562A (en) * 2015-11-16 2017-08-04 东芝泰格有限公司 Offer system and publicity offer method are provided
CN105631726A (en) * 2015-12-17 2016-06-01 天津市安佳信科技发展股份有限公司 Intelligent city shopping inquiry system
CN105608230A (en) * 2016-02-03 2016-05-25 南京云创大数据科技股份有限公司 Image retrieval based business information recommendation system and image retrieval based business information recommendation method
CN105913104A (en) * 2016-04-13 2016-08-31 上海厚吉智能科技有限公司 Calligraphy code generating method, calligraphy code generating system, calligraphy code analyzing method, calligraphy code analyzing system and calligraphy code label
CN105913104B (en) * 2016-04-13 2018-09-21 上海厚吉智能科技有限公司 Calligraphy code generating method and system, analytic method and system and calligraphy code label
CN107784061A (en) * 2016-08-24 2018-03-09 百度(美国)有限责任公司 It is determined that the method and system and machine readable media of the content genres based on image
CN106384111A (en) * 2016-08-30 2017-02-08 五八同城信息技术有限公司 Picture detection method and device
CN106384111B (en) * 2016-08-30 2020-03-31 五八同城信息技术有限公司 Picture detection method and device
CN108921185A (en) * 2018-05-04 2018-11-30 广州图匠数据科技有限公司 A kind of shelf sales promotion information recognition methods based on image recognition, device and system
CN111275134A (en) * 2020-02-26 2020-06-12 上海明略人工智能(集团)有限公司 Image matching method and device, storage medium and electronic device
CN113191813A (en) * 2021-05-14 2021-07-30 贵州海普科技有限公司 Marketing system and method based on image recognition
CN114758216A (en) * 2022-05-05 2022-07-15 北京容联易通信息技术有限公司 Illegal advertisement detection method and system based on machine vision
CN114758216B (en) * 2022-05-05 2023-01-13 北京容联易通信息技术有限公司 Illegal advertisement detection method and system based on machine vision

Similar Documents

Publication Publication Date Title
CN101789111A (en) Site advertisement and system for real-time interaction of electronic advertisement data
CN104239408B (en) The data access of content based on the image recorded by mobile device
CN104809632B (en) A kind of generation method and device of the dynamic advertising based on template
CN106227786B (en) Method and apparatus for pushed information
US10282616B2 (en) Visual data mining
CN101950302B (en) Method for managing immense amounts of music libraries based on mobile device
CN102349087B (en) Automatically providing content associated with captured information, such as information captured in real-time
CN101292258B (en) System and methods for creation and use of a mixed media environment
CN102567543B (en) Clothing picture search method and clothing picture search device
CN109155136A (en) The computerized system and method for highlight are detected and rendered automatically from video
CN109983455A (en) The diversified media research result on online social networks
Kim et al. Multimodal post attentive profiling for influencer marketing
CN110929138B (en) Recommendation information generation method, device, equipment and storage medium
CN106204165A (en) A kind of advertisement placement method and device
DE202010018601U1 (en) Automatically collecting information, such as gathering information using a document recognizing device
DE202010018557U1 (en) Linking rendered ads to digital content
CN105975581A (en) Media information display method, client and server
CN103426003A (en) Implementation method and system for enhancing real interaction
CN103577549A (en) Crowd portrayal system and method based on microblog label
CN103631835A (en) Interest point information map presenting system and method thereof
CN103353875B (en) Media interaction method based on visual search and system
CN105631051A (en) Character recognition based mobile augmented reality reading method and reading system thereof
WO2013138846A1 (en) Method and system of interacting with content disposed on substrates
CN102395991A (en) Method and apparatus for providing moving image advertisements
CN105809464A (en) Method and device for information delivery

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Open date: 20100728