Classifications

• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T7/00—Image analysis
  • G06T7/40—Analysis of texture
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V10/00—Arrangements for image or video recognition or understanding
  • G06V10/40—Extraction of image or video features
  • G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
  • G06V10/462—Salient features, e.g. scale invariant feature transforms [SIFT]
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V20/00—Scenes; Scene-specific elements
  • G06V20/40—Scenes; Scene-specific elements in video content
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
  • G06V30/40—Document-oriented image-based pattern recognition
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2207/00—Indexing scheme for image analysis or image enhancement
  • G06T2207/10—Image acquisition modality
  • G06T2207/10004—Still image; Photographic image
  • G06T2207/10008—Still image; Photographic image from scanner, fax or copier
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2207/00—Indexing scheme for image analysis or image enhancement
  • G06T2207/30—Subject of image; Context of image processing
  • G06T2207/30176—Document

Definitions

• Method of verifying the saliency areas of a multimedia document method of creating an advertising document, method of automatically verifying the saliency areas of an Internet site, and associated computer program product.
• the invention relates to a device and a procedure for verifying the saliency areas of a multimedia document.
• the invention applies more particularly to the evaluation of content and more particularly of documents such as advertising documents.
• various techniques for creating contents are known: quite simply, while writing a text document, one overscores, one writes in bold, one frames, etc.
• More sophisticated techniques are used by advertisers which may, for video or audio, combine image processing techniques and sound processing techniques, more generally signal processing techniques.
• oculomethc techniques can aid in the determination of saliency areas. Such techniques however are manual and unwieldy to implement since they do not allow automation of the procedure on a plurality of documents, Web pages, video documents.
• the invention proposes a method of verifying the saliency areas of a multimedia document.
• the method comprises the steps of:
• the method comprises a step of calculating a ratio of the saliency contained in the key areas of the said document to the total saliency of the said document.
• the method comprises a step of calculating the visual path indicating the course of the eye during the viewing of the said document, the said visual path being calculated on the basis of the said saliency map and composed of the pixels of the image whose saliency is greater than a threshold.
• an analysis report comprising the saliency areas, the said visual path, and a set of sub-images representative of the saliency areas of the said document is compiled.
• the said report comprises the key areas of the said document.
• the invention also relates to a method of creating an advertising document.
• the method alternately comprises a step of creating the content followed by a method of verifying the saliency areas of the said document according to the invention, the said steps being repeated so long as the saliency areas do not correspond to the key areas of the said document.
• the invention also relates to a method of automatically verifying the saliency areas of an Internet site.
• the method comprises for each page of the site the steps of
• the invention also relates to a computer program product comprising program code instructions for the execution of the steps of the methods according to any one of the embodiments of the invention when the said program is executed on a computer.
• the invention is particularly advantageous in documents of an advertising nature where the components of the document are particularly important by dint of their economic impact.
• advertising films be they a video, simply audio or of still image type in a magazine, are particularly cultivated for placing messages that are attractive to the consumer.
• these messages are not necessarily the areas which will attract the human eye the most and in this case, the advertiser will not have created a document having the hoped for effect.
• the present invention is thus aimed at affording means of analysing the documents, whether or not they are advertising documents, so as to verify that these documents have the desired impact on their recipients.
• a saliency map is a topographic representation of the perception of an image.
• the visual relevance of each pixel of the image is determined.
• the map is normalized for example between 0 and 255. The higher the value, the more the pixel attracts the eye.
• Figure 1 represents the steps of the method according to a preferred mode of the invention.
• a paper document D of commercial document type is available.
• This document has been created on the basis of a piece of publishing software, for example acrobat writer (trademark registered by the company adobe), word (trademark registered by the company microsoft), of HTML type, the electronic version of which is available. It is possible therefore to extract from this document a priori information which reflects what the author of the document desired to bring to the fore. For example, in a document of word type, it is possible to judge the importance of the information as a function of the size of the characters used, of the character font used, of the overscohng, of the colour used. It is also possible to use the location on the sheet, in general the important information being placed at the centre of the image.
• tags are also an aid to the determination of the points that the author wants to bring to the fore.
• step E1 it is possible to compile (step E1 ) the a priori information representative of the key points of the document D according to the author. It is thus possible to obtain the geographical location of the areas of interest of the document.
• a model making it possible to build the saliency map of a document is available.
• this model is applied to the document D.
• the model is for example a piece of software receiving the document D as input.
• the model analyses the characteristics of the document that are necessary for the extraction of saliency maps so as to obtain the saliency map of the document D.
• Information of text type as well as information of face type are also extracted since usually they are also representative of information considered to be important, when the text is included in a video document.
• an analysis report is obtained containing the following information:
• This visual course is obtained by searching through the saliency map for the local maxima having a saliency value greater than a threshold, as a function of the number of maxima that one desires to obtain or as a function of the global saliency of the image.
• the search for the local maxima can for example be done by disabling a circular area (representing the fovea of radius equal to 0.5 of a visual degree) about the (n-1 ) th maximum and by seeking the global maximum of this new map and so on and so forth for each maximum. For each maximum an area is therefore obtained and thereafter the centres of the areas n-1 ,n,... are joined so as to obtain the visual course of an average observer.
• a perceptual summary containing n sub-images of the image to be analysed. These sub-images are areas fixed by the observer.
• the sub-images are composed of the pixels about the local maxima.
• the number of sub-images is determined by fixing a threshold and sub- images are defined only for the maxima having a saliency value greater than this threshold.
• This information makes it possible to detect the areas of the image that are actually perceived by the human eye.
• step E1 the areas indicated by the author of the document or extracted automatically during step E1 and the areas indicated in the analysis report are compared. It is thus possible to compare what the author desired to bring to the fore in the document with the information that actually catches the human eye, by placing opposite one another the a priori information and the information of the analysis report.
• the analysis report can also provide this analysis directly by implementing a step of direct comparison between the saliency map and the a priori data. Specifically, it is possible to compare the geographical location of the saliency areas and of the areas considered to be important by the author.
• the invention therefore advantageously proposes a procedure for evaluating documents of a commercial or advertising nature.
• the invention can also be seen as being a remote method for the evaluation of advertising documents. It is actually possible to envisage the model being available on an Internet site and the client submitting his document in electronic form so as to ascertain the points/areas which will in reality catch the human eye. The user of the service, as a function of the result of the comparison can then modify his document and resubmit it in an iterative manner in such a way that the information that he desires to bring to the fore is indeed the information on which the human eye will focus.
• the method can also have as application the evaluation of several documents submitted by clients following a call for tenders. It is thus possible to analyse in an automatic and objective manner which document is the one that will have the most impact on the consumers.
• the document D is not a paper document or a still image, of the advertising insert type but a video document like the advertisements transmitted on televisual channels.
• a document can also be analysed according to the method implemented in the invention. Actually, it is also possible to compile a saliency map on the basis of the temporal information. Such a method is described in the document by O. Le Meur, P. Le Callet, D. Barba and D. Thoreau, "A spatio-temporal model of the selective human visual attention", Proc. ICIP-05 (IEEE International Conference on Image Processing), Genoa, Italy, September 2005. It is therefore possible to thus also obtain the saliency map of the video document.
• the document to be analysed being an Internet site and each page of the site being analysed regularly, in an automatic or manual manner.
• an automatic procedure for running the method according to the invention on all the Web pages of the site and displaying of the report comparative result between the data considered to be key in the page by the author and the data of the page that are actually viewed by the eye if they are available, or blindly if the key data are not available.

Landscapes

• Engineering & Computer Science (AREA)
• Computer Vision & Pattern Recognition (AREA)
• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• Theoretical Computer Science (AREA)
• Multimedia (AREA)
• Artificial Intelligence (AREA)
• Management, Administration, Business Operations System, And Electronic Commerce (AREA)
• Information Transfer Between Computers (AREA)
• Document Processing Apparatus (AREA)
• Image Analysis (AREA)

Applications Claiming Priority (2)

Publications (1)

Family

ID=36972848

Family Applications (1)

Country Status (5)

Families Citing this family (4)

Family Cites Families (8)

• 2006
  • 2006-02-03 FR FR0650404A patent/FR2897183A1/fr active Pending
• 2007
  • 2007-02-01 CN CN2007800043768A patent/CN101379529B/zh not_active Expired - Fee Related
  • 2007-02-01 JP JP2008552812A patent/JP4896160B2/ja not_active Expired - Fee Related
  • 2007-02-01 WO PCT/EP2007/051001 patent/WO2007088193A1/en active Application Filing
  • 2007-02-01 EP EP07726278A patent/EP1979876A1/en not_active Ceased

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events