CN101685453B - Interactive commentary device, interactive commentary system and method thereof - Google Patents

Interactive commentary device, interactive commentary system and method thereof Download PDF

Info

Publication number
CN101685453B
CN101685453B CN200810168927.0A CN200810168927A CN101685453B CN 101685453 B CN101685453 B CN 101685453B CN 200810168927 A CN200810168927 A CN 200810168927A CN 101685453 B CN101685453 B CN 101685453B
Authority
CN
China
Prior art keywords
web page
commentary
fragments
content block
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN200810168927.0A
Other languages
Chinese (zh)
Other versions
CN101685453A (en
Inventor
胡长建
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NEC China Co Ltd
Renesas Electronics China Co Ltd
Original Assignee
NEC China Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NEC China Co Ltd filed Critical NEC China Co Ltd
Priority to CN200810168927.0A priority Critical patent/CN101685453B/en
Publication of CN101685453A publication Critical patent/CN101685453A/en
Application granted granted Critical
Publication of CN101685453B publication Critical patent/CN101685453B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The invention provides an interactive commentary device and a method thereof. The device comprises a webpage content block auxiliary selector and a commentary recording device, wherein, the webpage content block auxiliary selector is used for selecting the webpage content blocks corresponding to the webpage segments selected by users according to the relation between the network subsections; and the commentary recording device is used for recording the user commentaries related to the selected webpage content blocks. The invention also provides an interactive commentary system and a method thereof. The interactive commentary device and the method thereof in the invention are conducive for users to conveniently establish the webpage content blocks, thus reducing the time spent in selecting the webpage segments to establish the webpage content blocks.

Description

Interactive commentary device, interactive commentary system and method thereof
Technical field
The present invention relates to information retrieval and information presents field.Particularly, the present invention relates to interactive commentary device and method thereof and interactive commentary system and method thereof.
Background technology
Along with the availability universal and web presence of WWW is more and more stronger, many users start to depend on WWW as the information source of its work and amusement.At present, web browser becomes instrument the most frequently used on subscriber computer, and many users are regarded as the window of information world.
When user starts web browser and keys in URL wherein, user may have two primary demands.First demand is also basic demand, and user may want to browse the content that the expectation destination relevant to URL contained, and finds own more interested information.Second demand is to supplement demand, and user also thinks with his family, friend shares penetrating viewpoint or oneself impression, even just hopes that write may be to others or oneself useful thing.Last primary demand is called net surfing demand, and then a primary demand is called that social networks is browsed or interactive network is browsed demand.
Web browser is the excellent instrument that meets net surfing demand.But, for interactive network, to browse, existing network browser is inoperative.Web browser is not Web page editor, cannot provide instrument so that user edits and makes commentary and annotation the network of current download.There are two kinds of basic skills to allow user during net surfing, to make commentary and annotation, share and exchange.First method is that network application provider transmits correlated characteristic (for example, many news websites provide reader commentary system, encourage reader to leave feedback on website) when its website of issue.Second method is in web browser, to develop and insert some aids (being similar to the notes and commentary instrument of current document editing machine).
Current, the scope of document content piece (contents fragment) to be made commentary and annotation depends on user's (by left button rolling mouse of clicking the mouse) conventionally.Only have a small amount of legacy system that document content piece selection tool is provided, the patented claim WO2007/135688A2 that for example name is called " A method for interactive commenting on media files " provides a kind of graphical tool, for the fragment (fragment comprises at least one frame of video or film record) of selecting to make commentary and annotation.For example, if there be n frame in selected content of multimedia, user can use this instrument from n frame, to select m frame (1≤m≤n) to create fragment, remove frame from institute's selected episode and add frame to institute's selected episode.
Existing document content piece selection tool is generally unsatisfactory, because when generating fragment, it cannot automatically create fragment and help user and save time.Particularly:
Supposing has n frame in multimedia source files,
1. in order to create the fragment that comprises m frame, under worst condition, user will carry out m selection;
2., even if user selects a framing to create fragment all the time, he also needs again to select associated frame to create fragment next time;
3. user cannot be used as Segment A ingredient and generates new segment B, and therefore under worst condition, user will carry out the inferior selection of FC (B) and creates B, the number of the frame that FC (B) indication B comprises.
Since there is the commentary system of good Web page content block system of selection, can help people easily to make commentary and annotation with to share it required, so how to construct and there is the notes and commentary instrument of Web page content block selector switch easily and just become general problem, and the relation automatically creating between the ingredient that forms Web page content block is key point.
Therefore, need interactive commentary system to help user its interested content is made commentary and annotation, thereby save user's time and interactive commentary platform is provided.
Summary of the invention
For addressing the above problem, the present invention considers that interactive network browses demand.The present invention has constructed a kind of notes and commentary instrument of Web page content block selector switch easily that has, and automatically creates the relation between the ingredient that forms Web page content block.Therefore, having the commentary device of good Web page content block auxilary selector or commentary system contributes to people stay at an easy rate the notes and commentary of Web page content block and share it and wish the content of expressing.
According to first aspect present invention, the invention provides a kind of interactive commentary device, comprising: Web page content block auxilary selector, for according to the relation between web page fragments, select the Web page content block corresponding with user-selected web page fragments; And notes and commentary pen recorder, for recording the user annotation associated with selected Web page content block.
According to second aspect present invention, the invention provides a kind of interactive commentary method, comprising: Web page content block additional step, according to the relation between web page fragments, select the Web page content block corresponding with user-selected web page fragments; And notes and commentary recording step, record the user annotation associated with selected Web page content block.
According to third aspect present invention, the invention provides a kind of interactive commentary system, comprising: the webserver, for a plurality of webpages are provided; Web browser control module, for obtaining the webpage that user checks and offering Web page content block auxilary selector; Web page content block auxilary selector, for according to the relation between web page fragments, selects the Web page content block corresponding with user-selected web page fragments; Notes and commentary pen recorder, for recording the user annotation associated with selected Web page content block; And notes and commentary display unit, for showing user annotation.
According to fourth aspect present invention, the invention provides a kind of interactive commentary method, comprising: webpage provides step, by the webserver, provide a plurality of webpages; Webpage obtaining step, obtains the webpage that user checks and offers Web page content block additional step; Web page content block additional step, for according to the relation between web page fragments, selects the Web page content block corresponding with user-selected web page fragments; Notes and commentary recording step, records the user annotation associated with selected Web page content block; And notes and commentary step display, show user annotation.
Utilize Web page content block auxilary selector, user can create the Web page content block that will make commentary and annotation easily.This can significantly reduce selects necessary web page fragments to create the time that Web page content block spends.Particularly:
1. during creating Web page content block, the visual signature of web page fragments is helpful.
Suppose in webpage to exist one group of DIV piece telling about story.After the above-mentioned segmentation method of this web application, each DIV piece is corresponding to web page fragments.Because DIV piece is described same story, so their visual signature should be similar, thereby can create the relation between DIV piece.The whole story if user wants to make commentary and annotation, he only need move on to its mouse on arbitrary DIV piece and click the mouse, and the present invention just can help user to create desirable Web page content block.Obviously, this can save user's time.
2. in addition, the notes and commentary that the present invention can stay according to user, additionally create the semantic relation between different web pages fragment or Web page content block, thereby help the more complicated Web page content block of user's fast creation.
Supposing to have the Web page content block of two tape labels, is " ring of Hilary Clinton " to the notes and commentary of first Web page content block, to the notes and commentary of second Web page content block, is " earrings of Hilary Clinton ".If the ring of Hilary Clinton and earrings belong to same brand " Charriol ", user may want to stay the notes and commentary of " Hilary Clinton likes Charriol " and so on two network blocks.Because ring and earrings are all jewellery, so create the relation between two related web page content blocks based on notes and commentary " ring of Hilary Clinton " and " earrings of Hilary Clinton ", can create the new web page candidate blocks that comprises two Web page content blocks, the processing so that user makes commentary and annotation.
Accompanying drawing explanation
Fig. 1 a shows according to the schematic diagram of the interactive commentary system of first embodiment of the invention;
Fig. 1 b shows according to the schematic diagram of the Web content auxilary selector of interactive commentary system of the present invention;
The web page fragments that Fig. 1 c shows Web content auxilary selector is related to the schematic diagram of creation apparatus;
Fig. 1 d shows the schematic diagram of the web page contents candidate blocks generating apparatus of Web content auxilary selector;
Fig. 1 e is an example of segmentation webpage;
Fig. 2 a and 2b show the process flow diagram of interactive commentary method;
Fig. 3 is an example of the segmentation webpage for sorting;
Fig. 4 shows the interactive commentary system according to second embodiment of the invention;
Fig. 5 a shows according to the schematic diagram of the notes and commentary density visualization device of the interactive commentary system of second embodiment of the invention;
Fig. 5 b shows the process flow diagram of notes and commentary density visualization method;
Fig. 5 c shows a graphical examples of the process that forms notes and commentary density visual pattern to 5f;
Fig. 6 a shows according to the schematic diagram of the instant notes and commentary device of the interactive commentary system of second embodiment of the invention;
Fig. 6 b shows the process flow diagram of instant notes and commentary method;
Fig. 6 c is a screenshot capture example of instant notes and commentary to 6e;
Fig. 7 a shows the notes and commentary guider according to the interactive commentary system of second embodiment of the invention;
Fig. 7 b shows the process flow diagram of notes and commentary air navigation aid; And
Fig. 7 c is a screenshot capture example of notes and commentary navigation to 7d.
Embodiment
Referring now to accompanying drawing, the preferred embodiments of the present invention are described, in the accompanying drawings, identical Reference numeral or the identical element of numeral indication.In addition, in the following description, omitted the detailed description to known function and configuration, to avoid making theme of the present invention unclear.
Fig. 1 a is according to the schematic diagram of the interactive commentary system of first embodiment of the invention.
Interactive commentary system comprises web browser control device 1, web database 2, interactive commentary device 10, notes and commentary display device 5, data archive devices 9 and is positioned at the backstage central database 11 on remote server.Web browser control device 1 provides the API communicating with main frame (web browser) set, obtains the example of checking webpage, and requires web browser to upgrade HTML of current loading etc.Interactive commentary device 10 comprises Web page content block auxilary selector 3 and notes and commentary pen recorder 4.Web page content block auxilary selector 3 helps user to select this user to want to stay the Web page content block of notes and commentary.After user has selected Web page content block, will call notes and commentary pen recorder 4, afterwards, notes and commentary pen recorder 4 recording user editors' notes and commentary also store editor's notes and commentary in the central database of backstage into by data archive devices 9.The form of user annotation comprises multiple format, for example video, audio frequency, image or text.When user browses the webpage of the notes and commentary with other users, notes and commentary display device 5 is obtained the relevant webpage of commenting and showing the notes and commentary that band obtains to some extent from backstage central database 11 by data file unit 9.In addition, the notes and commentary of obtaining will be for generating redaction HTML source, and then web browser control device 1 comes the renewal of indication network browser to check page and relevant commentary with this redaction HTML source.
Fig. 1 b shows according to the schematic diagram of the Web content auxilary selector 3 of interactive commentary system of the present invention.Web content auxilary selector 3 is for helping user to select to stay the Web page content block of commentary.
Web content auxilary selector 3 comprises: webpage sectioning 31, it uses webpage segmentation method will check that webpage is divided into a plurality of web page fragments, and in volatile data base 36 webpage of memory segment; Web page fragments ID generating apparatus 32, it generates unique ID based on related urls, relevant HTML source etc. for each web page fragments; Visual Feature Retrieval Process device 33, its extract each web page fragments such as font color, font size, font-weight style, visual signatures such as position in web browser layout, and the information of extraction is stored in volatile data base 36; Web page fragments is related to creation apparatus 34, and its visual signature based on every pair of web page fragments and/or the relevant notes and commentary of obtaining from the backstage central database 11 of server by data archive devices 9, create the link between every pair of web page fragments, i.e. relation; And web page contents candidate blocks generating apparatus 35, its relation based between web page fragments generates a plurality of web page contents candidate blocks and candidate blocks is stored in volatile data base 36.Alternatively, Web content auxilary selector 3 can not comprise Visual Feature Retrieval Process device 33.Therefore, web page fragments is related to that creation apparatus 34, according to the similarity between two of the similarity based on common trait or web page fragments between two web page fragments relevant notes and commentary, creates the relation between web page fragments.Then, web page contents candidate blocks generating apparatus 35 is based on being related to that from web page fragments the relation that creation apparatus 34 obtains generates web page contents candidate blocks.
In addition, be understandable that, described exemplary Web content auxilary selector 3 for above.For example, in the present invention, webpage sectioning 31 and web page fragments ID generating apparatus 32 can be option means.
The web page fragments that Fig. 1 c and Fig. 1 d show respectively Web content auxilary selector is related to the schematic diagram of creation apparatus and web page contents candidate blocks generating apparatus.
Web page fragments is related to that creation apparatus 34 comprises: web page fragments relationship example extraction unit 301, and it extracts any two web page fragments as web page fragments relationship example; And web page fragments relationship example score computing unit 302, it calculates the score of each web page fragments relationship example, and by the web page fragments relation of score filtering mistake.For example, if the score of the web page fragments relationship example of calculating is less than threshold value, this web page fragments relationship example of filtering.
Web page contents candidate blocks generating apparatus 35 comprises recognition unit 311, related web page fragment acquiring unit 312, cluster cell 313, synthetic intensity computing unit 314 and sequencing unit 315.The user-selected current web page fragment of recognition unit 311 identification, for example, user clicks the mouse right button to select web page fragments in web page fragments.Related web page fragment acquiring unit 312 obtains all web page fragments relevant with current selected web page fragments from volatile data base 36.Cluster cell 313 pools each cluster by the web page fragments of obtaining, and each cluster is all considered as web page contents candidate blocks.Synthetic intensity computing unit 314 calculates the synthetic intensity of each web page contents candidate blocks by calculating the average of relevant cluster.Sequencing unit 315 sorts to web page contents candidate blocks by being combined into intensity.
Fig. 2 a and Fig. 2 b are the process flow diagrams of interactive commentary method.Now, in conjunction with Fig. 1 b, to 1d, this interactive commentary method is described.
With reference to Fig. 2 a, at S201, webpage sectioning 31 is divided into a plurality of web page fragments by webpage.Webpage sectioning 31 adopts some traditional segmentation algorithms webpage to be resolved into the smaller portions that are called web page fragments.Existing method comprises:
> C.Bouras, V.Kapoulas and I.Misedakis, " A Web-page Fragmentation Technique for Personalized Browsing " (Poster Absract), ACM SAC2004 (IDM track), March14-17,2004.Ramaswamy L, Iyengar A, Liu L, Douglis F.Automatic Fragment Detection in Dynamic Web Pages and Its Impact on Caching.IEEE Trans Knowledge Data Eng2005; 17 (6): 859-74.
Fig. 1 e shows the example of segmentation webpage.For all pictures in webpage, apply some image segmentation algorithms so that associated picture is divided into smaller portions.
In addition, for image, video etc., webpage sectioning 31 can provide selection tool, so that user selects by drawing circle, square etc., thus user's segmentation webpage manually.
At S202, web page fragments ID generating apparatus 32 generates unique ID for each web page fragments.Can identify following information for web page fragments: the URL of webpage under this web page fragments is, the HTML source of this web page fragments, the visual position of this web page fragments in web browser layout, possible existing guidance path or contingent action sequence.Based on above-mentioned information, use hashing algorithm, web page fragments ID generating apparatus 32 can generate unique ID of this web page fragments.
Web page fragments can have following form:
Table 1
Id (optional)
UID
URL
HTML source
Guidance path (optional)
Action sequence (optional)
At S203, Visual Feature Retrieval Process unit 33 provides the information of the visual signature of relevant each web page fragments via network browsing control device 1, such as font style (color, runic, underscore, italic, size etc.), the visual position on web browser UI, background style (background color, background image etc.).
The visual signature extracting can have following form:
Table 2
Id (optional)
UID
Visual signature
Wherein, in field " visual signature ", the data of storage can be as follows:
At S204, web page fragments is related to the relation that creation apparatus 34 creates between web page fragments, and web page contents candidate blocks generating apparatus 35 is in S205 generating web page content candidate blocks.
Particularly, with reference to Fig. 2 b, at S211, web page fragments is related to that the web page fragments relationship example extraction unit 301 of creation apparatus 34 is related to candidate translation example using any two web page fragments as web page fragments.At S212, web page fragments is related to that the web page fragments relationship example score computing unit 302 of creation apparatus 34 calculates the score that each web page fragments is related to candidate translation example, and by the web page fragments relation of score filtering mistake, thereby being related to candidate translation example, the web page fragments of only having score to surpass predetermined threshold can become web page fragments relationship example.
Web page fragments is related to that the score of candidate translation example is calculated as follows.A and B are two web page fragments, and RI (A, B) is that web page fragments is related to candidate translation example, the score of RI (A, B) (being designated as SI (RI (A, B)) is calculated by following equation:
SI(RI(A,B))=w 1·Sim(vs(A),vs(B))
+w 2·Sim(cms(A),cms(B))
+w 3·Sim(A,B)
w 1+w 2+w 3=1
Wherein,
W1, in w2 and w3, at least one can value be 0,
Vs (A) is the visual signature of web page fragments A,
Sim (vs (A), vs (B)) is the similarity between the visual signature of web page fragments A and the visual signature of web page fragments B.For measuring the similarity between web page fragments A and B from visual signature aspect, establishment comprises the algorithm of XML document similarity measurement (because visual signature formats with XML) and geometric relationship definite (record visual position information, this is the key factor of relation between indication web page fragments).
All user annotations that cms (A) indication is relevant with web page fragments A.
Sim (cms (A), cms (B)) is two similarities between relevant notes and commentary collection.First, certain synonymicon can be for the treatment of two notes and commentary collection.Then, certain similarity measurement for short text can be for generating score.
Sim (A, B) is the similarity based on common trait between two web page fragments, can use following equation to measure:
Sim ( A , B ) = compact ( DomPath ( A ) , DomPath ( B ) ) · Sim ( InnerText ( A ) , InnerText ( B ) ) tag ( A ) = tag ( B ) 0 tag ( A ) ≠ tag ( B )
When DomPath (A) represents the DOM path of the plain ea of for example html element relevant to web page fragments A, DOM path be from html document root element navigate to that the html element that ea experiences is plain, the sequence of the direct text of HTML mark and html element element.InnerText (A) represents the direct text of html element element ea.Compact (DomPath (A), DomPath (B)) represents the consistance of DomPath (A) coupling DomPath (B), and two DOM paths are more similar, and consistance is larger.
If SI (RI (A, B)) is greater than predefined threshold value, web page fragments relationship example in being stored in volatile data base 36 as the web page fragments relationship example of web page fragments relationship example score computing unit 302.Thereby obtain a minute intersegmental relation.Web page fragments relationship example has following form:
Table 3
Id (optional)
Web page fragments A
Web page fragments B
Be related to score
Then, at S213, the user-selected web page fragments of recognition unit 311 identification.User can use mouse to carry out the selection of web page fragments.
At S214, related web page fragment acquiring unit 312, according to relation between web page fragments, obtains the web page fragments relevant to current selected web page fragments from volatile data base 36.
At S215, cluster cell 313 is used the existing clustering methods such as k-Means, k-Medoids that all related web page fragments are carried out to cluster.Each web page fragments cluster is considered as web page contents candidate blocks.
At S216, synthetic intensity computing unit 314 averages by the value sum of each web page fragments in cluster, calculates the synthetic intensity of each web page contents candidate blocks, and wherein each web page fragments in cluster is assigned a value.
Web page contents candidate blocks can be stored in web page contents candidate blocks database and have following form:
Table 4
Id (optional)
Web page contents candidate blocks
Intensity
Visual position
Then,, at S217, sequencing unit 315 sorts to web page contents candidate blocks (that is, in cluster) by synthetic intensity.If synthetic intensity equates, according to the visual position of the visual shape of web page fragments relationship example, web page contents candidate blocks and web page contents candidate blocks, sort.Fig. 3 has provided the detailed description of this ordering mechanism.
Fig. 3 is the example for the segmentation webpage of sequence.The required window of large rectangle indicated number all-network content, is designated as Wr, and the rectangle at the thinner edge of band represents vision window, is designated as Wv.
Suppose that current selected web page fragments is web page fragments A.Other web page fragments B, C are relevant to web page fragments A with D.Web page contents candidate blocks comprises web page contents candidate blocks 1 (A+B), web page contents candidate blocks 2 (A+C) and web page contents candidate blocks 3 (A+D).
1) if the synthetic intensity of web page contents candidate blocks 1 (A+B) and web page contents candidate blocks 2 (A+C) is equal, web page contents candidate blocks 1 can be more preferential than web page contents candidate blocks 2, because the visual shape of web page contents candidate blocks 1 is compacter than the visual shape of web page contents candidate blocks 2.
2) if the synthetic intensity of web page contents candidate blocks 2 (A+C) and web page contents candidate blocks 3 (A+D) is equal, web page contents candidate blocks 2 can be more preferential than web page contents candidate blocks 3, because web page fragments D is outside vision window (Wv).
Although process flow diagram comprises S203 shown in Fig. 2 a, optional, this process flow diagram also can not comprise S203.So at S204, web page fragments is related to that creation apparatus 34 is according between any two web page fragments, (that is, common feature, such as inner word based on common trait, the similarity of the relevant notes and commentary of similarity corresponding html source code etc.) or web page fragments, creates the relation between web page fragments.At S205, web page contents candidate blocks generating apparatus 35 generating web page content candidate blocks.
Fig. 4 shows the interactive commentary system according to second embodiment of the invention.Than the interactive commentary system of the first embodiment, difference is that interactive commentary system shown in Fig. 4 also comprises notes and commentary density visualization device 6, make commentary and annotation device 7 and notes and commentary guider 8 immediately.The method that visualization is carried out in notes and commentary density on the webpage that notes and commentary density visualization device 6 provides checking and position, to help user to navigate to efficiently the hottest point region of webpage.Instant notes and commentary device 7 provides and allows a plurality of users any selected Web page content block to be carried out to the mechanism of instant notes and commentary.Notes and commentary guider 8 provides the method that allows user to check its interested Web page content block by the notes and commentary of navigation peer link.
By omitting in Fig. 4 and the description to identical ingredient in Fig. 1 a, to avoid making the present invention unclear.
Be appreciated that block diagram shown in Fig. 4 is exemplary interactive commentary system.Alternatively, in the present invention, notes and commentary density visualization device 6, immediately make commentary and annotation in device 7 and notes and commentary guider 8 each can be option means.
In following paragraph, notes and commentary density visualization device 6, make commentary and annotation device 7 and notes and commentary guider 8 immediately will be described respectively.
Fig. 5 a shows according to the schematic diagram of the notes and commentary density visualization device of the interactive commentary system of second embodiment of the invention.
Many users, after navigating to particular webpage, need to identify its interested part.If a lot of people are very interested in certain part of webpage, generally will think that this part is interesting.Because people can make commentary and annotation to its interested part, so the notes and commentary density map that notes and commentary density visualization device 6 can be drawn webpage.User can use this map, by the domain of dependence on simple click map, navigates directly to hottest point part.
Notes and commentary density visualization device 6 comprises that vision initialization unit 61, data capture unit 62, fundamental figure generation unit 63, notes and commentary density calculation unit 64, figure present engine 65 and positional information that can storage network page fragment, the first volatile data base 66 of relevant notes and commentary, notes and commentary number and graphic element.Notes and commentary density visualization device 6 can also comprise summary unit, its to shown in the notes and commentary of each web page fragments of network summarize, and notes and commentary are stored in the first volatile data base 66.
Fig. 5 b shows the process of notes and commentary density visualization.With reference to Fig. 5 b, at S501, vision initialization unit 61 is carried out fundamental figure initialization, such as allocate memory, generation painting canvas etc.At S502, data capture unit 62 obtains positional information and all relevant notes and commentary of all web page fragments in this webpage, then these information is stored in the first volatile data base 66.At S503, the positional information of fundamental figure generation unit 63 based on all web page fragments, draws fundamental figure as shown in Figure 5 c, and the graphic element of this figure is stored in volatile data base 66.At S504, the number that notes and commentary density calculation unit 64 calculates for the notes and commentary of each web page fragments, is stored in result of calculation in volatile data base 66 as notes and commentary density.Then, at S505, figure presents engine 65 and draw final graphics on the initialized painting canvas of vision initialization unit 61, and calls web browser control device 1 to user's display graphics.Fig. 5 d-5f shows final graphics, in Fig. 5 f, if the number of relevant notes and commentary is greater than predetermined threshold, at cone top, shows animation circle.Therefore,, when user clicks the graphic element of figure, web browser control device 1 navigates to the relevant portion of webpage for user.
Fig. 6 a shows according to the schematic diagram of the instant notes and commentary device of the interactive commentary system of second embodiment of the invention.
When user checks the notes and commentary that another user stays, user may disagree with that another user is about the suggestion of this Web page content block, so this user may want directly to talk about these notes and commentary with another user.The passage that instant notes and commentary device 7 is provided convenience to user carries out the discussion of relevant notes and commentary or selected Web page content block.
Instant notes and commentary device 7 comprises notes and commentary information acquisition unit 71, information broadcast unit 72, make commentary and annotation unit 73, batch data storage unit 74 and can store Web page content block, relevant notes and commentary, expositor's information and exchange second volatile data base 75 of making commentary and annotation immediately.Instant notes and commentary unit 73 can be the instrument based on dialogue.
Fig. 6 b shows the process of notes and commentary navigation.At S601, notes and commentary information acquisition unit 71 is obtained the expositor's of the Web page content block corresponding with user-selected web page fragments, the notes and commentary relevant with this Web page content block and the Web page content block that obtains information, and above-mentioned notes and commentary information is stored in the second volatile data base 75.At S602, information broadcast unit 72 notifies user to want obtained Web page content block immediately to make commentary and annotation to expositor.At S603, the unit 73 of immediately making commentary and annotation provide user can be directly and other users (expositor) platform of webpage any part is discussed, first all message that generate during exchanging are stored in volatile data base 75.At S604, batch data storage unit 74 is uploaded to backstage central database 11 by message temporarily.
For example, when user moves to mouse in the notes and commentary relevant with Web page content block or any web page fragments, present the ejection tool bar shown in Fig. 6 c-6e, and obtain related content piece.With reference to Fig. 6 d, if user's button click " initiate immediately notes and commentary ", the device 7 of immediately making commentary and annotation is given notice to all expositors that once obtained Web page content block left to notes and commentary, as long as these expositors' web browser activates.Meanwhile, with reference to Fig. 6 e, the device 7 of immediately making commentary and annotation is opened dialogue, by this dialogue user, can exchange each other.
In addition, user can be drawn to any web page fragments the right view of Fig. 6 e from the current webpage of checking, to start new chat sessions, and other users that make commentary and annotation with the related web page content blocks of the web page fragments once this being pulled share the viewpoint of the web page fragments that this is pulled.
Fig. 7 a shows the notes and commentary guider according to the interactive commentary system of second embodiment of the invention.
User, when carrying out net surfing, may want to excavate its interested relevant Web page content block when forward part.For example, when user checks the webpage of the earrings of talking about Hillary Clinton, he may wonder other jewellery of Hillary Clinton.Notes and commentary guider 8 provides the efficient visualization method of display web page content blocks cluster.
Notes and commentary guider 8 comprises Web page content block search engine 81, image pretreatment unit 82, Web page content block cluster reader 83 and can store the relevant notes and commentary of Web page content block, sequencing information, Web page content block and the 3rd volatile data base 84 of image.
In conjunction with Fig. 7 a and 7b, the process that notes and commentary are navigated is described now.
At S701, Web page content block search engine 81 is searched for all Web page content blocks relevant with the Web page content block corresponding to user-selected web page fragments from backstage central database 11, and Web page content block and relevance ranking information are stored in the 3rd volatile data base 84.At S702, image pretreatment unit 82 is each Web page content block searching and relevant notes and commentary synthetic image, and data are saved in the 3rd volatile data base 84.At S703, Web page content block cluster reader 83 shows the image of Web page content block storage in volatile data base 84, after sequence with visual means.
For example, if user is interested in the earrings of Hillary Clinton, and wonder the more information relevant with the jewellery of Hillary Clinton, he can select the web page fragments of the earrings of relevant Hillary Clinton.Notes and commentary guider 8 shows the interface of intersection website Web page content block navigation as shown in Figure 7 c.If user clicks " navigation ", the guider 8 of making commentary and annotation is opened full screen view (Fig. 7 d) and is shown related web page content blocks, by this view user, can easily check intersection website Web page content block.
Although described the present invention with reference to above-mentioned specific embodiment, the invention is not restricted to described embodiment, and be only defined by the following claims.Be appreciated that in scope and spirit of the present invention, invention technician can carry out any modification and change to embodiment.

Claims (38)

1. an interactive commentary device, comprising:
Web page content block auxilary selector, for according to the relation between web page fragments, selects the Web page content block corresponding with user-selected web page fragments, and wherein said Web page content block auxilary selector comprises:
Web page fragments is related to creation apparatus, for according to the similarity between the similarity based on common trait between web page fragments or two relevant notes and commentary based on web page fragments, creates the relation between web page fragments; And
Web page contents candidate blocks generating apparatus, for according to the relation between related web page fragment, generates one or more Web page content blocks; And
Notes and commentary pen recorder, for recording the user annotation associated with selected Web page content block.
2. equipment according to claim 1, wherein interactive commentary equipment also comprises:
Comment density visualization device, for the commentary to web page fragments according to user, to commenting density, carry out visualization.
3. equipment according to claim 2, wherein comment density visualization device and comprise:
Data capture unit, for obtaining the relevant commentary of positional information and the web page fragments of webpage web page fragments;
Figure generation unit, for generating figure according to the positional information of web page fragments;
Comment density calculation unit, for calculating the commentary number of each web page fragments, as commenting density; And
Figure presents engine unit, for present commentary density with graphic form.
4. equipment according to claim 3, wherein comment density visualization device and also comprise:
Sum up unit, for summing up the commentary of described each web page fragments, to show for each web page fragments.
5. according to the equipment one of claim 1-2 Suo Shu, wherein interactive commentary device also comprises:
Instant notes and commentary device, makes commentary and annotation immediately for the Web page content block that the web page fragments to user-selected is corresponding.
6. equipment according to claim 5, the device of wherein immediately making commentary and annotation comprises:
Notes and commentary information acquisition unit, for the second user's of obtaining the relevant commentary of the Web page content block corresponding to the selected web page fragments of first user, Web page content block and once the Web page content block obtaining being made commentary and annotation information;
Information broadcast unit, for wanting the commentary of being correlated with of Web page content block to obtaining to the second user notification first user;
Instant notes and commentary unit, for instant interpolation first user or the relevant commentary of the second user to the Web page content block obtaining.
7. according to the equipment one of claim 1-2 Suo Shu, wherein interactive commentary device also comprises:
Notes and commentary guider, for providing notes and commentary navigation to user.
8. equipment according to claim 7, the guider of wherein making commentary and annotation comprises:
Web page content block search engine unit, for searching for the Web page content block that the Web page content block corresponding to user-selected web page fragments is relevant, relevant notes and commentary and relevance ranking information;
Image pretreatment unit, is used to each Web page content block searching and the relevant synthetic image of commenting; And
Web page content block cluster reader, for showing the image of the Web page content block searching with sortord.
9. an interactive commentary device, comprising:
Web page content block auxilary selector, for according to the relation between web page fragments, selects the Web page content block corresponding with user-selected web page fragments, and wherein Web page content block auxilary selector comprises:
Visual Feature Retrieval Process device, for extracting the visual signature of a plurality of each web page fragments of web page fragments;
Web page fragments is related to creation apparatus, for according to the visual signature of web page fragments, creates the relation between related web page fragment; And
Web page contents candidate blocks generating apparatus, for according to the relation between related web page fragment, generates one or more Web page content blocks; And
Notes and commentary pen recorder, for recording the user annotation associated with selected Web page content block.
10. equipment according to claim 9, wherein Web page content block auxilary selector also comprises:
Webpage sectioning, for being divided into webpage a plurality of web page fragments; And
Web page fragments ID generating apparatus, distributes unique ID for each web page fragments to a plurality of web page fragments.
11. equipment according to claim 9, wherein web page fragments is related to that creation apparatus comprises:
Web page fragments relationship example extraction unit, for extracting any two web page fragments as web page fragments relationship example; And
Web page fragments relationship example score computing unit, for calculating the score of each web page fragments relationship example.
12. equipment according to claim 11, wherein web page fragments relationship example score computing unit according in the similarity between the visual signature of two web page fragments in web page fragments relationship example and web page fragments relationship example between two web page fragments in the similarity based on common trait and web page fragments relationship example to two web page fragments at least one similarity in the similarity between relevant two notes and commentary respectively, count the score.
13. equipment according to claim 9, wherein web page contents candidate blocks generating apparatus comprises:
Recognition unit, for identifying user-selected web page fragments;
Related web page fragment acquiring unit, for obtaining the web page fragments relevant to selected web page fragments;
Cluster cell, for the web page fragments of obtaining is carried out to cluster, and each cluster that related web page fragment is formed is as web page contents candidate blocks;
Synthetic intensity computing unit, for calculating the synthetic intensity of web page contents candidate blocks by calculating the average of cluster web page fragments; And
Sequencing unit, for sorting to web page contents candidate blocks according to synthetic intensity.
14. equipment according to claim 13, wherein sequencing unit sorts to web page contents candidate blocks according to synthetic intensity, visual position and visual shape.
15. according to the equipment one of claim 9 to 14 Suo Shu, and wherein interactive commentary device also comprises:
Instant notes and commentary device, makes commentary and annotation immediately for the Web page content block that the web page fragments to user-selected is corresponding.
16. equipment according to claim 15, the device of wherein immediately making commentary and annotation comprises:
Notes and commentary information acquisition unit, for the second user's of obtaining the relevant commentary of the Web page content block corresponding to the selected web page fragments of first user, Web page content block and once the Web page content block obtaining being made commentary and annotation information;
Information broadcast unit, for wanting the commentary of being correlated with of Web page content block to obtaining to the second user notification first user;
Instant notes and commentary unit, for instant interpolation first user or the relevant commentary of the second user to the Web page content block obtaining.
17. according to the equipment one of claim 9 to 14 Suo Shu, and wherein interactive commentary device also comprises:
Notes and commentary guider, for providing notes and commentary navigation to user.
18. equipment according to claim 17, the guider of wherein making commentary and annotation comprises:
Web page content block search engine, for searching for the Web page content block that the Web page content block corresponding to user-selected web page fragments is relevant, relevant notes and commentary and relevance ranking information;
Image pretreatment unit, is used to each Web page content block searching and the relevant synthetic image of commenting; And
Web page content block cluster reader, for showing the image of the Web page content block searching with sortord.
19. 1 kinds of interactive commentary methods, comprising:
Web page content block additional step, according to the relation between web page fragments, selects the Web page content block corresponding with user-selected web page fragments, and wherein said Web page content block additional step comprises:
Web page fragments is related to foundation step, for according to the similarity between the similarity based on common trait between web page fragments or two relevant notes and commentary based on web page fragments, creates the relation between web page fragments; And
Web page contents candidate blocks generates step, according to the relation between related web page fragment, generates one or more Web page content blocks; And
Notes and commentary recording step, for recording the user annotation associated with selected Web page content block.
20. methods according to claim 19, also comprise:
Comment density visualization step, the commentary according to user to web page fragments, carries out visualization to commenting density.
21. methods according to claim 20, wherein comment density visualization step and comprise:
Data acquisition step, the relevant commentary of obtaining positional information and the web page fragments of web page fragments in webpage;
Figure generates step, according to the positional information of web page fragments, generates figure;
Comment density calculation step, calculate the commentary number of each web page fragments, as commenting density; And
Figure rendering step, presents commentary density with graphic form.
22. methods according to claim 21, wherein comment density visualization step and also comprise:
Sum up step, sum up the commentary of described each web page fragments, to show for each web page fragments.
23. according to claim 19 to the method one of 20 described, also comprises:
Instant notes and commentary step, makes commentary and annotation immediately to the Web page content block that user-selected web page fragments is corresponding.
24. methods according to claim 23, the step of wherein immediately making commentary and annotation comprises:
Notes and commentary acquisition of information step, obtains the relevant commentary of the Web page content block corresponding to the selected web page fragments of first user, Web page content block and the second user's of once Web page content block obtaining being made commentary and annotation information;
Information broadcast step, wants the commentary of being correlated with of Web page content block to obtaining to the second user notification first user;
Instant notes and commentary step, adds first user or the second user relevant commentary to the Web page content block obtaining immediately.
25. according to claim 19 to the method one of 20 described, also comprises:
Notes and commentary navigation step, provides notes and commentary navigation to user.
26. methods according to claim 25, the navigation step of wherein making commentary and annotation comprises:
Web page content block search step, searches for the Web page content block that the Web page content block corresponding to user-selected web page fragments is relevant, relevant notes and commentary and relevance ranking information;
Image pre-treatment step is each Web page content block searching and the relevant synthetic image of commenting; And
Web page content block sorting procedure, the image of the Web page content block searching with sortord demonstration.
27. 1 kinds of interactive commentary methods, comprising:
Web page content block additional step, according to the relation between web page fragments, selects the Web page content block corresponding with user-selected web page fragments, and wherein Web page content block additional step comprises:
Visual Feature Retrieval Process step, extracts the visual signature of each web page fragments in a plurality of web page fragments;
Web page fragments is related to foundation step, according to the visual signature of web page fragments, creates the relation between related web page fragment; And
Web page contents candidate blocks generates step, according to the relation between related web page fragment, generates one or more Web page content blocks; And
Notes and commentary recording step, for recording the user annotation associated with selected Web page content block.
28. methods according to claim 27, wherein Web page content block additional step also comprises:
Web page fragments step, is divided into a plurality of web page fragments by webpage; And
Web page fragments ID generates step, to each web page fragments of a plurality of web page fragments, distributes unique ID.
29. methods according to claim 27, wherein web page fragments is related to that foundation step comprises:
Web page fragments relationship example extraction step, extracts any two web page fragments as web page fragments relationship example; And
Web page fragments relationship example score calculation procedure, calculates the score of each web page fragments relationship example.
30. methods according to claim 29, wherein web page fragments relationship example score calculation procedure comprises step: according to two web page fragments at least one similarity in the similarity between relevant two notes and commentary respectively in the similarity based on common trait and web page fragments relationship example between two web page fragments in the similarity between the visual signature of two web page fragments in web page fragments relationship example and web page fragments relationship example, count the score.
31. methods according to claim 27, wherein web page contents candidate blocks generation step comprises:
Identification step, identifies user-selected web page fragments;
Related web page fragment obtaining step, obtains the web page fragments relevant to selected web page fragments;
Sorting procedure, carries out cluster by the web page fragments of obtaining, and each cluster that related web page fragment is formed is as web page contents candidate blocks;
Synthesize intensity calculation procedure, by calculating the average of web page fragments in cluster, calculate the synthetic intensity of web page contents candidate blocks; And
Sequencing unit, sorts to web page contents candidate blocks according to synthetic intensity.
32. methods according to claim 31, wherein ordered steps comprises step web page contents candidate blocks being sorted according to synthetic intensity, visual position and visual shape.
33. according to the method one of claim 27 to 32 Suo Shu, also comprises:
Instant notes and commentary step, makes commentary and annotation immediately to the Web page content block that user-selected web page fragments is corresponding.
34. methods according to claim 33, the step of wherein immediately making commentary and annotation comprises:
Notes and commentary acquisition of information step, obtains the relevant commentary of the Web page content block corresponding to the selected web page fragments of first user, Web page content block and the second user's of once Web page content block obtaining being made commentary and annotation information;
Information broadcast step, wants the commentary of being correlated with of Web page content block to obtaining to the second user notification first user;
Instant notes and commentary step, adds first user or the second user relevant commentary to the Web page content block obtaining immediately.
35. according to the method one of claim 27 to 32 Suo Shu, also comprises:
Notes and commentary navigation step, provides notes and commentary navigation to user.
36. methods according to claim 35, the navigation step of wherein making commentary and annotation comprises:
Web page content block search step, searches for the Web page content block that the Web page content block corresponding to user-selected web page fragments is relevant, relevant notes and commentary and relevance ranking information;
Image pre-treatment step is each Web page content block searching and the relevant synthetic image of commenting; And
Web page content block sorting procedure, the image of the Web page content block searching with sortord demonstration.
37. 1 kinds of interactive commentary systems, comprising:
Network provides unit, for making the webserver that a plurality of webpages are provided;
Web browser control module, the webpage of checking for obtaining user, and offer Web page content block auxilary selector;
Web page content block auxilary selector, for according to the relation between web page fragments, selects the corresponding Web page content block of web page fragments selected from webpage with user, and wherein said Web page content block auxilary selector comprises:
Web page fragments is related to creation apparatus, for according to the similarity between the similarity based on common trait between web page fragments or two relevant notes and commentary based on web page fragments, creates the relation between web page fragments; And
Web page contents candidate blocks generating apparatus, for according to the relation between related web page fragment, generates one or more Web page content blocks;
Notes and commentary pen recorder, for recording the user annotation associated with selected Web page content block; And
Notes and commentary display unit, for showing user annotation.
38. 1 kinds of interactive commentary methods, comprising:
Webpage provides step, makes the webserver that a plurality of webpages are provided;
Webpage obtaining step, obtains the webpage that user checks, and offers Web page content block assisted Selection step;
Web page content block additional step, according to the relation between web page fragments, the corresponding Web page content block of web page fragments that selection is selected from webpage with user, wherein said Web page content block additional step comprises:
Web page fragments is related to foundation step, for according to the similarity between the similarity based on common trait between web page fragments or two relevant notes and commentary based on web page fragments, creates the relation between web page fragments; And
Web page contents candidate blocks generates step, according to the relation between related web page fragment, generates one or more Web page content blocks;
Notes and commentary recording step, records the user annotation associated with selected Web page content block; And
Notes and commentary show single stage, show user annotation.
CN200810168927.0A 2008-09-27 2008-09-27 Interactive commentary device, interactive commentary system and method thereof Expired - Fee Related CN101685453B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN200810168927.0A CN101685453B (en) 2008-09-27 2008-09-27 Interactive commentary device, interactive commentary system and method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN200810168927.0A CN101685453B (en) 2008-09-27 2008-09-27 Interactive commentary device, interactive commentary system and method thereof

Publications (2)

Publication Number Publication Date
CN101685453A CN101685453A (en) 2010-03-31
CN101685453B true CN101685453B (en) 2014-08-27

Family

ID=42048617

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200810168927.0A Expired - Fee Related CN101685453B (en) 2008-09-27 2008-09-27 Interactive commentary device, interactive commentary system and method thereof

Country Status (1)

Country Link
CN (1) CN101685453B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9152625B2 (en) 2011-11-14 2015-10-06 Microsoft Technology Licensing, Llc Microblog summarization
CN103092945B (en) * 2013-01-11 2019-11-26 北京百度网讯科技有限公司 A kind of searching method and device returned based on interface
CN104021155A (en) * 2014-05-21 2014-09-03 小米科技有限责任公司 Webpage display method and device
CN110634171B (en) * 2019-02-01 2024-02-27 北京完美知识科技有限公司 Device and method for drawing map

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3713594B2 (en) * 2000-07-24 2005-11-09 浩隆 池田 Web page registration method by e-mail, Web page registration apparatus by e-mail, recording medium recording program for registering Web page by e-mail, and e-mail

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
JP特开2002-108762A 2002.04.12
方勃等.用画线对Web 网页进行注释的协同浏览系统.《计算机工程》.2006,第32卷(第22期),第212页右栏第8段、第213页左栏第5段.
用画线对Web 网页进行注释的协同浏览系统;方勃等;《计算机工程》;20061130;第32卷(第22期);第212页右栏第8段、第213页左栏第5段 *

Also Published As

Publication number Publication date
CN101685453A (en) 2010-03-31

Similar Documents

Publication Publication Date Title
US9881008B2 (en) Content participation translation apparatus and method
US9514216B2 (en) Automatic classification of segmented portions of web pages
JP4893243B2 (en) Image summarization method, image display device, k-tree display system, k-tree display program, and k-tree display method
JP5383234B2 (en) Information processing apparatus and print control method
US9483577B2 (en) Small form factor web browsing
US9594730B2 (en) Annotating HTML segments with functional labels
US20110161806A1 (en) System and method for providing online versions of print-medium publications
US9529438B2 (en) Printing structured documents
WO2015047920A1 (en) Title and body extraction from web page
JP2008234658A (en) Course-to-fine navigation through whole paginated documents retrieved by text search engine
US8931002B2 (en) Explanatory-description adding apparatus, computer program product, and explanatory-description adding method
US20180225379A1 (en) Recommendation Based On Thematic Structure Of Content Items In Digital Magazine
JP4878591B2 (en) Content search device, content search method, program, and recording medium
CN101685453B (en) Interactive commentary device, interactive commentary system and method thereof
Hsiao et al. Screenqa: Large-scale question-answer pairs over mobile app screenshots
CN113407775B (en) Video searching method and device and electronic equipment
Sack et al. Integrating Social Tagging and Document Annotation for Content-Based Search in Multimedia Data.
Gali et al. Extracting representative image from web page
KR101079766B1 (en) Document Editor for Easily Inputting Metadata of Auxiliary Explanation and Link with Associating Internet Search
Erol et al. Multimedia clip generation from documents for browsing on mobile devices
JP2008269086A (en) Information recommendation device and information recommendation system
CN116506676A (en) Data processing method and related product

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20140827

Termination date: 20160927

CF01 Termination of patent right due to non-payment of annual fee