CN105793836B

CN105793836B - Method and apparatus for sharing and showing written information

Info

Publication number: CN105793836B
Application number: CN201480066734.8A
Authority: CN
Inventors: 朱有晟; 金晟基; 李栽准; 权大亨; 柳性旭; 林铉佑; 郑度泳
Original assignee: Samsung Electronics Co Ltd
Current assignee: Samsung Electronics Co Ltd
Priority date: 2013-10-04
Filing date: 2014-10-02
Publication date: 2019-11-19
Anticipated expiration: 2034-10-02
Also published as: KR20150041547A; EP3039557A4; EP3039557A1; CN105793836A; CN110851033A; KR102212210B1

Abstract

Provide the device and method for sharing written information.In one example, method includes the request received from user for showing content；The content synchronization information of position of the written information written information synchronous with being used for about content about content is obtained, and is synchronized based on content synchronization information and shows written information and content.

Description

Method and apparatus for sharing and showing written information

Technical field

It is related to method that is a kind of shared and showing written information with the consistent device and method of exemplary embodiment, and More particularly, to a kind of method of storage and the shared written information about content shown on the screen and it is related to A method of display written information.

Background technique

In general, user uses on the writing implement of pen or pencil paper included in such as book or notebook etc. Write the information about content.Recently, multimedia technology and mobile display device are developed, this allows the screen to equipment Directly input written information of the user about content.

Typically, since the written information for being input by a user equipment is encoded together with content, so being difficult to individually altogether It enjoys written information or controls the display of written information.For example, because the related content of modification copyright be it is illegal, user is not The related content of copyright can be stored together with the written information about the related content of copyright.Therefore, user must be independent Ground stores written information.

Even if it is opposite with which content that user is also difficult to differentiate between written information when written information is stored separately in user It answers.Therefore, in order to user using from receive the different equipment of the equipment of written information come using written information, user needs direct Ground stores and manages content and written information.

In addition, when showing written information in equipment, shown written information is not according to shown in equipment Content and change.Therefore, written information must not be indirectly deleted or modified in user.

Summary of the invention

Solution

One or more exemplary embodiments include a kind of and another collaborative share written information method, and a kind of The method of written information is shown on the screen of equipment or other devices.

Advantageous effects of the invention

Accoding to exemplary embodiment, at least one of collaborative share written information, content synchronization information and content, and And show the content with written information on the screen based on content synchronization information.

Detailed description of the invention

In conjunction with attached drawing, accoding to exemplary embodiment below description, these and or other aspects will be apparent With it is easier to understand, in the accompanying drawings:

Fig. 1 is the figure for showing the system for sharing written information accoding to exemplary embodiment；

Fig. 2 is the figure for showing written information layer accoding to exemplary embodiment；

Fig. 3 is the flow chart of the method for shared written information accoding to exemplary embodiment；

Fig. 4 is the block diagram of the equipment for sharing written information accoding to exemplary embodiment；

Fig. 5 is the flow chart of the method for shared written information according to another exemplary embodiment；

Fig. 6 is the block diagram of the equipment for sharing written information according to another exemplary embodiment；

Fig. 7 be synchronization accoding to exemplary embodiment and show written information method flow chart；

Fig. 8 is the figure for showing various written informations accoding to exemplary embodiment；

Fig. 9 is the figure for showing content synchronization information accoding to exemplary embodiment；

Figure 10 is accoding to exemplary embodiment in the first equipment, the second equipment, server and content providing server Between share written information sequence flow chart；

Figure 11 is the figure for showing the screen of display written information accoding to exemplary embodiment；

Figure 12 is the flow chart of the method for the display written information of an exemplary embodiment of the present invention；

Figure 13 is the block diagram of the equipment for showing written information accoding to exemplary embodiment；

Figure 14 is the figure for showing the mapping of written information and window accoding to exemplary embodiment；

Figure 15 is shown accoding to exemplary embodiment, according to the figure of the change of the written information of the movement of window；

Figure 16 is shown accoding to exemplary embodiment, according to the figure of the change of the written information of the change of the size of window；

Figure 17 is shown accoding to exemplary embodiment, according to the figure of the change of the written information of the display of window；

Figure 18 is shown accoding to exemplary embodiment, according to the figure of the change of the deactivated written information of window；

Figure 19 is the flow chart for showing the method for display written information according to another exemplary embodiment；

Figure 20 is the figure of the object in the window shown accoding to exemplary embodiment；

Figure 21 is to show the figure that written information is shown accoding to exemplary embodiment, according to the display of object；And

Figure 22 is the block diagram of the equipment for sharing and showing written information accoding to exemplary embodiment.

Specific embodiment

Exemplary embodiment overcomes disadvantage mentioned above and other shortcomings not described above.In addition, exemplary embodiment It does not need to overcome disadvantages mentioned above, and exemplary embodiment may not overcome any one of above problem.

One or more exemplary embodiments include: a kind of and another collaborative share written information method, Yi Jiyi The method that kind shows written information on the screen of equipment or other devices.

In addition aspect will be stated partly in the following description and part will be apparent according to description, or Person can be by the practice of exemplary embodiment by acquistion.

One aspect accoding to exemplary embodiment provides a kind of method of shared written information, the method includes The request for showing content is received from user；It obtains content, the written information about content and synchronizing content and writes letter Content synchronization information required for ceasing；And it is synchronized based on content synchronization information and shows written information and content.

The method, which may further include, determines that written information and content synchronization information about content exist.

The acquisition may include: acquisition content synchronization information；And it is obtained based on content synchronization information obtained At least one of written information and content.

The acquisition may include: acquisition content；And written information is obtained based on content obtained and content is same Walk at least one of information.

Content synchronization information may include at least one in mark (ID) information of content and the location information of written information It is a.

The location information of written information may include the page info of content, the frame information of content, written information about interior At least one of the position of frame of the position of the page of appearance and written information about content.

Written information may include about the event information for writing beginning event and writing End Event and about writing At least one of text information of information.

Content may include video content, and is synchronized based on content synchronization information and show written information and content It may include extracting and showing written information corresponding at least one frame of video content.

Content may include document content, and is synchronized based on content synchronization information and show written information and content It may include extracting and showing written information corresponding at least one page of document content.

The acquisition may include: to obtain about at least one of written information, content synchronization information and content Link address information；And based on link address information obtained, written information, content synchronization information are obtained from external equipment And at least one of content.

One aspect according to another exemplary embodiment provides one kind and has been recorded on for executing the method Program computer readable recording medium.

One aspect according to another exemplary embodiment provides a kind of method of shared written information, the method It include: display content；Written information is obtained based on user's input about shown content；And it is transmitted to external equipment Written information and content synchronization information, mark (ID) information and written information that the content synchronization information includes content are about interior The location information of appearance.

Content synchronization information can be the information for being used to synchronize written information and content by external equipment.

The method may further include storage content synchronizing information and written information；And based on the content stored Synchronizing information synchronizes and shows stored written information and content.

Obtaining written information may include that detection writes beginning event and writes End Event；And it is based on book detected Beginning event and writing End Event detected are write to generate written information.

Transmission may include the link address letter generated about at least one of content, content information and written information Breath；And link address information generated is transmitted to external equipment.

The location information of written information may include the frame information of content, the page info of content, written information about interior The coordinate information of frame at least one of of the coordinate information and written information of the page of appearance about content.

One aspect according to another exemplary embodiment, provide it is a kind of for sharing the equipment of written information, it is described Equipment includes: display request receiver, receives the request for showing content from user；Information obtainer, obtain content, about The written information and content synchronization information of content；And display unit, it is synchronized based on content synchronization information and shows book Write information and content.

Equipment may further include information determiner, and the information determiner is determined about the written information of content and interior Hold synchronizing information to exist.

Equipment may further include information obtainer, and it is same that the information obtainer obtains written information, content and content Walk at least one of information.

Information obtainer can obtain content synchronization information, and be write based on content synchronization information obtained At least one of information and content.

Information obtainer can obtain content, and written information and content synchronization letter are obtained based on content obtained At least one of breath.

Content may include video content, and display unit can extract and show with video content at least one The corresponding written information of frame.

Content may include document content, and display unit can extract and show with document content at least one The corresponding written information of the page.

Information obtainer may further include address information acquisition device, the address information acquisition device can obtain about The link address information of at least one of written information, content synchronization information and content；And information obtainer can be based on Link address information obtained obtains at least one of written information, content synchronization information and content.

Aspect according to another exemplary embodiment provides a kind of for sharing the equipment of written information, the equipment Include: display, shows content；Written information acquisition device is write based on user's input about shown content Information；And conveyer, written information and content synchronization information are transmitted to external equipment, the content synchronization information includes described Location information of mark (ID) information and written information of content about content.

Equipment may further include storage device, the storage device storage content synchronizing information and written information, In, display can be synchronized based on the content synchronization information stored and show stored written information and content.

Written information acquisition device may include: event detector, and detection writes beginning event and writes End Event；With And written information generator, writing letter is generated based on writing beginning event detected and writing End Event detected Breath.

Conveyer may further include link address generator, and the link address generator is generated about content, interior Hold the link address information of at least one of synchronizing information and written information.

Conveyer can transmit link address information generated to external equipment.

The embodiment of invention

The used herein, term including descriptive term or technical term should be interpreted have There is meaning apparent for those skilled in the art.However, according to the intention of those skilled in the art, precedent Or the appearance of new technology, the term can have different meanings.In addition, some terms can be selected arbitrarily, and And in this case, the meaning of selected term will be described in detailed description.Therefore, terminology used in this article It is defined based on the meaning of term with together with the description of specification.

In the description, when region is connected to another region, region can be not only directly connected, but also can be through By another equipment electrical connection therebetween.In addition, when region includes element, region may further include another element without It is to exclude other elements, unless in addition differently stating.In the following description, such as " unit " and the term of " module " instruction For handling the unit of at least one functions or operations, and they can be embodied as hardware or software, or pass through Hardware and software is combined to be embodied.

Exemplary embodiment is described more fully hereinafter with reference to the accompanying drawings.However, one or more in exemplary embodiment Embodiment can be typically embodied as in many different forms, and should not be construed as being limited to the reality stated herein Apply example；Instead, these embodiments are provided so that the disclosure will be sufficient and complete, and will be to common skill in the art Art personnel comprehensively convey the concept of one or more exemplary embodiments.In the following description, it is known that function or knot Structure is not described in detail, this is because they will obscure exemplary embodiment with unnecessary details.In addition, running through explanation Book, identical appended drawing reference indicates the same or similar element in attached drawing.

As used herein, term "and/or" includes one or more any in listed item in association With all combinations.When the expression of such as "...... at least one" is after the list in element, the entire column of modified elements Table, and the discrete component in list is not modified.

Through specification, written information can indicate to be displayed on equipment or the screen of other devices with based on user's input On the related information of interior perhaps object.According to various aspects, written information can be annotation information, and but not limited to this.Separately Outside, for convenience of description, mentioned written information herein can be configured as other types of information, such as scheme Picture, video, text etc..

Fig. 1 is the figure for showing the system for sharing written information accoding to exemplary embodiment.

With reference to Fig. 1, the first equipment 101 can be transmitted to the second equipment 103 written information and content synchronization information and from Second equipment 103 receives written information and content synchronization information.For example, the first equipment 101 and the second equipment 103 can share book At least one of write information and content synchronization information.In addition, the first equipment 101 and the second equipment 103 can share content.

According to various aspects, written information may include input from the user, such as use finger, stylus by user Deng the person's handwriting inputted on the touchscreen.As another example, written information can be defeated by keyboard, control stick, mouse etc. Enter.As another example, writing input may include approaching touch and directly touching.

As non-limiting example, the first equipment 101 and the second equipment 103 can be smart phone, intelligence TV, mobile electricity Words, personal digital assistant (PDA), laptop devices, media player, microserver, global positioning system (GPS) equipment, electricity Philosophical works terminal, digital broadcast terminal, navigation equipment, information station, MP3 player, digital camera, movement in addition or non-moving Calculate equipment, flat equipment, electric appliance etc..In addition, the first equipment 101 and the second equipment 103 may include touching for receiving The various equipment of input, such as electron plate or touch table (touch table).

First equipment 101 and the second equipment 103 may include display unit.Display unit may include the screen of electron plate Curtain.The example of the equipment of screen including electron plate includes liquid crystal display (LCD) panel, personal computer (PC), flat PC, smart phone, laptop devices etc., but not limited to this.

First equipment 101 and the second equipment 103 can receive written information from user via input unit.For example, input Unit may include any one of various user interfaces, such as mouse, keyboard, touch tablet, trace ball, electronic pen, touch Screen, microphone for voice recognition, imaging device for receiving motion command from user etc..The example of user interface is unlimited In this.

In addition, the first equipment 101 and the second equipment 103 can show content on window.It is set according to various aspects, first Standby 101 and second equipment 103 can map and show written information and window.Here, window can be application or equipment The unit that treated as the result is shown on the screen, as described in example of the Figure 11 to Figure 22.

According to embodiment, the first equipment 101 can show content based on user's input and obtain the book about content Write information.For example, the first equipment 101 can be inputted based on user show written information about content on the screen, and from Written information is extracted in user's input.

According to embodiment, content and written information can be display together by the first equipment 101, described it with reference to Fig. 2 and shown Example.In addition, the content synchronization information for being used for synchronous written information and content can be generated in the first equipment 101.Here, content Synchronization can be synchronous with content with written order information.

For example, equipment can obtain the written information about first content based on user's input.Then, equipment can incite somebody to action The second content one obtained about the written information of first content and with mark (ID) information identical with first content Play display.Equipment can show written information at the position of the second content, and the position of the second content and input are about in first The position of the written information of appearance is corresponding.

For example, in the synchronizing of content, when the first equipment 101 obtains the writing of the third page of the first document about content When information, the first equipment 101 or the second equipment 103 can with have in id information identical with the first document of content The included identical format of written information shows written information in the third page of the second document held.

According to embodiment, content synchronization information may include in the id information of content and the location information of written information extremely It is one few.Id information can identify content related with content synchronization information, and may include such as content the file information, The information of size about content, about content number of pages information, about information of frame number of content etc..

In addition, the location information of written information can identify the position of the written information in content according to embodiment, and It may include position in the page of content of the page info of such as content, the frame information of content, written information, written information Position etc. in the frame of content, and can show any other information of the position of written information in the content.For example, book The location information of write information may include indicating show on which part of content while synchronous written information and content The information of written information.

In addition, written information may include the location information of written information.

First equipment 101 can transmit at least one in written information, content synchronization information and content to the second equipment 103 It is a.As another example, the first equipment 101 can be generated about at least one in written information, content synchronization information and content A link address information, and link address information generated can be transmitted to the second equipment 103.

As another example, one or more in the first equipment 101 and the second equipment 103 can be server.Example Such as, one or more in the first equipment 101 and the second equipment 103 can be content server.

Second equipment 103 can receive the request for showing content from user, and can determine about requested aobvious The written information for the content shown and the presence of content synchronization information.For example, the second equipment 103 can be inputted based on user to show Content determines whether content synchronization information and written information about shown content on the screen of the second equipment 103 deposit , and synchronized based on content synchronization information and show written information and content.

In addition, the second equipment 103 can be obtained based at least one of content synchronization information, content and written information Content synchronization information, content and written information describe its example with reference to Fig. 3 to Fig. 6.As another example, the second equipment 103 Content, book can be obtained according to from the first equipment 101 or other equipment or server link address information obtained Write information and content synchronization information.

The example of content includes video content, audio content, picture material, document content etc., and but not limited to this.

First equipment 101 and the second equipment 103 can be inputted via any method in various methods based on user to mention It takes and generates written information.It is tied for example, the first equipment 101 and the second equipment 103 can detecte to write beginning event and write Beam event, to generate and extract written information.As another example, the first equipment 101 and the second equipment 103 can according to Family input shows the note (note) about content on the screen, and extracts the letter about note shown on the screen Breath, to extract and generate written information.

Event may refer to the input according to user and the operation of equipment that occurs.As an example, write events can wrap Whether include beginning event of writing, write End Event, write moving event, write the duration, write is continuously to touch, connect Nearly touch etc..

Obtain in perhaps information refer to by from server or other equipment reception content or information or by from Reading of content or information in the memory stored in equipment and the interior perhaps information that can be obtained.

Fig. 2 is the figure for showing the method for display written information accoding to exemplary embodiment.In this example, written information It is displayed on the screen of the equipment of the first equipment 101 or the second equipment 103 such as shown in FIG. 1.

With reference to Fig. 2, written information can be displayed on written information layer 203 based on user's input.In addition, equipment can be with It is displayed the content according to user's request on content layer 201.Equipment can make written information layer 203 and content layer 201 overlapping, To show content and written information.

With reference to Fig. 2, shown image may include at least one layer on the screen of the device.Content is displayed on display On the content layer 201 of content, written information is displayed on written information layer 203 and equipment can make content layer 201 and book Write information layer 203 is overlapping, to display together written information and content.Furthermore it is possible to render simultaneously on the screen and show figure Picture.It is to be further appreciated that showing that the method for content is without being limited thereto on the screen of the device.

For example, content and written information can be respectively displayed on each layer, and equipment can make each layer overlapping simultaneously And it is displayed on the screen.Therefore, equipment individually can only store written information, or be stored therein the screen for overlapping each layer, As the method for storing written information and content together.

In addition, written information and content can be respectively displayed on each layer by equipment based on content synchronization information, and And each layer can be made overlapping to provide the screen for the result for showing synchronous written information and content to user.

In addition, video content can be shown after synchronizing content and written information according to frame.As another example, literary Shelves content can be shown after synchronizing content and written information according to the page.

Fig. 3 is the flow chart of the method for shared written information accoding to exemplary embodiment.

With reference to Fig. 3, in operation S301, equipment receives the request for showing content from user.For example, equipment can be with base In the input of user to select one or more contents, and selected one or more contents are shown in screen On.In addition, equipment can be received from user for showing the writing about content before receiving the request for showing content The request of information and content synchronization information.

In operation S303, equipment obtains content, written information and content synchronization information.For example, content, written information and Content synchronization information can be received from the external equipment of such as server or they can be from the storage device of equipment (storage device) or memory (memory) etc. are obtained.

For example, equipment can input another equipment reception content from such as server based on user, and can determine With the presence or absence of about received content written information and content synchronization information.If written information and content synchronization information are true Real storage but they be not stored in equipment, then equipment can be obtained from another equipment written information and content synchronization letter Breath.

Equipment can receive while from the external equipment reception content of such as server about written information and content The information that synchronizing information whether there is.For example, content server or other kinds of server can store and have about with interior The information that the written information and content synchronization information of pass whether there is, and such information is supplied to equipment.As another Example, the information that whether there is about written information and content synchronization information can be included in the metadata of content.

The various types of the metadata of the metadata of such as content, the metadata of written information and/or content synchronization information Metadata may include about display written information and the information that whether there is of content synchronization information.Metadata can also include Link address information, the link address information provide the connection to written information, content and content synchronization information.Written information and Content synchronization information can be deposited with the format of the meta data file of a meta data file, individual meta data file etc. Storage and generation.In addition, equipment can obtain at least one of written information, content and content synchronization information.

When equipment stores at least one in written information and content synchronization information, written information, content synchronization information The remainder neutralized at least one of content can be based at least one of written information and content synchronization information quilt It obtains.

If equipment obtains at least one of content synchronization information, content and written information, equipment can determine it The presence of his information or content, and other information or content are obtained from external equipment.When content synchronization information, written information and When content is all stored in equipment, equipment can obtain content synchronization information, written information and content from its storage device.

As another example, equipment can be obtained about at least one of content, content synchronization information and written information Link address information.Therefore, equipment can be obtained based on link address information obtained content, content synchronization information and At least one of written information.For example, equipment can be obtained from the external equipment with address corresponding with link address Content.

Link address information can be included in one or more in content, content synchronization information and written information In.For example, the information that not whether there is only about content synchronization information and written information, and for being connected to content synchronization letter The link address information of breath and written information can be included in content.

As described herein, link address information may include uniform resource locator (URL) or other addresses. In addition, link address information can be stored in the metadata of content, content synchronization information and written information.Show as another Example, equipment can be from the external equipments of such as server or another equipment or from the storage device of equipment, to obtain connection ground Location information.

In operation S305, equipment is synchronized based on content synchronization information and shows written information and content.For example, setting It is standby to be shown written information in content based on the location information of included written information in content synchronization information On predetermined part.

Content synchronization information may include at least one of the id information of content and the location information of written information.Example Such as, the id information of content may include content the file information, about content size information, about content number of pages letter It ceases, about information of frame number of content etc..

The location information of written information may include that the page info of such as content, the frame information of content, written information exist The position of position and written information in the frame of content in the page of content, or times of the position for showing written information What other information.In other words, when written information and content are synchronized, the location information of written information may include about writing Information is shown in the information on which part of content.

Written information may include for example about event information, the text information for writing beginning event and writing End Event Deng.User can input the written information about content.In response, equipment can detecte writing beginning event and writing and terminate Event, and written information may include the position for receiving written information, the type and such as written information of written information The size of area or height.

For example, equipment --- such as passing through electronic pen or mouse --- can be received about content from user via interface It explains.In this example, user, which presses the button of mouse or compresses electronic pen, can be writing beginning event, and unclamp mouse Button or lift electronic pen and can be writing End Event.Write moving event may include be pressed from the button of mouse or The period that button when electronic pen is compacted until mouse is released or electronic pen is lifted, but not limited to this.

Equipment, which can detecte, inputs event generated by user, by detect written information shape and in the form of and root Written information is generated according to it.In addition, written information may include the text information of bitmap form.

The example of content may include video content and document content, and but not limited to this.Equipment can be from content synchronization Information extraction and show corresponding with each frame of video content written information, and it is synchronous and show written information with Content.

Another example of content is to can be following document contents: the document content not only may include comprising various documents Content and can also include shown content etc. in still image.Document content may include multiple pages, and Equipment can be extracted from content synchronization information and show written information corresponding with each frame in document content, Yi Jitong It walks and shows a little information of book and content.

Fig. 4 is the block diagram of the equipment 400 for sharing written information accoding to exemplary embodiment.

With reference to Fig. 4, equipment 400 includes request receiver 401, input unit 402, information determiner 403, display unit 405, information obtainer 407 and control unit 409, control unit 409 are also referred to as controller 409.

Request receiver 410 can receive the request for showing content from user.For example, equipment 400 can be by asking Receiver 401 is asked to receive the request for showing content from user.Request receiver 401 can also be received from user for selecting The request of content.Request receiver 401 can receive for selecting the user of written information or content synchronization information to request, and For showing the request of content.

Input unit 402 can be used by a user in input data, to control equipment 400 and in the display of equipment 400 Upper written information.For example, input unit 402 may include keypad, salient point (dome) switch, touch tablet, runner (jog Wheel), jog switch (jog switch) etc..For example, touch tablet may include hand capacity type of touch plate, piezo-resistive type Touch tablet, infrared beams sensing type of touch plate, surface acoustic wave types touch tablet, integral strain gauge (integral strain Gauge) type of touch plate, piezoelectric effect type of touch plate etc..Input unit 402 can also include speech recognition module, be used for Receive the camera etc. of the movement input of user.Input unit 420 can receive touch input or such as by mouse or keyboard The other kinds of input carried out, and written information is generated based on input.

Information determiner 403 may determine whether the written information and content synchronization information about content.For example, can To determine the presence for passing through request receiver 401 selected written information and content synchronization information.

The information that whether there is about written information and content synchronization information can be included in content.For example, response It is received in equipment 400 and at least one of written information and content synchronization information is selected via input unit 402 by user The input carried out, equipment 400 can determine that at least one of content, written information and content synchronization information whether there is.

Display unit 405 can be synchronized based on content synchronization information and show written information and content.For example, display Unit 405 can id information and written information based on the content that can be included in content synchronizing information location information come It synchronizes and shows content and written information.

Information obtainer 407 can obtain at least one of written information, content and content synchronization information.For example, letter Breath determiner 403 can determine that there are written informations and content synchronization information, and information obtainer 407 can obtain writing letter Breath and content synchronization information.As another example, user can choose content synchronization information or written information, information obtainer 407 can obtain at least one of content, content synchronization information and written information based on the determination of information determiner 403.

About content written information and content synchronization information be not stored in the example in equipment 400, information obtains Device 407 can be from external equipment, reception contents synchronizing information and the written information such as server of content server.

In some instances, information obtainer 407 can be based on being obtained in content, written information and content synchronization information At least one is at least one of content, written information and content synchronization information, not obtained before to obtain Remaining person.

For example, the residue person can based among content, content synchronization information and written information first information obtained, In the content the id information of included link address information or content and be obtained.

In some instances, information obtainer 407 may include obtaining about written information, content synchronization information and content At least one of link address information address information acquisition device.Information obtainer 407 is also based on by address information Acquisition device link address information obtained obtains at least one of written information, content synchronization information and content.

In the various examples, content may include both video content and document content.Therefore, display unit 405 can be with Corresponding with each frame written information is extracted from content synchronization information with synchronous and show content and written information, or Can be extracted from content synchronization information written information corresponding with each page with it is synchronous and show content and write letter Breath.

Equipment can obtain written information when video content is reproduced or from user when video temporarily stops.For giving birth to Example at the method for the written information about video content include separation video content and with same form by video content The method for being stored as subtitle.As another example, written information can be included in the center of video frame and in separation It is managed in layer, such as multi-view video coding (MVC)/scalable video (SVC) technology, but not limited to this.

The temporal information of video content can be included in content synchronizing information.Equipment can be based on temporal information come really Determine the time for showing written information, and shows written information on the frame of the video content at the identified time.Make For another example, video content via digital multimedia broadcasting (DMB) or can spread and take business and be received.

Equipment 400 may further include storage device (not shown).Storage device can store content, content synchronization letter At least one of breath and written information.

Control unit 409 can control included all components in equipment 400.For example, control unit 409 can wrap The operating unit of such as central processing unit (CPU) is included, and the inside of any component of equipment 400 can be included in, but It is not limited to this.

The equipment 400 of Fig. 4 can be the first equipment 101 and/or the second equipment 103 of Fig. 1.

Fig. 5 is the flow chart of the method for shared written information according to another exemplary embodiment.

With reference to Fig. 5, in operation S501, equipment shows content.For example, equipment can be based on the user of request display content Input is to show content.Content may include all objects that can be shown on the screen.In addition, content can be displayed on screen On window in curtain.

In operation S503, equipment obtains written information based on user's input about shown content.For example, setting It is standby the written information about content to be obtained from user via any one of various interfaces.Lead to when equipment receives user It crosses using mouse or electronic pen in the input of the setting-out on the screen for showing content, user can be inputted based on user to generate Written information and obtain written information.As another example, the input of setting-out can be received via keyboard.

Equipment can detecte write beginning event and write End Event, and based on the writing detected start event and The writing End Event that detects generates written information.In this example, equipment can input beginning and end by detection Time point and input duration generate written information, as above with reference to described by Fig. 3.Written information can be shown Show any position on the screen of the device.

According to various aspects, equipment can store written information, and can be generated and be stored based on written information Content synchronization information.For example, equipment can store written information and content synchronization information together.In addition, equipment can will be write Information and content synchronization information be stored in the metadata of written information, in the metadata of content synchronization information and/or content In metadata.

Equipment can be generated and store the link address in each of written information, content and content synchronization information Information.Link address information may include the letter about the address for accessing written information, content and/or content synchronization information Breath.

Link address information about written information, content synchronization information and/or content can respectively be stored in writing In information, content and content synchronization information.In addition, the link address information about written information, content and content synchronization information It can be included in one in written information, content and content synchronization information.

In addition, content synchronization information may include at least one in the id information of content and the location information of written information It is a.The location information of written information may include the page info of content, the frame information of content, written information content the page In position in the frame of content of position and written information.

In operation S505, the location information of id information and written information of the equipment to external equipment transmission including content Content synchronization information and written information.For example, equipment can be into such as server or the transmission of the external equipment of another equipment Hold synchronizing information and written information.In addition, equipment can store content synchronization information and written information in the storage device.Separately Outside, equipment itself may be operative to server.

The link address letter about at least one of content, content synchronization information and written information can be generated in equipment Breath, and link address information is transmitted to external equipment.In addition, equipment can be based on the request from external equipment come to outside Equipment transmits at least one of content, content synchronization information and written information.For example, external equipment can be server, Fig. 3 In equipment etc..

For example, external equipment can be based on from the received content synchronization information of equipment institute and written information, it will be in equipment Upper shown written information is shown in the second content with id information identical with first content shown in equipment On.When equipment transfers written information and content synchronization information to server, external equipment can be write from server Information and content synchronization information.

In addition, the method for Fig. 3 and Fig. 5 can be executed by an equipment.For example, an equipment, which can execute generation, writes letter Breath is with the method for content synchronization information and based on content synchronization information come method that is synchronous and showing written information and content.

Fig. 6 is the block diagram of the equipment 600 for sharing written information according to another exemplary embodiment.

With reference to Fig. 6, equipment 600 includes display unit 601, written information acquisition device 603, conveyer 605, link address life It grows up to be a useful person 611 and control unit 613, control unit 613 is also referred to as controller 613.

Display unit 601 can be inputted based on user and be displayed the content on the screen of equipment 600.

Written information acquisition device 603 can obtain written information based on user's input about shown content.In In this example, written information acquisition device 603 includes event detector 607 and written information generator 609.

Event detector 607, which can detecte, writes beginning event and writing End Event.Event detector 607 can also be examined It surveys and is writing beginning event and writing user's input between End Event, as described above with reference to fig. 5.

Written information generator 609 can be tied based on event and writing being write by event detector 607 is detected Beam event generates written information.

In this example, equipment 600 further comprises link address generator 611.For example, link address generator 611 The link address information about at least one of content, content synchronization information and written information can be generated.Link address is raw Growing up to be a useful person 611 can transmit link address information generated to external equipment by conveyer 603, or link address can be believed Breath is included in content, at least one of content synchronization information and written information.

Conveyer 605 can transmit at least one of content, content synchronization information and written information to server.

In addition, according to an embodiment of the invention, equipment 600 may further include storage device (not shown).Storage is single Member can store at least one of content, content synchronization information and written information.In addition, display 601 can be based on depositing The content synchronization information stored in storage unit is come the written information that synchronizes and show content He stored.

Control unit 613 can control all components of equipment 600, may include the operation list of such as central processing unit Member, and can be included in any component, but not limited to this.

According to an embodiment of the invention, equipment 600 can be the first equipment 101 or the second equipment 103 of Fig. 1.

Fig. 7 be synchronization accoding to exemplary embodiment and show written information method flow chart.

With reference to Fig. 7, in operation S701, at least one of equipment reception content, content synchronization information and written information. For example, equipment can according to the user's choice from external equipment reception content, content synchronization information and written information at least One, or can choose at least one of the content, content synchronization information and written information stored in a device.

When content is obtained, equipment can determine that written information and content synchronization information about content whether there is, And obtain written information and content synchronization information based on the definitive result.Equipment can pass through identification and written information or interior Hold the related content of synchronizing information to obtain written information or content synchronization information from external equipment or storage device.

In operation S703, equipment determines whether to obtain all in content, content synchronization information and written information.If All information are not obtained, then in operation S705, such as based at least one in content, content synchronization information and written information Included link address information obtains content synchronization information and written information in a.

Do not obtain all but at least one of acquisition content, content synchronization information and written information in response to equipment, Remaining person can automatically be received.Equipment can show acknowledgement window, which determines whether to receive for user removes Information except the information stored or the content that is stored and receive user's input.

When equipment via spread take business reception content when, equipment can synchronize each frame of written information and content, and And the frame that display is synchronized.In addition, equipment --- for example, server of such as service provider --- can connect from another equipment Receive synchronized frame.

Additionally it is possible to determine whether showing written information while showing content.For example, equipment can determine in display Hold synchronous with written information.

In operation S707, equipment is synchronized based on content synchronization information and shows written information and content.For example, In When showing content on the screen of equipment, location information and time letter based on included written information in content synchronization information Breath, written information can be shown together with content.As another example, equipment can be as showing about content before The written information about content is provided a user on screen as written information.

Equipment can receive the input for modifying written information from user.In response, apparatus modifications and book is stored Write information and content synchronization information, thus modification of the reflection about the written information of content.Therefore, believe with the writing of content synchronization Breath can be modified and be stored.

Equipment can determine the resolution ratio and size of written information based on the resolution ratio for the content being just reproduced and size. For example, content synchronization information may include the information of the relative size and resolution ratio about content and written information and about setting At least one of standby information of resolution ratio.Therefore, equipment can based on included information in content synchronization information come It synchronizes and shows content and written information.

Fig. 8 is the figure for showing various written informations 801 accoding to exemplary embodiment.

Written information 801 may include at least one of write events information 803 and text information 805.Event refers to Based on user's input or the operation of the equipment occurred from external equipment signal obtained.As an example, write events Information 803 may include writing beginning event, writing End Event, write moving event etc..

User's input that equipment can start input writing information by detection writes beginning event to generate, and passes through tracking The movement of user is write to generate writing moving event, and by user's input that detection terminates input writing information to generate End Event.

Write events information 803 may include information 807, information 807 for render written information and including for example by The coordinate information of the written information of user's input, size information, type information, roughness information, transparence information, touch are practical It touches still close to touch etc..

In addition, written information may include text information 805.For example, writing letter when user is using keyboard input text Breath can be generated and extracting text information from input text.Text information 805 may include for rendering text Information 809, roughness information, type information and the directional information of such as text.In addition, text information 805 may further include The message bit pattern of text.It in addition, the example of written information is without being limited thereto, and may include having with user's input for content Any information closed.

Included information can be classified and be stored as field in written information.In addition, written information can be with It is stored as the metadata of content, and is stored together with content synchronization information.

Fig. 9 is the figure for showing content synchronization information 901 accoding to exemplary embodiment.

With reference to Fig. 9, content synchronization information 901 may include the id information 903 of content and the location information 905 of written information At least one of.

For example, related to which content in order to identify the written information inputted by user, equipment can determine current pass Which content written information is had input in and extracts the id information about the content, such as identifier, and in generation Hold synchronizing information 901.

For example, id information 903 may include the length about identifier (such as identifying the filename of content), content Degree, the size of content, the frame information of content, content at least one of page info etc. information 907.In addition, id information 903 can also include the link address information of content.

Location information 905 may include the information 909 of the position about written information in the content.For example, content can be with It is document content, and location information 905 may include the information about the coordinate and the page for wherein showing written information.

The example of content synchronization information 901 is without being limited thereto, and may include that be used to have been displayed in the content Written information is shown in the other information at the same position of the content of id information having the same.

In addition, information included in content synchronization information 901 can be classified and be stored as field.In addition, Content synchronization information 901 can be stored as the metadata of content or be stored together with written information.

In addition, written information can be stored together with content synchronization information 901.

Figure 10 is accoding to exemplary embodiment in the first equipment, the second equipment, server and content providing server Between share written information sequence flow chart.

With reference to Figure 10, in operation S1001, the second equipment is to server request content synchronizing information and written information.In In Figure 10, content synchronization information and written information can be stored together.As another example, content synchronization information can be deposited Storage is the metadata of content or the metadata of written information.Here, the second equipment can be directly to the first device request content Synchronizing information and written information.

In operation S1003, server transmits the connection about content synchronization information and written information to the second equipment Location information.For example, server can store content synchronization information and written information, and server can be straight to second server Ground connection provides content synchronization information and written information.

In operation S1005, the second equipment is based on link address information to the first device request content synchronization information and book Write information.In some instances, it if server provides content synchronization information and written information to the first equipment, operates S1005 can be omitted.

In operation S1007, the first equipment transmits content synchronization information and written information to the second equipment.For example, first Equipment can provide content and content synchronization information and written information to the second equipment.

In operation S1009, the second equipment is based on content synchronization information to content providing server request content.For example, If content, from the storage unit that the first equipment was provided or was stored in the second equipment, the second equipment can not be to content Server request content is provided.

In operation S1011, content providing server is transmitted to the second equipment by the requested content of the second equipment.One In a little examples, server and content providing server can be same server.In other words, in a server can provide Hold, the whole in content synchronization information and written information.

In Figure 10, only written information is shared.As another example, content can be received first, and then, with The corresponding written information of content and content synchronization information can be received based on content.

In addition, if at least one of content, written information and content synchronization information are stored in the second equipment, Second equipment can not request the information being already stored in the second equipment to the first equipment or server.

Figure 11 is the figure for showing the screen 1101 of display written information 1105 accoding to exemplary embodiment.

With reference to Figure 11, the screen 1101 of equipment is showing written information 1105 and corresponding with written information 1105 Window 1103.

For example, the screen 1101 of equipment can be the screen of electron plate, and equipment can be via in various user interfaces Any one to receive written information 1105 from user, and by an institute's received written information 1105 display in screen 1101 On.The equipment of Figure 11 can be one or more in the first equipment 101 and the second equipment 103 in Fig. 1.

Window 1103 is the region that content is shown on screen 1101.It is executed for example, window 1103 can be for showing The execution window of the result of the application of web browser, Word note, PowerPoint etc., or can with as locating for equipment The result of reason is corresponding, and but not limited to this.

In addition, equipment can show at least one object in window 1103.For example, object may include image, text Sheet, table, video etc..Shown object can be the object of instruction full content on window 1103, or can be content In each object.In addition, child window included in window 1103 is also possible to object.Child window is referred in screen 1101 The region of middle display content, and can be shown window in window 1103.

Equipment can in any state display window 1103.In addition, equipment can be repaired according to the state of window 1103 Change and be shown in the display state of object and/or content shown in window 1103.

When window 1103 is easily selected by a user and can receive the input of user, window 1103 can be known as in sharp In state living.The deactivation status of window 1103 is when window 1103 is not easily selected by a user and can not receive the input of user When.For example, activation/deactivation Window state can correspond to'sOperating system,MAC operation system in activation/deactivation Window state, but not limited to this.In addition, window 1103 is aobvious Show and do not determined according to activation and deactivated state, and window 1103 can be even shown in deactivation status.

Equipment can on screen 1101 display window 1103 size.For example, the size of window 1103 can be based on use The dragging at family is inputted or is adjusted based on the input about size information.However, the method for the size of adjustment window 1103 is not It is limited to this.

Equipment can also change the position of the window 1103 on screen 1101.For example, user can based on user input come The moving window 1103 in screen 1101.For example, window 1103 can based on user dragging input or based on user about The input of coordinate information and moved.However, the method for moving window 1103 is without being limited thereto.

Window 1103 can also be maximized on the screen 1101 of equipment.The maximization of window 1103 may mean that tool There is the window 1103 of minification to be displayed on screen 1101 again.

Window 1103 can also be minimized, so that it is not displayed on screen 1101.However, the minimum of window 1103 The state of change do not mean that performed display window 1103 using pent state.In addition, the minimum of window 1103 State can be displayed on status bar.

According to various aspects, equipment can show written information 1105 on any region in screen 1101.For example, setting It is standby written information 1105 not only to be shown that it will be shown in any positions on screen 1101 on window 1103, and also On.

Equipment can by written information 1105 show on written information layer, and by include content window show including Hold on layer.Here, equipment can render simultaneously and show the image to be displayed on screen 1101.Show the screen of equipment The example of 1101 method is unrestricted, as described above in reference to figure 2.

Written information 1105 can be display together by equipment with the information about window 1103.In addition, equipment can be generated It is used for the content synchronization information of synchronous written information 1105, content shown on window 1103 and/or object, and can With with another collaborative share written information and content synchronization information.

Figure 12 is the flow chart of the method for display written information accoding to exemplary embodiment.

With reference to Figure 12, in operation S1201, equipment inputs to receive written information based on user.For example, equipment can be through Any one of various user interfaces by mouse, keyboard, touch tablet, touch screen, electronic pen etc. write letter to receive Breath.Equipment can show the written information received based on user's input on the screen.

In operation S1203, at least one of multiple windows shown by equipment selection on the screen.For example, equipment At least one of window shown on the screen can be selected based on user's input.Equipment can based on user input come At least one of window is selected, and it is unrelated with the state of activation of window or deactivation status.As another example, equipment can be with Theactivewindow is selected among window shown on the screen.

In operation S1205, the device map received written information of institute and institute in operation S1203 in operation S1201 At least one window of selection.For example, the mapping can map the received written information of institute and selected window.Show herein Example in, operation S1201 in institute received written information and operate S1203 selected at least one window can be together It is mapped and controls.Identifier can be assigned to each of written information and window, and two identifiers can be each other Mapping is to show the written information and window that should be controlled together.

Equipment can show the knot of mapping written information and selected window on the screen or on selected window Fruit.For example, can show that written order information is mapped to the finger of window when there is the written information being mapped on window Show symbol.Equipment can store written information.In addition, equipment can store the information and written information about window together, and Information about window can be included in the metadata of written information.Window information may include about being performed as showing At least one in the information of the application of window, the information about content and the information about object included in the window It is a.In addition, the information of the mapping about window and written information can be included in about the data of window and believe about writing In the data of breath.

In operation S1207, equipment obtains the state change message of the state of the change of indication window.For example, state changes Become the information of the state for the change that information may include indication window.The state of the state instruction window of the change of window is based on using Family input is changed and is shown by equipment.The example of the state of change include increase or reduce the size of window, window movement, The activation or deactivation of window, the maximization of window or minimum etc..

In operation S1209, equipment shows written information based on state change message on the screen.For example, display letter Breath may include that the whether shown window on the screen of indication window shows information.In addition, window shows that the example of information can With include about window currently whether shown information and about the maximization of window or the information of minimum.

Equipment can be based on window display information to determine whether to show written information on the screen, and selects on the screen Show written information to selecting property.In addition, equipment can also show the book for being mapped to window when window to be displayed on the screen Write information, and the written information for being mapped to window can not be shown when not being displayed on the screen window.

State change message may include window movement information, after which includes the movement about window The information of position.That is, the example of window movement information may include about window before position information and about window Change after position information.When window, which is based on user's input, to be moved and shown, state change message may include closing The information of coordinate after the moving distance and movement of window.Equipment can also be moved and be shown according to the window after movement Written information.

State change message can also include the window active information whether indication window is activated.Window active information Example may include the information whether changed about the state of activation of window and the information of the state of activation about current window.

Equipment can determine whether that display is mapped to the written information of window based on window active information, with selectivity Ground shows written information.

For example, equipment can will be mapped to that the written information on window is displayed on the screen when window is activated. That is, entire window and written information can be shown without being deactivated window covering when window is activated.For example, working as window When mouth and written information shown by least one layer, equipment can be by theactivewindow and the writing for being mapped to theactivewindow Information is shown in top layer.

In addition, when window is deactivated, equipment can not show a part for being mapped to the written information of window or It can not show the whole for being mapped to the written information of window.For example, when window is deactivated, equipment can not show with The overlapping region of theactivewindow, or the region overlapped with theactivewindow can be covered.Therefore, be mapped to another window or its The region of the written information of the overlapping deactivation window of his written information, can be not displayed on the screen.Here, it is not displayed It can also mean shown but can not be recognized by the user, this is because a part of window is by another window or other writings Information covering.

For example, state change message may include the window size information of the size of indication window, such as about change before The information of the size of window, about change rear hatch size information, about information for the rate that increases or decreases etc..

Equipment can show written information based on window size information.For example, the size when window is increased or decreased When, equipment can increasing or decreasing rate and increase or decrease shown written information based on the size of window.

Written information can also be mapped to the object in window.For example, state change message may include indication window The object of the display of upper object shows information.In other words, object shows that the example of information may include about object and object The information of display, for example, about the information of object, the coordinate of object, type of object etc. currently or previously whether is shown.

In some instances, the size of window can be limited.Therefore, all objects in window may not be same When it is shown.In other words, the amount of information to be displayed is likely larger than the amount of the display space on the screen of equipment.Therefore, it is A large amount of objects are shown in the window, and the window that the display on window has small size can be used in equipment --- such as, sub- window Mouthful --- method.As another example, scroll bar can be disposed on window, so that object shown on window can And therefore it is moved with being inputted according to user, a part of of object can be not displayed and alternatively new information can be with It is shown.

Equipment can show that information determine whether to show the written information for being mapped to object on the screen based on object, And show written information to the property of can choose.

When the entire object in window is shown, equipment can show the entire written information for being mapped to the object. As another example, when some or all of the object is not shown, some or all of corresponding written information can be with It is not displayed.For example, not being shown when according to some or all of the scroll operation based on user's input, the object in window When, being mapped to some or all of written information of the object can be not displayed.In addition, the only a part when object is shown When showing, the part of corresponding written information can the ratio based on the part of displayed object and be shown.

Written information can be mapped to the preferred coordinates in window.In addition, equipment can store written information, and book Write information may include the information about mapped window, as above with reference to described by Figure 11.

Equipment can also store the information about the object in the window for being mapped to written information.For example, about object Information may include the information --- coordinate of object in the type and window of such as object --- of the attribute about object with And the information about the application for being performed as display window.As described herein, object may include such as child window Window, image, text, table, video etc. any one of various contents.

When the window of the identical information of the window for including with being mapped is based on written information and about the window being mapped Information when it is displayed on the screen, determines whether also to show written information to the equipment property of can choose.For example, working as web browser When being closed and being re-executed to for web browser window being displayed on the screen, equipment may determine whether that storage is reflected It is mapped to the written information of web browser window.Therefore, determine whether written information and web-browsing to the equipment property of can choose Device window is display together.In addition, when equipment obtains at least one in written information, content synchronization information and content, if It is standby to obtain still none obtained residue person, and written information, content synchronization information and content are display together.

Figure 13 is the block diagram of the equipment 1300 for showing written information accoding to exemplary embodiment.

With reference to Fig. 3, equipment 1300 includes written information receiver 1301, window selector 1303, map unit 1305, shape State changes information obtainer 1307 and display unit 1309.

Written information receiver 1301 can be inputted based on user to receive written information.For example, written information receiver 1301 can receive written information via any one of various user interfaces, and the example of user interface is unrestricted System.In addition, can be displayed on display unit 1309 by the 1301 received written information of institute of written information receiver.

Window selector 1303 can choose at least one of multiple windows shown on the screen.For example, window Selector 1303 can select at least one of window shown on the screen based on user's input, and sharp with window It lives or deactivates unrelated.As an example, window selector 1303 can select activation among window shown on the screen Window.

Map unit 1305 can be mapped by the selected window of window selector 1303 and written information.For example, mapping Unit 1305 can map window and written information, and will indicate existing for mapped window and mapped written information Indicator is shown on written information or window.

State change message acquisition device 1307 obtains the state change message of the state of the change of indication window.State changes Information can also include the information of the state of the state of indication window and the change of window.The example packet of the state of the change of window The movement of size, window for increasing or reducing window, the activation of window or deactivation, the maximization of window or minimum etc. are included, As above with reference to described by Figure 11.

Written information can be displayed on the screen by display unit 1309 based on state change message.State change message can To include that the whether shown window on the screen of indication window shows information.Window show information example may include about Window currently whether shown information and about the maximization of window and the information of minimum.

Display unit 1309 may further include display determiner (not shown), which is based on window and shows Information determines whether for written information to be displayed on the screen.In addition, display unit 1309 can be based on the determination of display determiner Determine whether for written information to be displayed on the screen, and written information is selectively displayed on screen.

When window when it is displayed on the screen, display unit 1309 can also show the book for being mapped to shown window Write information.When window is not shown on screen, display unit 1309 can not show the written information for being mapped to window.

State change message may include window movement information, after which includes the movement about window The information of position.The example of window movement information include about window before position information and about the change of window after Position information.

According to embodiment, display unit 1309 can show the writing letter for being mapped to window based on window movement information Breath.For example, when window is based on user and inputs mobile, be mapped to it is mobile after the written information of window can also be according to being moved Dynamic window and moved and shown.

State change message may include window active information, and whether which includes being activated about window Information.The example of window active information includes the information whether changed about the state of activation of window and about current window The information of state of activation.

In some instances, display determiner can determine whether that display is mapped to window based on window active information Written information.In addition, display unit 1309 can selectively show written information based on the determination of display determiner.

When window is activated, display unit 1309 can will be mapped to that the written information of window is displayed on the screen. For example, entire window can be shown, without being deactivated window covering, and therefore, all written informations can be shown Show on the screen, so that written information is not covered by other written informations or another window.For example, when window and written information are logical Cross at least one layer it is shown when, written information can be displayed on top layer.

When window is deactivated, display unit 1309 can not show the part for being mapped to the written information of window or All.For example, equipment 1300 can not be shown or the overlapping area of window that can cover and be activated when window is deactivated Domain.Therefore, it is mapped to the region of the written information of the deactivation window overlapping with another window or other written informations, it can be with It is not displayed on the screen.In addition, equipment 1300 can not show some or all of written information.

State change message may include the window size information of the size of indication window.Display unit 1309 can be based on Window size information is mapped to the written information of window to show.For example, when the size of window is increased or decreased, equipment 1300 can increasing or decreasing rate and zoom in or out and can show written information based on size.

Written information can be mapped to the object in window by map unit 1305.State change message can be wrapped further The object for including the display of object on indication window shows information.

Display determiner can show information based on object to determine that no display on the screen is mapped to the writing of object Information.In addition, display unit 1309 can selectively show written information based on the determination of display determiner.

When the entire object in window is shown, display unit 1309 can show all books for being mapped to the object Write information.As another example, when some or all of object is not shown, display unit 1309 can not show writing letter Some or all of breath.In addition, map unit 1305 can will be reflected by the 1301 received written information of institute of written information receiver The preferred coordinates being mapped in window.

Equipment 1300 may further include the storage unit (not shown) of storage written information.Storage unit can also deposit The information about the window for being mapped to written information is stored up, as described above with reference to figure 1.Storage unit can also store pass The information of object in the window for being mapped to written information.

Equipment 1300 may further include the conveyer (not shown) that stored written information is transmitted to another equipment.

Control unit 1311 can control included all components in equipment 1300, and may include such as central The operating unit of processing unit (CPU), and can be included in another component.

Figure 14 is the figure for showing the mapping of written information and window accoding to exemplary embodiment.

With reference to Figure 14, window 1403 and 1405 is displayed on screen 1401.In this example, equipment can be based on user Input receives written information 1407, and the received written information 1407 of institute can be displayed on screen 1401.

Equipment can map written information 1407 and window 1405.For example, equipment can map written information 1407 to incite somebody to action Written information 1407 controls together with the written information about window 1403 or 1405.

In this example, equipment can receive user's input of the window 1405 in selection deactivation status from user, and And can based on user input by deactivation status window 1405 and written information 1407 it is mapped onto one another.

Written information 1407 can be mapped to the window 1403 or 1405 in state of activation by equipment.If equipment does not receive The input of window is selected to user, then equipment can be mapped onto one another by the window 1403 in written information 1407 and state of activation. Acknowledgement window for receiving the selection of user can be displayed for the selection of guidance user.Written information can be mapped to Theactivewindow and any one in deactivation window.

Equipment can show that instruction has the indicator for the written information for being mapped to window 1403 or 1405.In addition, setting The standby attribute information or metadata that can be shown as written information, written order information is mapped to the letter of which window Breath.

Content synchronization information includes the information for synchronizing content and written information.Therefore, equipment can be same based on content Step information will wherein show that substantial window and written information are mapped onto one another.

The written information for being mapped to window 1403 or 1405 can be controlled together with window 1403 or 1405, such as be referred to Described by example of the Figure 15 into Figure 21.

Figure 15 is shown accoding to exemplary embodiment, according to the figure of the change of the written information of the movement of window.

With reference to Figure 15, equipment can in screen 1501 moving window.For example, in screen window position can according to Family input or screen resolution ratio change and be changed and show.

In the example of fig. 15, first window 1503 is mapped to the first written information 1505.When first window 1503 exists When moving on the direction of arrow, the second window 1507 can be shown.In addition, first writes when first window 1503 is mobile Information 1505 can also be moved and be shown together with first window 1503, or vice versa.That is, first window 1503 Window and written information before being movement with the first written information 1505, and the second window 1507 and the second written information 1509 be the window and written information after movement.

Equipment can obtain state change message, as with reference to described by Figure 11.For example, state change message may include Window movement information, the window movement information include the coordinate information before moving, the coordinate information after movement, moving distance Deng.

Equipment is also based on window movement information to move and show written information.For example, when window is according to user When input is mobile, equipment can be by the mobile distance identical with window of written information, even if not receiving individual user's input.

In addition, user can also determine mobile mapped written information.

Figure 16 is shown accoding to exemplary embodiment, according to the figure of the change of the written information of the change of the size of window.

With reference to Figure 16, the size of window be can change in screen 1601.In this example, first window 1603 is mapped to First written information 1605.When the size of first window 1603 increases, the second window 1607 can be shown.In response to first The size of window 1603 is increased, the size of the first written information 1605 can also be increased together with first window 1603 and by Display.Alternatively, when the size of window reduces, the size of written information also be can reduce.

According to embodiment, equipment can obtain state change message.For example, state change message may include window size Information, the window size information may include that size information, the size of window before the size of window is changed are changed it The coordinate information and rate of change of size information, window afterwards.

Equipment is also based on window size information to change and show the size of written information.For example, when window When size inputs change according to user, equipment can change the size of written information based on the size of window and rate of change, i.e., Make not receive individual user's input.In addition, user can determine the size for changing mapped written information.

Figure 17 is shown accoding to exemplary embodiment, according to the figure of the change of the written information of the display of window.

With reference to Figure 17, window can be not displayed on screen 1701.For example, being minimized when window is not closed When, window may not be displayed on screen 1701.In this example, first window 1707 is mapped to the first written information 1709.When the size of first window 1707 is minimized, first window 1707 can be not displayed, such as the second window 1703 Like that.When first window 1707 is not displayed, the first written information 1709 for being mapped to first window 1707 can not also It is shown.

In other words, in Figure 17, first window 1707 and the first written information 1709 are the window and book before minimizing Write information, and by dotted line represented by the second window 1703 and the second written information 1705 be minimized and minimizing The window and written information being not displayed later.

Equipment can obtain state change message, in this example, state change message may include about window whether It is displayed on window on screen 1701 and shows information, about minimizing or the information of maximized window and about the big of window Small information.

Equipment is also based on window and shows information to determine whether to show written information.For example, when window is displayed on When on screen, equipment can show the written information for being mapped to window, and when window is not shown on screen, equipment It can not show written information.

As another example, when window is maximized, equipment can show the written information for being mapped to window, and When window is minimized, equipment can not show written information.In addition, when the window minimized is shown on the screen again When, equipment can show written information again.

In Figure 17, status bar 1711 is displayed on screen 1701.For example, when window is minimized, with window phase Corresponding expression or icon can be displayed on status bar 1711, and can be not displayed on screen 1701.In addition, closing It can be displayed on status bar 1711 in the information of the state of window and window.

Figure 18 is shown accoding to exemplary embodiment, according to the figure of the change of the deactivated written information of window.

With reference to Figure 18, the window in screen 1801 may be at state of activation or deactivation status.With reference to Figure 18, the first window Mouth 1807 is mapped to the first written information 1809 and the second window 1803 is mapped to the second written information 1805.Herein In example, first window 1807 is theactivewindow, and the second window 1803 is to deactivate window.

Theactivewindow can be shown on the screen without being covered by other window, object or written information.In other words, Entire theactivewindow can be shown on the screen.In addition, deactivating window can be shown on the screen, but can be swashed Window, deactivation window in addition, object or a little information coverings of book living.It in other words, can some or all of in deactivation window To be not displayed on the screen.

With reference to Figure 18, when at least one of first window 1807 and the second window 1803 are displayed on screen 1801 When, based on the first window 1807 as theactivewindow, as some or all of the second window 1803 for deactivating window quilt It covers and is not shown.When some or all of second window 1803 is not shown, it is mapped to the second window 1803 Some or all of second written information 1805 by first window 1807 or can also be mapped to the first of first window 1807 Written information 1809 is covered and is not shown.Alternatively, it is not shown when some or all of in the second written information 1805 When showing, some or all of second window 1803 can by first window 1807 or the first written information 1809 covering and not by Display.

Equipment can obtain state change message, and in this example, state change message may include window active information, The information that such as whether is activated about window, the information whether overlapped by other window about window and about overlapping The information of size.

Equipment can change the size of written information based on window active information.For example, when window is active When middle, equipment can show all written informations, and when window is in deactivation status, equipment can not show writing Some or all of information.Written information be activated window or be mapped to theactivewindow other written informations it is overlapping when, The overlapping part of written information can be not displayed.

In addition, equipment can apply the details above with reference to described in Figure 15 to Figure 18, to control window and written information Display.Therefore, when the size and location of window is changed together, equipment can be used is retouched above with reference to Figure 15 to Figure 18 The example stated controls the display of window and written information.

Figure 19 be show according to another exemplary embodiment, display written information method flow chart.

With reference to Figure 19, in operation S1901, equipment inputs to receive written information based on user.Equipment can be based on use The received written information of institute is displayed on the screen by family input.

In operation S1903, equipment selects at least one object in window.

In operation S1905, written information is mapped to selected object by equipment.For example, equipment by parsing about The information of window or interior perhaps information included in the window can obtain the information about the object in window.In addition, setting It is standby object in window to be determined based on the application of the information for display window or about content.Information about object Example may include object position and type.

Equipment can map written information based on the type of the object in window or coordinate, or child window can be write Information MAP is in the window.Information about object may include the information about content, and such as above with reference to Fig. 1 to Figure 10 Describedly, it can be included in content synchronizing information about the information of object.

In operation S1907, equipment obtains object and shows information.For example, object shows that information may include about object With the information of the display of object, such as about the information for currently or previously whether showing object, the coordinate information of object and right The type of elephant.

In operation S1909, equipment shows information based on object to show written information.For example, equipment can be based on Whether object is shown on window to determine whether that display is mapped to the written information of object.For example, if the size of window has Limit, then included all objects may not be simultaneously displayed in the window.Therefore, only when object is displayed on screen In window on when, equipment can just show the written information for being mapped to object.As set forth above, it is possible to the state based on window To determine the display for the written information for being mapped to object.

When the entire object in window is shown, equipment can show all written informations for being mapped to the object, And when some or all of the object in window is not shown, equipment can not show the writing letter for being mapped to the object Some or all of breath, as described in the example in Figure 21.

In addition, equipment can also store the information about the object in the window for being mapped to written information.For example, about The information of object may include the information of the attribute about object --- the type of the object in such as window and the seat of object Mark --- and the information about the application for being performed as display window.

Figure 20 is the figure of the object in the window shown accoding to exemplary embodiment.

With reference to Figure 20, window 2003 is displayed on screen 2001.In addition, child window 2005 be displayed on window 2003 it On.

For example, child window 2005 can be the example of object, and such as image, text, table and frame is various right As that can be displayed on window 2003.In other words, object can be included any object in window 2003 and can To be content.In addition, child window 2005 may include another child window.

Figure 21 is to show the figure that written information is shown accoding to exemplary embodiment, according to the display of object.

With reference to Figure 21, window 2103 is displayed on the screen 2101 of equipment.First object 2105 is displayed on window On 2103.As with reference to described by Figure 19, the first written information 2107 can be mapped to the first object in window 2103 2105。

Equipment can obtain Window state and change information, and in this example, it may include object that Window state, which changes information, Show information, object shows that information may include about the information of the type of the object in window, about the object in window The information of coordinate, about the object on window display information and window scrolling information.Furthermore it is possible to based on window Ticker position determines the display of the object on window.

With reference to Figure 21, when scroll bar is in first position 2113, the first object 2105 can be displayed in screen 2101 Window 2103 on.In this example, the first object 2105 in window 2103 is mapped to the first written information 2107.Work as rolling When dynamic item is moved to the second position 2115 from first position 2113, the first object 2105 can be not displayed, such as the second object 2109 like that.When the first object 2105 is not displayed, the first written information 2107 for being mapped to the first object 2105 can also To be not displayed, as the second written information 2111.

In Figure 21, the first object 2105 and the first written information 2107 are pairs when scroll bar is in first position 2113 As and written information, and the second object 2109 and the second written information 2111 are pairs when scroll bar is in the second position 2115 As and written information.In this example, the second object 2109 and the second written information 2111 are shown by a dotted line, to indicate it Cannot be practically shown on screen 2101.

In addition, even if when content by it is shown in the form other than window when, synchronous mapping with written information It is also possible.

Figure 22 is the block diagram of the equipment 2200 accoding to exemplary embodiment, for sharing and showing written information.

With reference to Figure 22, equipment 2200 includes request receiver 2201, information determiner 2203, information obtainer 2204, window Mouth selector 2205, display unit 2209, state change message acquisition device 2213, storage unit 2215, leads at map unit 2207 Believe unit 2219 and control unit 2223.

Request receiver 2201 can receive the request for showing content from user.Equipment 2200 can be based on by requesting 2201 received request of receiver to show interior perhaps object on window.Request receiver 2201 and Fig. 4's of Figure 22 asks Ask receiver 401 corresponding.

Information determiner 2203 can determine that written information and content synchronization information about content whether there is.Figure 22's Information determiner 2203 is corresponding with the information determiner 403 of Fig. 4.

In the presence of written information and content synchronization information, information obtainer 2204 can be obtained from server or external equipment Obtain written information and content synchronization information.As another example, written information can be obtained based on user's input.According to some Embodiment, information determiner 2203 may include information obtainer 2204.

As above with reference to described by Fig. 6, the writing that information obtainer 2204 can detecte user's input start event and End Event is write, and is inputted based on user and is extracted and generate written information.The operation of information obtainer 2204 and Fig. 6's The operation of written information acquisition device 603 is corresponding.

Window selector 2205 can select the window of display content and/or object based on user's input.

Map unit 2207 can map written information and by the selected window of window selector 2205.It is mapped to The written information of window can be inputted by user, or can be obtained by information determiner 2203.

As another example, map unit 2207 can be believed based on the content synchronization obtained of information determiner 2203 is passed through Breath is to map written information and window.For example, equipment 2200 can map written information and window, written information and content, or Person's written information and object.

Display unit 2209 can be requested based on user to show content, object, window etc..In addition, display unit 2209 Can be inputted based on user and show written information, or can be synchronized based on content synchronization information and show written information with Content, as with reference to described by Fig. 4 and Fig. 6.

State change message acquisition device 2213 can obtain the state change message of the state of the change of indication window.Example Such as, state change message acquisition device 2213 can obtain the information of the object in the display state and window about window, and Display unit 2209 can based on the display for changing written information by the information obtained of state change message acquisition device 2213, As with reference to described by Figure 13.

In this example, storage unit 2215 includes content storage unit 2216, written information storage unit 2217 and interior Hold synchronizing information storage unit 2218.

Content storage unit 2216 can store content.In addition, written information storage unit 2217 can store from outside The received written information of equipment institute, or the written information shown based on user's input.Content synchronization information storage unit 2218 It can store the content synchronization information for written information and content.

In this example, communication unit 2219 includes conveyer 2220 and receiver 2221.Conveyer 2220 and receiver 2221 can respectively transmit and reception content, written information and content synchronization information.

Control unit 2223 can control included all components in equipment 2200, and may include such as central The operating unit of control device, and can be included in another component of equipment 2200.

Although not being shown in FIG. 22, equipment 2200, which may further include, such as to be carried out above with reference to the description of Fig. 6 The link address generator of operation.

Equipment as described herein may include processor, for storing program data and executing its memory, all The permanent or semi-permanent storage device of such as hard disk driver, for the communication port with external device communication and including display, key User interface facilities.When including software module, these software modules can be stored as on a computer-readable medium The program instruction or computer-readable code that can be performed on processor, the computer-readable medium such as read-only memory (ROM), random access memory (RAM), CD-ROM, tape, floppy disk and optical data storage devices.Computer-readable record is situated between Matter can also be distributed via the computer system of network-coupled, so that computer-readable code is deposited in a distributed fashion Storage and execution.The medium can be readable by a computer, and be stored in memory and be executed by processor.

All references cited herein, including publication, patent application and patent are by quoting simultaneously Enter this, reach seemingly each reference by individually and in particular to being shown as being incorporated by reference into this and herein Integrally stated identical degree.

For the purpose of the understanding for the principle for promoting this specification, with reference to exemplary embodiment shown in the accompanying drawings, And specific language be used to describe these embodiments.However, this specific language is not intended to limit the scope of the invention, and And the present invention should be interpreted all embodiments that will usually expect comprising those skilled in the art.

This specification can be described with regard to functional block components and various processing steps.Such functional block can pass through by It is configured to execute any amount of hardware and or software component of specific function to realize.For example, this specification can use Various integrated circuit packages can at one or more for example, memory component, processing element, logic element, look-up table etc. It is performed various functions under the control of multi-microprocessor or other control equipment.Similarly, software programming or software are being used In the case where element of the element to implement this specification, specification can be using any volume of C, C++, Java, compilation etc. Journey or scripting language, implemented using any combination by data structure, object, processing, routine or other programmed elements it is each Algorithm is planted to implement.It may be implemented as the algorithm executed on one or more processors in terms of function.In addition, this explanation Book can be using any amount of traditional technology for electrical arrangement, signal processing and/or control, data processing etc..Term " mechanism " and " element " is widely used and is not limited to embodiment mechanically or physically, but may include and processor knot The software routines etc. of conjunction.

Depicted herein and description specific embodiment is schematical example and is not intended to additionally to appoint Where formula limits the scope of the invention.For purposes of brevity, the software development of traditional electronic device, control system, system (and component in the component of the single operation of system) can not be described in detail in terms of other function.In addition, institute Connecting line, connector shown in each attached drawing presented be intended to indicate example functional relationships between various elements and/ Or it physically or logically couples.It should be noted that there may be many alternatives or additional functional relationships, object in actual equipment Reason connection or logical connection.In addition, no project is practiced or component is necessary for of the invention, except not element is by specifically It is described as " necessary " or " crucial ".

In the context describing the invention (especially, in the context of the attached claims), term " one ", "one" is to be interpreted as covering odd number and plural number with the use of "the" and similar indicant.In addition, the model of this paper intermediate value The reference enclosed is merely intended to serve as individually quoting the stenography method for falling into each separation value within the scope of this, unless another herein Other places instruction, and each separation value seemingly its specification is incorporated to like that by individually reference herein.Finally, it is retouched here The step of all methods stated, can be performed in any suitable order, understand unless otherwise indicated herein or with context Ground additionally contradiction.The use of any and all examples provided by herein or exemplary language (for example, " such as ") is only anticipated The present invention is better shown in figure, and does not apply to the scope of the present invention and limit, unless otherwise indicating that.Many modifications and adaptation Property modification for those skilled in the art it will be readily understood that without departing from the spirit and scope of the invention.

Claims

1. a kind of method of shared written information, which comprises

The request for showing content is received from user；

Obtain the content；

Based on the metadata of content obtained, determines the written information about the content and synchronize the content and described The presence of content synchronization information required for written information；

Written information described in the link address information acquisition for including in metadata based on the content and content synchronization letter Breath；And

The written information and the content are synchronized and shown based on the content synchronization information,

Wherein, the metadata of content obtained includes at least one indicated in the written information or the content synchronization information A information that whether there is.

2. according to the method described in claim 1, wherein, the content synchronization information includes mark (ID) information of the content At least one of with the location information of the written information.

3. according to the method described in claim 2, wherein, the location information of the written information includes the page letter of the content Breath, the frame information of the content, the written information about the page of the content position and the written information about At least one of the position of frame of the content.

4. according to the method described in claim 1, wherein, the content includes video content, and

The written information is synchronized and shown based on the content synchronization information and the content includes extracting and showing Written information corresponding at least one frame of the video content.

5. a kind of for sharing the equipment of written information, the equipment includes:

It shows request receiver, is configured as receiving the request for showing content from user；

Information obtainer is configured as obtaining the content, written information and content synchronization information about the content；With And

Display is configured as that the written information and the content are synchronized and shown based on the content synchronization information,

Wherein, the information obtainer is configured as determining the written information and institute based on the metadata of content obtained Writing described in the link address information acquisition stated the presence of content synchronization information, and include in the metadata based on the content Information and the content synchronization information,

6. equipment according to claim 5, wherein the content synchronization information further includes mark (ID) letter of the content Breath.

7. equipment according to claim 5, wherein the content includes document content, and

The display is configured as extracting and showing writing corresponding at least one page in the document content Information.