CN107636641A

CN107636641A - For handling the unified message delivery platform for the annotation for being attached to email message

Info

Publication number: CN107636641A
Application number: CN201680029632.8A
Authority: CN
Inventors: M·莱恩; M·布拉斯凯特; L·沃尔德曼; C·福斯; E·D·坎努托蒂伊尔
Original assignee: Microsoft Technology Licensing LLC
Current assignee: Microsoft Technology Licensing LLC
Priority date: 2015-05-22
Filing date: 2016-05-20
Publication date: 2018-01-26
Anticipated expiration: 2036-05-20
Also published as: IL255350A0; US20160344678A1; US10897441B2; BR112017022481A2; WO2016191224A1; CN113408243A; CN107683468A; US20210194837A1; US11297020B2; US20160344677A1; EP3298562A1; US10063501B2; CN107636641B; WO2016191225A1; EP3298558A1; CN113408242A; US20160344667A1; PH12017550115A1; US20180337877A1; CA2983288A1

Abstract

Describe a kind of unified message delivery platform, its provide it is a kind of be used to cooperating, the integrated environment of file-sharing and project management.In many aspects, unified message delivery platform is come tissue, wherein each team or project are also by can customize classification come tissue based on one or more team or project.Provide a kind of user interface, the user interface be used for pair with each classification (such as, communication, file, task, work product etc.) relevant information carries out fast accessing (ready access), in the interface, the cross-platform Current developments and state automatically and seamlessly synchronized to enable each Team Member to get caught up in project of information.Pass through the collaboration that at least a portion of additional file is extracted and provided in message text to promote on additional file.In addition, the modification carried out to the content extracted in message text can the automatically synchronous and reflection in additional file and in the file label for storing the file being associated with team.

Description

For handling the unified message delivery platform for the annotation for being attached to email message

Background technology

Numerous and various communications platforms can be obtained at present.Some communications platforms are (for example, messaging and/or electronics postal Part platform) allow a certain amount of interoperability.However, these platforms can not fully solve the needs of contemporary team environment and need Ask.For example, traditional e-mail applications are configured such that is sent to one or more receptions by sender by each message Person.Sender is often difficult to know which recipient will be interested in receiving some information, and this causes message to forward and/or ignore Related or crucial individual.In the case where message forwards, communication chain fracture, this causes to provide to each member of a team Different information.In addition, when some members are ignored and/or excluded, by will be only by this to the useful information of whole team The subset of team is filed and operated.Due to email message transmission be overused because of many purposes the fact, make Must be compound by drawbacks described above --- for example, from asking to agree to that equally basic message is directed to tissue to addition of from recipient Key visual document message --- this generates the inbox of overload and the recipient that can't bear the heavy load.

Other meanss of communication and media have been developed to plug a gap, such as instant message transmission, Short Message Service (SMS), Yammer, Skype, SharePoint etc., but these instruments add complexity rather than primary solution. For example, although these extra meanss of communication are useful in point solution, but they further create and user are visited Ask multiple positions with obtain for information about, task and obligation full picture demand.

Consider to describe embodiment on these and other in generals.In addition, although discuss relatively specific The problem of it should be appreciated that embodiment should not necessarily be limited by the particular problem for solving to identify in the introduction.

The content of the invention

Generally, this disclosure relates to method and system for providing unified message delivery platform.Unified message transmits Platform provide it is a kind of be used to cooperating, the integrated environment of file-sharing and project management.In many aspects, unified message passes It is come tissue, wherein each team or project are also by can customize classification based on one or more team or project to send platform Carry out tissue.Provide a kind of user interface, the user interface is used for pair with each classification (for example, communicating, file, task, work Make product etc.) relevant information carries out fast accessing (ready access), in the interface, the cross-platform automatic and nothing of information Synchronize the Current developments and state to enable each Team Member to get caught up in project seam.For example, by message just Extracted in literary and provide at least a portion of additional file to promote the collaboration on additional file.In many aspects, It can extract and summarize the annotation in additional file for being shown in message text.In addition, in message text The annotation that the content extracted is carried out can be in additional file and in the files-designated of the storage file associated with team Automatically synchronous and reflection in label.These and other features will be described in detail herein.

In many aspects, there is provided a kind of system including processing unit and memory.The memory storage calculates Machine executable instruction, the instruction by processing unit when being performed so that system performs method.The method performed by the system Method includes：The message with additional file is received, and identifies the structure of additional file.Extraly, methods described bag At least one annotation in the additional file of identification is included, and determines at least one annotation in the structure of additional file Position.Methods described also includes extracting at least one annotation and shows at least one annotation in the message.

In in a further aspect, there is provided a kind of system including processing unit and memory.Memory storage computer Executable instruction, the instruction by processing unit when being performed so that system performs method.The method bag performed by the system Include：The message of embedded content is received, wherein the message of the embedded content includes the content of the file extraction of slave phase association.It is described Method also includes the structure for identifying extracted content, wherein, the structure is associated with the file structure of associated file, And receive to the annotation for the content extracted.Extraly, methods described includes identifying the annotation in the content extracted Position in structure, and annotation is synchronized with associated file.

In in a further aspect, a kind of part for extracting additional file and it is partially submerged into what is extracted in the message Method.Methods described includes receiving the message with additional file, and the scanning additional file.Methods described is also Part including extracting the additional file, and extracted part is shown in the message.

Present invention is provided to be introduced into the form of simplified to being further described in following embodiment Concept selection.Present invention is not intended to the key feature or essential feature for identifying theme claimed, also not purport In the scope for limiting theme claimed.

Brief description of the drawings

Non-limiting and nonexhaustive example is described with reference to the following drawings.

Fig. 1 shows the exemplary concepts model for unified message delivery platform according to example embodiment.

Fig. 2A is shown according to example embodiment for the exemplary interfaces that interact with unified message delivery platform.

Fig. 2 B show exemplary for being interacted with unified message delivery platform according to the second example embodiment Interface.

Fig. 2 C show exemplary for being interacted with unified message delivery platform according to the 3rd example embodiment Interface.

Fig. 2 D show exemplary for being interacted with unified message delivery platform according to the 4th example embodiment Interface.

Fig. 2 E show exemplary for being interacted with unified message delivery platform according to the 5th example embodiment Interface.

Fig. 2 F are shown according to example embodiment for the exemplary movement that interacts with unified message delivery platform Interface.

Fig. 2 G show exemplary for being interacted with unified message delivery platform according to the second example embodiment Moving boundary.

Fig. 3 shows the example system for Message Processing realized on the computing device according to example embodiment.

Fig. 4 is shown is used for illustrative methods of the scanning with additional message according to example embodiment.

Fig. 5 is shown according to example embodiment for extracting the exemplary of at least a portion content from additional file Method.

Fig. 6 is shown according to example embodiment at least a portion content extracted to be inserted into showing in message Example property method.

Fig. 7 is shown to be used for the annotation carried out to the content extracted and associated file according to example embodiment The illustrative methods synchronized.

Fig. 8 shows the content insertion exemplary interfaces in the message for being used to be extracted according to example embodiment.

Fig. 9 A show the exemplary interfaces for being used to show the message of embedded content according to example embodiment.

Fig. 9 B show associated for being shown in response to the selection to embedded content according to example embodiment The exemplary interfaces of file.

Figure 10 shows the content insertion exemplary interfaces in the message for being used to be extracted according to example embodiment.

Figure 11 is the block diagram of the exemplary physical component for the computing device for showing many aspects that can put into practice the disclosure.

Figure 12 A and Figure 12 B are the simplified block diagrams of the mobile computing device for many aspects that can put into practice the disclosure.

Figure 13 is the simplified block diagram of the distributed computing system for many aspects that can put into practice the disclosure.

Figure 14 shows the tablet computing device of the one or more aspects for performing the disclosure.

Embodiment

In the following detailed description, to foring a part of this paper and wherein by specific embodiment or example Mode shown in accompanying drawing referred to.These aspects can be combined, other aspects can be utilized, and can not depart from Structural change is carried out in the case of the disclosure.Embodiment can be used as method, system or device to put into practice.Thus, embodiment can To take hardware to realize, in the form of complete software realization or the realization of integration software and hardware aspect.Therefore, it is following detailed Thin description is not qualified as restrictive, sense, and the scope of the present disclosure is limited by appended claims and its equivalent 's.

Especially, describe and the unified message transmission of integrated environment is provided for cooperation, file-sharing and project management put down Platform.In many aspects, based on one or more team or the project organization unified message delivery platform, wherein each team or Project is also by customizable classification come tissue, and the classification is for example, finance, engineering, news conference preparation, debugging, food and drink, build Build, be general, be random etc..Provide a kind of user interface, its be used for pair with each classification (for example, communicate, file, task, work Product etc.) relevant information fast accessed, in the user interface, by the page or label of each classification come tissue Information.In addition, the communication between the renewal of document, project, task and Team Member will be automatic across the platform and seamlessly same Step, to enable each Team Member to get caught up in the Current developments and state of project.For example, by being extracted in message text And at least a portion of additional file is provided to promote the collaboration on additional file.In many aspects, it can extract And summarize the annotation in additional file for being shown in message text.In addition, to being extracted in message text The annotation that content is carried out can be automatic in additional file and in the file label for storing the file associated with team Ground is synchronous and reflects.These and other features will be described in detail herein.Done on these and other general consider Embodiment is gone out.

Fig. 1 shows the example system for being used to provide unified message delivery platform according to example embodiment.

In many aspects, unified message delivery platform (UMP) 105 can be held via in client computing device 104 Capable client unified message transmission realizes that wherein client unified message transmission is using 104a and in server using 104a The server unified message transmission application performed on computing device 106 is communicated.In certain aspects, client computing device 104 can include the client-side pair that is communicated with server side object model 109 (for example, being realized by intermediate layer 106b) As model 107.In basic configuration, client computing device 104 be have both input element and output element individual or Handheld computer.For example, client computing device 104 can be it is following in one：Mobile phone；Smart phone；Flat board Computer；Tablet phone；Intelligent watch；Wearable computer；Personal computer；Desktop computer；Laptop computer；Trip Play equipment/computer (for example, Xbox)；TV etc..What the list was merely exemplary, and should not be regarded as restricted 's.Any suitable client computing device for performing messaging application can be utilized.

Unified message delivery platform 105 is the communication system/service for the Collaborative environment for providing the user communication and cooperation.Remove Other examples, unified message delivery platform 105 is shown by dashed lines, can it illustrates the realization of unified message delivery platform 105 To be related to the front end 106a of server computing device 106, intermediate layer 106b, and/or rear end 106c.In many aspects, service Device computing device 106 can include one or more server computing devices 106.In this example, unified message delivery platform 105 The configurable and expansible working space for carrying out the cooperation between user by user interface (UI), the user is presented Interface (UI) can include multiple different views.The user of unified message delivery platform 105 can include but is not limited to：One Or multiple individuals, company, tissue, department, virtual team, special group, supplier, client, third party etc..Unified message transmits The user of platform 105 can have one or more user profiles by user customizable.Unified message delivery platform 105 is enabled Visuality and communication between user, the user include being organized in outside the user in team or group and team/group User/group.Can one or more keepers by team/group and the keeper by unified message delivery platform 105 For team/group's Provisioning Policy.The disclosure in the whole text described in example be designed to be adapted to protection privacy of user.To bag The protection for including the sensitive information including the data being protected by law and personally identifiable information is described herein for realizing Example is vital.For example, user can set privacy settings for that can show/share what data, and Example described herein meets such set and law that protection with the distribution of data and to privacy is relevant.

As shown in FIG. 1, the system associated with unified message delivery platform 105 and/or service may be implemented as Front end 106a, intermediate layer 106b and rear end 106c on server computing device 106.However, those skilled in the art will realize Arrive, unified message delivery platform 105 can be across the one or more assemblies (including one of exemplary system described herein Or multiple client computing device 104 and/or enterprise's stack 110) realize.In certain aspects, server computing device 106 Front end 106a can be transmitted via client unified message and be sent information and order to client computing device 104 using 104a. Applied for example, the intermediate layer 106b and/or rear end 106c of server computing device 106 can transmit via client unified message 104a is from the receive information of client computing device 104 and order.In in other respects, front end 106a can serve as client calculating Intermediary between equipment 104 and intermediate layer 106b.That is, front end 106a can exchange life with client computing device 104 Order and information, and can also be with intermediate layer 106b exchange commands and information.In this example, unified message delivery platform 105 wraps Include via front end 106a, intermediate layer 106b and the rear end 106c to be communicated with the transmission of client unified message using 104a and The server unified message transmission application performed on server computing device 106.

In certain aspects, rear end 106c can also include or be communicated with one or more application proxy 106d, To promote and the interoperability of one or more external services 114 and communication.More specifically, application proxy 106d can be used Network hook (webhook) 106e is engaged with external service 114, to promote unified message delivery platform 105 and external service It is integrated between 114.External service 114 is service and/or the website by third party's trustship or control.For example, external service 114 Service line (LOB) management service, customer relation management (CRM) service, debugging services, accounting services, pay sheet clothes can be included Business etc..External service 114 can also include by other websites of third party's trustship and/or application, such as social media or network Website；Photo sharing website；Video and music stream website；Search engine web site；Physical culture, news or entertainment sites etc..Namely To say, some external services 114 can provide report, analysis, data compilation, and/or storage service of robust etc., and outside other Service 114 can provide search engine, or other access to data and information, image, video etc..

In many aspects, data or information can be in server computing devices 106 and one or more external services 114 Between share.For example, business connection people, sale etc. can be calculated via the client to be communicated with server computing device 106 What equipment 104 inputted, wherein server computer device 106 is communicated with by the CRM softwares of third party's trustship.Third party CRM softwares can track marketing activity, the marketing, customer interaction etc. to provide analysis or other information so as to promote business to close System.Alternately, it can be via the client computing device 104 to be communicated with server computing device 106 to manufacture work order Input, wherein server computing device 106 is communicated with by the LOB management softwares of third party's trustship.LOB management softwares can With by creating workflow (such as dispatching manufacturing equipment, ordering raw material, scheduling transportation, clearing stocks etc. for task Or alarm) instruct and track work order.In some cases, LOB management softwares can be in the different phase of workflow Place, which creates, is used for the request that user ratifies or checked.In in a further aspect, user can to one in external service 114 or Multiple external services send inquiry, for example, for the request of business connection people, the sale of last month, work order state or Person is for the search inquiry of image or request etc..

As illustrated by fig. 1, server computing device 106 can calculate via network 108 and external service 114 and client Equipment 104 is communicated.In an aspect, network 108 is the distributed computing network of such as internet etc.In multiple sides In face, unified message delivery platform 105 can be in the more than one server meter of such as multiple server computing devices 106 etc Calculate and realized in equipment 106.As discussed above, server computing device 106 can be set by network 108 to client Standby 104 provide data or provide data from client device 104.Can be by being transmitted suitable for transmitting any network of data Data.In certain aspects, network 108 is the computer network of such as corporate intranet and/or internet etc.With regard to this point For, network 108 can include LAN (LAN), wide area network (WAN), internet, wireless and wired transmissions medium.In addition Aspect in, server computing device 106 can enter via local network (for example, corporate intranet) and some components of system Row communication, and server computing device 106 can be led to via wide area network (for example, internet) come the other assemblies with system Letter.

According to other aspect, the communication between unified message delivery platform 105 and the other assemblies of system can need Certification 112.Certification 112 refers to that such process, equipment, application, component, user etc. accesses other by process offer and set Standby, application, component, user etc. or to carry out communication with other equipment, application, component, user etc. be " believable " or " through awarding The evidence of power ".Certification can be directed to use with third party's digital certificate, authentication token, symmetrically or non-symmetrically password, key encryption side Case, shared secret, authentication protocol or any other currently known or exploitation in the future suitable Verification System or side Method.In many aspects, in response to certification, can allow to access or communicate and can unified message delivery platform 105 with The swapping data or information of various other components of system.In certain aspects, by various equipment, application, component, user etc. The environment or network linked can be referred to as " trust " environment.In the environment of trust, equipment, application, component, Certification between user etc. can not be required.

The unified message delivery platform 105 that operation is performed on server computing device 106 can also be with one or more Enterprise is communicated using (for example, enterprise's stack 110).Enterprise's stack 110 can include for example, Active Directory 110a, enterprise message Transmission is using 110b, file-sharing application 110c, remote measurement application 110d etc..Enterprise's stack 110 can be for example in corporate intranet Or it is locally stored and/or performs in distributed location by internet.In some cases, enterprise's stack 110 can be by It is included in server computing device 106.For example, Active Directory 110a can be included as server computing device 106 Rear end 106c part.In some cases, enterprise's stack 110 can be resident the unified message delivery platform in the environment of trust 105 or communicated with unified message delivery platform 105., can will be via unified message delivery platform in many aspects It is 105 receiving, send or the information of storage and/or messaging are to enterprise's stack 110.In addition, received via enterprise's stack 110, The information and/or message for sending or storing can be transferred into unified message delivery platform 105.

Extraly, in certain aspects, the unified message delivery platform 105 performed on server computing device 106 can To be communicated with one or more third party's messaging applications 116.Third party's messaging application 116 is held in the palm by third party Pipe or the messaging application controlled, including electronic third-party email message transmission application, SMS are applied, instant message transmission is answered With, social networking application etc.., can be to the registration of unified message delivery platform 105 as the member's of team in many aspects Some users's (for example, internal user), but the other users (for example, external user) of the member as the team may not have Register, but may be noted to one or more third party's messaging applications 116 to unified message delivery platform 105 Volume.In certain aspects, the use registered using 110b rather than registered to unified message delivery platform 105 to enterprise message transmission Family is considered as external user.In this case, unified message delivery platform 105 can pass with one or more third party's message Send using 116 and/or communicated with the transmission of one or more enterprise messages using 110b, so as to exchange information with external user And message.In certain aspects, the unified message delivery platform 105 carried out by network 108 disappears with one or more third parties Breath transmission applies the communication between 110b to be related to certification 112 using 116 and/or the transmission of one or more enterprise messages. In other aspects, unified message delivery platform 105 and for example one or more enterprise message transmission are using logical between 110b Letter can not be related to certification 112.

It should be appreciated that various equipment, component with reference to described by figure 1 etc. are not intended to system and method being limited to institute The specific components of description.Thus, extra topological arrangement can be used for putting into practice methods herein and system, and/or can exclude Some described components are without departing from method and system herein disclosed.

Fig. 2A shows exemplary for being interacted with unified message delivery platform according to the first example embodiment Interface.

In many aspects, user can transmit via user interface 200 (for example, graphic user interface) and unified message Platform interacts.Except other examples, exemplary unified message delivery platform 105 is provided in Fig. 1 description, and It will be further described in such as Fig. 2A -2G remainder of this disclosure.In certain aspects, user interface 200 can To be related to the one or more panes or window of the display for organizational information and/or interactive controls.In one example, use Family interface 200 can include three panes, for example, left frame 202, central pane 204 and correct frame 206.In another example In, user interface 200 can include two panes, for example, left frame and correct frame.In other example, user interface 200 A pane, four or more panes can be included, and/or pane may be implemented within multiple browsers or application widget In.

As described above, each pane or window can be with text, figure etc. and/or one or more interactive controls Part or the form display information of link.For example, the first pane (for example, left frame 202) can show one or more team 208th, Email entrance etc..As used in this article, team refers to two formed for one or more purposes Or more user any group.Can be for any purpose being contemplated that or multiple purposes (for example, commercial object, society Purpose, charitable purpose etc.) and form team.In addition, team can include any kind of user, for example, colleague, family into Member, classmate, business parnter etc..In many aspects, can by create team's title (for example, leadership team, design team, Event team, project team etc.) and by the way that user (for example, member) is added into team come in unified message delivery platform Team is formed in 105.For example, set or manage pane (not shown) in, can by select user identifier (for example, User's icon, user email, subscriber directory number etc.) member is added to team.In at least some aspects, team In each member be authorized to Group Tour Entrance or channel.Appoint furthermore, it is possible to be created in unified message delivery platform 105 The team of what quantity, and/or team can implicitly be created based on the communication between two or more users.

Group Tour Entrance can provide to shared by any member of team all communications, file, link, list, topic The access of label, developing instrument etc..According to embodiment, in response to the choosing to the team 208 in pane (for example, left frame 202) (for example, passing through click) is selected, Group Tour Entrance can be opened.Group Tour Entrance refers to that Team Member can check shared information by it The access point interacted with other Team Members and with shared information and other Team Members.In at least some cases, Each member of team is awarded to the information shared in Group Tour Entrance and the complete access of session.In many aspects, ring Selections of the Ying Yu to team 208, can in the second pane (for example, central pane 204) display on team general information, Project specification etc..For example, can be shown in central pane 204 member name, member contact's information (for example, e-mail address, Telephone number etc.), member's usage time, project specification, PROJECT TIME line, project task etc..

The customizable information category 210 for team 208 is also based on come organization's entrance.For example, it can be directed to Group Tour Entrance creates any suitable classification 210 for organization's information, for example, finance, engineering, start prepare, debug, Food and drink, building, general, random etc.., can in response to the classification 210 of the team 208 in selection left frame 202 in many aspects To show the information relevant with classification 210 in central pane 204.In some cases, authorized pair of each member of team The information associated with each classification 210 of the team 208 in Group Tour Entrance is accessed completely.

As described above, Group Tour Entrance can provide all communications shared to the member by team 208, file, The access of link, list, topic label etc..In many aspects, in each classification 210, information can also by label or The page carrys out tissue.For example, each label 212 can be shown in central pane 204 it is associated with classification 210 different types of Information.When selected, can be by using different font or font color to highlight, by under outlining, picture Line etc. carrys out identification (RFID) tag 212.As shown in Fig. 2A, in response to the selection to the first label (for example, the meeting represented by underscore Talk about label 212a), the communication 218 between Team Member can be shown in central pane 204.As it is used herein, term " communication " can be used interchangeably with term " message ".In many aspects, session 216 needs any class between Team Member Two or more of type or pattern communication 218.In some cases, session 216 can be according in the bottom of central pane 204 The incremental order of nearest communication 218 is shown to show.Alternately, session 216 can be according at the top of central pane 204 Show nearest communication 218 successively decreases order to show.

In some cases, it is discussed further below, can be by one or more communication 218 (for example, communication 218a and 218b) it is grouped into threads of conversation 220.Communication 218 refers in any format (for example, Email, SMS, instant message Deng) via any pattern (for example, via unified message delivery platform, or should via any enterprise or third party's messaging With) by the single message of Team Member's transmission.That is, between internal user can be generated in unified message delivery platform Message, or application (for example, enterprise message transmission apply 110b) and/or third party's message can be transmitted via enterprise message Transmission transmits the message to external user using (for example, third party's messaging application 116) and disappeared from external user transmission Breath.

As being provided above, each pane or window can be with display information and/or interactive controls.For example, the 3rd Pane (that is, correct frame 206) can show contextual information, status information, latest activities etc..In certain aspects, in right frame Shown information can be with the classification 210 selected in left frame 202 and/or selected in central pane in frame 206 Label 212 it is relevant or associated.For example, have in the classification 210a of the display of central pane 204 and entitled " release of new products " In the case of the communication of pass, file, link, list, topic label etc., correct frame 206 can show one or more nearest File 222, nearest link 224, label 226 or the movable people 228 relevant with the release of new products.In certain aspects, exist At least some in the information shown in correct frame 206 can be (for example, via client computing device for specific user 104 access the specific user of Group Tour Entrance, " user to conduct interviews ") for.For example, access the specific user of Group Tour Entrance It can be identified by the title in correct frame 206, icon (user name 230a or user icon 230b) etc..That is, In some cases, the nearest file 222 relevant with the release of new products and/or it is nearest link 224 may recently via The user to conduct interviews access or uploaded.In addition, to access the correct frame that another user of same category 210 shows 206 can show nearest file 222 or the recently different sets of link 224., can be in correct frame in other example Display additionally the or different information related with classification 210 and specific user in 206, for example, user task, user's alarm, User's calendar, user's notes etc..

According to extra aspect, central pane 204 can include search field 240.For example, search field 240 can be permitted Family allowable searched in Group Tour Entrance any communication relevant with team 208, file, link, list, topic label, term, group Team member, calendar, task, event etc..In many aspects, search field 240 can allow simple language search, boolean search (for example, search using Boolean operator) or other modes.In response to one or more search terms are input into search word Can be searching to the user to conduct interviews by any presentation of information relevant with the search term in Group Tour Entrance in section 240 Hitch fruit.

It should be appreciated that be not intended to function will be related for the various features of the user interface 200 with reference to described by figure 2A The system and method for connection are limited to described special characteristic and function.Thus, extra feature and function can with herein Described in system and method be associated, and/or described some features and function can be excluded, without departing from herein Described in system and method.

As described hereinbefore, unified message delivery platform can be provided including three panes (for example, left frame 202nd, central pane 204 and correct frame 206) user interface 200.As shown in Fig. 2 B, unified message delivery platform can carry For a variety of options for generating communication.For example, unified message delivery platform can provide new message input field, for example, For the new message input field 232 for the communication for sending instant message, SMS or other " similar texts ".In many aspects In, new message input field 232 can allow the input that the input of text, the input of order, user recall, topic label Input, the input for inputting, enriching web page contents of image, input of rich interactive formula content etc..New message input field 232 The control 268 for appended document, insertion emoticon etc. can also be included.However, at least some aspects, new message Input field 232 can not provide the input of recipient or subject line.Word is inputted in response to message is input into new message In section 232 and click on " input ", the communication from user automatically can be sent out as the message of new " similar text " Cloth is to session.According to other aspect, new message input field 232 can include being used for new message input field 232 It is extended to (the table of optional control 266 of e-mail interface object (for example, e-mail interface object 238 described below) It is shown as ellipsis).

Alternately, unified message delivery platform can provide the reply link 234 that each communication with session is associated. In certain aspects, reply link 234 to be shown at each communication proximity of session, for example, in communication (not shown) The right side of sender or subject line, upper right side (not shown) of retraction, communication etc. below communication (showing).Alternately, Unless and until it is clicked, hovers, touches or otherwise utilizes by input equipment (for example, mouse, pointer etc.) Input equipment and be identified untill, can not show reply link 234.After showing and in response to pair and specific communications The selection of associated reply link 234, can show message back input field (not shown).Inputted similar to new message Field 232, message back input field can allow the input of text, the input of order, the input of topic label, file it is attached Add, the insertion of expression etc..However, in this case, in response to input message and click on " input ", the communication from user can Automatically to be issued in the threads of conversation 220 associated with specific communications.In many aspects, as shown in Fig. 2A, (bulleted) that secondary communication 218b in threads of conversation 220 can be shown as retraction, adding some points symbol or with its other party Formula is displaced to main or initial communication 218a lower sections, and (in the above example, " specific communications " can be referred to as " main logical Letter ").

Alternately, unified message delivery platform can be provided for accessing e-mail interface object (for example, electronics postal Part interface object 238) with the Email control 236 of the communication of transmission " similar Email ".In many aspects, electronics postal Part interface object 238 can allow the similar action to new message input field 232, such as input, order for text Input, theme mark input etc. input field 276, and for the additional of file, the control of the insertion etc. of emoticon Part 268.Extraly, e-mail interface object 238 can be provided for changing text font and size, symbol etc. of being added some points to text Control 278, and for sending, preserving the control 270 of draft email, deletion etc..E-mail interface object 238 is also Recipient's field 272 for inputting or selecting recipient and subject field 274 for inputting subject line etc. can be provided. In response to message is input in e-mail interface object 238 and clicks on input, the communication from user can be automatically Issued as the message of new " similar Email ".

It should be appreciated that be not intended to function will be related for the various features of the user interface 200 with reference to described by figure 2B The system and method for connection are limited to described special characteristic and function.Thus, extra feature and function can with herein Described in system and method be associated, and/or described some features and function can be excluded, without departing from herein Described in system and method.

As described hereinbefore, unified message delivery platform can be provided including three panes (for example, left frame 202nd, central pane 204 and correct frame 206) user interface 200.In addition, as described hereinbefore, each label 212 The different types of information associated with classification 210a can be shown in central pane 204.For example, as shown in Fig. 2 C, can The file shared between Team Member is shown in select (being represented by underscore) the second label (for example, file label 212b) 242.File 242 can include any kind of file, for example, document files, electronic form file, demonstration document, image are literary Part, video file, audio file, notes file etc..

In certain aspects, the file 242 shown in file label 212b includes sending to Team Member as annex Between communication 218 file.That is, unified message transmission application can extract the file sent as annex, and It is automatically saved in file label 212b.In in other respects, field is uploaded as file as shown in Fig. 2 C, can be provided 244.Field 244 is uploaded in response to select file, user can preserve one or more files 242 to file label 212b. For example, the selection in response to uploading field 244 to file, can activate and browse frame (not shown) to fetch the text for upload Part.Alternately, order (for example, "/file ") can be inputted to fetch the file for upload.Or can be by file Be copied and pasted in file upload field 244.In many aspects, it is possible to achieve for uploading and preserving extremely file File label 212b any suitable method.In at least some aspects, existing in file label 212b has the first text The single version of first file of part name, this causes synchronous in the single version and stores any note carried out to the first file Release (for example, modification, comment etc.).In certain aspects, can be by after the first file is preserved using the second filename Two document creations, add, and/or upload to file label 212b.

According to other example, the 3rd label (for example, link label 212c) is shared between may be displayed on Team Member Link (for example, hyperlink).In certain aspects, the link shown in link label 212c is included in logical body The link of transmission is sent to the link of the communication between Team Member as annex.That is, unified message transmission should Sent by the use of that can be extracted in communication or sent as annex to the link of communication, and they can be automatically saved to chain Meet label 212c.In in other respects, link can be provided and upload field (not shown).Linked in response to selection and upload field, User can preserve one or more link to link label 212c.For example, the selection in response to uploading field to link, can Frame (not shown) is browsed to fetch the link for upload with activation.Alternately, can input order (for example, "/ Link ") to fetch the link for upload.Alternately, link can be copied and pasted to link to upload in field. In many aspects, it is possible to achieve upload and preserve to link label 212c any suitable method for that will link.

4th label (for example, list tab 212d) may be displayed on the list object shared between Team Member and/or Other information, data, file, image etc..In many aspects, list object can include list, form, chart or other Organized data mode.In certain aspects, the list object shown in list tab 212d is being included in communication 218 just Text is interior sending or is sent as annex to the list object of the communication 218 between Team Member.That is, unified message Transmission application can extract sent as annex or list object in message text, and they are automatically preserved to List tab 212d.As used in this article, message text refers to activate or open to check in communication The content (for example, excluding recipient, sender, timestamp, subject information, confidentiality disclaimer etc.) of display.

In in other respects, list object can be created or uploaded in list tab 212d by user.For example, it can carry For the list creating control (not shown) for creating list object.In some cases, control is created in response to selective listing, It can be created in message text and insert list object and/or list object is attached to message.Creating list object Afterwards, list object can be automatically preserved to list tab 212d.Alternately, list can be provided and upload field (not Show).As described in hereinbefore similarly, field is uploaded in response to selective listing, one or more list objects can be by User's selection, upload and preserve to list tab 212d.In at least some cases, there may be the list of each list object Individual copy, if it to update the data in any view (for example, in communication tags 212a or list tab 212d), List object will be automatically updated across every other view and synchronization.

According to many aspects, it is relevant with classification 210a to organize and to isolate that any amount of label 212 can be created Various forms of information.For example, it can be created including topic tab bar with being stored in the communication between Team Member various Topic label.In extra example, customization or scalability label can be created, for example, for electrical form control panel Label, the label for webpage, the label for customized application, for label of system plugin etc..

, can (for example, in left frame 202) offer extra interactive controls or link (example in a further aspect Such as, control 246) for quickly and easily accessing the communication relevant with team 208, file, list, link, label etc.. For example, personnel's control 246a can access the Team Member being stored in Group Tour Entrance and/or session, file control 246b can be with The file being stored in Group Tour Entrance is accessed, list control 246c can access the list being stored in Group Tour Entrance, link control Part 246d can access the link being stored in Group Tour Entrance, and topic label control 246e can be accessed and is stored in Group Tour Entrance In topic label.In certain aspects, the selection to control 246 label corresponding to display can regard in central pane 204 Figure.In in other respects, selection to control 246 can (for example, to search for result formats associated with particular control 246) Result of the display for all categories in Group Tour Entrance.

As shown in Figure 2 C, in response to the selection to file label 212b, correct frame 206 can be shown different from when at center Information during different labels 212 is checked in pane 204.For example, selection or the file 242a highlighted in central pane 204 can To cause the presentation of information relevant with file 242a in correct frame 206.For example, file 242a file history 262 can be by It is shown in correct frame 206.File history 262 can include following information, such as upper transmitting file 242a user, creation file 242a user, the user identifier of editing files 242a user, file creation date, file Date of Revision etc..Correct frame 206 can also show the nearest comment 264 on file 242a., can will be relevant with file 242a in many aspects Any presentation of information is in correct frame 206.

It should be appreciated that be not intended to function will be related for the various features of the user interface 200 with reference to described by figure 2C The system and method for connection are limited to described special characteristic and function.Thus, extra feature and function can with herein Described in system and method be associated, and/or described some features and function can be excluded, without departing from herein Described in system and method.

As described hereinbefore, unified message delivery platform can be provided including three panes (for example, left frame 202nd, central pane 204 and correct frame 206) user interface 200.In in a further aspect, left frame 202 can include electricity Sub- mail entrance 214.Different from Group Tour Entrance, Email entrance 214 can be that specific user can be checked by it and roll into a ball His or her email message inside or outside the context of team and the access interacted with the email message Point.In many aspects, in response to the selection to Email entrance 214, the second pane (for example, central pane 204) can be with Show the email message of user.Central pane 204 can also show using user identifier 248 as title, for example, with Family e-mail address, user name, user's icon etc..Central pane 204 can provide to disappear for the Email of organizing user One or more labels 250 of breath.Label 250 can include for example, inbox label 250a, file label 250b, link mark 250c is signed, label 250d, rough draft label 250e is sent, deletes label 250f etc..For example, in response to inbox label 250a's Select (being represented by underscore), the inbox of the message of user can be shown in central pane 204.In certain aspects, use The message inbox at family can include sending to all message of user, it may for example comprise the team of internal user and external user Message between member, and entity and be not Team Member user between message.

In certain aspects, can based on the date that email message is received according to successively decrease order (in central pane 204 top shows nearest email message) user to collect row tableau format to show in inbox label 250a Email message 280.Collect the part that listings format can show each email message, for example, sender, theme The part of the text of row and each email message.

In the alternative aspect, the use in inbox label 250a can be shown with threads of conversation form (not shown) The email message at family.Threads of conversation form can show email message, and the email message is in main electricity Retraction, the reply carried out to primary email with according with or otherwise offset of adding some points below sub- email message.At least , can be with the date that last envelope Email in dialogue-based thread is received according in central pane 204 in some aspects Top at the nearest threads of conversation of display successively decrease order to show each threads of conversation.In this case, personal communication (example Such as, the communication being not yet responded) can based on the date that the personal communication is received according to successively decrease order threads of conversation it Between spread., can be with the date that the last Email in dialogue-based thread is received according in centre in other respects The incremental order of nearest threads of conversation is shown at the bottom of pane 204 to show each threads of conversation.In this case, it is personal Communication can be spread based on the date that the personal communication is received according to incremental order between threads of conversation.

In in a further aspect, the email message for having already turned on or checking can utilize normal text in central pane Shown in 204 inbox label 250a, and the email message not yet opened or checked can utilize email message In at least part with bold text and display is (for example, sender can be shown using bold text in the central pane 204 And/or subject line).

It should be appreciated that be not intended to function will be related for the various features of the user interface 200 with reference to described by figure 2D The system and method for connection are limited to described special characteristic and function.Thus, extra feature and function can with herein Described in system and method be associated, and/or described some features and function can be excluded, without departing from herein Described in system and method.

As described hereinbefore, unified message delivery platform can be provided including three panes (for example, left frame 202nd, central pane 204 and correct frame 206) user interface 200.As described hereinbefore, in response to Email The selection of entrance 214, central pane 204 can show the email message of user.In certain aspects, as by Fig. 2 E institutes Show, can be based on the session 252 between one or more users come the email message of organizing user.For example, such as in left frame Shown in frame 202, the session 252a between the first user and second user (for example, Rachel) can be with the first user, the 3rd Session 252b between user (for example, Rob) and fourth user (for example, Sofia) is respectively shown.

In many aspects, by the session 252 for selecting to show in left frame 202, it can show in central pane 204 Show the communication between one or more users.As shown in Figure 2 E, session 252c is had selected for, and in central pane 204 Show the first user and second user (for example, Rachel), the 3rd user (such as Rob), the 5th user (for example, Jim) and the Communication 254 between six users (for example, Sophia).In this example, the first user refers to by user name 256a and user's figure Mark the user (for example, Ping Li) to conduct interviews of 256b marks.

In many aspects, session 252c communication 254 can be based on the date that each communication 254 is received according in Nearest communication 254 is shown at the top of heart pane 204 successively decreases order to show.In in other respects, session 252c's is logical Letter 254 can be based on the date that each communication 254 is received according to the nearest communication of the display at the bottom of central pane 204 254 incremental order is shown.

, can be by label or the page come the tissue information relevant with session 252c in a further aspect.It is for example, each Label 258 can show the different types of information associated with session 252c in central pane 204.When selected, may be used To be highlighted by using different font or font color, by outlining, picture underscore etc. come identification (RFID) tag 258.As shown in Fig. 2 E, the first label (for example, conversation tag 258a) can show that the first user, second user, the 3rd use Communication 254 between family, the 5th user and the 6th user.As the extra label that is hereinbefore described in further detail can be with Including the second label (for example, file label 258b), the 3rd label (for example, link label 258c), the 4th label (for example, row Table label 258d) etc., they are used to be shown in the file shared between the participant in session 252c, link, list etc..Example Such as, as shown in Fig. 2 E, list object 260 is inserted in the communication 254a from second user (for example, Rachel).More In individual aspect, as described hereinbefore, list object 260 can be entered from conversation tag 258a or from list tab 258d Row accesses.

As shown in Fig. 2 E, when checking between the first user, second user, the 3rd user, the 5th user and the 6th user Session 252c when, correct frame 206 can show the information associated with session 252c and/or participate in session 252c user. For example, correct frame 206 can show the group's availability 282 for the user for participating in session 252c.Correct frame 206 can also be shown in Participate in the public conference 284 between session 252c user.In many aspects, it can be shown in correct frame 206 and session 252c and/or the relevant any information of the user of participation.

It should be understood that be not intended to will be associated for the various features and function of user interface 200 with reference to described by figure 2E System and method be limited to described special characteristic and function.Thus, extra feature and function can be with being described herein System and method be associated, and/or described some features and function can be excluded, without departing from described herein System and method.

In many aspects, the version of unified message delivery platform can provide the user interface 285 of mobile device.It is mobile User interface 285 can provide for check with user be member therein one or more team it is associated communicate, text The one or more panes or window of part, list, link etc..In certain aspects, in response to direction from left to right or The first pane (for example, first pane 286) is slided in direction from right to left, and the second pane can be shown (for example, the second pane 288)。

As illustrated, the first pane 286 shows one or more team (for example, team 287) and one or more classes Not (for example, classification 291).In many aspects, when receiving new communication, file, list, hyperlink in classification 291 When connecing etc., notice (for example, notifying 292) can be nearby shown in classification (for example, classification 291a).As further shown, Two panes 288 show each one or more communications 289 associated with sender (for example, sender 290a and sender 290b) (for example, communication 289a and communication 289b).

It should be appreciated that be not intended to function will be related for the various features of the user interface 285 with reference to described by figure 2F The system and method for connection are limited to described special characteristic and function.Thus, extra feature and function can with herein Described in system and method be associated, and/or described some features and function can be excluded, without departing from herein Described in system and method.

As described hereinbefore, mobile user interface 285 can allow user in session pane (for example, conversation window Lattice 294) in check session (for example, session 293).Mobile user interface 285 can also provide the new He of message input field 295 Inputting interface 296 is for inputting and send to the communication of the participant 293 of session 293.In many aspects, when communication is sent out When giving the participant of ongoing session (for example, session 293), new message input field 295 does not need recipient's letter Breath, but theme input field (for example, theme input field 297) can be provided for the theme of input communication (for example, " New UX”).In certain aspects, new message input field 295 can be similar to instant, chat, SMS or similar messaging Interface.In in other respects, new message input field 295 can provide similar to email message transmission interface (for example, Allow attached document, list object, image etc.) function.As illustrated, communication 298 has partly been input to new disappear Cease in input field 295.

It should be appreciated that be not intended to function will be related for the various features of the user interface 285 with reference to described by figure 2G The system and method for connection are limited to described special characteristic and function.Thus, extra feature and function can with herein Described in system and method be associated, and/or described some features and function can be excluded, without departing from herein Described in system and method.

In many aspects, client computing device 304 can realize unified message transmission application.In certain aspects, Client computing device 304 can be realized applies 312 for the unified message transmission with being realized on server computing device 308 The client application 310 engaged.In basic configuration, client computing device 104 can be similar to describe client Computing device 304.However, it is possible to using any suitable client computing device to realize the unified message of such application 312 or client application 310 are applied in transmission.

In many aspects, as shown in FIG. 3, unified message transmission can be in server computing device 308 using 312 Upper realization.In basic configuration, server computing device 308 can be similar to the ground of server computing device 106 and describe.Server Computing device 308 can provide data or from client computing device 304 by network 306 to client computing device 304 Data are provided, wherein network 306 describes similar to the ground of network 108.In in a further aspect, unified message transmission can using 312 To be realized on the more than one server computing device 308 of such as multiple server computing devices 308 etc.It is such as above Discussed in, server computing device 308 can by network 306 to client computing device 304 provide data and from Client computing device 304 provides data.In some cases, text or phonetic entry can be in client computing devices 304 Place is received and transmitted by network 306 to apply 312 by the unified message transmission at server computing device 308 come place Reason.

As shown in FIG. 3, unified message transmission can include scan components 314, context component 316 using 312, carry Take component 318, chain joint assembly 320, transition components 322 and component 324 is presented.Various assemblies can use hardware, software, Or the combination of hardware and software is realized.Unified message transmission can be configured to receive and process text and/or language using 312 Sound inputs message.In one example, text and/or phonetic entry can be included with text and/or spoken word input (example Such as, user version or speech message) be form phrase, word, and/or term.In this regard, unified message transmission should It can be configured as receiving text from user 302 with 312 and/or spoken word inputs.In many aspects, unified message transmission It can be configured as inputting spoken word into the textcommunication being converted between Team Member using 312.For example, unified message passes Received pronunciation identification technology well known by persons skilled in the art, such as " automatic speech recognition " can be included using 312 by sending (ASR), " Computer Distance Education " and " speech-to-text " (STT).In some cases, unified message transmission can using 312 With including received text well known by persons skilled in the art to voice technology, such as " Text To Speech " (TTS).

As shown in Figure 3, client computing device 304 and server computing device 308 can also be led to storage 326 Letter, storage 326 store parameter, configuration information, communication, image, document, list object or apply 312 by unified message transmission Any other information accessed.Storage 326 can be in corporate intranet or in the distributed location by internet Local or Remote database.In many aspects, storage 326 can include multiple texts, including with any tray Formatting, mark or the plain text of formula, such as numeric literal processing document, electrical form, demonstration, webpage, text message, push away Text, email message etc..

In many aspects, scan components 314 can be directed to embedded content, hyperlink, text or graphical content, image Content, video content, additional data, order line, user are recalled etc. to scan message.In certain aspects, " additional number According to " " additional file " can be included, its can with such as image file, document files, electronic form file, demonstration document, The file format of code file or the like stores.In in other respects, " additional data " can include not with tray The data of formula storage, for example, blob.Scan components 314 can realize any suitable technology for scanning message, including Known common technology or the in the future technology of exploitation.Extraly, scan components 314, which can scan, is attached to one or more of message Individual file.Common method for extracting structural data from document is carried using " wrapper " of the structure dependent on document Take customizing messages.Semi-structured information extraction, natural language processing of the latest developments of extractive technique dependent on html page (NLP) pass of technology (such as voice label device) and semantic label and shallow parsing to build between the various composition in sentence System.These methods identify physical relationship or pattern (for example, in HTML dom trees) using recognizable keyword, and right Change in the structure of document is more flexible.

In some cases, the annotation being inserted in additional file is (for example, the volume carried out to text or other guide Volume) and/or comment on and can be identified by scan components.As used in this article, " editor " can include appointing in content What inserts or deleted, and " comment " can include any annotation for being attached to the content.It is described above in many aspects Technology in any technology or be currently known or in the future exploitation any other technology can be realized by scan components 314 To identify one or more annotations in additional file.

In some cases, message and/or the structure of additional file can be characterized or otherwise by identifier Index.In this example, can be by quoting hierarchy for the message with hierarchy and/or additional file, content The different brackets of interior content and/or the nesting identifier of position index.That is, can be by for the identifier of sentence It is nested in the identifier for paragraph, can be nested in the identifier for page for the identifier of paragraph, with such Push away.In in other respects, message and/or additional file for no hierarchy, content can pass through reference structure (example Such as, linear or other non-hierarchical configurations) in the identifier of position of content index.Furthermore, it is possible to by metadata or with it His mode defines the layout of the content of message and/or additional file (for example, for transmit or show).

In certain aspects, annotation (for example, editor, comment or other data) can be indexed to additional file Structure.For example, the one or more marks of grade and/or position of the annotation in the content for the file that annotation can add with reference Symbol is associated.In in other respects, take passages (for example, any part of additional file, including one together with adjacent content Individual or multiple annotations) structure of additional file can be indexed to.For example, take passages the content of file that can be additional with reference The grade of interior extracts and/or one or more identifiers of position are associated.In many aspects, scan components 314 can be with One or more identifiers (or other indexes) are detected, the identifier will annotate and/or take passages association to additional file Structure.In certain aspects, the metadata of one or more identifiers and/or the given content layout of given content structure can be with Detected by scan components 314 in the form of computer-readable instruction or information.

Extraly, context component 316 can assess each message and/or additional file to determine context.Up and down Text refers to any feature or condition relevant with message and/or additional file.For example, context can be related to message, example Such as, informed source in and/or by be routed to the type of client computing device 304, informed source in and/or will be route The type of messaging application extremely, the text queue on user view, the whole world associated with message or its sender are determined Timestamp when position system (GPS) data, instruction message are sent etc..In in a further aspect, context can be with adding File, and/or annotation in additional file or take passages it is related (for example, the page number of the file associated with annotation or extracts, With the line number code of page including the position for the paragraph for annotating or taking passages of annotation or the associated file of extracts including annotating or plucking The position of the sentence of record, identify when to make the timestamp of annotation, the name of editor of annotation, file author name, Identify when to create timestamp of file etc.).In certain aspects, the context on message, additional file, annotation, Take passages etc. details can by context component 316 by by user can be read or it is intelligible in the form of detected.

Extraction assembly 318 can extract at least a portion of content and/or data from additional file.For example, can be with Extracted via any suitable mode from additional file.In certain aspects, annotation or extracts can with additional text The associated structure of part and context are extracted together.For example, except extraction annotation or taking passages, extraction assembly 318 can extract The anchor information relevant with annotating or taking passages.Anchor information can include any structure associated with annotation or extracts or context is believed Breath, it includes computer-readable or user's readable format information.For example, anchor information can include annotating or take passages association extremely The structure one or more identifier of additional file and/or other indexes.Extraly, anchor information can include on annotation or The descriptive information of the context of extracts is (for example, editor's name；Author's name；The timestamp of annotation) and with additional text Descriptive positional information (for example, row, page, paragraph, sentence, word, phrase etc.) that annotation or extracts in part are associated etc.. In many aspects, anchor information can be deposited together as computer-readable metadata or otherwise with the content extracted Storage.

Chain joint assembly 320 can create one or more chains between a part of content and additional file extracted Connect.As being hereinbefore described in detail, it is extracted together with the structure and context that annotation can be associated with additional file. Under certain situation, associating between the structure of additional file and the content extracted can be created or preserved.For example, it can make Extracted with by one or more identifiers of the structure of the relevance extracted to additional file and/or other indexes Content and additional file between create and link.In many aspects, when in the partial content extracted and additional file Between create link after, the content extracted can be referred to as " the active content extracted ".In some instances, when When user selects the active content extracted, additional file can be automatically opened associated to the content with being extracted Position.Additionally or alternatively, when user's (for example, by editing or inserting comment) is come to the active content extracted When being annotated, the annotation can be automatically synchronous with additional file.

When it is not that 312 or client application 310 are applied in unified message transmission that reception, which is applied, transition components 322 can incite somebody to action Message and/or the Content Transformation that is extracted are into can be by receiving application (for example, third party's messaging application, enterprise message pass Send using etc.) understand or read form and/or expression.In certain aspects, transition components 322 can by the message and/or The content extracted is reformated into the structure that can be presented by receiving application.In in a further aspect, transition components 322 can So that message and/or the content translation extracted to be represented into what can be read by reception application.

Component 324, which is presented, can cause message and/or the content extracted can be applied by receiving terminal and/or reception The form of reading and/or expression show, render, transmit or otherwise presented.For example, can with unified message Transmission is using the content for showing message in the associated user interface in 312 or client application 310 and/or being extracted.Traditionally, When being cooperated on annotated file, user may have received that the comment file for being attached to email message. Hereafter, the first recipient may have already turned on additional file, and additional note is have input in the form of adding, delete, comment on etc. Release, its annotation, and the additional file newly annotated are summarized in the text of the second email message (for example, replying message) Copy.Similarly, the second recipient can perform substantially the same step, so as to draw at least the three of annotated file Individual different version by the first recipient and the second recipient (for example, the first version that is sent in origination message and created Two extra versions).This not only creates the version of multiple potential conflicts of annotated file, also requires that user performs Extra operation, such as its annotation is summarized in email message.In aspect herein disclosed, active is extracted Content enable multiple users to input annotation in the single version of annotated file, and automatically present and message The consistent annotation of text, this eliminates the demand to summarizing annotation.

Additionally or alternatively, message and/or the content extracted can be caused with can be by the 3rd by component 324 being presented The form and/or table of the readings such as square messaging application, enterprise message transmission application, text processing application, collaborative authoring application Show showing, rendering, transmitting or otherwise presenting.In this case, recipient can be from the note to additional file Benefit in the inline display released, recipient may not benefit from the interacting of the single version with annotated file.

According to other aspect, client computing device 304 and/or server computing device 308 can be counted with third party Equipment 328 is calculated to be communicated.Third party's computing device 328 can be similar to server computing device 106 or server is calculated and set Standby 308 describe.In many aspects, third party's computing device 328 can be answered with trustship one or more third party messaging With, enterprise message transmission application, text processing application, collaborative authoring application etc..In at least some aspects, it may be necessary to certification (for example, certification 112) accesses third party's computing device 328.

It should be appreciated that various equipment, component with reference to described by figure 3 etc. are not intended to system and method being limited to institute The specific component of description.Thus, extra topological arrangement can be used for putting into practice methods herein and system, and/or can arrange Except some described components are without departing from method and system herein disclosed.

Fig. 4 shows the illustrative methods for being used to scan the message with additional file according to exemplary embodiment.

Method 400 since receive operation 402 start, wherein, by unified message transmission application reception message.The message can have There are any types or form, including email message, SMS message, instant message etc..In some cases, can be from second The sender of end receives the message for including any additional file, wherein the sender to cellular service plan, i.e. When the associated unified message transmission application such as messaging application, enterprise message transmission application, electronic third-party email message One or more of transmission application, SMS message transmission application registration.In other cases, can " visiting by first terminal Ask user " include the message of any additional file as input to receive, wherein the access user enter content into The associated new message input field of unified message transmission application, e-mail interface object, message back input field etc. In.

At the additional file operation 404 of identification, it can be offseted by any suitable means for additional file The content of breath is scanned.In many aspects, additional file can include video content, audio content, voice mail and disappear Breath, image, document, electrical form, PowerPoint etc..

At identification structure operation 406, it is determined that the structure of additional file.It is it is for instance possible to use additional for scanning File any suitable technology, including the common technology that is currently known or the technology in future exploitation." envelope can be used Dress device " identifies structural data, can identify such as HTML etc semi-structured information, can use natural language processing (NLP) opening relationships between each component of the technology in content of text, image and/or video detection technology etc. can be used.

In certain aspects, additional file can not include hierarchy, and can by quote it is linear or other The identifier of the position of content in non-hierarchical configuration carrys out index content.Alternately, additional file can be related to Documents Department Point hierarchy, such as the title of file, the author of file or creator, the text of file, the metadata etc. of file.One In the case of a little, the text (for example, document text) of file can be text, and in other cases, document text can include Structural data (for example, columns and rows of data cell), or image, video, hyperlink or its combination can be included.More In individual aspect, the structure of document text can be related to element (for example, text element, data cell element, column element, row element, Pictorial element, video elementary, hyperlink element etc.) hierarchy.In many aspects, the hierarchy of element can be by embedding Identifier or other indexes are covered to describe.

In the first example, document text can include structured text content.For example, structured text content can wrap Include the layering of element (for example, one or more page elements, Zhang Yuansu, section element, paragraph element, row element, sentence elements etc.) Structure.In some instances, each element can be associated with one group of nested identifier, for example, associated with sentence elements Identifier, it is associated with row element, associated with paragraph element, associated with page element, and chapter associated with section element Element is associated, by that analogy.In many aspects, specific sentence elements can be by first with row element, paragraph element, page Associated one or more identifiers such as element, section element, Zhang Yuansu uniquely define.

Additionally or alternatively, document text can include the form of structural data, for example, form, electrical form, List object or its combination, and structural data can include the hierarchy of element.For example, include position in structural data In the case of the data value in the data cell of the row and column in table or electrical form, structural data can include element The hierarchy of (for example, data value element, data cell element, row element, column element, worksheet (or page) element etc.).Often Individual element can be associated with the set of the identifier of nesting, for example, associated with the identifier of data cell element, itself and row Element is associated, associated with column element, associated with work table element, by that analogy.In many aspects, specific data Unity element can be by associated with data cell element, row element, column element, one or more of the table element etc. that works One or more identifiers uniquely define.

In addition to structure, the layout of additional file can also be determined.In many aspects, layout definition is used to pass Send and/or show the formatting (for example, page formatting etc.) of additional file.For example, can be from associated with additional file Metadata in detect the layout of additional file., can be in the form of computer-readable instruction or information in many aspects To identify the metadata of the one or more identifiers and/or given content of given content structure layout.

At mark context operations 408, the context associated with the file added can be identified.For example, with adding The relevant context of file can include additional file document formatting type (for example .xls .docx, .jpeg .pdf etc.), additional file is derived from and/or the type by the application being routed to, indicate additional file when by The timestamp of establishment, the author of additional file, the title etc. of additional file.In certain aspects, can with can by with Family is read or the form that understands detects the details of the context on additional file.

It is determined that at annotation operations 410, it may be determined that whether additional file includes one or more annotations.Annotation includes To text or the other guide editor carried out and/or the comment being attached in additional file." editor " include it is any insertion and/or Delete.In many aspects, additional file can be scanned by any suitable means to identify annotation, including scan attached The content of the file added and/or associated metadata.If additional file include it is one or more annotate, this method after Continue identification annotation structure operation 412.Alternately, if additional file one or more annotations not to be covered, the party Method terminates.

At identification annotation anchor operation 412, can identify with the relevant anchor information of annotation of the file to adding (or " anchor ").In many aspects, structure that can be by the location index of annotation to additional file.For example, as hereinbefore retouched State, the grade of annotation and/or one or more identifiers of position in structure that annotation can be with specifying additional file Associated, no matter whether the structure is layering.In many aspects, the position of the annotation in the structure of additional file can be with It is included in the form of computer-readable instruction or information in anchor information.

Extraly, anchor information can include the context of the annotation in additional file.For example, the note in additional file The context released can include the page number, the page of the additional file associated with annotation of the additional file associated with annotation The position of one or more sentences of position including annotation of one or more paragraphs of line number code including annotation, mark what When make timestamp, name of editor etc. of annotation of annotation.In certain aspects, the details on the context of annotation can In the form of being included in anchor information and can use and can be read by user.

It should be appreciated that operation 402-412 is in order at the purpose description that shows this method and system, and it is not intended to Present disclosure is limited to specific sequence of steps, for example, step can be executed in different order, can be performed extra Step, and disclosed step can be excluded without departing from the disclosure.

Fig. 5 is shown to be shown according to extraction at least one of of content from additional file that be used for of exemplary embodiment Example property method.

Method 500 since receive operation 502 start, wherein, by unified message transmission application reception message.The message can have There are any types or form, including email message, SMS message, instant message etc..In some cases, can be from second The sender of end receives message and any additional file, and the sender passes to cellular service plan, instant message Send using etc. associated unified message transmission application, enterprise message transmission application, the transmission application of electronic third-party email message One or more of registered.In other cases, can be by associated with unified message transmission application first eventually Access user at end receives message and any additional file as input.

, can be by (as with reference to described by the additional file operation 404 of identification at the additional file operation 504 of identification ) any suitable mode scans the content of the message for the file added.In many aspects, additional file can With including video content, audio content, voice mail message, image, document, electrical form, PowerPoint etc..

It is determined that at operation 506, it is determined that whether should extract at least a portion of additional file.In some respects In, can be in response to assessing one or more factors (for example, whether additional file includes image, whether additional image wraps Include one or more annotations etc.) and determine at least a portion of the additional file of extraction.In some instances, extracts can include The substantial portion (for example, in the case where additional file is image or video) of additional file.When it is determined that what extraction added During at least a portion (hereinafter referred to as " the taking passages ") of file, this method proceeds to decision operation 508.Alternately, such as At least a portion of additional file is not extracted in fruit determination, then this method terminates.

It is determined that in operation 508, annotated it is determined that taking passages and whether including one or more.As described hereinbefore, note Release including the editor to text or other guide progress and/or the comment being attached in the part of additional file.If take passages bag One or more annotations are included, then this method proceeds to identification anchor operation 516.Alternately, if taking passages does not include one or more Individual annotation, then this method, which proceeds to, identifies anchor operation 510.

At identification anchor operation 510, the anchor information (or " anchor ") related to the extracts to additional file can be identified. In many aspects, the position of extracts can be indexed to the structure of additional file.That is, as described hereinbefore , the grade of annotation and/or one or more identifier phases of position in structure that annotation can be with specifying additional file Association, no matter whether the structure is layering.In many aspects, the position of the annotation in the structure of additional file can be with The form of computer-readable instruction or information is included in anchor information.In some instances, additional text can be included by taking passages The substantial portion (for example, in the case where additional file is image or video) of part.In this case, anchor information can include The identifier (for example, file identifier) associated with additional file.

Extraly, anchor information can include the context of the extracts in additional file.For example, plucking in additional file The context of record can include page number, the page of the additional file associated with extracts of the additional file associated with extracts The position of one or more sentences of position including extracts of one or more paragraphs of line number code including extracts, mark plucks Record timestamp when being created etc..In some instances, take passages can include additional file substantial portion (for example, In the case that additional file is image or video).In this case, the context of extracts can include the additional file of instruction The timestamp that when is created, author of additional file etc..In certain aspects, the details on the context of extracts can be with It is included in anchor information, and the form that can be read by user can be used.

At extraction operation 512, it can extract and take passages from additional file by any suitable means.For example, carry Taking can include replicating taking passages.Extraly, as being identified above, extracts can be carried together with the anchor information for extracts Take.More specifically, anchor information can include by take passages association to additional file structure with computer-reader form One or more identifiers and/or other indexes.Extraly, anchor information can include with extracts it is context-sensitive, with The description information for the form that family can be read, for example, author's name；The date created of extracts；And in some cases, it will take passages The descriptive location information being associated in additional file, for example, row, page, paragraph, sentence etc.；Etc..

Creating at linked operation 514, can established the link between the file taken passages and added.In many aspects, Can at least use will take passages association to the computer-readable identifier of the structure of additional file or other indexes to create Link.When taking passages the substantial portion for including additional file, the file identifier that can be linked to additional file is taken passages. In many aspects, when take passages created between the file that adds link when, extracts can be referred to as " active extracts ". In some examples, when user selects active extracts, additional file can be automatically opened associated with extracts Position.Additionally or alternatively, when user's (for example, by editing or inserting comment) is annotated (example to active extracts Such as, in message) when, annotation can be synchronized automatically with additional file.

At identification anchor operation 516, when it is determined that taking passages comprising annotation, it can identify annotation association to additional file Anchor information (or " anchor ").In many aspects, as above for extracts, described, the position of annotation can be indexed To the structure of additional file.That is, as described hereinbefore, annotation can be with specifying the knot of additional file The grade of annotation in structure and/or one or more identifiers of position are associated, and no matter whether the structure is layering.More In individual aspect, the position of the annotation in the structure of additional file can be included in the form of computer-readable instruction or information In anchor information.

Extraly, anchor information can include the context of the annotation in additional file.For example, the note in additional file The context released can include the page number, the page of the additional file associated with annotation of the additional file associated with annotation The position of one or more sentences of position including annotation of one or more paragraphs of line number code including annotation, mark note Release timestamp when edited etc..In certain aspects, the details on the context of annotation can be included in anchor information In and can use can by user read form.

At extraction operation 518, annotation can be extracted from additional file by any suitable means.For example, carry Taking can include replicating annotation.Extraly, as being identified above, annotation can be carried together with the anchor information for annotation Take.More specifically, anchor information can include by annotate association to additional file structure with computer-reader form One or more identifiers and/or other indexes.Extraly, anchor information can include with annotation it is context-sensitive, with The description information for the form that family can be read, for example, author's name；The date created of annotation；And annotation is associated in additional Descriptive location information in file, for example, row, page, paragraph, sentence etc.；Etc..

Creating at linked operation 520, can linked annotating with being created between the file that adds.In many aspects, Can at least use will annotate association to the computer-readable identifier of the structure of additional file or other indexes to create Link.In many aspects, when annotate linked with being created between the file that adds after, annotation can be referred to as " active Annotation ".In some instances, when user selects active annotation, additional file can be automatically opened and note Release associated position.Additionally or alternatively, when user's annotation active to (for example, in message) annotates When (for example, by changing or inserting comment), annotation can be synchronized automatically with additional file.

It should be appreciated that operation 502-520 is in order at the purpose description of explanation this method and system, and it is not intended to Present disclosure is limited to specific sequence of steps, for example, step can be executed in different order, can be performed extra Step, and disclosed step can be excluded without departing from the disclosure.

Fig. 6 is shown to be used at least a portion for the content extracted being inserted into message according to exemplary embodiment Illustrative methods.

Since method 600 start receive operation 602, wherein transmitting application by unified message receives message, such as hereinbefore pin Dock and bring drill to an end as described by work 402 and reception operation 502.

At identification structure operation 604, the structure of message is identified.In many aspects, message can include one or more Individual part, such as message text, subject line, recipient's field, sender's field, timestamp, dater, one or more are attached Part, signature boxes, confidential disclosures etc..Extraly, in certain aspects, message text can also relate to content of text, such as greet, It is arranged on one or more of one or more paragraphs sentence, signature line etc..Message text can also include non-textual content, Such as image, video, hyperlink etc..In some cases, for example, for the message similar to Email, the message can relate to And some, for example, message text, subject line, recipient's field, sender's field, annex etc..In other cases, example Such as, for similar text or the message of similar chat, the message may relate to minimum part, for example, message text, sender Field, timestamp and/or dater.

At identification structure operation 604, the message can be identified as having substantial non-hierarchical configuration or hierarchy. In certain aspects, the message can be identified as the hierarchy with part, and message body part can also include The hierarchy of element.For example, the message body part can include sentence elements, paragraph element, bullets element, project The hierarchy of list element, pictorial element etc..In some cases, each element of message body part can with one or Multiple nested identifiers or other indexes are associated, each element in the hierarchy of its specified message body part etc. Level and/or position.In in other respects, message can be identified as the non-layered with content of text and/or non-textual content Structure, it is by the position in the linear of identifier index to content or other non-hierarchical configurations.

For the message with paragraph structure, the content of text of message body part can be by the first element and second element Hierarchy define.That is, the first element also refers to one or more paragraphs, and what second element can refer to It is one or more sentences.In many aspects, one or more second elements (for example, one or more sentences) can fall In each first element (for example, paragraph), and one or more first elements (for example, one or more paragraphs) can fall into and disappear Cease in body part (for example, message text).In some instances, non-text elements can be in text element or middle distribution. For example, image can be inserted between two sections or in the paragraph of content of text.Additionally or alternatively, emoticon can Together inserted with the sentence with content of text.

At embedded extracted content operation 606, from file (for example, additional file or file of storage) The content of extraction can be embedded into the message.For example, the content extracted can be taken passages, it can include additional file One or more annotations.The content extracted can be with the information phase for the structure for quoting the additional file for therefrom extracting content Association.That is, the content extracted can be associated with anchor information, including structural information is (for example, specify additional file File structure in grade and/or position computer-readable identifier), and contextual information is (for example, with therefrom extracting The readable details (for example, the page number, line number code etc.) of the corresponding user in position in the additional file of content).

Embedded extracted content can be realized by any suitable means.For example, the content extracted can be by Paste in the message, and specifically, can be embedded in the message text of message.As described hereinbefore, disappear Breath text can include the content of text for being arranged in hierarchy or otherwise setting, such as greet, one or more Individual sentence or paragraph and signature line.Message text is additionally may included in content of text and/or the non-textual content of middle distribution (for example, image, video, hyperlink etc.).

, can be by any suitable for the position in the message text of embedded extracted content in many aspects Mode determines.In some instances, the sender of message can select the position for embedded extracted content.In the feelings Under condition, for example, sender can disappear cursor placement in desired position and accessing for the content extracted to be embedded into Control in breath.For example, in response to accessing the control (for example, " insertion " link), user interface object can be shown with For the content extracted to be embedded in into desired opening position.Alternately, the position for the content extracted can be automatic Ground identifies.In some instances, strategy can be used to identify the position for embedded extracted content in message.Also It is to say, based on strategy, the content extracted can follow signature line and be embedded into.Alternately, based on strategy, that is extracted is interior Appearance can be embedded in message text, for example, following the first paragraph (first paragraph follows greeting), or follow greeting. It should be appreciated that other strategies can be realized for the content extracted is automatically embedded in message.

In some cases, more than one file can be affixed to message.In this case, from multiple additional files The content of middle extraction can be embedded in message.The extraction of content such as can be described in detail above for single additional file Ground is carried out like that.In certain aspects, the content extracted can be embedded into message by sender with desired sequential manual In.In in other respects, strategy can be implemented, the strategy specify for it is embedded extracted for multiple additional files it is interior The order of appearance.For example, the strategy can be based on the order that file is attached, to cause being extracted for the first additional file Content be embedded in for the second additional file the content extracted it is first-class.In addition, including being extracted with first The contextual information for the readable details of user that content and the second content extracted together are shown can include filename and position Confidence ceases (for example, the page number, line number code etc.).It should be appreciated that other strategies can be realized for will automatically be extracted Content be embedded into the message from multiple additional files.

When the content extracted is embedded in message, the content extracted can be associated with the structure of the message. That is, the message described by for the hierarchy by part and element, the content extracted can be with specified message Hierarchy in the grade for the content extracted and/or one or more identifiers of position be associated.Therefore, extracted Content can it is associated with being associated with the structure of message and be associated with therefrom extract content additional file structure It is associated.

In in a further aspect, the content extracted can be included to the one or more chains for the file for being attached to message Connect.As described hereinbefore, can be established the link between the content and additional file extracted.In many aspects In, content connection or the computer-readable identifier of the structure coupled to additional file that link can include being extracted Or other indexes are (e.g., including in anchor information).Extracted in many aspects, including to the link of additional file Content can be referred to as " the active content extracted ".In some instances, carried when recipient's selection of message is active During the content taken, additional file can be automatically turned on the position associated with the content extracted.Extraly or it can replace Dai Di, when recipient is annotated (for example, by editing or inserting comment) to the active content extracted in message, The annotation can automatically with attached file and/or be stored in unified message transmission application file label in it is corresponding The file file of storage (for example) synchronize.

At identification recipient's terminal operation 608, the one or more of one or more recipients of message can be identified Terminal.In some cases, each recipient can be directed to (for example, personal computer, mobile device, tablet PC, intelligence TV etc.) identify one or more terminals.Identify that recipient's terminal can include the device type of identification terminal (for example, moving Dynamic equipment, personal computer, tablet PC etc.), the type of display of terminal is (for example, monitor, television set, support to touch Display, graphic alphanumeric display, aplhanumeric visual display etc.), the state of terminal (for example, be powered, be active, inactive, locking, Sleep, shutdown etc.), the application to endpoint registration is (for example, enterprise or electronic third-party email message transmission application, SMS message Transmit application, social networking application, instant message transmission application, voice mail application, calendar application etc.) etc..It should be understood that Be, can any given time for recipient's terminal come identification equipment type, type of display, registration application and One or more of state combines.

At decision operation 610, it is determined whether have registered terminal to unified message transmission application.In many aspects, to the greatest extent Pipe may have received message in the end that have registered to unified message transmission application (for example, by accessing user), still The message can be delivered and displayed to the recipient in the terminal that application registration is not transmitted to unified message.If to system One messaging application have registered terminal, then this method proceeds to transmission operation 614.Alternately, if not to uniformly disappearing Registration terminal is applied in breath transmission, then this method proceeds to conversion operation 612.

At conversion operation 612, message (be hereinafter referred to as " message of embedded content ") of the conversion including extracted content, With so as to be read and/or presented from the one or more applications registered to one or more recipient's terminals. In some aspects, for the other application in addition to unified message transmission application, thus it is possible to vary (that is, changing) embedded content Message, the Team Member of application registration is not transmitted to unified message to allow it to be supplied to.That is, conversion insertion The message of content can be related to the expression translated into the message of embedded content and can read by receiving application, and can also wrap The message for reformatting embedded content is included, with so as to be presented from the reception application to recipient's endpoint registration.Cause This, the message for changing embedded content can be according to translation process (for example, with language can be read by consumer applications or intelligible Or form provides the message of embedded content) and process is reformatted (for example, allowing it to by consumer applications or by spy The form that fixed terminal is rendered or presented provides the message of embedded content) describe.In certain aspects, conversion operation can be with It is related to single process, its language or form for being converted into be read by receiving application by the message of embedded content, wherein receiving Using any processing performed required for the message of embedded content is rendered or is presented in specific recipient's terminal.

In certain aspects, embedded content can differently be changed for the different applications that have registered to different terminals Message.For example, the message of embedded content (including can be set based on the associated one or more factors of the terminal with being identified Standby type, type of display, the application etc. of registration) and changed.In some cases, email message can be directed to transmit Using (for example, electronic third-party mail transmission application and enterprise message transmission application) conversion message rather than for being noted to terminal Other application (for example, instant message transmission application, SMS applications etc.) conversion message of volume.

In many aspects, as described hereinbefore, by the position for specifying the content extracted in the structure of message The content extracted is anchored into the structure of message by the one or more identifiers put.Extraly, the content quotation extracted refers to The anchor letter of position in the associated file (for example, additional file and/or file of storage) of the fixed content therefrom extracted Breath, for example, computer-readable identifier specify therefrom extract content associated file file structure in grade and/ Or position.In some cases, anchor information also includes corresponding with the position in the associated file for therefrom extracting the content The details (for example, the page number, line number code etc.) that can be read of user.

In the transition period, the message of embedded content can be reformatted into what can be presented by different reception applications Different structure, for example, the first structure of application presentation can be transmitted by electronic third-party email message and can be disappeared by enterprise The second structure that breath transmission application is presented.For example, some parts and/or member of the message received by unified message transmission application Element may not be presented and can be removed by specific reception application.Extraly, the message of the insertion content can be by The different expressions that can be read by different messaging applications are translated into, for example, can be by electronic third-party email message The first of transmission application reading represents and can transmitted by enterprise message the second expression that application is read.

In many aspects, the computer of associated file (for example, additional file and/or file of storage) is quoted The anchor information that can be read and/or user can be read can be changed together with the message of embedded content.As hereinbefore retouched State, including the content extracted in the message can be the active content extracted, it includes the content that will be extracted Coupled to the link of the file structure of associated file (for example, additional file and/or file of storage).In the situation Under, linking between the active content extracted and associated file, which can also be translated into, to be read by receiving application Expression.In the first example, linking between the active content extracted and additional file can be translated, to ring Should be in accessing the active content extracted, recipient is able to access that additional file (for example, additional file can be automatic It is opened to the position of extracted content).In the second example, passed for example, being stored in unified message in associated file Send in the file label (for example, file of storage) of platform, and enterprise message transmission application is able to access that the file of storage In the case of, the link can be translated into the hyperlink of the correspondence position in the file structure for quoting stored file.

In some cases, the transmission of electronic third-party email message is using the message that possibly can not handle the insertion content. For example, hierarchy of the electronic third-party email message transmission using the message that possibly can not be handled.In such a case it is possible to will For the hierarchy flattening of the message of embedded content, to cause it to be represented by linear structure.Alternately, third party's message Transmission includes the link of extremely associated file (for example, additional file and/or file of storage) using that possibly can not handle The active content extracted.In this case, the content extracted can be translated into electronic image (for example, portable Document format .jpeg etc.) or other inactive contents to represent extracted content.

In addition, when the message of the embedded content of conversion, conversion operation 612 can contemplate extra factor, such as equipment class Type and type of display.For example, conversion operation can include the message for reformatting embedded content, with so as to by having The particular device type for having particular display type is presented.For example, although personal computer can render the message of embedded content, But mobile device may not have such ability.In this case, the message of embedded content or the content only extracted Electronic image (for example .jpeg) can be converted into for being rendered by mobile device.

Sending at operation 614, the message of embedded content is sent to one or more recipient's terminals.In some respects In, for example, when one or more recipient's terminals transmit application registration to unified message, the message of embedded content can be not required to Change.That is, as described hereinbefore, the message of embedded content can be in the user of unified message delivery platform Presented in session in the central pane at interface.In in a further aspect, the details for the context that user can be read is (for example, page Code, line number code, paragraph number etc.) can together it be shown with the content extracted to notify therefrom to extract the position in the file of content The recipient put.In addition, file can be represented as linking to the content that (for example, being accessed by message text) extracted, Corresponding to (for example, by opening additional file access) additional file and (for example, via file label access) The single synchronized version of the file of storage, to cause any annotation carried out at what access point in office to file to be connect across all Access point and the single version for being automatically synchronized to file.

Alternately, when recipient's terminal does not transmit application registration to unified message, sending operation 614 can will be embedding The message for entering content is sent to the reception application outside unified message delivery platform, such as the transmission of electronic third-party email message should With or enterprise message transmission application.Then, embedded content can be rendered or present to the user of recipient's end by receiving application Message copy.Details (the example for the context that user can be read can also together be shown with the content extracted by receiving application Such as, the page number, line number code, paragraph number etc.), to notify therefrom to extract the recipient of the position in the file of content.In the situation Under, when recipient's terminal to unified message transmit application registration when, although the content extracted can be linked to it is additional File, and although user can benefit from the copy of message for receiving embedded content, but user may not Interacted with the single synchronized version of additional file.In other examples, for example, can in enterprise message transmission application In the case of the stored version for accessing file, user can interact with the single synchronized version of file.

It should be appreciated that operation 602-614 is in order at the purpose description that shows this method and system, and it is not intended to Present disclosure is limited to specific sequence of steps, for example, step can be executed in different order, can be performed extra Step, and disclosed step can be excluded without departing from the disclosure.

Fig. 7 is shown to be used for the annotation carried out to the content extracted and associated text according to exemplary embodiment The illustrative methods that part synchronizes.

Receiving at annotation operations 702, receiving the annotation of the content to being extracted.The content extracted is associated text At least one of expression of part.Associated file can be attached to message (for example, additional file) and/or can deposit The file (for example, file of storage) in the file label of unified message delivery platform is stored up, it can access one or more Other application.Annotation refers to editor's (for example, addition and/or deletion) and/or is attached to the comment of extracted content.When to uniformly Messaging application, enterprise message transmission application, the transmission of electronic third-party email message is applied, SMS message transmits application, immediately User at the second terminal that one or more of messaging application etc. is registered selects extracted content and inserted When entering to annotate, annotation can be received.In other cases, at the first terminal registered to unified message transmission application Access user when selecting extracted content and inserting annotation, annotation can be received.

At identification structure operation 704, the structural information associated with the content extracted can be identified.As hereinbefore It is described in detail, the anchor information associated with the content extracted can include structural information, such as specify and therefrom extract content The computer-readable identifier of grade and/or position in the file structure of associated file.As being hereinbefore described in detail, Anchor information can store with (for example, in the form of computer-readable metadata) together with the content extracted.In being extracted Holding associated structural information can be by any suitable means (for example, associated with the content extracted by scanning Computer-readable metadata) identify.

At identification position operation 706, can identify received to the position of the annotation of content extracted.In the feelings Under condition, the position of the annotation received in the structure for the content extracted can be identified, it can be with associated file File structure is associated.For example, the content extracted can be with the second section element in the file structure of associated file Second to the tenth sentence elements of the 3rd paragraph element are associated.In this case, the content extracted shown in the message Second to the tenth sentence of the 3rd paragraph of the second section of associated file can be included.Based on the example, can incite somebody to action Annotation receives the 8th sentence elements of the 3rd paragraph of the second section of display in the message.Therefore, in this example, annotation can With in the associated file structure at the 8th sentence elements of the 3rd paragraph element of the second section element, and can be with Quoted by the grade of the position in specified associated file structure and one or more identifiers of position.It should be understood that , the other method of the position in associated file structure for quoting received annotation is possible and can be with It is implemented without departing from the disclosure.

At identification application operating 708, the transmission application associated with the annotation received can be identified.For example, send Using that can include, unified message transmission is applied, enterprise message transmission is applied, electronic third-party email message transmits application etc..Example Such as, as being hereinbefore described in detail, disappear when to unified message transmission application, enterprise message transmission application, electronic third-party mail The user at second terminal that one or more of breath transmission application etc. is registered selects extracted content and insertion During annotation, annotation can be received.

At decision operation 710, it is determined that sending whether application is unified message transmission application.If it is unified to send application Messaging application, then this method proceed to simultaneously operating 714.Alternately, if it is not unified message transmission to send application Using then this method proceeds to conversion operation 712.

At conversion operation 712, convert comments by unified message with so as to transmit application reading.As hereinbefore It is described in detail, annotation can be received in the opening position in the content extracted.It can identify in the structure for the content extracted The position of the annotation received, and the content extracted can be related to the position in the file structure of associated file Connection.Thus, the annotation received can be mapped to the position in the file structure of associated file.In this case, turn Energy can be converted into by annotation (for example, addition, deletion or comment) and the positional information associated with annotation by changing operation 712 It is enough that form and/or the expression that application is read are transmitted by unified message.That is, annotation can be converted into for annotation to be answered For the computer-readable instruction to the associated file in unified message delivery platform.

At simultaneously operating 714, the annotation received can synchronize with associated file.In many aspects, If it is unified message transmission application to send application, the annotation in response to receiving the content to being extracted in message can be with Generate for computer-readable instruction of the application to associated file will to be annotated, and the annotation received can be by automatically Using to associated file (for example, additional file and/or file of storage).In many aspects, computer-readable finger Order can include the instruction to annotation (for example, addition, deletion or comment) and map to the annotation received associated One or more identifiers of grade and/or position in the file structure of file.Computer-readable instruction can be implemented with Grade and/or the position annotation received being applied in associated file.In at least some aspects, by unified message Delivery platform provide associated file single version reflection via any access point (for example, via the content extracted, Via the file opened additional file, be stored in via opening in the file label of unified message transmission application) to associated File carry out annotation.

In in other respects, if send application be not unified message transmission application, can change received to institute The annotation that the content of extraction is carried out can be transmitted the computer-readable instruction of application reading to generate by unified message.Computer can Reading instruction can include the instruction to annotation (for example, addition, deletion, comment) and map to the annotation received in correlation One or more identifiers of grade and/or position in the file structure of the file of connection.The computer-readable instruction can be with Be implemented to be received annotates application to the grade in associated file and/or position.In at least some aspects, by The associated file that unified message delivery platform is provided single version (for example, via the content extracted, via opening Additional file, via opening the file that is stored in the file label of unified message transmission application) reflection is via any access The annotation that point is carried out to associated file.

It should be appreciated that operation 702-714 is in order at the purpose description of explanation this method and system, and the operation 702-714 is not intended to is limited to specific sequence of steps by present disclosure, for example, step can be executed in different order, Extra step can be performed, and disclosed step can be excluded without departing from the disclosure.

Fig. 8 shows the content insertion exemplary boundary in the message for being used to be extracted according to exemplary embodiment Face.

As described hereinbefore, unified message delivery platform can be provided including three panes (for example, left frame 802nd, central pane 804 and correct frame 806) user interface 800.In many aspects, as described hereinbefore, ring Ying Yu selects Email entrance (for example, Email entrance 808) in left frame 802, related to email INBOX 810 The communication of connection can be displayed on central pane 804.As shown in figure 8, visit is identified by user name 812a and user's icon 812b Ask the specific user (for example, Ping Li) of unified message transmission application.

As illustrated by fig.8, unified message delivery platform can provide e-mail interface object (for example, Email circle In face of sending the communication of " similar Email " as 814).In many aspects, e-mail interface object 814 can provide For inputting or selecting recipient's field 816 of recipient, and for inputting the subject field 818 of subject line.In addition, electronics E-mail interface object 814 can provide the input field 820 for text input, order input, theme label input etc..Electronics E-mail interface object 814 can also provide extra control, such as additional controls 822 and embedded control 824.

, can be by selecting additional controls 822 when browsing and selecting and insert file by text in many aspects Part is attached to email message.Additionally or alternatively, file can be added by replicating and pasting the file To message.In certain aspects, in response to file is attached into message, annotation can be directed to the file is scanned.Such as It is hereinbefore described, if at least a portion that additional file includes one or more files for annotating, adding can To be extracted and be embedded within the message.Alternately, as described hereinbefore, user can select to be embedded in Control 824 is to extract at least a portion of associated file (for example, additional file or being stored in unified message transmission application File label in file), and being partially submerged into associated file in the message.In response to message is input into electricity In sub- e-mail interface object 814 and input is clicked on, the communication from user can be as the letter of new " similar Email " Cease and be automatically distributed to session.

It should be appreciated that be not intended to will be associated for the various features and function of user interface 800 with reference to described by figure 8 System and method be limited to described special characteristic and function.Thus, extra feature and function can with it is herein Described system and method are associated, and/or can exclude some described features and function without departing from herein Described system and method.

Fig. 9 A show the exemplary interfaces for being used to show the message of embedded content according to exemplary embodiment.

As described hereinbefore, unified message delivery platform can be provided including three panes (for example, left frame 902nd, central pane 904 and correct frame 906) user interface 900.In many aspects, as described hereinbefore, ring Ying Yu selects the session 910 in Email entrance 908 in left frame 902, and session 910 can be displayed on central pane In 904 conversation tag 912.As shown in Figure 9 A, identified by user name 924a and user's icon 924b and access unified message biography Send the specific user (for example, Ping Li) of application.

As shown in Figure 9 A, communication 914 is received from Rachel Morrison.Communication 914 includes following embedded object 918 Content of text 916.Embedded object 918 is included on the contextual information 920 for the content 922 extracted.For example, contextual information 920 provide to annotation 924a (for example, deletion) and annotate the description of 924b (for example, addition), in associated file The position (for example, first paragraph of the section of entitled " what we establish ", page 2) for the content extracted, and also wrap Include filename (for example, " LAUNCH.docx ").

In extra or alternative example, the content extracted is (for example, the annotation in the content 922 extracted 924a and annotation 924b) can based on date or time come with the comment intertexture (not shown) in other message and/or session.Example Such as, the first date or time that can be in session carries out the first comment on word or file (for example, in conversation tag 912 Middle display).Extraly, the second comment can be carried out in word processing file in the second date or time.With anchor content Second comment can be extracted from word processing file and be present in based on the second date or time in session.This Afterwards, the 3rd date or time that can be in session carries out (and/or having anchor content on the 3rd comment of word processing file Second comment).Therefore, with anchor content comment can be based on reception date and/or the time and with disappearing in session The comment carried out in breath interweaves.

As described hereinbefore, unified message delivery platform can be provided including three panes (for example, left frame 902nd, central pane 904 and correct frame 906) user interface 900., as described hereinbefore, can in many aspects To show the file associated with classification 908 in the file label 901 in central pane 904.In many aspects, in response to Select the content (for example, communication 914 as shown in Figure 9 A) extracted presented in the communication of content insertion, associated text Part 912 can be opened in file label 910.As shown in Figure 9 B, associated file 912 is shown in central pane 904 At least a portion.In addition, as shown in figure 9 a, associated file, which can be opened to, to be included in extracted content One or more annotations positions, for example, annotation 924a (for example, deletion) and annotation 924b (for example, addition).

It should be appreciated that the various features and function of user interface 900 with reference to described by figure 9A and Fig. 9 B are not intended to Associated system and method are limited to described special characteristic and function.Thus, extra feature and function can be with Systems and methods described herein is associated, and/or can exclude some described features and description, without departing from this System and method described in text.

Figure 10 shows the content insertion exemplary boundary in the message for being used to be extracted according to exemplary embodiment Face.

As described hereinbefore, unified message delivery platform can be provided including three panes (for example, left frame 1002nd, central pane 1004 and correct frame 1006) user interface 1000.In many aspects, as described hereinbefore , can in response to selecting the session 1010 (for example, Email entrance 1008) in Email entrance in left frame 1002 With the display session 1010 in the conversation tag 1018 of central pane 1004.

As shown in Figure 10, communication 1012 is received from " I " (for example, accessing user).Communication 1012 includes following being carried The content of text 1014 of the content 1016 taken.In this case, the content 1016 extracted is image.As being hereinbefore described in detail , the content 1016 extracted can include the substantial portion of the content (for example, image) of associated file.In some respects In, in response to selecting extracted content 1016, it can be opened in central pane 1004 and be stored in file label (for example, text Part label 1020) in image.

It should be appreciated that be not intended to function will be related for the various features of the user interface 1000 with reference to described by figure 10 The system and method for connection are limited to described special characteristic and function.Therefore, extra feature and function can be with this paper institutes The system and method for description are associated, and/or can exclude described some features and function, without departing from institute herein The system and method for description.

Figure 11-14 and associated description provide the various operation rings for many aspects that can be implemented within the disclosure The discussion in border.However, the equipment and system that show and discuss with reference to figure 11-14, are in order at example and the purpose illustrated, rather than Limitation can be used for the substantial amounts of computing device configuration for many aspects for implementing the disclosure described herein.

Figure 11 be show using its can put into practice the physical assemblies of the computing device 1100 of the aspect of the disclosure (for example, Hardware) block diagram.Computing device component described below, which can have, to be used in (or the server of server computing device 106 Computing device 308) on realize the computer executable instructions of unified message transmission application, it includes being performed is existed with use The computer executable instructions that 1120 are applied for unified message transmission of method disclosed herein.In basic configuration, Computing device 1100 can include at least one processing unit 1102 and system storage 1104.Configuration depending on computing device And type, system storage 1104 can include but is not limited to volatile memory (for example, random access memory), non-volatile Any combinations of property memory (for example, read-only storage), flash memory or such memory.System storage 1104 can include operating system 1105 and be suitable for running unified message transmission using 1120 one or more program moulds Block 1106 (such as the one or more assemblies on Fig. 3, and particularly context component 1111, extraction assembly 1113, conversion Component 1117 is presented in component 1115).For example, operating system 1105 goes for controlling the operation of computing device 1100.This Outside, embodiment of the disclosure can combine shape library, other operating systems or any other application to put into practice, and be not limited to Any application-specific or system.In fig. 11 the basic configuration is shown by those components in dotted line 1108.Computing device 1100 can have extra feature or function.For example, computing device 1100 can also include it is extra (it is moveable and/or It is immovable) storage device, such as disk, CD or tape.In fig. 11 by movable memory equipment 1109 and not removable Dynamic storage device 1110 shows such extra storage.

As described above, multiple program modules and data file can be stored in system storage 1104.When When being performed on processing unit 1102, program module 1106 (for example, unified message transmission applies 1120) can be wrapped with implementation procedure Include but be not limited to, such as many aspects described herein.Other programs that can be used according to many aspects of the disclosure Module, particularly it is used for the program module that unified message delivery platform is provided, context component 1111, extraction assembly can be included 1113rd, transition components 1115 or presentation component 1117 etc..

In addition, embodiment of the disclosure can be put into practice in electric circuit, the electric circuit includes discrete electronic component, bag Encapsulation or integrated electronic chip containing gate, using the circuit of microprocessor or comprising electronic component or microprocessor One single chip.For example, embodiment of the disclosure can be put into practice via on-chip system (SOC), in the component wherein shown in Figure 11 Each or multiple be desirably integrated on single integrated circuit.Such SOC device can include one or more processing units, Graphic element, communication unit, system virtualization unit and various application functions, these are all used as single integrated circuit collection Into (or " firing ") to chip base.When being operated via SOC, function described herein can via with single collection The special logic that is integrated together into the other assemblies of the computing device 1100 on circuit (chip) operates.Can also use can The other technologies of execution logic computing (for example, AND, OR, NOT) put into practice the aspect of the disclosure, and the technology includes but unlimited In：Machinery, optics, fluid and quantum techniques.Extraly, can in all-purpose computer or in any other circuit or be Multiple embodiments are put into practice in system.

Computing device 1100 can also have one or more input equipments 1112, for example, keyboard, mouse, pen, sound or Voice-input device, touch or slidably input equipment etc..Such as display, loudspeaker, printer or the like can also be included Output equipment 1114.Aforementioned device is example, and can use other equipment.Computing device 1100 can include allowing and it One or more communication connections 1116 of the communication of his computing device 1150.The example of suitable communication connection 1116 is included but not It is limited to radio frequency (RF) emitter, receiver, and/or transceiver circuit；It is USB (USB), parallel and/or serially enter Mouthful.

Term computer-readable medium as used in this article can include computer-readable storage medium.Computer storage is situated between Matter can be included for storing any method of such as information of computer-readable instruction, data structure, program module etc Or technology is come the volatibility realized and non-volatile, removable and immovable medium.System storage 1104, it may move and deposit Storage equipment 1109 and non-removable storage device 1110 are all the examples (that is, memory storage) of computer-readable storage medium.Meter Calculation machine storage medium includes：RAM, ROM, electricallyerasable ROM (EEROM) (EEPROM), flash memory or other memory skills Art, CD-ROM, digital universal disc (DVD) or other optical storages, cassette tape, tape, magnetic disk storage or other magnetic storages are set Any other product standby or can be used for storage information and can be accessed by computing device 1100.It is any such Computer-readable storage medium is all a part for computing device 1100.Computer-readable storage medium include carrier wave or other through propagation Data-signal.

Communication media is by computer-readable instruction, data structure, program module or modulated data-signal (example Such as, carrier wave or other transmission mechanisms) in other data to implement, and be situated between including any information transmitting medium or transmission Matter.Term " modulated data-signal " can include the signal with one or more of its characteristic set, or to close Change in the mode for being encoded information in the signal.Unrestricted as example, communication media includes wire medium (for example, cable network or direct wired connection) and wireless medium are (for example, acoustics, radio frequency (RF), infrared and other are wireless Medium).

Figure 12 A and 12B are shown can put into practice the mobile computing device 1200 of aspect using it, for example, mobile phone, intelligence Energy phone, wearable computer (for example, intelligent watch), tablet personal computer, laptop computer etc..With reference to figure 12A, show The one side for the mobile computing device 1200 in terms of realization is gone out.In basic configuration, mobile computing device 1200 is Handheld computer with both input element and output element.Mobile computing device 1200 generally include display 1205 and User is allowed to input one or more load buttons 1210 of information into mobile computing device 1200.Mobile computing device 1200 Display 1205 can function as input equipment (for example, touch-screen display).If be included, optional side input Element 1215 allows further user to input.Side input element 1215 is the hand of rotary switch, button or any other type Dynamic input element.In alternative example, mobile computing device 900 includes more or less input elements.For example, one In a little aspects, display 1205 can not be touch-screen.In alternative example, mobile computing device 1200 is portable electric Telephone system, such as cell phone.Mobile computing device 1200 includes optional keypad 1235.Optional keypad 1235 is thing " soft " keypad that reason keypad either generates on touch-screen display.In various embodiments, output element includes using In the display 1205, visual detector 1220 (for example, light emitting diode), and/or audio that show graphic user interface (GUI) Transducing transducer 1225 (for example, loudspeaker).In certain aspects, mobile computing device 1200 includes tactile for providing the user with Feel the vibration transducer of feedback.In another aspect, mobile computing device 1200, which includes, is used to send signal to external equipment Or the ancillary equipment entrance 1240 from external equipment reception signal, such as audio input end (for example, microphone jack), audio Output end (for example, earphone jack) and video output terminals (for example, HDMI entrances).

Figure 12 B are the block diagrams of the framework for the one side for showing mobile computing device.That is, mobile computing device 1200 can include the system (for example, framework) 1202 for being used for realizing some aspects.In one embodiment, system 1202 is by reality It is now one or more using (for example, browser, Email, calendar, contact manager, messaging are objective for that can run Family end, game and media client/player) " smart phone ".In certain aspects, system 1202 is integrated into calculating Equipment, such as integrated personal digital assistant (PDA) and radio telephone.

One or more application programs 1266 can be loaded into memory 1262 and be transported in operating system 1264 Row is associatedly run with operating system 1264.The example of application program include Phone Dialer, e-mail program, Personal information management (PIM) program, word processing program, spreadsheet program, internet browser program, messaging application Deng.System 1202 also includes the nonvolatile storage 1268 in memory 1262.Nonvolatile storage 1268 can be with If the persistent information powered off for storing system 1202 without that should lose.Application program 1266 can be in nonvolatile storage In domain 1268 using and storage information, such as Email or other message for being used by e-mail applications etc..It is synchronous to answer Also resided on (not shown) in system 1202, and be programmed to enter with resident corresponding synchronous applications on a host computer Row interaction, so that by the information being stored in nonvolatile storage 1268 with storing corresponding information on a host computer Keep synchronous.It should be appreciated that other application can be loaded into memory 1262 and in mobile computing device 1200 Upper operation, including for providing the instruction such as unified message delivery platform described herein (for example, search engine, carrying Take device module, relevance rank module, answer grading module etc.).

System 1202 has power supply 1270, and it may be implemented as one or more battery.Power supply 1270 can also include External power source, such as AC adapters or to battery powered or the powered docking cradle of charging.

System 1202 can also include the wireless device 1272 for performing the function of sending and receiving video communication.Radio Equipment 1272 facilitates the wireless connectivity between system 1202 and " external world " via communication carrier or service provider.Come Toward in the transmission of wireless device 1272 being carried out under the control of operating system 1264.In other words, can will be by wireless The communication that electric equipment 1272 is received is disseminated to application program 1250 via operating system 1264, and vice versa.

Visual detector 1220 may be used to provide visual notification, and/or COBBAIF 1274 can be used for via audio Transducer 1225 produces audible notice.In an illustrated embodiment, visual detector 1220 is light emitting diode (LED), And audio-frequency transducer 1225 is loudspeaker.These equipment can couple directly to power supply 1270, so as to when activated, even if place Reason device 1260 and other assemblies can be closed to save battery electric quantity, and these equipment can also be remained powered on and continued by informing mechanism Indicated a period of time.LED can be programmed to indefinitely remain powered on, until user takes action to instruction equipment Untill "on" position.COBBAIF 1274 is used to provide a user audible signal and audible signal is received from user. For example, in addition to being coupled to audio-frequency transducer 1225, it is audible to receive that COBBAIF 1274 may also coupled to microphone The input seen, for example, to promote telephone conversation.As will be described hereinafter, in accordance with an embodiment of the present disclosure, microphone is also Audio sensor be may be used as to be controlled to notice.System 1202 can also include video interface 1276, and it causes car The operation for carrying video camera 1230 is able to record rest image, video flowing etc..

Extra feature or function can be had by realizing the mobile computing device 1200 of system 1202.For example, mobile computing Equipment 1200 can also include (moveable and/or immovable) extra data storage device, for example, disk, CD, Or tape.So extra storage is shown by nonvolatile storage 1268 in Figure 12 B.

As described hereinbefore, the data/information and warp that will be generated or captured by mobile computing device 1200 The data/information stored by system 1202 is locally stored on mobile computing device 1200.Storing data in can be through By wireless device 1272 or via mobile computing device 1200 and the single calculating associated with mobile computing device 1200 Wired connection between equipment (for example, server computer in distributed computing network (for example, internet)) by equipment Lai In any amount of storage medium accessed.It should be appreciated that it can be set via mobile computing device 1200, via radio Access for 1272 or via distributed computing network such data/information.Similarly, according to one side, according to known Data/information transmission and storage mode (including Email and synergistic data/information sharing system), such data/letter Breath easily can be transmitted for storing and using between computing devices.

As described hereinbefore, Figure 13 is shown by handling at computing system from remote source (for example, based on individual Calculation machine 1304, tablet computing device 1306 or mobile computing device 1308) received data system architecture a side Face.The content shown at server apparatus 1302 can be stored in different communication channels or other storage classes.Example Such as, directory service 1322, portal website 1324, mailbox service 1326, instant message transmission storage 1328 or social can be used Website 1330 stores various documents.Unified message transmission can be by the visitor that is communicated with server apparatus 1302 using 1320 Family end is used, and/or unified message transmission can be used using 1320 by server apparatus 1302.Server apparatus 1302 can be with By network 1315 to client computing device (for example, personal computer 1304, tablet computing device 1306, and/or mobile meter Calculate equipment 1308 (for example, smart phone)) data are provided and provide number from the client computing device by network 1315 According to.As an example, it can be calculated above by referring to the computer system described by Fig. 1-12 in personal computer 1304, flat board Implement in equipment 1306, and/or mobile computing device 1308 (for example, smart phone).In these embodiments of computing device Any one 1316 can obtain content from storage, and can receive available for figure initiate at system pretreatment or The graph data post-processed at reception computing system.

Figure 14 shows the exemplary flat computing device that can perform one or more aspects herein disclosed 1400.Extraly, aspect described herein and function can be in distributed system (for example, computing systems based on cloud) Upper operation, wherein application function, memory, data storage and fetch and various processing functions can pass through Distributed Calculation Network (such as internet or Intranet) is remotely to each other to be operated.Can via onboard computing device display or via The remote display unit associated with one or more computing devices shows various types of user interfaces and information.For example, Various types of user interfaces and information be shown on the metope being transmitted in various types of user interfaces and information and And interact and be projected thereon with such metope.Handed over embodiments of the invention using a variety of computing systems of its practice Mutually include：Key stroke, touch-screen input, voice or other audio inputs, gesture input, wherein associated computing device dress Detection (for example, camera) function for capturing and interpreting user gesture is had, for controlling function of computing device etc..

For example, block diagram and/or operation diagram above by referring to method, system and computer program product and describe The aspect of the disclosure.Function/the operation recorded in the block can be with different from the order shown in any flow chart Come carry out.For example, depending on involved function/operation, two square frames continuously shown can actually generally simultaneously Perform, or square frame can perform in reverse order sometimes.

The description of the one or more examples provided in this application or diagram are not intended to be limiting in any manner or about The scope of beam invention claimed.Aspect, example and the details provided in the present disclosure is considered as being enough passing on all Thing, and those skilled in the art are manufactured and use the optimal mode of invention claimed.The disclosure should not This is construed as limited to any aspect, example or the details provided in this application.Either jointly still individually show Go out or describe, (in structure and method on both) various features be intended to choosing by selecting property include or omit, with produce have spy Surely the example for the feature organized.After the description of the present application and diagram is had been provided for, those skilled in the art are it is envisioned that fall Enter the modification in the spirit of the wider range of aspect for the in general inventive concept implemented in this application, modifications and substitutions are shown Example, without departing from the wider range of scope of invention claimed.

Claims

1. a kind of system, including：

At least one processing unit；And

At least one memory of computer executable instructions is stored, the computer executable instructions are when by described at least one When processing unit performs so that the system performs method, and methods described includes：

Receive the message with additional file；

Identify the structure of the additional file；

Identify at least one annotation in the additional file；

Determine position of at least one annotation in the structure of the additional file；

Extract at least one annotation；And

At least one annotation is included in the message.

2. system according to claim 1, in addition to：

At least one annotation is anchored into the structure of the additional file.

3. system according to claim 2, wherein, at least one annotate is anchored into the knot of the additional file Structure, in addition to：

Create to the link of the additional file.

4. system according to claim 1, in addition to：

The part of the additional file is extracted, wherein, the part of the additional file includes at least one note Release.

5. system according to claim 1, in addition to：

At least one annotation is embedded in the text of the message.

6. system according to claim 1, in addition to：

Receive to the selection of the annotation extracted；And

Open the additional file.

7. system according to claim 6, in addition to：

The additional file is opened in the opening position of at least one annotation.

8. system according to claim 1, in addition to：

The message is changed for sending at least one of the following：Enterprise message transmission application and electronic third-party mail Messaging application.

9. system according to claim 1, in addition to：

Determine the context of at least one annotation；And

The context is together shown with the annotation extracted.

10. a kind of system, including：

At least one processing unit；And

The message of embedded content is received, wherein, the message of the embedded content includes the content of the file extraction of slave phase association；

The structure of the content of the extraction is identified, wherein, the structure is associated with the file structure of the associated file；

Receive the annotation to the content of the extraction；

Identify position of the annotation in the structure of the content of the extraction；And

The annotation is synchronized with the associated file.

11. system according to claim 10, wherein, the message of the embedded content is received from application.

12. system according to claim 11, in addition to：

Determine whether the application is unified message transmission application；And

In response to determining that the application is not the unified message transmission application, the computer-readable instruction is converted into can Transmit what application was read by the unified message.

13. a kind of method being partially submerged into the message for extracting the part of additional file and will be extracted, described Method includes：

Receive the message with additional file；

Scan the additional file；

Extract the part of the additional file；And

The part of the extraction is shown in the message.

14. the method according to claim 11, in addition to：

Determine position of the part of the extraction in the structure of the additional file；

And the structure by the anchoring portions of the extraction to the additional file.

15. the method according to claim 11, in addition to：

By being partly embedded in the text of the message for the extraction.