WO2001077816A2 - System and method for real-time multi-directional file-based data streaming editor - Google Patents

System and method for real-time multi-directional file-based data streaming editor Download PDF

Info

Publication number
WO2001077816A2
WO2001077816A2 PCT/US2001/011532 US0111532W WO0177816A2 WO 2001077816 A2 WO2001077816 A2 WO 2001077816A2 US 0111532 W US0111532 W US 0111532W WO 0177816 A2 WO0177816 A2 WO 0177816A2
Authority
WO
WIPO (PCT)
Prior art keywords
file
edit
replica
session
editor
Prior art date
Application number
PCT/US2001/011532
Other languages
English (en)
French (fr)
Other versions
WO2001077816A3 (en
Inventor
Dinkar Goswami
Original Assignee
Gausa L.L.C.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Gausa L.L.C. filed Critical Gausa L.L.C.
Priority to AU2001251481A priority Critical patent/AU2001251481A1/en
Publication of WO2001077816A2 publication Critical patent/WO2001077816A2/en
Publication of WO2001077816A3 publication Critical patent/WO2001077816A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/176Support for shared access to files; File sharing support
    • G06F16/1767Concurrency control, e.g. optimistic or pessimistic approaches
    • G06F16/1774Locking methods, e.g. locking methods for file systems allowing shared and concurrent access to files
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/10Text processing
    • G06F40/166Editing, e.g. inserting or deleting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • H04L12/18Arrangements for providing special services to substations for broadcast or conference, e.g. multicast
    • H04L12/1813Arrangements for providing special services to substations for broadcast or conference, e.g. multicast for computer conferences, e.g. chat rooms
    • H04L12/1822Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]

Definitions

  • This invention relates generally to data processing systems and, more specifically, to systems and methods that provide real-time multi-directional file- based data streaming editors.
  • the Internet is increasingly used as a collaboration tool among groups of users who are physically not located in the same area.
  • Collaboration generally includes multi-user access to a file. It is often desirable if the collaborating parties have joint editing and viewing capabilities.
  • remote Internet users may desire to participate in virtual meetings, distance learning, virtual seminars, and online conferencing.
  • the current marketplace offers various systems that allow users to collaborate over a network.
  • many of the conventional systems do not provide the safeguards that are useful to protect confidential information on a desktop, while providing complete multi-user access to one or more files.
  • email and chat systems allow users to exchange information, ideas and files over a network. Both of these systems have obvious shortcomings. An email message is sent from one user to another as a series of packets routed through a network.
  • the packets are not necessarily sent according to the same path and therefore may not arrive at the destination node in order.
  • the packets are reordered at the destination node and delivered to the intended recipient once all of the packets have been received. This process may take anywhere from a couple of seconds to several hours.
  • Email is therefore limited by its transmission time and fails to support real-time collaboration. Chat and instant messaging systems provide a more real-time manner for users to exchange text messages. Collaboration may prove more valuable, however, when users are able to exchange and compare files in real- time.
  • Some systems which allow remote users to exchange and compare files in real-time do exist. These systems can generally be grouped as either desktop sharing or capturing applications, or whiteboard applications. Whiteboard applications provide a common work area where multiple remote users can input data, which is reflected to all other users participating in a session. The users' input is generally in the form of annotations.
  • Desktop sharing and capturing applications allow multiple users to access the contents of an initiating computer, or of an application.
  • Conventional desktop sharing and whiteboard application systems are subject to several shortcomings, some of which are outlined below. First, these conventional systems generally either (1) provide users with access to all of the files included on the hard drive, in a specific directory of the initiating computer, or relative to a specific application on the initiating computer; (2) or only provide access to a single file.
  • This invention in a preferred embodiment, provides an online, multidirectional file-based data streaming editor that allows multiple users to simultaneously compare, merge, and instantly edit files, while concurrently communicating with one another over a dedicated connection.
  • an online file editing method is provided. The method includes creating a session that allows at least two users with simultaneous to access a file, where each user has access to a replica of the file, receiving from a user an edit instruction indicating a file edit, editing a replica of the file according to the edit instruction, and automatically cascading the file edit to each replica of the file.
  • an online file editing method includes providing at least two users with simultaneous access to a file such that each user has access to a replica of the file, providing one of the at least two users with a capability to edit a local replica of the file, and automatically cascading the edit to all of the replicas of the file.
  • an online file editing method includes uploading the file from a first client to a server, providing to the first client and a second client simultaneous access to a replica of the file, a first replica and a second replica, respectively, receiving from one of the first client and the second client an edit command to edit one of the first replica and the second replica, editing the one of the first replica and the second replica of the file according to the edit command, and automatically editing or causing to be edited an other of the first replica and the second replica of the file according to the editing of the one of the first replica and the second replica of the file such that the editing is performed at a same location of the other of the first replica and the second replica of the file as it was performed in the one of the first replica and the second replica of the file.
  • a system to edit a file over a network includes a first client, which includes a first file and an editor that allows a user of the first client to access a replica of a second file, a second client that includes the second file and an editor that allows the second client to access a replica of the first file, and a server that provides the first client and the second client with simultaneous access to the replicas of the first and second files.
  • Fig. 1 depicts an exemplary computer network suitable for practicing the invention.
  • Fig. 2 depicts an exemplary flow diagram of the processing performed relative to this invention.
  • Fig. 2A depicts an exemplary screen shot of a form that can be used to create a session.
  • Fig. 2B depicts an exemplary screen shot of a page that can be used to upload a file from a participant's local drive to a server.
  • Figure 3 depicts an exemplary screen layout of a virtual meeting space tool interface in a two user implementation in accordance with the present invention.
  • Fig. 3 A depicts an exemplary screen shot of the screen layout depicted in Fig. 3.
  • Fig. 3B depicts an exemplary screen shot of the screen displays of both participants of a two-participant session in accordance with the present invention.
  • Fig. 4 depicts an exemplary screen shot of a multi-user interface.
  • This invention provides an interactive web-based communications tool which serves as an online, multi-directional file based streaming editor.
  • This "virtual meeting space tool” allows multiple remote users to collaborate in real-time such that the users can compare, merge and instantly edit a file, while simultaneously communicating with each other online.
  • the merging or edit performed is immediately and simultaneously “cascaded” to all session users.
  • cascade refers to automatically sending, or causing to be sent, an edit made in one file to all other files of a session, ensuring that the edits are made in the same place in each of the files.
  • the process of cascading thus may include receiving an edit command, creating one or more packets reflecting the changes made to the file, compressing and encrypting the packets, sending the packets to all replicas of the file that are included in a session, ordering the packets at a destination, and editing the file according to the edit command, while ensuring that the edit is applied to an appropriate part of a file (i.e., the edit is made at a point of the file that corresponds to a point of the file where the edit was initially made).
  • each session participant accesses a replica of a file, as distinguished from a copy of the file, which implies that an original exists and the others are copies of the original.
  • each replica of the file is continuously updated and maintained consistent with each of the other replicas of the file, as modifications to a replica of a file are automatically cascaded to all other replicas of the file.
  • an “initiating” user initiates and session, which can be joined by one or more “invitees.”
  • the initiating user and invitee(s) are referred to as
  • participant participants Any of the session participants can be in control of a session and therefore function as a host of the session.
  • Each session creates a dedicated link among session participants.
  • the initiating user can create and delete a session.
  • Invitees may join scheduled or ongoing sessions.
  • Each session is uniquely identifiable according to information that is maintained by the system, for example, in a database. Further details on creating and joining sessions are provided below.
  • the invention allows multiple users to simultaneously access a file, while one of the multiple users can edit the file at a time.
  • the system explicitly indicates which of the users has editing control at a given time, and allows the user with editing control to transfer such editing control to another user as desired, i.e., the host user can change throughout a session.
  • changes are automatically and immediately cascaded to other session participants. Therefore, changes to a file can be viewed in real-time by other session participants.
  • the virtual meeting space tool also provides additional editing features, such as, for example, tracking of changes, spell check, save, print, etc.
  • the virtual meeting space tool provides a single interface that allows multiple network users to transfer files among one another, simultaneously open the files on each of the users' respective computers, edit the files, discuss the files via a one to one discussion interface, and browse the Internet while performing the above functions.
  • the virtual meeting space tool interface includes an editor, a "switch" utility which allows a single user to retain control of a file at a given time, a chat area, a reference area, and an instant messaging utility, each of which is described further below.
  • a user can therefore open a file and, in a parallel frame, open a file that has been received over the network.
  • the interface provides an editor which allows users to perform a variety of editing functions on a file.
  • the virtual meeting space tool in accordance with the invention provides various operational advantages that are not provided by conventional systems.
  • the virtual meeting space tool allows users to compare, merge and edit his or her own files, as well as the files of other session participants. Edits made to a file are transmitted simultaneously to all session participants, without a user initiating a "send" or "transmit” action. All session participants can save or print a file during the session. Further, during a session all participants may open, create or edit a file that cannot be viewed or otherwise accessed by other session participants. Such files can be merged with a shared file, regardless of the original owner of the shared file. The merged file is automatically transmitted to other session participants, as would a file that has been edited via the virtual meeting space interface.
  • a "discussion area" section of the interface provides a chat function that allows participants of a session to discuss over files in real-time.
  • the system further includes a manner for the users to designate one of the participants as having control over a file at a given time.
  • the participant who has control can merge, edit, save, or print a file, and transfer control of the file in its full form to another session participant.
  • the invention allows an owner of a file to assign access permissions to replicas of the file. For example, a file owner can provide other session participants with permission to edit the file, but deny such participants permission to print or save the file, or vice versa. Further, in an embodiment, the invention can automatically compare two files and indicate the differences on the display.
  • the files may be in a variety of file or media formats, including, for example, text, hypertext markup language (html), graphics, AVI, etc.
  • the tool may also enables users to browse the Internet while accessing shared files.
  • a user can open a file in one part of a screen and open in another part of the screen a file that was forwarded to the user during the current session, and work on both simultaneously.
  • session participants can copy text and objects from each other's files and paste them in their own respective files, thereby editing their own files based on the simultaneous discussions and suggestions taking place through the discussion area without affecting the shared files. After editing, both users can save, print, or download the file and the discussion that occurred in the discussion area.
  • FIG. 1 depicts an exemplary computer network 100 suitable for practicing the invention.
  • Network 100 includes clients 105 and 110, which communicate with one another and server 115 via network 120.
  • Clients 105 and 110 preferably correspond to desktop computers.
  • Network 120 corresponds to any public or private network, such as, for example, the Internet or a LAN.
  • Each of clients 105 and 110 include the conventional components of a computer including memory, at least one processor, storage, and input and output devices.
  • clients 105 and 110 have been depicted in Fig. 1 with a storage device, the invention may be practiced with dummy terminals that do not include storage devices. Specifically, in such embodiments, no stored file is necessary.
  • a document can be prepared, online or offline, or a user can join a session without contributing a file.
  • the memory further includes one or more applications 118 that are used to create and open files that are transmitted and displayed according to the interface of the invention and a virtual meeting space tool interface 125 that allows files to be opened, edited, and shared with session participants.
  • the applications may include, for example, text, graphics, or spreadsheet applications.
  • Session participants can upload locally stored files to server 115, which are downloaded to each session participant's computer when the file originator opens the file via the interface 125.
  • An edit function of the virtual meeting space tool interface 125 provides a single user with permission to edit a file. All other session participants are only provided read access to the open session files.
  • the interface 125 will transfer edit control to another participant upon receiving an appropriate input.
  • the virtual meeting space interface 125 is user friendly and includes, for example, a series of pull down menus, forms and selectable items.
  • the editor supports a variety of edit functions including, for example, typing, formatting (e.g., bold, italic) and clipboard operations (e.g., cut, replica, paste), and operations that respond to keyboard and mouse events, operations performed via a toolbar, and operations performed via a mouse click.
  • the editor determines where an edit occurred and also determines the properties of the edit, e.g., color, font, format, etc. It also supports opening and saving of files that include both formatted and non- formatted text.
  • the editor may further include a speech recognition feature.
  • the editor opens text files in a rich text file format (RTF) such that the location of each character of a file is uniquely identifiable.
  • RTF rich text file format
  • each cell of a file is marked according to a unique identifier corresponding to a cell address and for a graphic file, lines of marking uniquely identify screen coordinates of the file.
  • the cascading process receives an edit from a marked place of a file and sends the edit to the same marked place of a replica of the file. Because the editor works according to type and location of an edit, it is language independent. Therefore, the editor can handle fonts of any language that a user has installed on his or her computer.
  • the editor also allows each of the session participants to edit local files, i.e., files other than the shared replicas, during a session. For example, if one participant has edit control, while that participant is editing a replica of a file, the other participant may be working locally on a file that is stored on the hard drive.
  • Server 115 also includes the conventional components of a computer including memory, at least one processor, storage and input and output devices.
  • the memory of server 115 further includes virtual meeting space tool 130 which allows multiple users to access files simultaneously.
  • the tool 130 coordinates interaction among users via the interface 125.
  • Files that may be simultaneously accessed by the multiple users are uploaded from a user's local storage 140 on a client 105 or 110 to server 115 for virtual storage as file 150.
  • the virtual meeting space utility 130 is not language or application dependent. It is operable with any application included on clients 105 and 110.
  • FIG. 2 depicts an exemplary flow diagram of the operation of a virtual meeting space tool in accordance with the present invention.
  • a initiating user begins by creating, i.e., scheduling, a session (210), i.e., the user who creates a session is also the initiating user of the session.
  • Fig. 2A depicts an exemplary screen shot of a from that can be used to create a session.
  • a session is identified according to a unique identifier and has a begin time and an end time.
  • a session may therefore be represented, for example, by an application level array that includes a title, a description, one or more invitees, an initiating user, and a session application number.
  • a system user provides the necessary information via the system interface.
  • the creator of a session indicates each of the desired session participants because only indicated participants will later be allowed to join the session.
  • the creator of a session can amend the list of invitees to reflect additional participants at any time between creation and deletion of the session.
  • the system notifies each of the invitees of the session, for example, by sending an instant message to each of the invitees, informing them of information about the session, including its name, initiating user and time of operation.
  • a session participant uploads one or more files to a server (220).
  • Fig. 2B depicts an exemplary screen shot of a page that can be used to upload a file from a participant's local drive to a server.
  • the virtual meeting space tool interface on each user's computer performs this upload function.
  • the files that are uploaded to the interface can be accessed by any of the participants of a particular session.
  • Once a file has been uploaded, it is treated as a virtual file in that a replica of the file resides on the server until it is opened by its originator. When a file is opened, a replica of the file is downloaded to a memory area of each of the session participants' machines.
  • session participants may upload additional files to the server as desired throughout the session. Additionally, session participants may create new files or download files retrieved from an Internet browsing session and upload the files to the server. All such files may be viewed by other session participants when the originator opens the files.
  • a replica of the file is downloaded to the local interface of each of the session participants.
  • each of the session participants has full access to shared files, including editing, saving, merging and printing capabilities (230).
  • changes made by each participant are automatically cascaded to other session participants.
  • a single session participant has editing control of all session files at a given time during the session.
  • the session participant in control can save, edit, merge, or print a file.
  • the session may be closed or extended. Prior to closing a session, the system provides each participant an opportunity to save the replica of the file. Additional participants may join a session at any time (250 and 260).
  • a user may joins a session by providing an appropriate input to the system, for example, by selecting an icon on the system interface. Only users who are listed as invitees to a session may join a session. Therefore, if a user attempts to join a session and the user is not indicated as an invitee to the session, the system denies the user access to the session. Each time a new user joins a session, the system automatically reformats the display of all participants to reflect the newly joined participant. A user may join a session at any time during the duration of the session.
  • the session automatically terminates (270). While a session can be deleted by its creator at any time after the session has been created, this exemplary flow diagram illustrates a session deletion as occurring after the session has been terminated (280).
  • the session initiating user selects an indicated session from a list of sessions and deletes it. When a session is deleted, all files associated with the session that are stored on the server are also deleted. Receiving and processing the information relative to creating, joining and deleting sessions is well-known in the art and therefore not described in further detail herein.
  • Figure 3 depicts an exemplary screen layout of a virtual meeting space tool interface in a two user implementation in accordance with the present invention.
  • Fig. 3 A depicts an exemplary screen shot of the screen layout depicted in Fig. 3.
  • the interface simultaneously displays both the current user's file and another user's files, 310 and 320, respectively.
  • Each of the session participants can edit any of the open files in the session according to the editing functions provided on edit tool bar 325.
  • Each session participant can open a single file at a time, although each session participant can open multiple files during a session. Files can be edited by the participant that has edit control at a particular point in time.
  • Control indicators 327(a) and (b) correspond, for example, to selectable buttons that both indicate which participant has control and provides that control to the indicated participant.
  • the participant having control is the only session participant who possesses complete file editing capabilities.
  • control indicators 327(a) and (b) indicate whether a particular participant can perform edits or not.
  • the control indicators 327(a) and (b) may be of different colors such that a green indicator 327(a) indicates that the user 310 can perform editing operations on all session files and a red indicator 327(b) indicates that the user 320 only has read access rights to all of the open session files.
  • the edit functions of all participants not having control are effectively locked such that the participants have read only access to the open files. Read only file access includes scrolling operations.
  • Edit tool bar 325 includes basic editing operations including, for example, clipboard operations such as cut, paste and copy, drawing functions, formatting, etc.
  • the editor also includes a function that records editing operations performed by the user. This function therefore supports undo, redo, and track change editing operations.
  • Each time an edit is performed the edit data is cascaded over the network and transmitted to each of the files included on a computer that is participating in the session. To appropriately cascade data edits, the system determines the following information: (1) the edit; (2) the type of the edit, e.g., type formatting, a clipboard operation, etc; and (3) where in the file the edit occurred.
  • the virtual meeting space utility compresses and encrypts the cascaded data to ensure that it is sent according to an optimal transmission rate.
  • control indicators 327(a) and (b) are returned to their previous color and edit control is returned to the previously indicated participant.
  • a speech prompt there are different means of indicating data loss, such as, for example, a speech prompt.
  • Screen area 330 provides an area where a user can list all of the files that have been uploaded to the server.
  • Each session participant can upload multiple files to the server. Once a file is opened, it is downloaded from the server to the local machine of each of the session participants. Edits to the file are thus made on a local replica of the file. As edits are made to a replica of the file, the edits are automatically cascaded to all other replicas of the file.
  • Each time a new file is opened the current file is closed. Prior to closing a current file, the system allows the participant in control to save the file. The participant in control can provide such control to other participants so that they may save the file as well.
  • Screen area 340 corresponds to a discussion area, where participants can engage in a real-time chat session, transmitting text among each other.
  • the screen layout could conform to a side-by-side arrangement of 310 and 320, and 330 and 340, respectively.
  • Fig. 3B depicts an exemplary screen shot of the screen displays of both participants of a two-participant session.
  • the display screens of the two participants are swapped such that screen areas 310 and 320 are reversed on the screens of the users, i.e., the top portion of each user's display screen includes the user's file.
  • Whichever participant has edit control can edit both files included in screen areas 310 and 320 via edit toolbar 325.
  • Each participant has a different list 330 of files that were uploaded to the server. And each user's display includes control indicators 327, a discussion area 340, and an instant messaging area 350.
  • Fig. 4 depicts an exemplary screen shot of a multi-user interface.
  • a multi-user interface may be: (1) the same format of the two user interface described above, where user may open a file, which can be accessed by all other participants. In this implementation, the interface would include the same screen components, although each of the screen areas would be of a smaller size; or (2) a single file that has been made accessible to multiple session participants.
  • a single participant has edit control at a given point in time and such control can be easily transferred to another participant.
  • each participant has a replica of the file, to which any edits made to another replica of the file are automatically cascaded.
  • a single file is displayed.
  • the screen of each participant in the session depicted in Fig. 4 would closely resemble the exemplary display that is shown.
  • the file is displayed on the left hand side of the interface.
  • An edit toolbar 415 is included at the top of the file display area.
  • Multiple invitees, listed at 420, can access the file.
  • the system indicates the following: status, switch, and selection.
  • the status area indicates whether the invitee is participating in the session.
  • the switch area indicates which user has edit control at a given time.
  • the participant having edit control can transfer such control to another session participant by selecting, for example, interrupt 425.
  • the remove area allows a session participant to indicate to other participants that he or she is leaving the session.
  • 430 and 440 correspond to additional areas where a session participant can browse, open and send additional files, and chat with other session participants.
  • Switch Notes is a unique concept and product and a new and novel application which allows users at different locations in the world to edit any document over the internet as well as any intranet system.
  • the edits made by one user on a document are caused to happen in all the other replicas of documents opened in a session at different locations almost instantaneously by the Switch Notes application.
  • the system is unique both at usage interface level as well as the technical level. At the usage level, the uniqueness comes from the presence of utilities like cascading editor, its editing, comparing and merging abilities over the internet, the Switch, chat area, the Reference area, and the Instant Messenger - all present in the same, simple interface.
  • Switch Notes allows for opening for a reference document that will not be shown to the buddy at all.
  • the use can open any document from own computer and use it as a reference document for the online discussion ongoing on the Switch Notes editors.
  • the user can do comparison / merging of the documents open in the Switch Notes editor and with this stand-alone reference document.
  • Clipboard operations through the keyboard are by default supported by this control. But to handle such actions through toolbar and right click menu, one made use of the Clipboard object.
  • the system used the methods SetText and GetText of Clipboard object to perform the clipboard operations as needed.
  • Editcontrol has a property called SelStart that tells the system where the edit has happened.
  • the basic assumption here is that the numbering of characters of any document will never vary. In other words, if one has a document that contains a word
  • SetA SelColor, SelBullet etc. All these properties (called SetA), constitute to tell the system about what the new edit looked like.
  • the EditControl has methods LoadFile and SaveFile that allow opening of a RTF
  • Session while uploading the document to Server Archive, the document is converted to RTF by instantiating a Word. Application object. This conversion also makes sure that Switch Notes editor can then allow online editing online of various types of documents.
  • Edit recording was done in various events of the editor, namely the Keypress, keydown, keyup, mousedown, mouseup events.
  • the character set of the keyboard is covered through the KeyPress event.
  • the non-character set of the KeyBoard is covered by the KeyUp and KeyDown events.
  • Event handlers written as mentioned above gather all the SetA properties, the positional properties (selStart, selLength), and the data of the edit, merge them into a large String of information.
  • This String is known as the Command String.
  • the Command String is the key to the whole system. This carries all the information needed for the receiving editor to carry out the corresponding cascading operations.
  • FLOW CHART No. 1 explains this phenomenon.
  • the Flow chart connectors ET (Editor Typing), EF (Editor Formatting), and ECP (Editor Clipboard) handle the preparation of command strings based on user's actions.
  • the Switch Notes control is embedded in a container (browser). There is a hidden Java Applet in this container. The ActiveX control and this Java Applet can communicate with each other using JavaScript.
  • each Switch Notes Session has a unique ID. Within each Switch ID, there can be user(s).
  • the Java Server identifies the ID of the buddy to whom the data should go from ED of the originating user. If the buddy is connected to the server at this stage, the data is sent to the destination.
  • the Java Socket programming is used in this data transmission.
  • the flow chart connector EC Editor Communication in FLOW CHART NO. 6 describes how Java programs handle the transfer of data.
  • the Command String to be dispatched to this communication mechanism occasionally will contain the data in large proportions also like some pasted data or some document data. Passing such big amount of data over the Internet in its base form is never a good idea. Hence, to speed up the process, the data was compressed. A high degree of compression was used for such Command Strings. At the receiving end, again the data is decompressed and presented to the destination editor in base form. Such data was also required to be encrypted for only Switch Notes to understand it.
  • the FLOW CHART NO. 3 explains this execution procedure.
  • the connectors EXED Execution for an Edit
  • EXWD Execution for Whole Data
  • EXSW Execution for a Switch
  • Switch Notes can handle any language fonts. If, for example the users have a font of Russian installed on their computers, then they can do editing online in Russian language.
  • Both the users can continue to edit their own documents independently of the buddy's edits.
  • a similar cascading logic can be implemented for applications like spreadsheets, graphics.
  • the key factor is to identify what is same in both the documents.
  • the character numberings remain the same in both documents, in a spreadsheet, the cell address are the same, and in a graphic software, the screen coordinates are the same.
  • PRESTR and POSTSTR A concept of PRESTR and POSTSTR is also implanted. While preparing the Command String, the first5 and next5 characters at the point of edit are picked up and termed as PRESTR and POSTSTR. They are merged with the Command String. The merging of POSTSTR AND PRESTR us explained in FLOW CHART NO. 7.
  • the PRESTR and POSTSTR received in the Command String are validated against the ones already present around the point of edit. If these two strings are consistent, then it is ensured the edit will happen at the correct place. Lf any error is noticed in this phenomenon, then the light is turned to YELLOW and The Restorative phenomenon is again launched to bring status to normal.
  • the flow charts DATA CHECK explains this checking mechanism (in the FLOW CHART NO. 8).
  • the Switch is the indicator of control. Normally there is always a diagonal relationship of red/green states of the editor.
  • the top editors of each interface are GREEN, and the bottom editors of each editor are RED.
  • the LOCKED property of the EditControl is set to TRUE. In accordance with RED light, the top editor's toolbar is also made Locked.
  • Switch transfer is also treated as a Command String. This command string does not carry any user data. It only carries a flag saying TRUE. On receiving of this flag, it is interpreted that a Switch Transfer has happened.
  • the Switch Concept can very well be applied to any other application also whereby only one person can take control of the application at one time. Switch transfer would make sure that the Control is shifted to the concerned destination.
  • the three lights provided with the Switch act as a visual signal for allowing effective communications. While the green and red lights indicate the user's rights to edit the document, the yellow light works as a status indicator.
  • the lights turn GREEN and YELLOW together indicating that the buddy has gone offline, but the user can still do the edits.
  • the Flow Connector ST Switch Transfer in the FLOW CHART No. 4 explains the switch transfer phenomenon.
  • This module handles the preparation of Command String based on User's Actions.
  • the editing can only be of 3 types: typing, formatting, OR clipboard operations.
  • Command String should also indicate whether the operation is destined from top - bottom or bottom - top editor. For this a flag “tb” (Top - Bottom) OR a "bt” (Bottom -S> Top) as the case may be, has to be attached. At the receiving end, first this is identified and then only the Command String is sent for execution at the corresponding destination editor.
  • the SetA properties namely, SelStart, SelLength, SelColor, SelFontSize, SelFontName, SelUnderline, SelBold, Selltalic, SelBulIet, SelAlignment.
  • SelUnderline A flag that can be set to TRUE / FALSE. TRUE indicates that the selection of text is underlined. FALSE indicates the opposite.
  • SelBold A flag that can be set to TRUE / FALSE. TRUE indicates that the selection of text is bold. FALSE indicates the opposite.
  • SelBulIet A flag that can be set to TRUE / FALSE. TRUE indicates that the selection of text is bulleted. FALSE indicates the opposite.
  • the Sellength will be ZERO. But still the system will get the values of each of these flags.
  • the concept is that the properties at a particular cursor position will always be those of the preceding cursor position unless the user has changed them at the current position (such actions one is recording, so the system always know the properties of the current cursor position).
  • the character typed comes through the value of KEYASCII obtained as an argument to the event handler KEYPRESS of the editor.
  • the KEY ASCII value is a unique number that represents that character. For example the Capital letter "A" is equal to 65.
  • This type of editing only changes the appearance of the text already present. It does not add or delete any text from the document.
  • the normal of way of bringing out such changes on an editor is to select a part of text from the document (by highlighting), and perform the desired operation.
  • This desired operation can be invoked wither by keyboard commands (like Ctrl B, Ctrl U, CTrl I) or Toolbar icons, or by Right Click menu option Font... (that launches a font dialog box).
  • the main properties of importance are the cursor position of the selection start and the length of the selection. These are obtained by SelStart and SelLength.
  • Event handlers are incorporated in the system that identify a formatting operation. The first part in those event handlers is to make that change on the main editor, then to prepare a Command String so that the same operation happens on the buddy's editor.
  • the clipboard actions are be default handled through the keyboard on any editor - i.e. Ctrl C (copy), Ctrl X (cut), and Ctrl N (paste). But programming was required to perform such actions through the toolbar icons and Right click menu options.
  • the ClipBoard object was utilized.
  • the Clear to clear the memory
  • the SetText to put text into memory
  • To Cut first the data was put into memory as explained in Copy and then the data was deleted from the document.
  • the GetText method was used. It returns the text currently stored in the memory.
  • this data is also compressed and packetized first and then merged into the command string.
  • This module handles the processing of editor data when a user joins a session.
  • the basic criteria is that at any point of time, the contents of the diagonal set of editors should remain the same. For this, it has to be made sure that when any user joins the session, the complete data present on top editor of the user is cascaded to the buddy's diagonal editor.
  • each Command String ready to be sent out from the computer is tagged with a unique number.
  • This number is a running sequence of numbers. This numbering makes sure that at the receiving end, a check can be done for any missing packet.
  • Switch_id Each Switch Notes session has a unique identification (switch_id). Each user also has a unique identification (strMname). Within each Switch_id, the system can have only authenticated users. The Java Server actually maintains a registry of such sessions and the users within them.
  • the data packets reach the end of the buddy who is in session only and not to any one else.
  • the actual physical identification of the buddy's computer on the internet also know as the IP address
  • This IP address knowledge is extracted from the Java - Socket programming model. In this, a Client side and a Server side Socket for each client are made. For each socket, there is a socket ID and that in turn is related to the IP address of the user's computer. Hence, the main identifying factor in this model is the socket id of the computer.
  • the Client side hidden applet expects the strMname and the switch id from the page as an input. This is passed into the applet through the PARAM tags (parameters). This set of information is carried to the Java Server. AT the Java Server, it is first checked if any other user is already present in the same session. IF this is the case, then an entry of this session id will already be present in the Java server registry. If this is the case, then the buddy's status gets online for the newly entered user. A status information is sent to both the users confirming that both the users have been now connected. This means that now the communication can start between the two.
  • This module handles the operations to be performed after the Command String has been received.
  • the first thing to check after receiving the Command String is whether there has been a data loss - i.e. whether any data packet has been lost on the way to the buddy. For this check, one number called previous_executed_string_number is always maintained. The number attached with the newly received Command String (i.e. packet) should be only and only ONE MORE THAN THIS previous executed string number. If not, then it clearly indicates that either:
  • Command String can either be an edit, a switch, or a Whole Data.
  • the PRESTR and POSTSTR received as a part of the Command String is checked against the ones present already in the document. For example, if the words "switch notes” are present at position 10 in both the editors. The user types a character, say "4" at the space after the word switch. This means the new character has come at the position 16. Now, at the sending end, PRESTR would contain “switch” and the POSTSTR would contain " note” (a blank character is present before note”).
  • This event handles the execution of Command String that carries the whole document data.
  • This data will come in a sub packet form. Hence, first it has to be merged as one packet at the receiving end. The number of sub packets are mentioned in the very first Command String that carries the information that a Whole Data Command String is on its way. The following are the steps carried out in this sub module.
PCT/US2001/011532 2000-04-11 2001-04-11 System and method for real-time multi-directional file-based data streaming editor WO2001077816A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2001251481A AU2001251481A1 (en) 2000-04-11 2001-04-11 System and method for real-time multi-directional file-based data streaming editor

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US19608800P 2000-04-11 2000-04-11
US60/196,088 2000-04-11
US22318500P 2000-08-04 2000-08-04
US60/223,185 2000-08-04
US25100400P 2000-12-04 2000-12-04
US60/251,004 2000-12-04

Publications (2)

Publication Number Publication Date
WO2001077816A2 true WO2001077816A2 (en) 2001-10-18
WO2001077816A3 WO2001077816A3 (en) 2004-12-09

Family

ID=27393574

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2001/011532 WO2001077816A2 (en) 2000-04-11 2001-04-11 System and method for real-time multi-directional file-based data streaming editor

Country Status (3)

Country Link
US (1) US20020056003A1 (US20020056003A1-20020509-P00018.png)
AU (1) AU2001251481A1 (US20020056003A1-20020509-P00018.png)
WO (1) WO2001077816A2 (US20020056003A1-20020509-P00018.png)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103546573A (zh) * 2013-10-30 2014-01-29 北京荣之联科技股份有限公司 一种对文本编辑实时监控的方法和装置

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU6778601A (en) 2000-06-26 2002-01-08 International Business Machines Corporation Data management application programming interface for a parallel file system
US20060074727A1 (en) 2000-09-07 2006-04-06 Briere Daniel D Method and apparatus for collection and dissemination of information over a computer network
US7509577B2 (en) * 2002-03-08 2009-03-24 Toshiba Corp Oration Method and system for implementing a clipboard
US7454760B2 (en) * 2002-04-22 2008-11-18 Rosebud Lms, Inc. Method and software for enabling n-way collaborative work over a network of computers
US20050246636A1 (en) * 2004-05-01 2005-11-03 Microsoft Corporation System and method for a user interface that provides contact-based sharing of resources
US20070233844A1 (en) * 2006-03-29 2007-10-04 Murata Kikai Kabushiki Kaisha Relay device and communication system
FI20065479A0 (fi) * 2006-07-05 2006-07-05 Nokia Corp Ryhmäkommunikaatio
US20080250149A1 (en) * 2007-04-09 2008-10-09 Morris Robert P Methods And System For Providing Concurrent Access To A Resource In A Communication Session
EP1990974A3 (en) * 2007-05-02 2010-03-24 Murata Machinery, Ltd. Relay server and relay communication system
US8073812B2 (en) * 2008-10-15 2011-12-06 Microsoft Corporation Preserving user intention in distributed data systems
US11520643B2 (en) * 2008-12-03 2022-12-06 International Business Machines Corporation Clipboard object sharing for instant messaging
US8380754B2 (en) * 2009-09-14 2013-02-19 Michael Ernst Laude Apparatus and methods for creating, updating, and using learning tools
CN101834905B (zh) * 2010-05-13 2015-06-10 中兴通讯股份有限公司 远程文档共享方法以及远程文档共享服务器
WO2012012580A2 (en) * 2010-07-20 2012-01-26 Sparkling Logic, Inc. Decision bubbles
US9207767B2 (en) * 2011-06-29 2015-12-08 International Business Machines Corporation Guide mode for gesture spaces
US20130191903A1 (en) * 2012-01-20 2013-07-25 Aventura Hq, Inc. Dual factor authentication with a programmable terminal device
US9584682B2 (en) * 2012-05-24 2017-02-28 Blackberry Limited System and method for sharing data across multiple electronic devices
JP6469952B2 (ja) * 2014-02-21 2019-02-13 ソニー株式会社 情報処理装置、および制御方法
CA2886483C (en) * 2014-03-31 2023-01-10 Smart Technologies Ulc Dynamically determining workspace bounds during a collaboration session
US11128717B2 (en) 2015-11-19 2021-09-21 Microsoft Technology Licensing, Llc Private editing of shared files
US20190146899A1 (en) 2017-11-14 2019-05-16 Microsoft Technology Licensing, Llc Assistive debugging of web applications with port forwarding

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5781732A (en) * 1996-06-20 1998-07-14 Object Technology Licensing Corp. Framework for constructing shared documents that can be collaboratively accessed by multiple users

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5920694A (en) * 1993-03-19 1999-07-06 Ncr Corporation Annotation of computer video displays
JPH0816514A (ja) * 1994-07-01 1996-01-19 Hitachi Ltd 共同作業支援システム
US6343313B1 (en) * 1996-03-26 2002-01-29 Pixion, Inc. Computer conferencing system with real-time multipoint, multi-speed, multi-stream scalability
US6233600B1 (en) * 1997-07-15 2001-05-15 Eroom Technology, Inc. Method and system for providing a networked collaborative work environment
US6144991A (en) * 1998-02-19 2000-11-07 Telcordia Technologies, Inc. System and method for managing interactions between users in a browser-based telecommunications network
US6601087B1 (en) * 1998-11-18 2003-07-29 Webex Communications, Inc. Instant document sharing
US6342906B1 (en) * 1999-02-02 2002-01-29 International Business Machines Corporation Annotation layer for synchronous collaboration

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5781732A (en) * 1996-06-20 1998-07-14 Object Technology Licensing Corp. Framework for constructing shared documents that can be collaboratively accessed by multiple users

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
LAUWERS J C ET AL: "Replicated architectures for shared window systems: a critique" SIGOIS BULLETIN, CHICAGO, IL, US, vol. 11, no. 2-3, 1990, pages 249-260, XP002263332 ISSN: 0894-0819 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103546573A (zh) * 2013-10-30 2014-01-29 北京荣之联科技股份有限公司 一种对文本编辑实时监控的方法和装置
CN103546573B (zh) * 2013-10-30 2017-10-17 北京荣之联科技股份有限公司 一种对文本编辑实时监控的方法和装置

Also Published As

Publication number Publication date
US20020056003A1 (en) 2002-05-09
AU2001251481A1 (en) 2001-10-23
WO2001077816A3 (en) 2004-12-09

Similar Documents

Publication Publication Date Title
US20030105816A1 (en) System and method for real-time multi-directional file-based data streaming editor
WO2001077816A2 (en) System and method for real-time multi-directional file-based data streaming editor
US9071615B2 (en) Shared space for communicating information
Greenberg et al. Groupware toolkits for synchronous work
US8464164B2 (en) System and method to create a collaborative web-based multimedia contextual dialogue
US8250154B2 (en) Structured archiving and retrieval of linked messages in a synchronous collaborative environment
US6088702A (en) Group publishing system
US7130885B2 (en) Methods and apparatus providing electronic messages that are linked and aggregated
US7933956B2 (en) System and method to create a collaborative web-based multimedia layered platform
US7818679B2 (en) Method, system, and apparatus for enabling near real time collaboration on an electronic document through a plurality of computer systems
EP1934820B1 (en) Distributed clipboard
CN107636641A (zh) 用于处理附加至电子邮件消息的注释的统一消息传送平台
US20110302506A1 (en) Method for Multi-User Collaboration on Visual Content Based Upon the Exchange of Session Data Objects Including New Parameters
US20070044017A1 (en) Rich Multi-Media Format For Use in a Collaborative Computing System
US20030023679A1 (en) System and process for network collaboration through embedded annotation and rendering instructions
US20020169893A1 (en) System and method for computer data synchronization
JP2009519627A (ja) メディアのコンカレントコラボレーションのためのシステム、方法及びコンピュータプログラム製品
US20100185951A1 (en) Hybrid synchronous/asynchronous means for sharing user interactions across multiple devices
WO2001025919A2 (en) Architectures for netcentric computing systems
JP2018517197A (ja) 層状スクリーンコンテンツのキャプチャ方法
US8413074B2 (en) Mechanism for collaboratively exchanging navigation information in a distributed document review
US20120096408A1 (en) System and method for establishing a collaborative workspace
WO2004015897A2 (en) Multi-user collaboration system and method
US11366583B1 (en) Computer-to-computer users# edit and event transfer and synchronization
JP2005222246A (ja) 共同作業支援システム及び方法

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP