WO2010117909A1 - System and method for synchronizing collaborative web applications - Google Patents

System and method for synchronizing collaborative web applications Download PDF

Info

Publication number
WO2010117909A1
WO2010117909A1 PCT/US2010/029819 US2010029819W WO2010117909A1 WO 2010117909 A1 WO2010117909 A1 WO 2010117909A1 US 2010029819 W US2010029819 W US 2010029819W WO 2010117909 A1 WO2010117909 A1 WO 2010117909A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
plug
container
message bus
server component
Prior art date
Application number
PCT/US2010/029819
Other languages
French (fr)
Inventor
Zeev Halevi
Ivgeny Rafalovich
Original Assignee
Hbr Labs Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hbr Labs Inc. filed Critical Hbr Labs Inc.
Priority to US12/754,118 priority Critical patent/US20100257451A1/en
Publication of WO2010117909A1 publication Critical patent/WO2010117909A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/52Program synchronisation; Mutual exclusion, e.g. by means of semaphores
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1095Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes

Definitions

  • the present invention relates to collaborative web applications.
  • this invention relates to web applications that allow a plurality of users to collaborate in a synchronous manner.
  • One aspect of the invention is directed at a computerized method for synchronizing collaborative network application between two or more users each having their own respective network browser and input device, comprising the steps of a) providing to each user access at least one server system that includes i) at least one message bus server component; ii) at least one application server component; and iii) at least one plug-in server component; b) delivering a first container from at least one application server component to the network browser of a first user; c) delivering a second container from at least one application server component to the network browser of a second user, the first container and the second container being the same as or different from each other; d) receiving one or more requests by a first user for a plug-in via the plug-in server component; e) delivering to the first container the plug-in from the plug-in server component; f) notifying the second user of the one or more requests by delivering notification through the message bus server component; g) delivering to the second user via the plug-in server component
  • Another aspect of the invention is directed at a system for synchronizing collaborative web applications by a first user and a second users using a collaborative infrastructure including: a) a data communication network; b) a message bus server component coupled to the data communication network; c) an application server component coupled to the data communication network; d) a plug-in server component coupled to the data communication network; e) a first user having a network browser and coupled to the data communication network; f) a second user having a network browser and coupled to the data communication network; wherein the application server component is configured for i) delivering a first container to the network browser of a first user, and ii) delivering a second container to a second user; wherein the plug-in server component is configured for i) delivering a plug-in to the container of the first user upon receiving a request for the plug-in from the first user; and ii) delivering a plug- in to the container of the second user upon receiving a request for the plug-in from the second
  • Yet another aspect of the invention is directed at a file or document prepared by a method herein, wherein the file or document is electronically stored, printed, graphically displayed, or any combination thereof.
  • FIG. 1A is a schematic diagram illustrating features of a system for synchronized collaboration of an application.
  • FIG. 1 B is a schematic diagram illustrating features of a system for synchronized collaboration of an application.
  • FIG. 2 is an illustrative flow chart of process steps that may be employed in synchronized collaboration of an application.
  • FIG. 3 is an illustrative flow chart of process steps that may be employed in setting up a synchronized collaboration session.
  • FIG. 4 is an illustrative flow chart of process steps that may be employed in synchronizing two users during a collaboration session using a message bus server.
  • FIG. 5 is an illustrative flow chart of process steps that may be employed for synchronized collaboration of a document having a plurality of layers.
  • FIG. 6 is an illustrative flow chart of process steps that may be employed in synchronizing two users during a collaboration session using a message bus server.
  • FIG. 7 is an illustrative diagram of features that may be employed in a networking device such as a computer.
  • FIG. 8 is a schematic block diagram of a synchronized collaboration system illustrating features of the synchronization infrastructure.
  • FIG. 9 is an illustrative example of a schematic container structure chart.
  • FIG. 10 is an illustrative flow chart of a session initiation.
  • FIG. 11 is a flowchart illustrating an example of an object synchronization process during a synchronized collaboration application.
  • the architecture of the system and the process of the collaboration methods allow for synchronized collaboration between a plurality of users without the need for installing software (e.g., without the need for saving an executable file in the non-volatile memory of the users), without the need for specific firewall settings, without the need for a large bandwidth (e.g., for sending outgoing messages), without a continuous link (for example between a container and a server, such as the message bus server) or any combination thereof.
  • software e.g., without the need for saving an executable file in the non-volatile memory of the users
  • a large bandwidth e.g., for sending outgoing messages
  • a continuous link for example between a container and a server, such as the message bus server
  • teachings contemplate a system, software, apparatus, and process that is free of a continuous link, that is free of HTTP tunneling, that is free of Transmission Control Protocol (i.e., TCP) between a container and the message bus server, that is free of a step of installing software in a manner that changes an registry and/or saves a file to non-volatile memory, or any combination thereof.
  • TCP Transmission Control Protocol
  • a container is a main application that runs in a network browser.
  • the container may contains one or more other applications, one or more plug-ins.
  • the container may additionally control the flow of messages or other information to an application or plug-in that is in the container.
  • the present invention advantageously may employ simple HTTP interactions in which a continuous connection (e.g., between a user and a server) is not needed.
  • a continuous connection e.g., between a user and a server
  • wireless networks e.g., Wi-Fi networks
  • drop-downs may prevent the use of collaboration methods that require a continuous connection.
  • the systems and methods of the present invention may employ HTTP protocol for synchronizing one or more collaborative web applications in two or more users.
  • the present invention makes advantageous use of unique and elegantly simple methodology that allows for multiple users to substantially contemporaneously access a common file, and modify, navigate or otherwise observe the file at remote locations from one another.
  • two or more users can collaboratively word process and temporarily and/or permanently modify, navigate, or otherwise observe one or more files.
  • the technology herein is particularly attractive in that the system architecture operates in a way that avoids the need for and may be substantially free of any requirements for users to download specific collaboration software, for users to adjust firewall settings, for users to have access to a network with a high bandwidth for uploading, for users to have access to a stable network, for users to create a continuous link (e.g., with a message bus server), or any combination thereof.
  • collaboration is possible for mass scale use by users having a wide variety of hardware and software by virtue of a unique approach to data management that involves serialization of data in a manner that is can be transmitted between users (e.g., via one or more servers). Serialization may be performed by suitable software that functions to convert an object into a string using Hypertext Transfer Protocol (HTTP).
  • HTTP Hypertext Transfer Protocol
  • the system and methods described herein may be employed in a broad range of collaborative web applications.
  • the collaborative web applications which may take advantage of the present invention include co-browsing, working together on documents, viewing a map together, conducting a sales or marketing session, filling in a form together, shared text editing, shared viewing of still or video images, live presentations, viewing 3D models together, collaborative shopping, shared drawing of documents, shared operation of calculators, shared technical or financial analysis, shared educational testing or review of educational information or tests, or any combination thereof.
  • the present invention may enable synchronized co-browsing between multiple web browser clients (i.e., users), using collaborative web applications, the teachings thus contemplate collaboratively accessing, modifying, navigating, or otherwise observing one or more file or other item for word processing, browsing the internet, spreadsheet calculating, database sorting, image viewing, form filling, and the like.
  • FIG. 1A illustrates an exemplary network environment in which the present invention may be utilized.
  • FIG. 1A illustrates a network environment 10 with a plurality of users (e.g., a first user and three second users), it will be appreciated that the invention is operable with any number of users. Users herein generally contemplate a computer device.
  • a plurality of users including a first user 20, and one or more second users 22 are coupled to a data communication network 12.
  • the data communication may be any network capable of connecting the users (e.g., via electronic signaling, radio frequency signaling, or otherwise).
  • a preferred data communication network is a network that includes or consists essentially of the internet (i.e., the network supporting the World Wide Web).
  • the network environment 10 may include one or more computer servers.
  • the network environment may include a server system that includes an application server component 14, a plug-in server component 16, and a message bus server component 18.
  • a user may be connected to a display device 24, an input device 26, an output device 28, or any combination thereof.
  • the application server 14 may be employed to host and/or deliver a synchronization framework to the first user 20, to the one or more second users 22, or preferably both.
  • the plug-in server 16 may be employed to host and/or deliver one or more plug-ins to the first user 20, to the one or more second users 22, or preferably both.
  • the message bus server 18 may be employed for synchronizing one or more plug-ins of the first user 20 and one or more second user 22, or preferably of the first user 20 and all of the second users 22.
  • a single server may perform the functions of two or more of the message bus server, the application server, and the plug-in server.
  • the system may include a single server that includes the message bus server component, the application server component, and the plug-in server component. It is further contemplated that two or more of the server components can be distributed among two or more servers.
  • the first user and the one or more second users may be any device capable of receiving the synchronization framework, communicating with the message bus server, or preferably both.
  • the one or more users may individually and separately each be a computer (such as a desktop computer 22', 20', or a laptop computer 22"), a mobile phone 22'", a personal digital assistant, or an electronic tablet.
  • the input device may be any device capable of being manipulated by an operator of the user for inputting an object into a plug-in.
  • the inputting device may be a keyboard 26", a pointing device 26', a microphone, and the like, or any combination thereof.
  • the output device may include a memory storage device 28'" (such as an optical disk reader/writer, a magnetic disk reader/writer, or a memory card reader/writer), a printer 28', a speaker 28", and the like, or any combination thereof.
  • Embodiments of the present invention enable synchronized co-browsing between multiple web browser clients, using collaborative web applications.
  • web applications may encompass plug-ins, add ons, consoles, applications, programs, or additional software that is required to execute a transaction or function via a web browser.
  • the deployment architecture of the synchronized collaboration system may be based upon a plug-in model, wherein applications plug-in to the synchronization framework.
  • the applications may include public applications, custom-made applications, tailored applications or any combination thereof.
  • the deployment architecture of the synchronized collaboration system (e.g., the co- browsing system) may be based upon a synchronization framework that utilizes or implements, at least partially, a supplier/consumer model notification service.
  • a supplier/consumer model notification service that may be employed is a Common Object Request Broker Architecture (i.e., CORBA) Notification Service.
  • CORBA Common Object Request Broker Architecture
  • the notification service may be used to provide an architecture where each side or user implements, a notification supplier element (e.g., for supply events) and a notification consumer element (e.g., for consume events).
  • the remaining framework may provide a "channel" that takes care of distributing the events in a way that is transparent to the modules (e.g., plug-ins) which communicate through it.
  • the work flow can be summarized as:
  • FIG. 8 is a schematic block diagram illustration of an exemplary system for synchronizing collaborative web applications which may be used.
  • the system may include an application server 162, a plug-in server 164, a message bus server 194, and a plug-in application infrastructure functioning on multiple client devices.
  • the application server 162 may serve or deliver application infrastructures to clients (i.e., to users).
  • the application infrastructure on a client are hereinafter referred to as containers.
  • a container may serve as the "container" application for both the first user (e.g., presenters) and the one or more second users (e.g., the viewers).
  • the container for the first user may be different than the container for the second user.
  • the container for the first user has one or more functionalities that is not in the container for the second user.
  • the first container may include functionality to invite operators to join a collaborative session, to allocate an editing control to one or more other users, to remove a user from a collaborative session, to reallocate an editing control away from a user, or any combination thereof.
  • the viewers may be an audience to the presenter. It will be appreciated that the first user may switch roles with another user so that a second user is a presenter and the first user is a viewer.
  • the container may be remotely stored on the application server.
  • the container may be a scripting language file or application, such as an AS3 (ActionScript 3) application, or other suitable application, that may be loaded from the application server to the presenter browser 166 and viewer browser 168, to provide a framework or container for the synchronized application to each user.
  • AS3 ApplicationScript 3
  • other suitable application such as an AS3 (ActionScript 3) application, or other suitable application, that may be loaded from the application server to the presenter browser 166 and viewer browser 168, to provide a framework or container for the synchronized application to each user.
  • AS3 ApplicationScript 3 file
  • the container resides in the volatile memory of a user, and there is no need to store the file or application (e.g., the Action Script 3 file or application) in the non-volatile memory of user, before the session, during the session, or any combination thereof.
  • a user does not need to store the container file or application before, during and after the collaboration session.
  • the presenter container 170 in the presenter browser 166 may include a presenter container application programming interface (API) 186 and a network layer 188.
  • the viewer container 172 in the viewer browser 168 may include a viewer container application programming interface (API) 190 and a network layer 192.
  • API presenter container application programming interface
  • the plug-in server may be used to configure and supply plug-ins to users.
  • the plug-in server may be any web server that hosts a plug-in.
  • the plug-in may be an "executable" application.
  • the plug-in may be coupled with an XML "descriptor", where the descriptor includes information on how the plug-in is used. Without limitation, the descriptor may include information such as what is the text in the menu that describes it, and what parameters it requires from the container to work properly.
  • a plug-in may be a public plug- in. Alternatively, a user may write his or her own plug-in, place it on a server and use it in the session. Such plug-ins may be custom made (tailor made) applications.
  • plug- in architecture may be from a set of documented public APIs, which the users/customers of the system can use to develop their own collaborative applications as plug-ins. It will be appreciated that a user may develop a plug-in that may interact with their servers and databases etc., place a plug-ins on their servers, use a plug-in in a collaborative session (e.g., with a customer), or any combination thereof.
  • the container may act as a host to one or more plug-in applications.
  • the container may provide the one or more plug-in applications with a channel of communication that allows the plug-ins to communicate with remote instances (e.g., one or more, or all of the other users).
  • the communication with remote instances may be as if they were running on the same computer.
  • the communication with another user may be by a simple method invocation.
  • the plug-in may interact with the container using two functions.
  • the first function is a supply notification which may pass an object to the container so that the container may distribute it (e.g., via the message bus server) to all other instances of the plug-in that run on the other users.
  • an operator of the presenter may make a change to a plug-in using an input device, the plug-in may capture the change as an object and pass the object to the container so that it can be packaged and sent to the viewers.
  • the second function is a consume notification which may be invoked by the receiving end container.
  • the consume notification may function by passing a "clone" of the object that was sent.
  • a second user e.g., a viewer
  • a first user e.g., a presenter
  • an object may be any object.
  • the object may be an object of a complex structure.
  • the object may be a vector, a text, a size, a color, a sound, a direction, a line, a combination of many lines, a width, a location (such as a position of a cursor or pointing device), or any combination thereof.
  • the container may provide one or more session-level collaboration functionalities. Any session-level collaboration functionality may be provided.
  • session-level collaboration functionality that may be provided include, for example: showing the mouse location of one or more, or even all users; enabling textual chat; loading/unloading plug-ins (add / close tabs); providing a handing-over-control mechanism, whereby the presenter can give any viewer the ability to act as the presenter role, including adding new plug-ins or acting as presenter in plug-ins; sending usage statistics to the application server, informing the various plug-ins about status or changes in life-cycle events, and the like, or any combination thereof.
  • Examples of status or changes in life-cycle events that may be provided between collaborators include, when a plug-in is active, in-focus, out-of-focus, terminated, and the like.
  • usage statistics that may be sent to the application server include how many participants used the plug-ins and for how long and their geographical locations.
  • the container may host any number of plug-ins. For example, the container may host one plug, the container may host more than one plug-in, the number of plug-ins that the container hosts may change over time, or any combination thereof.
  • the container may provide a supplier/consumer model notification service, such as a plug-in application that "supplies" a notification object in the browser of one user and consumes it in the browser of a different user.
  • the container may further provide the mouse location of one or more, or even all of the participants (i.e., all of the users. For example, the mouse location of the presenter or first user may be shown in the containers of all of the other participants.
  • the container may provide a Toolbox that includes one or more tools or functions for collaborative or co-browsing. Exemplary toolbox tools include a pen, an eraser, a highlighter, a save function, a save to-pdf function, a undo function, a redo function, or any combination thereof., etc.
  • the container may also provide a Tab mechanism that manages many plug-ins at the same time and "informs" the various plug-ins about status or changes in "life-cycle events", for example, when they are active, in-focus, out-of-focus, terminated etc.
  • Tab mechanism that manages many plug-ins at the same time and "informs" the various plug-ins about status or changes in "life-cycle events", for example, when they are active, in-focus, out-of-focus, terminated etc.
  • the container may provide a plug-in API that allows the plug-ins to run in a synchronized mode on the web browser of two or more users (e.g., the presenter's and viewers' web-browsers).
  • the plug-in API may be a public plug-in API, such as a documented public API, written in AS3 that enables creation of a "synchronized application”.
  • a "player" plugin as opposed to JavaScript that is run by the browser itself
  • Java such as Flash Player, Microsoft SilverLight and Java.
  • the message bus server is a web application that provides synchronization capabilities and routs messages from / to session users. Any protocol that provides synchronization capabilities may be employed.
  • the MB may implement a publish-subscribe / mailbox architecture in random access memory (i.e., RAM). Access to the MB may be achieved using Hypertext Transfer Protocol (i.e., HTTP).
  • HTTP Hypertext Transfer Protocol
  • Other protocols that provide synchronization capabilities and object synchronization functionality may be used, such as Remote Shared Objects using Real Time Messaging protocol (i.e., RTMP).
  • RTMP Real Time Messaging protocol
  • firewall/NAT/proxy traversal is enabled. In contrast, typical usage of RTMP generally fails on many firewall/NAT/proxy configurations without specific configuration.
  • RTMP Transmission Control Protocol
  • TCP Transmission Control Protocol
  • an operator of a user may make a change to a plug-in.
  • the plug
  • Further advantages of using HTTP include the ability to synchronize plug-ins even when the a user has an unstable internet connection and the ability to synchronize plug-ins even when the bandwidth available by a user for uploading is generally low. For example, synchronizing may be accomplished even when the band width available for uploading is less than 20 kbytes/second, less than about 6 kbytes/second, or even less than about 3 kbytes/second. Of course, high band widths (i.e., greater than about 6 kbytes/second or even greater than about 20 kbytes/second may also be used. This contrasts with RTMP connections, which require significantly higher upstream bandwidth.
  • Collaborative functionality in web applications may be implemented by using a synchronized application.
  • the synchronized application may be a plug-in to the container that can be loaded from any web server.
  • the synchronized application preferably provides collaboration functionality (e.g., working together on documents, viewing Google maps together, conducting 1-on-1 selling session, filling forms together, text editing together etc.).
  • the "synchronized application” preferably interacts with the "Container” using the "Public plug-in API".
  • FIG. 10 schematically illustrates a steps or processes that may be employed to enable synchronized collaboration (eg., co-browsing) between multiple web browser users.
  • the process may include one or any combination of the following steps: the presenter browser (PB) requesting a container from the application server (AS); the viewer browser (VB) requesting a container from the AS; sending or downloading a container to the PB, the VB, or both; requesting by the presenter container (PC) a plug-in from the PS; receiving or downloading the plug-in from the PS by the PC; requesting by the viewer container (VC) a plug-in; the PC instructing the VC to load the plug-in; the viewer container (VC) requesting this plug-in from the PS; or the VC may receiving or downloading the plug-in from the PS.
  • the presenter browser requesting a container from the application server (AS)
  • the viewer browser (VB) requesting a container from the AS
  • the objects synchronization can be implemented by one or any combination of the following steps: the Presenter Plug-in (PP) generating a "Notification", as a binary object, such as an AS3 object; the Presenter Container (PC) converting the object to a String using serialization to byte array and then base64 encoding; posting the notification to the Message Bus Dispatcher Module (MBD), (for example, as a Base-64 serialized object using HTTP) wherein the string may include addressing information like a session ID, user ID, or both; the MBD collecting the string and sending it to the Message Bus Mailbox Module (MBM); sending the messages to one or more target Mailboxes (e.g., according to a UniCast or Multicast addressing mode); sending a message polling request to the MBM, by the Viewer Container (VC); the MBM sending message list response to the VC; the VC converting the string using base-64 decoding back to a byte array and
  • MBD Message Bus Dispatcher Module
  • the processes do not include a step of streaming or otherwise sending desktop information of one user to another user (e.g., from the presenter to the audience).
  • the particular object being worked on may be dispatched to the network of current users, such that the delta or changes in application state indicated by the object being dispatched can be rapidly and effectively sent to all instances or session participants, (e.g., using a standardized remote procedure call technology).
  • the synchronization is facilitated by the usage of containers, to contain the applications and plug-ins being used for collaboration.
  • the amount of information needed to be communicated between the users is thus minimized and may include substantially of (or even entirely of) the object deltas.
  • the containers enable connectionless (e.g., communication without a permanent link) notifications over HTTP, to facilitate effective synchronized collaboration (e.g., synchronized co-browsing) using collaborative web applications.
  • the deployment architecture and system for synchronizing collaborative web applications may enable deployment of spontaneous online-web-meetings for mass audiences.
  • the methods of the present invention advantageously may be web-based, consume very low bandwidth (e.g., less than about 3 kbytes/second of upstream), be very rich in functionality due to its plug-in architecture that allows rapid deployment of applications (e.g., custom-made synchronized applications), or any combination thereof.
  • the system and process of the present invention may be adapted to enable spontaneous initiation of a session, without significant downloading of applications or data; without the need to install and setup software in advance (e.g., as a popular browser plug-in may be used), or both.
  • the system and process of the present invention may enabling the service to be utilized by mass audience (e.g., including users of relatively low capacity machines and/or data networks).
  • mass audience e.g., including users of relatively low capacity machines and/or data networks.
  • the platform may serve the masses of users, and may serve large audiences simultaneously without significant networking changes.
  • the system consumes very low bandwidth, this may enable high level service provision to all customers, including those with low quality internet-connections, and there is no intrinsic need to add significant server power when the service is used by many concurrent users.
  • NAT network address translation
  • Examples of synchronized applications that may run as plug-ins include: viewing documents together (e.g., implemented by uploading documents to the application server, converting the documents to Flash format files, downloading the flash format files to all participants, and presenting the documents and changes using a shared plug-in that renders the documents); collaborative form filling; shared text editing; shared video watching (e.g., Youtube or any other Flash format video stored on any server) (e.g., where the presenter and viewers will be fully synchronized so that all users can see exactly the same thing, when the presenter pauses, searches, highlights, edits, and the like; co-browsing (e.g., co-browsing of a map service such as Google maps); live presentations; viewing 3D models together; synchronized shopping carts; and using any type of calculator or financial analysis application.
  • viewing documents together e.g., implemented by uploading documents to the application server, converting the documents to Flash format files, downloading the flash format files to all participants, and presenting the documents and changes using a shared
  • Elements from external services may be integrated into the collaborative web browsing system.
  • An external service may be integrated to enable one or more of: instant collaboration web-meeting sessions with, for example, form-filling tools, document sharing (e.g., an agent can load any document and immediately review it with a remote audience, using all MS-Office formats, pdf, text, images, videos, music etc.
  • a presenter and a viewer may exchange roles during a session.
  • the current presenter container may have a button or link to transfer presenter rights to another one of other users.
  • the new presenter may then inherit some or all of the presenter rights, until the rights are again transferred (e.g., to others or to the original presenter).
  • a Plug-in may be loaded from any third party web server, although typically the plug-ins may be loaded from the Application Server.
  • a "Current Tab Status" is available for participants who join in the middle of a session so that they can see exactly what the others see.
  • a tab is an instant of a plugin, for example: one document may be shared in a plug-in but multiple instances can be opened at the same time with different documents, as Tabs.
  • the mechanism of current- tab-status may take care of situations where viewers join the session in the middle. When this happens, the framework may open all the open tabs of the presenter for them, and sets the open tabs at the same state.
  • a document if a document is opened as a Tab, it will open on the same scroll position as the presenter. In another example, if a video is opened it may Fast- Forward to the frame where the presenter is.
  • An operator of the first user may control who can edit a document in a plug-in.
  • the first user may be a presenter and a second user, or even all of the other users may be a viewer.
  • the first user may control the ability of a second user to make a change (e.g., changes to a plug-in). As such the process may includes a step of passing a control to the second user so that the second user may make a change.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

A system and method for synchronizing collaborative web applications including using a message bus server and HTTP protocol.

Description

SYSTEM AND METHOD FOR SYNCHRONIZING COLLABORATIVE WEB APPLICATIONS
CLAIM OF PRIORITY
[001] The present application claims the benefit of U.S. Provisional Patent Application No.
61/166768 (filed on April 5, 2009) which is hereby incorporated by reference in its entirety for all purposes.
FIELD OF THE INVENTION
[002] The present invention relates to collaborative web applications. In particular, this invention relates to web applications that allow a plurality of users to collaborate in a synchronous manner.
BACKGROUND OF THE INVENTION
[003] There have been many advances in applications that have enabled groups of individuals to collaborate together even when separated by large distances, such as by sharing files, or chatting on the internet. Many of these advances are not synchronous and require sending documents back and forth. Others require installation of software, changes to network firewall settings, saving of files, or continuous links between users.
[004] Examples of methods for collaborative web applications are described in PCT Application No. WO2008/102364, published on August 28, 2008 (Moed et al.), U.S. Patent Application Publication No. 2001/0037367A1 , published on November 1 , 2001 (S. Iyer), U.S. Patent Application No. US 2006/0053380A1 , published on March 8, 2006 (Spataro et al.), and U.S. Patent Application No. US 2004/0243672A1 , published on December 2, 2008 (Markki et al.), all expressly incorporated herein by reference in their entirety.
[005] There continues to be a need for collaborative web applications that allow for synchronous collaboration by a broad range of users having different firewall and security settings, and having poor to excellent network stability. For example, there is a need for a collaboration method that does not require installation of software (e.g., having an executable file), that does not require specific firewall settings, that does not require HTTP tunneling, that does not require a continuous link, that can work on an unstable network, that does not require a large bandwidth, that allows for synchronizing documents in two or more computers, that does not require transmission control protocol (i.e., TCP), or any combination thereof.
SUMMARY OF THE INVENTION
[006] One aspect of the invention is directed at a computerized method for synchronizing collaborative network application between two or more users each having their own respective network browser and input device, comprising the steps of a) providing to each user access at least one server system that includes i) at least one message bus server component; ii) at least one application server component; and iii) at least one plug-in server component; b) delivering a first container from at least one application server component to the network browser of a first user; c) delivering a second container from at least one application server component to the network browser of a second user, the first container and the second container being the same as or different from each other; d) receiving one or more requests by a first user for a plug-in via the plug-in server component; e) delivering to the first container the plug-in from the plug-in server component; f) notifying the second user of the one or more requests by delivering notification through the message bus server component; g) delivering to the second user via the plug-in server component a plug-in compatible with the plug-in of the first user, so that the first and second user are each substantially simultaneously able to access compatible plug-ins and operate the plug-in in a coordinated substantially synchronized manner for modifying and/or observing a common file associated with the plug-ins; and h) following one or more modifications of the common file made by a first user, communicating to one or more of the other users, the one or more modifications, wherein the communicating is substantially contemporaneously with the modification, wherein the communicating takes place by i) converting the modification to a serialized string using HTTP in the container of the first user; ii) posting the serialized string to the message bus server; iii) cloning the serialized string for sending to the second users; iv) de-serializing the string to the modification in the container of the second user; and v) consuming the modification by the plug-in of the second user; so that the modification is delivered to the second user without interference by a firewall. [007] Another aspect of the invention is directed at a system for synchronizing collaborative web applications by a first user and a second users using a collaborative infrastructure including: a) a data communication network; b) a message bus server component coupled to the data communication network; c) an application server component coupled to the data communication network; d) a plug-in server component coupled to the data communication network; e) a first user having a network browser and coupled to the data communication network; f) a second user having a network browser and coupled to the data communication network; wherein the application server component is configured for i) delivering a first container to the network browser of a first user, and ii) delivering a second container to a second user; wherein the plug-in server component is configured for i) delivering a plug-in to the container of the first user upon receiving a request for the plug-in from the first user; and ii) delivering a plug- in to the container of the second user upon receiving a request for the plug-in from the second user; wherein the message bus server component is configured for delivering notifications to the users other than the user that sent the notification; and wherein the first container is configured for converting modifications to a plug-in to a serialized string using HTTP. [008] Another aspect of the invention is directed at one or more computers that are programmed for performing a method as described herein.
[009] Yet another aspect of the invention is directed at a file or document prepared by a method herein, wherein the file or document is electronically stored, printed, graphically displayed, or any combination thereof.
BRIEF DESCRIPTION OF THE DRAWINGS
[0010] The principles and operation of the system, apparatus, and method according to the present invention may be better understood with reference to the drawings, and the following description, it being understood that these drawings are given for illustrative purposes only and are not meant to be limiting.
[0011] FIG. 1A is a schematic diagram illustrating features of a system for synchronized collaboration of an application.
[0012] FIG. 1 B is a schematic diagram illustrating features of a system for synchronized collaboration of an application.
[0013] FIG. 2 is an illustrative flow chart of process steps that may be employed in synchronized collaboration of an application.
[0014] Fig. 3 is an illustrative flow chart of process steps that may be employed in setting up a synchronized collaboration session.
[0015] FIG. 4 is an illustrative flow chart of process steps that may be employed in synchronizing two users during a collaboration session using a message bus server.
[0016] FIG. 5 is an illustrative flow chart of process steps that may be employed for synchronized collaboration of a document having a plurality of layers.
[0017] FIG. 6 is an illustrative flow chart of process steps that may be employed in synchronizing two users during a collaboration session using a message bus server. [0018] FIG. 7 is an illustrative diagram of features that may be employed in a networking device such as a computer.
[0019] FIG. 8 is a schematic block diagram of a synchronized collaboration system illustrating features of the synchronization infrastructure.
[0020] FIG. 9 is an illustrative example of a schematic container structure chart.
[0021] FIG. 10 is an illustrative flow chart of a session initiation.
[0022] Fig. 11 is a flowchart illustrating an example of an object synchronization process during a synchronized collaboration application.
[0023] It will be appreciated that for simplicity and clarity of illustration, elements shown in the drawings have not necessarily been drawn to scale. For example, the dimensions of some of the elements may be exaggerated relative to other elements for clarity. Further, where considered appropriate, reference numerals may be repeated among the drawings to indicate corresponding or analogous elements throughout the serial views.
DETAILED DESCRIPTION OF THE INVENTION
[0024] The following description is presented to enable one of ordinary skill in the art to make and use the invention as provided in the context of a particular application and its requirements. Various modifications to the described embodiments will be apparent to those with skill in the art, and the general principles defined herein may be applied to other embodiments. Therefore, the present invention is not intended to be limited to the particular embodiments shown and described, but is to be accorded the widest scope consistent with the principles and novel features herein disclosed. In other instances, well-known methods, procedures, and components have not been described in detail so as not to obscure the present invention. [0025] System and methods of the present invention provide novel means of synchronizing collaborative web applications and related features. The architecture of the system and the process of the collaboration methods allow for synchronized collaboration between a plurality of users without the need for installing software (e.g., without the need for saving an executable file in the non-volatile memory of the users), without the need for specific firewall settings, without the need for a large bandwidth (e.g., for sending outgoing messages), without a continuous link (for example between a container and a server, such as the message bus server) or any combination thereof. Thus, the teachings contemplate a system, software, apparatus, and process that is free of a continuous link, that is free of HTTP tunneling, that is free of Transmission Control Protocol (i.e., TCP) between a container and the message bus server, that is free of a step of installing software in a manner that changes an registry and/or saves a file to non-volatile memory, or any combination thereof.
[0026] As used herein, a container is a main application that runs in a network browser. The container may contains one or more other applications, one or more plug-ins. The container may additionally control the flow of messages or other information to an application or plug-in that is in the container.
[0027] The present invention, advantageously may employ simple HTTP interactions in which a continuous connection (e.g., between a user and a server) is not needed. This makes the present invention particularly suitable for use with wireless networks (e.g., Wi-Fi networks) which tend to have short drop-downs. Such drop-downs may prevent the use of collaboration methods that require a continuous connection.
[0028] Advantageously, the systems and methods of the present invention may employ HTTP protocol for synchronizing one or more collaborative web applications in two or more users. [0029] The present invention makes advantageous use of unique and elegantly simple methodology that allows for multiple users to substantially contemporaneously access a common file, and modify, navigate or otherwise observe the file at remote locations from one another. By way of example, substantially in real time, two or more users can collaboratively word process and temporarily and/or permanently modify, navigate, or otherwise observe one or more files. For example, the technology herein is particularly attractive in that the system architecture operates in a way that avoids the need for and may be substantially free of any requirements for users to download specific collaboration software, for users to adjust firewall settings, for users to have access to a network with a high bandwidth for uploading, for users to have access to a stable network, for users to create a continuous link (e.g., with a message bus server), or any combination thereof. It has been realized through the teachings herein that collaboration is possible for mass scale use by users having a wide variety of hardware and software by virtue of a unique approach to data management that involves serialization of data in a manner that is can be transmitted between users (e.g., via one or more servers). Serialization may be performed by suitable software that functions to convert an object into a string using Hypertext Transfer Protocol (HTTP).
[0030] It will be appreciated that the system and methods described herein may be employed in a broad range of collaborative web applications. Without limitation, the collaborative web applications which may take advantage of the present invention include co-browsing, working together on documents, viewing a map together, conducting a sales or marketing session, filling in a form together, shared text editing, shared viewing of still or video images, live presentations, viewing 3D models together, collaborative shopping, shared drawing of documents, shared operation of calculators, shared technical or financial analysis, shared educational testing or review of educational information or tests, or any combination thereof. For example, the present invention may enable synchronized co-browsing between multiple web browser clients (i.e., users), using collaborative web applications, the teachings thus contemplate collaboratively accessing, modifying, navigating, or otherwise observing one or more file or other item for word processing, browsing the internet, spreadsheet calculating, database sorting, image viewing, form filling, and the like.
Network environment
[0031] Referring to the drawings, FIG. 1A illustrates an exemplary network environment in which the present invention may be utilized. Although FIG. 1A illustrates a network environment 10 with a plurality of users (e.g., a first user and three second users), it will be appreciated that the invention is operable with any number of users. Users herein generally contemplate a computer device. In FIG. 1A, a plurality of users including a first user 20, and one or more second users 22 are coupled to a data communication network 12. The data communication may be any network capable of connecting the users (e.g., via electronic signaling, radio frequency signaling, or otherwise). A preferred data communication network is a network that includes or consists essentially of the internet (i.e., the network supporting the World Wide Web). The network environment 10 may include one or more computer servers. For example, the network environment may include a server system that includes an application server component 14, a plug-in server component 16, and a message bus server component 18. A user may be connected to a display device 24, an input device 26, an output device 28, or any combination thereof. The application server 14 may be employed to host and/or deliver a synchronization framework to the first user 20, to the one or more second users 22, or preferably both. The plug-in server 16 may be employed to host and/or deliver one or more plug-ins to the first user 20, to the one or more second users 22, or preferably both. The message bus server 18 may be employed for synchronizing one or more plug-ins of the first user 20 and one or more second user 22, or preferably of the first user 20 and all of the second users 22.
[0032] It will be appreciated that a single server may perform the functions of two or more of the message bus server, the application server, and the plug-in server. For example, the system may include a single server that includes the message bus server component, the application server component, and the plug-in server component. It is further contemplated that two or more of the server components can be distributed among two or more servers. [0033] With reference to FIG. 1B, it will be appreciated that the first user and the one or more second users may be any device capable of receiving the synchronization framework, communicating with the message bus server, or preferably both. By way of example, the one or more users may individually and separately each be a computer (such as a desktop computer 22', 20', or a laptop computer 22"), a mobile phone 22'", a personal digital assistant, or an electronic tablet. The input device may be any device capable of being manipulated by an operator of the user for inputting an object into a plug-in. By way of example, the inputting device may be a keyboard 26", a pointing device 26', a microphone, and the like, or any combination thereof. The output device may include a memory storage device 28'" (such as an optical disk reader/writer, a magnetic disk reader/writer, or a memory card reader/writer), a printer 28', a speaker 28", and the like, or any combination thereof. [0034] Embodiments of the present invention enable synchronized co-browsing between multiple web browser clients, using collaborative web applications.
[0035] The term "web applications" as used herein may encompass plug-ins, add ons, consoles, applications, programs, or additional software that is required to execute a transaction or function via a web browser.
[0036] The deployment architecture of the synchronized collaboration system (e.g., the synchronized co-browsing system) may be based upon a plug-in model, wherein applications plug-in to the synchronization framework. The applications may include public applications, custom-made applications, tailored applications or any combination thereof. [0037] The deployment architecture of the synchronized collaboration system (e.g., the co- browsing system) may be based upon a synchronization framework that utilizes or implements, at least partially, a supplier/consumer model notification service. By way of example an exemplary supplier/consumer model notification service that may be employed is a Common Object Request Broker Architecture (i.e., CORBA) Notification Service. Other notification services. Preferably, the notification service may be used to provide an architecture where each side or user implements, a notification supplier element (e.g., for supply events) and a notification consumer element (e.g., for consume events). The remaining framework may provide a "channel" that takes care of distributing the events in a way that is transparent to the modules (e.g., plug-ins) which communicate through it. In one example, the work flow can be summarized as:
Supplier (Push) -» Channel -> Consumer (pull). [0038] Reference is now made to FIG. 8, which is a schematic block diagram illustration of an exemplary system for synchronizing collaborative web applications which may be used. As can be seen in Fig. 8, the system may include an application server 162, a plug-in server 164, a message bus server 194, and a plug-in application infrastructure functioning on multiple client devices. The application server 162 may serve or deliver application infrastructures to clients (i.e., to users). The application infrastructure on a client are hereinafter referred to as containers. For example, a container may serve as the "container" application for both the first user (e.g., presenters) and the one or more second users (e.g., the viewers). As another example, the container for the first user may be different than the container for the second user. Preferably, the container for the first user has one or more functionalities that is not in the container for the second user. By way of example, the first container may include functionality to invite operators to join a collaborative session, to allocate an editing control to one or more other users, to remove a user from a collaborative session, to reallocate an editing control away from a user, or any combination thereof. The viewers may be an audience to the presenter. It will be appreciated that the first user may switch roles with another user so that a second user is a presenter and the first user is a viewer. The container may be remotely stored on the application server. For example, the container may be a scripting language file or application, such as an AS3 (ActionScript 3) application, or other suitable application, that may be loaded from the application server to the presenter browser 166 and viewer browser 168, to provide a framework or container for the synchronized application to each user. Of course, other structures, elements or components may be used. Preferably, during a collaboration session, the container resides in the volatile memory of a user, and there is no need to store the file or application (e.g., the Action Script 3 file or application) in the non-volatile memory of user, before the session, during the session, or any combination thereof. Preferably, a user does not need to store the container file or application before, during and after the collaboration session. The presenter container 170 in the presenter browser 166, may include a presenter container application programming interface (API) 186 and a network layer 188. The viewer container 172 in the viewer browser 168, may include a viewer container application programming interface (API) 190 and a network layer 192.
[0039] The plug-in server may be used to configure and supply plug-ins to users. For example, the plug-in server may be any web server that hosts a plug-in. The plug-in may be an "executable" application. For example, the plug-in may be coupled with an XML "descriptor", where the descriptor includes information on how the plug-in is used. Without limitation, the descriptor may include information such as what is the text in the menu that describes it, and what parameters it requires from the container to work properly. A plug-in may be a public plug- in. Alternatively, a user may write his or her own plug-in, place it on a server and use it in the session. Such plug-ins may be custom made (tailor made) applications. Some or all of the plug- in architecture may be from a set of documented public APIs, which the users/customers of the system can use to develop their own collaborative applications as plug-ins. It will be appreciated that a user may develop a plug-in that may interact with their servers and databases etc., place a plug-ins on their servers, use a plug-in in a collaborative session (e.g., with a customer), or any combination thereof.
[0040] During a collaboration session, the container may act as a host to one or more plug-in applications. The container may provide the one or more plug-in applications with a channel of communication that allows the plug-ins to communicate with remote instances (e.g., one or more, or all of the other users). The communication with remote instances may be as if they were running on the same computer. The communication with another user may be by a simple method invocation. For example, the plug-in may interact with the container using two functions. The first function is a supply notification which may pass an object to the container so that the container may distribute it (e.g., via the message bus server) to all other instances of the plug-in that run on the other users. By way of example, an operator of the presenter may make a change to a plug-in using an input device, the plug-in may capture the change as an object and pass the object to the container so that it can be packaged and sent to the viewers. The second function is a consume notification which may be invoked by the receiving end container. The consume notification may function by passing a "clone" of the object that was sent. For example, a second user (e.g., a viewer) may pass a clone of an object sent by a first user (e.g., a presenter) to the plug-in in the container of the second user, so that the plug-in of the first user and the second user are synchronized. It will be appreciated that an object may be any object. For example the object may be an object of a complex structure. Without limitation, the object may be a vector, a text, a size, a color, a sound, a direction, a line, a combination of many lines, a width, a location (such as a position of a cursor or pointing device), or any combination thereof.
[0041] The container may provide one or more session-level collaboration functionalities. Any session-level collaboration functionality may be provided. By way of example, session-level collaboration functionality that may be provided include, for example: showing the mouse location of one or more, or even all users; enabling textual chat; loading/unloading plug-ins (add / close tabs); providing a handing-over-control mechanism, whereby the presenter can give any viewer the ability to act as the presenter role, including adding new plug-ins or acting as presenter in plug-ins; sending usage statistics to the application server, informing the various plug-ins about status or changes in life-cycle events, and the like, or any combination thereof. , Examples of status or changes in life-cycle events that may be provided between collaborators include, when a plug-in is active, in-focus, out-of-focus, terminated, and the like. By way of example, usage statistics that may be sent to the application server include how many participants used the plug-ins and for how long and their geographical locations. [0042] It will be appreciated that the container may host any number of plug-ins. For example, the container may host one plug, the container may host more than one plug-in, the number of plug-ins that the container hosts may change over time, or any combination thereof. [0043] The container may provide a supplier/consumer model notification service, such as a plug-in application that "supplies" a notification object in the browser of one user and consumes it in the browser of a different user. The container may further provide the mouse location of one or more, or even all of the participants (i.e., all of the users. For example, the mouse location of the presenter or first user may be shown in the containers of all of the other participants. The container may provide a Toolbox that includes one or more tools or functions for collaborative or co-browsing. Exemplary toolbox tools include a pen, an eraser, a highlighter, a save function, a save to-pdf function, a undo function, a redo function, or any combination thereof., etc. The container may also provide a Tab mechanism that manages many plug-ins at the same time and "informs" the various plug-ins about status or changes in "life-cycle events", for example, when they are active, in-focus, out-of-focus, terminated etc. An example of a schematic container structure may be seen with reference to FIG. 9.
[0044] In general, the container may provide a plug-in API that allows the plug-ins to run in a synchronized mode on the web browser of two or more users (e.g., the presenter's and viewers' web-browsers). For example, the plug-in API may be a public plug-in API, such as a documented public API, written in AS3 that enables creation of a "synchronized application". It will be appreciated that other high-level programming languages that run inside a "player" plugin (as opposed to JavaScript that is run by the browser itself) may be used, such as Flash Player, Microsoft SilverLight and Java.
[0045] The message bus server (MB) is a web application that provides synchronization capabilities and routs messages from / to session users. Any protocol that provides synchronization capabilities may be employed. The MB may implement a publish-subscribe / mailbox architecture in random access memory (i.e., RAM). Access to the MB may be achieved using Hypertext Transfer Protocol (i.e., HTTP). Other protocols that provide synchronization capabilities and object synchronization functionality may be used, such as Remote Shared Objects using Real Time Messaging protocol (i.e., RTMP). Advantageously, according to the MB implementation using HTTP, firewall/NAT/proxy traversal is enabled. In contrast, typical usage of RTMP generally fails on many firewall/NAT/proxy configurations without specific configuration. Even when RTMP is "tunneled" through HTTP it generally fails since many firewalls that inspect the application layer will block it. As such, the processes and systems of the present invention preferably avoid using RTMP, tunneling HTTP, Transmission Control Protocol (i.e., TCP), or other protocols that may fail on firewall/NAT/proxy configurations without specific configuration.
[0046] With reference to FIG. 4, an operator of a user may make a change to a plug-in. The plug
[0047] Further advantages of using HTTP, include the ability to synchronize plug-ins even when the a user has an unstable internet connection and the ability to synchronize plug-ins even when the bandwidth available by a user for uploading is generally low. For example, synchronizing may be accomplished even when the band width available for uploading is less than 20 kbytes/second, less than about 6 kbytes/second, or even less than about 3 kbytes/second. Of course, high band widths (i.e., greater than about 6 kbytes/second or even greater than about 20 kbytes/second may also be used. This contrasts with RTMP connections, which require significantly higher upstream bandwidth.
[0048] Collaborative functionality in web applications may be implemented by using a synchronized application. For example, the synchronized application may be a plug-in to the container that can be loaded from any web server. The synchronized application preferably provides collaboration functionality (e.g., working together on documents, viewing Google maps together, conducting 1-on-1 selling session, filling forms together, text editing together etc.). The "synchronized application" preferably interacts with the "Container" using the "Public plug-in API".
[0049] FIG. 10 schematically illustrates a steps or processes that may be employed to enable synchronized collaboration (eg., co-browsing) between multiple web browser users. The process may include one or any combination of the following steps: the presenter browser (PB) requesting a container from the application server (AS); the viewer browser (VB) requesting a container from the AS; sending or downloading a container to the PB, the VB, or both; requesting by the presenter container (PC) a plug-in from the PS; receiving or downloading the plug-in from the PS by the PC; requesting by the viewer container (VC) a plug-in; the PC instructing the VC to load the plug-in; the viewer container (VC) requesting this plug-in from the PS; or the VC may receiving or downloading the plug-in from the PS.
[0050] As can be seen with reference to FIG. 11 , the objects synchronization can be implemented by one or any combination of the following steps: the Presenter Plug-in (PP) generating a "Notification", as a binary object, such as an AS3 object; the Presenter Container (PC) converting the object to a String using serialization to byte array and then base64 encoding; posting the notification to the Message Bus Dispatcher Module (MBD), (for example, as a Base-64 serialized object using HTTP) wherein the string may include addressing information like a session ID, user ID, or both; the MBD collecting the string and sending it to the Message Bus Mailbox Module (MBM); sending the messages to one or more target Mailboxes (e.g., according to a UniCast or Multicast addressing mode); sending a message polling request to the MBM, by the Viewer Container (VC); the MBM sending message list response to the VC; the VC converting the string using base-64 decoding back to a byte array and then back into an object using de-serialization; sending a Consume notification, as a binary object, to the Viewer Plug-in Application (VP); and consuming by the viewer machine or device the Notification, and performing according to the object's content. Any combination of the above steps may be implemented. Further, other steps or series of steps may be used. [0051] It will be appreciated that the processes do not include a step of streaming or otherwise sending desktop information of one user to another user (e.g., from the presenter to the audience). Instead the particular object being worked on may be dispatched to the network of current users, such that the delta or changes in application state indicated by the object being dispatched can be rapidly and effectively sent to all instances or session participants, (e.g., using a standardized remote procedure call technology). The synchronization is facilitated by the usage of containers, to contain the applications and plug-ins being used for collaboration. The amount of information needed to be communicated between the users is thus minimized and may include substantially of (or even entirely of) the object deltas. In this way the containers enable connectionless (e.g., communication without a permanent link) notifications over HTTP, to facilitate effective synchronized collaboration (e.g., synchronized co-browsing) using collaborative web applications.
[0052] The deployment architecture and system for synchronizing collaborative web applications may enable deployment of spontaneous online-web-meetings for mass audiences. The methods of the present invention advantageously may be web-based, consume very low bandwidth (e.g., less than about 3 kbytes/second of upstream), be very rich in functionality due to its plug-in architecture that allows rapid deployment of applications (e.g., custom-made synchronized applications), or any combination thereof. The system and process of the present invention may be adapted to enable spontaneous initiation of a session, without significant downloading of applications or data; without the need to install and setup software in advance (e.g., as a popular browser plug-in may be used), or both. The system and process of the present invention may enabling the service to be utilized by mass audience (e.g., including users of relatively low capacity machines and/or data networks). It will be appreciated that the since the system is Web based and requires no installation of software or code, the platform may serve the masses of users, and may serve large audiences simultaneously without significant networking changes. Further, since the system consumes very low bandwidth, this may enable high level service provision to all customers, including those with low quality internet-connections, and there is no intrinsic need to add significant server power when the service is used by many concurrent users.
[0053] Further technological advantages include one or any combination of the following: no need for firewall or network address translation (i.e., NAT) configuration, (e.g., which may prevents a large audience of corporate users and people in large academy campuses from using the service); easy customization, allowing rapid deployment of tailored solutions and personalized look-and-feels for collaborative applications supplied to various market segments; easy deployment of customized collaborative applications by third parties that develop plug-ins (preferably using the documented plug-in API) and optionally deploy them from their own webservers; or easy integration with existing web-sites, since customized collaborative applications may access various IT infrastructures.
[0054] Examples of synchronized applications that may run as plug-ins include: viewing documents together (e.g., implemented by uploading documents to the application server, converting the documents to Flash format files, downloading the flash format files to all participants, and presenting the documents and changes using a shared plug-in that renders the documents); collaborative form filling; shared text editing; shared video watching (e.g., Youtube or any other Flash format video stored on any server) (e.g., where the presenter and viewers will be fully synchronized so that all users can see exactly the same thing, when the presenter pauses, searches, highlights, edits, and the like; co-browsing (e.g., co-browsing of a map service such as Google maps); live presentations; viewing 3D models together; synchronized shopping carts; and using any type of calculator or financial analysis application. [0055] Elements from external services, such as www.lnteractive-Host.com, www.verishow.com and www.showdocument.com etc., may be integrated into the collaborative web browsing system. An external service may be integrated to enable one or more of: instant collaboration web-meeting sessions with, for example, form-filling tools, document sharing (e.g., an agent can load any document and immediately review it with a remote audience, using all MS-Office formats, pdf, text, images, videos, music etc. and annotate it etc.); deploy free co-browsing by an unlimited number of participants, same web-page loading on all participant's screens, including highlight and annotations etc.; usage of a variety of other collaborative applications like whiteboard, mutual text editor, watching YouTube videos etc., together in a synchronized way; using an open or Public API that enables any developer to create his or her own tailored collaborative applications, maintaining a document library on the server, for optional use during a session; optional Video and voice usage; capabilities of integration with other web-sites as "plug-ins" or "widgets" without any changes to the site itself; and providing a customized look and feel.
[0056] It will be appreciated that a presenter and a viewer may exchange roles during a session. For example, by the current presenter container may have a button or link to transfer presenter rights to another one of other users. The new presenter may then inherit some or all of the presenter rights, until the rights are again transferred (e.g., to others or to the original presenter).
[0057] It will be appreciated that there may be no limit to the number of "viewers" or users during a session. For example, 2 or more users may co-browse or collaborate. The number of users may be greater than about 5, greater than about 10, greater than about 50, or greater than about 100. It is even conceivable that thousands of users or more may collaborate, e.g., without substantially adding server or network resources.
[0058] A Plug-in may be loaded from any third party web server, although typically the plug-ins may be loaded from the Application Server.
[0059] In various aspects of the invention, a "Current Tab Status" is available for participants who join in the middle of a session so that they can see exactly what the others see. A tab is an instant of a plugin, for example: one document may be shared in a plug-in but multiple instances can be opened at the same time with different documents, as Tabs. Alternatively there may be a single whiteboard plug-in, but multiple whiteboard tabs. For example, the mechanism of current- tab-status may take care of situations where viewers join the session in the middle. When this happens, the framework may open all the open tabs of the presenter for them, and sets the open tabs at the same state. In one example, if a document is opened as a Tab, it will open on the same scroll position as the presenter. In another example, if a video is opened it may Fast- Forward to the frame where the presenter is. [0060] An operator of the first user may control who can edit a document in a plug-in. For example, the first user may be a presenter and a second user, or even all of the other users may be a viewer. As another example, the first user may control the ability of a second user to make a change (e.g., changes to a plug-in). As such the process may includes a step of passing a control to the second user so that the second user may make a change. [0061] The foregoing description of the embodiments of the invention has been presented for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed. It should be appreciated by persons skilled in the art that many modifications, variations, substitutions, changes, and equivalents are possible in light of the above teaching. It is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the invention.

Claims

What is claimed is:
Claim 1 : A computerized method for synchronizing collaborative network application between two or more users each having their own respective network browser and input device, comprising the steps of a) providing to each user access at least one server system that includes i) at least one message bus server component; ii) at least one application server component; and iii) at least one plug-in server component; b) delivering a first container from at least one application server component to the network browser of a first user; c) delivering a second container from at least one application server component to the network browser of a second user, the first container and the second container being the same as or different from each other; d) receiving one or more requests by a first user for a plug-in via the plug-in server component; e) delivering to the first container the plug-in from the plug-in server component; f) notifying the second user of the one or more requests by delivering notification through the message bus server component; g) delivering to the second user via the plug-in server component a plug-in compatible with the plug-in of the first user, so that the first and second user are each substantially simultaneously able to access compatible plug-ins and operate the plug-in in a coordinated substantially synchronized manner for modifying and/or observing a common file associated with the plug- ins; and h) following one or more modifications of the common file made by a first user, communicating to one or more of the other users, the one or more modifications, wherein the communicating is substantially contemporaneously with the modification, wherein the communicating takes place by i) converting the modification to a serialized string using HTTP in the container of the first user; ii) posting the serialized string to the message bus server; iii) cloning the serialized string for sending to the second users; iv) de-serializing the string to the modification in the container of the second user; and v) consuming the modification by the plug-in of the second user; so that the modification is delivered to the second user without interference by a firewall.
Claim 2: The method of claim 1 , wherein the process does not employ a continuous link between the second user and the message bus server.
Claim 3: The method of claim 1 or 2, wherein the users are each independently a computer, a mobile phone, a personal digital assistant, or an electronic tablet.
Claim 4: The method of any of claims 1 through 3, wherein the first container is different from the second container.
Claim 5: The method of any of claims 1 through 4, wherein the message bus server component implements a supplier/consumer notification service.
Claim 6: The method of any of claims 1 through 5, wherein the process includes: upon receiving a second change to the plug-in of the second user by the second operator via the input device of the second user, delivering from the second container to the message bus, a third notification including a characterization of the second change to the second plug-in; delivering the third notification or a modification thereof from the message bus to the first container; and updating the plug-in of the first container so that the plug-in of the first user and the second plug-in of the second user are synchronized.
Claim 7: The method of any of claims 1 through 6, wherein the process includes: storing a file including the first change or information about the first change; printing a document including the first change or information about the first change; or both.
Claim 8: The method of any of claims 1 through 7, wherein the process does not employ
HTTP tunneling between the message bus and the second user. Claim 9: The method of any of claims 1 through 8, wherein the first container is a scripting language application.
Claim 10: The method of any of claims 1 through 9, wherein the first container is an ActionScript application.
Claim 11 : The method of any of claims 1 through 10, wherein the co-browsing infrastructure includes a plurality of second users.
Claim 12: The method of any of claims 1 through 11 , wherein the first change includes one or more characters, a color, a size, a sound, a position or movement of a pointing device, a drawing including a straight, line, a curved line, or a surface, or any combination thereof.
Claim 13: The method of any of claims 1 through 12, wherein the second change includes one or more characters, a color, a size, a sound, a position or movement of a pointing device, a drawing including a straight, line, a curved line, or a surface, or any combination thereof.
Claim 14: The method of any of claims 1 through 13, wherein the process includes a step of sending a plurality of messages from a user to the message bus, wherein adjacent messages are spaced by a predetermined time interval.
Claim 15: The method of any of claims 1 through 14, wherein the first input device includes a keyboard, a mouse, a microphone, a touchpad, or a joystick.
Claim 16: The method of any of claims 1 through 15, wherein the plug-in is sent to a network layer of the first user using an HTTP protocol.
Claim 17: The method of any of claims 1 through 16, wherein the first change to the first plug-in is a complex object.
Claim 18: The method of any of claims 1 through 17, wherein the process includes a step of sending a plurality of messages from the message bus to a user, wherein adjacent messages are spaced by a predetermined time interval. Claim 19: The method of any of claims 1 through 18, wherein the message bus does not stream the messages.
Claim 20: The method of any of claims 1 through 19, wherein the first user, the second user or both includes an output device.
Claim 21 : The method of any of claims 1 through 20, wherein the first user, the second user or both includes a display, and the process synchronizing the appearance of a window on the display.
Claim 22: The method of any of claims 1 through 21 , wherein the first user includes a storage device, and the process includes a step of saving a file to the storage device, wherein the file includes an object sent from the second user to the first user via the message bus.
Claim 23: The method of any of claims 1 through 22, wherein the first container includes a network layer and an application programming interface (API) for plug-ins, and the first plug-in includes a notification supplier element of the first plug-in and a consume element of the plug-in, wherein the process includes passing an object from the notification supplier element of the first plug-in to the API of the first container, to the network layer of the first container to the message bus.
Claim 24: The method of any of claims 1 through 23, wherein the message bus includes a message bus dispatcher and a message bus mailbox module.
Claim 25: The method of any of claims 1 through 24, wherein the message bus mailbox module sends a message according to a unicast addressing mode.
Claim 26: The method of any of claims 1 through 25, wherein the message bus mailbox module sends a message according to a multicast addressing mode.
Claim 27: The method of any of claims 1 through 26, wherein a second user is established by receiving a web address for the application server component by the second user, and the second user connecting to the application server component in the web browser of the second user.
Claim 28: The method of any of claims 1 through 27, including uploading a document to the application server component, converting the document to a flash format, and sending the flash format of the document to the first and second user,
Claim 29: The method of any of claims 1 through 28, wherein the process does not employ a continuous link between the second user and the message bus server component.
Claim 30: The method of any of claims 1 through 29, wherein the process does not employ a TCP connection between the message bus and the second user.
Claim 31 : The method of any of claims 1 through 30, wherein the process does not employ a transmission control protocol (TCP) connection between the message bus serer component and the second user.
Claim 32: One or more computers that are programmed for performing the method of any of claims 1 through 31.
Claim 33: A file or document prepared by the method of any of claims 1 through 31 , wherein the file or document is electronically stored, printed, graphically displayed, or any combination thereof.
Claim 34: A system for synchronizing collaborative web applications by a first user and a second users using a collaborative infrastructure including: a) a data communication network; b) a message bus server component coupled to the data communication network; c) an application server component coupled to the data communication network; d) a plug-in server component coupled to the data communication network; e) a first user having a network browser and coupled to the data communication network; f) a second user having a network browser and coupled to the data communication network; wherein the application server component is configured for i) delivering a first container to the network browser of a first user, and ii) delivering a second container to a second user; wherein the plug-in server component is configured for i) delivering a plug-in to the container of the first user upon receiving a request for the plug-in from the first user; and ii) delivering a plug-in to the container of the second user upon receiving a request for the plug-in from the second user; wherein the message bus server component is configured for delivering notifications to the users other than the user that sent the notification; and wherein the first container is configured for converting modifications to a plug-in to a serialized string using HTTP.
Claim 35: A file or document prepared by the system of claim34, wherein the file or document is electronically stored, printed, graphically displayed, or any combination thereof.
PCT/US2010/029819 2009-04-05 2010-04-02 System and method for synchronizing collaborative web applications WO2010117909A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/754,118 US20100257451A1 (en) 2009-04-05 2010-04-05 System and method for synchronizing collaborative web applications

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US16676809P 2009-04-05 2009-04-05
US61/166,768 2009-04-05

Publications (1)

Publication Number Publication Date
WO2010117909A1 true WO2010117909A1 (en) 2010-10-14

Family

ID=42936513

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2010/029819 WO2010117909A1 (en) 2009-04-05 2010-04-02 System and method for synchronizing collaborative web applications

Country Status (1)

Country Link
WO (1) WO2010117909A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030018719A1 (en) * 2000-12-27 2003-01-23 Ruths Derek Augustus Samuel Data-centric collaborative computing platform
US20030041108A1 (en) * 2001-08-22 2003-02-27 Henrick Robert F. Enhancement of communications by peer-to-peer collaborative web browsing
US20050097440A1 (en) * 2003-11-04 2005-05-05 Richard Lusk Method and system for collaboration
US20070088707A1 (en) * 2004-09-15 2007-04-19 Scott Durgin Method for providing extensible software components within a distributed synchronization system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030018719A1 (en) * 2000-12-27 2003-01-23 Ruths Derek Augustus Samuel Data-centric collaborative computing platform
US20030041108A1 (en) * 2001-08-22 2003-02-27 Henrick Robert F. Enhancement of communications by peer-to-peer collaborative web browsing
US20050097440A1 (en) * 2003-11-04 2005-05-05 Richard Lusk Method and system for collaboration
US20070088707A1 (en) * 2004-09-15 2007-04-19 Scott Durgin Method for providing extensible software components within a distributed synchronization system

Similar Documents

Publication Publication Date Title
US9043386B2 (en) System and method for synchronizing collaborative form filling
US20100257451A1 (en) System and method for synchronizing collaborative web applications
US7933956B2 (en) System and method to create a collaborative web-based multimedia layered platform
Rai Socket. IO real-time web application development
US8464164B2 (en) System and method to create a collaborative web-based multimedia contextual dialogue
US8266214B2 (en) System and method for collaborative web-based multimedia layered platform with recording and selective playback of content
US8195768B2 (en) Remote slide presentation
US20120254454A1 (en) Image-based synchronization system and method
CN108886672A (en) Extension of message application program shop
CN107491296A (en) The message application docked with one or more extension applications
KR20140088123A (en) Real time document presentation data synchronization through generic service
EP3466023B1 (en) Interactive display synchronisation
WO2015077259A1 (en) Image sharing for online collaborations
US10642455B2 (en) User interfaces in a computer system
US20070011232A1 (en) User interface for starting presentations in a meeting
US20110029885A1 (en) Confidential Presentations in Virtual Worlds
Tung MediaBoard: A shared whiteboard application for the MBone
Martinez-Pabon et al. Smart TV-smartphone multiscreen interactive middleware for public displays
US8683608B2 (en) Communication method, display apparatus, moderator terminal apparatus, user terminal apparatus, and multi-user communication system including the same
Shurtz Application Sharing from Mobile Devices with a Collaborative Shared Display
TW201626257A (en) Networking cooperation method and machine using such method
Naber et al. Interactive display services for smart environments
WO2010117909A1 (en) System and method for synchronizing collaborative web applications
US20230353802A1 (en) Systems and methods for multi-party distributed active co-browsing of video-based content
Geyer et al. Integrating support for collaboration-unaware VRML models into cooperative applications

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10762246

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10762246

Country of ref document: EP

Kind code of ref document: A1