CN105100679A

CN105100679A - Server and method for providing collaboration service and user terminal receiving collaboration service

Info

Publication number: CN105100679A
Application number: CN201510270712.XA
Authority: CN
Inventors: 李在根
Original assignee: Samsung Electronics Co Ltd
Current assignee: Samsung Electronics Co Ltd
Priority date: 2014-05-23
Filing date: 2015-05-25
Publication date: 2015-11-25
Anticipated expiration: 2035-05-25
Also published as: CN105100679B

Abstract

Provided are a server, method and device for providing a collaboration service. The server comprises a memory configured to store a computer executable instruction, and a processor configured to process the computer executable instruction to provide a screen comprising a first region displaying a user's video and a second region displaying an editable document. The processor is further configured to process to the computer executable instruction to receive a selection for a time point of the video, and to provide the editable document according to a state corresponding to the selected time point of the video.

Description

The server of collaboration services and the user terminal of method and reception collaboration services are provided

The cross reference of related application

This application claims No. 10-2014-0062625, the korean patent application submitted in Korean Intellectual Property Office on May 23rd, 2014, U.S. Non-provisional Patent application 14/556 that on December 1st, 2014 submits in U.S.Patent & Trademark Office, No. 10-2015-0018870, the korean patent application that on February 6th, No. 616 1 submits in Korean Intellectual Property Office and the U.S. Non-provisional Patent application 14/705 of submitting in U.S.Patent & Trademark Office on May 6th, 2015, the priority of No. 147, is incorporated to whole disclosures of these applications here by reference for all objects.

Technical field

Some aspects of one exemplary embodiment relate to for providing the method for collaboration services (collaborationservice) and server and for asking the user terminal of collaboration services.

Background technology

Due to the progress of Science and Technology, such as various types of user terminals of smart phone, dull and stereotyped PC, desktop computer, laptop computer etc. and so on are improving and are becoming more superior.User terminal has been evolved into high-end multimedia equipment, and these equipment can be connected to network with the information of search on internet and send or receive file and seizure and playback photo or moving image.

Along with the development of user terminal, the demand of cloud computing is increased.Cloud computing refer to allow user information to be stored in server on the internet and at any time from Anywhere via user terminal access server to use the technology of the information of storage.In order to meet the demand to this increase of cloud computing, the application of various use cloud computing is just developed.

The progress of user terminal and cloud computing technology allow for multiple user and utilizes its terminal to be connected to server and perform same application or access identical information.

Summary of the invention

Some aspects of one exemplary embodiment comprise a kind of for providing the method for collaboration services and server and the user terminal for receiving collaboration services, these collaboration services allow for user collaboration ground Edit Document, its mode is by being synchronized to by the document of collaborative editing by the meeting summary of the speech production comprised based on the video call image be associated with each user, identifies contextual information to make user while collaborative editing document.

An other aspect part will be recorded in ensuing description, and a part will clearly from description manifest, or know by putting into practice the one exemplary embodiment provided.

According to the one side of one exemplary embodiment, comprise for providing the server of the collaboration services allowing user Edit Document: a communication unit, for receiving the video call image that is associated with each user of Edit Document from the user terminal of request collaboration services and about by the edit file of document of editing; Controller, for the details of the meeting summary of speech production that will comprise based on the video call image be associated with each user and the document-synchronization according to edit file editor; And memory, for storing details and the document of meeting summary.

According to the one side of one exemplary embodiment, a kind of providing allows the method for the collaboration services of user Edit Document to comprise: receive the video call image that is associated with each user of Edit Document and about by the edit file of document of editing from the user terminal of request collaboration services; By the details of the meeting summary of the speech production comprised based on the video call image be associated with each user and the document-synchronization according to the edit file editor received; And store details and the document of meeting summary.

According to the one side of one exemplary embodiment, a kind of for comprising from the user terminal providing the server of the collaboration services allowing user's Edit Document to receive collaboration services: audio/video input unit, for inputting the voice and video of user; User input unit, for receiving about by the edit file of document of editing; Controller, it obtains the video call image and edit file that are obtained by the voice and video executive signal process to user; Communication unit, obtained video call image and edit file are sent to server by it, and from server receive be associated with each user of Edit Document video call image, based on the meeting summary of the speech production comprised with the video call image that each user is associated and the document synchronous with the details of meeting summary; And output unit, it exports the video call image, meeting summary and the document that are associated with each user that receive.

According to the one side of one exemplary embodiment, provide by make based on the speech production comprised in the video call image be associated with each user meeting summary be convenient to the collaboration services of user to the collaborative editing of document by the document-synchronization of collaborative editing, thus allow for user identify contextual information while collaborative editing document.

According to the one side of one exemplary embodiment, providing that a kind of this server comprises: memory for providing the server of collaboration services, being configured to store computer executable instructions; And processor, being configured to process computer executable instruction provide to comprise the first area of the video of display user and display can the screen of second area of Edit Document.Processor is also configured to process computer executable instruction receive the selection of the time point to video, and provide according to the state corresponding with the time point selected by video can Edit Document.

Processor also can be configured to process computer executable instruction receive to can the selection of editor of Edit Document, and from the time point rendered video corresponding with selected editor.

Screen also can comprise the 3rd region, the 3rd region display and the time point of video with can the text entry of the corresponding project of the editor of Edit Document.

Processor also can be configured to process computer executable instruction receive the selection to project from the text entry of project, from the time point rendered video corresponding with selected project, and provide according to the state corresponding with selected project can Edit Document.

Processor also can be configured to the next text entry based on the speech production project of the user in video of process computer executable instruction.

Processor also can be configured to process computer executable instruction to be come based on user can editor's generating item object text entry of Edit Document.

Can be displayed in word processing program (wordprocessingprogram) by Edit Document.

According to the one side of one exemplary embodiment, provide a kind of for providing the method for collaboration services, the method comprise display comprise the first area of the video of display user and display can the screen of second area of Edit Document.The method also comprises and receives selection to the time point of video, and show according to the state corresponding with the time point selected by video can Edit Document.

The method also can comprise and receives can the selection of editor of Edit Document, and from the time point rendered video corresponding with selected editor.

The method also can comprise and receives to the selection of project from the text entry of project, and from the time point rendered video corresponding with selected project, and provide according to the state corresponding with selected project can Edit Document.

The method also can comprise the text entry of the speech production project based on the user in video.

The method also can comprise based on user can editor's generating item object text entry of Edit Document.

A kind of non-transitory computer-readable medium can comprise the computer-readable instruction that can perform the method.

According to the one side of one exemplary embodiment, provide that a kind of this terminal comprises display for providing the terminal of collaboration services, it is configured to show the first area of the video comprising display user and display can the screen of second area of Edit Document.This terminal also comprises: input equipment, is configured to receive the selection to the time point of video; And controller, being configured to control display, show according to the state corresponding with the time point selected by video can Edit Document.

Input equipment also can be configured to receive to can the selection of editor of Edit Document, and controller also can be configured to control display from the time point rendered video corresponding with selected editor.

Input equipment also can be configured to receive from the text entry of project the selection of project, and controller also can be configured to: control display from the time point rendered video corresponding with selected project, and control that display shows according to the state corresponding with selected project can Edit Document.

The text entry of project can be the speech production based on the user in video.

The text entry of project can be to can the editor of Edit Document generate based on user.

According to the one side of one exemplary embodiment, provide that a kind of this server comprises communication equipment for providing the server of collaboration services, it is configured to send the document that will show, and receives the selection of a part for the document to display.Server also comprises controller, its part being configured to the video determining the user that will show and the part of text item that will show, and this part of video and this part of text item correspond to the selected portion of the document of display.

Communication equipment also can be configured to send the video that will show, and receive the selection of another part of the video to display, and controller also can be configured to the another part of another part and the text item that will show determining the document that will show, and this another part of document and this another part of text item correspond to selected another part of the video of display.

Communication equipment also can be configured to send the text item that will show, and receive the selection of another part of the text item to display, and controller also can be configured to the another part of another part and the document that will show determining the video that will show, and this another part of video and this another part of document correspond to selected another part of the text item of display.

Accompanying drawing explanation

By below in conjunction with the description of accompanying drawing to one exemplary embodiment, these and/or other aspect will become clear and more comprehensible, in accompanying drawing:

Fig. 1 illustrates the environment for providing collaboration services;

Fig. 2 is the block diagram of the configuration of user terminal according to one exemplary embodiment;

Fig. 3 is the block diagram of the configuration of the server for providing collaboration services according to one exemplary embodiment;

Fig. 4 illustrates the controller of the server for providing collaboration services according to one exemplary embodiment;

Fig. 5 illustrates the image management processor in the controller of the server that can be included in for providing collaboration services according to one exemplary embodiment;

Fig. 6 illustrates the integrated management database (DB) in the memory of the server that can be stored in for providing collaboration services according to one exemplary embodiment;

Fig. 7 illustrates the user profile DB in the memory of the server that can be stored in for providing collaboration services according to one exemplary embodiment;

Fig. 8 illustrates the document D B in the memory of the server that can be stored in for providing collaboration services according to one exemplary embodiment;

Fig. 9 illustrates the image DB in the memory of the server that can be stored in for providing collaboration services according to one exemplary embodiment;

Figure 10 illustrates figure for providing the server of collaboration services to be implemented as multiple distributing server according to another one exemplary embodiment;

Figure 11 is the block diagram as the integrated management server for one of the distributing server providing collaboration services according to another one exemplary embodiment;

Figure 12 is the block diagram as the subscriber management server for one of the distributing server providing collaboration services according to another one exemplary embodiment;

Figure 13 is the block diagram as the document management server for one of the distributing server providing collaboration services according to another one exemplary embodiment;

Figure 14 is the block diagram as the image management server for one of the distributing server providing collaboration services according to another one exemplary embodiment;

Figure 15 illustrates while utilizing the server process document for providing collaboration services according to the process request performing collaboration services being initiated to collaboration services according to one exemplary embodiment;

Figure 16 performs the example of collaboration services according to the one exemplary embodiment user terminal requests illustrated for receiving collaboration services;

Figure 17 creates the example of group according to the one exemplary embodiment user terminal requests illustrated for receiving collaboration services;

Figure 18 performs the example of the management of group member according to the one exemplary embodiment user terminal illustrated for receiving collaboration services;

Figure 19 according to one exemplary embodiment illustrate while being processed at document, to initiate collaboration services to make user terminal get out Edit Document collaboratively time each user terminal state;

Figure 20 illustrates display on the user terminal for receiving collaboration services according to one exemplary embodiment and comprises the user interface of address window and menu and the method for video call image;

Figure 21 illustrates the method for display video call images on the user terminal for receiving collaboration services according to one exemplary embodiment;

Figure 22 illustrates the other method of display video call images on the user terminal for receiving collaboration services according to one exemplary embodiment;

Figure 23 illustrates according to one exemplary embodiment and utilizes for providing the server of collaboration services during video conference according to the process request performing collaboration services being initiated to collaboration services;

Figure 24 illustrates the example performing video conference before making the request to execution collaboration services in the user terminal for receiving collaboration services according to one exemplary embodiment;

Figure 25 illustrates the process selecting the document shared during video conference in the user terminal for receiving collaboration services before making the request to execution collaboration services according to one exemplary embodiment;

Figure 26 illustrates the example being presented at the document shared in video conference before making the request to execution collaboration services on the user terminal for receiving collaboration services according to one exemplary embodiment;

Figure 27 asks according to the one exemplary embodiment user terminal illustrated for receiving collaboration services the example performing collaboration services during video conference;

Figure 28 illustrates the state of each user terminal when initiating collaboration services to make each user terminal get out Edit Document collaboratively during video conference according to one exemplary embodiment;

Figure 29 illustrates according to one exemplary embodiment and from video call Computer image genration, the image of the summary (hereinafter referred to as meeting summary) of meeting is being shown for providing in the server of collaboration services and meeting summary is being sent to the process of each user terminal;

Figure 30 illustrates the example of display conference summary on each user terminal for receiving collaboration services according to one exemplary embodiment;

Figure 31 illustrates another example of display conference summary on each user terminal for receiving collaboration services according to one exemplary embodiment;

Figure 32 illustrates the process to the server request management group group membership and interoperable group for providing collaboration services according to one exemplary embodiment;

Figure 33 illustrates the example setting the information about each group member in the user terminal for receiving collaboration services according to one exemplary embodiment;

Figure 34 illustrates the example current group being divided into multiple group in the user terminal for receiving collaboration services according to one exemplary embodiment;

Figure 35 illustrates the state of each user terminal when current group is divided into multiple group;

Figure 36 illustrates according to one exemplary embodiment and is limiting just by the process of editor's scope of the document of collaborative editing for providing in the server of collaboration services;

Figure 37 illustrates the example being locked first editor's scope in the user terminal for receiving collaboration services by first user according to one exemplary embodiment;

Figure 38 illustrates the example of scope of being edited by the second Subscriber Locked second in the user terminal for receiving collaboration services according to one exemplary embodiment;

Figure 39 illustrates the example of scope of being edited by the 3rd Subscriber Locked the 3rd in the user terminal for receiving collaboration services according to one exemplary embodiment;

Figure 40 according to one exemplary embodiment illustrate in the user terminal for receiving collaboration services for the multiple area lockings first in page to the 3rd editor scope example;

Figure 41 illustrates the process of Edit Document collaboratively in the server for providing collaboration services according to one exemplary embodiment;

Figure 42 to illustrate in the user terminal for receiving collaboration services by first user editor by the example of the document of collaborative editing according to one exemplary embodiment;

Figure 43 illustrates according to one exemplary embodiment and edits by the example of the document of collaborative editing by the second user in the user terminal for receiving collaboration services;

Figure 44 illustrates according to one exemplary embodiment and utilizes meeting summary to identify just by the example of the edit file of the document of collaborative editing in the user terminal for receiving collaboration services;

Figure 45 illustrates according to one exemplary embodiment and utilizes meeting summary to edit by the example of the document of collaborative editing in the user terminal for receiving collaboration services;

Figure 46 illustrates following example according to one exemplary embodiment: for receiving in the user terminal of collaboration services, for just by each set device in the image of the document of collaborative editing, video call image and meeting summary to utilize other equipment to user terminal registration separately to show these images;

Figure 47 illustrates according to one exemplary embodiment and separately shows just by the example of the document of collaborative editing, video call image and meeting summary on multiple equipment;

Figure 48 illustrates by stopping collaboration services to for providing the server request of collaboration services to stop collaboration services and the document of collaborative editing be sent to the process of another user terminal according to one exemplary embodiment;

Figure 49 according to one exemplary embodiment illustrate document for examining, for the video call image examined and for the meeting summary examined by example synchronized with each other;

Figure 50 illustrates to the document for providing the server request of collaboration services for examining according to one exemplary embodiment and examines the process of the editor of document;

Figure 51 illustrates following example according to one exemplary embodiment: when being selected by edit segment of the document for examining, all with selected by synchronous being output in the user terminal for receiving collaboration services for the meeting summary examined and the video call image for examining of edit segment;

Figure 52 illustrates to the video call image for providing the server request of collaboration services for examining according to one exemplary embodiment and examines the process of the editor of document;

Figure 53 illustrates following example according to one exemplary embodiment: when the video call image for examining want a reproduced part to be selected time, all with being output in the user terminal for receiving collaboration services for the meeting summary examined and the document for examining of selected reproduced Partial synchronization;

Figure 54 illustrates to the meeting summary for providing the server request of collaboration services for examining according to one exemplary embodiment and examines the process of the editor of document;

Figure 55 illustrates following example according to one exemplary embodiment: when the text in the meeting summary for examining is selected, all with being output in the user terminal for receiving collaboration services for the video call image examined and the document for examining of selected context synchronization;

Figure 56 is the flow chart providing the method for collaboration services according to one exemplary embodiment; And

Figure 57 is the flow chart of the method for reception collaboration services according to one exemplary embodiment.

Embodiment

To refer to embodiment in detail now, the example of embodiment illustrates in the accompanying drawings, and label similar in accompanying drawing refers to similar element all the time.At this, present example is provided to make the disclosure will be thorough and complete, and should not be construed as limited to description described herein.Thus, be only one exemplary embodiment is described with reference to the drawings so that each side of this description to be described below.Those of ordinary skill in the art are to describe and the one exemplary embodiment variant of easily inferring or combination are regarded as in the scope of inventive concept.The statement of such as " ... at least one " and so on modifies whole element list when before the list of element, and does not modify the individual element of volume in list.

Should also be understood that term " comprises " existence defining described element, assembly, step and/or operation when using in this manual, but do not get rid of one or more element, assembly, the existence of step and/or operation or interpolation.

Although in addition, it should be understood that and term " first ", " second " etc. can be used herein to describe various element and/or assembly, these elements and/or assembly should not limit by these terms.These terms are just for distinguishing an element or assembly and another element or assembly.

Present example relates to for providing the method for collaboration services and server and the user terminal for receiving collaboration services, and omits the detailed description to well known to a person skilled in the art function or structure in this article.

Fig. 1 illustrates the environment for providing collaboration services.

Collaboration services refers to the class service provided to these users when multiple user's coordination with one another performs the particular task pursuing same target.In the collaboration services allowing multiple user collaboration Edit Document, can be used as a class collaboration services for the documentation program of the communication between collaboration user or instrument and be provided to user.In the case, can be at the document for providing executable any kind on the server 100 of collaboration services by the document of collaborative editing, regardless of its type or content.Such as, the document can comprise text or content of multimedia.

Server 100 can be allow each user and various types of application of other user collaborations and the server of data for storing.Server 100 both also can perform telecommunication by executive board's field communication.Server 100 also can be connected to multiple user terminal 200 via network.

User terminal 200 can be the various types of subscriber equipmenies that can be used for being connected with server 100.Such as, user terminal 200 can be can perform the smart phone of wired or wireless communication, dull and stereotyped PC, desktop computer or laptop computer with server 100.In addition, user terminal 200 can be configured to catch and rendered video call images with the subscriber equipment allowing the user of collaborative editing document to participate in video conference.

In an exemplary embodiment, Edit Document can be included in interpolation in document, image, video, application etc., removes, revise and/or formatted text, object, image, figure etc.But editor is not limited to above-mentioned one exemplary embodiment, and other operations that document is performed can be comprised.

In an exemplary embodiment, collaborative editing can comprise by multiple user simultaneously or in a sequence Edit Document, or can not only comprise by Edit Document while of multiple user but also comprise by multiple user sequentially Edit Document.But collaborative editing is not limited to above-mentioned one exemplary embodiment, and other collaborative editings that document is performed can be comprised.

Fig. 2 is the block diagram of the configuration of user terminal 200 according to one exemplary embodiment.One of ordinary skill in the art will appreciate that user terminal 200 also can comprise other common assemblies except those shown in Fig. 2.In assembly shown in Fig. 2 each can according to reality realize user terminal 200 specification by integrated, add or omit.In other words, if necessary, two or more assemblies can be combined into single component, or single component can be divided into two or more assemblies.

With reference to figure 2, controller 210, user input unit 220 can be comprised (such as according to the user terminal 200 of the present embodiment, user input), audio/video input unit 230 (such as, audio/video input), communication unit 240 (such as, communicator) and output unit 250 (such as, exporting).

Controller 210 can control the part that display unit 251 shows the content be stored in memory (not shown).Or when user performs manipulation on the region of display unit 251, controller 210 can perform the control operation corresponding with this manipulation.

Although not shown in fig. 2, controller 210 can comprise at least one selected from the following: random access storage device (RAM), read-only memory (ROM), CPU (CPU), Graphics Processing Unit (not shown) and data/address bus.RAM, ROM, CPU and Graphics Processing Unit (GPU) can be connected to each other via data/address bus.

CPU reference to storage (not shown) and utilize and store operating system (O/S) in memory and perform startup.CPU also utilizes storage various types of programs, content and data in memory to perform various operation.

ROM stores Management Information Base and carrys out start up system.Such as, when input open command and when supplying electric power, CPU copies in RAM according to the order stored in ROM the O/S stored in memory, performed O/S and start up system.When startup completes, CPU in RAM, performs the various procedural copy stored in memory the program be copied in RAM, and performs various operation.In detail, GPU can generate screen, and the electronic document comprising the various objects of such as content, icon and menu and so on is shown on the screen.Each object's property value that GPU will show according to the layout calculation of screen, such as coordinate figure, shape, size and color.GPU also can create based on the property value calculated the screen comprising the various layouts of object.The screen that GPU creates can be provided to display unit 251, is displayed on each region of display unit 251 to make it.

Controller 210 controls video processor (not shown) and audio process (not shown) and to process in receiving via communication unit 240 video data and voice data that comprise in the content stored in perhaps memory respectively.

User input unit 220 can receive various order from user.User input unit 220 can comprise at least one selected from keypad 221, touch panel 223 and pen identification panel 225.

Keypad 221 can be included in various types of keys that the various regions of the such as front surface of the main body of user terminal 200, side surface and rear surface and so on provide, such as mechanical button, roller etc.

Touch panel 223 can detect the touch input of user and export the touch event value corresponding with the touch signal detected.When touch panel 223 and display floater (not shown) combined to form touch-screen (not shown) time, this touch-screen can be implemented as various types of touch sensor, such as condenser type, resistance-type and piezoelectric type touch sensor.Capacitive touch sensors uses the dielectric material covered on the surface of touch-screen.When the part of the health of user touches this touch-screen surperficial, capacitive touch sensors detects micro-electricity of being caused by this part of the health of user and calculates touch coordinate.Resistive touch sensor comprises two battery lead plates be embedded in touch-screen.When specified point in user's touch screen, power-on and power-off pole plate comes in contact at touch point place.Resistive touch sensor detects the electric current that caused by the contact of two battery lead plates and calculates touch coordinate.Touch event on touch-screen can utilize the finger of people to generate mostly.But touch event also can occur via the object that the electric conducting material of the change of electric capacity can be caused to be formed.

Pen identifies that panel 225 is according to felt pen (such as, pointer or digitizer pen) manipulation sensing pen close to input or touch input, and export to input with the pen sensed close or touch and input corresponding pen close to event or stylus touch event.Pen identifies that panel 225 can utilize electromagnetic resonance (ElectroMagneticResonance, EMR) technology to realize, and according to by pen close to or the variation that touches the intensity of electromagnetic field caused carry out sensing touch and to input or close to input.Specifically, pen identification panel 225 can comprise the electromagnetic induction coil transducer (not shown) with network provides the electric signal processor (not shown) exchanging (AC) signal with preset frequency with the loop coil sequentially to electromagnetic induction coil transducer.When the pen wherein with resonant circuit is positioned to the loop coil near pen identification panel 225, generate electric current from the magnetic field that loop coil sends based on the mutual electromagnetic induction the resonant circuit of pen.Induction field is created from the coil of the resonant circuit pen based on this electric current.Pen identifies that panel 225 senses from this induction field of the Data mining be in Signal reception state the position of point that pen is kept to be close to and to touch subsequently.Pen identifies that panel 225 can be disposed in below display floater and to have sufficient area to cover the viewing area of display floater.

Audio/video input unit 230 can comprise microphone 231 and shooting unit 233.Microphone 231 receives the voice of user or other sound and converts the voice of user or other sound to voice data.The voice of the user inputted via microphone 231 can be used for video conference by controller 210, or voice data can be stored in memory.Shooting unit 233 can according to the static or moving image of control shooting of user.Shooting unit 233 can utilize multiple camera to realize, such as Front camera and rearmounted camera.

When audio/video input unit 230 comprises microphone 231 and shooting unit 233, controller 210 can utilize via the voice of the user of microphone 231 input with by taking the video of the user that unit 233 identifies to generate video call image.

User terminal 200 can operate in motion control pattern or Voice command pattern.When user terminal 200 operates in motion control pattern, controller 210 can activate shooting unit 233 to take user, follows the tracks of the change of the motion of user, and performs the control operation corresponding with this change.When user terminal 200 operates in Voice command pattern, controller 210 is analyzed the voice of the user inputted via microphone 231 and is carried out executive control operation according to the voice of analyzed user.

Communication unit 240 can according to various types of communication means and dissimilar external equipment executive communication.Communication unit 240 can comprise at least one selected from Wireless Fidelity (Wi-Fi) chip 241, Bluetooth chip 243, near-field communication (NFC) chip 245 and wireless communication chips 247.Controller 210 can via communication unit 240 and various external device communication.

Wi-Fi chip 241 and Bluetooth chip 243 can utilize Wi-Fi and Bluetooth technology to carry out executive communication respectively.Use the communication unit 240 of Wi-Fi chip 241 or Bluetooth chip 243 can send or receive the link information of such as service set identifiers (SSID) or session key and so on and utilize link information establish a communications link after send or receive various types of information.NFC chip 245 refers to the chip utilizing the NFC technique that the 13.56MHz frequency band among various radio-frequency (RF) identification (RFID) frequency band comprising 135kHz, 13.56MHz, 433MHz, 860 to 960MHz and 2.45GHz operates to carry out executive communication.Wireless communication chips 247 refers to carrys out the chip of executive communication according to the various communication standards of such as institute of Electrical and Electronic Engineers (IEEE), Zigbee, the third generation (3G), third generation partner program (3GPP) and Long Term Evolution (LTE) and so on.

Output unit 250 can comprise display unit 251 and loud speaker 253.

Display unit 251 can comprise display floater (not shown) and the controller (not shown) for controlling display floater.The example of display floater can comprise liquid crystal display (LCD), Organic Light Emitting Diode (OLED) display, Activematric OLED (AM-OLED), Plasmia indicating panel (PDP) and other various displays.Display floater can be formed as flexible, transparent or wearable display.Display unit 251 can be combined to form touch-screen (not shown) with the touch panel 223 of user input unit 220.Such as, touch-screen can comprise integrated module, wherein display floater and touch panel 223 combined to form hierarchy.

The exportable voice data generated by audio process (not shown) of loud speaker 253.

The said modules of user terminal 200 can be endowed and those different titles above-mentioned.In addition, at least one in said modules can be comprised according to the user terminal 200 of the present embodiment.User terminal 200 can not comprise some in these assemblies or can also comprise extra assembly.User terminal 200 performs following operation by using at least one in said modules.

For receiving the voice and video of user from the user terminal 200 for providing the server 100 of collaboration services to receive collaboration services via audio/video input unit 230 and receiving about by the edit file of the document of collaborative editing via user input unit 220.In an exemplary embodiment, utilize in word processing program, spreadsheet program, lantern slide program, demonstration program, animation program, graphic package, note taking program, organizer program and other similar programs one or more come Edit Document collaboratively.Edit file can comprise the information for Edit Document, and can comprise at least one such as selected from the following: text message, image information, form data, copy information, stickup information, word space information, line space information, word size information, colouring information and other various information relevant with the editor of document.

The controller 210 of user terminal 200 can obtain the video call image and edit file that are obtained by the voice and video executive signal process to user, and video call image and edit file are sent to server 100.Communication unit 240 receives with the video call image that each user of collaborative editing document is associated from server 100, illustrates based on the image of the summary (hereinafter referred to as " meeting summary ") of the meeting with the speech production that the video call image that each user is associated comprises and synchronous just by the document of collaborative editing with meeting summary.Output unit 250 exports the video call image be associated with each user, the meeting summary and just by the document of collaborative editing that receive.Meeting summary can be as comprise from about meeting text, comprise the information that the image about at least one selected the document of the text of meeting and chart exports.In addition, meeting summary can comprise the speech production based on user text, generate the temporal information of the time of each text and be supplied to the page information of collaborative editing document of user, this user says the text when text is generated.In other words, the details of meeting summary can comprise at least one selected from text, temporal information, page information and image information.

In an exemplary embodiment, the editor of document can be indicated by corresponding designator, and this designator can be mark, highlighted, object, icon or one or more from the image of video call image, and described image is such as the thumbnail image of user.

In addition, because meeting summary and document are synchronized with each other, so can along with the change in another one for user's input of at least one in meeting summary and document.Such as, communication unit 240 can be sent to server 100 the information of the text selected from meeting summary about user, and in response to this transmission, receive about with by select the document of context synchronization by the information of edit segment.Output unit 250 subsequently exportable with by select the document of context synchronization by edit segment.

Meeting summary can be the text entry of the project of speech production based on the user in video.Meeting summary also can be to can the text entry of project that generates of the editor of Edit Document based on user.

Fig. 3 is the block diagram of the configuration of the server 100 for providing collaboration services according to one exemplary embodiment.One of ordinary skill in the art will appreciate that server 100 also can comprise other common assemblies except those shown in Fig. 3.According to the actual realization of server 100, each assembly shown in Fig. 3 can by integrated, add or omit.In other words, if necessary, two or more assemblies can be combined into single component, or single component can be divided into two or more assemblies.

Communication unit 110 can with the external equipment executive communication comprising user terminal (200 in Fig. 2).Such as, allow to receive the various requests relevant with collaboration services from user terminal 200 to the server 100 of the collaboration services of the collaborative editing of document for providing, comprise the request to initiating collaboration services, create cooperative work environment necessary set information, and about by the edit file of the document of collaborative editing.In addition, in response to the various requests relevant with collaboration services, server 100 can provide with collaboration services relevant all items are provided.

Controller 130 can perform and control the entirety of server 100.Controller 130 obtains the information and request the information received and request being stored in memory 150 that receive via communication unit 110.Memory 150 can comprise storage device or database.Controller 130 also can process the information and request that receive.Such as, controller 130 can be created on the image that will use in collaboration services or the process performed for managing the information received based on the information received from the 4th user terminal (600 in Figure 48).In addition, in response to obtained request, controller 130 can be sent to user terminal 200 by providing the necessary information of collaboration services.

Controller 130 can perform the holistic management of the video call image be associated with each user of collaborative editing document, the meeting summary of speech production comprised based on video call image and the document according to the edit file collaborative editing received.Video call image, meeting summary and document are used in collaboration services.Such as, controller 130 can perform the video call image, meeting summary and the bookkeeping such as generating, store, process and delete and so on just by the document of collaborative editing that are associated with each user.The controller 130 of server 100 is described in more detail referring now to Fig. 3 and Fig. 4.

Fig. 4 illustrates the controller 130 of the server 100 for providing collaboration services according to one exemplary embodiment.With reference to figure 3, the controller 130 of server 100 can comprise integrated management process device 131, user management processor 133, document management processor 135 and image management processor 137.One of ordinary skill in the art will appreciate that controller 130 also can comprise other common assemblies except those shown in Fig. 4.Controller 130 can comprise multiple processor as shown in Figure 4, or different from Fig. 4, in some or all the be integrated into single controllers in processor.

Integrated management process device 131 performs for providing the entirety of collaboration services to control.Integrated management process device 131 can be assigned to user management processor 133, document management processor 135 and image management processor 137 respectively the information relevant with collaboration services received and request and control the process to these information and request.In addition, in response to the request relevant with collaboration services, integrated management process device 131 can utilize at least one selected from user management processor 133, document management processor 135 and image management processor 137 to send information about collaboration services.Integrated management process device 131 for provide use in the integrated management of collaboration services collaboration services relevant information, according to integrated management generate, amendment and delete collaboration services relevant information and collaboration services support software can be stored in integrated management database (DB) 151.

In order to the video call image realized with each user of collaborative editing document is associated, based on the meeting summary of the speech production that the video call image that each user is associated comprises and synchronous by between the document of collaborative editing, integrated management process device 131 can to being input to the video call image of communication unit 240, the edit file of document from user terminal 200 and/or adding daily record data according to edit file to the result of the editor of document.Such as, if edit file is the text message for inserting text, then the result of the editor of document can be the document wherein with the text or the text be inserted in document.If edit file is for copying the copy information with paste text, then the result of the editor of document can be the document that text is copied into or the copied text be adhered in document.If edit file is the information for adjusting word size, then the result of the editor of document can be the wherein controlled document of font size or text.As mentioned above, video call image, meeting summary and document are used in collaboration services.In the case, daily record data can be the data relevant with the time that video call image or the serviced device of edit file 100 receive.In other words, time or synchronized with each other in the preset range of this time of receiving based on video call image or edit file serviced device 100 of the part of video call image and edit file.Therefore, video call image can with by the document-synchronization of collaborative editing.In addition, meeting summary can utilize the daily record data itself that is added to video call image with by the document-synchronization of collaborative editing.Can be changed for various types of image with by the attribute of the daily record data of the synchronous interpolation between the document of collaborative editing and sync interval.

In an exemplary embodiment, replace video call image, the rest image of the user of Edit Document can be had and the audio frequency of user can with by the document-synchronization of collaborative editing.In another one one exemplary embodiment, the rest image of user corresponds to part or all of the audio frequency of user.

Daily record data can be the text entry of the project of speech production based on the user in video.Daily record data can be to can the text entry of project that generates of the editor of Edit Document based on user.

User management processor 133 ALARA Principle is about the information of multiple users of use collaboration services.In other words, user management processor 133 ALARA Principle is about the personal information of each user and the information about the group member in each group.The user profile that user management processor 133 uses in user management and the user profile generating according to user management, revise and delete can be stored in user profile DB153.

Document management processor 135 performs overall control according to the edit file received from user terminal 200 to by the document of collaborative editing.When for providing the program server 100 of collaboration services performed for the treatment of document, document management processor 135 can according to the edit file received from user terminal 200 and the request relevant with the process of document to being performed overall control by the document of collaborative editing.Such as, document management processor 135 can the bookkeeping such as creating, edit, store and delete and so on of perform document.Can be stored in document D B155 by the document that document management processor 135 generates for the document information of document management with according to document management, revise and deletes.

Image management processor 137 performs overall control to the video call image be associated with each user of collaborative editing document and the meeting summary of speech production that comprises based on the video call image be associated with each user.Such as, image management processor 137 can perform the bookkeeping such as creating, store, process and delete and so on of the video call image that is associated with each user and meeting summary.Can be stored in image DB157 by the image information that image management processor 137 generates for the image information of image management with according to image management, revise and deletes.Image management processor 137 is described in more detail referring now to Fig. 5.

Fig. 5 illustrates the image management processor 137 in the controller 130 of the server 100 that can be included in for providing collaboration services according to one exemplary embodiment.

With reference to figure 5, image management processor 137 can comprise audio/video processor 138 and audio converter 139.One of ordinary skill in the art will appreciate that image management processor 137 also can comprise other common assemblies except those shown in Fig. 5.

Audio/video processor 138 can to the process of received image signal executive signal.In the case, signal transacting can refer to establishment or the process of image.The process of image can refer to the editor to it.The picture signal comprising audio signal and vision signal obtained can be sent to user terminal 200 via communication unit 110 or be stored in image DB157.

The speech conversion that audio converter 139 can comprise the video call image be associated with each user receiving collaboration services becomes the information of textual form.Image management processor 137 can receive the information of textual form to create meeting summary from audio converter 139.

Referring back to Fig. 3, server 100 can comprise memory 150.Memory 150 can comprise at least one selected from integrated management DB151, user profile DB153, document D B155, security document DB158 and image DB157, is described in more detail below with reference to Fig. 6 to Fig. 9.

Fig. 6 illustrates the integrated management DB151 in the memory 150 of the server 100 that can be stored in for providing collaboration services according to one exemplary embodiment.

Integrated management DB151 can provide the necessary various software of collaboration services and information by storage server 100.With reference to figure 6, integrated management DB151 can store collaboration services support software and collaboration services relevant information.

Collaboration services support software can be included in OS and application and for supporting various types of data of collaboration services that server 100 performs.Collaboration services relevant information can comprise about the information of the access to various database, such as various types of image with by the synchronizing information of the attribute and sync interval and so on of the daily record data of the synchronous interpolation between the document of collaborative editing and the cooperation historical information that generates when utilizing the collaboration services that provided by server 100 to perform cooperation.

Fig. 7 illustrates the user profile DB153 in the memory 150 of the server 100 that can be stored in for providing collaboration services according to one exemplary embodiment.

Can store about the personal information of each user of collaboration services and the information about the group member in each group with reference to figure 7, user profile DB153.User profile DB153 can be each user and stores such as obtaining the unique identifier of the account of the access to server 100 and so on, being stored in the information of the personal information in server 100 and the use about the collaboration services provided server 100.The personal information be stored in server 100 can be upload onto the server 100 various types of data and application.Information about the use of the collaboration services provided server 100 can be represent that user is allowed to use the information of the period of collaboration services or the authority of use collaboration services.

Fig. 8 illustrates the document D B155 in the memory 150 that can be stored in the server 100 providing collaboration services according to one exemplary embodiment.

Can memory server 100 document that creates or edit with reference to figure 8, document D B155.As shown in Figure 8, document D B155 can store the attribute information of document, wherein can comprise the information whether shared about document and version information.When utilizing collaboration services to edit document, document D B155 can by about the edit file of each user and the user of Edit Document account be used for storing together with synchronous daily record data.

In addition, if the cooperation write of execution requirements fail safe, then server 100 can have independent fail safe enhancing region, separately stores document and edit file here.Security document DB158 can memory server 100 creates or edits as document D B155 document, but security document DB158 can be that fail safe is by the DB strengthened further.Such as, being stored in document in security document DB158 can double or three times of encryption in order to store, or allows the certification that can require user or user terminal to the collaboration services of the editor of document in order to perform document or use.Can perform based on such as password, authenticate key, personal identification number (PIN), biological information, public-key certificate, medium access control (MAC) address and/or the approval via phone the certification of user or user terminal.

In addition, be stored in document in security document DB158 can only be provided for it uses to pay the local time in that independent expense or user being positioned at specific user.

When the document of collaborative editing is stored in security document DB158 by this way, the bookkeeping such as creating, edit, store and delete and so on can perform via security document DB158.Such as, if receive edit file from user terminal 200, then server 100 can perform generable activity during the editor of document via security document DB158, the interim storage of such as previous document and edit file, the storage of result of editor and/or the storage of edit commands.

Specifically, the group of collaboration services will be used and the one exemplary embodiment storing collaborative editing document describes the method that user determines the document that will be stored in security document DB158 in detail by describing to create below.

Fig. 9 illustrates the image DB157 in the memory 150 of the server 100 that can be stored in for providing collaboration services according to one exemplary embodiment.

With reference to figure 9, the meeting summary of speech production that image DB157 can store the video call image that is associated with each user of collaborative editing document and comprise based on the video call image be associated with each user.As shown in Figure 9, for each group of collaborative editing document, image DB157 can store with the video call image that each user is associated with the account of each user together with daily record data.Image DB157 also can for each group by meeting summary with say each text user account be used for storing together with synchronous daily record data.

Referring back to Fig. 3, the said modules of server 100 can be endowed and those different titles above-described.In addition, according to the present embodiment for providing the server 100 of collaboration services can comprise at least one in said modules.Server 100 can not comprise some in these assemblies or can also comprise extra assembly.Server 100 performs following operation by using at least one in said modules.

Allow to receive the video call image that is associated with each user of collaborative editing document and the edit file about document from the user terminal of request collaboration services to the server 100 of the collaborative editing of document for providing, and the video call image be associated with each user, the meeting summary of speech production comprised based on the video call image be associated with each user and the document according to the edit file collaborative editing received that storage receives.

In addition, server 100 can by synchronous with meeting summary for document to make user can identify contextual information while collaborative editing document.In other words, server 100 can by synchronous with meeting summary for document to make user by the text identification that comprises in meeting summary just by the state of the document of collaborative editing.

Synchronously refer to the time of coupling execution event.The synchronous time of origin that also can comprise the event that coupling has performed.In addition, synchronously can to occur while self-explanatory characters' part or time interval that adjustment event occurs is performed in preset range to make them.Such as, the text of saying with the user of Edit Document with other user collaborations (such as, meeting summary comprise text) can with the document-synchronization of the collaborative editing when generating the text.In the case, can comprise with document-synchronization text that user is said with about the edit file of the document edited when generating the text or synchronous with according to the edited result of edit file to document.The result of editor can be according to the document of edit file editor or by the part of document of editing.If the result of editor is by the part of document of editing, then edit file can with the coming to the same thing of editor.Such as, if edit file is user want the input text adding document to, then the result of editing can be wherein have this input text by Edit Document.

In addition, synchronously can comprise simultaneously or almost simultaneously multiple tasks that (such as, be less than in 5 seconds) occur to be relative to each other.In the case, can refer to that multiple task to be aggregated in group and to be managed together by relevant for multiple task, or be matched each other the time performing (such as, store, export or display) multiple task.

In an exemplary embodiment, such as, if user's Edit Document while via voice council details, then synchronously can comprise by the result of edit file or editor and user when the serviced device 100 of edit file receives or the text of saying when the result of editing is generated in server 100 be connected.In the case, can be stored in memory 150 with the synchronous and information that is that connect between the text that user says about edit file or the result of editor.

In addition, multiple tasks that synchronously can comprise in short time period (such as, be less than in 10 minutes) occurs together are relative to each other.Or some that synchronously can comprise in the multiple tasks (such as, be less than in 5 minutes) in the specific time period before or after occurring in one of multiple task occurred are relative to each other.

In the case, the multiple tasks that can refer to occur together in short time period of multiple task being correlated with to be aggregated in group and to be managed together, or the time performing (such as, store, export or display) multiple task is matched each other.

Such as, when between 3:10pm to 3:15pm in by the document of collaborative editing input or to the document copied text " patent strategy " time, user can interim says voice " extremely important " at one time.In the case, these voice can be converted into text, are then stored in meeting summary.

In this case, the text " extremely important " that the text " patent strategy " of input or copy can be said with user between 3:10pm to 3:15pm interconnects.Such as, interconnection text can refer to, if a text is shown later, is then shown together by another text.By this way the text that the result of editor and user are said is interconnected synchronized with each other both can being called as.

Server 100 also by generating by edited image from the corresponding part of each text extracted in the video call image that each user is associated with meeting summary based on meeting summary, can identify contextual information to make user while collaborative editing document.Owing to being regarded as synchronous with meeting summary by edited image based on meeting summary, and meeting summary and document-synchronization, so synchronized with each other by edited image, meeting summary and document.

In addition, server 100 can by meeting summary and document-synchronization to the video call image be associated with each user to store.

In addition, the course of the review after collaborative editing document, the contextual information existed when user can to utilize with various types of images of document-synchronization to be identified in collaborative editing.

Figure 10 illustrates figure for providing the server 100 of collaboration services to be implemented as multiple distributing server according to another one exemplary embodiment.Although eliminate, the description above about server 100 may be used on the server 100 shown in Figure 10.

With reference to Figure 10, integrated management server 101, subscriber management server 103, document management server 105 and image management server 107 can be comprised for providing the distributing server of collaboration services.Different from the server 100 of Fig. 3, the various processor be integrated in controller 130 is implemented as multiple distributing server with the various databases be stored in memory 150.

Integrated management server 101, subscriber management server 103, one of document management server 105 and image management server 107 can exchange various types of data each other with another server executive communication.Such as, integrated management server 101 can with user terminal 200 executive communication with by the information relevant with collaboration services received and ask to be sent at least one selected from subscriber management server 103, document management server 105 and image management server 107.Integrated management server 101 also can obtain the response of this transmission from another server and provide collaboration services to user terminal 200.When server 100 is implemented as multiple distributing server by this way, this configuration can be convenient to the maintenance and management of server 100.

Figure 11 is the block diagram as the integrated management server 101 for one of the distributing server providing collaboration services according to another one exemplary embodiment.

With reference to Figure 11, integrated management server 101 can comprise communication unit 111, integrated management process device 131 and integrated management DB151.Integrated management process device 131 and integrated management DB151 be may be used on to the description of the integrated management DB151 shown in the integrated management process device 131 shown in Fig. 4 and Fig. 6.One of ordinary skill in the art will appreciate that integrated management server 101 also can comprise other common assemblies except those shown in Figure 11.

Integrated management server 101 can ask subscriber management server 103 to confirm the whether authorized use collaboration services of the user of the server 100 be connected to for providing collaboration services.Integrated management server 101 also can ask document management server 105 according to the edit file Edit Document received from user terminal 200, or obtains the document be stored in document management server 105.Integrated management server 101 also can be stored in the video call image used in collaboration services or meeting summary in image management server 107 or obtain the image be stored in image management server 107.Integrated management server 101 can use user profile and daily record data to obtain image synchronized with each other and/or document.Such as, integrated management server 101 can obtain all texts in the meeting summary with same subscriber information and daily record data and about by the edit file of the document of collaborative editing, and provides the collaboration services using meeting summary synchronized with each other and document to user terminal 200.

Figure 12 is the block diagram as the subscriber management server 103 for one of the distributing server providing collaboration services according to another one exemplary embodiment.

With reference to Figure 12, subscriber management server 103 can comprise communication unit 113, user management processor 133 and user profile DB153.User management processor 133 and user profile DB153 be may be used on to the description of the user profile DB153 shown in the user management processor 133 shown in Fig. 4 and Fig. 7.One of ordinary skill in the art will appreciate that integrated management server 103 also can comprise other common assemblies except those shown in Figure 12.

Subscriber management server 103 ALARA Principle is about the information of multiple users of use collaboration services.User management processor 133 ALARA Principle is about the personal information of each user and the information about the group member in each group.The user profile used in user management and the user profile generating according to user management, revise and delete can be stored in user profile DB153.

Figure 13 is the block diagram as the document management server 105 for one of the distributing server providing collaboration services according to another one exemplary embodiment.

With reference to Figure 13, document management server 105 can comprise communication unit 115, document management processor 135 and document D B155.In order to the cooperation of execution requirements fail safe writes, document management server 105 can also comprise security document DB158.Document management processor 135 and document D B155 be may be used on to the description of the document D B155 shown in the document management processor 135 shown in Fig. 4 and Fig. 8.One of ordinary skill in the art will appreciate that document management server 105 also can comprise other common assemblies except those shown in Figure 13.

Document management server 105 can perform overall control according to by the edit file of the document of collaborative editing to the document.For document management document information and according to document management generate, amendment and delete document can be stored in document D B155.Document management server 105 also can via communication unit 115 and other server communications.Such as, document management server 105 can receive the request of the editor of document stored therein via communication unit 115 or receive document.

Figure 14 is the block diagram as the image management server 107 for one of the distributing server providing collaboration services according to another one exemplary embodiment.

With reference to Figure 14, image management server 105 can comprise communication unit 117, image management processor 137 and image DB157.Image management processor 137 and image DB157 be may be used on to the description of the image DB157 shown in the image management processor 137 shown in Fig. 4 and Fig. 9.One of ordinary skill in the art will appreciate that document management server 107 also can comprise other common assemblies except those shown in Figure 14.

Image management processor 107 can perform overall control to the meeting summary of the video call image be associated with each user of collaborative editing and the speech production comprised based on the video call image be associated with each user.Image management server 107 also can via communication unit 117 and other server communications.Such as, image management server 107 can receive the request of image stored therein via communication unit 117 or receive and want image stored therein.

Figure 15 according to one exemplary embodiment illustrate utilize for while providing the server 100 of collaboration services to process document according to the process request performing collaboration services being initiated to collaboration services.Specifically, Figure 15 illustrates the process preparing to receive collaboration services.When first user asks to perform collaboration services while utilizing server 100 to process document, collaboration services is provided so that by carrying out Edit Document collaboratively with the video conference of group member.But one exemplary embodiment is not limited to this process preparing to receive collaboration services.

Program for the treatment of document can be installed on server 100.First user can utilize his or her user account to sign in in server 100 via first user terminal 300 and ask the program that performs on server 100 for the treatment of document.Second and the 3rd user its user account can be utilized to sign in in server 100 and the collaboration services provided by server 100 is provided.

With reference to Figure 15, first user terminal 300 can ask to create document (operation S1505) to server 100.Owing to being installed on server 100 for the treatment of the program of document, so first user can sign in in server 100 and request creates the document with desired format.

Server 100 creates document (operation S1510) according to the request from first user terminal 300.

First user terminal 300 shows the document created by server 100 on its screen, and first user is by this screen processing the document (operation S1515).In the case, document server 100 performed can be displayed on the web browser screen of execution in first user terminal 300.In other words, server 100 provides the document based on web to first user terminal 300, and first user terminal 300 checks the document based on web by web browser screen.

First user terminal 300 can send the information (operation S1520) of the process about document to server 100.The time interval sent about the information of the process of document can be adjusted.First user terminal 300 can send the information of the process about document to server 100 when the event that each generation is relevant with the process of document.

Server 100 can store the information (operation S1525) of the process about document received from first user terminal 300.

First user can select the switching (operation S1530) performing collaboration mode in first user terminal 300.

First user terminal to server 100 asks to perform collaboration services (operation S1535).Referring now to Figure 16, the state that request performs the first user terminal 300 of collaboration services is described.

Figure 16 asks according to the one exemplary embodiment first user terminal 300 illustrated for receiving collaboration services the example performing collaboration services.Specifically, Figure 16 shows the user interface screen 360 of first user terminal 300.From top to bottom, user interface screen 360 comprises the address window 361 of the address for inputting server 100, menu bar 363 and banded menu bar 365.Menu bar 363 and banded menu bar 365 can have different shapes according to the type of the program performed on server 100.

First, first user can select " cooperation " menu in menu bar 363, clicks (or touch) " being switched to collaboration mode ", and perform the switching of collaboration mode in the submenu of display.

Then, according to the request of execution being arrived to the switching of collaboration mode from first user, instruction present mode is the mode indicators 367 of collaboration mode and the upper right side obtaining and the calling party display window 369 of the user of the access of current document is appeared to user interface screen 360 is shown.Illustrate and just can be displayed on below banded menu bar 365 by the window 370 of the document of collaborative editing.

Referring back to Figure 15, first user can perform group creating menu (operation S1540) in first user terminal 300.

First user terminal 300 can ask the establishment (operation S1545) of group to server 100.

Figure 17 asks according to the one exemplary embodiment first user terminal 300 illustrated for receiving collaboration services the example creating group.

In the user interface screen 360 of first user terminal 300, " cooperation " menu in the menu bar 363 of first user selectively between location window 361 with banded menu bar 365, then selects " the creating group " in the submenu shown.

" creating group " is selected to create group's window 362 by showing in the user interface screen 360 of first user terminal 300.In order to create group, first user can input suitable value in group name, accessibility, password and default privilege, and has pressed button.As shown in figure 17, first user can be selected respectively and input " group 1 ", " privately owned ", " * * * * " (not showing so that other users can not check it) and " read/write " in group name, accessibility, password and default privilege.In the case, if first user sets password, then group member is allowed through and participates in the group of establishment to use collaboration services via input password.In addition, create group's window 362 also can comprise for selecting setting via the menu 362-1 of the pattern of the level of security of the document of collaboration services editor.Such as, be respectively used to level of security to be set to high, medium and low button if provided via menu 362-1, then user is by select and one of high, medium and low corresponding button determines that group member to cooperate to it level of security of the document performing collaboration services.

According to one exemplary embodiment, if level of security is set to height by user, then the document via collaboration services editor can be stored in security document DB158.In addition, if during level of security is set to by user, then the document via collaboration services editor can be stored in document D B155, but can require further certification except inputting corresponding password.In addition, if level of security is set to low by user, then the document that the group created works can be stored in document D B155 and can be accessed by any user, and does not require that input port makes, or does not have password.

According to another one exemplary embodiment, if level of security is set to height by user, then the group member participating in collaboration services can be restricted.Such as, the place be located in the preset range from first user or the user being positioned at preassigned place can be only limitted to the participation of group.Or, can only allow the user via preassigned IP section access to participate in group.As another example, the user accessed via preassigned equipment identification information (such as, MAC Address etc.) can be only allowed to participate in group.

According to another one exemplary embodiment, if level of security is set to height by user, then can limit the execution of Another Application while just via collaboration services Edit Document.Such as, can limit and perform Another Application on the subscriber terminal to prevent from aligning the seizure of the document of editor, copy or transmission.

According to another one exemplary embodiment, if level of security is set to height by user, then the complexity via the encryption of the document of collaboration services editor can be increased when the document is stored.This encryption complexity increased can increase storage by document institute's time spent of editing, but can strengthen the fail safe of document further.

According to another one exemplary embodiment, if level of security is set to height by user, then server 100 can be sent to user terminal via independent escape way by by the document edited.Such as, server 100 can will be become image so that this image is provided to user terminal via escape way with the form of flow data by the document subject feature vector edited.If be image by the document edited, then the fail safe of the document can be strengthened further, because user terminal is difficult to structure, the interior perhaps text of resolving the document.

Referring back to Figure 15, server 100 can create group (operation S1550) according to the request from first user terminal 300.According to above-mentioned example, the privately owned group of group name " group 1 " can be had to server 100 registration, and first user (such as, user A) can be the current group member in group 1.

First user terminal 300 can perform group member management menu (operation S1555).

First user terminal 300 can ask invite group member (operation S1560) to server 100.The management of group member is described in more detail referring now to Figure 18.

Figure 18 performs the example of the management of group member according to the one exemplary embodiment first user terminal 300 illustrated for receiving collaboration services.

In the user interface screen 360 of first user terminal 300, " cooperation " menu in the menu bar 363 of first user selectively between location window 361 with banded menu bar 365, then selects " the management group group membership " in the submenu shown.

Then, management group group membership window 364 can be displayed in the user interface screen 360 of first user terminal 300.First user " adds member " by pressing, and button asks invite group member to server 100.

Referring back to Figure 15, server 100 can invite the second user terminal 400 and the 3rd user terminal 500, and the second user terminal 400 and the 3rd user terminal 500 can be connected to server 100 (operation S1565).

In the case, if first user sets password between the startup stage of group, then server 100 can receive password from the second user terminal 400 and the 3rd user terminal 500.In the case, password can be the text of group member input, or can be encrypted before being sent to server 100.

After receiving password, server 100 is by determining whether identical with the password that first user the creates certification performing group member of password received.When certification is confirmed, server 100 can provide to the second user terminal 400 and the 3rd user terminal 500 power using collaboration services.

In addition, although assign a password to each group substantially, also different passwords can be given to each group member.Such as, the second user terminal 400 and the 3rd user terminal 500 can use different passwords to participate in this group.Or, in the second user terminal 400 and the 3rd user terminal 500, only have one can be required to input its password.

Second user terminal 400 and the 3rd user terminal 500 can ask to perform by the document of collaborative editing and receive the document (operation S1570) based on web from server 100.

Second user terminal 400 and the 3rd user terminal 500 can show the document (operation S1575) just performed on server 100 respectively on the screen of the second user terminal 400 and the 3rd user terminal 500.In the case, document server 100 performed can be displayed on the web browser screen of execution on the second user terminal 400 and the 3rd user terminal 500.

First to the 3rd user terminal 300,400 and 500 can exchange video call image (operation S1580) each other via server 100.The exchange of video call image can continue until be made the request stopping collaboration services.

The video call image of its other party can be output to the first to the 3rd user terminal 300,400 and 500 (operation S1585) respectively.Such as, with second and the 3rd the video call image that is associated of user can be output to first user terminal 300.

Figure 19 illustrates the state of the first to the 3rd user terminal 300,400 and 500 when collaboration services while being just processed at document is initiated to make the first to the 3rd user terminal 300,400 and 500 to get out collaborative editing document according to one exemplary embodiment.With reference to Figure 19, the first to the 3rd user terminal 300,400 and 500 can be connected to server 100.

Illustrate just by the window 370 of the document of collaborative editing and illustrate second and the 3rd the window 380 of video call image of user's (such as, " in vain " and " Cui ") can be displayed in first user terminal 300.

Similarly, illustrate just by the window 470 of the document of collaborative editing and illustrate first and the 3rd the window 480 of video call image of user's (such as, " peace " and " Cui ") can be displayed on the second user terminal 400.

Similarly, illustrate and just can be displayed on the 3rd user terminal 500 with the window 580 of the video call image that the first and second users (such as, " peace " and " in vain ") are shown by the window 570 of the document of collaborative editing.In an exemplary embodiment, video call image can comprise movement vision image.In another one one exemplary embodiment, utilize Video Codec to process movement vision image.

In an exemplary embodiment, video call image can be the rest image of the first and second users, and the audio frequency that the first and second users provide simultaneously is played.

Figure 20 illustrates display in the first user terminal 300 for receiving collaboration services according to one exemplary embodiment and comprises the user interface of address window and menu and the method for video call image.

With reference to Figure 20, illustrate that the window 380 of video call image can be displayed thereon the right side of the first user terminal 300 showing address window, menu bar and banded hurdle.As described in reference diagram 19 above, second and the 3rd the video call image of user's (such as, " in vain " and " Cui ") can appear in the window 380 in first user terminal.But the video call image of some that first user can be handled in the user of collaborative editing document is not displayed in first user terminal 300 to make them.

Figure 21 illustrates the method for display video call images in the first user terminal 300 for receiving collaboration services according to one exemplary embodiment.

With reference to Figure 21, in first user terminal 300, the large I of the window 380 that video call image is shown of display is adjusted.In other words, the size of the window 380 that video call image is shown according to the default size display preset in first user terminal 300 can be adjusted.Multi-finger gesture, click pull method etc. to adjust the size of window 380 can be utilized.

Figure 22 illustrates the other method of display video call images in the first user terminal 300 for receiving collaboration services according to one exemplary embodiment.

With reference to Figure 22, in first user terminal 300, the position of the window 380 that video call image is shown of display can be adjusted.In other words, the position of the window 380 that video call image is shown according to the default location display preset in first user terminal 300 can be adjusted.Drag and drop method etc. can be utilized adjust the position of window 380.

Figure 23 illustrates according to one exemplary embodiment and utilizes for providing the server 100 of collaboration services during video conference according to the process request performing collaboration services being initiated to collaboration services.Specifically, Figure 23 illustrates the process preparing to receive collaboration services.When first user utilizes server 100 to run video conference and document, collaboration services is provided to shared document and edits the document collaboratively during video conference.But embodiment is not limited to this process preparing to receive collaboration services.

With reference to Figure 23, first user terminal 230 can be asked as video conference creates group (operation S2305) to server 100.

Server 100 can create group (operation S2310) according to the request from first user terminal 300.

First user terminal 300 can perform group member management menu (operation S2315).

First user terminal 300 can be asked as this video conference invite group member (operation S2320) to server 100.

In the case, for video conference creates group and invite group member can perform by with those the similar modes described with reference to Figure 17 and Figure 18 above.

Server 100 invites the second user terminal 400 and the 3rd user terminal 500, and the second user terminal 400 and the 3rd user terminal 500 can be connected to server 100 (operation S2325).

First to the 3rd user terminal 300,400 and 500 can exchange video call image (operation S2330) each other via server 100.The exchange of video call image can continue until be made the request stopping collaboration services.

The video call image of its other party can be output to the first to the 3rd user terminal 300,400 and 500 (operation S2335) respectively.Such as, with second and the 3rd the video call image that is associated of user can be output to first user terminal 300.In operation S2305 to S2335, the group of video conference is created, and group member is invited to, and video conference is performed.The user interface screen being used for video conference is described in detail referring now to Figure 24.

Figure 24 illustrates the example performing video conference before making the request to execution collaboration services in the first user terminal 300 for receiving collaboration services according to one exemplary embodiment.

Specifically, Figure 24 shows the user interface screen 360 of first user terminal 300.From top to bottom, user interface screen 360 comprises the address window 361 of the address for inputting server 100, menu bar 363 and banded menu bar 365.Menu bar 363 and banded menu bar 365 can have different shapes according to the type of the program performed on server 100.User interface screen 360 shown in Figure 24 has and the similar structure shown in Figure 16, but difference is that the shape on menu bar 363 and banded hurdle 365 is changed to mate the program for video conference with it.

In addition, it is video conference mode that mode indicators 367 can indicate present mode, and calling party display window 369 can illustrate the title of the user of current participation video conference.

Simple graph for showing the basic function that the region of the video call image of its other party, chat area and expression use during video conference marks present video conference window 375.Video conference window 375 also can comprise memorandum region or the region for showing shared document, and described shared document runs required for video conference.

Referring back to Figure 23, first user can select him or she to want the document (operating S2340) shared with other users participating in video conference from lists of documents.

Figure 25 illustrates the process selecting the document shared during video conference in the first user terminal 300 for receiving collaboration services before making the request to execution collaboration services according to one exemplary embodiment.

With reference to Figure 25, in the video conference window 375 of display in first user terminal 300, first user can be selected the file of Storage sharing document and open this file to identify sharable lists of documents 376 from the simple icon representing the basic function used during video conference.

First user can be selected at least one document and share selected document with other users from the list of document.In the case, first user can select two files with different document form to share two documents simultaneously.With reference to Figure 25, first user can be selected both " present.doc " and " Graph.pdf " from lists of documents 376.

Referring back to Figure 23, first user terminal 300 can perform the document (operation S2345) selected from lists of documents by request server 100.

Server 100 can perform the document (operation S2350) that first user terminal 300 asks to perform.Program for perform document can be installed in server 100.

Server 100 can be sent to the first to the 3rd user terminal 300,400 and 500 (operation S2355) using the document performed on server 100 as the document based on web.

First to the 3rd user terminal 300,400 and 500 can respectively via the document (operation S2360) that web browser display sends as the document based on web.

Figure 26 according to one exemplary embodiment illustrate before making the request performing collaboration services, in the first user terminal 300 for receiving collaboration services, be presented at video conference during the example of document shared.

With reference to Figure 26, the simple graph for showing the basic function that the region of the video call image of its other party, chat area and expression use during video conference marks the video conference window 375 of present first user terminal 300.Different from Figure 25, the two class shared document that first user is selected can be displayed on video conference window 375 together.

Referring back to Figure 23, first user can select the switching (operation S2365) performing collaboration mode in first user terminal 300.The switching selecting to perform collaboration mode is described in first user terminal 300 referring now to Figure 27.

Figure 27 asks according to the one exemplary embodiment first user terminal 300 illustrated for receiving collaboration services the example performing collaboration services during video conference.

Specifically, Figure 27 shows the user interface screen 360 of first user terminal 300.From top to bottom, user interface screen 360 comprises the address window 361 of the address for inputting server 100, menu bar 363 and banded menu bar 365.It is video conference mode that mode indicators 367 can indicate present mode, and calling party display window 369 can show the title of the user of current participation video conference.

With reference to Figure 27, first user selects " cooperation " menu in menu bar 363, clicks (or touch) " being switched to collaboration mode ", and perform the switching of collaboration mode in the submenu of display.

Referring back to Figure 23, first user terminal 300 can ask to perform to server 100 collaboration services (operation S2370) allowed the collaborative editing of document.In the case, setting can be provided for further by the menu of the safe condition of the document of collaborative editing.Such as, in response to user's input, namely click (or touch) " being switched to collaboration mode ", can be set by the level of security of the document of collaborative editing.Can via for selecting high, medium and low button to provide level of security respectively, and position server 100 storing the DB of document optionally changes according to selected level of security.Such as, if level of security is set to height by user, then the document that the group created works can be stored in security document DB158.On the other hand, if user level of security is set in or low, then the document that the group created works can be stored in document D B155.

Referring now to Figure 28 be described in detail in request perform allow collaboration services to the collaborative editing of document time the first to the 3rd user terminal 300,400 and 500 state.

Figure 28 illustrates the state of the first to the 3rd user terminal 300,400 and 500 when collaboration services is initiated to make the first to the 3rd user terminal 300,400 and 500 to get out collaborative editing document during video conference according to one exemplary embodiment.With reference to Figure 28, the first to the 3rd user terminal 300,400 and 500 can be connected to server 100.

Similarly, illustrate and just can be displayed on the 3rd user terminal 500 with the window 580 of the video call image that the first and second users (such as, " peace " and " in vain ") are shown by the window 570 of the document of collaborative editing.

Figure 19 illustrate collaboration services while being just processed at document be initiated to make the first to the 3rd user terminal 300,400 and 500 can collaborative editing document time the first to the 3rd user terminal 300,400 and 500 state.Figure 28 illustrate when during video conference collaboration services be initiated to make the first to the 3rd user terminal 300,400 and 500 can collaborative editing document time the first to the 3rd user terminal 300,400 and 500 state.Figure 19 and Figure 28 shows and prepares to receive collaboration services so that the process of collaborative editing document.Each in first to the 3rd user terminal 300,400 and 500 shows and is receiving the equal state after allowing the collaboration services of the collaborative editing of document according to the switching performing collaboration mode.The difference of the example shown in the example shown in Figure 28 and Figure 19 is only that two kinds of dissimilar documents are presented in window 370,470 and 570 respectively.

Figure 29 illustrates for providing the process being sent to each the first to the 3rd user terminal 300,400 and 500 in the server 100 of collaboration services from video call Computer image genration meeting summary and by meeting summary according to one exemplary embodiment.As mentioned above, when document is ready to by collaborative editing, video call image can be exchanged between the ues, and the document can be displayed on the screen of each user terminal.Because meeting summary is the speech production that comprises based on video call image, so video call image should be exchanged between each user terminal.In other words, although due to the sending/receiving not describing video call image, but the sending/receiving of video call image continues until be made the request stopping collaboration services, so suppose here to exchange video call image continuously between each user terminal.

With reference to Figure 29, the speech conversion that video call image comprises can be become text (operation S2905) by server 100.The speech conversion comprised in the video call image be associated with each user can be become text and generate meeting summary based on the text by server 100.In other words, because each in the first to the 3rd user terminal 300,400 and 500 sends or receiver, video call images via server 100, so when the video call image be associated with each user is transmitted or received, the speech conversion that video call image comprises can be become text by server 100 at every turn.

Server 100 can send meeting summary (operation S2910) by first to the 3rd user terminal 300,400 and 500.Such as, when the video call image of each each user is transmitted or received, the speech conversion in video call image can be become text and the meeting summary comprising the text is sent to each in the first to third terminal 300,400 and 500 by server 100.

Each in the first to third terminal 300,400 and 500 can show the meeting summary (operation S2915) received from server 100.From display conference summary in each in the first to third terminal 300,400 and 500, can think complete and provide the collaboration services allowed the collaborative editing of document.

Figure 30 illustrates the example of display conference summary on first for receiving collaboration services to each in the 3rd user terminal 300,400 and 500 according to one exemplary embodiment.With reference to Figure 30, the first to the 3rd user terminal 300,400 and 500 can be connected to the server 100 for providing collaboration services.

Illustrate just by the window 370 of the document of collaborative editing, illustrate second and the 3rd user's (such as, " in vain " and " Cui ") video call image window 380 and illustrate that the window 390 of meeting summary can be displayed in first user terminal 300.

Similarly, illustrate just by the window 470 of the document of collaborative editing, illustrate first and the 3rd user's (such as, " peace " and " Cui ") video call image window 480 and illustrate that the window 490 of meeting summary can be displayed on the second user terminal 400.

Similarly, illustrate just by the window 570 of the document of collaborative editing, illustrate the video call image of the first and second users (such as, " peace " and " in vain ") window 580 and illustrate that the window 590 of meeting summary can be displayed on the 3rd user terminal 500.

Clearly visible from Figure 30, in first user terminal 300, the window 390 of display shows first user (such as, " peace ") in a text form and what has been said during video conference.Specifically, meeting summary can comprise " peace " as user profile, the information as the time occurred about text " (09:01) ", as " [1] " of the information about the page in the document just checked by collaborative editing and by the user saying the text when text occurs and " this is the document wanting collaborative editing today " of text that be converted into as the voice in video call image.In other words, the information of the page in the meeting summary information that can comprise the time occurred about each text in meeting summary and the document checked about the user saying the text when the text occurs.

In addition, on the second user terminal 400 with the 3rd user terminal 500, the window 490 and 590 that meeting summary is shown of display comprises the details identical with the window 390 shown in first user terminal 300.

Figure 31 illustrates another example of display conference summary on first for receiving collaboration services to each in the 3rd user terminal 300,400 and 500 according to one exemplary embodiment.With reference to Figure 31, the first to the 3rd user terminal 300,400 and 500 can be connected to the server 100 for providing collaboration services.

As described in reference diagram 30 above, illustrate just by the window 370,470 and 570 of the document of collaborative editing, illustrate the video call image of all the other users except specific user window 380,480 and 580 and illustrate that the window 390,490 and 590 of meeting summary can be displayed on the first to the 3rd user terminal 300,400 and 500 respectively.In the case, the information of the page in the meeting summary information that can comprise the time occurred about each text in meeting summary and the document checked about the user saying the text when the text occurs.

Figure 30 and Figure 31 respectively illustrates the result that the process by performing Figure 15 and Figure 23 obtains.The difference of the example shown in the example shown in Figure 31 and Figure 30 is only that two kinds of dissimilar documents are presented in window 370,470 and 570 respectively.

Figure 32 illustrates the process to the server 100 request management group member and interoperable group for providing collaboration services according to one exemplary embodiment.At server 100 while providing and allowing collaboration services to the collaborative editing of document, the first user occupy first of group can be thought and is necessary management group group membership or group.In other words, first user may be wanted to change about the information of each member in group or the group that is divided into several less the group with larger size.

Referring now to Figure 32, the management to group member is described.

With reference to Figure 32, first user terminal 300 can perform group member management menu (operation S3205).The authority of the subgroup belonging to each group member or each group member is set in the group member window that first user can eject when performing group member management menu.

First user terminal 300 can send information (operation S3210) about each group member to server 100.In other words, if first user terminal 300 performs group member management menu to make to make change to the information about each group member, then the information about each group member can be sent to server 100 to reflect this change by first user terminal 300.

Server 100 can store the information (operation S3215) about each group member.Describe in detail referring now to Figure 33 and carry out management group group membership by setting about the information of each group member.

Figure 33 illustrates the example setting the information about each group member in the first user terminal 300 for receiving collaboration services according to one exemplary embodiment.

With reference to Figure 33, in the user interface screen 360 of first user terminal 300, " cooperation " menu in the menu bar 363 of first user selectively between location window 361 with banded menu bar 365, then selects " the management group group membership " in the submenu shown.

Then, management group group membership window 364 can be displayed in the user interface screen 360 of first user terminal 300.First user by change or setting about current membership information and press " completing " button and set information about each group member.With reference to Figure 33, the second user (such as, " in vain ") has the authority of read and write and belongs to subgroup G1-1.Similarly, the 3rd user (such as, " Cui ") has the authority of read and write and belongs to subgroup G1-2.

Referring back to Figure 32, first user terminal 300 can perform management and group menu (operation S3220).

First user terminal 300 can ask segmentation group (operation S3225) to server 100.

Group can be divided into less group (operation S3230) according to the request from first user terminal 300 by server 100.The management of group is described in detail referring now to Figure 34.

Figure 34 illustrates the example current group being divided into multiple group in the first user terminal 300 for receiving collaboration services according to one exemplary embodiment.

As described in reference diagram 33 above, the information about each group member can be set to make the second user (such as, " in vain ") and the 3rd user (such as, " Cui ") belong to different subgroup.If multiple users with different subgroup belong to single group, then occupy first user this group divisible first of group.

With reference to Figure 34, in the user interface screen 360 of first user terminal 300, " cooperation " menu in the menu bar 363 of first user selectively between location window 361 with banded menu bar 365, then selects " the management group " in the submenu shown.

Then, submenu " segmentation group " and " merging group " can be shown further.If multiple users with different subgroup belong to current group, and thus current group is divided, then submenu " segmentation group " can be activated.By chooser menu " segmentation group ", current group can be divided into multiple subgroup by first user.The result of segmentation group is described in detail referring now to Figure 35.

Figure 35 illustrates the state of each when current group is divided into multiple group in the first to the 3rd user terminal 300,400 and 500.

With reference to Figure 35, the first to the 3rd user terminal 300,400 and 500 can be connected to the server 100 for providing collaboration services.

Illustrate just by the window 370 of the document of collaborative editing, illustrate second and the 3rd user (such as, " user B " and " user C ") video call image window 380 and illustrate that the window 390 of meeting summary can be displayed in first user terminal 300.In addition, calling party display window 369 indicates first user (such as, " user A ") and belongs to " group 1-1 " and " group 1-2 " and " user B " and " user C " among the user belonging at least one same group with first user is current just at access services device 100.

Illustrate just by the window 470 of the document of collaborative editing, illustrate the video call image of first user (such as, " user A ") window 480 and illustrate that the window 490 of meeting summary can be displayed on the second user terminal 400.In addition, calling party display window 469 indicates the second user (such as, " user B ") and belongs to " group 1-1 " and " user A " among the user belonging to same group with the second user is current at access services device 100.

Illustrate just by the window 570 of the document of collaborative editing, illustrate the video call image of first user (such as, " user A ") window 580 and illustrate that the window 590 of meeting summary can be displayed on the 3rd user terminal 500.In addition, calling party display window 569 indicates the 3rd user (such as, " user C ") and belongs to " group 1-2 " and " user A " among the user belonging to same group with the 3rd user is current at access services device 100.

In other words, because the first and second users i.e. " user A " and " user B " belongs to " group 1-1 ", and first and the 3rd user namely " user A " and " user C " belong to " group 1-2 ", so can find out second and the 3rd user do not belong to same group due to the segmentation to current group.

If want the document of collaborative editing two type and need cooperation for every class document, then as shown in figure 35, efficient cooperation can be realized by group being divided into multiple subgroup.

Figure 36 illustrates according to one exemplary embodiment and is limiting just by the process of editor's scope of the document of collaborative editing for providing in the server 100 of collaboration services.Due to when multiple user on document during coordination with one another document by collaborative editing, so can to each user specify in advance editor's scope with prevent edit during conflict.

First, with reference to Figure 36, the example that first editor's scope locked by first user is described.

First user specifies first editor's scope (operation S3605) by using first user terminal 300.

First editor's scope that first user can be specified by first user terminal 300 is sent to server 100 (operation S3610).

Server 100 can edit scope corresponding part (operate S3615) just by the document of collaborative editing with first based on first editor's scope locking.

The document having locked first editor's scope can be sent to the first to the 3rd user terminal 300,400 and 500 (operation S3620) as the document based on web by server 100.

First to the 3rd user terminal 300,400 and 500 can lock first editor's scope also by the document (operation S3625) sent as the document based on web via web browser display respectively.

Next, second editor's scope is described by the example of the second Subscriber Locked with reference to Figure 36.

Second user specifies second editor's scope (operation S3630) by using the second user terminal 400.

Second editor's scope that second user can specify by the second user terminal 400 is sent to server 100 (operation S3635).

Server 100 can edit scope corresponding part (operate S3640) just by the document of collaborative editing with second based on second editor's scope locking.

The document having locked second editor's scope can be sent to the first to the 3rd user terminal 300,400 and 500 (operation S3645) as the document based on web by server 100.

First to the 3rd user terminal 300,400 and 500 can lock second editor's scope also by the document (operation S3650) sent as the document based on web via web browser display respectively.

Finally, the 3rd editor's scope is described by the example of the 3rd Subscriber Locked with reference to Figure 36.

3rd user specifies the 3rd editor's scope (operation S3655) by using the 3rd user terminal 500.

The 3rd editor's scope that 3rd user specifies can be sent to server 100 (operation S3660) by the 3rd user terminal 500.

Server 100 can edit scope corresponding part (operate S3665) just by the document of collaborative editing with the 3rd based on the 3rd editor's scope locking.

The document having locked the 3rd editor's scope can be sent to the first to the 3rd user terminal 300,400 and 500 (operation S3670) as the document based on web by server 100.

First to the 3rd user terminal 300,400 and 500 can lock the 3rd editor's scope also by the document (operation S3675) sent as the document based on web via web browser display respectively.

The method of the document having shown for each Subscriber Locked editor's scope is described in detail referring now to Figure 37 to Figure 40.

Figure 37 illustrates the example being locked first editor's scope 371 in the first user terminal 300 for receiving collaboration services by first user according to one exemplary embodiment.

With reference to Figure 37, illustrate just by the window 370 of the document of collaborative editing, illustrate video call image window 380 and illustrate that the window 390 of meeting summary can be displayed in first user terminal 300.In the case, when first user (such as, " peace ") display in specified window 370 document in first page and request for providing server (100 in Figure 36) locking first editor's scope 371 of collaboration services time, the document having locked first editor's scope 371 can be shown as shown in figure 37.Editor's scope that the predetermined color corresponding with each user, pattern or mark can be utilized to indicate each user is locked, so that other users can recognize it.

In addition, the video call image of first user is output to window 380, and the text that first user is said is displayed in window 390.In other words, the video call image be associated with the user saying the text in meeting summary can be shown together with meeting summary.For this reason, only the video call image corresponding with the text in meeting summary can be shown in window 380.

Figure 38 illustrates the example of being edited scope 372 in the first user terminal 300 for receiving collaboration services by the second Subscriber Locked second according to one exemplary embodiment.

With reference to Figure 38, illustrate just by the window 370 of the document of collaborative editing, illustrate video call image window 380 and illustrate that the window 390 of meeting summary can be displayed in first user terminal 300.In the case, when the second user (such as, " in vain ") utilize the second user terminal 400 specify just by the second page in the document of collaborative editing and request server (100 in Figure 36) locking second editor scope 372 time, the document having locked second editor's scope 372 can be shown as shown in figure 38.

In addition, the video call image of the second user is output to window 380, and the text that the second user says is displayed in window 390.In other words, the video call image be associated with the user saying the text in meeting summary can be shown together with meeting summary.For this reason, only the video call image corresponding with the text in meeting summary can be shown in window 380.

Figure 39 illustrates the example by the 3rd Subscriber Locked the 3rd editor's scope 373 in the first user terminal 300 for receiving collaboration services according to one exemplary embodiment.

With reference to Figure 39, illustrate just by the window 370 of the document of collaborative editing, illustrate video call image window 380 and illustrate that the window 390 of meeting summary can be displayed in first user terminal 300.In the case, when the 3rd user (such as, " Cui ") utilize the 3rd user terminal 500 specify just by the 3rd in the document of collaborative editing page and request server (100 in Figure 36) locking the 3rd editor's scope 373 time, the document having locked the 3rd editor's scope 373 can be shown as shown in figure 39.

In addition, the video call image of the 3rd user is output to window 380, and the text that the 3rd user says is displayed in window 390.In other words, the video call image be associated with the user saying the text in meeting summary can be shown together with meeting summary.For this reason, only the video call image corresponding with the text in meeting summary can be shown in window 380.

With reference to Figure 37 to Figure 39, each in the first to the 3rd user can align is specified editor's scope by the every one page in the document of collaborative editing.In addition, the page number of the document that each in the first to the 3rd user is checked on his or she user terminal is shown together with the text in meeting summary.By changing voice in the video call image of each user to obtain text.Information about the time of text generation also can be shown together with page number with text, and the video call image of the user corresponding with the up-to-date text in meeting summary is shown.

Figure 40 to illustrate in the first user terminal 300 for receiving collaboration services for the multiple area lockings first in page to the example of the 3rd editor's scope 371 to 373 according to one exemplary embodiment.

With reference to Figure 40, illustrate just by the window 370 of the document of collaborative editing, illustrate video call image window 380 and illustrate that the window 390 of meeting summary can be displayed in first user terminal 300.

When first user (such as, " peace ") to specify in window 370 in the document of display first page in region for first editor's scope 371 and request for providing the server of collaboration services (100 in Figure 36) to lock this region time, the document having locked first editor's scope 371 can be shown as shown in figure 40.

In addition, when the second user (such as, " in vain ") utilize the second user terminal 400 to specify just to be second editor's scope 372 by the region in the first page of the document of collaborative editing and request server (100 in Figure 36) locking second editor's scope 372 time, the document having locked second editor's scope 372 can be shown as shown in figure 40.

In the case, when the 3rd user (such as, " Cui ") utilize the 3rd user terminal 500 to specify just to be the 3rd editor's scope 373 by the region in the first page of the document of collaborative editing and request server (100 in Figure 36) locking the 3rd editor's scope 373 time, the document having locked the 3rd editor's scope 373 can be shown as shown in figure 40.

With reference to Figure 40, each in the first to the 3rd user can align by each Region specification editor scope of the one page in the document of collaborative editing.In addition, the page number of the document that each in the first to the 3rd user is checked on his or she user terminal is shown together with the text in meeting summary.By changing voice in the video call image of each user to obtain text.Information about the time of text generation also can be shown together with page number with text, and the video call image of the user corresponding with the up-to-date text in meeting summary is shown.

Figure 41 illustrates for providing server 100 inediting of collaboration services by the process of the document of collaborative editing according to one exemplary embodiment.

First, edited and the example be shown according to the first edit file by first user by the document of collaborative editing with reference to Figure 41 detailed description.

First user can at first user terminal 300 inediting by the document of collaborative editing (operation S4105).

First edit file can be sent to server 100 (operation S4110) by first user terminal 300.

Server 100 can store the first edit file (operation S4115).

The document of editor can be sent to the first to the 3rd user terminal 300,400 and 500 (operation S4120) as the document based on web by server 100.

First to the 3rd user terminal 300,400 and 500 can respectively via web browser display by according to the first edit file editor and by the document (operating S4125) sent as the document based on web.

Next, edited and the example be shown according to the second edit file by the second user by the document of collaborative editing with reference to Figure 41 detailed description.

Second user can at the second user terminal 400 inediting by the document of collaborative editing (operation S4130).

Second edit file can be sent to server 100 (operation S4135) by the second user terminal 400.

Server 100 can store the second edit file (operation S4140).

The document of editor can be sent to the first to the 3rd user terminal 300,400 and 500 (operation S4145) as the document based on web by server 100.

First to the 3rd user terminal 300,400 and 500 can respectively via web browser display by according to the second edit file editor and by the document (operating S4150) sent as the document based on web.

Describe by the document of collaborative editing by the example of the first and second users according to the first edit file and the second edit file sequence edit referring now to Figure 42 and Figure 43.

Figure 42 to illustrate in the first user terminal 300 for receiving collaboration services by first user editor by the example of the document of collaborative editing according to one exemplary embodiment.

With reference to Figure 42, illustrate just by the window 370 of the document of collaborative editing, illustrate video call image window 380 and illustrate that the window 390 of meeting summary can be displayed in first user terminal 300.

When first user (such as, " peace ") editor in window 370 display document first page in a part, said about during to the editor of this part and to server (100 in Figure 41) request editor for providing collaboration services by video call image, what having of indicating like that was as shown in figure 42 represented by " A " of instruction " peace " can be shown by the document of edit segment.

The predetermined color corresponding with each user, pattern can be utilized or mark to indicate who edits this part to make other users to recognize by edit segment.

With reference to Figure 42, first user can be edited as just by the target of a part for the catalogue in the document of collaborative editing, said about the editor to this part by video call image, and in meeting summary, show the text obtained by the voice of the first user in converting video call images.

Figure 43 illustrates according to one exemplary embodiment and is edited by the example of the document of collaborative editing by the second user in the second user terminal 400 for receiving collaboration services.

With reference to Figure 43, illustrate just by the window 470 of the document of collaborative editing, illustrate video call image window 480 and illustrate that the window 490 of meeting summary can be displayed on the second user terminal 400.

When the second user (such as, " in vain ") edit just by the part in the second page of the document of collaborative editing, said about during to the editor of this part and to server (100 in Figure 41) request editor for providing collaboration services by video call image, what having of indicating like that was as shown in figure 43 represented by " B " of instruction " in vain " can be shown by the document of edit segment.

With reference to Figure 43, second user can utilize felt pen editor just by the part in the second page of the document of collaborative editing, said about the editor to this part by video call image, and in meeting summary, show the text obtained by the voice of the second user in converting video call images.

Figure 44 illustrates according to one exemplary embodiment and utilizes meeting summary to identify just by the example of the edit file of the document of collaborative editing in the second user terminal 400 for receiving collaboration services.

With reference to Figure 44, illustrate just by the window 470 of the document of collaborative editing, illustrate video call image window 480 and illustrate that the window 490 of meeting summary can be displayed on the second user terminal 400.When have accumulated text in window 490, scroll bar can be created on the right side of window 490.

Server 100 can from the second user terminal 400 receive the text selected from meeting summary about user information and to the second user terminal 400 send about just by the document of collaborative editing with selected context synchronization by the information of edit segment.Specifically, if having selected the text of another user in window 490, then the edit file of corresponding with selected text document can be displayed in window 470.This is possible when meeting summary and document-synchronization.

Figure 45 illustrates according to one exemplary embodiment and utilizes meeting summary to edit just by the example of the document of collaborative editing in the second user terminal 400 for receiving collaboration services.

With reference to Figure 45, illustrate just by the window 470 of the document of collaborative editing, illustrate video call image window 480 and illustrate that the window 490 of meeting summary can be displayed on the second user terminal 400.

Information and identifying for providing the server of collaboration services (100 in Figure 41) can receive from the second user terminal 400 text selected from meeting summary about user whether have just by the document of collaborative editing with selected context synchronization by edit segment.Specifically, if the second user selects his or she text and the edit file of not corresponding with selected text document from window 490, then selected text can be utilized as the edit file of document to edit the document.Like this, the text of display in window 490 can be utilized to edit the document of display in window 470.

Figure 46 illustrates following example according to one exemplary embodiment: for receiving in the user terminal of collaboration services, for just by each set device in the image of the document of collaborative editing, video call image and meeting summary to utilize other equipment to user terminal registration to separate the image of display document, video call image and meeting summary.

Specifically, Figure 46 illustrates image particular device setting window 366.Align by the editor of the document of collaborative editing, meeting summary and video call image if user is difficult to check, then can be displayed on the equipment of forward direction user terminal registration to make at least one in the image of document, video call image and meeting summary to each image actuating equipment setting.

Figure 47 illustrates according to one exemplary embodiment and separately shows just by the example of the document of collaborative editing, video call image and meeting summary on multiple equipment.

When such as above described in reference diagram 46 for the setting of each image finishing equipment time, document, video call image and meeting summary can be separately presented on PC300-1, intelligent TV300-2 and dull and stereotyped PC300-3 respectively.

Figure 48 illustrates by stopping collaboration services to for providing the request of the server 100 of collaboration services to stop collaboration services and the document of collaborative editing be sent to the process of another user terminal according to one exemplary embodiment.

With reference to Figure 48, first user terminal 300 can ask to stop collaboration services (operation S4805) to server 100.

Server 100 can store and just also be stopped the program (operation S4810) for the treatment of document by the document of collaborative editing.

Server 100 can store meeting summary and video call image (operation S4815).

If document, meeting summary and video call image are all stored, server 100 can stop video call images serve (operation S4820).In the case, server 100 also can store document for examining, for the video call image examined and the meeting summary for examining.For examine document, refer to the wherein edit file image synchronous with text message for the video call image examined and the meeting summary for examining, that is, remain to the document of the instruction of the part of editing during utilizing collaboration services to the collaborative editing of document and with by the synchronous image of edit segment.

First user terminal 300 asks to share by the document of collaborative editing (operation S4825) to server 100.Such as, in order to share with not having the 4th user of collaborative editing document the document utilizing collaboration services to carry out collaborative editing, first user terminal 300 can ask to share the document to server 100.

Server 100 can retrieve the document (operation S4830) that first user terminal 300 is asked.

The document of retrieval can be sent to the 4th user terminal 600 (operation S4835) by server 100.

4th user terminal 600 can show the document (operation S4840) sent.The document that the screen of the 4th user terminal 600 shows is the document based on web.The document that server 100 performs can be displayed on the web browser screen of execution on the 4th user terminal 600.

Figure 49 according to one exemplary embodiment illustrate document for examining, for the video call image examined and for the meeting summary examined by example synchronized with each other.

With reference to Figure 49, can be used in the document of examination, for the video call image examined and the meeting summary for examining synchronized with each other.

Such as, when the first to the 3rd user is when participating in video call on May 21st, 2014, first user (such as, " peace ") sentence " utilance of the patent that enhancing has " can be inputted in a document at 09:03 in the morning on May 21st, 2014, export the voice of " I is the utilance strengthening the patent had by writing target " simultaneously.In the case, server 100 can be synchronous with the meeting details " I is the utilance strengthening the patent had by writing target " in meeting summary by the sentence " utilance of the patent that enhancing has " in document.In addition, the first to the 3rd user when participating in video call on May 21st, 2014, the video call image exported when first user inputs sentence " utilance of the patent that enhancing has " in a document can be synchronous with the document and meeting summary.

In other words, sentence " utilance of the patent that enhancing has " can be synchronous with meeting details " I is the utilance strengthening the patent had by writing target ".Thus sentence " utilance of the patent that enhancing has ", meeting details " I is the utilance strengthening the patent had by writing target " and the video call image that 09:03 exports in the morning on May 21st, 2014 can be synchronized with each other.

Figure 50 illustrates to for providing the server 100 of collaboration services ask the document for examining and examine the process of the editor of document according to one exemplary embodiment.

With reference to Figure 50, the 3rd user terminal 500 can ask the document for examining (operating S5005) to server 100.Such as, the 3rd user can to sign in in server 100 via the 3rd user terminal 500 and select the document for examining among document the list of the collaboration services performed from the 3rd user.The document that 3rd user terminal 500 can be asked for being examined to server 100 according to the selection information of the 3rd user received via user input unit (220 in Fig. 2) subsequently.

Server 100 can in response to the document (operation S5010) of this request retrieval for examining.Such as, server 100 can retrieve the document for examine corresponding with the request from the 3rd user terminal 500 from the document be stored in document D B (155 Fig. 3).

The document being used for examining can be sent to the 3rd user terminal 500 (operation S5015) by server 100.

3rd user terminal 500 can from receive for selecting the document examined by edit segment (operation S5050).Such as, if the 3rd user terminal 500 shows the document for examining, and the 3rd user selects for the sentence in the document examined or paragraph, then to select by edit segment from the document for examining.

3rd user terminal 500 can be sent to server 100 (operation S5025) by about selected by the edit file of edit segment.

Server 100 identifiable design synchronous with the edit file of transmission for the meeting summary examined with for the part (operating S5030) in the video call image examined.Such as, server 100 can determine synchronous with the edit file meeting summary for examining and the video call image for examining based on the synchronizing information comprised in integrated management DB (151 in Fig. 3) from image DB (157 Fig. 3).

The meeting summary that be used for examine synchronous with edit file and the video call image being used for examining can be sent to the 3rd user terminal 500 (operation S5035) by server 100.

Exportable synchronous with the edit file meeting summary for examining of 3rd user terminal 500 and the video call image (operation S5040) for examining.Such as, the 3rd user terminal 500 can via output unit (250 in Fig. 2) export receive for the meeting summary examined and the video call image for examining.

The example of the synchronous images exported in operation S5040 is described in referring now to Figure 51.

Figure 51 illustrates following example according to one exemplary embodiment: when being selected by edit segment of the document for examining, all with selected by synchronous being output in the 3rd user terminal 500 for receiving collaboration services for the meeting summary examined and the video call image for examining of edit segment.

Specifically, Figure 51 illustrates the image 570 of the document for examining and the window 580 of synchronous with the file and picture 570 for the examining video call image for examining and the example that for the meeting summary 590 examined be output to three user terminal 500 synchronous with the file and picture 570 for examining is shown.

In an exemplary embodiment, illustrate that the window 580 of video call image can be displayed in pop-up window or another window.In another one exemplary embodiment, video call image can in response to selection to can the editor of Edit Document or the designator of this editor and be displayed in pop-up window or another window.In another one one exemplary embodiment, video call image can be displayed in pop-up window or another window in response to option from the text entry of project, daily record data or meeting summary.

With reference to Figure 51, the 3rd user terminal 500 can select in the image 570 for examining expression sentence or paragraph by edit segment.Such as, the 3rd user terminal 500 can select to indicate sentence " utilance of the patent that enhancing has " by edit segment.

The meeting summary 590 for examine synchronous by edit segment that 3rd user terminal 500 is exportable with selected.Such as, assuming that when the first to the 3rd user is when participating in video call on May 21st, 2014, first user (such as, " peace ") the morning on May 21st, 2014 09:03 edit sentence " utilance of the patent that enhancing has " in a document, export the voice of " I will write target is strengthen the utilance of patent had " simultaneously.In the case, the exportable meeting summary 590 for examining of the 3rd user terminal 500, wherein meeting details " I is the utilance strengthening the patent had by writing target " is indicated by with runic.

3rd user terminal 500 is also exportable for illustrating and the selected window 580 of video call image for examine synchronous by edit segment.The reproduction bar corresponding with the time span of the video conference carrying out on May 21st, 2014 can be displayed on the window 580 for illustrating the video call image for examining.In addition, for illustrate the video call image for examining window 580 can from the morning on May 21st, 2014 09:03 time corresponding replay position be shown.But one exemplary embodiment is not limited thereto, and for illustrating that the window 580 of the video call image for examining can be the rest image at the replay position place corresponding with 09:03 in the morning on May 21st, 2014.

Figure 52 illustrates to for providing the server 100 of collaboration services to ask the video call image for examining and examining the process of the editor of document according to one exemplary embodiment.

With reference to Figure 52, the 3rd user terminal 500 can ask the video call image for examining (operating S5205) to server 100.Such as, the 3rd user can to sign in in server 100 via the 3rd user terminal 500 and select the video call image for examining among video call image the list of the collaboration services performed from the 3rd user.The video call image that 3rd user terminal 500 can be asked for being examined to server 100 according to the selection information of the 3rd user received via user input unit (220 in Fig. 2) subsequently.

Server 100 can retrieve the video call image (operation S5210) for examining.Such as, server 100 can retrieve the video call image for examine corresponding with the request from the 3rd user terminal 500 from the image be stored in image DB157.

The video call image being used for examining can be sent to the 3rd user terminal 500 (operation S5215) by server 100.

3rd user terminal 500 can from receive for selecting the part (operation S5220) that will reproduce the video call image examined.Such as, if the 3rd user terminal 500 is the video call image display reproduction article for examining, and the 3rd user select to reproduce article a bit, then can select the part that will reproduce from the video call image for examining.

Information about the selected part that will reproduce can be sent to server 100 (operation S5225) by the 3rd user terminal 500.

The synchronizing information about the part that will reproduce of server 100 identifiable design and transmission for the meeting summary examined with for the part (operating S5230) in the document examined.Such as, server 100 can based on the synchronizing information comprised in integrated management DB151 determine from document D B155 and image DB157 respectively with the synchronizing information about the part that will reproduce for the document examined and the meeting summary for examining.

Server 100 can be sent to the 3rd user terminal 500 (operating S5235) by with the meeting summary being used for examining of the synchronizing information about the part that will reproduce and the document that is used for examining.

3rd user terminal 500 exportable with the synchronizing information about the part that will reproduce for the meeting summary examined and the document (operating S5240) for examining.Such as, the 3rd user terminal 500 can via output unit 250 export receive for the meeting summary examined and the document for examining.

The example of the synchronous images exported in operation S5240 is described in referring now to Figure 53.

Figure 53 illustrates following example according to one exemplary embodiment: when the video call image for examining want a reproduced part to be selected time, all with being output in the 3rd user terminal 500 for receiving collaboration services for the meeting summary examined and the document for examining of selected reproduced Partial synchronization.

Specifically, Figure 53 illustrate the video call image illustrated for examining window 580 and all with the video call image synchronization for examining for the meeting summary 590 examined and the example being output to the 3rd user terminal 500 for the image 570 of the document examined.

With reference to Figure 53, the 3rd user terminal 500 can select the part that will reproduce in the video call image for examining.Such as, the 3rd user terminal 500 is by selecting to output to part that some selection will be reproduced from the video call image for examining in the reproduction of video call image examined article of the 3rd user terminal 500.

The meeting summary 590 for examining of the Partial synchronization that will reproduce that the 3rd user terminal 500 is exportable with selected.Such as, assuming that the first to the 3rd user when participating in video call on May 21st, 2014, first user (such as, " peace ") exports the voice saying " I is the utilance strengthening the patent had by writing target ".If the selected part that will reproduce comprises 09:03 in the morning on May 21st, 2014, then the exportable meeting summary 590 for examining indicating sentence " I is the utilance strengthening the patent had by writing target " of the 3rd user terminal 500.

The image 570 of document for examining of the Partial synchronization that will reproduce that the 3rd user terminal 500 is also exportable with selected.Such as, assuming that at the first to the 3rd user first user (such as, " peace ") sentence " utilance of the patent that enhancing has " in the morning on May 21st, 2014 09:03 Edit Document while May 21 in 2014 day entry meeting summary.If the selected part that will reproduce comprises 09:03 in the morning on May 21st, 2014, then the exportable image 570 of document for examining comprising sentence " utilance of the patent that enhancing has " of the 3rd user terminal 500.

The reproduction bar corresponding with the time span of the video conference carrying out on May 21st, 2014 can be displayed on the window 580 for illustrating video call image.In addition, for the video call image examined can from the morning on May 21st, 2014 09:03 time corresponding replay position be shown.But one exemplary embodiment is not limited thereto, and the video call image for examining can be the rest image at the replay position place corresponding with 09:03 in the morning on May 21st, 2014.

Figure 54 illustrates to for providing the server 100 of collaboration services ask the meeting summary for examining and examine the process of the editor of document according to one exemplary embodiment.

With reference to Figure 54, the 3rd user terminal 500 can ask the meeting summary for examining (operating S5405) to server 100.Such as, the 3rd user can to sign in in server 100 via the 3rd user terminal 500 and select the meeting summary for examining among meeting summary the list of the collaboration services performed from the 3rd user.The meeting summary that 3rd user terminal 500 can be asked for being examined to server 100 according to the selection information of the 3rd user received via user input unit 220 subsequently.

Server 100 can retrieve the meeting summary (operation S5410) for examining.Such as, server 100 can retrieve the meeting summary for examine corresponding with the request from the 3rd user terminal 500 from the meeting summary be stored in image DB157.

The meeting summary being used for examining can be sent to the 3rd user terminal 500 (operation S5415) by server 100.

3rd user terminal 500 can from receive for selecting the part (operation S5420) that will reproduce the meeting summary examined.Such as, if the 3rd user terminal 500 shows the meeting summary for examining, and the 3rd user selects for the region in the meeting summary examined, then the text at corresponding with selected region time point place can be selected.

Information about selected text can be sent to server 100 (operation S5425) by the 3rd user terminal 500.

Server 100 identifiable design synchronous with the text message of transmission for the video call image examined with for the part (operating S5430) in the document examined.Such as, server 100 can determine synchronous with the text message document for examining and the video call image for examining respectively based on the synchronizing information comprised in integrated management DB151 from document D B155 and image DB157.

The video call image that be used for examine synchronous with text message and the document being used for examining can be sent to the 3rd user terminal 500 (operation S5435) by server 100.

Exportable synchronous with the text message video call image for examining of 3rd user terminal 500 and the document (operation S5440) for examining.Such as, the 3rd user terminal 500 can via output unit 250 export receive for the video call image examined and the document for examining.

The example of the synchronous images exported in operation S5440 is described in detail in referring now to Figure 55.

Figure 55 illustrates following example according to one exemplary embodiment: when the text in the meeting summary for examining is selected, all with being output in the 3rd user terminal 500 for receiving collaboration services for the video call image examined and the document for examining of selected context synchronization.

Specifically, Figure 55 example of illustrating meeting summary 590 for examining and all synchronous with the meeting summary 590 for examining video call image 580 for examining and being output to the 3rd user terminal 500 for the image 570 of the document examined.

With reference to Figure 55, the 3rd user terminal 500 can select the text at the particular point in time place in the meeting summary 590 for examining.Such as, the 3rd user terminal 500 can select the corresponding text " I is the utilance strengthening the patent had by writing target " of meeting details with 09:03 in the morning on May 21st, 2014.

The video call image for examining of the context synchronization that the 3rd user terminal 500 is exportable with selected.The reproduction bar corresponding with the time span of the video conference carrying out on May 21st, 2014 can be displayed on the video call image for examining.In addition, for the video call image examined can from the morning on May 21st, 2014 09:03 time corresponding replay position be shown.But one exemplary embodiment is not limited thereto, and the video call image for examining can be the rest image at the replay position place corresponding with 09:03 in the morning on May 21st, 2014.

The image 570 of document for examining of the context synchronization that the 3rd user terminal 500 is also exportable with selected.Such as, assuming that the first to the 3rd user while May 21 in 2014 day entry meeting summary first user (such as, " peace ") the morning on May 21st, 2014 09:03 edit sentence " utilance of the patent that enhancing has ".If the time corresponding with selected text is 09:03 in the morning on May 21st, 2014, then the image 570 of document for examining of the exportable instruction sentence of the 3rd user terminal 500 " utilance of the patent that enhancing has ".

Figure 56 is the flow chart providing the method for collaboration services according to one exemplary embodiment.

With reference to Figure 56, the method for collaboration services that provides according to the present embodiment comprises by the operation for providing the server of collaboration services to perform in chronological order of Fig. 3.Thus although eliminate below, the above description about server 100 may be used on the method for Figure 56.

Server 100 receives the video call image that is associated with each user of Edit Document and about by the edit file (operating S5610) of document of editing from the user terminal of request collaboration services.

Server 100 is by the details of the meeting summary of the speech production comprised based on the video call image be associated with each user and the document-synchronization (operating S5620) according to the edit file editor received.

Server 100 store receive the video call image be associated with each user, meeting summary details and by the document (operating S5630) edited.

With reference to Figure 57, comprise the operation performed in chronological order by the user terminal 200 of Fig. 2 according to the method for the reception collaboration services of the present embodiment.Thus although eliminate below, the above description about user terminal 200 may be used on the method for Figure 57.

User terminal 200 obtains the video call image that obtained by the voice and video executive signal process to user and about by the edit file (operation S5710) of document of editing.

Obtained video call image and edit file are sent to the server 100 (operation S5720) for providing collaboration services by user terminal 200.

User terminal 200 from server 100 receive be associated with each user of Edit Document video call image, based on the meeting summary of the speech production comprised with the video call image that each user is associated and the document synchronous with the details of meeting summary (operating S5730).

User terminal 200 exports the video call image be associated with each user, meeting summary and the document (operating S5740) that receive.

The method of collaboration services being provided or receiving the method for collaboration services and can be recorded in the program that can perform on computers according to one exemplary embodiment, and by computer readable recording medium storing program for performing being utilized to run or perform the general purpose digital computer of these programs and one or more processor realizes.The example of computer readable recording medium storing program for performing comprises the recording medium of such as magnetic storage medium (such as, floppy disk, hard disk etc.) and optical recording media (such as, CD-ROM or DVD) and so on.

Although one or more one exemplary embodiment has been described with reference to the drawings, but those of ordinary skill in the art will be understood that, when not departing from the spirit and scope of the inventive concept be defined by the following claims, the change in various forms and details can be carried out to it.Thus one exemplary embodiment described herein should only take in descriptive sense, instead of in order to limit.The scope of inventive concept can't help to limit the detailed description of one exemplary embodiment, and is limited by claims, and all differences in the scope of claims and equivalent thereof all will be interpreted as being included in inventive concept.

Claims

1., for providing a server for collaboration services, this server comprises:

Memory, is configured to store computer executable instructions; And

Processor, is configured to process described computer executable instructions:

There is provided the first area that comprises display video and display can the screen of second area of Edit Document,

Receive the selection to the time point of described video, and

Can Edit Document described in providing according to the state corresponding with the time point selected by described video.

2. server as claimed in claim 1, wherein, described processor is also configured to process described computer executable instructions:

Receive to described can the selection of editor of Edit Document; And

Described video is reproduced from the time point corresponding with selected editor.

3. server as claimed in claim 1, wherein, described screen also comprises the 3rd region, the time point of the 3rd region display and described video and to described can the text entry of the corresponding project of the editor of Edit Document.

4. server as claimed in claim 3, wherein, described processor is also configured to process described computer executable instructions:

Receive the selection to project from the text entry of described project;

Described video is reproduced from the time point corresponding with selected project; And

Can Edit Document described in providing according to the state corresponding with selected project.

5. server as claimed in claim 3, wherein, described processor is also configured to process described computer executable instructions:

Based on the text entry of project described in the speech production in described video.

6. server as claimed in claim 3, wherein, described processor is also configured to process described computer executable instructions:

The editor of Edit Document the text entry of described project can be generated based on to described.

7. server as claimed in claim 1, wherein, describedly can be displayed in word processing program by Edit Document.

8., for providing a method for collaboration services, the method comprises:

Display comprises the first area of display video and display can the screen of second area of Edit Document;

Receive the selection to the time point of described video; And

Can Edit Document described in showing according to the state corresponding with the time point selected by described video.

9., for providing a terminal for collaboration services, this terminal comprises:

Display, being configured to show the first area that comprises display video and display can the screen of second area of Edit Document;

Input equipment, is configured to receive the selection to the time point of described video; And

Controller, be configured to control described display according to the state corresponding with the time point selected by described video show described can Edit Document.

10. terminal as claimed in claim 9, wherein:

Described input equipment be also configured to receive to described can the selection of editor of Edit Document, and

Described controller is also configured to control described display and reproduces described video from the time point corresponding with selected editor.

11. terminals as claimed in claim 9, wherein, described screen also comprises the 3rd region, the 3rd region display and the time point of described video and to described can the text entry of the corresponding project of the editor of Edit Document.

12. terminals as claimed in claim 11, wherein:

Described input equipment is also configured to receive the selection to project from the text entry of described project, and

Described controller is also configured to:

Control described display and reproduce described video from the time point corresponding with selected project, and

Control described display according to the state corresponding with selected project show described can Edit Document.

13. terminals as claimed in claim 11, wherein, the text entry of described project is based on the speech production in described video.

14. terminals as claimed in claim 11, wherein, the text entry of described project can the editor of Edit Document generate based on to described.

15. terminals as claimed in claim 9, wherein, describedly can be displayed in word processing program by Edit Document.