CN111144074B

CN111144074B - Document cooperation method and device, computer readable storage medium and computer equipment

Info

Publication number: CN111144074B
Application number: CN201811308519.0A
Authority: CN
Inventors: 廖戈语; 秦银; 邱玲; 廖宣任; 李彦涛; 杨泽宇; 卢锟
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2018-11-05
Filing date: 2018-11-05
Publication date: 2022-04-22
Anticipated expiration: 2038-11-05
Also published as: CN111144074A

Abstract

The application relates to a document cooperation method, a device, a computer readable storage medium and a computer device, wherein the method comprises the following steps: displaying a document page for performing online collaboration on a target document; displaying members participating in the online collaboration on the document page; when voice cooperation triggering operation occurs, initiating voice call invitation according to a member to which the voice cooperation triggering operation points; and when a connection response responding to the voice call invitation is received, establishing a voice call link for performing voice collaboration on the target document. The scheme provided by the application can improve the document cooperation efficiency.

Description

Document cooperation method and device, computer readable storage medium and computer equipment

Technical Field

The present application relates to the field of computer technologies, and in particular, to a document collaboration method, an apparatus, a computer-readable storage medium, and a computer device.

Background

With the development of computer technology, more and more office software is developed to assist people in daily office work. For example, in the field of office documentation, online documents are emerging. The online document is a webpage document, provides an online editing function, and can be edited and stored in real time by a user. The online document can also provide the functions of editing the document by multiple persons in real time and collaboratively editing the document by the multiple persons.

In a traditional online document, when a plurality of people collaboratively edit the document, a method of leaving messages in the document is usually adopted for collaborative communication, so that a collaborative communication method of leaving messages asynchronously has low collaborative efficiency.

Disclosure of Invention

In view of the above, it is necessary to provide a document cooperation method, apparatus, computer-readable storage medium and computer device for solving the technical problem of inefficient document cooperation of online documents.

A document collaboration method, comprising:

displaying a document page for performing online collaboration on a target document;

displaying members participating in the online collaboration on the document page;

when voice cooperation triggering operation occurs, initiating voice call invitation according to a member to which the voice cooperation triggering operation points;

and when a connection response responding to the voice call invitation is received, establishing a voice call link for performing voice collaboration on the target document.

An apparatus for document collaboration, the apparatus comprising:

the display module is used for displaying a document page for performing online collaboration on a target document;

the display module is also used for displaying the members participating in the online collaboration on the document page;

the voice call invitation initiating module is used for initiating voice call invitation according to the member pointed by the voice cooperation triggering operation when the voice cooperation triggering operation occurs;

and the voice call link establishing module is used for establishing a voice call link for performing voice collaboration on the target document when receiving a connection response responding to the voice call invitation.

A computer-readable storage medium storing a computer program which, when executed by a processor, causes the processor to perform the steps of the document collaboration method.

A computer device comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, causes the processor to perform the steps of the method of document collaboration.

According to the document cooperation method, the document cooperation device, the computer-readable storage medium and the computer equipment, the members participating in online cooperation are shown in the document page for performing online cooperation on the target document, so that a user can intuitively know other members currently participating in online cooperation. And when the voice cooperation triggering operation occurs, initiating voice call invitation according to the member pointed by the voice cooperation triggering operation. When the corresponding member triggers the connection response, a voice call link is established, and the user can perform voice collaboration on the target document. Therefore, the voice collaboration is carried out in the document page without departing from the target document, the target document can be edited, the voice communication collaboration can be conveniently carried out in real time, and the document collaboration efficiency is greatly improved.

A document collaboration method, comprising:

receiving a voice call invitation initiated by a terminal corresponding to a member participating in the online cooperation;

responding to the voice call invitation, and showing a response option on the document page;

when a triggering operation occurs for a response option for triggering a connection response, then

And sending a connection response for establishing a voice call link between the terminal and the terminal to the terminal, wherein the voice call link is used for carrying out voice collaboration on the target document.

A document collaboration apparatus, the apparatus comprising:

the receiving module is used for receiving voice call invitation initiated by a terminal corresponding to a member participating in the online cooperation;

the display module is also used for responding to the voice call invitation and displaying a response option on the document page;

and the sending module is used for sending a connection response for establishing a voice call link with the terminal to the terminal when the triggering operation of a response option for triggering the connection response occurs, wherein the voice call link is used for carrying out voice collaboration on the target document.

A computer device comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, causes the processor to perform the steps of the document collaboration method.

The document cooperation method, the document cooperation device, the computer readable storage medium and the computer equipment show a document page for performing online cooperation on a target document, and receive voice call invitation initiated by terminals corresponding to other users participating in the online cooperation in the document page. And displaying a response option on a document page, and when the triggering operation of the response option for triggering the connection response occurs, sending a connection response for establishing a voice call link to the terminal, wherein the user can perform voice collaboration on the target document through the voice call link. Therefore, the voice collaboration is carried out in the document page without departing from the target document, the target document can be edited, the voice communication collaboration can be conveniently carried out in real time, and the document collaboration efficiency is greatly improved.

Drawings

FIG. 1 is a diagram of an application environment of a document collaboration method in one embodiment;

FIG. 2 is a flowchart illustrating a method of document collaboration in one embodiment;

FIG. 3(a) is an interface diagram that illustrates, in one embodiment, member identifiers corresponding to members participating in an online collaboration on a stack of document pages;

FIG. 3(b) is a schematic diagram illustrating an interface where entries in a member identifier display pane show member identifiers corresponding to members participating in online collaboration in one embodiment;

fig. 3(c) is an interface diagram after the first terminal initiates a voice call invitation to the second terminal in an embodiment;

FIG. 3(d) is a schematic interface diagram illustrating a first terminal establishing a voice call link with a second terminal according to an embodiment;

FIG. 4 is a flowchart illustrating the steps of text collaboration on a target document in one embodiment;

FIG. 5(a) is a schematic diagram of an interface showing a text collaboration options menu in one embodiment;

FIG. 5(b) is a diagram illustrating an interface of a text collaboration options menu, in one embodiment;

FIG. 6 is a flowchart illustrating steps in one embodiment for performing a corresponding collaboration operation based on a selected text collaboration option;

FIG. 7(a) is an interface diagram that illustrates invoking a voice markup control, in one embodiment;

FIG. 7(b) is a schematic diagram of an interface for recording voice data according to an embodiment;

FIG. 7(c) is a diagram of an interface for displaying markup text in a voice markup control, in one embodiment;

FIG. 7(d) is an interface diagram that illustrates a markup box including markup text, in one embodiment;

FIG. 8 is a flowchart illustrating steps in one embodiment for performing a corresponding collaboration operation based on a selected text collaboration option;

FIG. 9(a) is an interface diagram illustrating the division of annotation regions at positions acted on by text collaboration trigger operations in one embodiment;

FIG. 9(b) is a diagram of an interface for displaying annotation text in an annotation area in one embodiment;

FIG. 10 is an interface diagram of a multi-person voice call management interface in accordance with an embodiment;

FIG. 11 is a flowchart illustrating a method of document collaboration in one embodiment;

FIG. 12 is a flowchart showing a document cooperation method in one embodiment;

FIG. 13(a) is an exemplary interface diagram illustrating an embodiment of receiving a voice call invitation initiated by a terminal corresponding to a member participating in online collaboration;

FIG. 13(b) is a diagram illustrating an interface for joining voice collaboration in one embodiment;

FIG. 14 is a diagram of a voice collaboration interaction architecture in one embodiment;

FIG. 15 is a sequence diagram of a document cooperation method in one embodiment;

FIG. 16 is a block diagram showing the construction of a document cooperation apparatus in one embodiment;

FIG. 17 is a block diagram showing a configuration of a document cooperation apparatus in another embodiment;

FIG. 18 is a block diagram showing the construction of a document cooperation apparatus in one embodiment;

FIG. 19 is a block diagram showing the construction of a document cooperation apparatus in another embodiment;

FIG. 20 is a block diagram showing the structure of a computer device in one embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.

FIG. 1 is a diagram of an application environment of a document collaboration method in one embodiment. Referring to fig. 1, the document collaboration method is applied to a document collaboration system. The document collaboration system includes a first terminal 110, a second terminal 120, and a server 130. The first terminal 110 and the server 130 are connected through a network, and the second terminal 120 and the server 130 are connected through a network. The first terminal 110 and the second terminal 120 may be specifically desktop terminals or mobile terminals, and the mobile terminals may be specifically at least one of a mobile phone, a tablet computer, a notebook computer, and the like. The server 130 may be implemented as a stand-alone server or a server cluster composed of a plurality of servers. It will be appreciated that the first terminal and the second terminal are used herein to distinguish between different terminals, and that both the first terminal and the second terminal may be referred to as terminals without causing ambiguity.

As shown in FIG. 2, in one embodiment, a document collaboration method is provided. The embodiment is mainly illustrated by applying the method to the first terminal 110 in fig. 1. Referring to fig. 2, the document collaboration method specifically includes the following steps:

s202, displaying a document page for performing online collaboration on the target document.

The target document is an online document and is a webpage document, and a user can edit the target document online or save the target document in real time. The target document may be specifically an online word document, an excel document, or a PPT document. Online collaboration refers to operations such as multiple collaborators viewing or editing a target document online. Where collaborators are users who view or edit a document together. The document page is a display page of the target document, and specifically may include a text region and a title region.

Specifically, the first terminal may have a target document stored thereon, or the first terminal may access a server to obtain the target document. After the user enters the target document through the user identification, the first terminal can display a document page for performing online collaboration on the target document. The user identifier is used for uniquely identifying the user, and specifically may be a user account, a user certificate number, a user mobile phone number, and the like.

In one embodiment, a document application is run on the first terminal, and a user can log in the document application through a user identifier and open a target document through the document application. The document application exposes document pages for online collaboration on the target document.

In one embodiment, a user may create a target document through a document application and store the target document in a server corresponding to the document application based on a currently logged-in user identification. Or, the first terminal may obtain the target document through communication modes such as USB (Universal Serial Bus) interface connection or network connection, and enter the target document through the document application.

S204, displaying the members participating in online collaboration on the document page.

Specifically, the first terminal may determine the members currently participating in online collaboration on the target document, and display the members participating in online collaboration in the document page. In one embodiment, the first terminal may present member identifications corresponding to members participating in online collaboration in a document page. The member identifier is used to uniquely identify a member participating in online collaboration, and specifically may be a user avatar, a user name, or a user account corresponding to the member participating in online collaboration.

For example, the first terminal may display a document page through a document application, where the document application determines user accounts corresponding to members currently opening the target document, and displays user avatars corresponding to the user accounts in the document page.

In one embodiment, the step S204, namely the step of presenting the members participating in the online collaboration on the document page specifically includes the following steps: stacking and displaying member identifications corresponding to members participating in online collaboration on a document page; when the triggering operation acting on the member identification is detected, the member identification display panel is called up; and displaying the member identification corresponding to the member participating in the online collaboration in an item manner in a member identification display panel.

The triggering operation is a preset operation acting on the member identification, and when the triggering operation is detected, the member identification display panel is turned off. The trigger operation may specifically be a touch operation, a cursor operation, a key operation, or a voice operation. The touch operation can be touch click operation, touch press operation or touch slide operation, and the touch operation can be single-point touch operation or multi-point touch operation; the cursor operation can be an operation of controlling a cursor to click or an operation of controlling the cursor to press; the key operation may be a virtual key operation or a physical key operation, etc.

Specifically, the first terminal may display member identifiers corresponding to members participating in online collaboration in a header area of a document page in a stacked manner. In one embodiment, when a plurality of members participating in online collaboration are provided, the first terminal can stack and display member identifiers corresponding to the members in a document page according to the time sequence participating in online collaboration. The member identification is, for example, a user avatar, a user name or a user account of the member participating in the online collaboration, etc.

When the first terminal detects the trigger operation acting on the member identification, the first terminal can call up the member identification display panel and display the member identification display panel partially covering the document page. The first terminal can display member identifications corresponding to members participating in online collaboration in a member identification display panel in an entry manner, wherein each entry corresponds to one member identification.

In one embodiment, the first terminal may place the member identification display panel in a collapsed state when the document page is displayed; and when the predefined trigger operation acting on the member identification is detected, the member identification display panel is set to be in the unfolded state.

Wherein the member identification display panel has a stowed state and a deployed state. The member identification display panel in the stowed state is not visible or only displays graphics representing the member identification display panel. The member identification display panel in the unfolded state can be displayed in different sizes under different use scenes.

Referring to FIG. 3(a), FIG. 3(a) is an interface diagram that illustrates member identifications corresponding to members participating in an online collaboration on a stack of document pages, in one embodiment. Fig. 3(a) shows a document page with a target document, the document page including a text region 310 and a title region 320. The document content of the target document is shown in the text area, and the member identification 322 corresponding to the member participating in online collaboration is shown in the title area. The title area 320 further shows a permission level virtual key 321, and a user may view a permission level corresponding to a currently registered member by clicking the virtual key, such as a viewing permission or an editing permission. Also shown in the header area 320 is a function key 323 that the user can click or press to perform normal operations on the target document. Such as sharing the target document, saving the target document as a target template, or generating a copy document, etc.

Referring to fig. 3(b), fig. 3(b) is a schematic interface diagram illustrating an example of displaying member identifiers corresponding to members participating in online collaboration in an entry manner in a member identifier display panel. Referring to fig. 3(b), when the first terminal detects a trigger operation applied to a member identifier (such as a user avatar), the member identifier display panel 324 partially covers the document page for displaying. And displaying the user head portraits and user names corresponding to the members participating in the online collaboration in an item manner in a member identification display panel.

In one embodiment, the first terminal may display the member identifiers corresponding to the members participating in the online collaboration in an entry manner in the member identifier display panel according to the group categories to which the members participating in the online collaboration belong and the corresponding group categories. Specifically, the first terminal can classify the members participating in the online collaboration according to the corresponding operation authority of the user; or, the first terminal may also classify the members participating in the online collaboration according to the session group corresponding to the user; alternatively, the first terminal may further classify the members participating in the online collaboration according to a user-defined category.

In the above embodiment, the member identifiers corresponding to the members participating in the online collaboration are displayed in the document page stack, and only when the trigger operation is detected, the member identifiers corresponding to the members participating in the online collaboration are displayed in the member identifier display panel in an entry manner. Therefore, the occupied area can be greatly reduced, and the method is suitable for the mobile terminal with a limited display interface.

S206, when the voice cooperation triggering operation occurs, initiating voice call invitation according to the member pointed by the voice cooperation triggering operation.

Wherein the voice collaboration trigger operation is a trigger operation for initiating a voice call invitation. The trigger operation may specifically be a touch operation, a cursor operation, a key operation, or a voice operation. Specifically, the first terminal may detect the voice collaboration trigger operation in real time or at regular time. When the voice cooperation triggering operation occurs, the first terminal can determine the member pointed by the voice cooperation triggering operation and initiate voice call invitation to the corresponding second terminal.

In one embodiment, the document page may present user identity information corresponding to members participating in the online collaboration. The user identity information is information which corresponds to a member participating in online collaboration and can indicate the identity of the member, such as a user avatar, a user tag, or a user category. When the voice collaboration triggering operation acting on the displayed user identity information occurs, the first terminal can initiate voice call invitation according to the user identity information acted by the voice collaboration triggering operation.

In one embodiment, when the user identity information only corresponds to the member participating in the document cooperation, the first terminal may initiate a voice call invitation to the corresponding second terminal directly according to the user identity information. When the user identity information is not uniquely corresponding to the members participating in the document cooperation, for example, a plurality of members correspond to the same user identity information, at this time, the first terminal may determine a member identifier corresponding to the user identity information acted by the voice cooperation triggering operation, and initiate a voice call invitation to a second terminal corresponding to the member identifier.

In one embodiment, when the voice collaboration triggering operation points to all members participating in online collaboration, the first terminal may initiate a voice call invitation to a second terminal corresponding to all the members currently participating in online collaboration.

In one embodiment, when the voice collaboration trigger operation points to a group member, the first terminal determines that the member identifier acted by the voice collaboration trigger operation belongs to a group to which the member corresponding to the member identifier belongs, and invites a voice call to the second terminal corresponding to all members in the group.

In one embodiment, when the voice collaboration trigger operation is directed to a single member, the first terminal invites a voice call to a second terminal corresponding to the member.

In an embodiment, referring to fig. 3(c), fig. 3(c) is a schematic diagram of an interface after a first terminal initiates a voice call invitation to a second terminal. As shown in fig. 3(c), when the first terminal initiates a voice call invitation to the second terminal, the header area of the document page may transition to a voice collaboration mode, displaying words such as "waiting for member to join". Referring to fig. 3(d), fig. 3(d) is a schematic interface diagram of the first terminal establishing a voice call link with the second terminal. When the number of the second terminals is multiple, the first terminal can establish a voice call link with any second terminal as long as the first terminal receives a connection response fed back by the second terminal. Other second terminals can enter the voice call link to form a multi-person voice call link. At this time, as shown in fig. 3(d), the title area of the document page may display the word "in voice call" and the like, and display the avatar of the user corresponding to the member participating in the current voice collaboration.

And S208, when the connection response responding to the voice call invitation is received, establishing a voice call link for performing voice collaboration on the target document.

Wherein, the voice call link is a channel capable of voice transmission. Specifically, when the first terminal receives a connection response from the second terminal, a voice communication link between the first terminal and the second terminal may be established. The user holding the first terminal and the user holding the second terminal can perform voice collaboration on the target document through the voice call link.

In one embodiment, the second terminal receives an invitation to participate in a voice call initiated by the first terminal and presents a response option in a document page. The response option may specifically include a response option of connecting the response and/or a response option of rejecting the response. When the second terminal detects a trigger operation for a response option for triggering a connection response, the connection response may be transmitted to the first terminal. And the first terminal establishes a voice call link with the second terminal according to the connection response.

It is understood that the number of the second terminals may be one or more, and when the number of the second terminals is one, the two-person voice call link between the first terminal and the second terminal is established. When the number of the second terminals is plural, the multi-person voice call link may be established.

In one embodiment, step S206 specifically includes: and when voice cooperation triggering operation pointing to all members participating in online cooperation occurs, respectively initiating voice call invitation to terminals corresponding to all members participating in online cooperation. Step S208 specifically includes: receiving a connection response from the terminal in response to the voice call invitation; establishing a multi-user voice call link between terminals corresponding to the received connection response; the voice call link is used for multi-person voice collaboration on the target document.

In one embodiment, when a voice collaboration triggering operation directed to all members participating in the online collaboration occurs, the first terminal may initiate a voice call invitation to the second terminals corresponding to all the members currently participating in the online collaboration. When the second terminal receives the voice call invitation initiated by the first terminal, the response option can be displayed in the document page. When the second terminal detects a trigger operation for a response option for triggering a connection response, the connection response may be transmitted to the first terminal. The first terminal establishes a multi-user voice call link between the terminals corresponding to the received connection response. And the users respectively holding the first terminal and the second terminal can carry out multi-person voice cooperation on the target document through the multi-person voice call link.

In one embodiment, when the number of the second terminals is plural, and at least one of the second terminals sends a connection response to the first terminal, a multi-person voice call link between the first terminal and the second terminal may be established. After the multi-person voice communication link is successfully established, other invited members can join the multi-person voice communication link at any time. Therefore, voice communication invitations can be conveniently and quickly initiated to the terminals corresponding to all members participating in online cooperation according to voice cooperation triggering operation triggered by users, and a multi-user voice communication link is established, so that multi-user voice cooperation aiming at a target document is realized.

According to the document cooperation method, the members participating in online cooperation are displayed in the document page for performing online cooperation on the target document, so that the user can intuitively know other members participating in online cooperation. And when the voice cooperation triggering operation occurs, initiating voice communication invitation according to the member to which the voice cooperation triggering operation points. When the corresponding member triggers the connection response, a voice call link is established, and the user can perform voice collaboration on the target document. Therefore, the voice collaboration is carried out in the document page without departing from the target document, the target document can be edited, the voice communication collaboration can be conveniently carried out in real time, and the document collaboration efficiency is greatly improved.

In one embodiment, the document collaboration method further includes a step of performing text collaboration on the target document, where the step specifically includes:

s402, when the text collaboration triggering operation acting on the document area in the document page is detected, displaying a text collaboration option menu at the position acted by the text collaboration triggering operation.

The text cooperation triggering operation is triggering operation for triggering text cooperation on the target document, and when the text cooperation triggering operation is detected, a text cooperation option menu is displayed at a position acted by the text cooperation triggering operation. The trigger operation may specifically be a touch operation, a cursor operation, a key operation, or a voice operation. The text collaboration options menu is a control that includes a plurality of text collaboration options. The text collaboration option may specifically include a text mark option, a text annotation option, a text insertion option, a text sharing option, and the like.

Specifically, the first terminal may detect in real time or at regular time a text cooperation trigger operation acting on a document area in a document page. And when the text collaboration triggering operation is detected, displaying a text collaboration option menu at the position acted by the text collaboration triggering operation.

Referring to FIG. 5(a), FIG. 5(a) is an interface illustration showing a text collaboration options menu in one embodiment. As shown in fig. 5(a), when the user selects text presented in the document region through the cursor, a text collaboration option menu may be presented at the selected text position. The text collaboration options menu includes a text markup option, a text annotation option, a text insertion option, and a text sharing option.

Referring to FIG. 5(b), FIG. 5(b) is an illustration of an interface showing a text collaboration options menu in one embodiment. As shown in fig. 5(b), when the user performs a click or press operation on the document region, the first terminal may present a text collaboration option menu at the position. The text collaboration options menu includes a text markup option, a text annotation option, a text insertion option, and a text sharing option.

S404, determining the text collaboration option selected from the text collaboration option menu.

Specifically, the first terminal can detect a trigger operation aiming at the text collaboration option menu, and takes the text collaboration option acted by the trigger operation as the text collaboration option selected from the text collaboration option menu.

S406, executing corresponding text cooperation operation according to the selected text cooperation option.

Specifically, the first terminal may execute a corresponding text collaboration operation according to the selected text collaboration option. For example, when the selected text collaboration option is a text tagging option, a text tagging operation may be performed. When the selected text collaboration option is a text annotation option, a text annotation operation can be performed.

In the above embodiment, when the text collaboration triggering operation acting on the document area in the document page is detected, the text collaboration option menu is displayed at the position where the text collaboration triggering operation acts, and corresponding text collaboration operation can be performed according to the text collaboration options in the text collaboration option menu.

In an embodiment, in step S406, that is, according to the selected text collaboration option, the step of performing the corresponding text collaboration operation specifically includes the following steps:

s602, when the selected text collaboration option is a text mark option, calling a voice mark control.

The voice mark control is a control for triggering voice mark, and can be displayed in a text area in a virtual panel form. Specifically, when the first terminal detects a selected operation for the text markup option, the voice markup control can be invoked.

Referring to FIG. 7(a), FIG. 7(a) is an interface diagram illustrating invoking a voice markup control in one embodiment. When the user clicks on the text markup option displayed as "markup" from the text collaboration options menu, the interface diagram shown in FIG. 7(a) appears. As shown in fig. 7(a), a voice markup control is presented at a position where a text collaboration trigger operation is applied. The voice marking control comprises a recording starting key which can trigger the recording of voice data.

And S604, recording the marked voice data through the voice marking control.

Specifically, the first terminal records voice data when detecting a recording start operation acting on the voice mark control. Wherein the recording start operation is a trigger operation for starting recording of the voice data. The recording start operation may be any preset trigger operation, such as a touch operation, a cursor click operation, a physical key pressing operation, or a shaking operation when the voice mark control is invoked. The recording start operation acts on the voice mark control, and specifically may act on any region, a preset region, or a preset virtual key in the voice mark control.

Specifically, the first terminal calls a local sound acquisition device when detecting a recording start operation acting on the voice mark control, and enters a voice recording state after the sound acquisition device makes a recording preparation. The first terminal can collect voice and record and mark voice data when the user inputs voice after entering the voice recording state.

In one embodiment, the first terminal may start recording the marked voice data when the sound is detected, and end the recording until a recording end condition is satisfied, to obtain the marked voice data. The recording end condition may be that a preset time length is reached from the start of recording, that a silence state is detected to reach the preset time length, or that a recording end operation is detected.

In one embodiment, the voice tagging control comprises a recording start key, the recording start key is a virtual key, and when the first terminal detects a pressing operation of the recording start key, the first terminal records the tagged voice data. And when the end of the pressing operation is detected, ending the recording.

Referring to fig. 7(b), fig. 7(b) is a schematic diagram of an interface for recording voice data according to an embodiment. When the user presses the recording start button in fig. 7(b) for a long time, the first terminal may perform voice data acquisition, and when the pressing operation is finished, the recording is finished.

And S606, displaying a first mark text obtained by identifying and marking the voice data in the voice mark control.

Specifically, the first terminal may obtain a first markup text obtained by performing voice recognition on the markup voice data, and display the obtained first markup text in the voice markup control. Wherein, the voice recognition is a process of recognizing text from the language data.

In one embodiment, the first terminal may perform local voice recognition on the tagged voice data directly to obtain a first tagged text corresponding to the tagged voice data. The first terminal may also send the marked voice data to the server, and the server performs voice recognition on the marked voice data and receives a first marked text obtained by performing voice recognition on the marked voice data and fed back by the server.

Referring to fig. 7(c), fig. 7(c) is a schematic diagram of an interface for displaying a first markup text in a voice markup control according to an embodiment. After the first terminal collects the marked voice data, a first marked text obtained by performing voice recognition on the marked voice data can be obtained, and the first marked text is displayed in the voice marking control. The voice markup control includes a confirm option and a cancel option. When the user clicks on the confirmation option, then FIG. 7(d) may be entered.

S608, when a confirmation operation corresponding to the first markup text is detected, the replacement voice markup control displays a markup box including the first markup text.

The confirming operation is a preset triggering operation and is used for confirming the first mark text to be input into the voice mark control. The confirmation operation acts on the voice mark control, and specifically may act on any region of the voice mark control, a preset region, or a preset control in the voice input panel.

Specifically, the first terminal may detect a confirmation operation corresponding to the first markup text after displaying the first markup text in the voice markup control. When the first terminal detects a confirmation operation corresponding to the first markup text, the markup box including the first markup text is displayed in place of the voice markup control.

In one embodiment, the terminal may clear the first markup text displayed in the voice markup control upon detecting a cancel operation corresponding to the confirmation operation of the first markup text.

In one embodiment, when the first terminal displays a markup box including the first markup text in place of the voice markup control, the currently selected text may be underlined so that the markup content is clearer and clearer.

Referring to fig. 7(d), 7(d) is an interface diagram showing a markup box including a first markup text in one embodiment. When the user clicks the confirmation option in the document page corresponding to the interface diagram shown in fig. 7(c), the first terminal displays the markup frame including the first markup text instead of the voice markup control.

S610, synchronizing the first mark text to the terminal corresponding to the member participating in the online cooperation in real time.

Specifically, the first terminal may synchronize the first markup text in real time to terminals corresponding to members participating in online collaboration. In one embodiment, the first terminal may upload the marked voice data to the server, and the server performs voice recognition on the marked voice data to obtain a first marked text, and writes the first marked text into the mark box. The server can update the target document according to the mark box containing the first mark text and synchronize to the terminals corresponding to all the members participating in the online collaboration in real time.

In the above embodiment, the marked voice data is recorded through the voice marking control, the first marked text obtained by identifying the marked voice data is displayed in the marking frame, and real-time synchronization can be performed among the terminals. Therefore, when a plurality of people collaborate the document in the text, manual editing is not needed, and the collaboration efficiency of the document collaboration can be greatly improved.

In an embodiment, in step S406, that is, according to the selected text collaboration option, the step of performing the corresponding text collaboration operation specifically includes the following steps: when the selected text collaboration option is a text marking option, displaying a voice marking control; when a mark triggering operation acting on the voice mark control occurs, determining voice collaboration data transmitted through a voice communication link in a time period when the mark triggering operation takes effect; displaying a second mark text obtained by recognizing the voice collaboration data in the voice mark control; displaying a mark-up box including a second mark-up text in place of the voice mark-up control when a confirmation operation corresponding to the second mark-up text is detected; and synchronizing the second mark text to the terminal corresponding to the member participating in the online cooperation in real time.

Wherein the flag triggering operation is an operation for triggering a flag. The time period for the mark trigger operation to take effect may be specifically a time period from the occurrence of the mark trigger operation to the occurrence of the end operation, a time period from the detection of the pressing operation to the end of the pressing operation, or a time period from the occurrence of the mark trigger operation to a preset time period.

Specifically, when the first terminal detects a selection operation for the text mark option, the voice mark control can be called. Virtual keys for triggering the mark triggering operation can be displayed on the voice mark control. When the mark triggering operation acting on the voice mark control occurs, the first terminal can determine the voice collaboration data transmitted through the voice call link in the period when the mark triggering operation takes effect.

Further, the first terminal can directly perform voice recognition on the voice collaboration data locally to obtain a second tagged text corresponding to the voice collaboration data. The first terminal may also send the voice collaboration data to the server, and the server performs voice recognition on the voice collaboration data and receives a second tagged text obtained by performing voice recognition on the voice collaboration data and fed back by the server.

In one embodiment, when a mark triggering operation acting on the voice mark control occurs, the first terminal may initiate a voice collaboration data collection instruction to the server, and the server collects voice collaboration data transmitted through the voice call link within a time period in which the mark triggering operation takes effect after receiving the voice collaboration data collection instruction. Furthermore, the server can directly perform voice recognition on the voice collaboration data to obtain a second marked text, and the second marked text is fed back to the terminal.

Further, the first terminal may detect a confirmation operation corresponding to the second markup text after displaying the second markup text in the voice markup control. When the first terminal detects a confirmation operation corresponding to the second markup text, the markup box including the second markup text is displayed in place of the voice markup control. The first terminal may synchronize the second markup text in real time to terminals corresponding to members participating in the online collaboration. Or the server can update the target document according to the mark box containing the second mark text and synchronize to the terminals corresponding to all the members participating in online collaboration in real time.

In one embodiment, the terminal may clear the second markup text displayed in the voice markup control upon detecting a cancel operation corresponding to the confirmation operation of the second markup text.

In one embodiment, when the first terminal displays the markup box including the second markup text in place of the voice markup control, the currently selected text may be underlined so that the markup content is clearer and clearer.

In the above embodiment, when the mark triggering operation acting on the voice mark control occurs, it may be determined that the voice collaboration data transmitted through the voice call link is valid in the time period in which the mark triggering operation is valid, and the second mark text obtained by identifying the voice collaboration data is displayed in the mark frame, and real-time synchronization may be performed between the terminals. Therefore, when a plurality of people collaborate the text of the document, the manual editing is not needed, the voice marking can be directly carried out according to the voice collaboration data transmitted through the voice call link, and the collaboration efficiency of the document collaboration is greatly improved.

and S802, when the selected text collaboration option is a text annotation option, dividing an annotation area at a position acted by a text collaboration triggering operation.

Specifically, when the selected text collaboration option is a text annotation option, the first terminal may divide the annotation area at a position on which the text collaboration trigger operation is performed.

Referring to fig. 9(a), fig. 9(a) shows an interface schematic diagram of dividing the annotation area at the position acted on by the text collaboration trigger operation in one embodiment. As shown in fig. 9(a), the marked-out region 311 is a blank region, and the user can input text or voice through an input device such as a virtual keyboard.

And S804, collecting the annotation voice data.

Specifically, the first terminal can collect annotation voice data through the recording starting control. In one embodiment, after the first terminal divides the annotation area at the position acted by the text collaboration triggering operation, the first terminal may display a recording start control. And when detecting the recording starting operation acting on the recording starting control, the first terminal records the annotation voice data.

Referring to fig. 9(a), in one embodiment, the first terminal may invoke the virtual keyboard 322 after dividing the annotation area at the location acted upon by the text collaboration trigger operation. And when the first terminal detects the recording starting operation acting on the virtual keyboard, recording the annotation voice data. In one embodiment, the user can also directly input annotation text in the annotation area through the virtual keyboard.

In one embodiment, the first terminal calls a local sound acquisition device when detecting a recording start operation acting on the recording start control, and enters a voice recording state after the sound acquisition device is prepared for recording. The first terminal can collect voice and record the annotation voice data when the user inputs voice after entering the voice recording state.

In one embodiment, the first terminal may start recording the annotation voice data when the sound is detected, and end the recording until a recording end condition is met, so as to obtain the annotation voice data. The recording end condition may be that a preset time length is reached from the start of recording, that a silence state is detected to reach the preset time length, or that a recording end operation is detected.

In one embodiment, after dividing the annotation area at the position acted by the text cooperation triggering operation, the first terminal may detect the annotation triggering operation, determine the voice cooperation data transmitted through the voice communication link within a time period in which the annotation triggering operation is effective, and use the determined voice cooperation data as the annotation voice data.

And S806, displaying the annotation text obtained by identifying the annotation voice data in the annotation area.

Specifically, the first terminal may acquire an annotation text obtained by performing voice recognition on annotation voice data, and display the acquired annotation text in the annotation region.

In one embodiment, the first terminal can directly perform voice recognition on the annotation voice data locally to obtain an annotation text corresponding to the annotation voice data. The first terminal can also send the annotation voice data to the server, and the server performs voice recognition on the annotation voice data and receives an annotation text obtained by performing voice recognition on the annotation voice data and fed back by the server.

Referring to fig. 9(b), fig. 9(b) is a schematic interface diagram for displaying annotation text in the annotation area in one embodiment. After the first terminal collects the annotation voice data, an annotation text obtained by voice recognition of the annotation voice data can be obtained, and the annotation text is displayed in the annotation area.

In one embodiment, the document collaboration method further includes an annotation reminding step, which specifically includes: when the annotation reminding operation is detected, displaying candidate members participating in document cooperation; when the selection operation occurs, according to the candidate member pointed by the selection operation, sending an annotation reminding instruction to the terminal corresponding to the candidate member; and the comment reminding instruction is used for indicating the terminal to trigger a reminding action.

The participation in the document collaboration may specifically be participation in online collaboration on the target document or participation in historical collaboration on the target document. The candidate members participating in the document collaboration may specifically be members currently participating in online collaboration; or may be a member of a document collaboration that has participated in the target document; but also members of document collaboration that are current and have historically participated in the target document.

In one embodiment, the first terminal can detect the annotation reminding operation, jump to the candidate member display page when the annotation reminding operation is detected, and display candidate members participating in document cooperation in the candidate member display page. In one embodiment, the first terminal may detect an annotation reminding operation acting on the virtual keyboard, for example, the user inputs an "@" symbol through the virtual keyboard, and at this time, it may be determined that the user intends to perform the annotation reminding.

Further, when the selection operation occurs, the first terminal sends an annotation reminding instruction to the second terminal corresponding to the candidate member according to the candidate member pointed by the selection operation. And after the second terminal receives the annotation reminding instruction, the reminding action can be triggered to remind the user. The reminding action comprises actions such as indicator light flashing, prompt information popping in a document page, terminal vibration and the like.

In the embodiment, when the annotation reminding operation is detected, candidate members participating in document collaboration are shown. When the selection operation occurs, an annotation reminding instruction can be sent to the terminal corresponding to the member pointed by the selection operation so as to indicate the terminal to trigger a reminding action, and the convenience of document cooperation can be greatly improved.

And S808, synchronously annotating the text to the terminal corresponding to the member participating in the online cooperation in real time.

Specifically, the first terminal may synchronously annotate the text to the terminals corresponding to the members participating in the online collaboration in real time. In one embodiment, the first terminal can upload the annotation voice data to the server, and the server performs voice recognition on the annotation voice data to obtain an annotation text and writes the annotation text into the annotation area. And the server can update the target document according to the annotation text and synchronize the target document to terminals corresponding to all members participating in online collaboration in real time.

In the above embodiment, when the selected text collaboration option is a text annotation option, the annotation region is divided at the position acted by the text collaboration triggering operation, and annotation voice data is collected. And displaying the annotation text obtained by identifying the annotation voice data in an annotation area, and performing real-time synchronization among terminals. Therefore, when a plurality of people collaborate the text of the document, manual editing is not needed, and the collaboration efficiency of the document collaboration can be greatly improved.

In one embodiment, the document collaboration method further comprises the step of voice call management, specifically comprising: displaying a multi-person voice call management inlet based on a voice call link on a document page; when an opening instruction for the management entrance is detected, entering a multi-person voice call management interface; displaying voice collaboration management options in a multi-person voice call management interface; the voice collaboration management option is used to trigger management actions for members participating in a multi-person voice call.

Specifically, the first terminal may present a management entry for a multi-person voice call based on a voice call link on a document page. The management entry may be specifically set in the header area of the document page. And when the first terminal detects an opening instruction for the management entrance, entering a multi-person voice call management interface. The start command may be triggered by a trigger operation.

Referring to fig. 10, fig. 10 is an interface diagram of a multi-person voice call management interface according to an embodiment. Referring to fig. 10, a multi-user voice call management interface may display a plurality of voice collaboration management options, and the multi-user voice call management interface may perform actions such as checking a voice collaboration member, muting a microphone, managing a speaker, ending a voice, and collapsing the multi-user voice call management interface.

In one embodiment, the first terminal presents a voice collaboration management option in a multi-person voice call management interface. The voice collaboration management option is used to trigger management actions for members participating in a multi-person voice call. For example, the voice collaboration management option may trigger the conference mode to be entered, control a member to speak forbidding, or control a single member to speak.

In the above embodiment, the management entry for the multi-person voice call based on the voice call link is displayed on the document page, and when an opening instruction for the management entry is detected, the multi-person voice call management interface is entered. The management behavior of the members participating in the multi-person voice call is triggered through the voice cooperation management options in the multi-person voice call management interface, so that the voice cooperation mode of the target document is more flexible and controllable.

In a specific embodiment, referring to fig. 11, the document cooperation method includes the steps of:

s1102, displaying a document page for performing online collaboration on the target document.

S1104, displaying member identifications corresponding to the members participating in online collaboration on the document page stack.

S1106, when the trigger operation acting on the member identification is detected, the member identification display panel is called up.

S1108, displaying the member identifications corresponding to the members participating in the online collaboration in the member identification display panel in an item manner.

S1110, when the voice cooperation triggering operation occurs, initiating voice call invitation according to the member to which the voice cooperation triggering operation points.

S1112, when receiving the connection response responding to the voice call invitation, establishing a voice call link for performing voice collaboration on the target document.

S1114, when a text collaboration triggering operation acting on a document area in a document page is detected, a text collaboration option menu is displayed at a position acted by the text collaboration triggering operation.

S1116, a text collaboration option selected from the text collaboration option menu is determined.

S1118, when the selected text collaboration option is a text mark option, the voice mark control is called.

And S1120, recording the marked voice data through the voice marking control.

S1122, a first markup text obtained by recognizing the markup speech data is displayed in the speech markup control.

S1124, when a confirmation operation corresponding to the first markup text is detected, displaying a markup box including the first markup text in place of the voice markup control.

S1126, synchronizing the first mark text to the terminal corresponding to the member participating in the online cooperation in real time.

And S1128, when the selected text collaboration option is the text annotation option, dividing the annotation area at the position acted by the text collaboration triggering operation.

S1130, collecting the annotation voice data.

And S1132, displaying an annotation text obtained by identifying the annotation voice data in the annotation area.

S1134, synchronously annotating the text to the terminal corresponding to the member participating in the online collaboration in real time.

S1136, when the annotation reminding operation is detected, displaying candidate members participating in document cooperation.

S1138, when the selection operation occurs, according to the candidate member pointed by the selection operation, sending an annotation reminding instruction to the terminal corresponding to the candidate member; and the comment reminding instruction is used for indicating the terminal to trigger a reminding action.

S1140, a management entrance of the multi-person voice call based on the voice call link is displayed on the document page.

S1142, when the opening instruction of the management entrance is detected, entering a multi-person voice call management interface.

S1144, displaying voice collaboration management options in the multi-person voice call management interface; the voice collaboration management option is used to trigger management actions for members participating in a multi-person voice call.

FIG. 11 is a flowchart illustrating a method of document collaboration in one embodiment. It should be understood that, although the steps in the flowchart of fig. 11 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not limited to being performed in the exact order described, and may be performed in other orders, unless otherwise indicated herein. Moreover, at least a portion of the steps in fig. 11 may include multiple sub-steps or multiple stages that are not necessarily performed at the same time, but may be performed at different times, and the order of performing the sub-steps or stages is not necessarily sequential, but may be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

As shown in FIG. 12, in one embodiment, a document collaboration method is provided. The embodiment is mainly illustrated by applying the method to the second terminal 120 in fig. 1. Referring to fig. 12, the document collaboration method specifically includes the steps of:

s1202, a document page for performing online collaboration on the target document is displayed.

Specifically, the second terminal may have a target document stored thereon, or the second terminal may access the server to obtain the target document. After the user enters the target document through the user identification, the second terminal can display a document page for performing online collaboration on the target document. The user identifier is used for uniquely identifying the user, and specifically may be a user account, a user certificate number, a user mobile phone number, and the like.

In one embodiment, the second terminal runs a document application, and a user can log in the document application through the user identification and open the target document through the document application. The document application exposes document pages for online collaboration on the target document.

In one embodiment, a user may create a target document through a document application and store the target document in a server corresponding to the document application based on a currently logged-in user identification. Or the second terminal can acquire the target document through other computer equipment in a communication mode such as USB interface connection or network connection and the like, and enter the target document through the document application.

S1204, receive the voice call invitation that the member participating in online cooperation initiates to the correspondent terminal.

In one embodiment, the second terminal may determine the members currently participating in the online collaboration on the target document, and present the members participating in the online collaboration in the document page. For specific limitation of the second terminal displaying the members participating in the online collaboration, reference may be made to the description of step S204, which is not described herein again.

In one embodiment, the second terminal may receive a voice call invitation initiated by a terminal corresponding to a member participating in online collaboration. It is understood that when the first terminal initiates a voice call invitation to the second terminal corresponding to the determined member, the second terminal may receive the voice call invitation initiated from the first terminal.

Referring to fig. 13(a), fig. 13(a) is a schematic diagram of an interface for receiving a voice call invitation initiated by a terminal corresponding to an adult participating in online collaboration in one embodiment. As shown in fig. 13(a), when a first terminal (user a) initiates a voice call invitation to a second terminal (user B), a title area of the second terminal may display "a invites you to join in voice collaboration", where "a" represents a member identifier corresponding to the first terminal.

It is understood that the first terminal may also receive a voice call invitation initiated by the second terminal, and accordingly, the second terminal may also initiate a voice call invitation to the first terminal. The first terminal and the second terminal are used to distinguish different terminals, and both the first terminal and the second terminal can be called terminals without causing ambiguity.

And S1206, responding to the voice call invitation, and displaying a response option on a document page.

Specifically, when the second terminal receives the voice communication invitation initiated by the terminal corresponding to the member participating in the online collaboration, the second terminal can display the response option on the document page. The response options may specifically include a response option that triggers a connection response and a response option that triggers a rejection response. Referring to fig. 13(a), the second terminal may present a response option in a title area of the document page, wherein the response option may be presented with a graphic representing the response option.

And S1208, when the triggering operation of the response option for triggering the connection response occurs, sending a connection response for establishing a voice call link with the terminal to the terminal, wherein the voice call link is used for performing voice collaboration on the target document.

In one embodiment, the response options may specifically include a response option that triggers a connection response and a response option that triggers a rejection response. The second terminal may detect a trigger operation acting on a response option triggering a connection response. For example, when the second terminal detects that a graphic representing a response option for triggering a connection response is pressed or clicked, it may be determined that a trigger operation for the response option for triggering the connection response is detected.

When a trigger operation for a response option for triggering a connection response occurs, the second terminal may transmit a connection response for establishing a voice call link with the first terminal to the first terminal. The first terminal can establish a voice call link according to the respective member identifications of the first terminal and the second terminal. The user holding the first terminal and the user holding the second terminal can perform voice collaboration on the target document through the voice call link.

In one embodiment, when the number of the second terminals is plural, and at least one of the second terminals sends a connection response to the first terminal, a multi-person voice call link between the first terminal and the second terminal may be established. After the multi-user voice call link is successfully established, other invited second terminals can join the multi-user voice call link at any time. Therefore, voice communication invitations can be conveniently and quickly initiated to the terminals corresponding to all members participating in online cooperation according to voice cooperation triggering operation triggered by users, and a multi-user voice communication link is established, so that multi-user voice cooperation aiming at a target document is realized.

Referring to FIG. 13(b), FIG. 13(b) shows a schematic diagram of an interface for joining voice collaboration in one embodiment. As shown in fig. 13(b), when the second terminal detects the trigger operation, a connection response is sent to the first terminal. The first terminal can establish a voice call link according to the respective member identifications of the first terminal and the second terminal. At this time, the title area of the document page displayed by the second terminal may display the user avatar corresponding to the member currently participating in the voice collaboration.

The document cooperation method comprises the steps of displaying a document page for performing online cooperation on a target document, and receiving voice call invitation initiated by terminals corresponding to other users participating in the online cooperation in the document page. And displaying a response option on a document page, and when the triggering operation of the response option for triggering the connection response occurs, sending a connection response for establishing a voice call link to the terminal, wherein the user can perform voice collaboration on the target document through the voice call link. Therefore, the voice collaboration is carried out in the document page without departing from the target document, the target document can be edited, the voice communication collaboration can be conveniently carried out in real time, and the document collaboration efficiency is greatly improved.

In one embodiment, the document collaboration method further includes the step of synchronizing the markup boxes, the step including: receiving real-time synchronized tagged text; determining the display position of the marked text in a document area in a document page; a markup box including markup text is presented at the presentation position.

In particular, the second terminal may receive the markup text synchronized in real time. In one embodiment, the tagged text is recognized from tagged speech data recorded by the first terminal. The first terminal can identify the recorded voice data locally to obtain a marked text, and then the marked text is sent to the second terminal through network connection. Or, the first terminal can send the recorded voice data to the server, and the server identifies the marked voice data to obtain a marked text and synchronizes the marked text to the first terminal and the second terminal.

In one embodiment, the tagged text is recognized by voice collaboration data communicated over a voice call link. The server can perform voice recognition on the voice data to obtain a marked text, and synchronizes the marked text to the first terminal and the second terminal through network connection.

Further, the second terminal may determine a presentation position of the markup text in the document region in the document page. The second terminal presents a markup box including markup text at the presentation position.

In one embodiment, when the first terminal sends the markup text to the second terminal, the position displayed by the markup text, that is, the position acted by the text collaboration trigger operation, can be synchronized to the second terminal. The second terminal presents a markup box including markup text at the presentation position.

In one embodiment, when the first terminal sends the marked voice data to the server, the position acted by the text collaboration triggering operation is sent to the server at the same time. And the server identifies the marked voice data to obtain a marked text, and synchronizes the marked text and the position acted by the text cooperation triggering operation to the second terminal. The second terminal presents a markup box including markup text at the presentation position.

In one embodiment, when the second terminal receives the synchronized tagged text, the text content selected by the first terminal may also be received. When the second terminal displays the marking box comprising the marking text at the display position, the text content selected by the first terminal can be underlined and marked synchronously.

In the above embodiment, the markup text synchronized in real time is received, the display position of the markup text in the document region in the document page is determined, and the markup box including the markup text is displayed at the display position. Therefore, the synchronization of the marked texts among a plurality of terminals can be realized, and the efficiency of text collaboration of a plurality of people on the target document is further improved.

In one embodiment, the text collaboration method further comprises a step of triggering a reminder instruction, specifically comprising: receiving real-time synchronous annotation texts; and when the annotation text carries an annotation reminding instruction, triggering a reminding action.

Specifically, the second terminal may receive the annotation text recognized from the recorded annotation voice data in real-time synchronization. And detecting whether the annotation text carries an annotation reminding instruction, and triggering a reminding action when the annotation text carries the annotation reminding instruction. The reminding action comprises actions such as indicator light flashing, prompt information popping in a document page, terminal vibration and the like.

In one embodiment, the annotation text is recognized from recorded annotation speech data. The first terminal can identify the recorded annotation voice data locally to obtain an annotation text, and then the annotation text is sent to the second terminal through network connection. Or the first terminal sends the annotation voice data to the server, the server identifies the annotation voice data to obtain an annotation text, and the annotation text is synchronized to the first terminal and the second terminal.

In one embodiment, the annotation text is identified by voice collaboration data communicated over a voice call link. The server can perform voice recognition on the voice data to obtain the annotation text, and the annotation text is synchronized to the first terminal and the second terminal through network connection.

In the embodiment, the real-time synchronous annotation text is received, and when the annotation text carries the annotation reminding instruction, the reminding action is triggered, so that the user can be reminded of the annotation content, and the convenience of document cooperation is further improved.

In one embodiment, the document collaboration method further includes a step of performing text collaboration on the target document, where the step specifically includes: when detecting a text collaboration triggering operation acting on a document area in a document page, displaying a text collaboration option menu at a position acted by the text collaboration triggering operation; determining a text collaboration option selected from a text collaboration option menu; and executing corresponding text cooperation operation according to the selected text cooperation option.

In one embodiment, the step of performing the corresponding collaboration operation according to the selected text collaboration option includes: when the selected text collaboration option is a text marking option, calling a voice marking control; recording and marking voice data through the voice marking control; displaying a first mark text obtained by identifying and marking voice data in a voice mark control; displaying a markup box including a first markup text in place of the voice markup control when a confirmation operation corresponding to the first markup text is detected; and synchronizing the first mark text to the terminal corresponding to the member participating in the online cooperation in real time.

In one embodiment, the step of performing the corresponding collaboration operation according to the selected text collaboration option includes: when the selected text collaboration option is a text marking option, displaying a voice marking control; when a mark triggering operation acting on the voice mark control occurs, determining voice collaboration data transmitted through a voice communication link in a time period when the mark triggering operation takes effect; displaying a second mark text obtained by recognizing the voice collaboration data in the voice mark control; displaying a markup box including a second markup text in place of the voice markup control when a confirmation operation corresponding to the second markup text is detected; and synchronizing the second mark text to the terminal corresponding to the member participating in the online cooperation in real time.

In one embodiment, the step of executing the corresponding collaboration operation according to the selected text collaboration option specifically includes: when the selected text collaboration option is a text annotation option, dividing an annotation area at a position acted by a text collaboration triggering operation; collecting annotation voice data; displaying an annotation text obtained by identifying the annotation voice data in an annotation area; and synchronously annotating the text to the terminal corresponding to the member participating in the online collaboration in real time.

In one embodiment, the text collaboration method further comprises: when the annotation reminding operation is detected, displaying candidate members participating in document cooperation; when the selection operation occurs, according to the candidate member pointed by the selection operation, sending an annotation reminding instruction to the terminal corresponding to the candidate member; and the comment reminding instruction is used for indicating the terminal to trigger a reminding action.

In a specific application scenario, referring to fig. 14, fig. 14 is a structure diagram of a voice collaboration interaction structure in an embodiment. Referring to fig. 14, a user (including a voice originator and a voice recipient) opens a target document through a terminal. After the voice initiator opens the target document, the voice initiator can initiate voice call invitation to the voice receiver. When the voice receiving party receives the voice call invitation, a voice call link is established. The voice initiator and the voice receiver can perform online voice collaboration through the target document. Users currently participating in online collaboration on the target document may also enter the voice call link. During the online voice collaboration process, the user can also perform text marking and text annotation, and can more effectively communicate and collaborate. When the voice call is ended by either the voice initiator or the voice receiver, the voice call link between the voice initiator and the voice receiver is disconnected.

Referring to FIG. 15, FIG. 15 is a timing diagram of a document collaboration method in one embodiment. The first terminal judges whether other collaborators participate in online collaboration on the target document at present. If so, a voice collaboration portal may be presented when a voice collaboration trigger operation is detected. And the user clicks a voice cooperation button, the first terminal sends the voice call invitation to the server, and the server forwards the voice call invitation to a second terminal corresponding to the member currently participating in the online cooperation of the target document. And displaying a voice collaboration state column in a title area of the document page of the first terminal. The second terminal receives the voice call invitation. The user may choose to accept or reject via the second terminal. When the user selects to receive, the title area of the document page displays a voice collaboration status bar. When the second terminal joins the current voice call, the server may update the voice collaborator information to all terminals. And for the first terminal and the second terminal, when the user can click the voice collaboration status bar, the user can enter a multi-person voice call management interface to perform voice call management. Recovering the target document page if the click quits; and clicking to shrink to enter a voice collaboration state. For the first terminal and the second terminal, namely the terminals where the voice initiator and the voice inviter are located, when the voice initiator and the voice inviter carry out voice communication, the first terminal and/or the second terminal sends the recorded voice data to the server, and the server forwards the recorded voice data to other terminals. Both the voice originator and the voice inviter can implement voice markup and voice annotation through the document page. The explanation is given by taking an example in which the voice originator or the voice inviter realizes the voice annotation through a document page. The voice originator or voice inviter may select the presented text in a document page, and when the presented text is selected, a text collaboration options menu is presented within the document page. The user may click on a text annotation option for triggering text annotation for voice annotation. Correspondingly, the terminal collects the annotation voice data and sends the annotation voice data to the server after recording is finished. And the server performs voice recognition on the annotation voice data to obtain an annotation text. And the server writes the annotation text into the document annotation and synchronizes the annotation text to the terminals corresponding to all the members participating in the online collaboration. And the first terminal and the second terminal display the annotation texts at corresponding positions after receiving the annotation texts.

As shown in fig. 16, in one embodiment, a document collaboration apparatus 1600 is provided that includes a presentation module 1601, a voice call invitation initiation module 1602, and a voice call link establishment module 1603.

A displaying module 1601, configured to display a document page for performing online collaboration on a target document.

The presentation module 1601 is further configured to present members participating in the online collaboration on the document page.

A voice call invitation initiating module 1602, configured to initiate a voice call invitation according to a member to which the voice cooperation triggering operation is directed when the voice cooperation triggering operation occurs.

A voice call link establishing module 1603, configured to, when receiving a connection response in response to the voice call invitation, establish a voice call link for performing voice collaboration on the target document.

In one embodiment, the presentation module 1601 is further configured to present, in the document page stack, a member identifier corresponding to a member participating in the online collaboration; when the triggering operation acting on the member identification is detected, the member identification display panel is called up; and displaying the member identification corresponding to the member participating in the online collaboration in an item manner in a member identification display panel.

In an embodiment, the voice call invitation initiating module 1602 is further configured to respectively initiate a voice call invitation to the terminals corresponding to all the members participating in the online collaboration when a voice collaboration triggering operation pointing to all the members participating in the online collaboration occurs. The voice call link establishing module 1603 is further configured to receive a connection response from the terminal in response to the voice call invitation; establishing a multi-user voice call link between terminals corresponding to the received connection response; the voice call link is used for multi-person voice collaboration on the target document.

In one embodiment, the document collaboration device 1600 also includes a determination module 1604 and an execution module 1605.

The presentation module 1601 is further configured to, when a text collaboration trigger operation acting on a document area in a document page is detected, present a text collaboration option menu at a position on which the text collaboration trigger operation acts.

Determining module 1604 determines a text collaboration option selected from the menu of text collaboration options.

An executing module 1605, configured to execute a corresponding text collaboration operation according to the selected text collaboration option.

In one embodiment, the executing module 1605 is further configured to invoke a voice markup control when the selected text collaboration option is a text markup option; recording and marking voice data through a voice marking control; displaying a first mark text obtained by identifying and marking voice data in a voice mark control; displaying a markup box including a first markup text in place of the voice markup control when a confirmation operation corresponding to the first markup text is detected; and synchronizing the first mark text to the terminal corresponding to the member participating in the online cooperation in real time.

In one embodiment, the executing module 1605 is further configured to display a voice markup control when the selected text collaboration option is a text markup option; when a mark triggering operation acting on the voice mark control occurs, determining voice collaboration data transmitted through a voice communication link in a time period when the mark triggering operation takes effect; displaying a second mark text obtained by recognizing the voice collaboration data in the voice mark control; displaying a mark-up box including a second mark-up text in place of the voice mark-up control when a confirmation operation corresponding to the second mark-up text is detected; and synchronizing the second mark text to the terminal corresponding to the member participating in the online cooperation in real time.

In one embodiment, the executing module 1605 is further configured to, when the selected text collaboration option is a text annotation option, divide the annotation area at a position acted by the text collaboration triggering operation; collecting annotation voice data; displaying an annotation text obtained by identifying the annotation voice data in an annotation area; and synchronously annotating the text to the terminal corresponding to the member participating in the online collaboration in real time.

As shown in FIG. 17, in one embodiment, the document collaboration device 1600 also includes a sending module 1606.

The presentation module 1601 is further configured to present candidate members participating in document collaboration when the annotation reminding operation is detected.

A sending module 1606, configured to send an annotation reminding instruction to a terminal corresponding to a candidate member according to the candidate member pointed by the selection operation when the selection operation occurs; and the comment reminding instruction is used for indicating the terminal to trigger a reminding action.

In one embodiment, the presentation module 1601 is further configured to present a management entry of a multi-person voice call based on a voice call link on a document page; when an opening instruction for a management entrance is detected, entering a multi-person voice call management interface; displaying voice collaboration management options in a multi-person voice call management interface; the voice collaboration management option is used to trigger management actions for members participating in a multi-person voice call.

According to the document cooperation device, the members participating in online cooperation are displayed in the document page for performing online cooperation on the target document, so that the user can intuitively know other members participating in online cooperation. And when the voice cooperation triggering operation occurs, initiating voice communication invitation according to the member to which the voice cooperation triggering operation points. When the corresponding member triggers the connection response, a voice call link is established, and the user can perform voice collaboration on the target document. Therefore, the voice collaboration is carried out in the document page without departing from the target document, the target document can be edited, the voice communication collaboration can be conveniently carried out in real time, and the document collaboration efficiency is greatly improved.

As shown in FIG. 18, in one embodiment, a document collaboration apparatus 1800 is provided that includes a presentation module 1801, a receiving module 1802, and a sending module 1803.

A display module 1801, configured to display a document page for performing online collaboration on a target document;

a receiving module 1802, configured to receive a voice call invitation initiated by a terminal corresponding to a member participating in online collaboration;

the presentation module 1801 is further configured to present a response option on the document page in response to the voice call invitation;

a sending module 1803, configured to send, to the terminal, a connection response for establishing a voice call link with the terminal when a triggering operation for a response option for triggering the connection response occurs, where the voice call link is used to perform voice collaboration on the target document.

In one embodiment, the receiving module 1802 is further configured to receive mark-up text synchronized in real time. The presentation module 1801 is further configured to determine a presentation position of the markup text in a document region in the document page, and present a markup box including the markup text at the presentation position.

As shown in FIG. 19, in one embodiment, the document collaboration apparatus 1800 also includes a trigger module 1804. The receiving module 1802 is further configured to receive the annotation text synchronized in real time. The triggering module 1804 is configured to trigger a reminding action when the annotation text carries the annotation reminding instruction.

The document cooperation device displays a document page for performing online cooperation on the target document, and receives voice call invitation initiated by terminals corresponding to other users participating in the online cooperation in the document page. And displaying a response option on a document page, and when the triggering operation of the response option for triggering the connection response occurs, sending a connection response for establishing a voice call link to the terminal, wherein the user can perform voice collaboration on the target document through the voice call link. Therefore, the voice collaboration is carried out in the document page without departing from the target document, the target document can be edited, the voice communication collaboration can be conveniently carried out in real time, and the document collaboration efficiency is greatly improved.

FIG. 20 is a diagram illustrating an internal structure of a computer device in one embodiment. The computer device may specifically be the first terminal 110 or the second terminal 120 in fig. 1. As shown in fig. 20, the computer apparatus includes a processor, a memory, a network interface, an input device display screen, and a sound collection device connected by a system bus. Wherein the memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium of the computer device stores an operating system and may also store a computer program that, when executed by a processor, causes the processor to implement a document collaboration method. The internal memory may also have stored therein a computer program that, when executed by the processor, causes the processor to perform a document collaboration method. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.

Those skilled in the art will appreciate that the architecture shown in fig. 20 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.

In one embodiment, the document collaboration apparatus provided in the present application may be implemented in the form of a computer program, and the computer program may be run on a computer device as shown in fig. 20. The storage of the computer device may store various program modules constituting the document cooperation apparatus, such as a presentation module, a voice call invitation module, and a voice call link module shown in fig. 16. The computer program constituted by the respective program modules causes the processor to execute the steps in the document cooperation method of the respective embodiments of the present application described in the present specification.

Also for example, the display module, the receiving module, and the transmitting module shown in fig. 18. The computer program constituted by the respective program modules causes the processor to execute the steps in the document cooperation method of the respective embodiments of the present application described in the present specification.

For example, the computer apparatus shown in fig. 20 may perform steps S202 and S204 by the presentation module in the document cooperation apparatus shown in fig. 16. The computer device may perform step S206 through the voice call invitation launching module. The computer device may perform step S208 through the voice call link establishment module.

For example, the computer apparatus shown in fig. 20 may perform steps S1202 and S1206 through the presentation module in the document cooperation apparatus shown in fig. 18. The computer device may perform step S1204 through the receiving module. The computer device may perform step S1208 through the transmission module.

In one embodiment, a computer device is provided, comprising a memory and a processor, the memory storing a computer program which, when executed by the processor, causes the processor to perform the steps of the above-described document cooperation method. The steps of the document cooperation method here may be the steps in the document cooperation methods of the respective embodiments described above.

In one embodiment, a computer-readable storage medium is provided, storing a computer program that, when executed by a processor, causes the processor to perform the steps of the document collaboration method described above. Here, the steps of the document cooperation method may be the steps in the document cooperation method of the above-described respective embodiments.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a non-volatile computer-readable storage medium, and can include the processes of the embodiments of the methods described above when executed. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present application. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims

1. A document collaboration method, comprising:

displaying a document page for performing online collaboration on a target document, wherein the document page comprises a text area and a title area, and the text area is used for displaying document content;

displaying member identifications corresponding to members currently participating in online collaboration on the target document in a title area of the document page;

when voice cooperation triggering operation acting on the displayed member identification occurs, initiating voice call invitation according to a member to which the voice cooperation triggering operation points, wherein the member to which the voice cooperation triggering operation points is at least one member of the members participating in online cooperation;

2. The method of claim 1, wherein the displaying, in the header area of the document page, member identifiers corresponding to members currently participating in online collaboration on the online document comprises:

in a title area of the document page, member identifications corresponding to members participating in online collaboration are displayed in a stacking mode;

when the triggering operation acting on the member identification is detected, calling up a member identification display panel;

and displaying the member identification corresponding to the member participating in the online collaboration in the member identification display panel in an entry.

3. The method of claim 1, wherein when a voice collaboration trigger operation acting on the presented member identifier occurs, initiating a voice call invitation according to a member to which the voice collaboration trigger operation is directed, comprises:

when voice cooperation triggering operation pointing to all members participating in the online cooperation occurs, respectively initiating voice call invitation to terminals corresponding to all members participating in the online cooperation;

when receiving a connection response responding to the voice call invitation, establishing a voice call link for performing voice collaboration on the target document, including:

receiving a connection response from the terminal in response to the voice call invitation;

establishing a multi-user voice call link between terminals corresponding to the received connection response; the voice call link is used for carrying out multi-person voice cooperation on the target document.

4. The method of claim 1, further comprising:

when a text collaboration triggering operation acting on a document area in the document page is detected, displaying a text collaboration option menu at a position acted by the text collaboration triggering operation;

determining a selected text collaboration option from the text collaboration option menu;

and executing corresponding text cooperation operation according to the selected text cooperation option.

5. The method of claim 4, wherein performing the corresponding text collaboration operation according to the selected text collaboration option comprises:

when the selected text collaboration option is a text marking option, a voice marking control is called;

recording the marked voice data through the voice marking control;

displaying a first mark text obtained by recognizing the mark voice data in the voice mark control;

displaying a markup box including the first markup text in place of the voice markup control when a confirmation operation corresponding to the first markup text is detected;

and synchronizing the first mark text to the terminal corresponding to the member participating in the online collaboration in real time.

6. The method of claim 4, wherein performing the corresponding text collaboration operation according to the selected text collaboration option comprises:

when the selected text collaboration option is a text marking option, displaying a voice marking control;

when a mark triggering operation acting on the voice mark control occurs, determining voice collaboration data transmitted through the voice communication link in a time period when the mark triggering operation takes effect;

displaying a second mark text obtained by recognizing the voice collaboration data in the voice mark control;

displaying a markup box including the second markup text in place of the voice markup control when a confirmation operation corresponding to the second markup text is detected;

and synchronizing the second mark text to the terminal corresponding to the member participating in the online collaboration in real time.

7. The method of claim 4, wherein performing the corresponding text collaboration operation according to the selected text collaboration option comprises:

when the selected text collaboration option is a text annotation option, dividing an annotation area at a position acted by the text collaboration triggering operation;

collecting annotation voice data;

displaying an annotation text obtained by identifying the annotation voice data in the annotation area;

and synchronizing the annotation texts in real time to terminals corresponding to the members participating in the online collaboration.

8. The method of claim 7, further comprising:

when the annotation reminding operation is detected, displaying candidate members participating in document cooperation;

when selection operation occurs, according to a candidate member pointed by the selection operation, sending an annotation reminding instruction to a terminal corresponding to the candidate member; and the annotation reminding instruction is used for indicating the terminal to trigger a reminding action.

9. The method according to any one of claims 1 to 8, further comprising:

displaying a management entrance of the multi-person voice call based on the voice call link on the document page;

when an opening instruction for the management entrance is detected, entering a multi-person voice call management interface;

displaying voice collaboration management options in the multi-person voice call management interface; the voice collaboration management option is used to trigger management actions for members participating in the multi-person voice call.

10. A document collaboration method, comprising:

receiving a voice call invitation initiated by a terminal corresponding to a member currently participating in online collaboration on the target document, wherein the voice call invitation is initiated by voice collaboration triggering operation acting on a member identifier in a title area of a document page displayed by an inviter, and the member identifier is used for identifying the member currently participating in the document collaboration;

responding to the voice call invitation, and showing a response option in a title area of the document page;

11. The method of claim 10, further comprising:

receiving real-time synchronized tagged text;

determining the display position of the mark text in a document area in the document page;

displaying a markup box including the markup text at the display position.

12. The method of claim 11, further comprising:

receiving real-time synchronous annotation texts;

and when the annotation text carries an annotation reminding instruction, triggering a reminding action.

13. An apparatus for document collaboration, the apparatus comprising:

the system comprises a display module, a display module and a display module, wherein the display module is used for displaying a document page used for performing online collaboration on a target document, the document page comprises a text area and a title area, and the text area is used for displaying document content;

the display module is further used for displaying member identifications corresponding to members currently participating in online collaboration on the target document in a title area of the document page;

the voice communication invitation initiating module is used for initiating voice communication invitation according to the member pointed by the voice cooperation triggering operation when the voice cooperation triggering operation acting on the displayed member identification occurs, wherein the member pointed by the voice cooperation triggering operation is at least one member of the members participating in the online cooperation;

14. The apparatus according to claim 13, wherein the presentation module is further configured to stack and present member identifiers corresponding to members participating in the online collaboration in a header area of the document page; when the triggering operation acting on the member identification is detected, calling up a member identification display panel; and displaying the member identification corresponding to the member participating in the online collaboration in the member identification display panel in an entry.

15. The apparatus according to claim 13, wherein the voice call invitation initiating module is further configured to respectively initiate a voice call invitation to terminals corresponding to all members participating in the online collaboration when a voice collaboration triggering operation pointing to all members participating in the online collaboration occurs; the voice call link establishing module is further used for receiving a connection response from the terminal in response to the voice call invitation; establishing a multi-user voice call link between terminals corresponding to the received connection response; the voice call link is used for carrying out multi-person voice cooperation on the target document.

16. The apparatus of claim 13, further comprising a determining module and an executing module, wherein:

the display module is further used for displaying a text collaboration option menu at a position acted by a text collaboration trigger operation when the text collaboration trigger operation acted on a document area in the document page is detected;

the determining module is further configured to determine a text collaboration option selected from the text collaboration option menu;

the execution module is further configured to execute a corresponding text collaboration operation according to the selected text collaboration option.

17. The apparatus of claim 16, wherein the execution module is further configured to invoke a voice markup control when the selected text collaboration option is a text markup option; recording the marked voice data through the voice marking control; displaying a first mark text obtained by recognizing the mark voice data in the voice mark control; displaying a markup box including the first markup text in place of the voice markup control when a confirmation operation corresponding to the first markup text is detected; and synchronizing the first mark text to the terminal corresponding to the member participating in the online collaboration in real time.

18. The apparatus of claim 16, wherein the execution module is further configured to present a voice markup control when the selected text collaboration option is a text markup option; when a mark triggering operation acting on the voice mark control occurs, determining voice collaboration data transmitted through the voice communication link in a time period when the mark triggering operation takes effect; displaying a second mark text obtained by recognizing the voice collaboration data in the voice mark control; displaying a markup box including the second markup text in place of the voice markup control when a confirmation operation corresponding to the second markup text is detected; and synchronizing the second mark text to the terminal corresponding to the member participating in the online collaboration in real time.

19. The apparatus according to claim 16, wherein the execution module is further configured to, when the selected text collaboration option is a text annotation option, divide an annotation area at a position acted on by the text collaboration trigger operation; collecting annotation voice data; displaying an annotation text obtained by identifying the annotation voice data in the annotation area; and synchronizing the annotation texts in real time to terminals corresponding to the members participating in the online collaboration.

20. The apparatus of claim 19, further comprising a transmitting module, wherein:

the display module is further used for displaying candidate members participating in document cooperation when the annotation reminding operation is detected;

the sending module is used for sending an annotation reminding instruction to a terminal corresponding to a candidate member according to the candidate member pointed by the selection operation when the selection operation occurs; and the annotation reminding instruction is used for indicating the terminal to trigger a reminding action.

21. The apparatus according to any one of claims 13 to 20, wherein the presentation module is further configured to present, on the document page, a management portal for a multi-person voice call based on the voice call link; when an opening instruction for the management entrance is detected, entering a multi-person voice call management interface; displaying voice collaboration management options in the multi-person voice call management interface; the voice collaboration management option is used to trigger management actions for members participating in the multi-person voice call.

22. An apparatus for document collaboration, the apparatus comprising:

a receiving module, configured to receive a voice call invitation initiated by a terminal corresponding to a member currently participating in online collaboration on the target document, where the voice call invitation is initiated by a voice collaboration trigger operation acting on a member identifier in a header area of a document page displayed by an inviter, and the member identifier is used to identify the member currently participating in the document collaboration;

the display module is also used for responding to the voice call invitation and displaying a response option in a title area of the document page;

23. The apparatus of claim 22, wherein the receiving module is further configured to receive markup text synchronized in real time; the display module is further used for determining the display position of the marked text in a document area in the document page; displaying a markup box including the markup text at the display position.

24. The apparatus of claim 23, further comprising a triggering module, wherein: the receiving module is also used for receiving the real-time synchronous annotation texts; and the triggering module is used for triggering a reminding action when the annotation text carries an annotation reminding instruction.

25. A computer device comprising a memory and a processor, the memory storing a computer program that, when executed by the processor, causes the processor to perform the steps of the method of any one of claims 1 to 12.

26. A computer-readable storage medium, storing a computer program which, when executed by a processor, causes the processor to carry out the steps of the method according to any one of claims 1 to 12.