CN114422460A

CN114422460A - Method and system for establishing same-screen communication sharing in instant messaging application

Info

Publication number: CN114422460A
Application number: CN202111513109.1A
Authority: CN
Inventors: 路九阳
Original assignee: Individual
Current assignee: Individual
Priority date: 2021-12-12
Filing date: 2021-12-12
Publication date: 2022-04-29
Anticipated expiration: 2041-12-12
Also published as: CN114422460B

Abstract

The application provides a method for establishing same-screen communication sharing in instant messaging application, which comprises the following steps: generating a same-screen communication sharing creation request based on the content to be shared and sending the same-screen communication sharing creation request to a server at an instant communication terminal, then receiving a same-screen communication sharing link or a creation completion notification returned by the server, and starting a same-screen communication page according to a trigger event of the link or a receiving event of the notification; receiving and displaying the same-screen communication sharing link at another instant messaging application terminal, and starting a same-screen communication page according to a trigger event of the link; and collecting and sending the same-screen data at the instant messaging application terminals participating in the same-screen communication, receiving the same-screen data sent by other terminals and executing page synchronous processing, thereby realizing the same-screen interactive communication among all participant terminals. Therefore, the method and the device provide a new sharing and communication mode for instant messaging application, directly enter the same-screen interactive communication through sharing, are simple and easy to use, and improve the communication efficiency and quality.

Description

Method and system for establishing same-screen communication sharing in instant messaging application

Technical Field

The invention relates to the technical field of internet communication, in particular to a method and a system for establishing same-screen communication sharing in instant messaging application.

Background

The instant messaging (or instant messaging) application software is widely used in work and life of people, such as the existing WeChat, QQ, nailing, enterprise WeChat, customer service tools and the like, and has the main function of sending and receiving Internet messages in real time, so that the information communication and communication problems of people are solved. In daily use, there is often a need to send a content to other users and then communicate with the content, and the prior art generally solves this problem by: the content is selected and sent to other users in the instant messaging application, the other users access the content through the chat panel, then the two parties initiate voice and video calls, and the shared content is discussed, but the method cannot achieve synchronous browsing and operation of the shared content, and the communication effect is poor. In another way: the method includes the steps that a sharer firstly creates a video conference, then shares video conference entrance information with other users, and after the video conference is entered, the sharer realizes on-screen communication discussion of shared contents with other participator users through functions of file sharing, desktop sharing and the like. Therefore, a method and a system for establishing on-screen communication sharing and rapidly establishing on-screen communication for shared content in instant messaging application are needed to solve the above problems.

Disclosure of Invention

In view of the above problems, the present invention provides a method and system for establishing on-screen communication sharing and quickly establishing on-screen communication with respect to shared content in instant messaging application, aiming to realize that a user of instant messaging application can quickly initiate on-screen communication based on the shared content, and improve communication efficiency and quality, and the technical scheme provided by the present invention is as follows:

in a first aspect, the present application provides a method for establishing on-screen communication sharing in an instant messaging application, where the method is applied to an instant messaging application terminal, and the method includes:

acquiring data and/or information based on shared content needing to be established with on-screen communication and sharing, generating an on-screen communication and sharing establishing request based on the data and/or the information, and sending the on-screen communication and sharing establishing request to a server; receiving a same-screen communication sharing link and/or same-screen communication sharing description data sent by the server, generating an access entry link based on the same-screen communication sharing link and/or the same-screen communication sharing description data, and displaying the access entry link at the instant messaging application terminal, or receiving a same-screen communication sharing creation completion notification returned by the server; after a trigger event for the access entry link is received or a notification of completion of creation of the on-screen communication sharing is received, starting an on-screen communication page;

further comprising: receiving a same-screen communication sharing link and/or same-screen communication sharing description data sent by a server or other instant messaging application terminals, generating an access entry link based on the same-screen communication sharing link and displaying the access entry link on the instant messaging application terminals; and starting the same-screen communication page after receiving a trigger event for accessing the entrance link.

Wherein the on-screen communication sharing is used for realizing on-screen interactive communication with other visitors when being accessed by a user; the data acquired based on the shared content includes, but is not limited to, file (including folder) data, picture data, text data, table data, web page data, video data, sound data, and the like, and the information acquired based on the shared content includes, but is not limited to, website information, file (including folder) information, web page information, picture information, sound information, video information, text information, shared information that has been generated or exists in the instant messaging application terminal, and the like.

The method provides a method for quickly establishing same-screen communication sharing based on shared content and starting same-screen communication for an instant messaging application terminal user, and provides two starting modes: the method enters through the on-screen communication sharing link and enters after the on-screen communication sharing creation completion notification is received, and therefore the efficiency of communication through sharing is improved.

In a possible implementation manner, the access entry link is displayed in a chat panel area of the instant messaging application terminal, and the access entry link is used for starting a same-screen communication page after receiving a user trigger event.

The embodiment is beneficial to the user to quickly enter the same-screen communication of the shared content when the user chats in the instant messaging software.

In a possible implementation manner, after the instant messaging application terminal starts the on-screen communication page, based on a network request included in a link of the on-screen communication page, the on-screen communication page data returned by the server is received to load and generate the local on-screen communication page, and communication between the instant messaging application terminal and the on-screen communication service corresponding to the server is established.

The above embodiment corresponds to a mode that when the server processes the on-screen communication sharing creation request, the server generates and stores the content of the on-screen communication page, and the on-screen communication sharing link provided to the terminal can directly or indirectly access the content of the on-screen communication page, so that the on-screen communication page data is stored and provided by the server.

In a possible implementation manner, after the instant messaging application terminal starts the on-screen communication page, a on-screen communication service connection request is sent to a server, communication between the instant messaging application terminal and the on-screen communication service is established, the on-screen communication page data sent by the on-screen communication service is received, and the on-screen communication page is loaded and generated.

The above embodiment provides a method for loading data of an on-screen page through an on-screen communication service, where the on-screen page data is used for providing data communication services for terminals participating in on-screen communication.

In one possible implementation manner, after the instant messaging application terminal starts the on-screen communication page, on-screen communication components are locally loaded on the on-screen communication page, and the on-screen communication components include but are not limited to one or more of a graffiti component, a video display component, an audio and video control component, a recording component, an on-screen state information display component, an on-screen authority control component, an on-screen communication setting component and a participant information display component.

The above embodiment provides a way for locally loading the on-screen communication component on the instant messaging application terminal.

In one possible implementation manner, after the communication between the instant messaging application terminal and the on-screen communication service of the server side is established, one or more of operation instruction data, picture data, content data and video data are collected on the on-screen communication page to generate on-screen data, and the on-screen data is sent to the on-screen communication service; receiving the on-screen data sent by the on-screen communication service, and executing page synchronization processing on the on-screen communication page based on the data type contained in the on-screen data, wherein the page synchronization processing comprises one or more of executing the operation instruction contained in the on-screen communication page based on the operation instruction data to restore the operation behavior, replacing or drawing the picture based on the picture data, updating or replacing the page content data based on the content data, and playing the video data.

The above embodiment realizes synchronization of the display content and operation of the terminal pages participating in the same-screen communication, and has the effect of same-screen communication.

In one possible implementation manner, after the instant messaging application terminal starts the on-screen communication page, audio and/or video communication between the instant messaging application terminal and a server or other instant messaging application terminals participating in on-screen communication is established, and audio data and/or video data are sent and received.

The above embodiment adds audio and video communication in the same-screen communication, so that a face-to-face communication effect can be achieved, and the communication efficiency and the communication quality are further improved.

In a possible implementation manner, after the instant messaging application terminal where the creator of the on-screen communication sharing is located starts the on-screen communication page, data related to the on-screen communication sharing is locally acquired at the instant messaging application terminal of the creator based on the information of the on-screen communication sharing, the on-screen communication page data is generated based on the data related to the on-screen communication sharing, the on-screen communication page is locally loaded, and the on-screen communication page data is sent to the server or other participant terminals.

The above embodiment provides a mode for generating the same-screen communication page data at the same-screen communication shared creator terminal, which is beneficial to reducing the operation load of the server and protecting the user data and privacy.

In a possible implementation manner, after the instant messaging application terminal where the participant sharing the same-screen communication starts the same-screen communication page, the same-screen communication page data sent by the server or the instant messaging application terminal of the same-screen communication creator is received, and a local same-screen communication page is loaded based on the same-screen communication page data.

The above embodiment provides a mode for loading the data of the on-screen communication page by the on-screen communication shared receiver, which includes two modes of receiving from the server or receiving from another terminal.

In one possible implementation manner, the instant messaging application terminal generates a co-screen communication sharing creation request, acquires setting data of a shared target user shared by the co-screen communication sharing, generates a sharing request based on the setting data and sends the sharing request to the server, the sharing request is processed by the server, a sharing target is acquired based on the setting data contained in the sharing request, and the co-screen communication sharing link and/or the co-screen communication sharing description data are sent to the sharing target.

The above embodiment provides a method for setting a sharing target and a sharing range for the on-screen communication and sharing, so as to send the on-screen communication and sharing to a corresponding receiver.

In a second aspect, the present application further provides a method for establishing on-screen communication sharing in an instant messaging application, where the method is applied to a server, and the method includes:

receiving a co-screen communication sharing creation request sent by an instant messaging application terminal, registering a co-screen communication service based on the co-screen communication sharing creation request, generating a corresponding co-screen communication sharing link and/or co-screen communication sharing description data, and sending the co-screen communication sharing creation request to the corresponding instant messaging application terminal;

receiving a connection request of the on-screen communication service sent by an instant messaging application terminal, searching a corresponding on-screen communication service based on the connection request, establishing communication connection between the instant messaging application terminal and the corresponding on-screen communication service, and starting the on-screen communication service when the on-screen communication service is determined not to be started;

and the on-screen communication service receives on-screen data sent by the instant messaging application terminal and sends on-screen data to other instant messaging application terminals connected with the on-screen communication service.

The above embodiment provides service end service support for creating and accessing on-screen communication sharing in an instant messaging application system, including registration processing, connection processing, data communication service in the on-screen communication process, and the like.

In a possible implementation manner, a server receives a sharing request sent by the instant messaging application terminal, analyzes a sharing target and a corresponding on-screen communication sharing link contained in the sharing request, and sends the on-screen communication sharing link and/or the on-screen communication sharing description data to the sharing target.

The method and the device for sharing the instant messaging application terminal achieve processing of the sharing requirement shared by the instant messaging application terminal.

In a possible implementation manner, after the on-screen communication sharing creation request sent by the instant messaging application terminal is received, on the basis of data and/or information included in the on-screen communication sharing creation request, on-screen communication page data is generated at the server. In addition, after receiving a network request sent by the instant messaging application terminal for starting the on-screen communication page, returning the on-screen communication page data to the instant messaging application terminal, or after receiving an on-screen communication service connection request sent by the instant messaging application terminal, returning the corresponding on-screen communication page data to the instant messaging application terminal.

The method comprises the steps that content data of the same-screen communication page are generated and stored in the server, and the data content of the same-screen communication page can be acquired through a same-screen communication sharing link provided to the terminal or a same-screen communication service connected with the terminal.

In a possible implementation manner, the on-screen communication page data is generated at the server, further, an on-screen communication component is created in the on-screen communication page, and the on-screen communication component data is added to the on-screen communication page data, wherein the on-screen communication component includes one or more of a graffiti component, a video display component, an audio/video control component, a recording component, an on-screen state information display component, an on-screen right control component, and an on-screen communication setting component.

Through the content and the data of the on-screen communication page provided by the embodiment, the on-screen communication component is arranged in the on-screen communication page, or the on-screen communication page further comprises the related on-screen communication client configuration information, so that the on-screen communication component can be directly loaded from the server side when the on-screen communication page loading is started by the instant communication application terminal.

In a possible implementation manner, after the on-screen communication service is started, one or more of on-screen communication page data, on-screen data received by the on-screen communication service, on-screen data sent to the instant messaging application terminal, sender information, receiver information and occurrence time information are recorded to generate on-screen communication process recording data.

The data recorded in the on-screen communication process generated by the above embodiment can be used for generating playback or video of the on-screen communication process.

In a third aspect, the present application further provides an instant messaging system including a function of sharing on-screen communication, where the system includes: instant messaging application terminal, server side, instant messaging application terminal includes: the method comprises a creating module, a link generating and processing module and a same-screen communication page, wherein the same-screen communication page further comprises the following steps: load module, with screen data acquisition and processing module, the server includes: the system comprises a creation request processing module, an access request processing module and a same-screen communication service module, wherein:

the creation module is used for creating a same-screen exchange sharing creation request and sending the same-screen exchange sharing creation request to the server;

the link generation and processing module is used for receiving a notification of completion of on-screen communication sharing creation returned by the server, or receiving an on-screen communication sharing link and/or on-screen communication sharing description data sent by the creation request processing module, generating an access entry link and displaying the access entry link on the instant messaging application terminal;

the link generation and processing module is also used for receiving the on-screen communication sharing link and/or on-screen communication sharing description data sent by the server or other instant messaging application terminals to generate an access entry link, and displaying the access entry link on the instant messaging application terminals;

the link generation and processing module is further used for starting the on-screen communication page after receiving a trigger event for the access entry link or receiving the on-screen communication sharing creation completion notification;

the loading module is used for loading page content based on the on-screen communication sharing link;

the on-screen data acquisition and processing module is used for acquiring one or more of operation instruction data, picture data, content data and video data, generating on-screen data and sending the on-screen data to the on-screen communication service module;

the on-screen data acquisition and processing module is further used for receiving on-screen data sent by the on-screen communication service module, and executing corresponding page synchronous processing on the on-screen communication page based on the data type contained in the on-screen data;

the creation request processing module is used for receiving the on-screen communication sharing creation request sent by the creation module, registering on-screen communication service based on the on-screen communication creation request, generating a corresponding on-screen communication sharing link and/or on-screen communication sharing description data and sending the on-screen communication sharing link and/or on-screen communication sharing description data to a corresponding instant messaging application terminal, and generating an on-screen communication sharing creation completion notification and sending the on-screen communication sharing creation completion notification to the instant messaging application terminal sending the on-screen communication sharing creation request;

the access request processing module is used for receiving the on-screen communication service connection request sent by the link generation and processing module, searching the corresponding on-screen communication service based on the on-screen communication service connection request, and establishing communication connection between the on-screen communication service and the instant messaging application terminal, and further starting the on-screen communication service when the on-screen communication service is determined not to be started;

the on-screen communication service module is used for receiving the on-screen data sent by the on-screen data acquisition and processing module and sending the on-screen data to the on-screen data acquisition and processing module.

In one possible implementation, the instant messaging system further includes:

the link generation and processing module is further used for displaying the access entrance link in a chat panel area of the instant messaging application terminal after the access entrance link is generated;

the loading module is further configured to receive the data of the on-screen communication page returned by the server based on a network request included in the link of the on-screen communication page, load and generate the content of the on-screen communication page, and establish communication between the instant messaging application terminal and the on-screen communication service of the server;

the loading module is also used for loading a same-screen communication component on the same-screen communication page, wherein the same-screen communication component comprises one or more of a doodling component, a video display component, an audio and video control component, a recording component, a same-screen state information display component, a same-screen authority control component and a same-screen communication setting component;

the loading module is further configured to receive the on-screen communication page data sent by the server or the on-screen communication creator instant messaging application terminal, and load the local on-screen communication page based on the on-screen communication page data;

the on-screen data acquisition and processing module is further used for receiving the on-screen communication page data sent by the on-screen communication service module, replacing the loading module to load and generate the on-screen communication page content;

the creation module is further configured to acquire setting data of the sharing target shared by on-screen communication, generate a sharing request based on the setting data, and send the sharing request to the creation request processing module;

the creation request processing module is further configured to receive a sharing request sent by the creation module, analyze a sharing target and a corresponding on-screen communication sharing link included in the sharing request, and send the on-screen communication sharing link and/or the on-screen communication sharing description data to the sharing target.

In a possible implementation manner, the on-screen page of the instant messaging system further includes an audio/video module, a doodle module, and a page content data generation module, where:

the audio and video module is used for executing audio and/or video communication between the instant messaging application terminal and a server or other instant messaging application terminals participating in same-screen communication;

the scrawling module is used for collecting scrawling data, sending the scrawling data to the on-screen communication service module, receiving the scrawling data sent by the on-screen communication service module and executing scrawling drawing;

the page content data generation module in the on-screen communication page is used for locally acquiring the on-screen communication shared data content based on the on-screen communication shared information, locally loading and generating the on-screen communication page content based on the on-screen communication shared data content, and acquiring or generating on-screen communication page data to be sent to the server or other participant terminals.

In a possible implementation manner, the server of the instant messaging system further includes a recording module and a page content data generating module, wherein:

the recording module is used for recording one or more of on-screen communication page data, on-screen data received by the on-screen communication service module, on-screen data sent to the on-screen data acquisition and processing module, sender information, receiver information and occurrence time information, and storing the on-screen data, the sender information, the receiver information and the occurrence time information in a structured manner to generate recorded data in an on-screen communication process;

the page content data generation module of the server is used for generating on-screen communication page data at the server based on the data and/or information contained in the on-screen communication sharing creation request sent by the creation module;

the page content data generation module of the server is further configured to create an on-screen communication component in the on-screen communication page, and add the on-screen communication component data to the on-screen communication page data generated by the server;

the access request processing module is further configured to return the on-screen communication page data to the instant messaging application terminal after receiving a network request sent by the instant messaging application terminal to start the on-screen communication page;

and the on-screen communication service module is also used for returning the corresponding on-screen communication page data to the instant messaging application terminal after establishing connection with the instant messaging application terminal.

In a fourth aspect, the present application further provides a computer program product, which includes instructions that, when executed on a computer, cause the computer to perform the method for establishing and sharing on-screen communication with a user in an instant messaging application according to any one of the first and second aspects.

The invention has at least the following beneficial effects:

the invention provides a method for establishing same-screen communication sharing in instant messaging application, which enables a user to establish sharing based on content to be shared and quickly enter same-screen communication based on sharing at an instant messaging application terminal. Therefore, the method and the device increase novel sharing for the instant messaging application, and are high in efficiency and good in experience.

Drawings

Fig. 1 is a schematic flowchart illustrating a process of creating and starting on-screen communication sharing at an instant messaging application creator terminal according to an embodiment of the present disclosure;

fig. 2 is a schematic flowchart illustrating a process of receiving and starting on-screen communication sharing at an instant messaging application receiver terminal according to an embodiment of the present application;

fig. 3 is a schematic flowchart of loading page data from a server through a network request according to an embodiment of the present application;

fig. 4 is a schematic flowchart illustrating a process of loading page data by connecting a co-screen communication service according to an embodiment of the present application;

fig. 5 is a schematic flowchart of locally loading an on-screen communication component according to an embodiment of the present application;

fig. 6 is a schematic flowchart of related data processing on the same screen according to an embodiment of the present application;

fig. 7 is a schematic flowchart of an audio/video communication process according to an embodiment of the present application;

fig. 8 is a schematic flowchart of a process for generating and processing page data at a creator terminal according to an embodiment of the present disclosure;

fig. 9 is a schematic flowchart of loading page data at a participant terminal according to an embodiment of the present disclosure;

fig. 10 is a schematic flowchart illustrating a process of generating a sharing request by an instant messaging application terminal according to an embodiment of the present application;

fig. 11 is a schematic flowchart illustrating a process of processing a share creation request on the same screen at a server according to an embodiment of the present application;

fig. 12 is a schematic flowchart illustrating a connection and service providing process of an on-screen communication service according to an embodiment of the present application;

fig. 13 is a schematic flowchart illustrating a process of processing a sharing request by a server according to an embodiment of the present disclosure;

fig. 14 is a schematic flowchart of a process of generating page data and providing a service at a server according to an embodiment of the present application;

fig. 15 is a schematic flowchart of a process of generating on-screen communication component data at a server according to an embodiment of the present application;

fig. 16 is a schematic flowchart of a process of recording the on-screen communication at the server according to an embodiment of the present application;

fig. 17 is a schematic flowchart illustrating a process of establishing on-screen communication sharing in an instant messaging application according to an embodiment of the present application;

fig. 18 is a schematic structural diagram of an instant messaging system including an on-screen communication sharing function according to an embodiment of the present application;

fig. 19 is a schematic structural diagram of an instant messaging system including an on-screen communication sharing function according to an embodiment of the present application;

fig. 20 is a schematic view of an interface for establishing on-screen communication sharing in an instant messaging application according to an embodiment of the present application;

fig. 21 is a schematic view of an interface for establishing on-screen communication and sharing in an instant messaging application according to an embodiment of the present application;

fig. 22 is a schematic interface diagram illustrating establishment of on-screen communication sharing in an instant messaging application according to an embodiment of the present application;

fig. 23 is a schematic interface diagram illustrating establishment of on-screen communication sharing in an instant messaging application according to an embodiment of the present application;

fig. 24 is a schematic interface diagram illustrating establishment of on-screen communication sharing in an instant messaging application according to an embodiment of the present application;

Detailed Description

The embodiments of the present application are in part illustrative of the present application and are not intended to be limiting of the present application.

The embodiment of the application can be applied to an instant messaging system, comprising an instant messaging application terminal, a server and other systems associated with the instant messaging system.

The term "sharing" in the embodiments of the present application also includes "sending", that is, a form of sending some content or data to some person. The same-screen interactive communication in the embodiment of the application comprises one or more of page display synchronization, page operation or operation effect synchronization, audio communication, video communication and synchronous doodling.

Embodiments of the present application will now be described with reference to the accompanying drawings, and it is to be understood that the described embodiments are merely illustrative of some, but not all, embodiments of the present application. As can be known to those skilled in the art, with the development of technology and the emergence of new scenarios, the technical solution provided in the embodiments of the present application is also applicable to similar technical problems.

Fig. 1 shows a schematic flow diagram of a possible process of creating and starting on-screen communication sharing at an instant messaging application creator terminal, where in step S101, data and/or information are acquired based on shared content to be created on-screen communication sharing, an on-screen communication sharing creation request is generated based on the data and/or information, and the on-screen communication sharing creation request is sent to a server. And returning a processing result after the creation request is processed by the server, wherein the processing result comprises but is not limited to a same-screen communication sharing link, description data of same-screen communication sharing, processing completion notification information and the like. Step S102 is executed at the creator terminal, the on-screen communication sharing link and/or the on-screen communication sharing description data sent by the server are received, an access entry link is generated based on the on-screen communication sharing link and/or the on-screen communication sharing description data, and the access entry link is displayed at the instant messaging application terminal, or an on-screen communication sharing creation completion notification returned by the server is received. And S103, after a trigger event for the access entry link is received or a notification of completion of creation of the same-screen communication sharing is received, starting a same-screen communication page.

In the above embodiment, the S101 generates the same-screen exchange sharing creation request, and provides two ways of obtaining data and information based on the content to be shared, for example, the content to be shared is a PDF document, where the data is PDF file data, and the information is information such as a file name, a file path, a network file address, and the like.

Optionally, S101 generates a request for sharing and creating on the same screen, where the request includes user identification or verification information such as a user ID and a Cookie; optionally, after the instant messaging application terminal establishes a communication connection with the server, the network request sent to the server automatically includes user identification information; optionally, in this embodiment of the application, based on a communication connection established between the instant messaging application terminal and the server, the server identifies the user identity through the communication connection.

Optionally, the on-screen communication and sharing creation request further includes setting information for on-screen communication and sharing, for example: the method includes the steps of establishing a same-screen communication sharing mode (data or information), generating a same-screen communication page content data mode (server side generation or local generation), loading page data in which mode is adopted (network link loading or loading through the same-screen communication service), judging whether to perform data protection (such as prohibiting screen capture in the communication process), accessible effective time, judging whether to start recording, initially setting a same-screen communication part (such as default video closing), limiting setting of the same-screen communication (such as limiting current chat user access, re-sharing invalidity, limiting the number of rooms, limiting the position and the like), controlling setting of the same-screen communication (such as only one party has operation authority), judging whether to start video communication, accessing a password, adding watermarks and the like, and the method includes but is not limited to the above setting information. Optionally, the default assignment process is executed based on a default value included in part or all of the setting information. Optionally, the setting of the same-screen communication sharing by the user is recorded to generate user setting, and the user setting assignment is used when the same-screen communication sharing creation request is generated. Optionally, the setting information is stored at the server and the generated same-screen communication sharing is set.

It should be particularly noted that, in the present application, and/or the association relationship of the associated object is described, it means that there may be three relationships. For example, A and/or B may indicate that A is present alone, A and B are present simultaneously, and B is present alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.

The on-screen communication sharing description data is used for displaying on-screen communication sharing in the instant messaging application terminal, such as names.

Optionally, the entry link further includes the on-screen communication sharing link, that is, the content of the on-screen communication sharing link is directly displayed in the entry link.

The on-screen communication page is used for displaying the on-screen communication shared content, the on-screen communication component and the like, the form of the content presented by the on-screen communication page includes but is not limited to a webpage, a webview component, a picture, a table component, a pdf browsing control, a word control and the like, and the form of the page includes but is not limited to an independent page, a pop-up window and the like.

With reference to the foregoing embodiments, in a specific implementation scenario, in the instant messaging application terminal, in response to a selection event of a user for the on-screen communication sharing content, receiving the on-screen communication sharing content (or information) selected by the user, generating and sending the on-screen communication sharing creation request based on the content, optionally, in response to the selection event of the user for the sharing content, receiving tag information selected by the user for creating the on-screen communication sharing type sharing based on the sharing content (that is, the user selects to designate sharing based on the content for creating the on-screen communication type while sharing a content), generating the on-screen communication sharing creation request based on the sharing content and the tag information, or generating the sharing creation request, and including a creation type parameter in the sharing creation request, where the parameter is an on-screen communication type, the method can also be understood as that a common sharing creation request is sent to the server, meanwhile, the sent request includes type information of the sharing request, the type is an on-screen communication sharing type, and the server identifies the common sharing creation request as the on-screen communication sharing creation request and processes the on-screen communication sharing creation request.

Fig. 2 is a schematic flow chart illustrating a possible on-screen communication sharing recipient terminal of an instant messaging application receiving and starting on-screen communication sharing. Step S201 receives the on-screen communication sharing link and/or the on-screen communication sharing description data sent by the server or other instant communication application terminals, generates an access entry link based on the on-screen communication sharing link and displays the access entry link on the instant communication application terminal. Step S202, after receiving the trigger event for accessing the entry link, starting the same-screen communication page. Optionally, the entry link further includes a form of directly adopting the on-screen communication sharing link. Optionally, after receiving a trigger event for accessing the portal link or starting the on-screen page, a connection request is sent to the server, and optionally, the connection request carries parameter information of a user (such as a user ID). Optionally, the on-screen page includes an independent page, a pop-up window, and the like. Optionally, in S201, a notification of completion of on-screen communication and sharing sent by a server or other instant messaging terminals is received, and an on-screen communication page is started after the user confirms the notification information, where the notification of completion of on-screen communication and sharing includes the on-screen communication and sharing link and/or the on-screen communication and sharing description data information. Optionally, after the step S202 accesses the entry link, an access verification operation is performed, and verification data is collected and sent to the server, for example, the identity of the visitor is verified, and the access right is verified. Optionally, the receiver terminal receives and displays the verification result information returned by the server, for example, an access time limit is set for a certain on-screen communication and sharing, and the server returns related prompt information for prohibiting entry.

With the embodiments shown in fig. 1 and fig. 2, a user can quickly generate on-screen communication sharing in the instant messaging system based on the content to be shared at the instant messaging application terminal and send the on-screen communication sharing to a receiver, and a creator and the receiver can quickly enter on-screen communication based on the generated link or notification, display the shared content on the same screen, and perform synchronization operation. Therefore, the embodiment has the advantages that efficient on-screen interactive communication is realized under the condition that operation steps of a user are not increased (if the number of the operation steps is approximately the same as that of common file sharing), the operation is simple, and the communication efficiency and quality are improved.

In another specific implementation scenario, the steps S102 and S201 generate an access entry link based on the on-screen communication sharing link and/or the on-screen communication sharing description data, and display the access entry link in a chat panel area of the instant messaging application terminal. Optionally, the on-screen communication sharing link is directly displayed in a chat panel area of the instant messaging application terminal. The implementation scene is suitable for the chat scene of instant messaging, such as two-user chat, group chat and the like, and has the characteristic of high efficiency. Optionally, the on-screen communication sharing entry link is displayed on the instant messaging application terminal, and the mark information or the related setting information that can be subjected to on-screen communication is displayed on the entry link.

In a possible implementation manner, as shown in fig. 3, after the instant messaging application terminal starts an on-screen communication page in S301, S302 requests data from a server based on a network request included in a link of the on-screen communication page, and S303 receives on-screen communication page data returned by the server to load and generate a local on-screen communication page, and establishes communication between the instant messaging application terminal and an on-screen communication service corresponding to the server. The implementation method obtains the data of the on-screen communication page from the server through a network request contained in the link of the on-screen communication page, for example, a webpage A is generated for certain on-screen communication sharing at the server, namely, the webpage A contains the shared content provided by a user, and the link of the generated on-screen communication page contains the website of the webpage A, so that after the on-screen communication page is opened at the terminal, the webpage A is accessed and loaded to obtain the data of the on-screen communication content.

In another possible implementation manner, as shown in fig. 4, at an instant messaging application terminal, S401 starts an on-screen communication page, S402 sends an on-screen communication service connection request to a server, establishes communication with the on-screen communication service, and S403 receives the on-screen communication page data sent by the on-screen communication service, loads and generates the on-screen communication page. In step S402, the communication between the instant messaging application terminal and the on-screen communication service is established, where the on-screen communication service is used to provide data communication service for the terminal during on-screen communication. It can be seen that, in this manner, after the loading of the on-screen page itself is completed, the on-screen page data content is not included, that is, the shared content is not included, and after the loading of the page is completed, the on-screen page data is obtained from the on-screen page data service through S403, and the page including the shared content is loaded and generated. The realization mode is beneficial to the unified management and processing of the transmitted data by the same-screen communication service.

In a possible implementation manner, corresponding to the above implementation manner that the instant messaging application terminal shown in fig. 3 requests the data of the on-screen communication page through the network request included in the link of the on-screen communication page and the implementation manner that the instant messaging application terminal shown in fig. 4 loads the data of the on-screen communication page through the on-screen communication service, the implementation manner at the service end is shown in fig. 14, S1401 receives the on-screen communication sharing creation request sent by the instant messaging application terminal, S1402 generates the data of the on-screen communication page at the service end based on the data and/or information included in the on-screen communication sharing creation request, S1403 returns the data of the on-screen communication page to the instant messaging application terminal after receiving the network request sent by the instant messaging application terminal starting the on-screen communication page, or, after receiving the connection request of the on-screen communication service sent by the instant messaging application terminal, and returning the corresponding same-screen communication page data to the instant messaging application terminal. The implementation method generates and stores the same-screen communication page and/or the same-screen communication page data at the server, corresponds to the terminal implementation mode shown in fig. 3, and for example, generates a webpage file at the server based on the shared content data sent by the creator terminal and stores the webpage file at the server, such as a webpage a, and then generates a same-screen communication sharing link based on the website of the webpage a; corresponding to the terminal implementation shown in fig. 4, for example, the on-screen page data is generated and stored as a data record at the server based on the shared content data sent by the creator terminal, and the relationship between the data record and the registered on-screen communication service is recorded, and the data included in the corresponding data record is returned after the on-screen communication service connection request is received at S1403.

In a possible implementation manner, as shown in fig. 5, after the on-screen communication page is started in S501, S502 is executed to load the on-screen communication component locally in the instant messaging application terminal. The on-screen communication component comprises one or more of a scrawling component, a video display component, an audio and video control component, a recording component, an on-screen state information display component, an on-screen authority control component and an on-screen communication setting component, and is used for assisting on-screen communication and realizing related function control in the on-screen communication process. Optionally, S502 is executed, and the on-screen communication component is initialized and configured, for example, a microphone is turned on by default, and an audio communication service is connected. Optionally, the on-screen communication component is loaded based on the existing configuration information and the on-screen communication shared setting information, such as a graffiti component, a video display component, a video control component, and the like. The implementation mode has high component loading speed and does not need to acquire data from a server.

In another possible implementation manner, as shown in fig. 15, at the server, S1501 generates on-screen page data at the server, and simultaneously or subsequently, S1502 creates on-screen communication components in the on-screen page generated at the server, and adds the on-screen communication component data to the on-screen page data. Through the possible implementation mode, the same-screen communication component is generated at the server side, so that the terminal can load the same-screen communication component after downloading, or the same-screen communication component is loaded by receiving the same-screen communication service data. Optionally, S1502 further includes generating an initialization configuration of the on-screen communication component, and generating and/or configuring the on-screen communication component based on the existing configuration information at the service end, which is similar to the above embodiment and is not described herein again. Through the implementation mode, the loading configuration of the on-screen communication component can be updated under the condition that the terminal program is not updated, and the business logic adjustment is realized.

In a possible implementation manner, as shown in fig. 6, in an instant messaging application terminal, when the loading of the on-screen communication page and the on-screen communication component is completed or in the loading process, step S601 is executed to establish communication with the server side between the on-screen communication services, and then step S602 is executed to collect one or more of operation instruction data, picture data, content data, and video data on the on-screen communication page, generate on-screen data, and send the on-screen data to the on-screen communication services; and receiving the on-screen data sent by the on-screen communication service, and executing page synchronization processing on the on-screen communication page based on the data type contained in the on-screen data.

The method comprises the steps that S601 communication between the terminal and the server-side on-screen communication service is established, the on-screen communication service is similar to a service program of a conference room, and data communication service is provided for each terminal in the on-screen communication process and used for sending and receiving on-screen data. Optionally, in a possible implementation scenario, the on-screen communication service is executed at the instant messaging application terminal, so as to implement direct communication between terminals participating in on-screen communication.

In the above embodiment, as a result of the execution of S602, it is achieved that the display and/or operation of the on-screen page of each terminal participating in the on-screen communication are kept synchronized, that is, the operation is executed at one of the terminals, and the resulting change of the on-screen page picture content is synchronized, and the operation effect is synchronized to the other terminal, and the implementation manner includes, but is not limited to, one or more of the following manners:

the first method is as follows: starting event monitoring to acquire an operation event at an instant messaging application terminal which is operated, wherein the operation event at least comprises a user operation event, converting the monitored operation event into an operation instruction, acquiring the operation instruction and data related to the operation event to generate operation data, and sending the operation data serving as on-screen data to the on-screen communication service; and other instant messaging application terminals participating in the on-screen communication receive the on-screen data, analyze the operation instruction and the data related to the operation contained in the on-screen data, and execute the corresponding operation instruction on the receiver terminal based on the data related to the operation to obtain the effect of synchronizing with the operated terminal. The following illustrates the above process, for example, in the form of a web page, where the on-screen communication page is in the form of a web page: for example, a click operation occurs on a terminal webpage at one side, after the event is monitored, the click operation is converted into a click operation instruction, a button with the click event occurring and a function triggered by the click event are recorded as data related to the click operation, and on-click event execution of the corresponding button is called through Javascript or the function triggered by the click event is executed at a receiving terminal webpage, so that a page operation effect consistent with the terminal with the occurrence of the operation is obtained. For another example, when a page sliding operation occurs on a terminal webpage at one side, a page sliding operation instruction is correspondingly generated after a page sliding event is monitored, sliding distance data is recorded, and the page sliding operation instruction is executed through Javascript on the receiving terminal webpage by taking the sliding displacement as a parameter, so that the effect of page synchronous sliding is realized.

The second method comprises the following steps: starting an event monitoring page data content change at an operated instant messaging application terminal, wherein the page data is used for generating the page display content of the same-screen communication page based on the page data, acquiring all page data or changed incremental part data to generate same-screen data after monitoring the page data content change, and sending the same-screen data to the same-screen communication service; and other instant messaging application terminals participating in the same-screen communication receive the same-screen data, and based on the content and the property of the page data contained in the same-screen data, the page data is updated or replaced at the receiver terminal, and finally the page data content consistent with the generation operation terminal is generated, so that the same page display effect is obtained. Also, taking the form of the on-screen communication page as a web page as an example, the above process is explained: for example, in a web page of a side terminal, a function for monitoring web page content change, such as a MutationObserver, is started to monitor, after the content of web page data changes due to user operation of the side, web page data of a changed part, such as DOM data, serialized DOM data and the like, is collected and sent as same-screen data, a receiver terminal receives the web page data, and updates or replaces local web page data, so that the final display content of the web page is updated, and the display effect which is consistent with that of a terminal web page with the first web page content change is kept.

The third method comprises the following steps: starting event monitoring at an operated instant messaging application terminal, generating picture data and/or drawing instructions based on page display contents or changed page display contents after monitoring an event, and sending the picture data and/or the drawing instructions as same-screen data; and receiving the same-screen data at the receiver terminal, analyzing the picture data and/or drawing instructions contained in the same-screen data, and displaying or drawing the picture or replacing the picture on the local terminal page based on the same-screen data, so that the display content of the receiver terminal is consistent with the page display of the sending terminal.

The method is as follows: recording screen data at an instant messaging application terminal at one side, acquiring picture or video data, generating same-screen data and sending the same-screen data; and receiving and displaying the picture or video data at other terminals participating in the on-screen communication, thereby obtaining the on-screen display effect. Optionally, at a terminal that receives and displays the picture or video data, collecting a user operation event, and generating and sending on-screen data based on the operation event; and receiving the on-screen data and analyzing the operation events contained in the on-screen data at a terminal at one side of the recorded screen data, and executing the operations contained in the operation events at the terminal. Optionally, after receiving the instruction that the on-screen communication creator terminal quits the on-screen communication, stopping recording the screen data. The method realizes that the terminal A records screen data, the terminal B, C participating in the same-screen communication keeps consistent with the display of the terminal A by acquiring display content, the terminal A is an execution environment of a same-screen communication page, B, C only displays a result in an image or video form, for the purpose of interaction, when a user slides a picture in the terminal B, a sliding event, data (such as sliding displacement and position) related to the event and the like are collected to generate same-screen data to be sent, and after the terminal A receives the same-screen data, the terminal A actually executes sliding operation, and since a B, C picture and the terminal A keep a synchronous state, the terminal B finally displays a sliding effect.

The above implementation manners all achieve the effect of the same-screen page synchronization and synchronization between the terminals participating in the same-screen communication, and it should be particularly noted that the method for implementing the same-screen page synchronization and synchronization of the same-screen page communication is not limited to the above manner, and the above manner is only an example of a part of the implementation manners, and the application should not be limited by the above example.

In one possible implementation manner, as shown in fig. 7, in an instant messaging application terminal, S701 starts an on-screen communication page, S702 establishes audio and/or video communication between the instant messaging application terminal and a server or other instant messaging application terminals participating in on-screen communication, and S703 sends and receives audio data and/or video data. Optionally, the instant messaging application terminal establishes a connection with a server providing an audio and video service, and sends and receives audio and video data. Preferably, WebRTC (Web Real Time Communication) is used to directly perform video and audio Communication between the terminals participating in the Communication. Optionally, the steps S702 and S703 are executed at the instant messaging application terminal. Optionally, the steps S702 and S703 are executed in the on-screen page program.

Through the implementation mode, audio and video communication among all terminals participating in same-screen communication is established, the audio and video communication is carried out while the same-screen interactive communication is carried out, the communication efficiency and the user experience are further improved, and the face-to-face communication effect is finally obtained.

In a possible implementation manner, after the instant messaging application terminal starts the on-screen communication page, a doodle component starting instruction is received, user operation is intercepted, doodle operation data is collected to generate on-screen data, and the on-screen data is sent to a server or other participant terminals; and receiving the same-screen data sent by the server or other participant terminals, analyzing the doodle operation data contained in the same-screen data, and executing synchronous doodle drawing at the local terminal. The implementation mode realizes the scrawling synchronization between the alternating current terminals.

In a possible implementation manner, as shown in fig. 8, at an instant messaging application terminal where the creator is located in the same-screen communication, the instant messaging application terminal where the creator is located starts the same-screen communication page S801, S802 locally obtains data related to the same-screen communication sharing at the instant messaging application terminal of the creator based on the information shared in the same-screen communication, generates the same-screen communication page data based on the data related to the same-screen communication sharing, locally loads the same-screen communication page, and S803 sends the same-screen communication page data to the server or other participant terminals.

The above implementation manner provides a method for generating on-screen page data communication at a creator terminal, which illustrates: the creator creates the on-screen share based on the local file a.pdf, but the file data is large, and the creator initially intends to perform a communication discussion on a part of the content, so that when the on-screen share creation request is generated, the information providing the a.pdf is used for creation (such as a file name and a storage path of the file in the local), that is, actual file data is not provided. When the server processes the creation request, the on-screen page data (or content data of a.pdf) is not generated and stored at the server corresponding to the generated on-screen sharing, and only information such as a file name and a local storage path of the file is stored. After the on-screen communication sharing is completed, the creator terminal executes step S801 to enter an on-screen communication page, locally acquires content data of a.pdf according to a file name included in the on-screen communication sharing description information and local storage path information of a file, displays the content data in the on-screen communication page of the creator terminal, and simultaneously executes step S803 to send page data corresponding to the page display. By the implementation mode, the transmission quantity of the network is reduced in the creating process, the storage resource of the server is saved, and in addition, the creator only sends the content data of the display part of the a.pdf to the receiver, which is beneficial to protecting the whole data content.

In a possible implementation manner, the same-screen communication page data is generated at the server corresponding to fig. 14, the same-screen communication page data is generated at the creator terminal corresponding to fig. 8, and a process of loading the same-screen communication page data at the receiver terminal is shown in fig. 9, an instant messaging application terminal where a participant is located starts the same-screen communication page S901, and an instant messaging application terminal where the participant is located receives the same-screen communication page data sent by the server or the creator, and loads a local same-screen communication page based on the same-screen communication page data S902. In the above implementation manner, the manner of receiving data in S902 includes, but is not limited to, requesting to obtain data through a network request included in a link of the on-screen page, and obtaining data through the on-screen communication service.

In another possible implementation manner, as shown in fig. 10, the following steps are performed at an instant messaging application terminal where the on-screen communication sharing creator is located: s1001 obtains setting data of the shared target user shared by the same-screen communication, and S1002 generates a sharing request based on the setting data and sends the sharing request to the server. The method for realizing the same screen communication sharing sets the sharing target user at the same time of establishing the same screen communication sharing. Optionally, S1002 generates a separate sharing request and sends the request to the server. Optionally, the content of the sharing request generated in S1002 is merged into the on-screen communication sharing creation request and sent, that is, the on-screen communication sharing creation request includes creation information and sharing target information at the same time. Optionally, in a specific application scenario, the instant messaging system obtains shared target user information according to the scenario calculation without generating and sending the sharing request, for example, in a chat scenario between a user a and a user B, the user a creates on-screen communication sharing, and the user B is automatically set as a sharing target. It should be noted that the sharing target in the present application may be understood as a user, a terminal, a module, or a program, etc. for receiving sharing, including but not limited to an instant messaging terminal user, an instant messaging terminal user set, a chat room, etc.

In a possible implementation manner, a processing flow of processing the on-screen communication sharing request at the server is as shown in fig. 11, S1101 receives an on-screen communication sharing creation request sent by an instant messaging application terminal, S1102 registers an on-screen communication service based on the on-screen communication creation request, then S1103 is executed to generate a corresponding on-screen communication sharing link and/or on-screen communication sharing description data to send to the corresponding instant messaging application terminal, or S1104 is executed to generate an on-screen communication sharing creation completion notification to send to the instant messaging application terminal that sends the on-screen communication sharing creation request.

Optionally, S1102 registers the on-screen communication service, including but not limited to creating an on-screen communication service record, assigning an on-screen communication service program, and starting one or more processes of the on-screen communication service program, which may be understood as registering a conference room, and may select to provide room service immediately or upon receiving a connection. Optionally, S1102 further includes registering configuration information of the on-screen communication service, such as a maximum connection number. Optionally, S1102 further includes recording associated information of the on-screen communication service, such as data or information shared by on-screen communication, a creator, a sharing target (a recipient or a chat ID, etc.), and the like. By the method, the on-screen communication service is registered, so that on-screen communication sharing created by the user can be managed conveniently. Optionally, after the step S1101, the method further includes processing, at the server, the received data for creating the on-screen communication sharing, for example, converting the received data into a web page format, adding a watermark, and generating on-screen communication page data.

In the above steps, the on-screen communication sharing link and/or on-screen communication sharing description data generated in S1103 is used for the creator or recipient of the on-screen communication sharing to receive, and generate entry information at the terminal; the on-screen communication sharing creation completion notification generated in S1104 is used for the creator terminal to receive, for example, the creator terminal directly enters the on-screen communication page after receiving the notification, which is convenient and efficient. Optionally, after the server fails to create the on-screen communication and sharing request, the method further includes returning a notification of the on-screen communication and sharing creation failure to the creator terminal, and the creator terminal displays notification content after receiving the notification.

In a possible scenario, the method can skip step S1102 to implement, namely, the on-screen communication service is not registered, and after the on-screen communication sharing creation is completed, the corresponding on-screen communication service is allocated to provide the communication service, and the method is implemented in a mode of allocating the on-screen communication service in real time.

In a possible implementation manner, a processing flow of the server processing the on-screen communication and sharing connection request is shown in fig. 12, and S1201 receives an on-screen communication service connection request sent by an instant messaging application terminal; s1202, searching a corresponding on-screen communication service based on the on-screen communication service connection request, and establishing communication connection between the instant messaging application terminal and the corresponding on-screen communication service; s1203 the on-screen communication service receives the on-screen data sent by the instant messaging application terminal, and sends the on-screen data to other instant messaging application terminals connected with the on-screen communication service. In the above implementation manner, S1202 searches for and connects to the corresponding on-screen communication service, and optionally, when it is determined that the on-screen communication service is not started, the on-screen communication service is started. Optionally, S1202 detects the connection request, such as: whether connection is allowed or not is judged based on the sharing target shared by the on-screen communication and/or the configuration information of the on-screen communication service, and prompt information is returned when connection is not allowed, so that the situations that fake links enter on-screen communication and the like are prevented. Optionally, the on-screen communication service in S1203 further includes processing the received on-screen data, generating new on-screen data, and sending the new on-screen data to other receiving terminals, where the processing includes but is not limited to sensitive word detection, data filtering, and the like. Above, S1202 can be understood as a process of entering a conference room, and the step S1203 is similar to the process of providing a conference room service.

In a possible implementation manner, a processing flow of the server processing the sharing request sent by the instant messaging terminal is shown in fig. 13, and S1301 receives the sharing request sent by the instant messaging application client; s1302, analyzing a sharing target contained in the sharing request and a corresponding same-screen communication sharing link; and S1303 the on-screen communication sharing link and/or the on-screen communication sharing description data are/is sent to the sharing target. Optionally, the sharing request is processed based on the setting information of the on-screen communication sharing, for example, the effective time of the on-screen communication sharing is set in the setting information, and when the instant messaging terminal generates the sharing request or the server processes the sharing request, the validity judgment is executed, and the corresponding prompt information is returned and displayed. Optionally, the sharing request is processed while the on-screen communication sharing creation request is processed.

In a possible implementation manner, as shown in fig. 16, S1601 is to start an on-screen communication service at a server; s1602 record, at the server, one or more of an on-screen communication service ID (room ID), on-screen communication page data, on-screen data received by the on-screen communication service, on-screen data sent to the instant messaging application terminal, sender information, receiver information, and occurrence time information to generate on-screen communication process recording data. Optionally, the audio data and/or the video data sent by the instant messaging application terminal are recorded and generated to the recorded data in the same-screen communication process. Optionally, the doodle data sent by the instant messaging application terminal is received, recorded and generated, and the recorded data in the same-screen communication process is generated. Preferably, the data received and sent in the one-time on-screen interaction process and the corresponding occurrence time information are stored according to a structure to generate the on-screen communication process recording data. Optionally, after the data recorded in the same-screen communication process changes every time, a message abstract algorithm is adopted to generate a message abstract for the data recorded in the same-screen communication process, the message abstract is used for storing the verification of the same-screen communication process, optionally, the message abstract is displayed on the same-screen communication page, optionally, after the same-screen communication process is finished, the generated message abstract is displayed on a terminal or submitted to a block chain for storage.

The above implementation mode realizes recording, storing and storing of the same-screen communication process aiming at the same-screen sharing communication, and in addition, the data recorded in the same-screen communication process can also be used for generating playback of the same-screen communication process or generating a playback video.

In a possible implementation manner, the method provided in the embodiment shown in fig. 16 is executed at the instant messaging application terminal, and the recording data of the on-screen communication process is recorded and generated at the instant messaging application terminal.

For the convenience of understanding, the following is exemplified by an integrated implementation process, as shown in fig. 17, including the instant messaging application terminal 10A (creator terminal), the server 20, and the instant messaging application terminal 10B (recipient terminal), and the schematic flow is as follows:

at the instant messaging application terminal 10A:

s1701, a request for creating on-screen communication and sharing is generated. In this step, content used for creating on-screen communication and sharing is selected, and optionally, the creation request includes creator user ID information, creation mode (created through information or data), setting information of on-screen communication and sharing, and the like;

s1702, generate a sharing request. This step sets the goals of sharing, including but not limited to: recipient user ID, chat ID, group chat room ID, etc.;

and S1703, sending a creating and sharing request. Optionally, after the creating step is completed, the same-screen communication sharing link is selected on a chat panel, a sharing target is set, and a new sharing request is generated and sent;

at the server 20:

s1704, receiving a creating and sharing request;

and S1705, generating the same-screen page data. The method of generating and storing the same-screen communication page data at the server is adopted, so that the participant terminal downloads the data after entering the same-screen communication;

s1706, creating an on-screen communication component, and adding the on-screen communication component data into the on-screen communication page data. In the method, the on-screen communication component is generated on the on-screen communication page of the server, and the on-screen communication component is included when the on-screen communication page is loaded by the terminal. Optionally, when the on-screen communication component is generated, default setting is performed on the on-screen communication component, or default configuration parameters are provided;

and S1707, registering the on-screen communication service, and generating a corresponding on-screen communication sharing link and/or on-screen communication sharing description data. The execution sequence of this step is not particularly limited, and may be executed after S1704. This step may be understood as registering a conference room. Optionally, the on-screen communication service is started in this step;

and S1708, generating a same-screen communication sharing creation completion notification. In this embodiment, a manner of sending a notification to a creator terminal after a server processes a creation request is completed is adopted, so that the creator terminal directly enters on-screen communication after receiving the notification, and optionally, an on-screen communication sharing link and description information are generated and sent to the creator terminal;

s1709, sending a same-screen communication sharing creation completion notification;

at the instant messaging application terminal 10A:

s1711, receiving a same-screen communication sharing creation completion notification;

s1712, starting a same-screen communication page;

at the server 20:

s1710, processing a sharing request;

s1713, sending the same-screen communication sharing link and the description information;

at the instant messaging application terminal 10B:

s1717, generating and displaying an access entry link;

s1718, receiving a trigger event for accessing the entrance link, and starting the same-screen communication page;

at the instant messaging application terminal 10A:

and S1714, sending a network link request of the same-screen communication page. The step is related to the step S1712, after the on-screen page is started, the on-screen page data is requested to be loaded from the server through the website included in the page;

at the server 20:

s1715, returning the same-screen alternating page data;

at the instant messaging application terminal 10A:

and S1716, loading the data of the same-screen alternating page. The on-screen page loaded in this step already includes relevant components for on-screen communication (refer to the server-side processing in step S1706);

s1721, sending the same-screen communication service connection request. This step is aimed at establishing data communication related to the same screen;

at the server 20:

s1722, starting the on-screen communication service and establishing connection. The step adopts a mode of starting the same-screen communication service when a connection request is received, and establishes connection between the same-screen communication service and the terminal 10A;

at the instant messaging application terminal 10B:

s1719, sending a network link request of the same-screen communication page (similar to the processing of S1714);

at the server 20:

s1720, returning the same-screen page data;

at the instant messaging application terminal 10B:

s1723, loading the data of the on-screen communication page (similar to the processing of S1716);

s1724, sending a connection request of the same-screen communication service;

at the server 20:

s1725, establishing the same-screen communication service connection. Namely, the connection between the same-screen communication service and the terminal 10B is established;

the same-screen interaction is started, for example, when a user operation occurs in the 10B terminal, and the 10A terminal is synchronized, as follows:

at the instant messaging application terminal 10B:

s1726, collecting and generating the same-screen data;

s1727, sending the same-screen data;

at the server 20:

s1728, processing the data on the same screen;

s1729, sending the same-screen data;

at the instant messaging application terminal 10A:

s1730, receiving the data on the same screen, and executing page synchronization processing. Through the steps, the effect of synchronous operation on the same screen as the instant messaging application terminal 10B is obtained.

It should be noted that this example only represents an implementation manner of the present application, some steps or modules of the present application may be combined, replaced, and omitted, the execution sequence of the steps is not fixed, and the present application is only used for illustrating the implementation principle of the present application, and the present application should not be limited thereby.

In a possible implementation manner, an instant messaging application terminal of the present application also includes the function of the server, so as to implement the method for establishing on-screen communication sharing in an instant messaging application provided in other embodiments of the present application. For example, the on-screen communication and sharing creation request processing is executed at an instant messaging application terminal, and on-screen communication and sharing services are registered and provided.

In a possible implementation manner, a user creates on-screen communication sharing in a scene of audio and video communication, and directly enters on-screen communication based on the created on-screen communication sharing. In the implementation mode, an audio and video communication page comprises a first button used for creating on-screen communication sharing, a trigger event of a creator to the first button is received, a sharing content selection picture is opened, sharing content selected by the creator is received, data and/or information are obtained based on the selected sharing content, an on-screen communication sharing creation request is generated based on the data and/or information, and the on-screen communication sharing creation request is sent to a server. In addition, the implementation method sets a sharing target based on a user (not including a creator) participating in the audio-video communication, further generates a sharing request and sends the sharing request to the server, and optionally, the sharing request includes information included in the sharing request in the on-screen communication sharing creation request, that is, the information is combined into a request and sent to the server. In this way, the service end processes the on-screen communication sharing creation request, and can adopt a mode of generating an on-screen communication sharing link or not generating an on-screen communication sharing link, and under the condition of not generating the on-screen communication sharing link, register the on-screen communication service and directly start the on-screen communication service, so as to provide communication service for the terminals participating in on-screen communication. In the implementation mode, each terminal participating in audio and video communication receives a notification of completion of creation of the on-screen communication sharing link or the on-screen communication sharing sent by the server, directly starts an on-screen communication page, or loads content and components of the on-screen communication page on the current audio and video communication page.

In a possible implementation manner, the user creates the on-screen communication share based on the shared content, for example, clicks to view a certain shared content, and selects to create the on-screen communication share, or long-presses a certain shared content, and selects and creates the on-screen communication share. The shared content is, for example, shared content existing in a chat panel, shared content in a circle of friends, and the like, and is mainly characterized in that the sharing record is registered at the server. In the implementation mode, the same-screen communication sharing creation request is generated at the creator terminal based on the identification information of the shared content, and is sent to the server. The server processes the same-screen communication sharing creation request, acquires data or information of the same-screen communication sharing content based on the identification information of the shared content, registers the same-screen communication sharing service at the server, generates a same-screen communication sharing link and/or same-screen communication sharing description data, or generates a notification of completing creation of the same-screen communication sharing, or generates mark information for creating the same-screen communication sharing for a certain sharing record, and sends the mark information to the creator terminal. Optionally, in this implementation, a sharing target is set based on a certain shared content, a sharing request is generated based on the setting result and sent to the server, or the sharing request and the created on-screen communication sharing request are combined into a network request to be sent, and after the on-screen communication sharing is generated by processing at the server, the setting information based on the sharing request is sent to the corresponding instant messaging application terminal in a sharing link manner. Optionally, the creator terminal receives mark information for creating the sharing record with the same screen for communication and sharing, displays a mark on the shared content, namely, marks that the shared content can be communicated with the same screen, and starts the page with the same screen for communication after receiving a trigger event of the sharing link with the mark information. Optionally, the creator terminal receives the on-screen communication sharing link and/or the on-screen communication sharing description data sent by the server, generates an access entry link based on the on-screen communication sharing link and/or the on-screen communication sharing description data, and displays the access entry link at the instant messaging application terminal, or receives an on-screen communication sharing creation completion notification returned by the server. And the creator terminal starts the on-screen communication page after receiving a trigger event for the access entry link or receiving the on-screen communication sharing creation completion notification. Receiving the on-screen communication sharing link and/or on-screen communication sharing description data sent by a server or other instant messaging application terminals at a receiver terminal, generating an access entry link based on the on-screen communication sharing link and displaying the access entry link at the instant messaging application terminal; and starting the same-screen communication page after receiving a trigger event for accessing the entrance link.

In a possible implementation manner, device information data, such as screen size, page size, and the like, is collected at the instant messaging application terminal, the device information data is included when the on-screen communication sharing creation request and the on-screen communication connection request are generated and sent, and the on-screen communication page data or the configuration data of the on-screen communication is generated based on the device information data at a server or a creator terminal. The implementation mode is beneficial to ensuring the same screen effect, for example, the page display size and proportion compatible with each terminal device are obtained by calculating the display size of each terminal, so that the problems of terminal page display difference, malposition in the doodling process and the like are solved.

In one possible implementation, the present application provides a method for creating an narration type share based on shared content and executing the share. The method specifically comprises the following steps: receiving the selection of a user on shared content used for establishing comment type sharing at the instant messaging application creator terminal; generating comment page data at the local terminal or the server based on the selected data and/or information of the shared content, loading a comment component, and generating a comment page, wherein the comment component comprises but is not limited to an audio acquisition component, a video acquisition component, a doodle component and the like; based on the operation of a creator on the comment page, one or more of operation instruction data, picture data, content data, audio data, video data and doodle data and corresponding occurrence time information are collected at the local terminal or the server side, comment data records are generated, and further structured storage is performed to generate comment data; generating a sharing and creating request of the comment type based on one or more of the shared content, the comment data, the sharing target setting, the comment page data or information and the like, and sending the sharing and creating request to a server; the server receives the request, registers the comment type sharing establishing request, and generates a comment type sharing link and/or comment type sharing description data to send to a sharing target based on the sharing target contained in the comment type sharing establishing request; receiving an explanation type sharing link and/or explanation type sharing description data sent by a server or other instant messaging application terminals at the instant messaging application creator terminal or the receiver terminal, generating an access entry link based on the explanation type sharing link and displaying the access entry link (or displaying the access entry link on a chat panel) at the instant messaging application terminal, and starting an explanation playing page after receiving a trigger event of the access entry link; after the playing is started, the comment page data is loaded, a playing control component (such as a start component, a play component, a pause component, a play progress component, a fast forward component, a rewind component and the like) is loaded, the comment data is obtained and analyzed, corresponding playing processing is executed according to time information contained in the comment data record and according to the time sequence, the corresponding playing processing is executed based on the type of the comment data record, and the corresponding playing processing is executed based on the type of the comment data record, such as one or more of operation behavior restoration based on the operation instruction data, picture replacement or drawing based on the picture data, page content data updating or replacement based on the content data, video data playing, audio data playing and graffiti drawing restoration. In the above, the content types for creating the comment type sharing include, but are not limited to, files (including folders), pictures, texts, tables, web pages, videos, sounds, websites, and the like. Optionally, the content types used for creating the comment type sharing further include existing comment type sharing, so as to implement a method for multiple comment exchanges of shared content. The implementation mode has the advantages that an offline communication mode can be implemented in instant messaging software aiming at the communication content, if a user A needs to explain and scribble and annotate part of content in a certain contract file, a user B can acquire the information when browsing the explanation and generate the evidence of the network communication process. The communication method of the above-explained type can be used as a communication mode complementary to the on-screen communication method described in the present application, and it is specifically explained that some methods for on-screen communication in the present application are also applicable to the on-screen communication method.

In a possible implementation manner, after entering the on-screen communication page, the participant realizes a replacement operation of the communication content in the communication process, specifically: receiving a change event triggered by a user or selecting a same-screen communication sharing content change event at the instant messaging application terminal; acquiring new shared content acquisition data and/or information, and generating a communication content replacement request based on the data and/or the information; generating new on-screen page data at a server or a request initiating terminal, and sending the on-screen page data to other participant terminals; processing the exchange content exchange request at the server, and sending an exchange instruction and/or on-screen exchange page data to the participant terminal; and at the participant terminal, receiving the replacement instruction to reload page data, or receiving new on-screen page data and updating the page. Optionally, a data record is registered and stored corresponding to each on-screen communication content at the server, or corresponding on-screen communication page data is further stored, so that the communication content can be switched in the on-screen communication process.

In a possible implementation manner, after the on-screen communication is finished, after the server or the local terminal generates the recorded data in the on-screen communication process, the recording completion mark information and/or the recorded data description information is returned, and the recording mark information is displayed at an entrance link in the terminal. Optionally, the recording data description information, such as recording duration, data size, and the like, is displayed at the entry link. Optionally, the obtaining of the on-screen communication sharing link and/or the on-screen communication sharing description data at the instant messaging application terminal further includes obtaining recording completion flag information and/or recording data description information of the on-screen communication. After a trigger event for the access entry link is received, starting a same-screen communication page, loading data of the same-screen communication page and/or recorded data of the same-screen communication process, loading a play control component (such as a start component, a play component, a pause component, a play progress component, a fast forward component, a rewind component and the like), analyzing the recorded data of the same-screen communication process, and executing corresponding play processing according to time sequence according to time information contained in the recorded data record, wherein the corresponding play processing is executed according to the type of the recorded data record, and the corresponding play processing comprises one or more of restoring an operation behavior based on the operation instruction data, replacing or drawing a picture based on the picture data, updating or replacing page content data based on the content data, playing video data, playing audio data and restoring and executing graffiti drawing. The above embodiments provide a method for viewing and playing back the on-screen communication process.

In a possible implementation manner, the server receives a setting request sent by the instant messaging application terminal for on-screen communication and sharing or a setting request generated according to setting information for on-screen communication and sharing, and sets the created on-screen communication and sharing or the registered on-screen communication service based on the setting information included in the setting request. For example, if the setting information is to cancel the on-screen communication service, the corresponding on-screen communication sharing type is set to be common sharing (content sharing in the prior art), and the corresponding on-screen communication service is cancelled at the same time; and if the set information is that the on-screen communication sharing is closed, the access right of the on-screen communication sharing link is cancelled, and the like. In the above example, the state of the on-screen communication sharing is changed, and optionally, the state information of the on-screen communication sharing is acquired and updated at the instant messaging application terminal, for example, the on-screen communication mark is cancelled. The above embodiment is convenient for the user to set the state of sharing by on-screen communication, for example, after the communication is finished, the state of the user is set and converted into common sharing.

In a possible implementation manner, in the same-screen communication process aiming at the same-screen communication sharing, an audio or video communication switching request sent by the instant messaging terminal is received, and the same-screen communication page is switched to an independent audio or video communication function page or an instant messaging application terminal audio or video communication page. And the method also comprises the steps of receiving a same-screen sharing and exchanging switching request sent by the instant messaging terminal and switching the current page into a same-screen exchanging page for exchanging the shared content. The embodiment exemplifies a method for switching between independent audio and video communication and on-screen communication.

In a possible implementation mode, the operation right of each participating terminal is distributed in the process of on-screen communication, only one terminal has the operation right at the same time, and the control state of the terminal is divided into the following steps according to whether the terminal has the operation right or not: idle (the terminal and other terminals do not possess the operation right), master control (the terminal possesses the operation right), controlled (other terminals possess the operation right) and other states, including:

after monitoring user operation on the same-screen communication page of one terminal, judging the control state of the terminal, and executing the following judgment and operation according to the control state:

A. when the terminal is in an idle state, sending an operation right application to the server and obtaining the operation right after permission, setting the control state of the terminal as a master control state, executing the user operation, starting a timer of the terminal to start timing operation, and informing other terminals of switching the control state into a controlled state by the server; sending an operation right application to a server and intercepting the user operation after the operation right application is rejected;

B. when the state is a controlled state, user operation is intercepted;

C. and when the state is the master control state, executing user operation, refreshing the timer and restarting timing.

After starting the timer to start timing, the method further comprises:

a, refreshing the timer and restarting timing after monitoring user operation on the same-screen communication page within a preset time threshold;

and B, if the timer reaches a preset time threshold, setting the control state of the terminal to be an idle state, sending an operation right return notice to the server, and informing other terminals of switching the control state to be the idle state by the server.

The implementation mode realizes the automatic allocation of the operation permission of each terminal in the same screen communication process.

In a possible implementation manner, in the communication mode in which the data communication is established between the on-screen communication page and the server, optionally, a communication channel established by the instant messaging terminal and the server is used instead. The communication service provided by the same-screen communication page is provided at the server side, and optionally, the server side and a communication channel established with the instant communication terminal are adopted for replacing the same-screen communication service.

In a possible implementation manner, after the server receives the on-screen communication sharing creation request, a browsing instance is created at the server, the on-screen communication page data is loaded in the browsing instance, an on-screen communication page browsing and operating instance is generated, and page monitoring is started; after the example content is loaded or the change of the example page content is monitored, acquiring the example page data to generate the on-screen data and sending the on-screen data to the instant messaging application terminal participating in on-screen communication, or acquiring a drawing instruction for drawing the example page content based on the example page and sending the drawing instruction as on-screen data to the instant messaging application terminal participating in on-screen communication, or generating picture or video data based on the example page display content and sending the picture or video data as on-screen data to the instant messaging application terminal participating in on-screen communication. Correspondingly, the data sent by the server side is received at the corresponding instant messaging application terminal. The method also comprises the steps of collecting user operation events at the instant messaging application terminal and sending the operation events to the server side. And further comprising the steps of receiving a user operation event sent by the instant messaging application terminal at the server side, and executing the user operation in the browsing instance. Optionally, the above data collecting mode includes an incremental data collecting mode and a full data collecting mode, where the incremental data is changed partial data or includes changed partial data. Optionally, in combination with the method provided by this embodiment, the same-screen communication page of one of the instant messaging application terminals is used to replace the browsing and operating example described above. The implementation manner provides another method for realizing the same screen in the application, which creates an actual browsing and operation execution environment for the same-screen communication content at the server, sends the operation event of each participating terminal aiming at the same-screen communication content to the server and actually executes the same in the server execution environment, and then sends the mirror image of the execution result to the terminal to display to obtain the same-screen effect, thereby being beneficial to solving the problem of execution confusion caused by dynamic execution content (for example, a network request is sent to the server, and a plurality of same requests cause operation logic errors) in the same-screen interaction.

In addition, it should be particularly noted that in the foregoing embodiments, the on-screen page data supports the server generation, the creator terminal local generation, and the like listed in the embodiments of the present application, the loading of the on-screen communication component also supports the server generation, the terminal local generation, and the like listed in the embodiments of the present application, and in addition, supports setting, based on the setting information, the on-screen communication sharing provided by other embodiments of the present application, and the like.

Based on the same inventive concept, referring to fig. 18, an instant messaging system including a function of sharing communication with one screen is further provided in an embodiment of the present invention, where the system includes an instant messaging application terminal 10 and a server 20, and the instant messaging application terminal 10 includes: the method comprises a creating module 101, a link generating and processing module 102 and an on-screen communication page 103, wherein the on-screen communication page 103 further comprises: a loading module 1031 and an on-screen data collecting and processing module 1032, wherein the server 20 includes: a creation request processing module 201, an access request processing module 202 and an on-screen communication service module 203, wherein:

the creating module 101 is configured to create a sharing creating request for on-screen communication and send the sharing creating request to the server;

the link generation and processing module 102 is configured to receive a notification of completion of on-screen communication and sharing creation returned by the server, or receive an on-screen communication and sharing link and/or on-screen communication and sharing description data sent by the creation request processing module 201, generate an access entry link, and display the access entry link on the instant messaging application terminal;

the link generation and processing module 102 is further configured to receive a same-screen communication sharing link and/or same-screen communication sharing description data sent by a server or other instant messaging application terminals, generate an access entry link, and display the access entry link at the instant messaging application terminal;

the link generation and processing module 102 is further configured to start the on-screen communication page after receiving a trigger event for the access entry link or receiving the on-screen communication sharing creation completion notification;

the loading module 1031 is configured to load page content based on the on-screen communication sharing link;

the on-screen data acquisition and processing module 1032 is configured to acquire one or more of operation instruction data, picture data, content data, and video data, generate on-screen data, and send the on-screen data to the on-screen communication service module 203;

the on-screen data acquisition and processing module 1032 is further configured to receive the on-screen data sent by the on-screen communication service module 203, and execute corresponding page synchronization processing on the on-screen communication page based on a data type included in the on-screen data;

the creation request processing module 201 is configured to receive the on-screen communication sharing creation request sent by the creation module 101, register an on-screen communication service based on the on-screen communication creation request, generate a corresponding on-screen communication sharing link and/or on-screen communication sharing description data, and send the on-screen communication sharing creation description data to a corresponding instant messaging application terminal, and further generate an on-screen communication sharing creation completion notification to send the on-screen communication sharing creation request to the instant messaging application terminal that sends the on-screen communication sharing creation request;

the access request processing module 202 is configured to receive the on-screen communication service connection request sent by the link generation and processing module 102, search for a corresponding on-screen communication service based on the on-screen communication service connection request, establish a communication connection between the on-screen communication service and the instant messaging application terminal, and start the on-screen communication service when it is determined that the on-screen communication service is not started;

the on-screen communication service module 203 is configured to receive the on-screen data sent by the on-screen data collection and processing module 1032 and send the on-screen data to the on-screen data collection and processing module 1032.

In one possible implementation, the instant messaging system further includes:

the link generation and processing module 102 is further configured to display the access entry link in a chat panel area of the instant messaging application terminal after the access entry link is generated;

the loading module 1031 is further configured to receive, based on a network request included in a link of the on-screen communication page, on-screen communication page data returned by the server, load and generate the on-screen communication page content, and establish communication between the instant messaging application terminal and the on-screen communication service of the server;

the loading module 1031 is further configured to load an on-screen communication component on the on-screen communication page, where the on-screen communication component includes one or more of a graffiti component, a video display component, an audio/video control component, a recording component, an on-screen state information display component, an on-screen authority control component, and an on-screen communication setting component;

the loading module 1031 is further configured to receive the on-screen communication page data sent by the server or the on-screen communication creator instant messaging application terminal, and load the local on-screen communication page based on the on-screen communication page data;

the on-screen data acquisition and processing module 1032 is further configured to receive the on-screen communication page data sent by the on-screen communication service module 203, load and generate the on-screen communication page content;

the creating module 101 is further configured to acquire setting data of the sharing target shared by on-screen communication, generate a sharing request based on the setting data, and send the sharing request to the creating request processing module 201;

the creation request processing module 201 is further configured to receive a sharing request sent by the creation module 101, analyze a sharing target and a corresponding on-screen communication sharing link included in the sharing request, and send the on-screen communication sharing link and/or the on-screen communication sharing description data to the sharing target instant messaging application terminal.

In one possible implementation, the on-screen page 103 of the instant messaging system further includes an audio/video module 1033, a graffiti module 1034, and a page content data generation module 1035, where:

the audio/video module 1033 is configured to perform audio and/or video communication between the instant messaging application terminal and a server or other instant messaging application terminals participating in on-screen communication;

the scrawling module 1034 is configured to collect scrawling data, send the scrawling data to the on-screen communication service module 203, receive the scrawling data sent by the on-screen communication service module 203, and execute scrawling drawing;

the page content data generating module 1035 in the on-screen page 103 is configured to locally obtain the on-screen data content shared by the on-screen communication based on the information shared by the on-screen communication, locally load the on-screen page content based on the on-screen data content shared by the on-screen communication to generate the on-screen page content, and collect or generate on-screen page data to be sent to the server or other participant terminals.

In a possible implementation manner, the server 20 of the instant messaging system further includes a recording module 204 and a page content data generating module 205, wherein:

the recording module 204 is configured to record one or more of on-screen page data, on-screen data received by the on-screen communication service module 203, on-screen data sent to the on-screen data acquisition and processing module 1032, sender information, receiver information, and occurrence time information, and to store and generate structured data for recording an on-screen communication process;

the page content data generating module 205 of the server 20 is configured to generate on-screen page data based on data and/or information included in the on-screen communication sharing creation request sent by the creating module 101;

the page content data generating module 205 of the server is further configured to create an on-screen communication component in the on-screen communication page, and add the on-screen communication component data to the on-screen communication page data generated by the server;

the access request processing module 202 is further configured to return the on-screen communication page data to the instant messaging application terminal after receiving a network request sent by the instant messaging application terminal to start the on-screen communication page;

the on-screen communication service module 203 is further configured to return the corresponding on-screen communication page data to the instant messaging application terminal after establishing connection with the instant messaging application terminal.

In a possible embodiment, the instant messaging application terminal 10 further includes a recording module 1036, where the recording module 1036 is configured to locally record one or more of on-screen page data, on-screen data sent and received, and occurrence time information, and to store and generate the on-screen page data in a structured manner as recorded data of an on-screen communication process.

The embodiment of the application also provides an instant messaging application terminal, which comprises a processor and a memory for storing the executable instructions of the processor; wherein the processor is configured to perform any one of the above methods of establishing sharing with using on-screen communication in an instant messaging application.

An embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program runs on a computer, the computer is enabled to execute the method for establishing and using on-screen communication sharing in an instant messaging application according to the foregoing embodiment.

In addition, an embodiment of the present application further provides a computer program product, where the computer program product includes a computer program, and when the computer program product runs on a computer, the computer executes the method for establishing and sharing on-screen communication in an instant messaging application according to the foregoing embodiment.

The present application is exemplified below with reference to an instant messaging software application example, for further understanding:

as shown in fig. 20, it is a chat panel of the instant messenger X, and the user a and the user B are in the process of chatting; the user a has a requirement for the communication discussion between the file 1 and the user B, at this time, the user a clicks the add button (see the "+" icon button in the dotted line) below, starts the type selection panel for sending data, and selects "share on screen" (see the dotted line frame mark) at this position as shown in fig. 21; entering a same-screen communication sharing content selection panel, as shown in fig. 22, selecting sharing content for same-screen communication on the page, at this time, selecting "file 1" by the user a, and sending a same-screen communication sharing creation request to the server based on the content selected by the user a; after the server processes the creation request, generating a co-screen communication sharing link, and displaying the co-screen communication sharing link in a chat panel by the user a terminal, as shown in fig. 23 (see a dashed box mark); meanwhile, because the on-screen communication sharing is initiated in a chat scene, the server sets and processes the sharing target as the current chat room ID, and therefore the user B receives the on-screen communication sharing link at the same time; the user A and the user B click the on-screen communication sharing link to enter an on-screen communication page, as shown in FIG. 24; after the two parties enter the same-screen sharing communication page, exemplary processing steps are as follows:

1) loading on-screen communication page data and on-screen communication components;

2) establishing on-screen communication data communication with a server side, or establishing on-screen communication data communication between two terminals;

3) starting an audio and video communication function based on the setting information during the same-screen communication sharing creation, wherein the audio and video communication function comprises the steps of collecting video data of a camera of a terminal at one side, sending the video data to a terminal at the other side, receiving the video data of the terminal at the other side, playing the video data at the terminal at the side, and collecting, sending and receiving audio and video data;

4) when user operation occurs at a terminal at one side, collecting and generating same-screen data and sending the same-screen data to a server or the terminal at the other side; and receiving the same-screen data sent by the server or the terminal on the other side, and executing corresponding page synchronization processing on the terminal on the side. In addition, the step is set according to the operation authority, and the method also comprises the situation that only one terminal is allowed to execute the operation, and the other terminal executes the synchronization;

5) starting a doodle module, collecting doodle data and sending the doodle data to a server or a terminal on the other side; and receiving the scrawling data sent by the server or the terminal on the other side, and executing corresponding synchronous scrawling processing on the terminal on the local side.

Summarizing the method provided in this example: receiving a second button click event triggered by a user and starting a sending content type selection panel in a chat page (including group chat) in the instant messaging application program; receiving a selection event of a user for a sending type, and starting a sharing content selection panel for creating the same-screen communication sharing when the selected type is determined to be the same-screen communication sharing type; receiving sharing content selected by a user, and generating a same-screen exchange sharing creation request to send based on the content selected by the user; receiving a notification that the creation of the on-screen communication sharing is completed to start an on-screen communication page (or starting the on-screen communication page after confirmation of a user), or receiving a click event of the on-screen communication sharing link from the user and starting the on-screen communication page, wherein the notification is displayed on the chat page; after entering the same-screen communication page, acquiring one or more of operation instruction data, picture data, content data and video data, generating same-screen data and sending the same-screen data to a server or other terminals; and receiving the same-screen data sent by a server or other terminals, and executing page synchronization processing on the same-screen communication page based on the data type contained in the same-screen data.

In addition, the above embodiment realizes the effect of sharing a document in a video conference, but compares the operation steps of creating a conference, entering the conference and executing sharing, and is obviously fast and efficient. Further, in combination with the above embodiments, the user a or the user B has a requirement to invite the user C to participate in the discussion, and the user C can invite the user C to join the on-screen discussion only by long pressing the sharing link to select the sharing target user in the instant messaging chat panel. Furthermore, after the on-screen communication is finished, recording data of the on-screen communication process is recorded and generated at a server (or a terminal), a user can enter a process record of checking the communication through the on-screen communication sharing link of the chat panel, the on-screen communication process is played back, and meanwhile, communication evidence is provided.

The above description is only a specific implementation of the embodiments of the present application, but the scope of the embodiments of the present application is not limited thereto, and any person skilled in the art can easily conceive of changes or substitutions within the technical scope of the embodiments of the present application, and all the changes or substitutions should be covered by the scope of the embodiments of the present application. Therefore, the protection scope of the embodiments of the present application shall be subject to the protection scope of the claims.

Claims

1. A method for establishing on-screen communication sharing in instant messaging application is applied to an instant messaging application terminal, and the on-screen communication sharing is used for realizing on-screen interactive communication with other visitors when being accessed by a user, and the method comprises the following steps:

acquiring data and/or information based on shared content needing to be established with on-screen communication and sharing, generating an on-screen communication and sharing establishing request based on the data and/or the information, and sending the on-screen communication and sharing establishing request to a server;

receiving a same-screen communication sharing link and/or same-screen communication sharing description data sent by the server, generating an access entry link based on the same-screen communication sharing link and/or the same-screen communication sharing description data, and displaying the access entry link at the instant messaging application terminal, or receiving a same-screen communication sharing creation completion notification returned by the server;

after a trigger event for the access entry link is received or a notification of completion of creation of the on-screen communication sharing is received, starting an on-screen communication page;

further comprising:

receiving a same-screen communication sharing link and/or same-screen communication sharing description data sent by a server or other instant messaging application terminals, generating an access entry link based on the same-screen communication sharing link and displaying the access entry link on the instant messaging application terminals;

and starting the same-screen communication page after receiving a trigger event for accessing the entrance link.

2. The method of claim 1, wherein displaying the access entry link at the instant messaging application terminal further comprises displaying the access entry link at a chat panel area of the instant messaging application terminal, wherein the access entry link is used for starting an on-screen communication page after receiving a user trigger event.

3. The method according to claim 1, wherein after the instant messaging application terminal starts the on-screen communication page, the method further comprises, based on a network request included in a link of the on-screen communication page, receiving on-screen communication page data returned by the server to load and generate the local on-screen communication page, and establishing communication between the instant messaging application terminal and an on-screen communication service corresponding to the server.

4. The method according to claim 1, wherein after the instant messaging application terminal starts the on-screen communication page, the method further comprises sending an on-screen communication service connection request to a server, establishing communication between the instant messaging application terminal and the on-screen communication service, receiving the on-screen communication page data sent by the on-screen communication service, loading and generating the on-screen communication page.

5. The method according to claim 1, wherein after the instant messaging application terminal starts the on-screen communication page, the method further comprises:

the on-screen communication page is locally loaded with on-screen communication components, and the on-screen communication components comprise one or more of a doodling component, a video display component, an audio and video control component, a recording component, an on-screen state information display component, an on-screen authority control component and an on-screen communication setting component.

6. The method according to claim 1, after establishing communication between the instant messaging application terminal and the on-screen communication service at the service end, further comprising:

acquiring one or more of operation instruction data, picture data, content data and video data on the on-screen communication page to generate on-screen data, and sending the on-screen data to the on-screen communication service; receiving the on-screen data sent by the on-screen communication service, and executing page synchronization processing on the on-screen communication page based on the data type contained in the on-screen data, wherein the page synchronization processing comprises one or more of executing the operation instruction contained in the on-screen communication page based on the operation instruction data to restore the operation behavior, replacing or drawing the picture based on the picture data, updating or replacing the page content data based on the content data, and playing the video data.

7. The method according to claim 1, wherein after the instant messaging application terminal starts the on-screen communication page, the method further comprises:

and establishing audio and/or video communication between the instant messaging application terminal and a server or other instant messaging application terminals participating in on-screen communication, and sending and receiving audio data and/or video data.

8. The method according to claim 1, wherein after the instant messaging application terminal where the creator of the on-screen communication sharing is located starts the on-screen communication page, the method further comprises:

and locally acquiring data related to the on-screen communication sharing at the instant messaging application terminal of the creator based on the information related to the on-screen communication sharing, generating on-screen communication page data based on the data related to the on-screen communication sharing, locally loading the on-screen communication page, and sending the on-screen communication page data to the server or other participant terminals.

9. The method according to claim 1, wherein after the instant messaging application terminal where the participant sharing the on-screen communication is located starts the on-screen communication page, the method further comprises:

and receiving the on-screen communication page data sent by the server or the on-screen communication creator instant messaging application terminal, and loading a local on-screen communication page based on the on-screen communication page data.

10. The method according to claim 1, wherein generating a request for creating the share of the same-screen communication at the instant messaging application terminal further comprises:

the method comprises the steps of obtaining setting data of a sharing target shared by on-screen communication, generating a sharing request based on the setting data, sending the sharing request to a server, processing the sharing request by the server, obtaining the sharing target shared by on-screen communication based on the setting data contained in the sharing request, and sending an on-screen communication sharing link and/or on-screen communication sharing description data to the sharing target.

11. A method for establishing same-screen communication sharing in instant messaging application is characterized in that the method is applied to a server side, and the method comprises the following steps:

12. The method of claim 11, further comprising:

receiving a sharing request sent by the instant messaging application terminal, analyzing a sharing target and a corresponding on-screen communication sharing link contained in the sharing request, and sending the on-screen communication sharing link and/or the on-screen communication sharing description data to the sharing target.

13. The method according to claim 11, further comprising, after receiving the on-screen communication sharing creation request sent by the instant messaging application terminal, the step of:

generating on-screen communication page data at the server side based on the data and/or information contained in the on-screen communication sharing creation request;

and after receiving a network request sent by the instant messaging application terminal for starting the on-screen communication page, returning the on-screen communication page data to the instant messaging application terminal, or after receiving an on-screen communication service connection request sent by the instant messaging application terminal, returning the corresponding on-screen communication page data to the instant messaging application terminal.

14. The method of claim 13, wherein generating the on-screen page data at the server further comprises:

the method comprises the steps of creating a same-screen communication component in a same-screen communication page, and adding the same-screen communication component data in the same-screen communication page data, wherein the same-screen communication component comprises one or more of a graffiti component, a video display component, an audio and video control component, a recording component, a same-screen state information display component, a same-screen authority control component and a same-screen communication setting component.

15. The method of claim 11, further comprising, after the on-screen communication service is started, recording one or more of on-screen communication page data, on-screen data received by the on-screen communication service, on-screen data sent to the instant messaging application terminal, sender information, receiver information, and occurrence time information to generate on-screen communication process recording data, wherein the on-screen communication process recording data is used for generating playback or video of an on-screen communication process.

16. An instant messaging system including on-screen communication sharing, the system comprising: instant messaging application terminal, server side, instant messaging application terminal includes: the method comprises a creating module, a link generating and processing module and a same-screen communication page, wherein the same-screen communication page further comprises the following steps: load module, with screen data acquisition and processing module, the server includes: the system comprises a creation request processing module, an access request processing module and a same-screen communication service module, wherein:

17. The system of claim 16, further comprising:

18. The system of claim 16, wherein the on-screen page further comprises an audio/video module, a graffiti module, and a page content data generation module, wherein:

19. The system of claim 16, wherein the server further comprises a recording module and a page content data generating module, wherein:

20. A computer program product comprising instructions which, when run on a computer, cause the computer to perform the method of any one of claims 1 to 10 or cause the computer to perform the method of any one of claims 11 to 15.