CN118200273A - Method and system for establishing same-screen communication sharing in instant communication application - Google Patents

Method and system for establishing same-screen communication sharing in instant communication application Download PDF

Info

Publication number
CN118200273A
CN118200273A CN202410304599.1A CN202410304599A CN118200273A CN 118200273 A CN118200273 A CN 118200273A CN 202410304599 A CN202410304599 A CN 202410304599A CN 118200273 A CN118200273 A CN 118200273A
Authority
CN
China
Prior art keywords
screen
screen communication
communication
data
sharing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202410304599.1A
Other languages
Chinese (zh)
Inventor
路九阳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN202410304599.1A priority Critical patent/CN118200273A/en
Publication of CN118200273A publication Critical patent/CN118200273A/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/07—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
    • H04L51/10—Multimedia information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1069—Session establishment or de-establishment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80—Responding to QoS
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The application provides a method for establishing on-screen communication sharing in instant communication application, which comprises the following steps: generating an on-screen communication sharing creation request based on the content to be shared and sending the request to the server, then receiving an on-screen communication sharing link returned by the server or a creation completion notification, and starting an on-screen communication page according to a triggering event of the link or a receiving event of the notification; receiving and displaying an on-screen communication sharing link at another instant messaging application terminal, and starting an on-screen communication page according to a triggering event of the link; and collecting and transmitting the same-screen data at the instant messaging application terminals participating in the same-screen communication, receiving the same-screen data transmitted by other terminals and executing page synchronization processing to realize the same-screen interactive communication among all participant terminals. Therefore, the application provides a new sharing and communication mode for instant messaging application, and the sharing is directly used for same-screen interaction communication, so that the method is simple and easy to use, and the communication efficiency and quality are improved.

Description

Method and system for establishing same-screen communication sharing in instant communication application
Technical Field
The invention relates to the technical field of internet communication, in particular to a method and a system for establishing on-screen communication sharing in instant messaging application.
Background
Instant messaging (or instant messaging) application software is widely used in work and life of people, such as existing WeChat, QQ, nail, enterprise WeChat, customer service tool and the like, and has the main functions of sending and receiving Internet messages in real time, so that the problems of information communication and communication of people are solved. In daily use, there is often a need to send one content to other users and then communicate about the content, and the prior art generally solves this problem by: the method includes the steps that content is selected in instant communication application and sent to other users, the other users access the content through a chat panel, then the two parties initiate voice and video calls to discuss the shared content, but the method cannot achieve synchronous browsing and operation of the shared content, and the communication effect is poor. Another way is: the sharer firstly creates the video conference, then shares the video conference entrance information to other users, and after entering the video conference, the sharer realizes the same-screen communication discussion with other participating users about the shared content through the functions of file sharing, desktop sharing and the like. Therefore, it is needed to provide a method and system for establishing on-screen communication sharing and quickly constructing on-screen communication for sharing content in instant messaging application, so as to solve the above problems.
Disclosure of Invention
Aiming at the problems, the invention provides a method and a system for establishing on-screen communication sharing and quickly constructing on-screen communication by sharing content in instant communication application, which aim to realize that a user of the instant communication application can quickly initiate on-screen communication based on the sharing content and improve communication efficiency and quality, and the technical scheme provided by the invention is as follows:
in a first aspect, the present application provides a method for establishing on-screen communication sharing in an instant messaging application, where the method is applied to an instant messaging application terminal, and the method includes:
Acquiring data and/or information based on shared content to be established for sharing with the screen, generating a request for creating the sharing with the screen based on the data and/or the information, and sending the request for creating the sharing with the screen to a server; receiving on-screen communication sharing links and/or on-screen communication sharing description data sent by the server, generating access entry links based on the on-screen communication sharing links and/or on-screen communication sharing description data, and displaying the access entry links on the instant messaging application terminal, or receiving on-screen communication sharing creation completion notification returned by the server; after receiving a triggering event for accessing the portal link or receiving the on-screen communication sharing creation completion notification, starting an on-screen communication page;
Further comprises: receiving on-screen communication sharing links and/or on-screen communication sharing description data sent by a server or other instant messaging application terminals, generating access entry links based on the on-screen communication sharing links and displaying the access entry links on the instant messaging application terminals; and after receiving a trigger event for accessing the portal link, starting the on-screen communication page.
The on-screen interaction sharing is used for realizing on-screen interaction communication with other visitors when the on-screen interaction sharing is accessed by a user; the data acquired based on the shared content includes, but is not limited to, file (including folder) data, picture data, text data, form data, web page data, video data, sound data, etc., and the information acquired based on the shared content includes, but is not limited to, web site information, file (including folder) information, web page information, picture information, sound information, video information, text information, shared information that has been generated or exists in the instant messaging application terminal, etc.
The method provides a method for rapidly creating the on-screen communication sharing based on the sharing content and starting the on-screen communication for the instant messaging application terminal user, and provides two starting modes: the sharing link is accessed through the on-screen communication, and the sharing link is accessed after receiving the on-screen communication sharing establishment completion notification, so that the efficiency of the sharing communication is improved.
In a possible implementation manner, the access entry link is displayed on the chat panel area of the instant messaging application terminal, and the access entry link is used for starting the on-screen communication page after receiving the user trigger event.
The embodiment is beneficial to the on-screen communication of sharing contents when the user rapidly enters in chat in instant communication software.
In a possible implementation manner, after the instant messaging application terminal starts the on-screen communication page, on the basis of a network request contained in a link of the on-screen communication page, on-screen communication page data returned by the server side are received to load and generate the local on-screen communication page, and communication between the instant messaging application terminal and on-screen communication service corresponding to the server side is established.
The above embodiment corresponds to a manner in which when the server processes the on-screen communication sharing creation request, the content of the on-screen communication page is generated and stored in the server, and the on-screen communication sharing link finally provided to the terminal can directly or indirectly access the content of the on-screen communication page, so that the on-screen communication page data is stored and provided by the server.
In a possible implementation manner, after the instant communication application terminal starts the on-screen communication page, a connection request of the on-screen communication service is sent to a server, communication between the instant communication application terminal and the on-screen communication service is established, the on-screen communication page data sent by the on-screen communication service is received, and the on-screen communication page is loaded and generated.
The above embodiment provides a method for loading on-screen communication page data through an on-screen communication service, wherein the on-screen communication service is used for providing data communication service for each terminal participating in on-screen communication.
In a possible implementation manner, after the instant messaging application terminal starts the on-screen communication page, an on-screen communication component is loaded locally on the on-screen communication page, where the on-screen communication component includes one or more of a doodling component, a video display component, an audio/video control component, a recording component, an on-screen status information display component, an on-screen permission control component, an on-screen communication setting component, and a participant information display component.
The above embodiment provides a way for the instant communication application terminal to load the on-screen communication component locally.
In a possible implementation manner, after establishing communication between the instant messaging application terminal and the on-screen communication service of the server, collecting one or more of operation instruction data, picture data, content data and video data on the on-screen communication page, generating on-screen data, and sending the on-screen data to the on-screen communication service; and receiving on-screen data sent by the on-screen communication service, and executing page synchronization processing on the on-screen communication page based on the data type contained in the on-screen data, wherein the page synchronization processing comprises one or more of executing operation instructions contained in the operation instruction data to restore operation behaviors, replacing or drawing pictures based on the picture data, updating or replacing page content data based on the content data and playing video data.
The embodiment realizes that the display content and operation of each terminal page participating in the same-screen communication are kept synchronous, and has the effect of the same-screen communication.
In a possible implementation manner, after the instant messaging application terminal starts the on-screen communication page, audio and/or video communication between the instant messaging application terminal and a server side or other instant messaging application terminals participating in on-screen communication is established, and audio data and/or video data are sent and received.
The embodiment adds audio and video communication in the same-screen communication, so that the face-to-face communication effect can be achieved, and the communication efficiency and the communication quality are further improved.
In a possible implementation manner, after the on-screen communication page is started by the instant messaging application terminal where the creator of the on-screen communication sharing is located, data related to the on-screen communication sharing is locally acquired at the instant messaging application terminal of the creator based on the information of the on-screen communication sharing, the on-screen communication page data is generated based on the data related to the on-screen communication sharing, the on-screen communication page is locally loaded, and the on-screen communication page data is sent to the server or other participant terminals.
The method for generating the on-screen communication page data at the creator terminal shared by the on-screen communication is beneficial to reducing the operation load of the server and protecting the user data and privacy.
In a possible implementation manner, after the on-screen communication page is started by the on-screen communication application terminal where the participants sharing the on-screen communication are located, the on-screen communication page data sent by the server or the on-screen communication creator instant communication application terminal is received, and a local on-screen communication page is loaded based on the on-screen communication page data.
The above embodiment provides a method for loading the on-screen communication page data by the on-screen communication shared receiver, which comprises two methods of receiving from a server or receiving from another terminal.
In a possible implementation manner, an on-screen communication sharing creation request is generated at the instant communication application terminal, setting data of a shared target user shared by the on-screen communication is obtained, a sharing request is generated based on the setting data and sent to the server, the sharing request is processed by the server, a sharing target is obtained based on the contained setting data, and the on-screen communication sharing link and/or the on-screen communication sharing description data are sent to the sharing target.
The above embodiments provide a method for setting a sharing target and a range for the on-screen communication sharing, so as to send the on-screen communication sharing to a corresponding receiver.
In a second aspect, the present application further provides a method for establishing on-screen communication sharing in an instant messaging application, where the method is applied to a server, and the method includes:
receiving an on-screen communication sharing creation request sent by an instant messaging application terminal, registering on-screen communication service based on the on-screen communication sharing creation request, generating a corresponding on-screen communication sharing link and/or on-screen communication sharing description data to send to the corresponding instant messaging application terminal, and generating an on-screen communication sharing creation completion notification to send to the instant messaging application terminal sending the on-screen communication sharing creation request;
Receiving a connection request of an on-screen communication service sent by an instant communication application terminal, searching for a corresponding on-screen communication service based on the connection request, and establishing communication connection between the instant communication application terminal and the corresponding on-screen communication service, wherein the method further comprises the step of starting the on-screen communication service when the on-screen communication service is not started;
And the on-screen communication service receives the on-screen data sent by the instant messaging application terminal and sends the on-screen data to other instant messaging application terminals connected with the on-screen communication service.
The above embodiments provide service support for creating and accessing on-screen communication sharing in an instant messaging application system, including registration processing, connection processing, and data communication services in the on-screen communication process.
In a possible implementation manner, a server receives a sharing request sent by the instant messaging application terminal, analyzes a sharing target and a corresponding on-screen communication sharing link included in the sharing request, and sends the on-screen communication sharing link and/or the on-screen communication sharing description data to the sharing target.
The embodiment realizes the processing of the sharing requirement shared by the instant messaging application terminal.
In a possible implementation manner, after receiving the on-screen communication sharing creation request sent by the instant communication application terminal, on-screen communication page data is generated at the server based on data and/or information contained in the on-screen communication sharing creation request. In addition, after receiving a network request sent by the instant communication application terminal for starting the on-screen communication page, the on-screen communication page data is returned to the instant communication application terminal, or after receiving an on-screen communication service connection request sent by the instant communication application terminal, the corresponding on-screen communication page data is returned to the instant communication application terminal.
The method for generating the on-screen communication page data at the server side generates and stores the content data of the on-screen communication page at the server side, and the data content of the on-screen communication page can be obtained through an on-screen communication sharing link provided to the terminal or an on-screen communication service connected with the terminal.
In a possible implementation manner, the on-screen communication page data is generated at the server, further, an on-screen communication component is created in the on-screen communication page, and the on-screen communication component data is added in the on-screen communication page data, wherein the on-screen communication component comprises one or more of a doodling component, a video display component, an audio/video control component, a recording component, an on-screen status information display component, an on-screen authority control component and an on-screen communication setting component.
Through the content and the data of the on-screen communication page provided by the embodiment, the on-screen communication component is built in or further comprises the client configuration information of related on-screen communication, so that the on-screen communication component can be directly loaded from the server when the on-screen communication page is started by the instant communication application terminal.
In one possible implementation manner, after the on-screen communication service is started, one or more of on-screen communication page data, on-screen data received by the on-screen communication service, on-screen data sent to the instant messaging application terminal, sender information, receiver information and occurrence time information are recorded to generate on-screen communication process recording data.
The on-screen communication process record data generated in the above embodiment can be used to generate playback or video of the on-screen communication process.
In a third aspect, the present application also provides an instant messaging system including an on-screen communication sharing function, the system including: the instant messaging application terminal comprises an instant messaging application terminal and a server side, wherein the instant messaging application terminal comprises: the system comprises a creation module, a link generation and processing module and a same-screen communication page, wherein the same-screen communication page further comprises: the loading module and the on-screen data acquisition and processing module, and the server comprises: the method comprises the steps of creating a request processing module, accessing the request processing module and an on-screen communication service module, wherein:
The creation module is used for creating an on-screen communication sharing creation request and sending the request to the server;
the link generation and processing module is used for receiving an on-screen communication sharing creation completion notification returned by the server side, or receiving an on-screen communication sharing link and/or on-screen communication sharing description data sent by the creation request processing module, generating an access entry link and displaying the access entry link on the instant messaging application terminal;
The link generation and processing module is also used for receiving the on-screen communication sharing links and/or the on-screen communication sharing description data sent by the server or other instant communication application terminals to generate access entry links and displaying the access entry links on the instant communication application terminals;
The link generation and processing module is further used for starting the on-screen communication page after receiving a triggering event of the access portal link or receiving the on-screen communication sharing creation completion notification;
the loading module is used for loading page contents based on the same-screen communication sharing link;
The on-screen data acquisition and processing module is used for acquiring one or more of operation instruction data, picture data, content data and video data, generating on-screen data and sending the on-screen data to the on-screen communication service module;
the on-screen data acquisition and processing module is also used for receiving the on-screen data sent by the on-screen communication service module and executing corresponding page synchronization processing on the on-screen communication page based on the data type contained in the on-screen data;
The creation request processing module is used for receiving the on-screen communication sharing creation request sent by the creation module, registering on-screen communication service based on the on-screen communication sharing creation request, generating a corresponding on-screen communication sharing link and/or sending on-screen communication sharing description data to a corresponding instant messaging application terminal, and generating an on-screen communication sharing creation completion notification to send the on-screen communication sharing creation request to the instant messaging application terminal;
the access request processing module is used for receiving the connection request of the on-screen communication service sent by the link generation and processing module, searching the corresponding on-screen communication service based on the connection request, establishing communication connection between the on-screen communication service and the instant communication application terminal, and starting the on-screen communication service when the on-screen communication service is not started;
the on-screen communication service module is used for receiving the on-screen data sent by the on-screen data acquisition and processing module and sending the on-screen data to the on-screen data acquisition and processing module.
In one possible implementation manner, the instant communication system further comprises:
the link generation and processing module is further configured to display the access portal link in a chat panel area of the instant messaging application terminal after the access portal link is generated;
The loading module is further configured to receive on-screen communication page data returned by the server, load and generate on-screen communication page content, and establish communication between the instant messaging application terminal and the on-screen communication service of the server based on a network request included in the link of the on-screen communication page;
The loading module is further configured to load a co-screen communication component on the co-screen communication page, where the co-screen communication component includes one or more of a doodling component, a video display component, an audio/video control component, a recording component, a co-screen status information display component, a co-screen authority control component, and a co-screen communication setting component;
The loading module is further configured to receive the on-screen communication page data sent by the server or the on-screen communication creator instant messaging application terminal, and load a local on-screen communication page based on the on-screen communication page data;
the on-screen data acquisition and processing module is also used for receiving the on-screen communication page data sent by the on-screen communication service module, and loading and generating the on-screen communication page content instead of the loading module;
the creation module is further configured to obtain setting data of a sharing target for sharing the same-screen communication, generate a sharing request based on the setting data, and send the sharing request to the creation request processing module;
The creation request processing module is further configured to receive the sharing request sent by the creation module, analyze a sharing target and a corresponding on-screen communication sharing link included in the sharing request, and send the on-screen communication sharing link and/or the on-screen communication sharing description data to the sharing target.
In a possible implementation manner, the on-screen communication page of the instant communication system further comprises an audio-video module, a graffiti module and a page content data generation module, wherein:
the audio and video module is used for executing audio and/or video communication between the instant messaging application terminal and a server or other instant messaging application terminals participating in on-screen communication;
the doodling module is used for collecting doodling data and sending the doodling data to the same-screen communication service module, and also used for receiving the doodling data sent by the same-screen communication service module and executing doodling drawing;
The page content data generating module in the on-screen communication page is configured to locally acquire the data content shared by the on-screen communication based on the information shared by the on-screen communication, generate on-screen communication page content based on the data content shared by the on-screen communication, and acquire or generate on-screen communication page data to send to the server or other participant terminals.
In a possible implementation manner, the server side of the instant messaging system further includes a recording module and a page content data generating module, where:
the recording module is used for recording one or more of the on-screen communication page data, the on-screen data received by the on-screen communication service module, the on-screen data sent to the on-screen data acquisition and processing module, sender information, receiver information and occurrence time information, and is used for structurally storing and generating on-screen communication process recording data;
The page content data generation module of the server is used for generating on-screen communication page data on the server based on the data and/or information contained in the on-screen communication sharing creation request sent by the creation module;
The page content data generating module of the server is further configured to create a same-screen communication component in the same-screen communication page, and add the same-screen communication component data to the same-screen communication page data generated by the server;
The access request processing module is further used for returning the on-screen communication page data to the instant communication application terminal after receiving a network request sent by the instant communication application terminal for starting the on-screen communication page;
The on-screen communication service module is further configured to return corresponding on-screen communication page data to the instant messaging application terminal after establishing connection with the instant messaging application terminal.
In a fourth aspect, the present application also provides a computer program product comprising instructions which, when run on a computer, cause the computer to perform any of the above first and second aspects to establish and use a on-screen communication sharing method in an instant messaging application.
The invention has at least the following beneficial effects:
The application provides a method for establishing on-screen communication sharing in an instant messaging application, which enables a user to establish sharing based on content to be shared in the instant messaging application terminal and quickly enter on-screen communication based on the sharing, and compared with file sharing and the like in the existing instant messaging application, the method can realize on-screen communication without adding any additional operation steps, and can obtain excellent communication effect. Therefore, the application adds a novel sharing method for instant messaging application, and has high efficiency and good experience.
Drawings
Fig. 1 is a schematic flow chart of creating and starting on-screen communication sharing by an instant communication application creator terminal according to an embodiment of the present application;
Fig. 2 is a schematic flow chart of receiving and starting on-screen communication sharing by an instant communication application receiver terminal according to an embodiment of the present application;
FIG. 3 is a flow chart of loading page data from a server through a network request according to an embodiment of the present application;
FIG. 4 is a schematic flow chart of loading page data by connecting with an on-screen communication service according to an embodiment of the present application;
FIG. 5 is a schematic flow chart of a method for locally loading on-screen communication components according to an embodiment of the present application;
FIG. 6 is a schematic flow chart of related on-screen data processing according to an embodiment of the present application;
Fig. 7 is a schematic flow chart of an audio/video communication process according to an embodiment of the present application;
FIG. 8 is a schematic flow chart of generating and processing page data at a creator terminal according to an embodiment of the present application;
fig. 9 is a schematic flow chart of loading page data at a participant terminal according to an embodiment of the present application;
fig. 10 is a schematic flow chart of generating a sharing request by an instant messaging application terminal according to an embodiment of the present application;
FIG. 11 is a schematic flow chart of processing an on-screen communication sharing creation request at a server according to an embodiment of the present application;
FIG. 12 is a schematic diagram of a connection and service providing process of an on-screen communication service according to an embodiment of the present application;
fig. 13 is a schematic flow chart of a service side processing a sharing request according to an embodiment of the present application;
FIG. 14 is a schematic flow chart of generating page data and providing services at a server according to an embodiment of the present application;
FIG. 15 is a schematic flow chart of generating on-screen communication component data at a server according to an embodiment of the present application;
FIG. 16 is a schematic flow chart of a process of recording on-screen communications at a server according to an embodiment of the present application;
FIG. 17 is a schematic flow chart of establishing on-screen communication sharing in an instant messaging application according to an embodiment of the present application;
fig. 18 is a schematic diagram of an instant messaging system including an on-screen communication sharing function according to an embodiment of the present application;
fig. 19 is a schematic diagram of an instant messaging system including an on-screen communication sharing function according to an embodiment of the present application;
FIG. 20 is a schematic diagram of an interface for establishing on-screen communication sharing in an instant messaging application according to an embodiment of the present application;
FIG. 21 is a schematic diagram of an interface for establishing on-screen communication sharing in an instant messaging application according to an embodiment of the present application;
FIG. 22 is a schematic diagram of an interface for establishing on-screen communication sharing in an instant messaging application according to an embodiment of the present application;
FIG. 23 is a schematic diagram of an interface for establishing on-screen communication sharing in an instant messaging application according to an embodiment of the present application;
FIG. 24 is a schematic diagram of an interface for establishing on-screen communication sharing in an instant messaging application according to an embodiment of the present application;
Detailed Description
The description of the embodiments of the application is intended to be illustrative of the application and is not intended to be limiting.
The embodiment of the application can be applied to an instant messaging system, comprising an instant messaging application terminal, a server and other systems related to the instant messaging system.
The term "share" in the embodiments of the present application includes both the meaning of "send", i.e. a form of sending a certain content or data to a person. The on-screen interaction communication in the embodiment of the application comprises one or more of page display synchronization, page operation or operation effect synchronization, audio communication, video communication and synchronous graffiti.
Embodiments of the present application will now be described with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all embodiments of the present application. As one of ordinary skill in the art can know, with the development of technology and the appearance of new scenes, the technical scheme provided by the embodiment of the application is also applicable to similar technical problems.
Fig. 1 shows a possible flow chart of creating and starting on-screen communication sharing by an instant messaging application creator terminal, and step S101 obtains data and/or information based on the shared content to be shared by the on-screen communication, generates an on-screen communication sharing creation request based on the data and/or information, and sends the on-screen communication sharing creation request to a server. And returning processing results after the server side processes the creation request, wherein the processing results comprise, but are not limited to, sharing links with the screen, description data shared with the screen, processing completion notification information and the like. And step S102 is executed at the creator terminal, the on-screen communication sharing link and/or the on-screen communication sharing description data sent by the server are received, an access entry link is generated based on the on-screen communication sharing link and/or the on-screen communication sharing description data, and the access entry link is displayed at the instant messaging application terminal, or an on-screen communication sharing creation completion notification returned by the server is received. And S103, starting the on-screen communication page after receiving a trigger event for accessing the portal link or receiving the on-screen communication sharing creation completion notification.
In the above embodiment, S101 generates the on-screen communication sharing creation request, and provides two ways of obtaining data and information based on the content to be shared, for example, the content to be shared is a PDF document, the data is PDF file data, and the information includes information such as file name, file path, network file address, and the like.
Optionally, S101 generates an on-screen communication sharing creation request, where the request includes user identification or verification information such as a user ID, a Cookie, and the like; optionally, after the instant messaging application terminal establishes a communication connection with the server, the network request sent to the server automatically includes user identification information; optionally, in the embodiment of the present application, based on a communication connection established between the instant messaging application terminal and the server, the server identifies the user identity through the communication connection.
Optionally, the on-screen communication sharing creation request further includes setting information for the on-screen communication sharing, for example: the method includes the steps of establishing a construction mode (data or information) of sharing with the on-screen communication, generating a generation mode (server side generation or local generation) of page content data of the on-screen communication, loading page data in which mode (network link loading or loading through the on-screen communication service), whether data protection is carried out (such as disabling screen capture in the communication process), available effective time, whether recording is started, initial setting of a part of the on-screen communication (such as closing video by default), limiting setting of the on-screen communication (such as limiting access of a current chat user, re-sharing invalidity, limiting the number of people in a room, limiting the position and the like), controlling setting of the on-screen communication (such as having operation authority on only one side), whether video communication is started, access codes are accessed, watermarks are added and the like, including but not limited to the above setting information. Optionally, the default assignment process is performed based on default values contained in some or all of the setting information. Optionally, recording the user setting generated by the user on the setting of the on-screen communication sharing, and using the user setting assignment when generating the on-screen communication sharing creation request. Optionally, the setting information is stored in the server and the generated on-screen communication sharing is set.
In particular, in the present application, and/or describing the association relationship of the association object, three relationships may be represented. For example, A and/or B may mean that A alone, both A and B, and B alone are present. The character "/" generally indicates that the context-dependent object is an "or" relationship.
The on-screen communication sharing description data is used for being presented in the instant communication application terminal, such as a name and the like.
Optionally, the portal link further includes the on-screen communication sharing link, that is, the content of the on-screen communication sharing link is directly displayed in the portal link.
The on-screen communication page is used for displaying the content shared by the on-screen communication, the on-screen communication component and the like, the form of the content presentation comprises a webpage, a webview component, a picture, a form component, a pdf browsing control, a word control and the like, and the page form comprises an independent page, a popup window and the like.
In combination with the above embodiment, in a specific implementation scenario, in the instant messaging application terminal, in response to a user selection event of the on-screen communication shared content, the on-screen communication shared content (or information) selected by the user is received, and the on-screen communication shared creation request is generated and sent based on the content, optionally, in response to a user selection event of the shared content, the on-screen communication shared type of the shared content is created by receiving user-selected tag information (that is, the user selects to share a content and designates to create an on-screen communication shared type based on the content), the on-screen communication shared creation request is generated based on the shared content and the tag information, or a shared creation request is generated, and the shared creation request includes a creation type parameter, where the parameter is an on-screen communication shared type, or may be understood as sending a common creation request to the server, and the sent request includes type information of the shared request, where the type is an on-screen communication type, and the server identifies that the common creation request is the on-screen communication shared type of the shared type.
Fig. 2 is a schematic flow diagram of a possible on-screen communication sharing receiver terminal of an instant messaging application receiving and initiating on-screen communication sharing. Step S201 receives the on-screen communication sharing link and/or the on-screen communication sharing description data sent by the server or other instant messaging application terminals, generates an access entry link based on the on-screen communication sharing link and displays the access entry link on the instant messaging application terminals. Step S202 starts the on-screen communication page after receiving the trigger event of the access entry link. Optionally, the portal link further includes directly taking the form of the on-screen communication sharing link. Optionally, after receiving a trigger event for accessing the portal link or starting the on-screen communication page, a connection request is sent to the server, and optionally, the connection request carries user (such as user ID) parameter information. Optionally, the on-screen communication page comprises a form of independent page, popup window and the like. Optionally, in S201, a notification of completion of on-screen communication sharing sent by the server or other instant communication terminals is received, and after the user confirms the notification information, an on-screen communication page is started, where the notification of completion of on-screen communication sharing includes the on-screen communication sharing link and/or on-screen communication sharing description data information. Optionally, after accessing the portal link in step S202, an access authentication operation is performed, and authentication data is collected and sent to the server, for example, authentication of the identity of the visitor, authentication of access rights, and the like. Optionally, the receiver terminal receives and displays the verification result information returned by the server, for example, an access time limit is set by sharing with a screen, and the server returns related prompt information which is forbidden to enter, etc.
In combination with the embodiments shown in fig. 1 and fig. 2, the user can generate on-screen communication sharing in the instant messaging system based on the content to be shared in the instant messaging application terminal and send the same-screen communication sharing to the receiver, and the creator and the receiver can quickly enter on-screen communication based on the generated link or notification, and display the sharing content and the synchronous operation on the same screen. Therefore, the embodiment has the beneficial effects that under the condition that the operation steps of a user (such as the number of the operation steps is approximately the same as that of common file sharing) are not added, the efficient interaction communication with the same screen is realized, the operation is simple, and the communication efficiency and quality are improved.
In another specific implementation scenario, the steps S102 and S201 generate an access entry link based on the on-screen communication sharing link and/or on-screen communication sharing description data, and display the access entry link in a chat panel area of the instant messaging application terminal. Optionally, in the chat panel area of the instant messaging application terminal, the on-screen communication sharing link is directly displayed. The realization scene is suitable for chat scenes of instant messaging, such as chat of two users, group chat and the like, and has the characteristic of high efficiency. Optionally, displaying the on-screen communication sharing portal link on the instant messaging application terminal, and displaying the marking information or the related setting information capable of on-screen communication on the portal link.
In one possible implementation manner, as shown in fig. 3, after the instant communication application terminal starts the on-screen communication page, S301 requests data from the server based on the network request included in the link of the on-screen communication page, S303 receives the on-screen communication page data returned by the server to load and generate the local on-screen communication page, and establishes communication between the instant communication application terminal and the on-screen communication service corresponding to the server. The implementation method includes the steps that through a network request contained in a link of an on-screen communication page, on-screen communication page data are acquired from a server side, for example, a webpage A is generated at the server side for certain on-screen communication sharing, namely shared content provided by a user is contained in the webpage A, and a website of the webpage A is contained in the generated link of the on-screen communication page, so that after the on-screen communication page is opened by a terminal, the webpage A is accessed and loaded to acquire on-screen communication content data.
In another possible implementation manner, as shown in fig. 4, the instant communication application terminal starts an on-screen communication page in S401, sends an on-screen communication service connection request to a server, establishes communication with the on-screen communication service, receives the on-screen communication page data sent by the on-screen communication service in S403, and loads and generates the on-screen communication page. The step of S402 of this implementation manner establishes communication between the instant messaging application terminal and the on-screen communication service, where the on-screen communication service is used to provide a data communication service for the terminal in the on-screen communication process. It can be seen that, in this manner, after the loading of the on-screen communication page is completed, the on-screen communication page data content is not included, that is, the shared content is not included, and after the loading of the page is completed, the on-screen communication page data is acquired from the on-screen communication service through S403, and the page including the shared content is loaded and generated. The implementation mode is beneficial to the unified management and processing of the transmitted data by the on-screen communication service.
In a possible implementation manner, corresponding to the implementation manner of requesting on-screen communication page data by the instant messaging application terminal through the network request included in the link of the on-screen communication page shown in fig. 3 and the implementation manner of loading on-screen communication page data by the instant messaging application terminal through the on-screen communication service shown in fig. 4, in the implementation manner of the server side, as shown in fig. 14, S1401 receives the on-screen communication sharing creation request sent by the instant messaging application terminal, S1402 generates on the server side on-screen communication page data based on the data and/or information included in the on-screen communication sharing creation request, S1403 returns the on-screen communication page data to the instant messaging application terminal after receiving the network request sent by the on-screen communication page initiated by the instant messaging application terminal, or returns corresponding on-screen communication page data to the instant messaging application terminal after receiving the on-screen communication service connection request sent by the instant messaging application terminal. The implementation mode generates and stores the same-screen communication page and/or the same-screen communication page data at the server, which corresponds to the terminal implementation mode shown in fig. 3, for example, the server generates a web page file based on the shared content data sent by the creator terminal and stores the web page file at the server, for example, a web page a, and then generates a same-screen communication sharing link based on the web address of the web page a; corresponding to the terminal embodiment shown in fig. 4, if the on-screen communication page data is generated at the server based on the shared content data sent by the creator terminal and stored as a data record, and the relationship between the data record and the registered on-screen communication service is recorded, the data contained in the corresponding data record is returned after receiving the on-screen communication service connection request in S1403.
In one possible implementation, as shown in fig. 5, after the instant communication application terminal starts the on-screen communication page in S501, S502 is executed, and the on-screen communication component is loaded locally. The on-screen communication component comprises one or more of a doodling component, a video display component, an audio and video control component, a recording component, an on-screen state information display component, an on-screen authority control component and an on-screen communication setting component, and is used for assisting on-screen communication and realizing related function control in the on-screen communication process. Optionally, S502 is executed while the on-screen communication component is configured in an initialized manner, such as turning on a microphone by default, to connect to an audio communication service. Optionally, the on-screen communication component is loaded based on the existing configuration information and the setting information shared by the on-screen communication, such as a graffiti component, a video display component not loaded, a video control component not loaded, and the like. The implementation method has the advantages that the component loading speed is high, and data acquisition from a server side is not needed.
In another possible implementation, as shown in fig. 15, at the server, S1501 generates on-screen communication page data at the server, and S1502 is performed to create on-screen communication components in the on-screen communication page generated at the server, and the on-screen communication component data is added to the on-screen communication page data. Through the possible implementation manner, the on-screen communication component is generated at the server side so as to be loaded after the terminal downloads, or is loaded by receiving on-screen communication service data. Optionally, S1502 further includes generating an initialization configuration of the on-screen communication component, and generating and/or configuring the on-screen communication component based on the existing configuration information at the server, which is similar to the previous embodiment and will not be described herein. By the implementation mode, the loading configuration of the same-screen communication component is updated under the condition that the terminal program is not updated, and business logic adjustment is realized.
In a possible implementation manner, as shown in fig. 6, in the loading completion or loading process of the on-screen communication page and the on-screen communication component of the instant communication application terminal, step S601 is executed to establish communication with the on-screen communication service of the server, and then step S602 is executed to collect one or more of operation instruction data, picture data, content data and video data in the on-screen communication page, generate on-screen data, and send the on-screen data to the on-screen communication service; and receiving the same-screen data sent by the same-screen communication service, and executing page synchronization processing on the same-screen communication page based on the data type contained in the same-screen data.
The S601 establishes communication between the terminal and the service end on-screen communication service, where the on-screen communication service is similar to a service program of a conference room, and provides a data communication service for each terminal in the on-screen communication process, so as to send and receive on-screen data. Optionally, in a possible implementation scenario, the on-screen communication service is executed by the instant messaging application terminal, so as to implement direct communication between terminals participating in on-screen communication.
In the above embodiment, as a result of executing S602, it is achieved that the display and/or operation of the on-screen communication page of each terminal participating in the on-screen communication is kept synchronous, that is, an operation is executed in one of the terminals, and the caused change of the screen content of the on-screen communication page is synchronized to the other terminal, where the implementation manner includes, but is not limited to, one or more of the following manners:
Mode one: an event monitoring and acquiring operation event is started at an instant messaging application terminal with operation, the operation event at least comprises a user operation event, the monitored operation event is converted into an operation instruction, the operation instruction and data related to the operation event are acquired and generated into operation data, and the operation data are used as on-screen data to be sent to the on-screen communication service; and the other instant messaging application terminals participating in the same-screen communication receive the same-screen data, analyze the operation instruction contained in the same-screen data and the data related to the operation, and execute the corresponding operation instruction on the receiver terminal based on the data related to the operation to obtain the effect of synchronizing the receiver terminal with the terminal generating the operation. The following, for example, the form of the on-screen communication page is a web page, and the above procedure is illustrated: for example, after a click operation occurs on a terminal webpage at one side, the terminal webpage is converted into a click operation instruction after the event is monitored, meanwhile, a button where the click event occurs and a function triggered by the click event are recorded as data related to the click operation, and the click event of the corresponding button is called through Javascript to execute or the function triggered by the click event on a receiving terminal webpage, so that a page operation effect consistent with a terminal where the operation occurs is obtained. For another example, after a page sliding operation occurs on a terminal webpage at one side, a page sliding operation instruction is correspondingly generated after a page sliding event is monitored, sliding distance data is recorded, and the page sliding operation instruction is executed through Javascript by taking the sliding displacement as a parameter in a receiving terminal webpage, so that the effect of page synchronous sliding is realized.
Mode two: starting an event monitoring page data content change at an instant messaging application terminal which operates, wherein the page data is used for the same-screen communication page to generate page display content based on the page data, collecting all page data or changed incremental part data to generate same-screen data after the page data content change is monitored, and transmitting the same-screen data to the same-screen communication service; and other instant messaging application terminals participating in the same-screen communication receive the same-screen data, perform page data updating or replacing processing on the receiver terminal based on the content and the property of the page data contained in the same-screen data, and finally generate the page data content consistent with the occurrence operation terminal, thereby obtaining the same page display effect. Also, taking the form of the on-screen communication page as a web page as an example, the above process is described: for example, in a webpage of a terminal at one side, a function such as MutationObserver for monitoring webpage content change is started to execute monitoring, after the user operation at the side causes the webpage data content to change, webpage data such as DOM data, serialized DOM data and the like of a changed part are collected and sent as same-screen data, a receiver terminal receives the webpage data and executes an updating or replacing operation on the local webpage data, so that the updating of the final display content of the webpage is realized, and the display effect consistent with that of the terminal webpage with the webpage content change at first is maintained.
Mode three: starting event monitoring at an instant messaging application terminal with operation, generating picture data and/or drawing instructions based on page display contents or changed page display contents after the event is monitored, and sending the picture data and/or drawing instructions as same-screen data; and receiving the same-screen data at the receiver terminal, analyzing the picture data and/or drawing instructions contained in the same-screen data, and displaying or drawing pictures and replacing pictures on the local terminal page based on the same-screen data, so that the display content of the receiver terminal is consistent with the page display of the sending terminal.
Mode four: recording screen data at one side of the instant messaging application terminal, acquiring pictures or video data and generating same-screen data for transmission; and receiving and displaying the picture or video data at other terminals participating in the on-screen communication, thereby obtaining the on-screen display effect. Optionally, collecting user operation events at a terminal for receiving and displaying the picture or video data, and generating same-screen data to send based on the operation events; and receiving the same-screen data and analyzing the operation event contained in the same-screen data at the terminal on one side of the recorded screen data, and executing the operation contained in the operation event at the terminal. Optionally, after receiving the instruction of the on-screen communication creator terminal to exit the on-screen communication, stopping recording the screen data. The method realizes that the terminal A records screen data, the terminal B, C participating in the same-screen communication keeps consistent with the display of the terminal A by acquiring display content, the terminal A is an execution environment of a same-screen communication page, B, C only displays a result in a form of an image or a video, and when a user slides a picture in the B for achieving the interaction purpose, a sliding event, data (such as sliding displacement and position) related to the event and the like are acquired to generate same-screen data for transmission, and when the terminal A receives the same-screen data, sliding operation is actually executed in the terminal A, and a B, C picture and the terminal A keep a synchronous state, so that the sliding effect is finally displayed in the B.
The above implementation manners all realize the effects of the same-screen communication page and the same-screen synchronization between the terminals participating in the same-screen communication, and it should be specifically noted that the method for realizing the same-screen communication page and the same-screen synchronization is not limited to the above manner, and the above is only a part of implementation manner examples, and the application should not be limited by the above examples.
In one possible implementation, as shown in fig. 7, the instant messaging application terminal starts a on-screen communication page in S701, establishes audio and/or video communication between the instant messaging application terminal and a server or other instant messaging application terminals participating in the on-screen communication in S702, and sends and receives audio data and/or video data in S703. Optionally, the instant messaging application terminal sends and receives the audio and video data by establishing a connection with a server providing the audio and video service. Preferably, webRTC (Web Real Time Communication, network real-time communication) is used to directly communicate video and audio between terminals participating in the communication. Optionally, the steps S702 and S703 are executed at the instant messaging application terminal. Optionally, the steps S702 and S703 are executed in the on-screen communication page program.
Through the implementation mode, the audio and video communication among the terminals participating in the communication with the screen is established, the audio and video communication is carried out while the communication with the screen interaction is carried out, the communication efficiency and the user experience are further improved, and finally the face-to-face communication effect is obtained.
In one possible implementation manner, after the instant communication application terminal starts the on-screen communication page, receiving a start instruction of the doodling component, intercepting user operation, collecting doodling operation data to generate on-screen data, and sending the on-screen data to a server or other participant terminals; and receiving the same-screen data sent by the server or other participant terminals, analyzing the contained graffiti operation data, and executing synchronous graffiti drawing on the local terminal. The implementation mode realizes the graffiti synchronization between the alternating-current terminals.
In a possible implementation manner, as shown in fig. 8, the on-screen communication page is started at the instant messaging application terminal where the on-screen communication sharing creator is located, S801 the on-screen communication page is started at the instant messaging application terminal where the creator is located, S802 data related to the on-screen communication sharing is locally acquired at the instant messaging application terminal of the creator based on the information of the on-screen communication sharing, the on-screen communication page data is generated based on the data related to the on-screen communication sharing, the on-screen communication page is locally loaded, and S803 the on-screen communication page data is sent to the server or other participant terminals.
The above implementation provides a method for generating on-screen communication page data at a creator terminal, illustrating: the creator creates the on-screen communication sharing based on the local file a.pdf, but the file data is larger, and the creator initially aims at carrying out communication discussion on a part of content in the file data, so that when the on-screen communication sharing creation request is generated, the creator creates the on-screen communication sharing by adopting information for providing a.pdf (such as file name and local storage path of the file), namely, does not provide actual file data. When the server side processes the creation request, the same-screen communication page data (or a.pdf content data) is not generated and stored in the server side corresponding to the generated same-screen communication sharing, and only information such as file names, local storage paths of files and the like is stored. After the on-screen communication sharing creation is completed, executing step S801 to enter an on-screen communication page at the creator terminal, locally acquiring content data of a.pdf according to the file name and the local storage path information of the file contained in the on-screen communication sharing description information, displaying the content data in the on-screen communication page of the creator terminal, and executing step S803 to send page data corresponding to the page display. By the implementation mode, the transmission quantity of the network is reduced in the creation process, meanwhile, storage resources of a server are saved, and in addition, the creator only sends the content data of the display part of the a.pdf to a receiver, so that the protection of the whole data content is facilitated.
In a possible implementation manner, corresponding to the above generation of on-screen communication page data at the server side in fig. 14 and the generation of on-screen communication page data at the creator terminal in fig. 8, the flow of loading the on-screen communication page data by the receiver terminal is shown in fig. 9, the on-screen communication application terminal where the participant is located starts the on-screen communication page in S901, and the on-screen communication page data sent by the server side or the creator instant communication application terminal is received in S902, and the local on-screen communication page is loaded based on the on-screen communication page data. In the above implementation, the manner of receiving data in S902 includes, but is not limited to, a manner of requesting to obtain data based on a network request included in the link of the on-screen communication page, obtaining data through the on-screen communication service, and the like.
In another possible implementation manner, as shown in fig. 10, the following steps are performed at the instant messaging application terminal where the on-screen communication sharing creator is located: s1001, setting data of the shared target user shared by the same-screen communication is obtained, and S1002 generates a sharing request based on the setting data and sends the sharing request to the server. The implementation mode establishes the sharing of the same screen communication and simultaneously sets a sharing target user. Optionally, S1002 generates a separate sharing request and sends the single sharing request to the server. Optionally, the content of the sharing request generated in S1002 is merged and sent in the on-screen communication sharing creation request, that is, the on-screen communication sharing creation request includes creation information and sharing target information at the same time. Optionally, in a specific application scenario, the instant messaging system obtains the shared target user information according to the scenario calculation, without generating and sending the sharing request, for example, in a chat scenario of a user a and a user B, a creates a co-screen communication sharing, and automatically sets the user B as a sharing target. It should be noted that, the sharing object of the present application may be understood as a user, a terminal, a module, a program, etc. that receives sharing, including but not limited to an instant messaging terminal user, an instant messaging terminal user set, a chat room, etc.
In a possible implementation manner, a process flow of processing the on-screen communication sharing request at the server is shown in fig. 11, S1101 receives an on-screen communication sharing creation request sent by an instant messaging application terminal, S1102 registers on-screen communication service based on the on-screen communication creation request, and then S1103 generates a corresponding on-screen communication sharing link and/or sends on-screen communication sharing description data to a corresponding instant messaging application terminal, or S1104 generates an on-screen communication sharing creation completion notification and sends the on-screen communication sharing creation request to the instant messaging application terminal.
Optionally, S1102 registers for the on-screen communication service, including, but not limited to, one or more of creating an on-screen communication service record, assigning an on-screen communication service program, and initiating an on-screen communication service program, which may be understood as registering for a conference room, optionally providing room services immediately or upon receipt of a connection. Optionally, S1102 further includes registering configuration information of the on-screen communication service, such as a maximum connection number. Optionally, S1102 further includes recording associated information of the on-screen communication service, such as data or information shared by on-screen communication, creator, sharing target (receiver or chat ID, etc.), etc. Above, registering the on-screen communication service facilitates managing on-screen communication sharing created by the user. Optionally, after step S1101, the method further includes processing, at the server, the received data for creating the on-screen communication sharing, for example, converting the received data into a web format, adding a watermark, and the like, to generate on-screen communication page data.
In the above step, S1103 generates an on-screen communication sharing link and/or on-screen communication sharing description data, which are used for being received by the creator or receiver of the on-screen communication sharing, and generates entry information at the terminal; the on-screen communication sharing creation completion notification generated in S1104 is used for the creator terminal to receive, for example, the creator terminal directly enters the on-screen communication page after receiving the notification, which is convenient and efficient. Optionally, after the server fails to create the on-screen communication sharing request, the method further includes returning the on-screen communication sharing creation failure notification to the creator terminal, and the creator terminal displays notification content after receiving the notification.
In one possible scenario, the method may skip step S1102, that is, the on-screen communication service is not registered, and the corresponding on-screen communication service is allocated to provide the communication service after the on-screen communication sharing is created.
In a possible implementation manner, a process flow of the server side to process the on-screen communication sharing connection request is shown in fig. 12, and S1201 receives an on-screen communication service connection request sent by an instant communication application terminal; s1202, searching corresponding on-screen communication service based on the on-screen communication service connection request, and establishing communication connection between the instant communication application terminal and the corresponding on-screen communication service; and S1203, the on-screen communication service receives the on-screen data sent by the instant communication application terminal and sends the on-screen data to other instant communication application terminals connected with the on-screen communication service. In the above implementation manner, S1202 searches for and connects to a corresponding on-screen communication service, and optionally, when it is confirmed that the on-screen communication service is not started, the on-screen communication service is started. Optionally, S1202 detects a connection request, such as: and judging whether to allow connection or not based on the sharing target shared by the same-screen communication and/or the configuration information of the same-screen communication service, and returning prompt information when the connection is not allowed, thereby being beneficial to preventing the situation that counterfeit links enter the same-screen communication and the like. Optionally, the on-screen communication service in S1203 further includes processing the received on-screen data, generating new on-screen data, and sending the new on-screen data to other receiving terminals, where the processing includes, but is not limited to, sensitive word detection, data filtering, and so on. Above, S1202 may be understood as a process of entering a conference room, and S1203 step is similar to the process of providing a conference room service.
In a possible implementation manner, a processing flow of the server side to process the sharing request sent by the instant messaging terminal is shown in fig. 13, and S1301 receives the sharing request sent by the instant messaging application client side; s1302, analyzing a sharing target contained in the sharing request and a corresponding on-screen communication sharing link; s1303, sending the on-screen communication sharing link and/or the on-screen communication sharing description data to the sharing target. Optionally, the sharing request is processed based on the setting information of the on-screen communication sharing, for example, the effective time of the on-screen communication sharing is set in the setting information, and when the instant communication terminal generates the sharing request or the server processes the sharing request, the validity judgment is executed, and corresponding prompt information is returned and displayed. Optionally, the sharing request is processed while the on-screen communication sharing creation request is processed.
In one possible implementation, as shown in fig. 16, S1601 starts an on-screen communication service at the server; s1602 records one or more of on-screen communication service ID (room ID), on-screen communication page data, on-screen data received by the on-screen communication service, on-screen data sent to the instant messaging application terminal, sender information, receiver information, and occurrence time information at a server side to generate on-screen communication process recording data. Optionally, recording audio data and/or video data sent by the instant messaging application terminal, and generating recording data in the on-screen communication process. Optionally, the graffiti data sent by the instant messaging application terminal is received, recorded and generated, and the recorded data is recorded in the same-screen communication process. Preferably, the data received and transmitted in one same-screen interaction process and the corresponding occurrence time information are stored in a structured manner to generate the recording data of the same-screen interaction process. Optionally, after each change of the on-screen communication process recording data, a message digest algorithm is adopted to generate a message digest for the on-screen communication process recording data, wherein the message digest is used for storing and verifying the on-screen communication process, optionally, the message digest is displayed on the on-screen communication page, and optionally, after the on-screen communication process is finished, the generated message digest is displayed on a terminal or submitted to a blockchain for storage.
The realization mode realizes the recording, storage and evidence storage of the same-screen communication process aiming at the same-screen sharing communication, and in addition, the recorded data of the same-screen communication process can be used for generating playback of the same-screen communication process or generating playback video.
In a possible implementation manner, the method provided by the embodiment shown in fig. 16 is executed at the instant messaging application terminal, and recording data of the on-screen communication process is recorded and generated at the instant messaging application terminal.
For easy understanding, the following description will be given by way of an example of a comprehensive implementation procedure, as shown in fig. 17, including an instant messaging application terminal 10A (creator terminal), a server 20, and an instant messaging application terminal 10B (recipient terminal), the schematic flow is as follows:
at the instant messaging application terminal 10A:
s1701, generating an on-screen communication sharing creation request. The step selects content for creating the on-screen communication sharing, and optionally, the creation request comprises creator user ID information, a creation mode (through information or data creation), setting information of the on-screen communication sharing and the like;
S1702, a sharing request is generated. This step sets the goal of sharing, including but not limited to: recipient user ID, chat ID, group chat room ID, etc.;
S1703, a creating and sharing request is sent. The method comprises the steps of independently sending a creation request and a sharing request, combining the two requests into a network request to send, and the like, and optionally, after the creation step is finished, selecting the on-screen communication sharing link on a chat panel, setting a sharing target and generating a new sharing request to send;
At the server 20:
s1704, receiving a creation and sharing request;
S1705, generating on-screen communication page data. The method adopts a mode of generating and storing the same-screen communication page data at a server side so as to enable a participant terminal to download the data after entering the same-screen communication;
S1706, creating an on-screen communication component, and adding the on-screen communication component data into the on-screen communication page data. In the embodiment, a mode of generating the same-screen communication component on the same-screen communication page of the server is adopted, and in the mode, the terminal loads the same-screen communication page, namely the same-screen communication component is contained. Optionally, when the on-screen communication component is generated, default setting is performed on the on-screen communication component, or default configuration parameters are provided;
S1707, registering the on-screen communication service, and generating a corresponding on-screen communication sharing link and/or on-screen communication sharing description data. The execution order of this step is not particularly limited, and may be performed after S1704, for example. This step may be understood as registering the conference room. Optionally, the on-screen communication service is started in the step;
S1708, generating an on-screen communication sharing creation completion notification. In this embodiment, a manner of sending a notification to a creator terminal after a server side processes a creation request is completed is adopted, so that the creator terminal can directly enter on-screen communication after receiving the notification, and optionally, an on-screen communication sharing link and description information are generated and sent to the creator terminal;
s1709, sending an on-screen communication sharing creation completion notification;
at the instant messaging application terminal 10A:
s1711, receiving a notification of completion of the sharing creation in the same screen;
s1712, starting a same-screen communication page;
At the server 20:
S1710, processing a sharing request;
s1713, sending the same-screen communication sharing link and the description information;
At the instant messaging application terminal 10B:
s1717, generating and displaying an access entry link;
S1718, receiving a trigger event for accessing the portal link, and starting the on-screen communication page;
at the instant messaging application terminal 10A:
S1714, sending a network request for linking the on-screen communication page. The step accepts S1712, after the on-screen communication page is started, the on-screen communication page data is requested to be loaded to a server through a website included in the page;
At the server 20:
s1715, returning the same-screen communication page data;
at the instant messaging application terminal 10A:
S1716, loading the same-screen communication page data. The on-screen communication page loaded in the step already contains relevant components for on-screen communication (refer to the server processing in step S1706);
s1721, sending an on-screen communication service connection request. The step aims at establishing data communication related to the screen;
At the server 20:
S1722, starting the on-screen communication service and establishing connection. The step adopts a mode of starting the on-screen communication service when receiving a connection request, and establishes connection between the on-screen communication service and the terminal 10A;
At the instant messaging application terminal 10B:
S1719, sending a request for linking the network of the on-screen communication page (similar to the processing of S1714);
At the server 20:
s1720, returning the same-screen alternating-current page data;
At the instant messaging application terminal 10B:
s1723, loading on-screen communication page data (similar to S1716 processing);
S1724, sending an on-screen communication service connection request;
At the server 20:
S1725, establishing the on-screen communication service connection. I.e. establishing a connection of the on-screen communication service with the terminal 10B;
The following starts the on-screen interaction, e.g., user operation occurs in the 10B terminal, synchronizing to the 10A terminal, example steps are as follows:
At the instant messaging application terminal 10B:
S1726, collecting and generating same-screen data;
S1727, transmitting the same screen data;
At the server 20:
S1728, processing the same screen data;
s1729, transmitting the same screen data;
at the instant messaging application terminal 10A:
s1730, receiving the same screen data and executing page synchronization processing. Through this step, the same screen and synchronous operation effect with the instant communication application terminal 10B is obtained.
It should be noted that this embodiment only represents an embodiment of the present application, some steps or modules thereof may be combined, replaced, and omitted for implementation, and the execution sequence of the steps is not fixed, which is merely used to illustrate the implementation principle of the present application, and should not limit the present application.
In a possible implementation manner, the instant messaging application terminal of the present application also includes the function of the server, so as to implement the method for establishing on-screen communication sharing in the instant messaging application provided by other embodiments of the present application. For example, the on-screen communication sharing creation request processing is executed in an instant communication application terminal, and on-screen communication sharing services are registered and provided.
In one possible implementation, a user creates an on-screen communication share in a scene of an audio-video communication, and directly enters the on-screen communication based on the created on-screen communication share. In the implementation mode, the audio and video communication page comprises a first button for creating the on-screen communication sharing, a trigger event of a creator on the first button is received, a sharing content selection picture is opened, the sharing content selected by the creator is received, data and/or information are acquired based on the selected sharing content, an on-screen communication sharing creation request is generated based on the data and/or information, and the on-screen communication sharing creation request is sent to a server. In addition, the implementation mode sets a sharing target based on a user (excluding a creator) participating in audio and video communication, further generates a sharing request and sends the sharing request to a server, and optionally, the same-screen communication sharing creation request contains information contained in the sharing request, namely, the sharing request is combined into a request and sent to the server. In this way, the server processes the on-screen communication sharing creation request, and may adopt a manner of generating an on-screen communication sharing link or not generating an on-screen communication sharing link, register the on-screen communication service and directly start the on-screen communication service under the condition that the on-screen communication sharing link is not generated, so as to provide communication service for terminals participating in the on-screen communication. Under the implementation mode, each terminal participating in audio and video communication receives an on-screen communication sharing link or an on-screen communication sharing creation completion notification sent by a server, and directly starts an on-screen communication page, or loads on-screen communication page contents and components on the current audio and video communication page.
In one possible implementation, a user creates an on-screen communication share based on the shared content, such as clicking to view a shared content, selecting to create an on-screen communication share, or pressing a shared content long, selecting and creating an on-screen communication share. The shared content is, for example, shared content existing in a chat panel, shared content in a friend circle, and the like, and is mainly characterized in that the shared record is registered at a server side. In the implementation mode, an on-screen communication sharing creation request is generated at the creator terminal based on the identification information of the shared content, and the on-screen communication sharing creation request is sent to the server. The server side processes the on-screen communication sharing creation request, acquires data or information of the on-screen communication sharing content based on the identification information of the shared content, registers on-screen communication sharing service at the server side, generates on-screen communication sharing links and/or on-screen communication sharing description data, generates on-screen communication sharing completion notification, or generates marking information for creating on-screen communication sharing for a certain sharing record, and sends the marking information to the creator terminal. Optionally, in this implementation manner, a sharing target is set at the same time based on a certain shared content, a sharing request is generated based on the setting result and sent to a server, or the sharing request and the created on-screen communication sharing request are combined into a network request to be sent, after the on-screen communication sharing is generated by processing at the server, setting information based on the sharing request is sent to a corresponding instant messaging application terminal, and the sharing link is sent. Optionally, the creator terminal receives the mark information for creating the on-screen communication sharing for a certain sharing record, displays a mark on the shared content, namely, identifies that the shared content can be communicated on the same screen, and starts the on-screen communication page after receiving a trigger event of the sharing link with the mark information. Optionally, the creator terminal receives the on-screen communication sharing link and/or the on-screen communication sharing description data sent by the server, generates an access entry link based on the on-screen communication sharing link and/or the on-screen communication sharing description data, and displays the access entry link on the instant messaging application terminal, or receives an on-screen communication sharing creation completion notification returned by the server. And the creator terminal starts the on-screen communication page after receiving the trigger event of the access entry link or receiving the on-screen communication sharing creation completion notification. Receiving on a receiver terminal, on the basis of which an access entry link is generated and displayed on an instant messaging application terminal, on the basis of the same-screen communication sharing link and/or same-screen communication sharing description data sent by a server or other instant messaging application terminals; and after receiving a trigger event for accessing the portal link, starting the on-screen communication page.
In a possible implementation manner, device information data, such as a screen size, a page size and the like, are collected at the instant messaging application terminal, the device information data is included when the on-screen communication sharing creation request and the on-screen communication connection request are generated and sent, and the on-screen communication page data or the on-screen communication configuration data are generated at a server or a creator terminal based on the device information data. The embodiment is beneficial to ensuring the effect of the same screen, for example, the page display size and proportion compatible with each terminal device are obtained by calculating the display size of each terminal, so as to solve the problems of page display difference of the terminals, dislocation in the doodling process and the like.
In one possible embodiment, the present application provides a method for creating comment type sharing and performing sharing based on shared content. The method comprises the following steps: receiving, at the instant messaging application creator terminal, a user selection of shared content for establishing a comment type sharing; generating commentary page data at the local terminal or server based on the selected data and/or information of the shared content, and loading commentary components including, but not limited to, an audio acquisition component, a video acquisition component, a graffiti component, etc., generating commentary pages; based on the operation of the creator on the comment page, collecting one or more of operation instruction data, picture data, content data, audio data, video data and graffiti data and corresponding occurrence time information at the local terminal or the server, generating a comment data record, and further structurally storing the comment data record to generate comment data; generating a comment type sharing creation request based on one or more of the shared content, the comment data, the sharing target setting, the comment page data or information and the like, and sending the comment type sharing creation request to a server; the server receives the request, registers the comment type sharing creation request, generates a comment type sharing link and/or comment type sharing description data based on a sharing target contained in the request, and sends the comment type sharing link and/or the comment type sharing description data to the sharing target; receiving a comment type sharing link and/or comment type sharing description data sent by a server or other instant communication application terminals at the instant communication application creator terminal or the receiver terminal, generating an access entry link based on the comment type sharing link and/or comment type sharing description data, displaying the access entry link at the instant communication application terminal (or displaying the access entry link on a chat panel), and starting a comment playing page after receiving a trigger event for the access entry link; after playing is started, loading the comment page data, loading a playing control component (such as starting, playing, pausing, playing progress component, fast forwarding, rewinding and the like), obtaining and analyzing the comment data, and executing corresponding playing processing according to time information contained in the comment data record and time sequence, wherein the corresponding playing processing comprises executing corresponding playing processing based on the type of the comment data record, such as one or more of restoring operation behaviors based on the operation instruction data, replacing or drawing pictures based on the picture data, updating or replacing page content data based on the content data, playing video data, playing audio data and restoring and executing graffiti drawing. Above, the content types used to create the commentary type sharing include, but are not limited to, files (including folders), pictures, text, forms, web pages, videos, sounds, websites, and the like. Optionally, the content type for creating the comment type sharing further includes an existing comment type sharing, so as to implement a method for sharing content for multiple comment communications. The implementation method has the advantages that an off-line communication mode can be realized in instant communication software aiming at communication content, for example, a user A needs to comment and graffiti annotation on part of the content in a certain contract file, and a user B can acquire the information when browsing the comment and generate a certificate of a network communication process. The above description of the communication method can be used as a supplementary communication method of the on-screen communication method, and it should be noted that some of the methods of the present application for on-screen communication are equally applicable to the description of the communication method.
In one possible implementation manner, after entering the on-screen communication page, the participant realizes the exchange operation of the communication content in the communication process, specifically: receiving replacement or selection of a content replacement event shared by the same screen communication triggered by a user at the instant messaging application terminal; acquiring new shared content acquisition data and/or information, and generating an exchange content replacement request based on the data and/or information; generating new on-screen communication page data at a server or an initiating request terminal, and sending the on-screen communication page data to other participant terminals; processing the exchange content exchange request at a server, and sending an exchange instruction and/or on-screen exchange page data to a participant terminal; and receiving the replacement instruction to reload the page data or receiving the new on-screen communication page data and updating the page at the participant terminal. Optionally, the server registers and stores data records corresponding to each on-screen communication content, or further stores corresponding on-screen communication page data for switching communication content in the on-screen communication process.
In a possible implementation manner, after the on-screen communication is finished and the on-screen communication process recording data is generated at the server side or the local terminal, recording completion mark information and/or recording data description information is returned, and the recording mark information is displayed at an entrance link in the terminal. Optionally, the recording data description information, such as recording duration, data size, etc., is displayed at the entry link. Optionally, the instant messaging application terminal obtains the on-screen communication sharing link and/or the on-screen communication sharing description data, and further obtains recording completion marking information and/or recording data description information of the on-screen communication. After receiving the triggering event of the access portal link, starting an on-screen communication page, loading on-screen communication page data and/or on-screen communication process recording data, loading a play control component (such as a start, play, pause, play progress component, fast forward, rollback and the like), analyzing the on-screen communication process recording data, and executing corresponding play processing according to time sequence according to time information contained in the recording data record, wherein the corresponding play processing comprises executing corresponding play processing according to the type of the recording data record, such as one or more of restoring operation behaviors based on operation instruction data, replacing or drawing pictures based on picture data, updating or replacing page content data based on content data, playing video data, playing audio data and restoring and executing graffiti drawing. The above embodiments provide a method of viewing and playing back on-screen communication processes.
In a possible implementation manner, the server receives a setting request for on-screen communication sharing sent by the instant messaging application terminal or a setting request generated according to setting information shared by the on-screen communication, and sets the created on-screen communication sharing or registered on-screen communication service based on the setting information contained in the setting request. For example, if the setting information is to cancel the on-screen communication service, setting the corresponding on-screen communication sharing type to be common sharing (content sharing in the prior art), and canceling the corresponding on-screen communication service; and if the setting information is that the same-screen communication sharing is closed, canceling the access right of the same-screen communication sharing link and the like. The above examples change the state of the on-screen communication sharing, and optionally, the instant communication application terminal obtains and updates the state information of the on-screen communication sharing, such as canceling the on-screen communication mark. The above embodiment is convenient for the user to set the state of sharing with the screen communication, for example, after the communication is finished, the user sets the state and converts the state into a common sharing.
In a possible implementation manner, in the on-screen communication process aiming at the on-screen communication sharing, an audio or video communication switching request sent by the instant communication terminal is received, and the on-screen communication page is switched to an independent audio or video communication function page or to the audio or video communication page of the instant communication application terminal. And the method further comprises the step of receiving a same-screen sharing exchange switching request sent by the instant communication terminal and switching the current page into a same-screen exchange page for exchanging the sharing content. This embodiment illustrates a method for switching between independent audio and video communication and on-screen communication.
In one possible implementation manner, the operation rights of each participating terminal are allocated in the same-screen communication process, so that only one terminal has the operation rights at the same time, and the control states of the terminals are divided into: idle (the own terminal and other terminals do not have the operation right), master control (the own terminal has the operation right), controlled (other terminals have the operation right) and other states, including:
After the same-screen communication page of one terminal monitors user operation, judging the control state of the terminal, and executing the following judgment and operation according to the control state:
A. When the terminal is in an idle state, sending an operation right application to a server, obtaining the operation right after permission, setting a control state of the terminal as a main control state, executing the user operation, starting a timer of the terminal to start timing operation, and informing other terminals to switch the control state into a controlled state by the server; after sending an operation right application to a server and refusing, intercepting the user operation;
B. Intercepting user operation when the control state is in a controlled state;
C. and when the main control state is in the main control state, executing user operation, refreshing the timer, and restarting timing.
After starting the timer to start timing, the method further comprises:
A, refreshing the timer to restart timing after monitoring user operation on the same-screen communication page within a preset time threshold;
And B, setting the control state of the terminal to be an idle state when the timer reaches a preset time threshold, sending an operation right return notification to a server, and informing other terminals to switch the control state to the idle state by the server.
The implementation manner realizes the automatic allocation of the operation authority of each terminal in the same-screen communication process.
In a possible implementation manner, the application establishes a communication mode of data communication between the on-screen communication page and the server, and optionally, adopts a communication channel established by the instant communication terminal and the server to replace the communication channel. The communication service provided by the application for the same-screen communication page at the server side, such as the same-screen communication service, is optionally replaced by a communication channel established between the server side and the instant communication terminal.
In a possible implementation manner, after the server receives the on-screen communication sharing creation request, a browsing instance is created at the server, the on-screen communication page data is loaded in the browsing instance, an on-screen communication page browsing and operating instance is generated, and page monitoring is started; after the instance content is loaded or the instance page content is monitored to change, acquiring the instance page data to generate the same-screen data and sending the same-screen data to the instant messaging application terminal participating in the same-screen communication, or acquiring a drawing instruction for drawing the instance page content based on the instance page and sending the drawing instruction as the same-screen data to the instant messaging application terminal participating in the same-screen communication, or generating picture or video data based on the instance page display content and sending the picture or video data as the same-screen data to the instant messaging application terminal participating in the same-screen communication. Correspondingly, based on the data sent by the server, the data is received at the corresponding instant messaging application terminal. And collecting user operation events at the instant messaging application terminal, and sending the operation events to the server. And the server receives a user operation event sent by the instant messaging application terminal, and executes the user operation in the browsing instance. Optionally, the above data acquisition method includes an incremental data acquisition method and a full data acquisition method, wherein the incremental data is changed partial data or contains changed partial data. Optionally, in combination with the method provided in this embodiment, the on-screen communication page of one of the instant messaging application terminals is implemented instead of the browsing and operation examples described above. The implementation manner provides another method for realizing the same screen, which creates an actual browsing and operation execution environment for the same-screen communication content at the server, sends the operation event of the same-screen communication content to the server and is actually executed in the execution environment of the server, and then sends the mirror image of the execution result to the terminal to display to obtain the same-screen effect, thereby being beneficial to solving the problem of execution confusion caused by the fact that the same-screen interaction comprises dynamic execution content (such as network request sent to the server, and a plurality of identical requests cause operation logic errors).
In addition, it should be specifically noted that, in the above embodiments, the on-screen communication page data supports the modes of server generation, creator terminal local generation, and the like listed in the embodiments of the present application, and the loading of the on-screen communication component also supports the modes of server generation, terminal local generation, and the like listed in the embodiments of the present application, and further supports setting the on-screen communication sharing based on setting information provided by other implementations of the present application.
Based on the same inventive concept, referring to fig. 18, the embodiment of the present invention further provides an instant messaging system including an on-screen communication sharing function, where the system includes an instant messaging application terminal 10 and a server 20, and the instant messaging application terminal 10 includes: the creation module 101, the link generation and processing module 102, and the on-screen communication page 103, where the on-screen communication page 103 further includes: the loading module 1031 and the on-screen data collecting and processing module 1032, and the server 20 includes: a creation request processing module 201, an access request processing module 202, an on-screen communication service module 203, wherein:
The creating module 101 is configured to create an on-screen communication sharing creation request and send the request to the server;
The link generation and processing module 102 is configured to receive a notification of completion of the on-screen communication sharing creation returned by the server, or receive an on-screen communication sharing link and/or on-screen communication sharing description data sent by the creation request processing module 201, generate an access portal link, and display the access portal link on the instant messaging application terminal;
the link generation and processing module 102 is further configured to receive an on-screen communication sharing link and/or on-screen communication sharing description data sent by a server or other instant messaging application terminals to generate an access entry link, and display the access entry link on the instant messaging application terminals;
The link generation and processing module 102 is further configured to start the on-screen communication page after receiving a trigger event for the access portal link or receiving the on-screen communication sharing creation completion notification;
The loading module 1031 is configured to share and load page content based on the on-screen communication;
the on-screen data collection and processing module 1032 is configured to collect one or more of operation instruction data, picture data, content data, and video data, generate on-screen data, and send the generated on-screen data to the on-screen communication service module 203;
the on-screen data collecting and processing module 1032 is further configured to receive on-screen data sent by the on-screen communication service module 203, and execute corresponding page synchronization processing on the on-screen communication page based on a data type included in the on-screen data;
The creation request processing module 201 is configured to receive the on-screen communication sharing creation request sent by the creation module 101, register on-screen communication service based on the on-screen communication sharing creation request, generate a corresponding on-screen communication sharing link and/or send on-screen communication sharing description data to a corresponding instant messaging application terminal, and further generate an on-screen communication sharing creation completion notification to send the on-screen communication sharing creation request to the instant messaging application terminal;
The access request processing module 202 is configured to receive the connection request of the on-screen communication service sent by the link generation and processing module 102, and search for a corresponding on-screen communication service based on the connection request, and establish a communication connection between the on-screen communication service and the instant messaging application terminal, and further include, when it is determined that the on-screen communication service is not started, starting the on-screen communication service;
the on-screen communication service module 203 is configured to receive on-screen data sent by the on-screen data acquisition and processing module 1032, and send on-screen data to the on-screen data acquisition and processing module 1032.
In one possible implementation manner, the instant communication system further comprises:
The link generation and processing module 102 is further configured to display the access portal link in a chat panel area of the instant messaging application terminal after the access portal link is generated;
The loading module 1031 is further configured to receive on-screen communication page data returned by the server, load and generate the on-screen communication page content, and establish communication between the instant messaging application terminal and the on-screen communication service of the server based on a network request included in the link of the on-screen communication page;
The loading module 1031 is further configured to load a co-screen communication component on the co-screen communication page, where the co-screen communication component includes one or more of a graffiti component, a video display component, an audio/video control component, a recording component, a co-screen status information display component, a co-screen permission control component, and a co-screen communication setting component;
The loading module 1031 is further configured to receive the on-screen communication page data sent by the server or the on-screen communication creator instant messaging application terminal, and load a local on-screen communication page based on the on-screen communication page data;
The on-screen data collecting and processing module 1032 is further configured to receive the on-screen communication page data sent by the on-screen communication service module 203, and load and generate the on-screen communication page content;
The creation module 101 is further configured to obtain setting data of a sharing target for the same-screen communication sharing, generate a sharing request based on the setting data, and send the sharing request to the creation request processing module 201;
The creation request processing module 201 is further configured to receive a sharing request sent by the creation module 101, analyze a sharing target and a corresponding on-screen communication sharing link included in the sharing request, and send the on-screen communication sharing link and/or the on-screen communication sharing description data to the sharing target instant messaging application terminal.
In a possible implementation manner, the on-screen communication page 103 of the instant messaging system further includes an audio/video module 1033, a graffiti module 1034, and a page content data generation module 1035, where:
The audio/video module 1033 is configured to perform audio and/or video communication between the instant messaging application terminal and a server or other instant messaging application terminals participating in on-screen communication;
the graffiti module 1034 is configured to collect graffiti data and send the graffiti data to the on-screen communication service module 203, and receive the graffiti data sent by the on-screen communication service module 203 and perform graffiti drawing;
The page content data generating module 1035 in the on-screen communication page 103 is configured to locally obtain the data content shared by the on-screen communication based on the information shared by the on-screen communication, generate on-screen communication page content based on local loading of the data content shared by the on-screen communication, and collect or generate on-screen communication page data to send to the server or other participant terminals.
In a possible implementation manner, the server 20 of the instant messaging system further includes a recording module 204 and a page content data generating module 205, where:
The recording module 204 is configured to record one or more of the on-screen communication page data, the on-screen data received by the on-screen communication service module 203, the on-screen data sent to the on-screen data acquisition and processing module 1032, sender information, receiver information, and occurrence time information, and store the one or more in a structured manner to generate on-screen communication process recording data;
The page content data generating module 205 of the server 20 is configured to generate on-screen communication page data at the server based on data and/or information included in the on-screen communication sharing creation request sent by the creating module 101;
the page content data generating module 205 of the server is further configured to create an on-screen communication component in the on-screen communication page, and add the on-screen communication component data to the on-screen communication page data generated by the server;
The access request processing module 202 is further configured to return the on-screen communication page data to the instant messaging application terminal after receiving a network request sent by the instant messaging application terminal to start the on-screen communication page;
the on-screen communication service module 203 is further configured to return the corresponding on-screen communication page data to the instant messaging application terminal after establishing a connection with the instant messaging application terminal.
In a possible implementation manner, the instant messaging application terminal 10 further includes a recording module 1036, where the recording module 1036 is configured to record one or more of on-screen communication page data, sending and receiving on-screen data, and occurrence time information locally and store and generate recording data for an on-screen communication process in a structured manner.
The embodiment of the application also provides an instant messaging application terminal which comprises a processor and a memory for storing executable instructions of the processor; wherein the processor is configured to perform any of the above methods of establishing communication sharing with a user in an instant messaging application.
The embodiment of the application also provides a computer readable storage medium, in which a computer program is stored, which when running on a computer, causes the computer to execute the method for establishing and sharing with using on-screen communication in the instant messaging application described in the above embodiment.
In addition, an embodiment of the present application further provides a computer program product, where the computer program product includes a computer program, when running on a computer, causes the computer to perform the method for establishing sharing with using on-screen communication in the instant messaging application described in the foregoing embodiment.
The present application is described below by way of example in connection with instant messaging software application examples, for further understanding:
as shown in fig. 20, a chat panel of the time communication software X is shown, and the user a and the user B are in the chat process; user a has a need to communicate with user B for file 1, at which time user a clicks the down add button (see dotted "+" icon button), initiates the type selection panel for sending data, as shown in fig. 21, where "share in screen communication" (see dotted box label); entering a sharing content selection panel for on-screen communication, as shown in fig. 22, selecting sharing content for on-screen communication on the page, wherein at this time, a user a selects "file 1", and based on the content selected by the user a, a request for creating the sharing of on-screen communication is sent to a server; after the server side processes the creation request, generating an on-screen communication sharing link, and the user A terminal receives the on-screen communication sharing link and displays the on-screen communication sharing link in a chat panel, as shown in fig. 23 (see a dotted line box mark); meanwhile, because the on-screen communication sharing is initiated in the chat scene, the server sets and processes the sharing target as the current chat room ID, and therefore, the user B receives the on-screen communication sharing link at the same time; the user A and the user B click on the same-screen communication sharing link to enter a same-screen communication page, as shown in fig. 24; after both parties enter the on-screen sharing communication page, exemplary processing steps are as follows:
1) Loading the same-screen communication page data and the same-screen communication component;
2) Establishing one-screen communication data communication with a server or establishing one-screen communication data communication between two terminals;
3) Starting an audio and video communication function based on the setting information during the sharing creation of the same screen communication, wherein the audio and video communication function comprises the steps of collecting video data of a camera of a terminal at one side and sending the video data to the terminal at the other side, receiving the video data of the terminal at the other side and playing the video data at the terminal at the other side, and collecting, sending and receiving the audio and video data;
4) When user operation occurs at one side of the terminal, collecting and generating same-screen data and sending the same-screen data to the server or the other side of the terminal; and receiving the same-screen data sent by the server or the terminal at the other side, and executing corresponding page synchronization processing at the terminal at the local side. In addition, the step is set according to the operation authority, and the method also comprises the situation that only one side of the terminals is allowed to execute operation and the other side of the terminals is allowed to execute synchronization;
5) Starting a doodling module, collecting doodling data and sending the doodling data to a server or a terminal at the other side; and receiving the graffiti data sent by the server or the terminal at the other side, and executing corresponding synchronous graffiti processing at the terminal at the home side.
Summarizing the methods provided in this example: chat pages (including group chat) in the instant messaging application program, receiving a second button click event triggered by a user, and starting a content type selection panel; receiving a selection event of a user for a sending type, and starting a sharing content selection panel for creating the sharing of the same screen communication when the selected type is confirmed to be the sharing type of the same screen communication; receiving sharing content selected by a user, and generating an on-screen communication sharing creation request to send based on the content selected by the user; receiving the on-screen communication sharing creation completion notice to start an on-screen communication page (or starting the on-screen communication page after user confirmation), or receiving the on-screen communication sharing link to be displayed on the chat page, receiving a click event of the on-screen communication sharing link by a user and starting the on-screen communication page; after entering the on-screen communication page, one or more of operation instruction data, picture data, content data and video data are collected, and on-screen data are generated and sent to a server or other terminals; and receiving the same-screen data sent by the server or other terminals, and executing page synchronization processing on the same-screen communication page based on the data type contained in the same-screen data.
The method and the device are used for explaining the implementation effect of the method, the requirement of the user A and the user B for the communication discussion of the file 1 is met quickly, and it is easy to see that the steps of creating the communication sharing with the screen by the user A are basically the same as the common file sharing operation times, the purpose of the communication with the screen is realized, the communication efficiency is improved, and in addition, the effect of the video conference for sharing the document discussion is realized, but compared with the steps of creating a conference, entering the conference and executing the sharing, the method and the device are obviously quick and efficient. Further, in combination with the above embodiment, the user a or the user B has a need to invite the user C to participate in the discussion, and only needs to select the sharing target user by long-pressing the sharing link in the instant messaging chat panel, so that the user C can invite to join in the same screen discussion. Further, after the on-screen communication is finished, recording and generating on-screen communication process recording data at a server (or a terminal), enabling a user to enter a process record for checking the communication through the on-screen communication sharing link of the chat panel, playing back the on-screen communication process, and providing evidence of the communication.
The foregoing is merely a specific implementation of the embodiment of the present application, but the protection scope of the embodiment of the present application is not limited thereto, and any person skilled in the art can easily think about changes or substitutions within the technical scope of the embodiment of the present application, and the changes or substitutions are covered by the protection scope of the embodiment of the present application. Therefore, the protection scope of the embodiments of the present application shall be subject to the protection scope of the claims.

Claims (10)

1. A method for establishing on-screen communication sharing in instant messaging application, wherein the method is applied to an instant messaging application terminal, and the method comprises the following steps:
At the on-screen communication creation terminal, a user selects the content which is shared in the instant messaging application terminal, and based on the shared content, an on-screen communication sharing creation request is generated and sent;
Receiving the on-screen communication sharing creation completion notice from the creation terminal of the on-screen communication to start an on-screen communication page; receiving the same-screen communication sharing link at the receiving terminal of the same-screen communication, displaying the same-screen communication sharing link on the chat page, receiving a click event of a user on the same-screen communication sharing link and starting the same-screen communication page;
After the instant messaging application terminal starts the on-screen communication page, collecting one or more of operation instruction data, picture data, content data, video data and doodle data in the on-screen communication page, generating on-screen data, and sending the on-screen data to the on-screen communication service; and receiving on-screen data sent by the on-screen communication service, and executing page synchronization processing on the on-screen communication page based on the data type contained in the on-screen data, wherein the page synchronization processing comprises one or more of executing operation instructions contained in the operation instruction data to restore operation behaviors, replacing or drawing pictures based on the picture data, updating or replacing page content data based on the content data, playing video data and executing synchronous graffiti drawing based on the graffiti data.
After the instant messaging application terminal starts the on-screen communication page, establishing audio and/or video communication between the instant messaging application terminal and a server or other instant messaging application terminals participating in the on-screen communication, and sending and receiving audio data and/or video data;
Wherein, the server side function includes: receiving an on-screen communication sharing creation request sent by the instant communication application terminal, registering on-screen communication service based on the on-screen communication sharing creation request, and generating corresponding on-screen communication sharing links and/or on-screen communication sharing description data; generating a sharing creation completion notice of the same screen communication; receiving a connection request of the on-screen communication service sent by the instant communication application terminal, searching the corresponding on-screen communication service based on the connection request, and establishing communication connection between the instant communication application terminal and the corresponding on-screen communication service; and receiving the same-screen data sent by the instant messaging application terminal, and sending the same-screen data to other instant messaging application terminals connected with the same-screen communication service.
2. The method of claim 1, wherein the user selecting content that has been shared in the instant messaging application terminal creates the on-screen communication share, further comprising:
And the user views the shared content, and generates the on-screen communication sharing creation request to send based on the shared content creation in the shared content viewing page.
3. The method of claim 1, wherein the user selecting content that has been shared in the instant messaging application terminal creates the on-screen communication share, further comprising:
And the user presses the shared content for a long time, and generates the on-screen communication sharing creation request to send based on the shared content creation.
4. The method of claim 1, wherein generating the on-screen communication share creation request based on the shared content further comprises:
and generating an on-screen communication sharing creation request at the creator terminal based on the identification information of the shared content.
5. The method of claim 1, wherein generating an on-screen communication share creation request at the instant messaging application terminal further comprises:
And acquiring setting data of a sharing target of the on-screen communication sharing, generating a sharing request based on the setting data and sending the sharing request to the server, wherein the sharing request is processed by the server, acquiring the sharing target of the on-screen communication sharing based on the contained setting data, and sending the on-screen communication sharing link and/or the on-screen communication sharing description data to the sharing target.
6. The method of claim 1, wherein receiving the on-screen share link for display on the chat page further comprises:
And receiving mark information which is used for creating on-screen communication sharing for the shared content, displaying the mark on the shared content, wherein the mark is used for identifying that the shared content can be clicked to enter on-screen communication.
7. The method of claim 1, further comprising, after the on-screen communication application terminal starts the on-screen communication page:
and the on-screen communication page is locally loaded with an on-screen communication component, and the on-screen communication component comprises one or more of a doodling component, a video display component, an audio and video control component, a recording component, an on-screen state information display component, an on-screen authority control component and an on-screen communication setting component.
8. The method of claim 1, further comprising, after the instant messaging application terminal enters the on-screen communication page:
Receiving a switching request for switching to audio or video communication sent by the instant communication terminal, and switching the same-screen communication page to an independent audio or video communication page; and receiving a switching request for switching to the same-screen communication sent by the instant communication terminal, and switching an audio or video communication page to the same-screen communication page.
9. The method of claim 1, further comprising, after the on-screen communication is started, recording on-screen communication page data, on-screen data received by the on-screen communication service, on-screen communication process recording data generated by one or more of on-screen data transmitted to the on-screen communication application terminal, sender information, receiver information, and time of occurrence information at the server or the instant communication application terminal; returning recording completion mark information and/or recording data description information, and displaying the recording mark information at an entrance link in the terminal; and receiving an access event of the user to the on-screen communication sharing link, and starting to play the on-screen communication process recording data so as to play back the on-screen communication process, wherein the on-screen communication process recording data is used for generating playback or video of the on-screen communication process.
10. The method of claim 1, further comprising, after the on-screen communication application terminal starts the on-screen communication page:
Receiving a replacement event triggered by a user or selecting the exchange sharing content with the screen; receiving new shared content, acquiring data and/or information of the new shared content, generating an exchange content replacement request based on the new shared content data and/or information, and sending the exchange content replacement request to the server, wherein new on-screen exchange page data is generated at the server or a terminal initiating the content replacement request, and the on-screen exchange page data is sent to other participant terminals; processing the exchange content exchange request at the server, and sending an exchange instruction and/or on-screen exchange page data to a participant terminal;
And receiving the replacement instruction to reload page data at the participant terminal in the on-screen communication, or receiving new on-screen communication page data and updating the on-screen communication page.
CN202410304599.1A 2021-12-12 2021-12-12 Method and system for establishing same-screen communication sharing in instant communication application Pending CN118200273A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202410304599.1A CN118200273A (en) 2021-12-12 2021-12-12 Method and system for establishing same-screen communication sharing in instant communication application

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202410304599.1A CN118200273A (en) 2021-12-12 2021-12-12 Method and system for establishing same-screen communication sharing in instant communication application
CN202111513109.1A CN114422460B (en) 2021-12-12 2021-12-12 Method and system for establishing same-screen communication sharing in instant communication application

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CN202111513109.1A Division CN114422460B (en) 2021-12-12 2021-12-12 Method and system for establishing same-screen communication sharing in instant communication application

Publications (1)

Publication Number Publication Date
CN118200273A true CN118200273A (en) 2024-06-14

Family

ID=81264668

Family Applications (4)

Application Number Title Priority Date Filing Date
CN202410304421.7A Pending CN118200271A (en) 2021-12-12 2021-12-12 Method and system for establishing same-screen communication sharing in instant communication application
CN202410304560.XA Pending CN118200272A (en) 2021-12-12 2021-12-12 Method and system for establishing same-screen communication sharing in instant communication application
CN202410304599.1A Pending CN118200273A (en) 2021-12-12 2021-12-12 Method and system for establishing same-screen communication sharing in instant communication application
CN202111513109.1A Active CN114422460B (en) 2021-12-12 2021-12-12 Method and system for establishing same-screen communication sharing in instant communication application

Family Applications Before (2)

Application Number Title Priority Date Filing Date
CN202410304421.7A Pending CN118200271A (en) 2021-12-12 2021-12-12 Method and system for establishing same-screen communication sharing in instant communication application
CN202410304560.XA Pending CN118200272A (en) 2021-12-12 2021-12-12 Method and system for establishing same-screen communication sharing in instant communication application

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN202111513109.1A Active CN114422460B (en) 2021-12-12 2021-12-12 Method and system for establishing same-screen communication sharing in instant communication application

Country Status (1)

Country Link
CN (4) CN118200271A (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115134318A (en) * 2022-06-16 2022-09-30 王蕾茜 Application program and chatting method capable of realizing synchronous same-screen real-time hand drawing by user
CN114970449B (en) * 2022-07-08 2022-11-01 青岛希望鸟科技有限公司 Font processing method applied to on-screen communication
CN115186218B (en) * 2022-09-14 2023-01-10 中新云服(北京)科技有限公司 Content switching method and system applied to same screen of webpage

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101166161B (en) * 2007-10-11 2012-05-30 刘帅 A method for dynamically obtaining exchange on screen of other party in instant communication tool
KR101470346B1 (en) * 2012-07-20 2014-12-09 주식회사 케이티 Screen Share Method Between User Stations through RCS Mobile Communication Service Network
CN102883135B (en) * 2012-11-01 2015-08-26 成都飞视美视频技术有限公司 Screen sharing and control method
US20150033140A1 (en) * 2013-07-23 2015-01-29 Salesforce.Com, Inc. Providing active screen sharing links in an information networking environment
CN105450688A (en) * 2014-08-20 2016-03-30 阿里巴巴集团控股有限公司 Screen-sharing method and device
CN105451198B (en) * 2014-09-30 2019-04-09 阿里巴巴集团控股有限公司 Share the method and apparatus of picture in instant messaging
CN106973330B (en) * 2017-03-20 2021-03-02 腾讯科技（深圳）有限公司 Screen live broadcasting method, device and system
CN112291496A (en) * 2019-07-24 2021-01-29 北京我声我视科技有限公司 Instant messaging method and system based on content
CN116471284A (en) * 2019-12-17 2023-07-21 青岛希望鸟科技有限公司 Online synchronous communication method based on HTML5 webpage
CN111405303B (en) * 2020-03-06 2021-11-12 青岛希望鸟科技有限公司 Method for quickly establishing live broadcast based on webpage
CN113595852A (en) * 2020-04-30 2021-11-02 北京字节跳动网络技术有限公司 Mail information display method and device, electronic equipment and storage medium
CN112347401A (en) * 2020-09-30 2021-02-09 深圳市聚点数码科技有限公司郑州分公司 House same-screen watching method, system, device and computer readable storage medium
CN111935443B (en) * 2020-10-12 2021-01-22 融智通科技（北京）股份有限公司 Method and device for sharing instant messaging tool in real-time live broadcast of video conference
CN113242173B (en) * 2021-05-10 2023-05-16 深圳宜享科技有限公司 Screen sharing method, device and system and instant messaging server
CN113377312A (en) * 2021-06-17 2021-09-10 北京十一贝科技有限公司 Same-screen interaction method and device, computer equipment and computer readable storage medium

Also Published As

Publication number Publication date
CN118200272A (en) 2024-06-14
CN118200271A (en) 2024-06-14
CN114422460A (en) 2022-04-29
CN114422460B (en) 2024-03-01

Similar Documents

Publication Publication Date Title
CN114422460B (en) Method and system for establishing same-screen communication sharing in instant communication application
US11140106B2 (en) Method, device and storage medium for interactive message in video page
US10872127B2 (en) Method and system of providing for cross-device operations between user devices
EP3926917B1 (en) Data transmission method, device and computer storage medium
US7856473B2 (en) Teleconference system, teleconference support method, and computer program
JP5727385B2 (en) Synchronize presentation state across multiple applications
US20160330258A1 (en) Broadcasts among electronic devices of registered users via internet protocol
US20150149933A1 (en) User interface widget unit sharing for application user interface distribution
EP2631825A1 (en) Communication system, server and terminal, with mounting of a per-conference shared folder
KR102052245B1 (en) Methods, systems, and media for recommending collaborators of media content based on authenticated media content input
US20130080560A1 (en) System and Method for Sharing Digital Data on a Presenter Device to a Plurality of Participant Devices
CN104539977A (en) Live broadcast previewing method and device
US20230017859A1 (en) Meeting control method and apparatus, device, and medium
CN112584187A (en) Session creation method, device, server and storage medium
CN110996118A (en) Cover synthesis method, device, server and storage medium
JP3882605B2 (en) Messaging system and method, messaging apparatus, and message exchange apparatus
JP2008294854A (en) Information recording support device, information recorder, information recording system, and information recording method
KR20110065292A (en) Method and apparatus for sharing comments of content
CN111143607B (en) Information acquisition method and device
CN114726816B (en) Method and device for establishing association relationship, electronic equipment and storage medium
CN114466208B (en) Live broadcast record processing method and device, storage medium and computer equipment
CN116820792B (en) Interactive processing method applied to web page on-screen communication
CN113422970B (en) Live fragment display method and device, electronic equipment and storage medium
CN116980149A (en) Connection management method, device, terminal and storage medium
CN117609652A (en) Display equipment and webpage screen projection method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination