CN114222190A

CN114222190A - Remote control processing and responding method and device, equipment, medium and product thereof

Info

Publication number: CN114222190A
Application number: CN202111531921.7A
Authority: CN
Inventors: 巫金生
Original assignee: Guangzhou Huaduo Network Technology Co Ltd
Current assignee: Guangzhou Huaduo Network Technology Co Ltd
Priority date: 2021-12-14
Filing date: 2021-12-14
Publication date: 2022-03-22
Anticipated expiration: 2041-12-14
Also published as: CN114222190B

Abstract

The application discloses a live broadcast room remote control processing and response method and a device, equipment, a medium and a product thereof, wherein the method comprises the following steps: pushing a control application instruction to a target user side in a live broadcast room; receiving a screen recording video stream pushed by a target user end in response to a control application instruction, outputting the screen recording video stream to a control area of a live broadcast room, and playing the screen recording video stream, wherein the screen recording video stream is forwarded and pushed by a media server; monitoring an operation event acting on a control area of a live broadcast room in real time, and generating a corresponding operation message according to the operation event; and pushing the operation message to the target user side so that the target user side can analyze the operation message and execute the operation instruction in the operation message in the position corresponding to the operation position information in the live broadcast interface of the target user side to control the current live broadcast online service, wherein the operation message is forwarded and pushed by a communication server. The method and the system provide remote assistance service for users of the live broadcast platform, and the video stream and the instruction are shunted, forwarded and pushed by the corresponding server to achieve data synchronization.

Description

Remote control processing and responding method and device, equipment, medium and product thereof

Technical Field

The present application relates to the field of network live broadcast, and in particular, to a method for processing and responding to a remote control in a live broadcast room, and further, to an apparatus, a device, a non-volatile storage medium, and a computer program product corresponding to the method.

Background

With the development of network live broadcast, the network live broadcast is more and more popular and is favored by users, a live broadcast platform provides live broadcast room services for platform users, a main broadcast user in the platform creates a live broadcast room in the network live broadcast platform, audience users of the platform enter the live broadcast room to participate in live broadcast services started by the audience users, the audience users watch talent performance, game live broadcast explanation and other contents of the main broadcast in the live broadcast room, the communication among the users is greatly facilitated, and the social progress is promoted.

However, users in the network live broadcast platform often encounter many problems when using the application program of the live broadcast platform daily, for example, a new user cannot use a corresponding live broadcast function due to insufficient guidance provided by the platform, or a anchor user in the platform cannot maintain an interaction behavior of audience users in a live broadcast room when live broadcast services are busy, or a certain error that the user cannot repair occasionally occurs in the live broadcast application program, so that the device where the user is located cannot normally run the application program.

In view of the above problems, the present applicant has made a corresponding search in view of the problems.

Disclosure of Invention

It is an object of the present application to meet the needs of the prior art or overcome at least some of the deficiencies of the prior art and to provide a live broadcast room remote control processing method and a corresponding apparatus, electronic device, non-volatile storage medium and computer program product.

In order to realize the purpose of the application, the following technical scheme is adopted:

the method for remotely controlling and processing the live broadcast room is suitable for the purpose of the home page of the application and comprises the following steps:

pushing a control application instruction to a target user side in a live broadcast room;

receiving a screen recording video stream formed by recording a live broadcast room interface of the target user side after the target user side responds to the control application instruction, outputting the screen recording video stream to a live broadcast room control area for playing, and forwarding and pushing the screen recording video stream to a current control end by a media server;

monitoring an operation event acting on the live broadcast room control area in real time, and generating a corresponding operation message according to the operation event, wherein the operation message comprises an operation instruction which can be analyzed to act on a live broadcast room interface of the target user side and operation position information carried by the operation instruction as required;

and pushing the operation message to the target user side so that after the target user side analyzes the operation message, the operation instruction in the operation message is executed on a live broadcast room interface of the target user side, the operation instruction acts on a corresponding position indicated by the operation position information as required to control the current live broadcast room online service, and the operation message is forwarded and pushed to the client side by the communication server.

In a further embodiment, the method comprises the following pre-steps:

receiving a help seeking notification pushed by a user side in a live broadcast room, and displaying a notification window in a current graphical user interface so as to display user characteristic information and live broadcast room characteristic information contained in the help seeking notification in the notification window;

and responding to the help-seeking receiving instruction acting on the notification window, and generating a control application instruction pointing to the user side positioned in the live broadcast room.

In a further embodiment, the step of receiving a screen recording video stream formed by a live broadcast interface of the target user after the target user responds to the control application instruction, and outputting the screen recording video stream to a live broadcast control area for playing includes the following steps:

receiving a screen recording video stream which is transmitted and pushed by a media server and recorded by a target user side;

outputting the screen recording video stream to a live broadcast room control area of a current graphical user interface for playing;

and displaying an operation instruction set control in the current graphical user interface, wherein the operation instruction set control comprises a pause control instruction, a continue control instruction and an end control instruction which cannot be generated through the control area of the live broadcast room.

In a further embodiment, the step of monitoring the operation event acting on the live broadcast room control area in real time and generating a corresponding operation message according to the operation event, where the operation message includes an operation instruction capable of being resolved into a live broadcast room interface acting on the target user side and operation position information carried as required, includes the following steps:

monitoring an operation event triggered by a current user through the control area of the live broadcast room in real time;

responding to the operation event, and acquiring an operation instruction currently executed by a current user in the live broadcast room control area and the corresponding operation position information of the operation instruction in the live broadcast room control area;

and packaging the operation instruction and the operation position information corresponding to the operation instruction to generate the operation message.

In a further embodiment, the operation event triggered by the current user through the live broadcast room control area includes any one of the following: a click operation event, a long press operation event, a drag operation event, a slide operation event, and a touch operation event.

In a further embodiment, the live room online service is any one of the following: the system comprises a live broadcast room audience management service, a live broadcast room playing service and a live broadcast room error reporting service.

A live broadcast room remote control processing apparatus adapted to a primary object of the present application, comprising:

the application instruction pushing module is used for pushing a control application instruction to a target user side in a live broadcast room;

the screen recording video stream playing module is used for receiving a screen recording video stream formed by recording a live broadcast room interface of the target user side after the target user side responds to the control application instruction, outputting the screen recording video stream to a live broadcast room control area for playing, and forwarding and pushing the screen recording video stream to a current control end by a media server;

the operation message generation module is used for monitoring operation events acting on the live broadcast room control area in real time and generating corresponding operation messages according to the operation events, wherein the operation messages comprise operation instructions capable of being analyzed into live broadcast room interfaces acting on the target user sides and operation position information carried by the operation instructions according to needs;

and the operation message pushing module is used for pushing the operation message to the target user side so that after the target user side analyzes the operation message, an operation instruction in the operation message is executed on a live broadcasting room interface of the target user side, the operation instruction acts on a corresponding position indicated by the operation position information as required to realize control of the current live broadcasting room online service, and the operation message is forwarded and pushed to the client side by the communication server.

In a further embodiment, the screen recording video stream playing module includes:

the screen recording video stream receiving submodule is used for receiving the screen recording video stream which is transmitted and pushed by the media server and is recorded by the target user side;

the screen recording video stream playing submodule is used for outputting the screen recording video stream to a live broadcast room control area of a current graphical user interface for playing;

and the operation instruction set control piece display submodule is used for displaying an operation instruction set control piece in the current graphical user interface, and the operation instruction set control piece comprises a pause control instruction, a continuation control instruction and an end control instruction which cannot be generated through the control area of the live broadcast room.

In a further embodiment, the operation message generation module includes:

the operation event monitoring submodule is used for monitoring an operation event triggered by a current user through the control area of the live broadcast room in real time;

the operation event response submodule is used for responding to the operation event and acquiring an operation instruction currently executed by a current user in the live broadcast room control area and the operation position information corresponding to the operation instruction in the live broadcast room control area;

and the operation message generation submodule is used for packaging the operation instruction and the operation position information corresponding to the operation instruction to generate the operation message.

Another objective of the present application is to provide a method for responding to a live broadcast room remote control, which includes the following steps:

responding to a control application instruction pushed by a control end, and displaying a control application control in a current live broadcast room interface;

responding to a control receiving instruction acting on the control application control, pushing a screen recording video stream generated by recording a graphical user interface of a current live broadcast room interface to the control end, wherein the screen recording video stream is forwarded and pushed to the control end by a media server;

responding to the operation message pushed by the control terminal, executing the operation instruction in the position corresponding to the operation position information in the current live broadcasting room interface according to the operation instruction and the operation position information corresponding to the operation instruction contained in the operation message, controlling live broadcasting room online service in the current live broadcasting room, and forwarding and pushing the operation message to the current client by the communication server.

Another object of the present application is to provide a live broadcast room remote control processing apparatus, including:

the application instruction response module is used for responding to a control application instruction pushed by the control end and displaying a control application control in the current live broadcast room interface;

the receiving control instruction module is used for responding to a receiving control instruction acting on the control application control and pushing a screen recording video stream generated by recording a graphical user interface of a current live broadcast room interface to the control end, and the screen recording video stream is forwarded and pushed to the control end by the media server;

and the operation message response module is used for responding to the operation message pushed by the control terminal, executing the operation instruction in a position corresponding to the operation position information in a current live broadcasting room interface according to the operation instruction and the operation position information corresponding to the operation instruction contained in the operation message, controlling live broadcasting room online service in the current live broadcasting room, and forwarding and pushing the operation message to the current client by the communication server.

The electronic device comprises a central processing unit and a memory, wherein the central processing unit is used for calling and running a computer program stored in the memory to execute the live broadcast room remote control processing method or the live broadcast room remote control processing method.

The non-volatile storage medium stores a computer program implemented according to the live broadcast room remote control processing method or the live broadcast room remote control processing method, and when the computer program is called by a computer, the computer program executes the steps included in the corresponding method.

In order to solve the foregoing technical problem, an embodiment of the present application further provides a computer program product, which includes a computer program and a computer instruction, and when the computer program and the computer instruction are executed by a processor, the processor executes the steps of the live broadcast data hierarchical prediction method, the live broadcast room remote control processing method, or the live broadcast room remote control processing method.

Compared with the prior art, the application has the following advantages:

this application can provide long-range assistance service to the user in the live platform, provide its required assistance when broadcasting the business for the user in daily live application who uses the platform or broadcasting in using, be similar to and provide real-time manual assistance to the user, for example, help the anchor user who is broadcasting live to provide the service of maintaining audience order, promote anchor user's live experience, or help the user that the mistake appears in the live room to provide mistake repair service, or provide guide etc. to the user of the live play activity that is unfamiliar with and opens in the live room, and then promote the experience that live platform user used live application through the mode of remote control assistance.

Secondly, the screen recording video stream and the operation message in the application are forwarded and pushed through different server shunting, so that when the control end executes remote control through the screen recording video stream, synchronization between the video stream played by the control end and operation in the remote control user end is ensured, and the data transmission efficiency during bidirectional transmission of different data is improved.

Additional aspects and advantages of the present application will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the present application.

Drawings

The foregoing and/or additional aspects and advantages of the present application will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:

fig. 1 is a schematic diagram of a typical network deployment architecture related to implementing the technical solution of the present application;

fig. 2 is a schematic flowchart of an exemplary embodiment of a remote control processing method of a live broadcast room according to the present application;

fig. 3 is a schematic diagram of a graphical user interface for a user side to visually control an application command in the present application;

fig. 4 is a schematic diagram of a graphical user interface of a live broadcast room interface at a user side in the present application;

fig. 5 is a schematic diagram of a graphical user interface for playing a screen-recorded video stream by a control terminal according to the present application;

fig. 6 is a schematic diagram of a graphical user interface when a user at a control end performs remote control through a live broadcast room area in the present application;

FIG. 7 is a schematic diagram of a graphical user interface for a user to perform corresponding operations after receiving an operation message;

fig. 8 is a schematic diagram of a graphical user interface for a control end to synchronously play a latest screen recording video stream in a live broadcast room area after pushing an operation message in the application;

fig. 9 is a schematic flowchart illustrating a process of receiving a help-seeking notification pushed by a user side in a live broadcast room by a control side according to an embodiment of the present application;

FIG. 10 is a schematic diagram of a graphical user interface for a control-side visual help notification in the present application;

fig. 11 is a schematic flowchart illustrating an embodiment of playing a radio-cassette video stream by a control terminal according to the present application;

fig. 12 is a schematic flowchart illustrating an embodiment of generating an operation message by a control terminal according to the present application;

fig. 13 is a functional block diagram of an exemplary embodiment of a live room remote control processing device of the present application;

fig. 14 is a flowchart illustrating an exemplary embodiment of a remote control response method of a live broadcast room according to the present application;

fig. 15 is a functional block diagram of an exemplary embodiment of a live room remote control response apparatus of the present application;

fig. 16 is a block diagram illustrating a basic structure of a computer device according to an embodiment of the present application.

Detailed Description

Reference will now be made in detail to embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are exemplary only for the purpose of explaining the present application and are not to be construed as limiting the present application.

As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. As used herein, the term "and/or" includes all or any element and all combinations of one or more of the associated listed items.

It will be understood by those within the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

As will be appreciated by those skilled in the art, "client," "terminal," and "terminal device" as used herein include both devices that are wireless signal receivers, which are devices having only wireless signal receivers without transmit capability, and devices that are receive and transmit hardware, which have receive and transmit hardware capable of two-way communication over a two-way communication link. Such a device may include: cellular or other communication devices such as personal computers, tablets, etc. having single or multi-line displays or cellular or other communication devices without multi-line displays; PCS (Personal Communications Service), which may combine voice, data processing, facsimile and/or data communication capabilities; a PDA (Personal Digital Assistant), which may include a radio frequency receiver, a pager, internet/intranet access, a web browser, a notepad, a calendar and/or a GPS (Global Positioning System) receiver; a conventional laptop and/or palmtop computer or other device having and/or including a radio frequency receiver. As used herein, a "client," "terminal device" can be portable, transportable, installed in a vehicle (aeronautical, maritime, and/or land-based), or situated and/or configured to operate locally and/or in a distributed fashion at any other location(s) on earth and/or in space. The "client", "terminal Device" used herein may also be a communication terminal, a web terminal, a music/video playing terminal, such as a PDA, an MID (Mobile Internet Device) and/or a Mobile phone with music/video playing function, and may also be a smart tv, a set-top box, and the like.

The hardware referred to by the names "server", "client", "service node", etc. is essentially an electronic device with the performance of a personal computer, and is a hardware device having necessary components disclosed by the von neumann principle such as a central processing unit (including an arithmetic unit and a controller), a memory, an input device, an output device, etc., a computer program is stored in the memory, and the central processing unit calls a program stored in an external memory into the internal memory to run, executes instructions in the program, and interacts with the input and output devices, thereby completing a specific function.

It should be noted that the concept of "server" as referred to in this application can be extended to the case of a server cluster. According to the network deployment principle understood by those skilled in the art, the servers should be logically divided, and in physical space, the servers may be independent from each other but can be called through an interface, or may be integrated into one physical computer or a set of computer clusters. Those skilled in the art will appreciate this variation and should not be so limited as to restrict the implementation of the network deployment of the present application.

Referring to fig. 1, the hardware basis required for implementing the related art embodiments of the present application may be deployed according to the architecture shown in the figure. The server 80 is deployed at the cloud end, and serves as a business server, and is responsible for further connecting to a related data server and other servers providing related support, so as to form a logically associated server cluster to provide services for related terminal devices, such as a smart phone 81 and a personal computer 82 shown in the figure, or a third-party server (not shown in the figure). Both the smart phone and the personal computer can access the internet through a known network access mode, and establish a data communication link with the cloud server 80 so as to run a terminal application program related to the service provided by the server.

For the server, the application program is usually constructed as a service process, and a corresponding program interface is opened for remote call of the application program running on various terminal devices.

The application program refers to an application program running on a server or a terminal device, the application program implements the related technical scheme of the application in a programming mode, a program code of the application program can be saved in a nonvolatile storage medium which can be identified by a computer in a form of a computer executable instruction, and is called into a memory by a central processing unit to run, and the related device of the application is constructed by running the application program on the computer.

The technical scheme suitable for being implemented in the terminal device in the application can also be programmed and built in an application program providing live webcasting, and the technical scheme is used as a part of extended functions. The live webcast refers to a live webcast room network service realized based on the network deployment architecture.

The live broadcast room is a video chat room realized by means of an internet technology, generally has an audio and video broadcast control function and comprises a main broadcast user and audience users, wherein the audience users can comprise registered users registered in a platform or unregistered tourist users; either registered users who are interested in the anchor user or registered or unregistered users who are not interested in the anchor user. The interaction between the anchor user and the audience user can be realized through known online interaction modes such as voice, video, characters and the like, generally, the anchor user performs programs for the audience user in the form of audio and video streams, and economic transaction behaviors can also be generated in the interaction process. Of course, the application form of the live broadcast room is not limited to online entertainment, and can be popularized to other relevant scenes, such as an educational training scene, a video conference scene, a product recommendation and sale scene, and any other scene needing similar interaction.

The person skilled in the art will know this: although the various methods of the present application are described based on the same concept so as to be common to each other, they may be independently performed unless otherwise specified. In the same way, for each embodiment disclosed in the present application, it is proposed based on the same inventive concept, and therefore, concepts of the same expression and concepts of which expressions are different but are appropriately changed only for convenience should be equally understood.

The embodiments to be disclosed herein can be flexibly constructed by cross-linking related technical features of the embodiments unless the mutual exclusion relationship between the related technical features is stated in the clear text, as long as the combination does not depart from the inventive spirit of the present application and can meet the needs of the prior art or solve the deficiencies of the prior art. Those skilled in the art will appreciate variations therefrom.

Referring to fig. 2, in an exemplary embodiment of a method for remote control processing of a live broadcast room, the method includes the following steps executed by a control end:

step S11, pushing a control application instruction to a target user side in the live broadcast room:

and the current control end pushes the control application instruction to the target user end positioned in the live broadcast room so as to control the live broadcast room online service of the target user end in the live broadcast room.

The control end obtains the screen recording video stream recorded by the target user end on the interface of the live broadcast room by pushing the application instruction to the target user end in the live broadcast room, and synchronously controls the live broadcast room online service performed by the target user end in the live broadcast room through the screen recording video stream.

The control application instruction is generally forwarded and pushed by a communication server constructed based on a TPC network communication protocol, and the current control end pushes the control application instruction to the communication server, so that the communication server responds to the control application instruction, determines a target user end for receiving the control application instruction, and forwards and pushes the control application instruction to the target user end.

After receiving the control application instruction, the target user side displays a control application control in the graphical user interface of the live broadcast interface of the target user side, so that the target user side triggers and accepts the control application instruction acceptance control event or triggers and rejects the control application instruction rejection control event through the control application control, when the control application control acceptance control event is triggered, the target user side records the graphical user interface of the live broadcast interface of the target user side to generate a screen recording video stream and pushes the screen recording video stream to the current control end, and the related specific implementation mode refers to the subsequent steps, which is not repeated.

The control application instruction is generally pushed by a current control end actively, the current control end selects a target user end in any live broadcast room, the target user end is generally a main broadcast user end, then the control application instruction is pushed to the target user end to apply remote control to the target user end, and in addition, the control application instruction can be pushed to the user end after responding to a help-seeking request pushed by any user end in any live broadcast room for the current control end so as to help the user end to carry out live broadcast room on-line service in the live broadcast room where the user end is located.

Step S12, receiving a screen recording video stream formed by recording a live broadcast interface of the target user after the target user responds to the control application instruction, outputting the screen recording video stream to a live broadcast control area for playing, where the screen recording video stream is forwarded by the media server and pushed to the current control end:

after the current control end pushes the control application instruction to the target user end, the current control end waits for the target user end to receive the control application instruction, and after the target user end receives the control application instruction, the current control end pushes the screen recording video stream formed by recording a live broadcast room interface to the current control end, so that the current control end receives the screen recording video stream and outputs the screen recording video stream to a live broadcast room control area for playing, and then the screen recording video stream played in the live broadcast room control area is paired with live broadcast room online service carried out in a live broadcast room where the target user end is located.

Referring to fig. 3 and 4, after receiving the control application instruction pushed by the current control end, the target user end displays the control application control 301 shown in fig. 3 in the live broadcast interface, and the user at the target user end can generate an acceptance control instruction through the acceptance control 302 in the control application control shown in the touch control, so that the target user end records a screen recording video stream generated by the graphical user interface of the live broadcast interface shown in fig. 4 in response to the instruction, and pushes the screen recording video stream to the media server, so as to drive the media server to transmit and push the screen recording video stream to the current control end.

Referring to fig. 5, after receiving the screen recording video stream forwarded and pushed by the media server, the current control end outputs the screen recording video stream to the live broadcast room control area 501 shown in fig. 5 for playing, so that the user at the current control end operates and controls the target user side through the live broadcast room control area 501, and in addition, after outputting and playing the screen recording video stream, the current control end also displays an operation instruction set control 502 shown in fig. 5 in a graphical user interface, where the operation instruction set control 502 includes a pause control instruction, a continue control instruction, and an end control instruction that cannot be generated through the live broadcast room control area 501.

The media server is responsible for forwarding and pushing the screen recording video stream, the target user side firstly pushes the screen recording video stream generated by recording and a corresponding forwarding instruction to the media server together, and after receiving the screen recording video stream, the media server determines a control terminal for receiving the screen recording video stream according to the forwarding instruction so as to push the screen recording video stream to the control terminal for output and play.

And a data communication link for continuously transmitting the screen recording video stream is established between the current control end and the target user end, and the data communication link is maintained by the media server, so that the current control end continuously receives the screen recording video stream recorded and generated by the target control end through the data communication link to generate and play, and the screen recording video stream played in the live broadcast room control area of the current control end is ensured to be synchronous with the live broadcast room interface in the target user end.

Step S13, monitoring the operation event acting on the live broadcast room control area in real time, and generating a corresponding operation message according to the operation event, wherein the operation message comprises an operation instruction which can be analyzed as a live broadcast room interface acting on the target user side and operation position information carried by the operation instruction as required:

and after the current control end outputs the screen recording video stream to the live broadcast room control area for playing, the current control end monitors the operation event triggered by the user at the current control end in the live broadcast room control area in real time, and outputs a corresponding operation message according to the monitored operation event.

The current control end monitors the operation events performed in the live broadcast room control area by the current user at the current control end in real time, for example, a current user clicks or long-presses or touches a click operation event or a long-press operation event or a touch operation event which is triggered by any control correspondingly in a live broadcast interface displayed in the currently played video stream in the live broadcast control area, or the current user drags the live broadcast room interface displayed in the screen recording video stream played in the live broadcast room control area to drag a dragging operation event triggered by any control in the live broadcast room interface, or the current user slides the live broadcast room interface displayed in the screen recording video stream played in the live broadcast room control area to switch the live broadcast room interface or activate and display a sliding operation event triggered by a corresponding control, and the like.

After monitoring that a current user triggers a corresponding operation event in a real-time live broadcast room control area, a current control end responds to the operation event, determines an operation instruction corresponding to the operation event, acquires operation position information recording the position operated by the operation instruction in a live broadcast room interface displayed in a video stream recorded on a screen, and further encapsulates the operation instruction and the operation position information corresponding to the operation instruction into the operation message, so that after analyzing the operation message, a target user end executes corresponding operation in the live broadcast room interface according to the operation instruction and the operation position information contained in the operation message, and controls live broadcast room online service in the live broadcast room where the target user end is located.

Referring to fig. 6, fig. 6 is a schematic diagram of a current user at a current control end performing an operation event in the live broadcast room control area, where a click audience talk 602 of the current user in the live broadcast room control area 601 shown in fig. 6 triggers a click operation event, an operation point corresponding to the click operation event is a click operation instruction, operation position information of the click operation corresponding to the click operation instruction is an operation position 603 in the live broadcast room control area 601 shown in fig. 6, and the operation position 603 is a position of the click operation of the current user in the live broadcast room control area 601.

Step S14, the operation message is pushed to the target user side, so that after the target user side parses the operation message, the operation instruction in the operation message is executed on the live broadcast interface, and acts on the corresponding position indicated by the operation position information therein as needed, so as to control the currently performed live broadcast online service, and the operation message is forwarded by the communication server and pushed to the client:

after the current control end generates the operation message, the operation message is pushed to the target user end to control the live broadcast room online service in the live broadcast room where the target user end is currently located, and specifically, after the target user end receives the operation message, the operation instruction contained in the operation message and the operation position information corresponding to the operation instruction are analyzed and obtained, so that the operation instruction is executed in the position corresponding to the operation position information in the current live broadcast room interface.

The communication server is responsible for forwarding and pushing the operation message, the current control end pushes the operation message to the communication server, and after receiving the operation message, the communication server verifies the current control end to determine a target user end establishing a data communication link with the current control end, so as to push the operation message to the target user end.

The live broadcast room online service generally comprises live broadcast room audience management service, live broadcast room play service and live broadcast room error reporting service, wherein the live broadcast room audience management service generally faces a main broadcast user end in a live broadcast room, a current control end is responsible for the management online service of audience users in the live broadcast room where the main broadcast user end is located, the live broadcast room play service generally refers to online services with play interaction property, such as microphone connecting online service or live broadcast lottery online service, which are started in the live broadcast room, the current control end can control the audience user end or the main broadcast user end which carries out the live broadcast room play service to provide corresponding substitute play service for the audience user end or the main broadcast user end, and the live broadcast room error reporting service generally refers to the online service with errors or faults in the live broadcast room, when the live broadcast room where any user end is located has errors or faults, the method can push a help request to the current control end to request the current control end to repair errors or faults occurring in the live broadcast room for the current control end.

Referring to fig. 6, 7 and 8, fig. 7 is a schematic diagram of a live room interface of a host client in a live room of a live room online service for a live room audience management service responding to the operation message pushed by a current control terminal, when an operation message generated by triggering a click operation event at an operation position 603 where the front control end clicks a viewer utterance 602 in a live broadcast room control area 601 shown in fig. 6 is pushed to the target user end, the target ue will align to the operation position 701 in fig. 7 according to the operation position information included in the operation message, and execute the click operation represented in the operation command, further shown in figure 7 is audience management control 702 for an utterance pointing to "user UVW", reporting a talk event, banning a talk event, and kicking out a live room event may be performed on "user UVW" in audience management control 702; correspondingly, after the target user side executes an event for controlling the live broadcast room online service according to the operation instruction and the operation position information corresponding to the operation instruction included in the operation message, the screen recording video stream played in the live broadcast room control area of the graphical user interface of the current control end is converted from the screen recording video stream shown in fig. 6 to the screen recording video stream played in the live broadcast room control area 801 shown in fig. 8.

As can be seen from the exemplary embodiment, the control end executing the method applies for controlling the live broadcast room online service performed by the user end in the live broadcast room by pushing a control application instruction to a certain user end in the live broadcast room, and after receiving the control application instruction, the user end pushes the screen recording video stream of the live broadcast room interface recorded by the control end to the control end, so that the control end is convenient for the control user to know the current live broadcast room interface of the user end by playing the screen recording video stream, and by operating the live broadcast room online service performed in the live broadcast room where the user end is located in the live broadcast room control area displaying the screen recording video stream, the control end provides a corresponding assistant service for the user at the user end, thereby improving the user experience of the live broadcast room, for example, helping the main broadcast user who is performing live broadcast to provide a service for managing audience, and improving the live broadcast experience of the main broadcast user, or help users with errors in the live broadcast room to provide error repair services, etc.

The above exemplary embodiments and their variants fully disclose the embodiments of the method for remote control processing of a live broadcast room of the present application, but many variants of this method can be deduced by transforming and augmenting some technical means, and further embodiments are outlined as follows:

in one embodiment, referring to fig. 9 and 10, the method includes the following pre-steps:

step S09, receiving a help-seeking notification pushed by a user side in the live broadcast room, and displaying a notification window in the current graphical user interface to display user characteristic information and live broadcast room characteristic information included in the help-seeking notification in the notification window:

and the current control end receives the help-seeking notification pushed by the user end positioned in the live broadcast room, displays the notification window in the current graphical user interface, and outputs the user characteristic information and the live broadcast room characteristic information contained in the help-seeking notification to the notification window for display.

Referring to fig. 10, fig. 10 is a schematic view of a graphical user interface after the current control end receives the help-seeking notification, and after the current control end receives the help-seeking notification, a notification window 1001 as shown in fig. 10 is displayed in the current graphical user interface, and the user characteristic information and the live broadcast room characteristic information included in the help-seeking notification are output to the notification window 1001 for display.

Step S10, in response to the help-seeking acceptance instruction acting on the notification window, generating a control application instruction pointing to the user side in the live broadcast room:

referring to fig. 10, after the user at the current control end touches the receiving control 1002 in the notification window 1001 shown in fig. 10, the job application receiving instruction is triggered to be output, so that when the current control end responds to the help receiving instruction, the control application instruction pointing to the user end corresponding to the user feature information displayed in the notification window 1001 is generated.

In this embodiment, the control end may receive the help-seeking notification pushed by the user end that needs the assistant service, so as to receive the help-seeking request from the user end, provide the assistant service for the user end, and further improve the use experience of the user in the live broadcast room.

In an embodiment, referring to fig. 5 and 11, the step of receiving a screen recording video stream formed by a live broadcast interface of the target user after the target user responds to the control application instruction, and outputting the screen recording video stream to a live broadcast control area for playing includes the following steps:

step S121, receiving the screen recording video stream recorded by the target user side forwarded and pushed by the media server:

and after the current control end pushes the control application instruction to the target user end and the target user end receives the control application instruction, the current control end receives the screen recording video stream which is forwarded by the media server and pushed and recorded by the target user end on the live broadcast interface of the current control end.

Step S122, outputting the screen recording video stream to a live broadcast room control area of the current graphical user interface for playing:

referring to fig. 5, after receiving the screen recording video stream, the current control end outputs the screen recording video stream to the live broadcast room control area 501 shown in fig. 5 for playing, so that the user at the current control end controls the live broadcast room online service performed by the target user side in the live broadcast room through the live broadcast room control area 501.

Step S123, displaying an operation instruction set control in the current graphical user interface, wherein the operation instruction set control comprises a pause control instruction, a continue control instruction and an end control instruction which cannot be generated through the live broadcast room control area:

referring to fig. 5, the current control end outputs the screen recording video stream to the live broadcast room control area 501 shown in fig. 5 for playing, and displays an operation instruction set control 502 shown in fig. 5 in the current graphical user interface, where the operation instruction set control is used to generate a pause control instruction, a continue control instruction, and an end control instruction that cannot be generated through the live broadcast room control area 501.

In this embodiment, the control end receives the screen recording video stream forwarded by the media server to play and display, so that the user can know the live broadcast room interface of the target user end through the screen recording video stream, and then perform corresponding operation event to control live broadcast room online service performed in the live broadcast room, and display an operation instruction set control in the interface, so that the user operation cannot be performed through the operation of controlling the area realization in the live broadcast room.

In an embodiment, referring to fig. 6 and 12, the step of monitoring the operation event acting on the live broadcast room control area in real time, and generating a corresponding operation message according to the operation event, where the operation message includes an operation instruction capable of being resolved into a live broadcast room interface acting on the target user side and operation location information carried on the operation instruction as needed includes the following steps:

step S131, monitoring the operation event triggered by the current user through the live broadcast room control area in real time:

Step S132, responding to the operation event, acquiring an operation instruction currently executed by the current user in the live broadcast room control area and the operation position information corresponding to the operation instruction in the live broadcast room control area:

Step S133, encapsulating the operation instruction and the operation position information corresponding thereto to generate the operation message:

and the current control end encapsulates the operation instruction and the operation position information corresponding to the operation instruction into the operation message so as to subsequently push the operation message to the target user end, so that the target user end receives the operation message and analyzes and obtains the operation instruction contained in the operation message and the operation position information corresponding to the operation instruction, and the operation instruction is executed in a position corresponding to the operation position information in the current live broadcasting room interface.

In this embodiment, the control end monitors the operation event of the user in the live broadcast room control area in real time to generate a corresponding operation message for pushing, so as to synchronize the operation behavior of the user in the control end to the target user end, thereby implementing live broadcast room online service in the live broadcast room of the remote control user end.

Further, a live broadcast room remote control processing apparatus of the present application can be constructed by functionalizing the steps in the methods disclosed in the above embodiments, and according to this idea, please refer to fig. 13, wherein in an exemplary embodiment, the apparatus includes: an application instruction pushing module 11, configured to push a control application instruction to a target user side in a live broadcast room; a screen recording video stream playing module 12, configured to receive a screen recording video stream formed by recording a live broadcast room interface of the target user end after the target user end responds to the control application instruction, output the screen recording video stream to a live broadcast room control area for playing, where the screen recording video stream is forwarded and pushed to a current control end by a media server; an operation message generation module 13, configured to monitor, in real time, an operation event acting on the live broadcast room control area, and generate a corresponding operation message according to the operation event, where the operation message includes an operation instruction that can be parsed into a live broadcast room interface acting on the target user side and operation position information carried on the operation instruction as needed; and the operation message pushing module 14 is configured to push the operation message to the target user side, so that after the target user side analyzes the operation message, the operation message pushing module executes an operation instruction in the operation message on a live broadcast room interface of the target user side, and acts on a corresponding position indicated by the operation position information in the operation message as required to control a currently performed live broadcast room online service, where the operation message is forwarded by the communication server and pushed to the client.

In one embodiment, the screen recording video stream playing module 12 includes: the screen recording video stream receiving submodule is used for receiving the screen recording video stream which is transmitted and pushed by the media server and is recorded by the target user side; the screen recording video stream playing submodule is used for outputting the screen recording video stream to a live broadcast room control area of a current graphical user interface for playing; and the operation instruction set control piece display submodule is used for displaying an operation instruction set control piece in the current graphical user interface, and the operation instruction set control piece comprises a pause control instruction, a continuation control instruction and an end control instruction which cannot be generated through the control area of the live broadcast room.

In one embodiment, the operation message generation module 13 includes: the operation event monitoring submodule is used for monitoring an operation event triggered by a current user through the control area of the live broadcast room in real time; the operation event response submodule is used for responding to the operation event and acquiring an operation instruction currently executed by a current user in the live broadcast room control area and the operation position information corresponding to the operation instruction in the live broadcast room control area; and the operation message generation submodule is used for packaging the operation instruction and the operation position information corresponding to the operation instruction to generate the operation message.

Referring to fig. 14, in an exemplary embodiment of a method for remote control response of a live broadcast room of the present application, the method includes the following steps performed by a client:

step S21, responding to the control application instruction pushed by the control end, displaying a control application control in the current live broadcast room interface:

the current user side responds to the control application instruction pushed by the control side, displays the control application control in the current live broadcast room interface, specifically, please refer to fig. 3, fig. 3 is a schematic diagram of a graphical user interface of the control application control displayed in the current live broadcast room interface by the current user side, the control application control 301 shown in fig. 3 has an acceptance control 302 and a rejection control 303, and after a user touches the acceptance control 302 in the control application control 301 shown in fig. 3, subsequent steps are executed.

The control application instruction is generally forwarded and pushed by a communication server constructed based on TCP, and the control end pushes the control application instruction to the communication server so as to drive the communication server to forward and push the control application instruction to the current user end.

Step S22, responding to the control command received by the control application control, pushing the screen recording video stream generated by recording the graphic user interface of the current live broadcast interface to the control terminal, wherein the screen recording video stream is forwarded and pushed to the control terminal by the media server:

and after the user at the current user side touches the receiving control in the control application control, triggering to generate the receiving control instruction so that the current user side responds to the receiving control instruction, records the graphical user interface of the current live broadcast interface to generate the screen recording video stream, and pushes the screen recording video stream to the control terminal for output and play.

Referring to fig. 4 and 5, after the current user side responds to the received control instruction, the graphical user interface shown in fig. 4 is recorded, and the video stream of the screen recording containing the graphical user interface is generated and pushed to the control side, so that the control side plays the graphical user interface shown in fig. 4 in the live broadcast room control area 501 in the graphical user interface shown in fig. 4.

The media server is responsible for forwarding and pushing the screen recording video stream, the current user side firstly pushes the screen recording video stream generated by recording and a corresponding forwarding instruction to the media server together, and after receiving the screen recording video stream, the media server determines a control terminal for receiving the screen recording video stream according to the forwarding instruction so as to push the screen recording video stream to the control terminal for output and play.

Step S23, responding to the operation message pushed by the control end, executing the operation instruction in the position corresponding to the operation position information in the current live broadcast room interface according to the operation instruction and the operation position information corresponding to the operation instruction contained in the operation message, controlling live broadcast room online service performed in the current live broadcast room, and forwarding the operation message by the communication server to push the operation message to the current client:

and the current user side responds to the operation message pushed by the control side which receives the screen recording video stream forwarded and pushed by the current user side, so that the operation represented by the operation instruction is executed in the position corresponding to the operation position message in the current live broadcasting room interface according to the operation instruction contained in the operation message and the operation position message corresponding to the operation instruction, and the control side controls live broadcasting room online service in the current live broadcasting room.

The communication server is responsible for forwarding and pushing the operation message, the control end pushes the operation message to the communication server, and after receiving the operation message, the communication server verifies the current control end to determine a target user end establishing a data communication link with the current control end, so that the operation message is pushed to the target user end.

Referring to fig. 6, 7 and 8, when the current user side is a main broadcasting user side in a live broadcast room in which live broadcast room online service is the live broadcast room audience management service, and the control side triggers an operation message generated by a click operation event at an operation position 603 where a click audience speech 602 is in a live broadcast room control area 601 shown in fig. 6 to be pushed to the current user side, the current user side aligns to an operation position 701 in fig. 7 according to the operation position information included in the operation message, and executes the click operation represented in the operation instruction, thereby displaying an audience management control 702 pointing to a speech of "user UVW" in fig. 7, and performing live broadcast speech reporting, speech prohibition events and kicking out the live broadcast room events to "user UVW" in the audience management control 702; correspondingly, after the current user side executes the event for controlling the live broadcast room online service according to the operation instruction and the operation position information corresponding to the operation instruction included in the operation message, the screen recording video stream played in the live broadcast room control area of the graphical user interface of the control side is converted from the screen recording video stream shown in fig. 6 to the screen recording video stream played in the live broadcast room control area 801 shown in fig. 8.

In the exemplary embodiment, the user side in the live broadcast room can respond to the control application instruction pushed by the control end, the live broadcast room online service performed in the live broadcast room is delivered to the control end for operation, the screen recording video stream of the screen recording graphical user interface is pushed to the control end for playing and displaying, and then corresponding operation is performed according to the operation message pushed by the control end, so that remote assistance service is provided for the user of the live broadcast platform, live broadcast service of a main broadcast user of an assistance platform or a user unfamiliar with the live broadcast room online service of the platform is provided, and the use experience of the user in the platform is improved.

Further, a live broadcast room remote control response apparatus of the present application can be constructed by functionalizing the steps in the method disclosed in the above embodiments, and according to this idea, please refer to fig. 15, wherein in an exemplary embodiment, the apparatus includes: an application instruction response module 21, configured to respond to a control application instruction pushed by a control end, and display a control application control in a current live broadcast room interface; a control receiving instruction module 22, configured to respond to a control receiving instruction acting on the control application control, and push a screen recording video stream generated by recording a graphical user interface of a current live broadcast room interface to the control terminal, where the screen recording video stream is forwarded and pushed to the control terminal by a media server; and an operation message response module 23, configured to respond to an operation message pushed by the control end, execute the operation instruction in a position corresponding to the operation position information in a current live broadcast room interface according to the operation instruction and the operation position information corresponding to the operation instruction included in the operation message, and control live broadcast room online service performed in the current live broadcast room, where the operation message is forwarded by the communication server and pushed to the current client.

In order to solve the foregoing technical problem, an embodiment of the present application further provides a computer device, configured to run a computer program implemented according to the live broadcast room remote control processing method or the live broadcast room remote control processing method. Referring to fig. 16, fig. 16 is a block diagram of a basic structure of a computer device according to the present embodiment.

As shown in fig. 16, the internal structure of the computer device is schematically illustrated. The computer device includes a processor, a non-volatile storage medium, a memory, and a network interface connected by a system bus. The non-volatile storage medium of the computer device stores an operating system, a database and computer readable instructions, the database can store control information sequences, and the computer readable instructions when executed by the processor can enable the processor to realize a live broadcast room remote control processing method or a live broadcast room remote control processing method. The processor of the computer device is used for providing calculation and control capability and supporting the operation of the whole computer device. The memory of the computer device may have computer readable instructions stored therein that, when executed by the processor, cause the processor to perform a live room remote control processing method or a live room remote control processing method. The network interface of the computer device is used for connecting and communicating with the terminal. Those skilled in the art will appreciate that the architecture shown in fig. 15 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.

In this embodiment, the processor is configured to execute specific functions of each module/sub-module in the live broadcast remote control processing apparatus or the live broadcast remote control processing apparatus of the present invention, and the memory stores program codes and various data required for executing the modules. The network interface is used for data transmission to and from a user terminal or a server. The memory in this embodiment stores program codes and data necessary for executing all modules/submodules in the live broadcast room remote control processing device or the live broadcast room remote control processing device, and the server can call the program codes and data of the server to execute the functions of all the submodules.

The present application further provides a non-volatile storage medium, where the live broadcast room remote control processing method or the live broadcast room remote control processing method is written as a computer program and stored in the storage medium in the form of computer readable instructions, where the execution of the computer readable instructions by one or more processors means the execution of the program in a computer, and thereby causes the one or more processors to execute the steps of the live broadcast room remote control processing method or the live broadcast room remote control processing method according to any one of the above embodiments.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and can include the processes of the embodiments of the methods described above when the computer program is executed. The storage medium may be a non-volatile storage medium such as a magnetic disk, an optical disk, a Read-Only Memory (ROM), or a Random Access Memory (RAM).

In summary, the present application provides remote assistance service for a user of a live broadcast platform, and the video stream and the instruction are distributed, forwarded and pushed by the corresponding server to implement data synchronization.

It should be understood that, although the steps in the flowcharts of the figures are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and may be performed in other orders unless explicitly stated herein. Moreover, at least a portion of the steps in the flow chart of the figure may include multiple sub-steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed alternately or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

Those of skill in the art will appreciate that the various operations, methods, steps in the processes, acts, or solutions discussed in this application can be interchanged, modified, combined, or eliminated. Further, other steps, measures, or schemes in various operations, methods, or flows that have been discussed in this application can be alternated, altered, rearranged, broken down, combined, or deleted. Further, steps, measures, schemes in the prior art having various operations, methods, procedures disclosed in the present application may also be alternated, modified, rearranged, decomposed, combined, or deleted.

The foregoing is only a partial embodiment of the present application, and it should be noted that, for those skilled in the art, several modifications and decorations can be made without departing from the principle of the present application, and these modifications and decorations should also be regarded as the protection scope of the present application.

Claims

1. A remote control processing method for a live broadcast room is characterized by comprising the following steps:

2. The method according to claim 1, characterized in that it comprises the following preliminary steps:

3. The method of claim 1, wherein the step of receiving a video stream recorded by the target ue in response to the control application command and formed in a live broadcast interface of the target ue, and outputting the video stream to a live broadcast control area for playing comprises the steps of:

4. The method according to claim 1, wherein the step of monitoring the operation event acting on the live broadcast room control area in real time and generating a corresponding operation message according to the operation event, wherein the operation message includes an operation instruction capable of being resolved into a live broadcast room interface acting on the target user side and operation position information carried on the operation instruction as required, comprises the following steps:

5. The method according to any one of claims 1 to 4, wherein the operation event triggered by the current user through the live broadcast room control area comprises any one of: a click operation event, a long press operation event, a drag operation event, a slide operation event, and a touch operation event.

6. The method of claims 1 to 4, wherein the live-room online service is any one of: the system comprises a live broadcast room audience management service, a live broadcast room playing service and a live broadcast room error reporting service.

7. A remote control response method for a live broadcast room is characterized by comprising the following steps:

8. An electronic device comprising a central processor and a memory, wherein the central processor is configured to invoke execution of a computer program stored in the memory to perform the steps of the method according to any one of claims 1 to 7.

9. A non-volatile storage medium, characterized in that it stores, in the form of computer-readable instructions, a computer program implemented according to the method of any one of claims 1 to 7, which, when invoked by a computer, performs the steps comprised by the method.

10. A computer program product comprising computer program/instructions, characterized in that the computer program/instructions, when executed by a processor, implement the steps of the method of any one of claims 1 to 7.