WO2018149170A1

WO2018149170A1 - Cross-application control method and device

Info

Publication number: WO2018149170A1
Application number: PCT/CN2017/107853
Authority: WO
Inventors: 周志刚
Original assignee: 武汉斗鱼网络科技有限公司
Priority date: 2017-02-16
Filing date: 2017-10-26
Publication date: 2018-08-23
Also published as: CN108449643A; CN108449643B

Abstract

Disclosed is a cross-application control method applied in a broadcaster terminal, comprising: acquiring overlay comment information transmitted by a target user in a first application; extracting, according to a preset extraction rule, control information from the overlaid comment information; transmitting the control information to a second application, both the second application and the first application being operating on a broadcaster terminal; and controlling a target object displayed in the second application to execute an action corresponding to the control information. The method and device of the present invention can solve a technical problem in the prior art in which an audience has limited participation in a live broadcast game which results in poor audience experience, thereby increasing participation options for an audience of a live broadcast game, and improving audience experience.

Description

Cross-application control method and device

Technical field

The present invention relates to the field of computer technologies, and in particular, to a cross-application control method and apparatus.

Background technique

At present, with the advancement of network communication technology and the speed of broadband networks, webcasting has been increasingly developed and applied. At the same time, with the development of the barrage, the live broadcast has better interaction and fun. Especially in the field of game live broadcast, more and more viewers will watch the live broadcast of the game anchor.

In the live broadcast of the game, for the anchor end, the live broadcast software and the specific game will be simultaneously opened. While the anchor plays the game, the live broadcast software collects the content of the game and pushes the content to the server of the live website through the network. The viewer pulls the live content pushed by the anchor through the server of the live website for video playback. For game live broadcast, the anchor broadcasts the gameplay while playing the game. For the viewer, it can only watch and send the barrage, but can't participate in the game, nor can it control the game, and can't feel the function of the game. Experience.

It can be seen that the game live broadcast in the prior art has a technical problem that the audience experience form is single and the experience effect is poor.

Summary of the invention

The invention provides a cross-application control method and device, which is used to solve the game live broadcast in the prior art, and has the technical problem that the audience experience form is single and the experience effect is poor.

In a first aspect, the present invention provides a cross-application control method, where the method is applied to an anchor end, including:

Obtaining the barrage information sent by the target user in the first application;

Extracting control information from the barrage information according to a preset extraction rule;

Sending the control information to the second application, where the second application and the first application are both running on the anchor end;

Controlling, by the target object displayed in the second application, an action corresponding to the control information.

Optionally, the control information is information for controlling a moving direction; and the controlling the target object displayed in the second application to perform the action corresponding to the control information comprises: controlling the target object to be characterized along the control information The direction of movement.

Optionally, the first application is a live application, the second application is a game application, and an image or video displayed in the second application is sent by the first application to a viewer connected to the anchor end. .

Optionally, before the acquiring the barrage information sent by the target user in the first application, the method includes: receiving a selection operation that is performed on the anchor end; and, based on the selecting operation, from a user group connected to the anchor end Identify the target user.

Optionally, the acquiring the barrage information sent by the target user in the first application includes: acquiring a barrage information group sent by the user group connected to the anchor end; and filtering out the salvage information group from the salvage information group The barrage information sent by the target user.

Optionally, the extracting the control information from the barrage information according to the preset extraction rule includes: extracting a key from the barrage information according to the preset keyword and the corresponding information of the control information a word; determining, according to the keyword and the corresponding information, the control information corresponding to the keyword.

Optionally, the sending the control information to the second application includes: injecting the control information into the injection module by using a named pipe preset in the first application, where the injection module is a pre-written injection The module of the second application.

Optionally, the controlling the target object displayed in the second application to perform the action corresponding to the control information comprises: calling a control function by using the injection module to control the target object to execute the control information corresponding to An action, wherein the control function is obtained by the injection module from a reverse analysis of the second application.

The second aspect provides a cross-application control device, where the device is a main broadcast terminal, including:

An obtaining module, configured to acquire the barrage information sent by the target user in the first application;

An extraction module, configured to extract control information from the barrage information according to a preset extraction rule;

a sending module, configured to send the control information to a second application, where the second application and the first application are both running on the anchor end;

And a control module, configured to control, by the target object displayed in the second application, an action corresponding to the control information.

Optionally, the control information is information for controlling a moving direction; and the control module is further configured to: control the target object to move in a direction represented by the control information.

One or more technical solutions provided in the embodiments of the present invention have at least the following technical effects or advantages:

The method and device provided by the embodiment of the present application acquire the barrage information of the target user in the first application, and extract the control information in the barrage information to control the target object of the second application to perform the action, thereby realizing the specified live broadcast. The viewer can perform the corresponding action by transmitting the barrage to the anchor end to control the target object in the game application of the anchor end, thereby increasing the experience form of the game live audience and enhancing the experience effect.

The above description is merely an overview of the technical solution of the present invention, in order to more clearly understand the technology of the present invention. The above and other objects, features, and advantages of the present invention will be apparent from the description and appended claims.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, a brief description of the drawings used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work.

1 is a flowchart of a cross-application control method according to an embodiment of the present invention;

FIG. 2 is a schematic structural diagram of a cross-application control apparatus according to an embodiment of the present invention.

detailed description

The embodiment of the present application solves the technical problem that the game experience is live and the audience experience form is single and the experience is poor, by providing a cross-application control method and device. The technical effect of increasing the experience form of the game live audience and enhancing the experience effect is realized.

The general technical idea of the technical solution in the embodiment of the present application is as follows:

Obtaining the barrage information sent by the target user in the first application; extracting control information from the barrage information according to a preset extraction rule; transmitting the control information to the second application, the second application and the The first application runs on the anchor end; and controls the target object displayed in the second application to perform an action corresponding to the control information.

The above method controls the target object of the second application to perform the action by acquiring the barrage information of the target user in the first application and extracting the control information in the barrage information, thereby realizing that the designated live audience can send the barrage to The anchor end performs corresponding actions on the target object in the game application of the application control anchor on the application side, thereby increasing the experience form of the live audience of the game and enhancing the experience effect.

The technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the drawings in the embodiments of the present invention. It is a partial embodiment of the invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

Embodiment 1

The embodiment provides a cross-application control method. As shown in FIG. 1 , the method is applied to the anchor end, and includes:

Step S101, acquiring barrage information sent by the target user in the first application;

Step S102, extracting control information from the barrage information according to a preset extraction rule;

Step S103: Send the control information to the second application, where the second application and the first application are both running on the anchor end;

Step S104, controlling a target object displayed in the second application to perform an action corresponding to the control information.

In the embodiment of the present application, the anchor end may be an electronic device such as a smart phone, a desktop computer, a notebook, or a tablet computer, and is not limited herein.

In the embodiment of the present application, the anchor end may be an Android system, an IOS system, or a Windows system, and is not limited herein.

In the embodiment of the present application, the first application is a live software application, the second application is a game software application, and the anchor end runs the first application and the second application at the same time. The image or video displayed in the second application is sent by the first application to each viewer connected to the anchor end to perform live game play. Of course, in the specific implementation process, the second application may also be a video playing application or a picture display application, and the like, which is not limited herein.

The specific implementation steps of the method provided by the present application are described in detail below with reference to FIG. 1 , where the first application is a live broadcast software, and the second application is a game software.

First, step S101 is executed to acquire the barrage information sent by the target user in the first application.

In the embodiment of the present application, the determining manner of the target user may be multiple, and the anchor terminal may receive the selecting operation, and determining the target from the user group connected to the anchor terminal based on the selecting operation. The user may also determine the target user by receiving information sent by the viewer connected to the anchor.

Specifically, the anchor may determine the target client by performing a click operation on the interface of the live broadcast software, so that the target client controls the game; or the anchor end sends a signal, and receives the registration returned by each viewer. The information is determined according to the order in which the registration information is sent. In the specific implementation process, the target customer's determination plan can be set according to the needs, and no restrictions are imposed here.

In the embodiment of the present application, the barrage information may be moving text or symbol information floating on the video, or may be a text or symbol displayed on another chat window independent of the video window on the first application interface. Information, no restrictions here.

In the specific implementation process, the acquiring the barrage information sent by the target user in the first application includes:

Obtaining a barrage information group sent by a user group connected to the anchor end;

The barrage information sent by the target user is filtered from the barrage information group.

Specifically, the anchor end can obtain all the barrage information in real time through the first application, that is, the live broadcast software, and can also filter out all the barrage information of a certain viewer from all the barrage information.

In the embodiment of the present application, the barrage filtering function can be written in the live broadcast software to filter out the barrage of the target user. The anchor end can receive the barrage message of all the audience users in the live room through the live broadcast software. Since each barrage message contains the information of the sender of the barrage, after the anchor determines the target user, it can pass each barrage. The sender information obtains all the barr information of the target user.

Then, step S102 is executed to extract control information from the barrage information according to a preset extraction rule.

In the specific implementation process, there are many ways to extract control information. Here are two examples:

The first type, the corresponding information of the preset keyword and the control information.

That is, the control information is extracted from the barrage information according to a preset extraction rule, including:

Extracting a keyword from the barrage information according to a preset keyword and corresponding information of the control information;

Determining the control information corresponding to the keyword according to the keyword and the corresponding information.

Specifically, taking the control information as the direction control information as an example, the anchor may indicate the direction control information of the game character by setting some keyword tables in advance. The keywords in the table may be “left” for leftward and “right” for “right”. Go right, wait. All the direction control information is retrieved from the barrage information by acquiring all the barrage information of the target user and according to the keyword table. The control information is a series of walking information for controlling walking information of characters in subsequent games.

For example, the preset corresponding information records a control code corresponding to “right” corresponding to “control character going to the right”, and the obtained bullet information is “to see the cave on the right side”, and the bullet can be queried according to the corresponding information. The keyword "right" in the screen information corresponds to the control code of the control information "control character to the right", thereby extracting the control code whose control information is "control the character to the right".

Second, the keyword is directly extracted as control information.

Specifically, taking the control information as the direction control information, the direction-related field may be directly extracted from the barrage information as the control information by using a continuous learning algorithm or a method such as querying from a database.

For example, if the obtained bullet information is "to see the cave on the right", the direction field "Right" may be extracted from the barrage information as the control information.

Of course, in the specific implementation process, different control information extraction methods may be selected according to requirements, and are not limited herein.

Then, step S103 is executed to send the control information to the second application, where the second application and the first application are both running on the anchor end.

In the embodiment of the present application, there are many methods for transmitting the control information from the first application to the second application across an application, which may be through a network, through a server of the first application, and the second application. The server is used to implement the cross-application transmission of the anchor side; the method of sharing the memory or the shortcut key triggering may be used to implement the cross-application transmission of the anchor end, which is not limited herein.

Preferably, in consideration of saving network resources and speeding up the transmission speed of information across applications, the embodiment adopts a method of naming pipes and injecting modules to implement cross-application information transmission. That is, the control information is injected into the injection module by using a named pipe preset in the first application, wherein the injection module is a module that is pre-written to inject the second application.

Specifically, for the establishment of the named pipe, the named pipe may be first written in the first application, that is, the live broadcast software, for the communication between the live broadcast software and the second application, that is, the game process. Among them, the named pipe is through the network to complete the communication between processes, it shields the underlying network protocol details, through the named pipe this paper realizes the communication between the live software and the injection module injected in the game process.

In the following description, the injection module is referred to as a client of a named pipe, and the anchor software is referred to as a server of a named pipe. First, create a named pipe on the server and wait for the client to connect. Once the injected injection module is injected into the game process and starts running, the injection module will connect to the named pipe. Once the named pipe is connected, the live software can be communicated with the injection module in the game. The specific implementation method is as follows:

For the server:

(1) Create a named pipe by calling the WindowsAPI function CreateNamedPipe.

First set the name of the named pipe, you can set a unique name at will, and will not be the same as the pipe of other processes in the system. The client game injection module of the named pipe will connect to the named pipe by this name.

(2) Wait for the client connection of the named pipe by calling the function ConnectNamedPipe.

(3) Once the client is connected, the function ReadFile is called to read the data sent by the client. The data is to tell the server that the client has completed the connection and can communicate.

(4) The control information acquired in step S102 is then written into the named pipe by calling the function WriteFile.

For the client:

(1) The client connects to the named pipe created by the server by calling the function CreateFile. The name of the named pipe can be a unique name defined in advance.

(2) The client waits for a response from the server by calling the function WaitNamedPipe.

(3) The client writes data to the named pipe by calling the function WriteFile.

(4) The client reads the control information sent by the server from the named pipe by calling the function ReadFile.

Through the named pipe, the server of the live broadcast software continuously writes the obtained control information into the named pipe, and the injection module injected into the game process continuously collects the control from the named pipe. Information.

For the setting of the injection module, the function of injecting the module to the second application, that is, the game process, may be written in the first application, ie, live broadcast software.

Specifically, the injection module can be injected into another game process by calling an API function provided by the Windows system. The basic idea is to create a remote thread in the game process through the Windows system API function CreateRemoteThread (this is called a remote thread because this thread is a thread created by the live software process in the game process), and is called by the created remote thread. The system function LoadLibrary is used to load the injection module that needs to be injected into the game process. The specific implementation is as follows:

(1) Allocate memory in the memory space of the target process through the WindowsAPI function VirtualAllocEx function.

(2) Write the disk path of the module that needs to be injected by the Windows API function WriteProcessMemory to the allocated memory, that is, the memory space of the target process allocated in step (1).

(3) Call the WindowsAPI function CreateRemoteThread function to create a thread in the target process. The execution logic of the thread is to call the Windows API function LoadLibrary to load the disk path of the injection module written in the target process space in step (2). In this way, a thread is opened in the target process, and the injection module is loaded by the thread, thereby implementing the function of injecting the injection module into the target process.

Through the above steps, the function of injecting the injection module into the game process is realized, thereby providing a possibility for subsequent application inter-process communication.

Then, step S104 is executed to control the target object displayed in the second application to perform an action corresponding to the control information.

In the embodiment of the present application, when the second application is a game process, the control information may be direction control information for controlling a target object displayed in the second application to move along a direction represented by the control information; The motion control information for controlling the target object displayed in the second application to sit, stand up or run; or the sound control information for controlling the sound of the target object displayed in the second application. When the second application is a video playing application, the control information may also be video control information for controlling the target video played by the second application to fast forward, pause, or switch the target video, which is not listed here, nor is it made. limit.

In the embodiment of the present application, the cross-application control in the step S104 may be implemented by setting the control information as a shortcut key triggering code, or may be implemented by using the injection module, which is not limited herein.

Preferably, the control function can be invoked by the injection module to control execution of the target object. The action corresponding to the control information, wherein the control function is obtained by the injection module from a reverse analysis in the second application.

In the following, the second application is a game application process, and the control information is a game character direction control information as an example to illustrate how to control the target object by using an injection module:

First, the function of character walking in the game process is inversely analyzed.

Specifically, you can disassemble and analyze the functions that the character walks in the game process will call. You can use the dynamic debugging tool WinDbg provided by Windows to dynamically debug the game process, and then find the game by walking in all directions of the character in the game. The function walks to call which function in the game process, and analyzes the parameters of the called walk function for the walking control role of the injection module. Similarly, the interface that can be provided is: Walk(int dir), where Walk indicates the walking function and the parameter di r indicates the direction of walking. Through this step, the function function of analyzing the character walking in the game process is realized, so that the injection module can be called to control the walking of the character.

Then, the functions of the injection module are written, including the function of communicating with the named pipe and the function of calling the character walk function in the game process. Since the injection module is pre-injected into the game process and belongs to the same process space as the game process, the function of the game process can be directly called.

Specifically, controlling the walking of the game character is accomplished by invoking a character walk function by the injection module injected into the game process. After the communication module establishes communication with the named pipe, the control information for controlling the walking of the character is continuously collected through the named pipe. After receiving the control information, the injection module can directly call the game character walking function that is inversely analyzed before, thereby implementing the function of controlling the walking of the game character according to the control information.

For ease of understanding, the method provided by the present application is explained by a specific control example from the perspective of human-computer interaction:

First, the anchor simultaneously starts the game process and the live broadcast software process on the device of the anchor end, the anchor enters the live broadcast room, and the game broadcasts in the live broadcast room, and each viewer entering the live broadcast room can watch the game screen through the live broadcast software opened by the viewer terminal;

Then, the anchor selects the audience user A in the live broadcast room as the control audience, and the anchor terminal filters out the barrage information sent by the user A from the barrage of the live broadcast room, and extracts the control information therefrom;

When the user A sends the "going forward" barrage information through the barrage, the control information extracted from the anchor end is the code corresponding to "control the game character moving forward";

The live broadcast process of the anchor end sends the control information to the pre-injection injection module in the game process through a preset named pipe;

The injection module calls the game character walking function, and controls the forward movement of the game character according to the control information, so that the user A can control the walking of the character in the game process through the hair bombing to the anchor end in real time, thereby increasing the live broadcast audience of the game. The form of experience enhances the experience.

Based on the same inventive concept, the present application also provides an apparatus corresponding to the cross-application control method in the first embodiment. For details, see Embodiment 2.

Embodiment 2

The embodiment provides a cross-application control device. As shown in FIG. 2, the device is a main broadcast terminal, and includes:

The obtaining module 201 is configured to acquire the barrage information sent by the target user in the first application;

The extracting module 202 is configured to extract control information from the barrage information according to a preset extraction rule;

The sending module 203 is configured to send the control information to the second application, where the second application and the first application are both running on the anchor end;

The control module 204 is configured to control a target object displayed in the second application to perform an action corresponding to the control information.

In the embodiment of the present application, the device may be an Android system, an IOS system, or a Windows system, and is not limited herein.

In the embodiment of the present application, the control information is information for controlling a moving direction; the control module 204 is further configured to: control the target object to move in a direction represented by the control information.

The device described in the second embodiment of the present invention is a device for implementing the cross-application control method according to the first embodiment of the present invention. Therefore, based on the method introduced in Embodiment 1 of the present invention, those skilled in the art can understand the specific device. Structure and deformation, so it will not be described here. The apparatus used in the method of the first embodiment of the present invention is within the scope of the present invention.

The technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages:

Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.

The present invention is directed to a method, apparatus (system), and computer program according to an embodiment of the present invention. The flow chart and/or block diagram of the product is described. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

While the preferred embodiment of the invention has been described, it will be understood that Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and the modifications and

It is apparent that those skilled in the art can make various modifications and variations to the embodiments of the invention without departing from the spirit and scope of the embodiments of the invention. Thus, it is intended that the present invention cover the modifications and modifications of the embodiments of the invention.

Claims

A cross-application control method is characterized in that the method is applied to an anchor end, and includes:

Obtaining the barrage information sent by the target user in the first application;

Extracting control information from the barrage information according to a preset extraction rule;

Sending the control information to the second application, where the second application and the first application are both running on the anchor end;

Controlling, by the target object displayed in the second application, an action corresponding to the control information.
The method of claim 1 wherein:

The control information is information for controlling a moving direction;

The controlling the target object displayed in the second application to perform the action corresponding to the control information comprises: controlling the target object to move in a direction represented by the control information.
The method of claim 1, wherein the first application is a live application, the second application is a game application, and an image or video displayed in the second application is sent by the first application to A viewer connected to the anchor.
The method of claim 1, wherein before the obtaining the barrage information sent by the target user in the first application, the method comprises:

Receiving a selection operation acting on the anchor end;

Based on the selection operation, the target user is determined from a group of users connected to the anchor end.
The method of claim 1, wherein the obtaining the barrage information sent by the target user in the first application comprises:

Obtaining a barrage information group sent by a user group connected to the anchor end;

The barrage information sent by the target user is filtered from the barrage information group.
The method of claim 1, wherein the extracting control information from the barrage information according to a preset extraction rule comprises:

Extracting a keyword from the barrage information according to a preset keyword and corresponding information of the control information;

Determining the control information corresponding to the keyword according to the keyword and the corresponding information.
The method of claim 1, wherein the transmitting the control information to the second application comprises:

The control information is injected into the injection module by a named pipe preset in the first application, wherein the injection module is a module that is pre-written to inject the second application.
The method of claim 6 wherein said controlling said display in said second application The target object performs the action corresponding to the control information, including:

The control function is invoked by the injection module to control the target object to perform an action corresponding to the control information, wherein the control function is obtained by the injection module from a reverse analysis in the second application.
A cross-application control device, wherein the device is a main broadcast terminal, and includes:

An obtaining module, configured to acquire the barrage information sent by the target user in the first application;

An extraction module, configured to extract control information from the barrage information according to a preset extraction rule;

a sending module, configured to send the control information to a second application, where the second application and the first application are both running on the anchor end;

And a control module, configured to control, by the target object displayed in the second application, an action corresponding to the control information.
The apparatus according to claim 9, wherein said control information is information for controlling a moving direction; and said control module is further configured to: control said target object to move in a direction characterized by said control information.