CN115065875B

CN115065875B - Character display control method and device of network live broadcast system

Info

Publication number: CN115065875B
Application number: CN202210972304.9A
Authority: CN
Inventors: 林土轩; 周辉; 金昊
Original assignee: Guangzhou Qianjun Network Technology Co ltd
Current assignee: Guangzhou Qianjun Network Technology Co ltd
Priority date: 2022-08-15
Filing date: 2022-08-15
Publication date: 2023-01-03
Anticipated expiration: 2042-08-15
Also published as: CN115065875A

Abstract

The application discloses a text display control method and a text display control device of a network live broadcast system, which are applied to a main broadcast end of the network live broadcast system, and particularly search a process ID of a player on an operation platform of the main broadcast end when the player of the main broadcast end starts to operate; opening the access authority of the player according to the process ID; monitoring a layered window of the player during the running of the player; when the content of the layered window is monitored to be updated, acquiring the lyric content of the layered window; and adding the lyric content into the live stream so that the lyric content is pushed to the audience. Therefore, the audience can watch the lyrics through the audience, thereby improving the live broadcast effect.

Description

Character display control method and device of network live broadcast system

Technical Field

The present application relates to the field of live webcast technologies, and in particular, to a text display control method and apparatus for a live webcast system.

Background

Currently, when many anchor broadcasters directly broadcast on the internet, songs are played as background music through corresponding players, so as to show talent or provide music atmosphere for other talent performances to audiences. However, at present, the client of the audience in the live broadcasting system cannot display the lyrics displayed by the player, so that only the anchor sees the lyrics and the audience cannot see the lyrics, thereby causing poor live broadcasting experience of the audience.

Disclosure of Invention

In view of this, the present application provides a method and an apparatus for controlling text display in a live webcast system, which are used to display the lyrics of a song played by a player at a client of a viewer, so as to improve the live webcast effect.

In order to achieve the above object, the following solutions are proposed:

a text display control method of a network live broadcast system is applied to an anchor terminal of the network live broadcast system, and comprises the following steps:

when a player of the anchor terminal starts to run, searching a process ID of the player on a running platform of the anchor terminal;

opening the access authority of the player according to the process ID;

monitoring a layered window of the player during the operation of the player;

when monitoring that the content of the layered window is updated, acquiring the lyric content of the layered window;

and adding the lyric content into a live stream so as to push the lyric content to a spectator end.

Optionally, the method further comprises the steps of:

before, after or at the same time of opening the access authority of the player, creating a shared memory block bound with the process ID, and setting a mutex for the shared memory block.

Optionally, the obtaining the lyric content of the layered window when it is monitored that the content in the layered window is updated includes the steps of:

acquiring the window content of the layered window;

screening the window content to obtain the lyric content;

on the basis of obtaining the control right of the shared memory block, the lyric content is put into the shared memory block, and the control right is released after the lyric content is put into the shared memory block.

Optionally, the window content includes a handle, device context, and/or resolution of the hierarchical window.

Optionally, the adding the lyric content to a live stream to enable the lyric content to be pushed to a viewer side includes:

acquiring the control right of the shared memory block;

reading the lyric content, and releasing the control right after the reading is finished;

adding the lyric content to the live stream.

A character display control device of a network live broadcast system is applied to an anchor terminal of the network live broadcast system, and comprises:

the process searching module is configured to search a process ID of a player on a running platform of the anchor when the player of the anchor starts running;

the permission opening module is configured to open the access permission of the player according to the process ID;

a window monitoring module configured to monitor a layered window of the player during operation of the player;

the lyric obtaining module is configured to obtain the lyric content of the layered window when the content of the layered window is monitored to be updated;

and the lyric pushing module is configured to add the lyric content into a live stream so as to push the lyric content to a viewer side.

Optionally, the method further includes:

and the memory creating module is configured to create a shared memory block bound with the process ID before, after or while the access right of the player is opened, and set a mutex for the shared memory block.

Optionally, the window monitoring module includes:

a content acquisition unit configured to acquire window content of the layered window;

the content screening unit is configured to screen the window content to obtain the lyric content;

and the content dump unit is configured to put the lyric content into the shared memory block on the basis of acquiring the control right of the shared memory block, and release the control right after putting the lyric content into the shared memory block.

Optionally, the lyric pushing module includes:

a control right acquiring unit configured to acquire a control right of the shared memory block;

the content reading unit is configured to read the lyric content and release the control right after the reading is finished;

a push execution unit configured to add the lyric content to the live stream.

The method and the device are applied to a main broadcasting end of the network live broadcasting system, and particularly search a process ID of a player on an operation platform of the main broadcasting end when the player of the main broadcasting end starts to operate; opening the access authority of the player according to the process ID; monitoring a layered window of the player during the running of the player; when the content of the layered window is monitored to be updated, acquiring the lyric content of the layered window; and adding the lyric content into the live stream so that the lyric content is pushed to the audience. Therefore, the audience can watch the lyrics through the audience, thereby improving the live broadcasting effect.

In addition, the scheme has good real-time performance, can quickly capture the desktop lyric window at multiple frame rates, and improves the live broadcasting use experience; and only the desktop lyric window is captured, so that the CPU consumption is reduced; in addition, the scheme has strong usability, and can be realized by directly using a simple tool such as a DLL without an additional processing program.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a flowchart of a text display control method of a live webcast system according to an embodiment of the present application;

fig. 2 is a block diagram of a text display control device of a live webcast system according to an embodiment of the present application;

fig. 3 is a block diagram of a text display control device of another webcast system according to an embodiment of the present disclosure;

fig. 4 is a block diagram of a text display control device of another webcast system according to an embodiment of the present disclosure;

fig. 5 is a block diagram of a text display control device of another webcast system according to an embodiment of the present disclosure;

fig. 6 is a block diagram of an electronic device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be described clearly and completely with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only some embodiments of the present application, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

Example one

Fig. 1 is a flowchart of a text display control method of a live webcast system according to an embodiment of the present application.

As shown in fig. 1, the text display control method provided in this embodiment is applied to a live webcast system, the live webcast system is built based on an operating platform of a certain electronic device, a Windows platform is taken as an example in this embodiment, the live webcast system includes a main broadcasting end and a viewer end based on the Windows platform, and the text display control method specifically includes the following steps:

s1, searching the process ID of the player.

That is, the corresponding player starts to run based on the anchor or the Windows platform running the anchor, and searches for the process ID of the player on the Windows platform. The player is playing software for playing various multimedia audios and videos, such as cool dog music, QQ music, baidu cloud music and the like.

And S2, opening the access authority of the player according to the process ID.

After the process ID of the player is determined, deep operation is performed based on the process ID to open the access right of the player, which includes, but is not limited to, obtaining input data, output data and running data of the player during running. Specifically, the process can be opened by using a windows api function such as OpenProcess.

In addition, before, after, or at the same time as the operation in this step, at least one shared memory block bound to the process ID is created, and no mutex is set for the shared memory block, so that different processes can access data therein without mutual interference. The shared memory block refers to the same memory space which can be accessed by a plurality of processes in sequence, and is the fastest available IPC form.

The shared memory chunks created here should be given custom names, and the mutex should also be given custom names, in order to ensure that all the neighbors are accessing the same shared memory chunk and mutex.

And S3, monitoring the layered window of the player.

I.e. during the operation of the player, the player's layered window, in particular the change of the window content of the layered window, is monitored on the basis that the access rights of the player are opened. The layered window is a window which can be automatically synthesized with an inactive window under windows.

Monitoring a layered window UpdateLayeredWindow of the player by using a HOOK (HOOK), updating an API function address, and registering a callback function; the callback function can automatically call back to inform a user when the layered window is updated, and the user can obtain the window data from the window.

HOOK (HOOK) is a platform for windows message handling mechanisms on which an application can set a subroutine to monitor certain messages for a given window, and the monitored window can be created by other processes. When a message arrives, it is processed before the target window processing function.

And S4, acquiring the lyric content in the layered window.

When the window content of the layered window is monitored to change, lyric content is obtained from the layered window, wherein the lyric content refers to a picture bearing lyric characters. The specific scheme is as follows:

first, when the window content of the layered window is monitored to change, the window content of the layered window is obtained, and the window content includes, but is not limited to, the handle, the device context, and/or the resolution of the layered window.

And then, screening the contents of the windows, and screening the lyric windows to obtain the corresponding lyric contents.

And finally, acquiring the control right of the shared memory block, storing the corresponding lyric content into the shared memory block on the basis, giving up the control right in time after the lyric content is put into the shared memory block, and informing other applications that the content in the memory block is updated.

The operations can be integrated in a DLL, and the DLL is implanted into a Windows platform after the development is finished, so that the scheme can be realized in response to the operation of a user. Generally, the webcast system further includes a live helper, and the subsequent content may be implemented based on the live helper or directly based on the Windows platform.

And S5, adding the lyric content into the live stream.

After new lyric content is put into the shared memory block, the lyric content is automatically acquired based on the notification information, and is added into the live stream, so that the lyric content can be displayed after the audience receives the live stream. Specifically, the operation content of joining the live stream is as follows:

first, the control right of the shared memory block is obtained.

Then, the new lyric content in the shared memory block is read, and the control right is released after the reading is completed.

And finally, adding the lyric content in the picture format into the live stream.

It can be seen from the above technical solutions that the present embodiment provides a text display control method for a live webcast system, which is applied to an anchor terminal of the live webcast system, and specifically, when a player of the anchor terminal starts to run, a process ID of the player on a running platform of the anchor terminal is searched; opening the access authority of the player according to the process ID; monitoring a layered window of the player during the running of the player; when the content of the layered window is monitored to be updated, acquiring the lyric content of the layered window; and adding the lyric content into the live stream so that the lyric content is pushed to the audience. Therefore, the audience can watch the lyrics through the audience, thereby improving the live broadcast effect.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

Although the operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous.

It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order, and/or performed in parallel. Moreover, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.

Computer program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including but not limited to an object oriented programming language such as Java, smalltalk, C + +, and conventional procedural programming languages, such as the C language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer.

Example two

Fig. 2 is a block diagram of a text display control device of a live webcast system according to an embodiment of the present application.

As shown in fig. 2, the text display control device provided in this embodiment is applied to a network live broadcast system, the network live broadcast system is built based on an operating platform of a certain electronic platform, a Windows platform is taken as an example in this embodiment, the network live broadcast system includes a main broadcast end and a viewer end based on the Windows platform, and the text display control device specifically includes a process search module 10, an authority opening module 20, a window monitoring module 30, a lyric obtaining module 40, and a lyric pushing module 50.

The short-range searching module is used for searching the process ID of the player.

And the permission opening module is used for opening the access permission of the player according to the process ID.

After the process ID of the player is determined, deep operation is performed based on the process ID to open the access right of the player, including but not limited to obtaining data input, data output and operation data during the operation of the player. Specifically, the process can be opened by using a windows api function such as OpenProcess.

In addition, the present embodiment further includes a memory creating module 60, as shown in fig. 3, before, after, or at the same time as the permission opening module opens the access permission of the player, creating at least one shared memory block bound to the process ID, where no mutex is set in the shared memory block, so as to facilitate different processes to access data therein without mutual interference. The shared memory block refers to the same memory space which can be accessed by a plurality of processes in sequence, and is the fastest available IPC form.

The window monitoring module is used for monitoring the layered window of the player.

The lyric obtaining module is used for obtaining the lyric content in the layered window.

That is, when the window content of the layered window is monitored to change, the lyric content is obtained from the layered window, wherein the lyric content refers to a picture bearing lyric characters. The module includes a content acquisition unit 41, a content filtering unit 42, and a content dump unit 43, as shown in fig. 4.

The content acquiring unit is used for acquiring the window content of the layered window when monitoring that the window content of the layered window changes, wherein the window content comprises but is not limited to a handle, a device context and/or a resolution of the layered window.

The content screening unit is used for screening the window content and screening the lyric window to obtain corresponding lyric content.

The content dump unit is used for acquiring the control right of the shared memory block, storing the corresponding lyric content into the shared memory block on the basis, abandoning the control right in time after the lyric content is put into the shared memory block, and informing other applications that the content in the memory block is updated.

The functional modules can be integrated in a DLL, and the DLL is implanted into a Windows platform after development is completed, so that the scheme can be realized in response to the operation of a user. Generally speaking, the webcast system further includes a live assistant end, and the subsequent modules may be implemented based on the live assistant end or directly based on the Windows platform.

The lyric pushing module is used for adding the lyric content into the live stream.

After new lyric content is put into the shared memory block, the lyric content is automatically acquired based on the notification information, and is added into the live stream, so that the lyric content can be displayed after the audience receives the live stream. Specifically, the module specifically includes a control right acquisition unit 51, a content reading unit 52, and a push execution unit 53, as shown in fig. 5.

The control right acquiring unit is used for acquiring the control right of the shared memory block.

The content reading unit is used for reading new lyric content in the shared memory block and releasing the control right after the reading is completed.

The push execution unit is used for adding the lyric content in the picture format into the live stream.

It can be seen from the foregoing technical solutions that, the present embodiment provides a text display control device for a live webcast system, which is applied to an anchor terminal of the live webcast system, and specifically, when a player of the anchor terminal starts to run, a process ID of the player on a running platform of the anchor terminal is searched; opening the access authority of the player according to the process ID; monitoring a layered window of the player during the running of the player; when the content of the layered window is monitored to be updated, acquiring the lyric content of the layered window; and adding the lyric content into the live stream so that the lyric content is pushed to the audience. Therefore, the audience can watch the lyrics through the audience, thereby improving the live broadcast effect.

In addition, the scheme has good real-time performance, can quickly capture the desktop lyric window at multiple frame rates, and improves the live broadcasting use experience; only a desktop lyric window is captured, so that the CPU loss is reduced; in addition, the scheme has strong usability, and can be realized by directly using a simple tool such as a DLL without an additional processing program.

The units described in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of a unit does not in some cases constitute a limitation of the unit itself, for example, the first retrieving unit may also be described as a "unit for retrieving at least two internet protocol addresses".

The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems on a chip (SOCs), complex Programmable Logic Devices (CPLDs), and the like.

EXAMPLE III

The present embodiments provide a block diagram of an electronic device.

As shown in fig. 6, a schematic diagram of an electronic device suitable for implementing the embodiments of the present disclosure is shown. The terminal device in the embodiments of the present disclosure may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle terminal (e.g., a car navigation terminal), and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 6 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.

As shown in fig. 6, the electronic device may include a processing means (e.g., a central processing unit, a graphics processor, etc.) 601, which may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 602 or a program loaded from a storage means 608 into a Random Access Memory (RAM) 603. In the RAM 603, various programs and data necessary for the operation of the electronic apparatus are also stored. The processing device 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input/output (I/O) interface 605 is also connected to bus 604.

Generally, the following devices may be connected to the I/O interface 605: input devices 606 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 607 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 608 including, for example, tape, hard disk, etc.; and a communication device 609. The communication means 609 may allow the electronic device to communicate with other devices wirelessly or by wire to exchange data. While fig. 6 illustrates an electronic device having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may be alternatively implemented or provided.

Example four

The present embodiment provides a computer-readable storage medium.

The computer readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device is enabled to implement the text display control method of the live webcast system in the first embodiment. The method specifically comprises the steps that when a player of a main broadcasting end starts to run, a process ID of the player on a running platform of the main broadcasting end is searched; opening the access authority of the player according to the process ID; monitoring a layered window of the player during the running of the player; when the content of the layered window is monitored to be updated, acquiring the lyric content of the layered window; and adding the lyric content into the live stream so that the lyric content is pushed to the audience. Therefore, the audience can watch the lyrics through the audience, thereby improving the live broadcast effect.

It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.

The embodiments in the present specification are all described in a progressive manner, and each embodiment focuses on differences from other embodiments, and portions that are the same and similar between the embodiments may be referred to each other.

While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including the preferred embodiment and all changes and modifications that fall within the true scope of the embodiments of the present invention.

Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising a … …" does not exclude the presence of another identical element in a process, method, article, or terminal apparatus that comprises the element.

The technical solutions provided by the present invention are described in detail above, and the principle and the implementation of the present invention are explained in this document by applying specific examples, and the descriptions of the above examples are only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A text display control method of a network live broadcast system is applied to an anchor terminal of the network live broadcast system, and is characterized by comprising the following steps:

opening the access authority of the player according to the process ID;

monitoring for changes in window content of a layered window of the player during operation of the player;

when the content of the layered window is monitored to be updated, acquiring the lyric content of the layered window;

2. The text display control method according to claim 1, further comprising the steps of:

3. The method for controlling display of words according to claim 2, wherein said obtaining the lyrics content of said layered window when it is monitored that there is an update of the content of said layered window comprises the steps of:

acquiring the window content of the layered window;

screening the window content to obtain the lyric content;

4. The text display control method of claim 3, wherein the window content comprises a handle, a device context, and/or a resolution of the hierarchical window.

5. The text display control method of claim 2, wherein the adding the lyric content to a live stream to enable the lyric content to be pushed to a viewer side comprises the steps of:

acquiring the control right of the shared memory block;

adding the lyric content to the live stream.

6. A character display control device of a network live broadcast system is applied to an anchor terminal of the network live broadcast system, and is characterized by comprising:

a window monitoring module configured to monitor changes in window content of a layered window of the player during operation of the player;

7. The character display control apparatus of claim 6, further comprising:

8. The text display control device of claim 7, wherein the window monitoring module comprises:

9. The text display control apparatus of claim 8, wherein the window content comprises a handle, a device context, and/or a resolution of the hierarchical window.

10. The text display control device of claim 7, wherein the lyric pushing module comprises:

a push execution unit configured to add the lyric content to the live stream.