CN114222147A - Live broadcast layout adjustment method and device, storage medium and computer equipment - Google Patents

Live broadcast layout adjustment method and device, storage medium and computer equipment Download PDF

Info

Publication number
CN114222147A
CN114222147A CN202111295771.4A CN202111295771A CN114222147A CN 114222147 A CN114222147 A CN 114222147A CN 202111295771 A CN202111295771 A CN 202111295771A CN 114222147 A CN114222147 A CN 114222147A
Authority
CN
China
Prior art keywords
service
information
target
layout
area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202111295771.4A
Other languages
Chinese (zh)
Other versions
CN114222147B (en
Inventor
曾家乐
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Cubesili Information Technology Co Ltd
Original Assignee
Guangzhou Cubesili Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Cubesili Information Technology Co Ltd filed Critical Guangzhou Cubesili Information Technology Co Ltd
Priority to CN202111295771.4A priority Critical patent/CN114222147B/en
Publication of CN114222147A publication Critical patent/CN114222147A/en
Application granted granted Critical
Publication of CN114222147B publication Critical patent/CN114222147B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/23412—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations

Abstract

The embodiment of the application discloses a live broadcast layout adjusting method and device, a storage medium and computer equipment. The method comprises the steps that video stream information and first operation service information sent by a client are received; analyzing the video stream information, and determining a first human body characteristic region corresponding to a main broadcast in the video stream information; acquiring a target service component corresponding to the first operation service information, and determining a first service occupation area corresponding to the target service component; when the intersection of the first service occupation area and the first human body feature area is larger than a first preset threshold value, acquiring a plurality of service layout information; and determining target service layout information with the minimum intersection between the first service occupation area and the first human body characteristic area from the plurality of service layout information, and returning the target service layout information to the client, so that the client changes the position of the first service occupation area, and the blocking of the anchor is prevented. Therefore, the live broadcast effect is greatly improved.

Description

Live broadcast layout adjustment method and device, storage medium and computer equipment
Technical Field
The application relates to the field of network live broadcast, in particular to a live broadcast layout adjusting method and device, a storage medium and computer equipment.
Background
With the development and popularization of the live broadcast industry, live broadcast watching becomes a daily entertainment mode of a plurality of users, and gift delivery in a live broadcast room is an important feedback means of the preference degree of the users to live broadcast contents as an important payment function of the live broadcast room. At this time, in order to satisfy the requirement that the user adopts different kinds of live broadcast gifts to express different degrees of liking to the live broadcast content, the live broadcast room can set up the live broadcast gifts of different kinds.
In the research and practice processes of the prior art, the inventor of the application finds that in the prior art, after the gift is given, the business components displaying the gift giving effect are fixed, and live content can be shielded in the live broadcasting process, so that the live broadcasting effect is poor.
Disclosure of Invention
The embodiment of the application provides a live broadcast layout adjusting method and device, a storage medium and computer equipment, which can improve the live broadcast effect.
In order to solve the above technical problem, the embodiments of the present application provide the following technical solutions:
a live broadcast layout adjustment method is applied to a live broadcast layout adjustment system, the live broadcast layout adjustment system comprises a server, an audience client and an anchor client, and the method comprises the following steps:
the server is used for receiving video stream information and first operation service information sent by the client; analyzing the video stream information, and determining a first human body characteristic region corresponding to a main broadcast in the video stream information; acquiring a target service component corresponding to the first operation service information, and determining a first service occupation area corresponding to the target service component; when the intersection of the first service occupation area and the first human body feature area is larger than a first preset threshold value, acquiring a plurality of service layout information, wherein each service layout information is provided with a first service occupation area in different positions corresponding to the target service component; determining target business layout information with the minimum intersection between a first business occupation area and the first human body feature area from a plurality of pieces of business layout information, and returning the target business layout information to a client so that the client replaces the position of the first business occupation area corresponding to the target business component;
the client is used for sending video stream information and first operation service information of a live broadcast room to the server, so that when the server detects that the intersection between a first human body feature area corresponding to a main broadcast in the video stream information and a first service occupation area of a target service assembly corresponding to the first operation service information is larger than a first preset threshold value, a target service layout with the minimum intersection with the first human body feature area is selected from the multiple pieces of service layout information; receiving the target business layout; and replacing the position of the first service occupying area of the target service assembly corresponding to the first running service information of the live broadcast room with the position of the first service occupying area of the target service assembly in the target service layout.
A live broadcast layout adjustment method includes:
receiving video stream information and first operation service information sent by a client;
analyzing the video stream information, and determining a first human body characteristic region corresponding to a main broadcast in the video stream information;
acquiring a target service component corresponding to the first operation service information, and determining a first service occupation area corresponding to the target service component;
when the intersection of the first service occupation area and the first human body feature area is larger than a first preset threshold value, acquiring a plurality of service layout information, wherein each service layout information is provided with a first service occupation area in different positions corresponding to the target service component;
and determining target business layout information with the minimum intersection between a first business occupation area and the first human body feature area from a plurality of pieces of business layout information, and returning the target business layout information to the client so that the client replaces the position of the first business occupation area corresponding to the target business component.
A live broadcast layout adjustment method includes:
sending video stream information and first operation service information of a live broadcast room to a server, so that when the server detects that the intersection between a first human body characteristic region corresponding to a main broadcast in the video stream information and a first service occupation region of a target service assembly corresponding to the first operation service information is larger than a first preset threshold value, selecting a target service layout with the minimum intersection with the first human body characteristic region from a plurality of service layout information for feedback;
receiving the target business layout;
and replacing the position of the first service occupying area of the target service assembly corresponding to the first running service information of the live broadcast room with the position of the first service occupying area of the target service assembly in the target service layout.
A live layout adjustment apparatus comprising:
the receiving unit is used for receiving video stream information and first operation service information sent by a client;
the analysis unit is used for analyzing the video stream information and determining a first human body characteristic region corresponding to a main broadcasting in the video stream information;
a first determining unit, configured to obtain a target service component corresponding to the first running service information, and determine a first service occupation area corresponding to the target service component;
an obtaining unit, configured to obtain multiple pieces of service layout information when an intersection of the first service occupation area and the first human body feature area is greater than a first preset threshold, where each piece of service layout information includes a first service occupation area in a different position corresponding to the target service component;
and the second determining unit is used for determining target business layout information with the minimum intersection between a first business occupation area and the first human body characteristic area from a plurality of pieces of business layout information and returning the target business layout information to the client so that the client replaces the position of the first business occupation area corresponding to the target business component.
In some embodiments, the second determining unit is configured to:
respectively determining an intersection between a first service occupation area corresponding to the target service component in each service layout information and the first human body area to obtain a plurality of intersections;
sequencing the plurality of intersections according to a sequence from small to large, and determining the service layout information with the minimum intersection as target service layout information;
and returning the target business layout information to the client so that the client replaces the position of the first business occupation area corresponding to the target business component.
In some embodiments, the method further comprises a generating unit for:
acquiring a plurality of target live broadcast rooms matched with the live broadcast rooms corresponding to the video stream information sent by the client;
and generating live broadcast suggestion information of the live broadcast rooms according to the live broadcast attribute information of the target live broadcast rooms.
A live layout adjustment apparatus comprising:
the system comprises a sending unit, a receiving unit and a feedback unit, wherein the sending unit is used for sending video stream information and first operation service information of a live broadcast room to a server so that when the server detects that the intersection between a first human body characteristic region corresponding to a main broadcast in the video stream information and a first service occupation region of a target service assembly corresponding to the first operation service information is larger than a first preset threshold value, a target service layout with the minimum intersection with the first human body characteristic region is selected from a plurality of service layout information for feedback;
a receiving unit, configured to receive the target service layout;
and the replacing unit is used for replacing the position of the first service occupying area of the target service assembly corresponding to the first running service information of the live broadcast room with the position of the first service occupying area of the target service assembly in the target service layout.
In some embodiments, the method further comprises a first adjusting unit for:
receiving first voice information and converting the voice information into first character information;
when the first text information meets a preset condition, extracting keyword information in the first text information;
determining a corresponding first target object according to the keyword information;
when detecting that the intersection of the first target object and the first service occupation area is larger than a second preset threshold, adjusting the position of the first service occupation area of the target service assembly, so that the intersection of the first service occupation area and the first target object is smaller than the second preset threshold.
In some embodiments, the method further comprises a scaling unit for:
when the intersection of the first target object and the first service occupation area is detected to be larger than a second preset threshold value, receiving second voice information, and converting the second voice information into second text information;
extracting keyword information and scaling ratio words in the second character information;
and carrying out corresponding zooming processing on the first target object corresponding to the keyword information according to the zooming proportion word.
In some embodiments, the method further comprises a second adjusting unit for:
receiving a target object selected by a user;
when the target object is a second target object, recording the size information of the second target object;
when it is detected that the intersection of the second target object and the first service occupation area is larger than a third preset threshold, acquiring a weighted value of a first service type corresponding to the first service occupation area;
adjusting the position of a first service occupation area of the target service component according to the weight value;
in some embodiments, the method further comprises an identifying unit configured to:
and when the fact that the shielding area of the second target object shielded by the third target object is larger than a fourth preset threshold value is detected, predicting the prediction area of the second target object according to the size information, and displaying the prediction area in an identification frame.
In some embodiments, the method further comprises a fixing unit for:
and when the target object is a business component, fixing the display position and the display size of the business component corresponding to the target object.
A computer storage medium, wherein the storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor to execute the steps of the live broadcast layout adjustment method.
A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, the processor implementing the steps in the live layout adjustment method provided above when executing the computer program.
A live layout adjustment system, the system comprising: a server, a spectator client and a anchor client;
the server comprises the live broadcast layout adjusting device;
the client comprises the live broadcast layout adjusting device.
A computer program product or computer program comprising computer instructions stored in a storage medium. The processor of the computer device reads the computer instructions from the storage medium, and executes the computer instructions, so that the computer device executes the steps in the live broadcast layout adjustment method provided above.
The method comprises the steps that video stream information and first operation service information sent by a client are received; analyzing the video stream information, and determining a first human body characteristic region corresponding to a main broadcast in the video stream information; acquiring a target service component corresponding to the first operation service information, and determining a first service occupation area corresponding to the target service component; when the intersection of the first service occupation area and the first human body feature area is larger than a first preset threshold value, acquiring a plurality of service layout information; and determining target service layout information with the minimum intersection between the first service occupation area and the first human body characteristic area from the plurality of service layout information, and returning the target service layout information to the client, so that the client changes the position of the first service occupation area, and the blocking of the anchor is prevented. Therefore, the live broadcast effect is greatly improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a scene schematic diagram of a live broadcast layout adjustment system provided in an embodiment of the present application;
fig. 2 is a schematic flowchart of a live broadcast layout adjustment method provided in an embodiment of the present application;
fig. 3 is a scene schematic diagram of a live broadcast layout adjustment method provided in an embodiment of the present application;
fig. 4 is a schematic flowchart of a live broadcast layout adjustment method provided in an embodiment of the present application;
fig. 5 is a schematic timing diagram of a live broadcast layout adjustment method according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a live broadcast layout adjusting apparatus according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of a live broadcast layout adjusting apparatus according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of a computer device provided in an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The embodiment of the application provides a live broadcast layout adjusting method and device, a storage medium and computer equipment.
Referring to fig. 1, fig. 1 is a schematic view of a scene of a live broadcast layout adjustment system according to an embodiment of the present application, including: the client A and the server B can be connected through a communication network, and the communication network comprises a wireless network and a wired network, wherein the wireless network comprises one or more of a wireless wide area network, a wireless local area network, a wireless metropolitan area network and a wireless personal network. The network includes network entities such as routers, gateways, etc., which are not shown in the figure. The client A can perform information interaction with the server B through a communication network.
The live broadcast layout adjustment system also comprises a server B, wherein the server B can be used for receiving video stream information and first operation service information sent by a client; analyzing the video stream information, and determining a first human body characteristic region corresponding to a main broadcast in the video stream information; acquiring a target service component corresponding to the first operation service information, and determining a first service occupation area corresponding to the target service component; when the intersection of the first service occupation area and the first human body feature area is larger than a first preset threshold value, acquiring a plurality of service layout information, wherein each service layout information is provided with a first service occupation area in different positions corresponding to the target service component; and determining target business layout information with the minimum intersection between the first business occupation area and the first human body characteristic area from the plurality of business layout information, and returning the target business layout information to the client A so that the client A replaces the position of the first business occupation area corresponding to the target business component.
The live broadcast layout adjusting system can comprise a live broadcast layout adjusting device, the live broadcast layout adjusting device can be particularly integrated in a terminal with computing capability, such as a tablet computer, a mobile phone, a notebook computer, a desktop computer and the like, which is provided with a storage unit and a microprocessor, the terminal may be equipped with a client, such as a live client or a game client, to mention, the live clients may include a main client and a viewer client, in fig. 1, the client a may be configured to send the video stream information and the first running service information of the live room to the server B, so that when the server B detects that the intersection between the first human body feature region corresponding to the anchor in the video stream information and the first service occupation region of the target service component corresponding to the first running service information is greater than the first preset threshold, selecting a target business layout with the minimum intersection with the first human body characteristic region from the plurality of business layout information; receiving the target business layout; and replacing the position of the first service occupying area of the target service assembly corresponding to the first running service information of the live broadcast room with the position of the first service occupying area of the target service assembly in the target service layout.
It should be noted that the scene diagram of the live broadcast layout adjustment system shown in fig. 1 is merely an example, and the live broadcast layout adjustment system and the scene described in the embodiment of the present application are for more clearly illustrating the technical solution of the embodiment of the present application, and do not form a limitation on the technical solution provided in the embodiment of the present application.
The following are detailed below.
In the present embodiment, a description will be made from the perspective of a live layout adjustment apparatus, which may be specifically integrated in a server.
Referring to fig. 2, fig. 2 is a schematic flow chart of a live broadcast layout adjustment method according to an embodiment of the present application. The live broadcast layout adjusting method comprises the following steps:
in step 101, video stream information and first running service information sent by a client are received.
The client can be a live broadcast client or a spectator client, the spectator client is a client for watching a main broadcast to perform, the main broadcast client records a client for the main broadcast to perform corresponding live broadcast video stream information, the main broadcast client can display a live broadcast room exclusive for the main broadcast, the main broadcast can check own performance through the live broadcast room exclusive for the main broadcast, moreover, the main broadcast can upload the video stream information recorded by the main broadcast client to a server in real time, the server can store the corresponding relation between the main broadcast client and the live broadcast rooms of all the main broadcasts, and when the spectator client selects any live broadcast room of the main broadcast to access, the server sends live broadcast video streams collected by the main broadcast client to all the spectator clients accessing the live broadcast room of the same main broadcast according to the corresponding relation, so that the live broadcast video streams are realized.
In the related live broadcast technology, for different live broadcast gifts, no matter a live broadcast room of a main broadcast or a live broadcast room watched by audiences, a corresponding service component is set to display the special effect of the corresponding type of the live broadcast gifts, each service component comprises a corresponding display size, the different types of the live broadcast gifts can correspond to different service components, an audience client can give the live broadcast gifts to a main broadcast user, after the live broadcast gifts are given, corresponding service information is triggered according to the types of the live broadcast gifts, the service information is the gift giving service corresponding to the specific types of the live broadcast gifts, each service information is associated with one service component, and the corresponding special effect is displayed on the corresponding service components in the live broadcast room of the main broadcast and the live broadcast room watched by the audiences according to the service information. However, since the position and size of the service component are fixed, the part of the anchor desired to be shown may be blocked during the live broadcast process, which seriously affects the live broadcast effect.
In order to solve the above problem, the server may receive video stream information and first operation service information uploaded by a main broadcast client or a viewer client, where the first operation service information is currently operating service information, that is, service information triggered by a currently presented live gift.
In step 102, the video stream information is analyzed to determine a first human body feature region corresponding to the anchor in the video stream information.
The video stream information is composed of video stream images of multiple frames, object analysis can be performed on the video stream images of each frame through an image recognition algorithm, a first human body feature area corresponding to a main broadcast in the video stream is recognized, in an actual live broadcast scene, in order to guarantee a live broadcast effect, the main broadcast needs to be preferentially displayed, for example, a human face and a trunk of the main broadcast are preferentially displayed, the human face and the trunk can become human body features, and the area containing the human body features is the first human body feature area.
In step 103, a target service component corresponding to the first running service information is obtained, and a first service occupation area corresponding to the target service component is determined.
Each service information is associated with a service component, so that a corresponding target service component can be determined according to the first operation service information, a special effect of a live gift of a corresponding type of the first operation service information needs to be played on the target service component subsequently, each target service component comprises corresponding size information and position information, the position information represents a display position of the target service component in a live broadcast room, the size information represents the size of the service component, and an area occupied by the target service component in the live broadcast room, namely the first service occupied area, can be determined according to the size information and the position information.
In a live broadcast scene, the position and the size of the target service component in each live broadcast room are fixed, for example, please refer to fig. 3 together, fig. 3 is a scene schematic diagram of the live broadcast layout adjustment method provided in the embodiment of the present application, a live broadcast picture of a main broadcast can be displayed in the live broadcast room 20, the first operation service information can correspond to the target service component 21, a special effect corresponding to a live broadcast gift "blue heart" can be played in the target service component 21, and the dotted line box represents a first service occupation area of the target service component 21 in the live broadcast room 20.
In step 104, when an intersection of the first service occupation area and the first human body feature area is greater than a first preset threshold, a plurality of service layout information is obtained, and each service layout information is provided with a first service occupation area in a different position corresponding to the target service component.
As shown in fig. 3, a special effect of a live broadcast gift of a corresponding type is played in a first service occupation area of the target service component 21, because the special effect may block a first human body feature area of the anchor, in order to avoid the effect of the live broadcast being affected by the special effect playing, a first preset threshold may be set, where the first preset threshold is a critical value defining whether blocking affects the live broadcast, and may be set to a size of half of size information of the first service occupation area, and when it is detected that an intersection of the first service occupation area and the first human body feature area is greater than the first preset threshold, it is indicated that the first service occupation area covers and affects performance of the anchor.
In order to solve the above problem, a developer may customize a plurality of service layout information in advance in a server, where the positions of the service components in each service layout information are different, that is, the first service occupying areas corresponding to the target service components in each service layout information are different, so that the embodiment of the present application may obtain the plurality of preset service layout information to prepare for changing the service layout to reduce occlusion.
And when the intersection of the first service occupation area and the first human body characteristic area is detected to be not larger than the first preset threshold, the fact that the coverage of the first service occupation area does not influence the performance of the main broadcast is indicated, and no adjustment can be performed.
In step 105, target business layout information with the minimum intersection between the first business occupation area and the first human body feature area is determined from the plurality of business layout information, and the target business layout information is returned to the client, so that the client replaces the position of the first business occupation area corresponding to the target business component.
In order to reduce the influence of the first service occupation area covering the first human body feature area on the live broadcasting as much as possible, intersection calculation can be performed on the first service occupation area set by each service layout information corresponding to the target service component and the first human body feature area, the service layout information with the smallest intersection between the first service occupation area and the first human body feature area, namely the service layout information with the smallest coverage area, is determined as the target layout information, and the target service layout information is returned to the corresponding anchor client or audience client, so that the anchor client or audience client performs re-layout according to the position of each service component in the target service component, namely the position of the first service occupation area of the target service component in the target service layout information replaces the position of the first service occupation area of the target service component in the original live broadcasting room of the client, the special effect played in the first service occupying area covers the human body characteristic area to the minimum, and the live broadcast effect is better reflected.
In some embodiments, the determining a target business layout information representation from the plurality of business layout information with a least intersection between the first business footprint and the first human body feature region includes:
(1) respectively determining the intersection between the first service occupation area corresponding to the target service assembly in each service layout information and the first human body area to obtain a plurality of intersections;
(2) and sequencing the intersections according to the sequence from small to large, and determining the service layout information with the minimum intersection as target service layout information.
The intersection formed between the first service occupation area corresponding to the target service component in each service layout information and the first human body area may be determined, where the intersection may be an overlapping area, and multiple intersections are obtained. And then, sequencing each intersection according to the size of the intersection according to the sequence from small to large, and determining the service layout information with the minimum intersection, namely the minimum overlapped area, as the target service layout information.
In some embodiments, the method further comprises:
(1.2) acquiring a plurality of target live broadcast rooms matched with the live broadcast rooms corresponding to the video stream information sent by the client;
and 2.2, generating live broadcasting suggestion information of the live broadcasting room according to the live broadcasting attribute information of the target live broadcasting rooms.
The server can also match a plurality of target live broadcast rooms similar to the live broadcast room of the client according to the coverage rate of a first human body characteristic area of the anchor and a first service occupation area of a target service component in the live broadcast room corresponding to the video stream information uploaded by the client in real time, record live broadcast attribute information of each target live broadcast room, wherein the live broadcast attribute information can be understood as adopted strategies corresponding to the coverage rate of the target live broadcast room, such as strategies of backward movement of the anchor, leftward movement of the anchor and the like, and is recorded as live broadcast attribute information, live broadcast suggestion information of the live broadcast is generated according to the live broadcast attribute information, and for example, the most live broadcast attribute information, namely the live broadcast attribute information of backward movement of the anchor, is generated into live broadcast suggestion information.
As can be seen from the above, in the embodiment of the present application, video stream information and first operation service information sent by a client are received; analyzing the video stream information, and determining a first human body characteristic region corresponding to a main broadcast in the video stream information; acquiring a target service component corresponding to the first operation service information, and determining a first service occupation area corresponding to the target service component; when the intersection of the first service occupation area and the first human body feature area is larger than a first preset threshold value, acquiring a plurality of service layout information; and determining target service layout information with the minimum intersection between the first service occupation area and the first human body characteristic area from the plurality of service layout information, and returning the target service layout information to the client, so that the client changes the position of the first service occupation area, and the blocking of the anchor is prevented. Therefore, the live broadcast effect is greatly improved.
In this embodiment, the live broadcast layout adjusting apparatus will be described from the perspective of a live broadcast layout adjusting apparatus, the live broadcast layout adjusting apparatus may be specifically integrated in a terminal having an arithmetic capability and provided with a storage unit and a microprocessor, such as a tablet computer and a mobile phone, and the terminal may open a live broadcast client.
Referring to fig. 4, fig. 4 is another schematic flow chart of a live broadcast layout adjustment method according to an embodiment of the present application. The method flow can comprise the following steps:
in step 201, the video stream information and the first running service information of the live broadcast room are sent to a server.
The audience client or the anchor client may send the video stream information played in the current live broadcast room and the first running service information triggered by the live broadcast gift and currently running to the server, so that the server executes the step of the previous embodiment, that is, when it is detected that an intersection between a first human body feature region corresponding to the anchor in the video stream information and a first service occupation region of a target service component corresponding to the first running service information is greater than a first preset threshold, a target service layout with the smallest intersection with the first human body feature region is selected from the multiple pieces of service layout information for feedback, which is not specifically described herein.
In step 202, a target business layout is received.
With reference to fig. 3, in the live broadcast room 20, since the intersection of the first service occupying area corresponding to the target service component 21 corresponding to the first service operation information and covering the first human body feature of the anchor is greater than the first preset threshold, the playing special effect of the target service component may cause the shielding of the anchor and affect the effect of the anchor, so that the target service layout fed back by the server may be received, and the intersection of the first service occupying area corresponding to the target service component and the current first human body feature area is the least.
In step 203, the position of the first service occupation area of the target service component corresponding to the first running service information of the live broadcast room is replaced with the position of the first service occupation area of the target service component in the target service layout.
For example, please refer to fig. 3 continuously, when the first service occupation area of the target service component in the target service layout is the upper left corner, the position of the current first service occupation area of the target service component 21 is replaced by the upper left corner for displaying, so that even if special-effect playing is performed in the replaced first service occupation area of the target service component, the anchor broadcast is not blocked, and the live broadcast effect is greatly improved.
In one embodiment, the method further comprises:
(1) receiving first voice information and converting the voice information into first character information;
(2) when the first character information accords with a preset condition, extracting keyword information in the first character information;
(3) determining a corresponding first target object according to the keyword information;
(4) when detecting that the intersection of the first target object and the first service occupation area is larger than a second preset threshold, adjusting the position of the first service occupation area of the target service assembly, so that the intersection of the first service occupation area and the first target object is smaller than the second preset threshold.
When the client is a main broadcast client, the main broadcast client can speak out first voice information so that a viewer can see an object which the viewer wants to show, such as a mobile phone or a blower and other commodities on hands, the main broadcast client can acquire the first voice information through a microphone and convert the voice information into first character information through a voice recognition technology, for example, "please note the mobile phone on hands", the preset condition is a preset grammar, for example, "please note XX" and "please see XX", when it is detected that characters in the first character information meet the preset grammar, keyword information in the first character information can be extracted, and the keyword information can be an object keyword, such as "mobile phone" or "blower" and the like.
Further, a first target object which the anchor wants to pay attention to by the audience is determined according to the keyword information, and an area occupied by the first target object can be cut out to perform position tracking processing. The second preset threshold is a critical value defining whether the occlusion of the first traffic occupied area affects the display of the first target object, and the second preset threshold may be half of the area occupied by the first target object. When it is detected that the intersection of the first target object and the first service occupation area is greater than a second preset threshold, i.e., indicating that the first service footprint coverage affects the presentation of the first target object, the position of the first service footprint of the target service component may be adjusted in real-time, for example, the target service component is moved a certain distance in any direction, so that the intersection of the first service occupation area of the moved target service component and the occlusion of the first target object occupation area is smaller than the second preset threshold, in an embodiment, the server may further select, from a plurality of service layout information, the service layout information with the least intersection between the first service occupation area and the first target object, and feed the service layout information back to the anchor client for service layout switching, and the shielding influence of the switched first service occupation area on the first target object is reduced to the minimum.
In some embodiments, after determining the corresponding first target object according to the keyword information, the method further includes:
(1.1) receiving second voice information and converting the second voice information into second text information when detecting that the intersection of the first target object and the first service occupation area is larger than a second preset threshold value;
(1.2) extracting keyword information and scaling words in the second character information;
and (1.3) carrying out corresponding scaling treatment on the first target object corresponding to the keyword information according to the scaling word.
When it is detected that the intersection of the first target object and the first service occupation area is greater than a second preset threshold, second voice information of the anchor may be received, and the second voice information is converted into second text information by a voice recognition technology, for example, "enlarge the mobile phone by 30 percent in proportion".
Further, keyword information 'mobile phone' and a zoom word such as '30% amplified' in the second text information are extracted, and the mobile phone 30% amplified displayed on the first target object anchor player corresponding to the keyword information 'mobile phone' is displayed according to the zoom word such as '30% amplified', so that after the first target object is amplified, the first target object can be better displayed, shielding is avoided, correspondingly, the audience client side can synchronize the effect after the zoom processing, and the live broadcast effect is better improved.
In one embodiment, the method further comprises:
(2.1) receiving a target object selected by a user;
(2.2) when the target object is a second target object, recording size information of the second target object;
(2.3) when detecting that the intersection of the second target object and the first service occupation area is larger than a third preset threshold, acquiring a weight value of a first service type corresponding to the first service occupation area;
(2.4) adjusting a position of a first service occupation area of the target service component according to the weight value;
and (2.5) when the fact that the shielding area of the second target object shielded by the third target object is larger than a fourth preset threshold value is detected, predicting the prediction area of the second target object according to the size information, and displaying the prediction area in an identification frame in an identification mode.
When the client is a viewer client, and a viewer watches live broadcast, the viewer can have live broadcast information which the viewer wants to pay attention to, and can receive a target object selected by the user, wherein the object can be a service component or an object displayed in a live broadcast room.
Further, when the target object is a second target object, which indicates that the second target object is an object that is continuously watched by the viewer, size information of the second target object may be recorded, the third predetermined threshold is a critical value that defines whether occlusion of the first service occupation area affects display of the second target object, and the third predetermined threshold may be half of an area occupied by the second target object. When it is detected that the intersection of the second target object and the first service occupation area is greater than a third preset threshold, that is, it is indicated that the coverage of the first service occupation area affects the display of the second target object, a weight value of the first service type of the target service component of the first service occupation area is obtained, the weight value may reflect the importance degree of a characteristic played in the target service component, the larger the weight value is, the larger the importance degree is, the smaller the importance degree is, the position of the first service occupation area of the target service component may be adjusted according to the weight value, for example, the larger the weight value is, the larger the coordinate value of the position adjustment is, so that the second target object is far away from the first service occupation area as possible, thereby avoiding mutual influence, and the smaller the weight value is, the smaller the coordinate value of the position adjustment is.
In an actual live broadcast scene, the second target object concerned by the audience user may also be other objects, which are hereinafter referred to as a third target object occlusion, the fourth preset threshold is a critical value defining whether the third target object occlusion affects the display of the second target object, and the fourth preset threshold may also be half of an area occupied by the second target object. When it is detected that the occlusion area of the second target object occluded by the third target object is greater than a fourth preset threshold, that is, it is said that the third target object covers and affects the display of the second target object, the prediction area after the second target object is occluded can be predicted according to the size information of the second target object, and the prediction area can be identified and displayed by the identification frame, which can be a rectangular frame or a dotted rectangular frame, so that even if the second target object is occluded, the user can still know the predicted position of the second target object.
In one embodiment, after receiving the target object selected by the user, the method further includes:
and when the target object is a business component, fixing the display position and the display size of the business component corresponding to the target object.
When the target object is a business component, it is indicated that the business component corresponding to the target object is a business component which the user continuously pays attention to, and the display position and the display size of the business component corresponding to the target object can be locked, so that the business component corresponding to the target object does not change when other business layouts are subsequently executed.
In one embodiment, the method further comprises:
(3.1) receiving a service set by a user, wherein the service set comprises at least one service component;
(3.2) adding a canvas layer for each business component in the business set, wherein the canvas layer is used for displaying the first human body characteristic area.
The client can display a service list corresponding to all service components in the current live broadcast room, receive the service components selected by a user, and generate a service set, wherein the service set can include one or more service components, and further a Canvas layer (Canvas) is added to each service component in the service set, and the Canvas layer can display a human body of a main broadcast, that is, a first human body characteristic region. Therefore, the transparent effect of business components which are not concerned by some users can be realized, and the live broadcast effect is further improved.
Referring to fig. 5, fig. 5 is a timing diagram illustrating a live broadcast layout adjustment method according to an embodiment of the present disclosure. The method flow can comprise the following steps:
in step S1, the client transmits the video stream information and the first operation service information to the server.
In step S2, the server receives the video stream information and the first operation service information sent by the client.
In step S3, the server analyzes the video stream information and determines a first human body feature region corresponding to the anchor in the video stream information.
In step S4, the server analyzes the video stream information and determines a first human body feature region corresponding to the anchor in the video stream information.
In step S5, when the server detects that the intersection of the first service occupation area and the first human body feature area is greater than a first preset threshold, a plurality of service layout information are obtained.
In step S6, the server obtains a plurality of pieces of service layout information when an intersection of the first service occupation area and the first human body feature area is greater than a first preset threshold.
In step S7, the server transmits the target service layout information to the client.
In step S8, the client replaces the position of the first service occupation area of the target service component corresponding to the first running service information of the live broadcast room with the position of the first service occupation area of the target service component in the target service layout.
In the above embodiments, reference may be made to the above detailed description of the live broadcast layout adjustment method, which is not described herein again.
In order to better implement the live broadcast layout adjustment method provided by the embodiment of the present application, an embodiment of the present application further provides a device based on the live broadcast layout adjustment method. The meaning of the noun is the same as that in the live broadcast layout adjustment method, and specific implementation details can refer to the description in the method embodiment.
Referring to fig. 6, fig. 6 is a schematic structural diagram of a live broadcast layout adjusting apparatus applied to a server according to an embodiment of the present application, where the live broadcast layout adjusting apparatus may include a receiving unit 301, an analyzing unit 302, a first determining unit 303, an obtaining unit 304, a second determining unit 305, and the like.
A receiving unit 301, configured to receive video stream information and first operating service information sent by a client.
An analyzing unit 302, configured to analyze the video stream information, and determine a first human body feature region corresponding to the anchor in the video stream information.
A first determining unit 303, configured to obtain a target service component corresponding to the first running service information, and determine a first service occupation area corresponding to the target service component.
An obtaining unit 304, configured to obtain multiple pieces of service layout information when an intersection of the first service occupation area and the first human body feature area is greater than a first preset threshold, where each piece of service layout information sets a first service occupation area in a different position corresponding to the target service component.
A second determining unit 305, configured to determine, from the plurality of service layout information, target service layout information with a minimum intersection between the first service occupation area and the first human body feature area, and return the target service layout information to the client, so that the client replaces a position of the first service occupation area corresponding to the target service component.
In some embodiments, the second determining unit 305 is configured to:
respectively determining the intersection between the first service occupation area corresponding to the target service assembly in each service layout information and the first human body area to obtain a plurality of intersections;
sequencing the plurality of intersections according to a sequence from small to large, and determining the service layout information with the minimum intersection as target service layout information;
and returning the target business layout information to the client so that the client replaces the position of the first business occupation area corresponding to the target business component.
In some embodiments, the method further comprises a generating unit for:
acquiring a plurality of target live broadcast rooms matched with the live broadcast rooms corresponding to the video stream information sent by the client;
and generating live broadcast suggestion information of the live broadcast room according to the live broadcast attribute information of the target live broadcast rooms.
Referring to fig. 7, fig. 7 is a schematic structural diagram of a live broadcast layout adjustment apparatus applied to a client according to an embodiment of the present application, where the live broadcast layout adjustment apparatus may include a sending unit 401, a receiving unit 402, a replacing unit 403, and the like.
The sending unit 301 is configured to send video stream information and first operation service information of a live broadcast to a server, so that when the server detects that an intersection between a first human body feature region corresponding to a main broadcast in the video stream information and a first service occupation region of a target service component corresponding to the first operation service information is greater than a first preset threshold, a target service layout with the smallest intersection with the first human body feature region is selected from multiple pieces of service layout information and fed back.
A receiving unit 302, configured to receive the target service layout.
A replacing unit 303, configured to replace a position of a first service occupation area of a target service component corresponding to the first running service information of the live broadcast room with a position of the first service occupation area of the target service component in the target service layout.
In some embodiments, the method further comprises a first adjusting unit for:
receiving first voice information and converting the voice information into first character information;
when the first character information accords with a preset condition, extracting keyword information in the first character information;
determining a corresponding first target object according to the keyword information;
when detecting that the intersection of the first target object and the first service occupation area is larger than a second preset threshold, adjusting the position of the first service occupation area of the target service assembly, so that the intersection of the first service occupation area and the first target object is smaller than the second preset threshold.
In some embodiments, the method further comprises a scaling unit for:
when detecting that the intersection of the first target object and the first service occupation area is larger than a second preset threshold value, receiving second voice information, and converting the second voice information into second text information;
extracting keyword information and scaling ratio words in the second character information;
and carrying out corresponding zooming processing on the first target object corresponding to the keyword information according to the zooming proportion word.
In some embodiments, the method further comprises a second adjusting unit for:
receiving a target object selected by a user;
when the target object is a second target object, recording the size information of the second target object;
when detecting that the intersection of the second target object and the first service occupation area is larger than a third preset threshold, acquiring a weight value of a first service type corresponding to the first service occupation area;
adjusting the position of a first service occupation area of the target service component according to the weight value;
in some embodiments, the method further comprises an identifying unit configured to:
and when detecting that the shielding area of the second target object shielded by the third target object is larger than a fourth preset threshold value, predicting the prediction area of the second target object according to the size information, and performing identification display on the prediction area by using an identification frame.
In some embodiments, the method further comprises a fixing unit for:
and when the target object is a business component, fixing the display position and the display size of the business component corresponding to the target object.
An embodiment of the present application further provides a computer device, where the computer device may be a terminal or a server, as shown in fig. 8, which shows a schematic structural diagram of a computer device according to an embodiment of the present invention, specifically:
the computer device may include components such as a processor 501 of one or more processing cores, memory 502 of one or more computer-readable storage media, a power supply 503, and an input unit 504. Those skilled in the art will appreciate that the computer device configuration illustrated in FIG. 8 does not constitute a limitation of computer devices, and may include more or fewer components than those illustrated, or some components may be combined, or a different arrangement of components. Wherein:
the processor 501 is a control center of the computer device, connects various parts of the entire computer device by using various interfaces and lines, and performs various functions of the computer device and processes data by running or executing software programs and/or modules stored in the memory 502 and calling data stored in the memory 502, thereby monitoring the computer device as a whole. Optionally, processor 501 may include one or more processing cores; preferably, the processor 501 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 501.
The memory 502 may be used to store software programs and modules, and the processor 501 executes various functional applications and data processing by operating the software programs and modules stored in the memory 502. The memory 502 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data created according to use of the computer device, and the like. Further, the memory 502 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. Accordingly, the memory 502 may also include a memory controller to provide the processor 501 with access to the memory 502.
The computer device further comprises a power supply 503 for supplying power to the various components, and preferably, the power supply 503 may be logically connected to the processor 501 through a power management system, so that functions of managing charging, discharging, power consumption, and the like are realized through the power management system. The power supply 503 may also include any component of one or more dc or ac power sources, recharging systems, power failure detection circuitry, power converters or inverters, power status indicators, and the like.
The computer device may also include an input unit 504, and the input unit 504 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.
Although not shown, the computer device may further include a display unit and the like, which are not described in detail herein. Specifically, in this embodiment, the processor 501 in the computer device loads the executable file corresponding to the process of one or more application programs into the memory 502 according to the following instructions, and the processor 501 runs the application programs stored in the memory 502, so as to implement various functions as follows:
receiving video stream information and first operation service information sent by a client;
analyzing the video stream information, and determining a first human body characteristic region corresponding to a main broadcast in the video stream information;
acquiring a target service component corresponding to the first operation service information, and determining a first service occupation area corresponding to the target service component;
when the intersection of the first service occupation area and the first human body feature area is larger than a first preset threshold value, acquiring a plurality of service layout information, wherein each service layout information is provided with a first service occupation area in different positions corresponding to the target service component;
and determining target business layout information with the minimum intersection between the first business occupation area and the first human body characteristic area from the plurality of business layout information, and returning the target business layout information to the client so that the client replaces the position of the first business occupation area corresponding to the target business component.
In the above embodiments, the descriptions of the embodiments have respective emphasis, and parts that are not described in detail in a certain embodiment may refer to the above detailed description of the live broadcast layout adjustment method, and are not described herein again.
It will be understood by those skilled in the art that all or part of the steps of the methods of the above embodiments may be performed by instructions or by associated hardware controlled by the instructions, which may be stored in a computer readable storage medium and loaded and executed by a processor.
To this end, the present application provides a computer storage medium, in which a plurality of instructions are stored, where the instructions can be loaded by a processor to execute the steps in any live broadcast layout adjustment method provided in the present application.
According to an aspect of the application, a computer program product or computer program is provided, comprising computer instructions, the computer instructions being stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions to cause the computer device to perform the method provided in the various alternative implementations provided by the embodiments described above.
The above operations can be implemented in the foregoing embodiments, and are not described in detail herein.
Wherein the computer storage medium may include: read Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, and the like.
Since the instructions stored in the computer storage medium may execute the steps in any live broadcast layout adjustment method provided in the embodiment of the present application, beneficial effects that can be achieved by any live broadcast layout adjustment method provided in the embodiment of the present application may be achieved, which are detailed in the foregoing embodiments and will not be described herein again.
The live broadcast layout adjustment method, the live broadcast layout adjustment device, the storage medium and the computer device provided by the embodiment of the present application are introduced in detail, a specific example is applied in the text to explain the principle and the implementation of the present application, and the description of the embodiment is only used to help understanding the method and the core idea of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (14)

1. A live broadcast layout adjustment method is applied to a live broadcast layout adjustment system, the live broadcast layout adjustment system comprises a server and a client, and the method comprises the following steps:
the server is used for receiving video stream information and first operation service information sent by the client; analyzing the video stream information, and determining a first human body characteristic region corresponding to a main broadcast in the video stream information; acquiring a target service component corresponding to the first operation service information, and determining a first service occupation area corresponding to the target service component; when the intersection of the first service occupation area and the first human body feature area is larger than a first preset threshold value, acquiring a plurality of service layout information, wherein each service layout information is provided with a first service occupation area in different positions corresponding to the target service component; determining target business layout information with the minimum intersection between a first business occupation area and the first human body feature area from a plurality of pieces of business layout information, and returning the target business layout information to a client so that the client replaces the position of the first business occupation area corresponding to the target business component;
the client is used for sending video stream information and first operation service information of a live broadcast room to the server, so that when the server detects that the intersection between a first human body feature area corresponding to a main broadcast in the video stream information and a first service occupation area of a target service assembly corresponding to the first operation service information is larger than a first preset threshold value, a target service layout with the minimum intersection with the first human body feature area is selected from the multiple pieces of service layout information; receiving the target business layout; and replacing the position of the first service occupying area of the target service assembly corresponding to the first running service information of the live broadcast room with the position of the first service occupying area of the target service assembly in the target service layout.
2. A live broadcast layout adjustment method is characterized by comprising the following steps:
receiving video stream information and first operation service information sent by a client;
analyzing the video stream information, and determining a first human body characteristic region corresponding to a main broadcast in the video stream information;
acquiring a target service component corresponding to the first operation service information, and determining a first service occupation area corresponding to the target service component;
when the intersection of the first service occupation area and the first human body feature area is larger than a first preset threshold value, acquiring a plurality of service layout information, wherein each service layout information is provided with a first service occupation area in different positions corresponding to the target service component;
and determining target business layout information with the minimum intersection between a first business occupation area and the first human body feature area from a plurality of pieces of business layout information, and returning the target business layout information to the client so that the client replaces the position of the first business occupation area corresponding to the target business component.
3. The live broadcast layout adjustment method of claim 2, wherein determining target service layout information with a minimum intersection between a first service occupation area and the first human body feature area from a plurality of service layout information comprises:
respectively determining an intersection between a first service occupation area corresponding to the target service component in each service layout information and the first human body area to obtain a plurality of intersections;
and sequencing the intersections according to the sequence from small to large, and determining the service layout information with the minimum intersection as target service layout information.
4. The live layout adjustment method according to claim 2, further comprising:
acquiring a plurality of target live broadcast rooms matched with the live broadcast rooms corresponding to the video stream information sent by the client;
and generating live broadcast suggestion information of the live broadcast rooms according to the live broadcast attribute information of the target live broadcast rooms.
5. A live broadcast layout adjustment method is characterized by comprising the following steps:
sending video stream information and first operation service information of a live broadcast room to a server, so that when the server detects that the intersection between a first human body characteristic region corresponding to a main broadcast in the video stream information and a first service occupation region of a target service assembly corresponding to the first operation service information is larger than a first preset threshold value, selecting a target service layout with the minimum intersection with the first human body characteristic region from a plurality of service layout information for feedback;
receiving the target business layout;
and replacing the position of the first service occupying area of the target service assembly corresponding to the first running service information of the live broadcast room with the position of the first service occupying area of the target service assembly in the target service layout.
6. The live layout adjustment method according to claim 5, further comprising:
receiving first voice information and converting the voice information into first character information;
when the first text information meets a preset condition, extracting keyword information in the first text information;
determining a corresponding first target object according to the keyword information;
when detecting that the intersection of the first target object and the first service occupation area is larger than a second preset threshold, adjusting the position of the first service occupation area of the target service assembly, so that the intersection of the first service occupation area and the first target object is smaller than the second preset threshold.
7. The live layout adjustment method according to claim 6, further comprising:
when the intersection of the first target object and the first service occupation area is detected to be larger than a second preset threshold value, receiving second voice information, and converting the second voice information into second text information;
extracting keyword information and scaling ratio words in the second character information;
and carrying out corresponding zooming processing on the first target object corresponding to the keyword information according to the zooming proportion word.
8. The live layout adjustment method according to claim 5, further comprising:
receiving a target object selected by a user;
when the target object is a second target object, recording the size information of the second target object;
when it is detected that the intersection of the second target object and the first service occupation area is larger than a third preset threshold, acquiring a weighted value of a first service type corresponding to the first service occupation area;
adjusting the position of a first service occupation area of the target service component according to the weight value;
and when the fact that the shielding area of the second target object shielded by the third target object is larger than a fourth preset threshold value is detected, predicting the prediction area of the second target object according to the size information, and displaying the prediction area in an identification frame.
9. The live layout adjustment method according to claim 8, further comprising:
and when the target object is a business component, fixing the display position and the display size of the business component corresponding to the target object.
10. The live layout adjustment method according to claim 5, further comprising:
receiving a service set by a user, wherein the service set comprises at least one service component;
and adding a canvas layer for each business component in the business set, wherein the canvas layer is used for displaying a first human body characteristic area.
11. A live layout adjustment apparatus, comprising:
the receiving unit is used for receiving video stream information and first operation service information sent by a client;
the analysis unit is used for analyzing the video stream information and determining a first human body characteristic region corresponding to a main broadcasting in the video stream information;
a first determining unit, configured to obtain a target service component corresponding to the first running service information, and determine a first service occupation area corresponding to the target service component;
an obtaining unit, configured to obtain multiple pieces of service layout information when an intersection of the first service occupation area and the first human body feature area is greater than a first preset threshold, where each piece of service layout information includes a first service occupation area in a different position corresponding to the target service component;
and the second determining unit is used for determining target business layout information with the minimum intersection between a first business occupation area and the first human body characteristic area from a plurality of pieces of business layout information and returning the target business layout information to the client so that the client replaces the position of the first business occupation area corresponding to the target business component.
12. A live layout adjustment apparatus, comprising:
the system comprises a sending unit, a receiving unit and a feedback unit, wherein the sending unit is used for sending video stream information and first operation service information of a live broadcast room to a server so that when the server detects that the intersection between a first human body characteristic region corresponding to a main broadcast in the video stream information and a first service occupation region of a target service assembly corresponding to the first operation service information is larger than a first preset threshold value, a target service layout with the minimum intersection with the first human body characteristic region is selected from a plurality of service layout information for feedback;
a receiving unit, configured to receive the target service layout;
and the replacing unit is used for replacing the position of the first service occupying area of the target service assembly corresponding to the first running service information of the live broadcast room with the position of the first service occupying area of the target service assembly in the target service layout.
13. A computer readable storage medium storing a plurality of instructions adapted to be loaded by a processor to perform the steps of the live layout adjustment method of any one of claims 1 to 10.
14. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, the processor implementing the steps in the live layout adjustment method of any one of claims 1 to 10 when executing the computer program.
CN202111295771.4A 2021-11-03 2021-11-03 Live broadcast layout adjustment method and device, storage medium and computer equipment Active CN114222147B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111295771.4A CN114222147B (en) 2021-11-03 2021-11-03 Live broadcast layout adjustment method and device, storage medium and computer equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111295771.4A CN114222147B (en) 2021-11-03 2021-11-03 Live broadcast layout adjustment method and device, storage medium and computer equipment

Publications (2)

Publication Number Publication Date
CN114222147A true CN114222147A (en) 2022-03-22
CN114222147B CN114222147B (en) 2023-10-03

Family

ID=80696480

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111295771.4A Active CN114222147B (en) 2021-11-03 2021-11-03 Live broadcast layout adjustment method and device, storage medium and computer equipment

Country Status (1)

Country Link
CN (1) CN114222147B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106375775A (en) * 2016-09-26 2017-02-01 广州华多网络科技有限公司 Virtual gift display method and apparatus
CN107347166A (en) * 2016-08-19 2017-11-14 北京市商汤科技开发有限公司 Processing method, device and the terminal device of video image
CN109286824A (en) * 2018-09-28 2019-01-29 武汉斗鱼网络科技有限公司 A kind of method, apparatus, equipment and the medium of the control of live streaming user side
CN110493630A (en) * 2019-09-11 2019-11-22 广州华多网络科技有限公司 The treating method and apparatus of virtual present special efficacy, live broadcast system
CN111385663A (en) * 2018-12-28 2020-07-07 广州市百果园信息技术有限公司 Live broadcast interaction method, device, equipment and storage medium
CN111669612A (en) * 2019-03-08 2020-09-15 腾讯科技（深圳）有限公司 Live broadcast-based information delivery method and device and computer-readable storage medium
KR102207712B1 (en) * 2019-09-19 2021-01-26 주식회사 엔씨소프트 Apparatus and method for providing broadcast information
CN112333459A (en) * 2020-10-30 2021-02-05 北京字跳网络技术有限公司 Video live broadcast method and device and computer storage medium

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107347166A (en) * 2016-08-19 2017-11-14 北京市商汤科技开发有限公司 Processing method, device and the terminal device of video image
CN106375775A (en) * 2016-09-26 2017-02-01 广州华多网络科技有限公司 Virtual gift display method and apparatus
CN112839249A (en) * 2016-09-26 2021-05-25 广州方硅信息技术有限公司 Virtual gift display method, device, equipment and storage medium
CN109286824A (en) * 2018-09-28 2019-01-29 武汉斗鱼网络科技有限公司 A kind of method, apparatus, equipment and the medium of the control of live streaming user side
CN111385663A (en) * 2018-12-28 2020-07-07 广州市百果园信息技术有限公司 Live broadcast interaction method, device, equipment and storage medium
CN111669612A (en) * 2019-03-08 2020-09-15 腾讯科技（深圳）有限公司 Live broadcast-based information delivery method and device and computer-readable storage medium
CN110493630A (en) * 2019-09-11 2019-11-22 广州华多网络科技有限公司 The treating method and apparatus of virtual present special efficacy, live broadcast system
KR102207712B1 (en) * 2019-09-19 2021-01-26 주식회사 엔씨소프트 Apparatus and method for providing broadcast information
CN112333459A (en) * 2020-10-30 2021-02-05 北京字跳网络技术有限公司 Video live broadcast method and device and computer storage medium

Also Published As

Publication number Publication date
CN114222147B (en) 2023-10-03

Similar Documents

Publication Publication Date Title
US10134364B2 (en) Prioritized display of visual content in computer presentations
CN109640188B (en) Video preview method and device, electronic equipment and computer readable storage medium
US10271105B2 (en) Method for playing video, client, and computer storage medium
US11563915B2 (en) Media content presentation
US11974013B2 (en) Modifying digital video content
CN105472437A (en) Video playing method and apparatus thereof
CN111405301B (en) Screen recording interaction method and device for terminal, computer equipment and storage medium
JP2014139681A (en) Method and device for adaptive video presentation
CN111629253A (en) Video processing method and device, computer readable storage medium and electronic equipment
CN109274999A (en) A kind of video playing control method, device, equipment and medium
JP2016046705A (en) Conference record editing apparatus, method and program for the same, conference record reproduction apparatus, and conference system
CN110913260B (en) Display control method, display control device and electronic equipment
CN112291615A (en) Audio output method and audio output device
CN113170076A (en) Dynamic curation of sequence events for a communication session
CN112989112B (en) Online classroom content acquisition method and device
CN114257824A (en) Live broadcast display method and device, storage medium and computer equipment
CN114143572A (en) Live broadcast interaction method and device, storage medium and electronic equipment
WO2024022473A1 (en) Method for sending comment in live-streaming room, method for receiving comment in live-streaming room, and related device
US20150163259A1 (en) Detecting active region in collaborative computing sessions using voice information
CN114222147B (en) Live broadcast layout adjustment method and device, storage medium and computer equipment
JP6602423B6 (en) Content providing server, content providing terminal, and content providing method
CN109640164A (en) A kind of playback method and device between multiple virtual reality devices
CN113891136A (en) Video playing method and device, electronic equipment and storage medium
US11682210B1 (en) Methods and device for video data analysis
JP2008090526A (en) Conference information storage device, system, conference information display device, and program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant