CN114222147B - Live broadcast layout adjustment method and device, storage medium and computer equipment - Google Patents

Live broadcast layout adjustment method and device, storage medium and computer equipment Download PDF

Info

Publication number
CN114222147B
CN114222147B CN202111295771.4A CN202111295771A CN114222147B CN 114222147 B CN114222147 B CN 114222147B CN 202111295771 A CN202111295771 A CN 202111295771A CN 114222147 B CN114222147 B CN 114222147B
Authority
CN
China
Prior art keywords
service
information
layout
target
occupation area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111295771.4A
Other languages
Chinese (zh)
Other versions
CN114222147A (en
Inventor
曾家乐
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Cubesili Information Technology Co Ltd
Original Assignee
Guangzhou Cubesili Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Cubesili Information Technology Co Ltd filed Critical Guangzhou Cubesili Information Technology Co Ltd
Priority to CN202111295771.4A priority Critical patent/CN114222147B/en
Publication of CN114222147A publication Critical patent/CN114222147A/en
Application granted granted Critical
Publication of CN114222147B publication Critical patent/CN114222147B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23412—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The embodiment of the application discloses a live broadcast layout adjustment method, a live broadcast layout adjustment device, a storage medium and computer equipment. The embodiment of the application receives the video stream information and the first operation service information sent by the client; analyzing the video stream information and determining a first human feature area corresponding to the anchor in the video stream information; acquiring a target service component corresponding to the first operation service information, and determining a first service occupation area corresponding to the target service component; when the intersection of the first service occupation area and the first human feature area is larger than a first preset threshold value, acquiring a plurality of service layout information; and determining target service layout information with the minimum intersection between the first service occupation area and the first human body characteristic area from the service layout information, and returning the target service layout information to the client side, so that the client side changes the position of the first service occupation area and prevents the blocking of the anchor. Therefore, the live broadcast effect is greatly improved.

Description

Live broadcast layout adjustment method and device, storage medium and computer equipment
Technical Field
The application relates to the field of network live broadcast, in particular to a live broadcast layout adjustment method, a live broadcast layout adjustment device, a storage medium and computer equipment.
Background
With the development and popularization of the live broadcast industry, watching live broadcast becomes a daily entertainment mode of a plurality of users, and gift sending in a live broadcast room serves as an important payment function of the live broadcast room, so that the live broadcast system is an important feedback means of the preference degree of the users for live broadcast contents. At this time, in order to satisfy the requirement that the user adopts different kinds of live gifts to express different loving degrees to the live contents, the live broadcast room can set up different kinds of live gifts.
In the research and practice process of the prior art, the inventor of the present application finds that in the prior art, after gift giving, service components for displaying gift giving effects are all fixed, and in the live broadcast process, live broadcast contents may be blocked, so that the live broadcast effect is poor.
Disclosure of Invention
The embodiment of the application provides a live broadcast layout adjustment method, a live broadcast layout adjustment device, a storage medium and computer equipment, which can improve live broadcast effect.
In order to solve the above technical problems, the embodiments of the present application provide the following technical solutions:
a live broadcast layout adjustment method applied to a live broadcast layout adjustment system, the live broadcast layout adjustment system comprising a server, a viewer client and a host client, the method comprising:
The server is used for receiving video stream information and first operation service information sent by the client; analyzing the video stream information and determining a first human body characteristic region corresponding to a host in the video stream information; acquiring a target service component corresponding to the first operation service information, and determining a first service occupation area corresponding to the target service component; when the intersection of the first service occupation area and the first human body characteristic area is larger than a first preset threshold value, acquiring a plurality of service layout information, wherein each service layout information is provided with a first service occupation area at different positions corresponding to the target service component; determining target service layout information with the minimum intersection between a first service occupation area and the first human body characteristic area from a plurality of service layout information, and returning the target service layout information to a client so that the client replaces the position of the first service occupation area corresponding to the target service component;
the client is used for sending video stream information and first operation business information of a live broadcasting room to the server, so that when the server detects that the intersection between a first human body characteristic region corresponding to a host in the video stream information and a first business occupation region of a target business component corresponding to the first operation business information is larger than a first preset threshold, a target business layout with the least intersection with the first human body characteristic region is selected from a plurality of business layout information; receiving the target service layout; and replacing the position of the first service occupation area of the target service component corresponding to the first operation service information of the live broadcasting room with the position of the first service occupation area of the target service component in the target service layout.
A live layout adjustment method, comprising:
receiving video stream information and first operation service information sent by a client;
analyzing the video stream information and determining a first human body characteristic region corresponding to a host in the video stream information;
acquiring a target service component corresponding to the first operation service information, and determining a first service occupation area corresponding to the target service component;
when the intersection of the first service occupation area and the first human body characteristic area is larger than a first preset threshold value, acquiring a plurality of service layout information, wherein each service layout information is provided with a first service occupation area at different positions corresponding to the target service component;
and determining target service layout information with the minimum intersection between the first service occupation area and the first human body characteristic area from the service layout information, and returning the target service layout information to the client so that the client replaces the position of the first service occupation area corresponding to the target service component.
A live layout adjustment method, comprising:
transmitting video stream information and first operation service information of a live broadcasting room to a server, so that when the server detects that the intersection between a first human body characteristic region corresponding to a host in the video stream information and a first service occupation region of a target service component corresponding to the first operation service information is larger than a first preset threshold, selecting a target service layout with the minimum intersection with the first human body characteristic region from a plurality of service layout information to feed back;
Receiving the target service layout;
and replacing the position of the first service occupation area of the target service component corresponding to the first operation service information of the live broadcasting room with the position of the first service occupation area of the target service component in the target service layout.
A live layout adjustment apparatus, comprising:
the receiving unit is used for receiving the video stream information and the first operation service information sent by the client;
the analysis unit is used for analyzing the video stream information and determining a first human body characteristic area corresponding to the anchor in the video stream information;
the first determining unit is used for acquiring a target service component corresponding to the first operation service information and determining a first service occupation area corresponding to the target service component;
the acquiring unit is used for acquiring a plurality of service layout information when the intersection of the first service occupation area and the first human body characteristic area is larger than a first preset threshold value, wherein the first service occupation area at different positions is set corresponding to the target service component in each service layout information;
and the second determining unit is used for determining target service layout information with the minimum intersection between the first service occupation area and the first human body characteristic area from the plurality of service layout information, and returning the target service layout information to the client so that the client replaces the position of the first service occupation area corresponding to the target service component.
In some embodiments, the second determining unit is configured to:
respectively determining intersections between a first service occupation area corresponding to the target service component and the first human body area in each service layout information to obtain a plurality of intersections;
sequencing the intersections according to the sequence from small to large, and determining the service layout information with the smallest intersection as target service layout information;
and returning the target service layout information to the client so that the client replaces the position of the first service occupation area corresponding to the target service component.
In some embodiments, the method further comprises a generating unit for:
acquiring a plurality of target live rooms matched with the live rooms corresponding to the video stream information sent by the client;
and generating live broadcast proposal information of the live broadcast room according to the live broadcast attribute information of the multiple target live broadcast rooms.
A live layout adjustment apparatus, comprising:
the transmitting unit is used for transmitting the video stream information and the first operation service information of the live broadcasting room to the server, so that when the server detects that the intersection between the first human body characteristic region corresponding to the anchor in the video stream information and the first service occupation region of the target service component corresponding to the first operation service information is larger than a first preset threshold value, the target service layout with the minimum intersection with the first human body characteristic region is selected from the service layout information to feed back;
A receiving unit, configured to receive the target service layout;
and the replacing unit is used for replacing the position of the first service occupation area of the target service component corresponding to the first operation service information of the live broadcasting room with the position of the first service occupation area of the target service component in the target service layout.
In some embodiments, the method further comprises a first adjustment unit for:
receiving first voice information and converting the voice information into first text information;
when the first text information accords with a preset condition, extracting keyword information in the first text information;
determining a corresponding first target object according to the keyword information;
and when the intersection of the first target object and the first service occupation area is detected to be larger than a second preset threshold value, adjusting the position of the first service occupation area of the target service assembly so that the intersection of the first service occupation area and the first target object is smaller than the second preset threshold value.
In some embodiments, the method further comprises a scaling unit for:
when the intersection of the first target object and the first service occupation area is detected to be larger than a second preset threshold value, receiving second voice information, and converting the second voice information into second text information;
Extracting keyword information and scaling proportion words in the second text information;
and carrying out corresponding scaling treatment on the first target object corresponding to the keyword information according to the scaling proportion word.
In some embodiments, the method further comprises a second adjustment unit for:
receiving a target object selected by a user;
when the target object is a second target object, recording the size information of the second target object;
when the intersection of the second target object and the first service occupation area is detected to be larger than a third preset threshold value, acquiring a weight value of a first service type corresponding to the first service occupation area;
adjusting the position of the first service occupation area of the target service component according to the weight value;
in some embodiments, the method further comprises an identification unit for:
when the fact that the shielding area of the second target object, which is shielded by the third target object, is larger than a fourth preset threshold value is detected, a prediction area of the second target object is predicted according to the size information, and the prediction area is marked and displayed through an identification frame.
In some embodiments, the method further comprises a fixation unit for:
And when the target object is a service component, fixing the display position and the display size of the service component corresponding to the target object.
A computer storage medium storing a plurality of instructions adapted to be loaded by a processor to perform the steps of the live layout adjustment method described above.
A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, the processor implementing the steps in the live layout adjustment method provided above when the computer program is executed.
A live layout adjustment system, the system comprising: a server, a spectator client and a anchor client;
the server comprises the live broadcast layout adjustment device;
the client comprises the live broadcast layout adjustment device.
A computer program product or computer program comprising computer instructions stored in a storage medium. The processor of the computer device reads the computer instructions from the storage medium, and the processor executes the computer instructions, so that the computer device performs the steps in the live layout adjustment method provided above.
The embodiment of the application receives the video stream information and the first operation service information sent by the client; analyzing the video stream information and determining a first human feature area corresponding to the anchor in the video stream information; acquiring a target service component corresponding to the first operation service information, and determining a first service occupation area corresponding to the target service component; when the intersection of the first service occupation area and the first human feature area is larger than a first preset threshold value, acquiring a plurality of service layout information; and determining target service layout information with the minimum intersection between the first service occupation area and the first human body characteristic area from the service layout information, and returning the target service layout information to the client side, so that the client side changes the position of the first service occupation area and prevents the blocking of the anchor. Therefore, the live broadcast effect is greatly improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic view of a live layout adjustment system according to an embodiment of the present application;
fig. 2 is a flow chart of a live broadcast layout adjustment method according to an embodiment of the present application;
fig. 3 is a schematic view of a scenario of a live broadcast layout adjustment method according to an embodiment of the present application;
fig. 4 is a flow chart of a live broadcast layout adjustment method according to an embodiment of the present application;
fig. 5 is a timing diagram of a live layout adjustment method according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of a live broadcast layout adjustment device according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of a live broadcast layout adjustment device according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of a computer device according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to fall within the scope of the application.
The embodiment of the application provides a live broadcast layout adjustment method, a live broadcast layout adjustment device, a storage medium and computer equipment.
Referring to fig. 1, fig. 1 is a schematic view of a live broadcast layout adjustment system according to an embodiment of the present application, including: the client A and the server B can be connected through a communication network, wherein the communication network comprises a wireless network and a wired network, and the wireless network comprises one or a combination of a plurality of wireless wide area networks, wireless local area networks, wireless metropolitan area networks and wireless personal networks. The network includes network entities such as routers, gateways, etc., which are not shown. Client a may interact with server B via a communication network.
The live broadcast layout adjustment system may further include a server B, where the server B may be configured to receive video stream information and first operation service information sent by the client; analyzing the video stream information and determining a first human body characteristic region corresponding to a host in the video stream information; acquiring a target service component corresponding to the first operation service information, and determining a first service occupation area corresponding to the target service component; when the intersection of the first service occupation area and the first human body characteristic area is larger than a first preset threshold value, acquiring a plurality of service layout information, wherein each service layout information is provided with a first service occupation area at different positions corresponding to the target service component; and determining target service layout information with the minimum intersection between the first service occupation area and the first human body characteristic area from the service layout information, and returning the target service layout information to the client A so that the client A replaces the position of the first service occupation area corresponding to the target service component.
The live broadcast layout adjustment system may include a live broadcast layout adjustment device, which may be integrated in a terminal having a storage unit and a microprocessor and having an operation capability, such as a tablet computer, a mobile phone, a notebook computer, and a desktop computer, where the terminal may be provided with a client, for example, a live broadcast client or a game client, where it is to be noted that the live broadcast client may include a hosting client and a viewer client, and in fig. 1, the client a may be configured to send video stream information and first operation service information between live broadcast rooms to the server B, so that when the server B detects that an intersection between a first human body feature area corresponding to the hosting in the video stream information and a first service occupation area of a target service component corresponding to the first operation service information is greater than a first preset threshold, a target service layout with the minimum intersection between the first human body feature areas is selected from multiple service layout information; receiving the target service layout; and replacing the position of the first service occupation area of the target service component corresponding to the first operation service information of the live broadcasting room with the position of the first service occupation area of the target service component in the target service layout.
It should be noted that, the schematic view of the live broadcast layout adjustment system shown in fig. 1 is only an example, and the live broadcast layout adjustment system and the scene described in the embodiments of the present application are for more clearly describing the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided by the embodiments of the present application, and those skilled in the art can know that, with the evolution of the live broadcast layout adjustment system and the appearance of the new service scene, the technical solutions provided by the embodiments of the present application are equally applicable to similar technical problems.
The following will describe in detail.
In the present embodiment, description will be made from the viewpoint of a live-broadcast layout adjustment apparatus, which can be integrated in a server in particular.
Referring to fig. 2, fig. 2 is a flowchart illustrating a live layout adjustment method according to an embodiment of the application. The live broadcast layout adjustment method comprises the following steps:
in step 101, video stream information and first operation service information sent by a client are received.
The client can be a live broadcast client or a spectator client, the spectator client is a client for watching a live broadcast to perform, the live broadcast client records a client for performing corresponding live broadcast video stream information for the live broadcast, the live broadcast client can display a live broadcast room exclusive to the live broadcast, the live broadcast can view own performance through the live broadcast room exclusive to the live broadcast, the live broadcast can upload video stream information recorded by the live broadcast client to a server in real time, the server can store a corresponding relation between the live broadcast client and the live broadcast room of each live broadcast, and when the spectator client selects any live broadcast room of the live broadcast to access, the server sends live broadcast video streams collected by the live broadcast client to all spectator clients in the live broadcast room accessing the same live broadcast according to the corresponding relation to realize live broadcast.
In the related live broadcast technology, for different live broadcast gifts, no matter a live broadcast room of a host broadcast or a live broadcast room watched by a spectator, corresponding service components are set for displaying special effects of the corresponding type of live broadcast gifts, each service component comprises a corresponding display size, different types of live broadcast gifts can correspond to different service components, a spectator client can give a live broadcast gifts to a host broadcast user, after giving the live broadcast gifts, corresponding service information is triggered according to the types of the live broadcast gifts, the service information is gift service corresponding to the live broadcast gifts of a specific type, each service information is associated with a service component, and corresponding special effects are displayed on the corresponding service components in the live broadcast room of the host broadcast and the live broadcast room watched by the spectator according to the service information. However, since the position and the size of the service component are fixed, the part which is wanted to be displayed by the anchor may be blocked in the live broadcast process, and the live broadcast effect is seriously affected.
In order to solve the above problems, the server may receive video stream information uploaded by a hosting client or a viewer client and first operation service information, where the first operation service information is currently operating service information, that is, service information triggered by a currently presented live gift.
In step 102, the video stream information is analyzed to determine a first human feature region corresponding to the anchor in the video stream information.
The video stream information is composed of video stream images of multiple frames, object analysis can be carried out on the video stream images of each frame through an image recognition algorithm, a first human feature area corresponding to a main cast in the video stream is recognized, in an actual live broadcast scene, the main cast needs to be preferentially displayed, for example, a face and a trunk of the main cast need to be preferentially displayed, the face and the trunk can become human features, and an area containing the human features is a first human feature area.
In step 103, a target service component corresponding to the first operation service information is obtained, and a first service occupation area corresponding to the target service component is determined.
Because each service information is associated with a service component, a corresponding target service component can be determined according to the first operation service information, a special effect of a direct broadcast gift of a corresponding type of the first operation service information needs to be played on the target service component, each target service component comprises corresponding size information and position information, the position information represents a display position of the target service component in the direct broadcast room, the size information represents the size of the service component, and the area occupied by the target service component in the direct broadcast room, namely the first service occupied area, can be determined according to the size information and the position information.
In a live broadcast scenario, the position and the size of a target service component in each live broadcast room are fixed, for example, please refer to fig. 3 together, fig. 3 is a schematic diagram of a live broadcast layout adjustment method provided in an embodiment of the present application, a live broadcast picture of a host broadcast may be displayed in the live broadcast room 20, the first operation service information may correspond to the target service component 21, a special effect corresponding to a live broadcast gift "blue heart word" may be played in the target service component 21, and the dashed box represents a first service occupation area of the target service component 21 in the live broadcast room 20.
In step 104, when the intersection of the first service occupation area and the first human feature area is greater than a first preset threshold, a plurality of service layout information are acquired, and the first service occupation area in different positions is set in each service layout information corresponding to the target service component.
With continued reference to fig. 3, since the special effect of the corresponding type of live gift is played in the first service occupation area of the target service component 21, the first human feature area of the anchor is blocked by the special effect, in order to avoid the effect of the special effect playing affecting the live broadcast, a first preset threshold may be set, where the first preset threshold is a critical value defining whether the blocking affects the live broadcast, and may be set to be half of the size information of the first service occupation area, and when it is detected that the intersection between the first service occupation area and the first human feature area is greater than the first preset threshold, it is indicated that the performance of the anchor is affected by the coverage of the first service occupation area.
In order to solve the above problem, a developer may customize a plurality of service layout information in advance in a server, where each service component in each service layout information is set in a different position, that is, a first service occupation area set corresponding to a target service component in each service layout information is different.
And when the intersection of the first service occupation area and the first human body characteristic area is detected to be not more than a first preset threshold value, the first service occupation area coverage is indicated not to affect the performance of the anchor, and the adjustment can be omitted.
In step 105, target service layout information with the minimum intersection between the first service occupation area and the first human body characteristic area is determined from the plurality of service layout information, and the target service layout information is returned to the client, so that the client replaces the position of the first service occupation area corresponding to the target service component.
In order to reduce the influence of the coverage of the first service occupation area on the live broadcast caused by the first human body characteristic area as much as possible, the intersection calculation can be performed on the first service occupation area set by each service layout information corresponding to the target service component and the first human body characteristic area respectively, the intersection between the first service occupation area and the first human body characteristic area is minimum, namely, the service layout information with the minimum coverage area is determined as the target layout information, and the target service layout information is returned to the corresponding anchor client or audience client, so that the anchor client or audience client performs the re-layout according to the position of each service component in the target service component, namely, the position of the first service occupation area of the target service component in the target service layout information is replaced by the position of the first service occupation area of the target service component in the original live broadcast room of the client, the played special effect in the first service occupation area is minimum, and the live broadcast effect is better.
In some embodiments, the determining, from the plurality of service layout information, a target service layout information representation having a minimum intersection between the first service occupancy zone and the first human feature zone includes:
(1) Respectively determining intersections between a first service occupation area corresponding to the target service component and the first human body area in each service layout information to obtain a plurality of intersections;
(2) And sequencing the intersections according to the sequence from small to large, and determining the service layout information with the smallest intersection as target service layout information.
The intersection formed between the first service occupation area of the corresponding target service component and the first human body area in each service layout information can be determined respectively, and the intersection can be an overlapping area, so that a plurality of intersections are obtained. And then each intersection can be sorted according to the size according to the order from small to large, and the service layout information with the smallest intersection, namely the smallest overlapping area, is determined as the target service layout information.
In some embodiments, the method further comprises:
(1.2) acquiring a plurality of target live rooms matched with the live rooms corresponding to the video stream information sent by the client;
and (2.2) generating live broadcast proposal information of the live broadcast room according to the live broadcast attribute information of the plurality of target live broadcast rooms.
The server may also match, in real time, a plurality of target living rooms similar to the living room of the client according to coverage rates of the first human body characteristic region of the main broadcast and the first service occupation region of the target service component in the living room corresponding to the video stream information uploaded by the client, and record living broadcast attribute information of each target living room, where the living broadcast attribute information may be understood as a policy adopted by the target living room for solving the coverage rate, for example, a policy that the main broadcast moves backward, the main broadcast moves left, etc., record the policy as living broadcast attribute information, and generate living broadcast suggestion information of the living broadcast according to the living broadcast attribute information, for example, generate living broadcast suggestion information with the largest living broadcast attribute information, that is, living broadcast attribute information that the main broadcast moves backward.
As can be seen from the above, in the embodiment of the present application, the video stream information and the first operation service information sent by the client are received; analyzing the video stream information and determining a first human feature area corresponding to the anchor in the video stream information; acquiring a target service component corresponding to the first operation service information, and determining a first service occupation area corresponding to the target service component; when the intersection of the first service occupation area and the first human feature area is larger than a first preset threshold value, acquiring a plurality of service layout information; and determining target service layout information with the minimum intersection between the first service occupation area and the first human body characteristic area from the service layout information, and returning the target service layout information to the client side, so that the client side changes the position of the first service occupation area and prevents the blocking of the anchor. Therefore, the live broadcast effect is greatly improved.
In this embodiment, a description will be given from the perspective of a live broadcast layout adjustment device, which may be specifically integrated in a terminal having a storage unit and a microprocessor installed and having an operation capability, such as a tablet computer, a mobile phone, etc., where the terminal may start a live broadcast client, and in this embodiment, the live broadcast client may be a viewer client or a host client.
Referring to fig. 4, fig. 4 is another flow chart of the live layout adjustment method according to the embodiment of the application. The method flow may include:
in step 201, video stream information and first operation service information of a live room are transmitted to a server.
The audience client or the anchor client may send the video stream information played in the current live broadcast room and the first running service information triggered by the live broadcast gift and currently running to the server, so that the server executes the step of the previous embodiment, that is, when detecting that the intersection between the first human body feature area corresponding to the anchor in the video stream information and the first service occupied area of the target service component corresponding to the first running service information is greater than a first preset threshold, selects, from the multiple service layout information, a target service layout with the minimum intersection with the first human body feature area for feedback, which is not described in detail herein.
In step 202, a target business layout is received.
With continued reference to fig. 3, in the living broadcast room 20, since the intersection of the first human body feature covered by the first service occupation area corresponding to the target service component 21 corresponding to the first service operation information is greater than the first preset threshold, the playing special effect of the target service component may cause shielding of the host, and affect the host effect, so that the target service layout fed back by the server may be received, where the intersection of the first service occupation area set by the target service component corresponding to the target service component and the current first human body feature area is minimum.
In step 203, the location of the first service occupation area of the target service component corresponding to the first operation service information of the live room is replaced with the location of the first service occupation area of the target service component in the target service layout.
The position of the first service occupying area of the target service component corresponding to the current first operation service information in the live broadcasting room can be replaced with the position of the first service occupying area of the target service component in the target service layout, for example, please continue to refer to fig. 3, when the first service occupying area of the target service component in the target service layout is the upper left corner, the position of the current first service occupying area of the target service component 21 is replaced with the upper left corner for displaying, so that even if special effect playing is performed on the first service occupying area of the replaced target service component, the anchor is not blocked, and the live broadcasting effect is greatly improved.
In one embodiment, the method further comprises:
(1) Receiving first voice information and converting the voice information into first text information;
(2) When the first text information accords with a preset condition, extracting keyword information in the first text information;
(3) Determining a corresponding first target object according to the keyword information;
(4) And when the intersection of the first target object and the first service occupation area is detected to be larger than a second preset threshold value, adjusting the position of the first service occupation area of the target service assembly so that the intersection of the first service occupation area and the first target object is smaller than the second preset threshold value.
When the client is a host client, the host client can speak the first voice information in order to enable the audience to see the object which the audience wants to display, such as a mobile phone on hand or a blower, and the host client can collect the first voice information through a microphone and convert the voice information into first text information through a voice recognition technology, for example, "please pay attention to the mobile phone on the hand", the preset conditions are preset grammars, for example, "please pay attention to XX" and "please see XX", when the characters in the first text information are detected to meet the preset grammars, keyword information in the first text information can be extracted, and the keyword information can be an object keyword, such as a "mobile phone" or a "blower".
Further, a first target object which the anchor wants to pay attention to by the audience is determined according to the keyword information, and the area occupied by the first target object can be cut out for position tracking processing. The second preset threshold is a critical value defining whether the first traffic occupancy zone shielding affects the display of the first target object, and the second preset threshold may be half of the area occupied by the first target object. When the intersection of the first target object and the first service occupation area is detected to be greater than a second preset threshold, that is, it is indicated that the coverage of the first service occupation area affects the display of the first target object, the position of the first service occupation area of the target service component can be adjusted in real time, for example, the target service component is moved to a certain distance in any direction, so that the intersection of the first service occupation area of the moved target service component, which is blocked by the first service occupation area, is smaller than the second preset threshold.
In some embodiments, after determining the corresponding first target object according to the keyword information, the method further includes:
(1.1) when detecting that the intersection of the first target object and the first service occupation area is larger than a second preset threshold value, receiving second voice information and converting the second voice information into second text information;
(1.2) extracting keyword information and scaling proportion words in the second text information;
and (1.3) carrying out corresponding scaling processing on the first target object corresponding to the keyword information according to the scaling proportion word.
When detecting that the intersection of the first target object and the first service occupation area is greater than a second preset threshold, the method can also receive second voice information of the anchor and convert the second voice information into second text information through a voice recognition technology, for example, "amplifying the mobile phone by 30 percent".
Further, the keyword information 'mobile phone' and zooming, for example, the word 'enlarged by 30 percent' in the second text information are extracted, and the mobile phone enlarged by 30 percent displayed on the main player of the first target object corresponding to the keyword information 'mobile phone' is displayed according to the zooming, for example, the word 'enlarged by 30 percent', so that after the first target object is enlarged, the display can be better performed, shielding is avoided, and accordingly, the effect of the audience client after the zooming processing can be synchronous, and the live broadcasting effect is better improved.
In one embodiment, the method further comprises:
(2.1) receiving a target object selected by a user;
(2.2) when the target object is a second target object, recording size information of the second target object;
(2.3) when the intersection of the second target object and the first service occupation area is detected to be larger than a third preset threshold value, acquiring a weight value of a first service type corresponding to the first service occupation area;
(2.4) adjusting the position of the first service occupation area of the target service component according to the weight value;
and (2.5) when the shielding area of the second target object, which is shielded by the third target object, is detected to be larger than a fourth preset threshold value, predicting a predicted area of the second target object according to the size information, and displaying the predicted area in an identification mode through an identification frame.
When the client is a viewer client, the viewer can have live broadcast information which the viewer wants to pay attention to when watching live broadcast, and can receive a target object selected by the user, wherein the object can be a service component or an object displayed in a live broadcast room.
Further, when the target object is a second target object, it is indicated that the second target object is an object that the viewer continuously focuses on, the size information of the second target object may be recorded, the third preset threshold is a critical value defining whether the shielding of the first service occupying area affects the display of the second target object, and the third preset threshold may be half of the area occupied by the second target object. When the intersection of the second target object and the first service occupation area is detected to be greater than a third preset threshold, it is indicated that the coverage of the first service occupation area affects the display of the second target object, a weight value of a first service type of a target service component of the first service occupation area is obtained, the weight value can reflect the importance degree of the characteristics played in the target service component, the greater the weight value is, the smaller the weight value is, the lesser the importance degree is, the position of the first service occupation area of the target service component can be adjusted according to the weight value, for example, the greater the weight value is, the greater the coordinate value of the position adjustment is, so that the second target object is far away from the first service occupation area as far as possible, the mutual influence is avoided, and the smaller the weight value is, and the coordinate value of the position adjustment is smaller.
In an actual live broadcast scenario, the second target object focused by the viewer may also be other objects, hereinafter collectively referred to as a third target object occlusion, where the fourth preset threshold is a critical value defining whether the third target object occlusion affects the second target object display, and the fourth preset threshold may also be half of the area occupied by the second target object. When it is detected that the shielding area of the second target object, which is shielded by the third target object, is greater than a fourth preset threshold, that is, it is indicated that the third target object covers a display affecting the second target object, a prediction area after the second target object is shielded may be predicted according to the size information of the second target object, and the identification frame may be a rectangular frame or a dotted rectangular frame to perform identification display on the prediction area, so that even if the second target object is shielded, a user may still know the predicted position of the second target object.
In one embodiment, after receiving the target object selected by the user, the method further includes:
and when the target object is a service component, fixing the display position and the display size of the service component corresponding to the target object.
When the target object is a service component, it is indicated that the service component corresponding to the target object is a service component which is continuously focused by the user, and the display position and the display size of the service component corresponding to the target object can be locked, so that the service component corresponding to the target object will not change when other service layouts are executed subsequently.
In one embodiment, the method further comprises:
(3.1) receiving a service set by a user, wherein the service set comprises at least one service component;
(3.2) adding a canvas layer for each business component in the business set, the canvas layer for displaying the first human feature region.
The client can display a service list corresponding to all service components in the current live broadcasting room, receive the service components selected by the user, generate a service set, wherein the service set can comprise one or more service components, further add Canvas layers (Canvas) for each service component in the service set, and the hierarchy of the Canvas layers can display the main broadcasting human body, namely the first human body characteristic region. Therefore, the transparent effect of the service components which are not concerned by some users can be realized, and the live broadcast effect is further improved.
Referring to fig. 5, fig. 5 is a timing diagram of a live layout adjustment method according to an embodiment of the application. The method flow may include:
in step S1, the client transmits video stream information and first operation service information to the server.
In step S2, the server receives video stream information and first operation service information sent by the client.
In step S3, the server analyzes the video stream information and determines a first human feature region corresponding to the anchor in the video stream information.
In step S4, the server analyzes the video stream information and determines a first human feature region corresponding to the anchor in the video stream information.
In step S5, when the server detects that the intersection of the first service occupying area and the first human feature area is greater than a first preset threshold, a plurality of service layout information is acquired.
In step S6, the server obtains a plurality of service layout information when the intersection of the first service occupying area and the first human feature area is greater than a first preset threshold.
In step S7, the server transmits the target service layout information to the client.
In step S8, the client replaces the position of the first service occupation area of the target service component corresponding to the first operation service information of the live broadcasting room with the position of the first service occupation area of the target service component in the target service layout.
In the foregoing embodiments, reference may be made to the foregoing detailed description of the live layout adjustment method, which is not repeated herein.
In order to facilitate better implementation of the live broadcast layout adjustment method provided by the embodiment of the application, the embodiment of the application also provides a device based on the live broadcast layout adjustment method. The meaning of the nouns is the same as that in the live layout adjustment method, and specific implementation details can be referred to the description in the method embodiment.
Referring to fig. 6, fig. 6 is a schematic structural diagram of a live broadcast layout adjustment device according to an embodiment of the present application, where the live broadcast layout adjustment device is applied to a server, and the live broadcast layout adjustment device may include a receiving unit 301, an analyzing unit 302, a first determining unit 303, an obtaining unit 304, a second determining unit 305, and so on.
The receiving unit 301 is configured to receive video stream information and first operation service information sent by a client.
An analysis unit 302, configured to analyze the video stream information and determine a first human feature area corresponding to the anchor in the video stream information.
The first determining unit 303 is configured to obtain a target service component corresponding to the first operation service information, and determine a first service occupation area corresponding to the target service component.
And the obtaining unit 304 is configured to obtain a plurality of service layout information when the intersection of the first service occupation area and the first human feature area is greater than a first preset threshold, where each service layout information sets a first service occupation area in a different position corresponding to the target service component.
The second determining unit 305 is configured to determine, from the plurality of service layout information, target service layout information with a minimum intersection between the first service occupation area and the first human feature area, and return the target service layout information to the client, so that the client replaces the position of the first service occupation area corresponding to the target service component.
In some embodiments, the second determining unit 305 is configured to:
respectively determining intersections between a first service occupation area corresponding to the target service component and the first human body area in each service layout information to obtain a plurality of intersections;
sequencing the intersections according to the sequence from small to large, and determining the service layout information with the smallest intersection as target service layout information;
and returning the target service layout information to the client so that the client replaces the position of the first service occupation area corresponding to the target service component.
In some embodiments, the method further comprises a generating unit for:
acquiring a plurality of target live rooms matched with the live rooms corresponding to the video stream information sent by the client;
and generating live broadcast suggestion information of the live broadcast room according to the live broadcast attribute information of the plurality of target live broadcast rooms.
Referring to fig. 7, fig. 7 is a schematic structural diagram of a live broadcast layout adjustment device according to an embodiment of the present application, where the live broadcast layout adjustment device is applied to a client, and the live broadcast layout adjustment device may include a sending unit 401, a receiving unit 402, a replacing unit 403, and the like.
The sending unit 301 is configured to send video stream information and first operation service information in a live broadcasting room to a server, so that when the server detects that an intersection between a first human feature area corresponding to a host in the video stream information and a first service occupation area of a target service component corresponding to the first operation service information is greater than a first preset threshold, a target service layout with the minimum intersection with the first human feature area is selected from a plurality of service layout information to feed back.
A receiving unit 302, configured to receive the target service layout.
And a replacing unit 303, configured to replace the position of the first service occupation area of the target service component corresponding to the first operation service information of the live room with the position of the first service occupation area of the target service component in the target service layout.
In some embodiments, the method further comprises a first adjustment unit for:
receiving first voice information and converting the voice information into first text information;
when the first text information accords with a preset condition, extracting keyword information in the first text information;
determining a corresponding first target object according to the keyword information;
and when the intersection of the first target object and the first service occupation area is detected to be larger than a second preset threshold value, adjusting the position of the first service occupation area of the target service assembly so that the intersection of the first service occupation area and the first target object is smaller than the second preset threshold value.
In some embodiments, the method further comprises a scaling unit for:
when the intersection of the first target object and the first service occupation area is detected to be larger than a second preset threshold value, receiving second voice information, and converting the second voice information into second text information;
Extracting keyword information and scaling proportion words in the second text information;
and carrying out corresponding scaling processing on the first target object corresponding to the keyword information according to the scaling proportion word.
In some embodiments, the method further comprises a second adjustment unit for:
receiving a target object selected by a user;
when the target object is a second target object, recording the size information of the second target object;
when the intersection of the second target object and the first service occupation area is detected to be larger than a third preset threshold value, acquiring a weight value of a first service type corresponding to the first service occupation area;
adjusting the position of the first service occupation area of the target service component according to the weight value;
in some embodiments, the method further comprises an identification unit for:
when the fact that the shielding area of the second target object, which is shielded by the third target object, is larger than a fourth preset threshold value is detected, a prediction area of the second target object is predicted according to the size information, and the prediction area is marked and displayed through a marking frame.
In some embodiments, the method further comprises a fixation unit for:
and when the target object is a service component, fixing the display position and the display size of the service component corresponding to the target object.
The embodiment of the application also provides a computer device, which may be a terminal or a server, as shown in fig. 8, which shows a schematic structural diagram of the computer device according to the embodiment of the application, specifically:
the computer device may include one or more processing cores 'processors 501, one or more computer-readable storage media's memory 502, a power supply 503, and an input unit 504, among other components. Those skilled in the art will appreciate that the computer device structure shown in FIG. 8 is not limiting of the computer device and may include more or fewer components than shown, or may be combined with certain components, or a different arrangement of components. Wherein:
the processor 501 is the control center of the computer device and uses various interfaces and lines to connect the various parts of the overall computer device, and by running or executing software programs and/or modules stored in the memory 502, and invoking data stored in the memory 502, performs various functions of the computer device and processes the data, thereby performing overall monitoring of the computer device. Optionally, processor 501 may include one or more processing cores; preferably, the processor 501 may integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., with a modem processor that primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 501.
The memory 502 may be used to store software programs and modules, and the processor 501 executes various functional applications and data processing by executing the software programs and modules stored in the memory 502. The memory 502 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like; the storage data area may store data created according to the use of the computer device, etc. In addition, memory 502 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 502 may also include a memory controller to provide access to the memory 502 by the processor 501.
The computer device further includes a power supply 503 for powering the various components, and preferably the power supply 503 may be logically coupled to the processor 501 via a power management system such that functions such as charge, discharge, and power consumption management are performed by the power management system. The power supply 503 may also include one or more of any of a direct current or alternating current power supply, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.
The computer device may also include an input unit 504, which input unit 504 may be used to receive input numeric or character information and to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.
Although not shown, the computer device may further include a display unit or the like, which is not described herein. In particular, in this embodiment, the processor 501 in the computer device loads executable files corresponding to the processes of one or more application programs into the memory 502 according to the following instructions, and the processor 501 executes the application programs stored in the memory 502, so as to implement various functions as follows:
receiving video stream information and first operation service information sent by a client;
analyzing the video stream information and determining a first human body characteristic region corresponding to a host in the video stream information;
acquiring a target service component corresponding to the first operation service information, and determining a first service occupation area corresponding to the target service component;
when the intersection of the first service occupation area and the first human body characteristic area is larger than a first preset threshold value, acquiring a plurality of service layout information, wherein each service layout information is provided with a first service occupation area at different positions corresponding to the target service component;
And determining target service layout information with the minimum intersection between the first service occupation area and the first human body characteristic area from the service layout information, and returning the target service layout information to the client so that the client replaces the position of the first service occupation area corresponding to the target service component.
In the foregoing embodiments, the descriptions of the embodiments are focused on, and the portions of a certain embodiment that are not described in detail may be referred to the above detailed description of the live broadcast layout adjustment method, which is not repeated herein.
Those of ordinary skill in the art will appreciate that all or a portion of the steps of the various methods of the above embodiments may be performed by instructions, or by instructions controlling associated hardware, which may be stored in a computer-readable storage medium and loaded and executed by a processor.
To this end, an embodiment of the present application provides a computer storage medium having stored therein a plurality of instructions capable of being loaded by a processor to perform the steps of any of the live layout adjustment methods provided by the embodiments of the present application.
According to one aspect of the present application, there is provided a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the methods provided in the various alternative implementations provided in the above embodiments.
The specific implementation of each operation above may be referred to the previous embodiments, and will not be described herein.
Wherein the computer storage medium may include: read Only Memory (ROM), random access Memory (RAM, random Access Memory), magnetic or optical disk, and the like.
The instructions stored in the computer storage medium can execute the steps in any live broadcast layout adjustment method provided by the embodiment of the present application, so that the beneficial effects that any live broadcast layout adjustment method provided by the embodiment of the present application can be achieved, and detailed descriptions of the foregoing embodiments are omitted.
The foregoing describes in detail a live broadcast layout adjustment method, apparatus, storage medium and computer device provided by the embodiments of the present application, and specific examples are applied to illustrate the principles and embodiments of the present application, where the foregoing description of the embodiments is only for helping to understand the method and core idea of the present application; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in light of the ideas of the present application, the present description should not be construed as limiting the present application.

Claims (14)

1. A live broadcast layout adjustment method, applied to a live broadcast layout adjustment system, the live broadcast layout adjustment system including a server and a client, the method comprising:
the server is used for receiving video stream information and first operation service information sent by the client; analyzing the video stream information and determining a first human body characteristic region corresponding to a host in the video stream information; acquiring a target service component corresponding to the first operation service information, and determining a first service occupation area corresponding to the target service component; when the intersection of the first service occupation area and the first human body characteristic area is larger than a first preset threshold value, acquiring a plurality of service layout information, wherein each service layout information is provided with a first service occupation area at different positions corresponding to the target service component; determining target service layout information with the minimum intersection between a first service occupation area and the first human body characteristic area from a plurality of service layout information, and returning the target service layout information to a client so that the client replaces the position of the first service occupation area corresponding to the target service component;
The client is used for sending video stream information and first operation business information of a live broadcasting room to the server, so that when the server detects that the intersection between a first human body characteristic region corresponding to a host in the video stream information and a first business occupation region of a target business component corresponding to the first operation business information is larger than a first preset threshold, a target business layout with the least intersection with the first human body characteristic region is selected from a plurality of business layout information; receiving the target service layout; and replacing the position of the first service occupation area of the target service component corresponding to the first operation service information of the live broadcasting room with the position of the first service occupation area of the target service component in the target service layout.
2. A live broadcast layout adjustment method, comprising:
receiving video stream information and first operation service information sent by a client;
analyzing the video stream information and determining a first human body characteristic region corresponding to a host in the video stream information;
acquiring a target service component corresponding to the first operation service information, and determining a first service occupation area corresponding to the target service component;
when the intersection of the first service occupation area and the first human body characteristic area is larger than a first preset threshold value, acquiring a plurality of service layout information, wherein each service layout information is provided with a first service occupation area at different positions corresponding to the target service component;
And determining target service layout information with the minimum intersection between the first service occupation area and the first human body characteristic area from the service layout information, and returning the target service layout information to the client so that the client replaces the position of the first service occupation area corresponding to the target service component.
3. The live layout adjustment method according to claim 2, wherein determining target traffic layout information having a minimum intersection between a first traffic occupation area and the first human feature area from among a plurality of traffic layout information, comprises:
respectively determining intersections between a first service occupation area corresponding to the target service component and the first human body area in each service layout information to obtain a plurality of intersections;
and sequencing the intersections according to the sequence from small to large, and determining the service layout information with the smallest intersection as target service layout information.
4. The live layout adjustment method according to claim 2, further comprising:
acquiring a plurality of target live rooms matched with the live rooms corresponding to the video stream information sent by the client;
And generating live broadcast proposal information of the live broadcast room according to the live broadcast attribute information of the multiple target live broadcast rooms.
5. A live broadcast layout adjustment method, comprising:
transmitting video stream information and first operation service information of a live broadcasting room to a server, so that when the server detects that the intersection between a first human body characteristic region corresponding to a host in the video stream information and a first service occupation region of a target service component corresponding to the first operation service information is larger than a first preset threshold, selecting a target service layout with the minimum intersection with the first human body characteristic region from a plurality of service layout information to feed back;
receiving the target service layout;
and replacing the position of the first service occupation area of the target service component corresponding to the first operation service information of the live broadcasting room with the position of the first service occupation area of the target service component in the target service layout.
6. The live layout adjustment method of claim 5, further comprising:
receiving first voice information and converting the voice information into first text information;
when the first text information accords with a preset condition, extracting keyword information in the first text information;
Determining a corresponding first target object according to the keyword information;
and when the intersection of the first target object and the first service occupation area is detected to be larger than a second preset threshold value, adjusting the position of the first service occupation area of the target service assembly so that the intersection of the first service occupation area and the first target object is smaller than the second preset threshold value.
7. The live layout adjustment method of claim 6, further comprising:
when the intersection of the first target object and the first service occupation area is detected to be larger than a second preset threshold value, receiving second voice information, and converting the second voice information into second text information;
extracting keyword information and scaling proportion words in the second text information;
and carrying out corresponding scaling treatment on the first target object corresponding to the keyword information according to the scaling proportion word.
8. The live layout adjustment method of claim 5, further comprising:
receiving a target object selected by a user;
when the target object is a second target object, recording the size information of the second target object;
When the intersection of the second target object and the first service occupation area is detected to be larger than a third preset threshold value, acquiring a weight value of a first service type corresponding to the first service occupation area;
adjusting the position of the first service occupation area of the target service component according to the weight value;
when the fact that the shielding area of the second target object, which is shielded by the third target object, is larger than a fourth preset threshold value is detected, a prediction area of the second target object is predicted according to the size information, and the prediction area is marked and displayed through an identification frame.
9. The live layout adjustment method of claim 8, further comprising:
and when the target object is a service component, fixing the display position and the display size of the service component corresponding to the target object.
10. The live layout adjustment method of claim 5, further comprising:
receiving a service set by a user, wherein the service set comprises at least one service component;
and adding a canvas layer for each service component in the service set, wherein the canvas layer is used for displaying the first human body characteristic region.
11. A live broadcast layout adjustment device, comprising:
the receiving unit is used for receiving the video stream information and the first operation service information sent by the client;
the analysis unit is used for analyzing the video stream information and determining a first human body characteristic area corresponding to the anchor in the video stream information;
the first determining unit is used for acquiring a target service component corresponding to the first operation service information and determining a first service occupation area corresponding to the target service component;
the acquiring unit is used for acquiring a plurality of service layout information when the intersection of the first service occupation area and the first human body characteristic area is larger than a first preset threshold value, wherein the first service occupation area at different positions is set corresponding to the target service component in each service layout information;
and the second determining unit is used for determining target service layout information with the minimum intersection between the first service occupation area and the first human body characteristic area from the plurality of service layout information, and returning the target service layout information to the client so that the client replaces the position of the first service occupation area corresponding to the target service component.
12. A live broadcast layout adjustment device, comprising:
the transmitting unit is used for transmitting the video stream information and the first operation service information of the live broadcasting room to the server, so that when the server detects that the intersection between the first human body characteristic region corresponding to the anchor in the video stream information and the first service occupation region of the target service component corresponding to the first operation service information is larger than a first preset threshold value, the target service layout with the minimum intersection with the first human body characteristic region is selected from the service layout information to feed back;
a receiving unit, configured to receive the target service layout;
and the replacing unit is used for replacing the position of the first service occupation area of the target service component corresponding to the first operation service information of the live broadcasting room with the position of the first service occupation area of the target service component in the target service layout.
13. A computer readable storage medium, characterized in that the storage medium stores a plurality of instructions adapted to be loaded by a processor for performing the steps of the live layout adjustment method of any of claims 1 to 10.
14. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, the processor implementing the steps in the live layout adjustment method of any of claims 1 to 10 when the computer program is executed.
CN202111295771.4A 2021-11-03 2021-11-03 Live broadcast layout adjustment method and device, storage medium and computer equipment Active CN114222147B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111295771.4A CN114222147B (en) 2021-11-03 2021-11-03 Live broadcast layout adjustment method and device, storage medium and computer equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111295771.4A CN114222147B (en) 2021-11-03 2021-11-03 Live broadcast layout adjustment method and device, storage medium and computer equipment

Publications (2)

Publication Number Publication Date
CN114222147A CN114222147A (en) 2022-03-22
CN114222147B true CN114222147B (en) 2023-10-03

Family

ID=80696480

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111295771.4A Active CN114222147B (en) 2021-11-03 2021-11-03 Live broadcast layout adjustment method and device, storage medium and computer equipment

Country Status (1)

Country Link
CN (1) CN114222147B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106375775A (en) * 2016-09-26 2017-02-01 广州华多网络科技有限公司 Virtual gift display method and apparatus
CN107347166A (en) * 2016-08-19 2017-11-14 北京市商汤科技开发有限公司 Processing method, device and the terminal device of video image
CN109286824A (en) * 2018-09-28 2019-01-29 武汉斗鱼网络科技有限公司 A kind of method, apparatus, equipment and the medium of the control of live streaming user side
CN110493630A (en) * 2019-09-11 2019-11-22 广州华多网络科技有限公司 The treating method and apparatus of virtual present special efficacy, live broadcast system
CN111385663A (en) * 2018-12-28 2020-07-07 广州市百果园信息技术有限公司 Live broadcast interaction method, device, equipment and storage medium
CN111669612A (en) * 2019-03-08 2020-09-15 腾讯科技（深圳）有限公司 Live broadcast-based information delivery method and device and computer-readable storage medium
KR102207712B1 (en) * 2019-09-19 2021-01-26 주식회사 엔씨소프트 Apparatus and method for providing broadcast information
CN112333459A (en) * 2020-10-30 2021-02-05 北京字跳网络技术有限公司 Video live broadcast method and device and computer storage medium

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107347166A (en) * 2016-08-19 2017-11-14 北京市商汤科技开发有限公司 Processing method, device and the terminal device of video image
CN106375775A (en) * 2016-09-26 2017-02-01 广州华多网络科技有限公司 Virtual gift display method and apparatus
CN112839249A (en) * 2016-09-26 2021-05-25 广州方硅信息技术有限公司 Virtual gift display method, device, equipment and storage medium
CN109286824A (en) * 2018-09-28 2019-01-29 武汉斗鱼网络科技有限公司 A kind of method, apparatus, equipment and the medium of the control of live streaming user side
CN111385663A (en) * 2018-12-28 2020-07-07 广州市百果园信息技术有限公司 Live broadcast interaction method, device, equipment and storage medium
CN111669612A (en) * 2019-03-08 2020-09-15 腾讯科技（深圳）有限公司 Live broadcast-based information delivery method and device and computer-readable storage medium
CN110493630A (en) * 2019-09-11 2019-11-22 广州华多网络科技有限公司 The treating method and apparatus of virtual present special efficacy, live broadcast system
KR102207712B1 (en) * 2019-09-19 2021-01-26 주식회사 엔씨소프트 Apparatus and method for providing broadcast information
CN112333459A (en) * 2020-10-30 2021-02-05 北京字跳网络技术有限公司 Video live broadcast method and device and computer storage medium

Also Published As

Publication number Publication date
CN114222147A (en) 2022-03-22

Similar Documents

Publication Publication Date Title
US20220360825A1 (en) Livestreaming processing method and apparatus, electronic device, and computer-readable storage medium
CN103718166B (en) Messaging device, information processing method
US10524005B2 (en) Facilitating television based interaction with social networking tools
US10645464B2 (en) Eyes free entertainment
CN113170076A (en) Dynamic curation of sequence events for a communication session
CN110692251B (en) Method and system for combining digital video content
CN109274999A (en) A kind of video playing control method, device, equipment and medium
JP2014139681A (en) Method and device for adaptive video presentation
JP2016046705A (en) Conference record editing apparatus, method and program for the same, conference record reproduction apparatus, and conference system
US20190371023A1 (en) Method and apparatus for generating multimedia content, and device therefor
CN110913260B (en) Display control method, display control device and electronic equipment
CN113676592A (en) Recording method, recording device, electronic equipment and computer readable medium
CN113297399A (en) Personalized recommendation method, personalized recommendation device and electronic equipment
CN114257824B (en) Live broadcast display method and device, storage medium and computer equipment
CN114531564A (en) Processing method and electronic equipment
CN113905254A (en) Video synthesis method, device, system and readable storage medium
US9354697B2 (en) Detecting active region in collaborative computing sessions using voice information
CN111274449B (en) Video playing method, device, electronic equipment and storage medium
CN114222147B (en) Live broadcast layout adjustment method and device, storage medium and computer equipment
CN113282770A (en) Multimedia recommendation system and method
CN104123112B (en) A kind of image processing method and electronic equipment
JP2020080115A (en) Thumbnail output device, thumbnail output method, and thumbnail output program
CN113891136A (en) Video playing method and device, electronic equipment and storage medium
US11682210B1 (en) Methods and device for video data analysis
US20230007276A1 (en) Encoding Device and Method for Video Analysis and Composition

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant