CN117615211A - Live broadcast optimization method, device, equipment and storage medium - Google Patents

Live broadcast optimization method, device, equipment and storage medium Download PDF

Info

Publication number
CN117615211A
CN117615211A CN202311656917.2A CN202311656917A CN117615211A CN 117615211 A CN117615211 A CN 117615211A CN 202311656917 A CN202311656917 A CN 202311656917A CN 117615211 A CN117615211 A CN 117615211A
Authority
CN
China
Prior art keywords
live broadcast
rendering
abnormal
image quality
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311656917.2A
Other languages
Chinese (zh)
Inventor
闫森
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shuhang Technology Beijing Co ltd
Original Assignee
Shuhang Technology Beijing Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shuhang Technology Beijing Co ltd filed Critical Shuhang Technology Beijing Co ltd
Priority to CN202311656917.2A priority Critical patent/CN117615211A/en
Publication of CN117615211A publication Critical patent/CN117615211A/en
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44209—Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23412—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H04N21/2402—Monitoring of the downstream path of the transmission network, e.g. bandwidth available
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/67—Focus control based on electronic image sensor signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H04N23/84—Camera processing pipelines; Components thereof for processing colour signals
    • H04N23/88—Camera processing pipelines; Components thereof for processing colour signals for colour balance, e.g. white-balance circuits or colour temperature control

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The application provides a live broadcast optimization method, a live broadcast optimization device, live broadcast optimization equipment and a storage medium, wherein the live broadcast optimization method comprises the following steps: acquiring a live broadcast picture frame displayed in a target live broadcast room to be detected and live broadcast picture quality information of the live broadcast picture frame; detecting abnormal images of live broadcast picture frames in the target live broadcast room according to the live broadcast picture quality information, and determining the abnormal picture frames in the target live broadcast room; acquiring the rendering log information of each live broadcast rendering stage associated with the abnormal picture frame, comparing the rendering log information of each live broadcast rendering stage, and positioning the abnormal rendering stage of the target live broadcast room; and optimizing the abnormal rendering stage to obtain an image quality optimizing result. According to the technical scheme, the image quality abnormal factors in the live broadcasting process can be accurately and rapidly positioned, the abnormal rendering stage corresponding to the image quality abnormal factors is pertinently optimized, and the image quality stability in the live broadcasting process is improved.

Description

Live broadcast optimization method, device, equipment and storage medium
Technical Field
The application relates to the technical field of live broadcasting, in particular to a live broadcasting optimization method, a live broadcasting optimization device, live broadcasting equipment and a storage medium.
Background
At present, with the rapid development of internet technology and live broadcasting technology, more and more users (i.e. the host or the blogger) live broadcast through live broadcast applications in intelligent terminals such as mobile phones, tablets, intelligent computers and the like, so as to share programs such as games/talent showing/commodity and the like to spectators in real time. However, when the anchor is broadcasting, the pictures need to pass through a plurality of live broadcast rendering links from shooting to rendering in the live broadcast room, and in the rendering process, the image quality of the live broadcast room is abnormal possibly caused by the abnormality of a certain live broadcast rendering link, so that the anchor or related personnel cannot quickly and effectively locate and repair the abnormal rendering link, and the live broadcast display effect is affected.
Disclosure of Invention
The embodiment of the application provides a live broadcast optimization method, a live broadcast optimization device, live broadcast optimization equipment and a storage medium, and aims to solve the technical problem that live broadcast image quality abnormality of a live broadcast room cannot be rapidly checked and repaired in the prior art.
In one aspect, an embodiment of the present application provides a live broadcast optimization method, where the live broadcast optimization method includes the following steps:
acquiring a live broadcast picture frame displayed in a target live broadcast room to be detected and live broadcast picture quality information of the live broadcast picture frame;
detecting abnormal images of live broadcast picture frames in the target live broadcast room according to the live broadcast picture quality information, and determining the abnormal picture frames in the target live broadcast room;
Acquiring the rendering log information of each live broadcast rendering stage associated with the abnormal picture frame, comparing the rendering log information of each live broadcast rendering stage, and positioning the abnormal rendering stage of the target live broadcast room;
and optimizing the abnormal rendering stage to obtain an image quality optimizing result.
In one possible implementation manner of the present application, the live broadcast rendering stage includes a first live broadcast rendering stage and a second live broadcast rendering stage, where the first live broadcast rendering stage is a previous live broadcast rendering stage of the second live broadcast rendering stage;
the step of obtaining the rendering log information associated with the abnormal picture frame in each live broadcast rendering stage, comparing the rendering log information of each live broadcast rendering stage, and positioning the abnormal rendering stage of the target live broadcast room comprises the following steps:
acquiring first rendering log information associated with the abnormal picture frame at a first live broadcast rendering stage in the target live broadcast room and second rendering log information associated with the abnormal picture frame at a second live broadcast rendering stage;
calculating a first image quality evaluation parameter of a first rendered image in the first rendering log information and a second image quality evaluation parameter of a second rendered image in the second rendering log;
And if the second image quality evaluation parameter is lower than the first image quality evaluation parameter and lower than a preset image quality evaluation threshold, setting the second live broadcast rendering stage as an abnormal rendering stage.
In one possible implementation manner of the present application, the obtaining the rendering log information associated with the abnormal picture frame in each live broadcast rendering stage, comparing the rendering log information of each live broadcast rendering stage, and locating the abnormal rendering stage of the target live broadcast room includes:
acquiring shooting log information of an image shooting stage of the target live broadcasting room, wherein the shooting log information comprises a target shooting image, and image noise data and image sharpening data corresponding to the target shooting image;
and if the image noise data is larger than a preset noise threshold value and/or the image sharpening data is larger than a preset sharpening parameter threshold value, setting the image shooting stage as an abnormal rendering stage of the target live broadcasting room.
In one possible implementation manner of the present application, the optimizing the abnormal rendering stage to obtain an image quality optimizing result includes:
acquiring an abnormal link module corresponding to the abnormal rendering stage, wherein the abnormal link module comprises any one or more of an abnormal shooting module, an abnormal rendering module and an abnormal coding module;
And obtaining an image quality optimization strategy corresponding to the abnormal link module, and performing optimization processing on the abnormal rendering stage based on the image quality optimization strategy to obtain an image quality optimization result.
In one possible implementation manner of the present application, the obtaining the image quality optimization policy corresponding to the abnormal link module, and performing optimization processing on the abnormal rendering stage based on the image quality optimization policy, to obtain an image quality optimization result, includes:
if the abnormal link module is an abnormal shooting module, determining the image quality optimization strategy as a shooting optimization strategy;
optimizing the abnormal shooting module based on focusing optimization parameters, white balance optimization parameters and/or camera switching parameters in the shooting optimization strategy to obtain an optimized shooting module;
and acquiring an optimized shooting image acquired by the optimized shooting module, and outputting an image quality optimization result of the optimized shooting module according to the optimized shooting image.
In one possible implementation manner of the present application, the obtaining the image quality optimization policy corresponding to the abnormal link module, and performing optimization processing on the abnormal rendering stage based on the image quality optimization policy, to obtain an image quality optimization result, includes:
If the abnormal link module is an abnormal rendering module, determining that the image quality optimization strategy is a rendering optimization strategy;
identifying an abnormal beautification item associated with the abnormal picture frame in the abnormal rendering module and an abnormal beautification parameter of the abnormal beautification item;
adjusting the abnormal beautification parameters based on the target beautification parameters of the target beautification items in the rendering optimization strategy to obtain an optimized rendering module;
and obtaining an optimized rendering image rendered by the optimized rendering module, and determining an image quality optimization result of the optimized rendering module according to the optimized rendering image.
In one possible implementation manner of the present application, the determining, according to the optimized rendering image, an image quality optimization result of the optimized rendering module includes:
if the image quality evaluation parameter of the optimized rendering image is lower than a preset image quality evaluation threshold, a rendering update package of the optimized rendering module is obtained;
updating the optimized rendering module based on the rendering update package to obtain an updated rendering module;
and acquiring an updated rendering image of the updated rendering module, and outputting an image quality optimization result corresponding to the updated rendering image.
In one possible implementation manner of the present application, the obtaining the image quality optimization policy corresponding to the abnormal link module, and performing optimization processing on the abnormal rendering stage based on the image quality optimization policy, to obtain an image quality optimization result, includes:
If the abnormal link module is an abnormal coding module, determining the image quality optimization strategy as a coding optimization strategy;
optimizing the abnormal coding module based on a target coding strategy and a target coding format in the coding optimization strategy to obtain an optimized coding module;
and obtaining an optimized coding image coded by the optimized coding module, and outputting an image quality optimization result corresponding to the optimized coding image.
On the other hand, the application provides a live broadcast optimizing device, live broadcast optimizing device includes:
the information acquisition module is configured to acquire live broadcast picture frames displayed in a target live broadcast room to be detected and live broadcast image quality information of the live broadcast picture frames;
the abnormal identification module is configured to detect abnormal images of live broadcast picture frames in the target live broadcast room according to the live broadcast picture quality information, and determine the abnormal picture frames in the target live broadcast room;
the link positioning module is configured to acquire the rendering log information of each live broadcast rendering stage associated with the abnormal picture frame, compare the rendering log information of each live broadcast rendering stage and position the abnormal rendering stage of the target live broadcast room;
and the live broadcast optimization module is configured to perform optimization processing on the abnormal rendering stage to obtain an image quality optimization result.
On the other hand, the application also provides a live broadcast optimizing device, which comprises:
one or more processors;
a memory; and
one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the steps of the live optimization method.
In another aspect, the present application also provides a computer readable storage medium having stored thereon a computer program to be loaded by a processor for performing the steps of the live optimization method.
In the method, whether the live broadcast picture frame is an abnormal picture frame or not is determined by acquiring the live broadcast picture frame displayed in the target live broadcast room and the live broadcast picture quality information in the live broadcast picture frame and detecting the image quality of the live broadcast picture frame according to the live broadcast picture quality information, when the abnormal picture frame exists in the target live broadcast room, the rendering log information of each live broadcast rendering stage associated with the abnormal picture frame in the live broadcast rendering link is acquired, the rendering log information of each live broadcast rendering stage is compared, the abnormal rendering stage of the target live broadcast room is determined, and the abnormal rendering stage is optimized to obtain an image quality optimizing result. The method and the device can accurately and rapidly position the image quality abnormal factors in the live broadcast process, and can pertinently optimize the abnormal rendering stage corresponding to the image quality abnormal factors, so that the image quality stability in the live broadcast process is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic view of a scenario of a live broadcast optimization method according to an embodiment of the present application;
FIG. 2 is a flow chart of one embodiment of a live optimization method according to embodiments of the present application;
fig. 3a is a schematic view of a scene of an embodiment of each live rendering stage in a live rendering link of a target live room in the live optimization method provided in the embodiment of the present application;
FIG. 3b is a schematic view of a scene of one embodiment of a live rendering link of a target live room rendering each live frame provided in embodiments of the present application;
fig. 4 is a timing diagram of an embodiment of a live broadcast optimization method according to the embodiments of the present application;
fig. 5 is a schematic flow chart of an embodiment of performing image quality optimization on an abnormal shooting module in the live broadcast optimization method provided in the embodiment of the present application;
FIG. 6 is a flowchart of an embodiment of optimizing image quality of an anomaly rendering module in a live broadcast optimization method according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of an embodiment of a live broadcast optimizing apparatus provided in an embodiment of the present application;
fig. 8 is a schematic structural diagram of an embodiment of a live broadcast optimization device provided in an embodiment of the present application.
Detailed Description
The following description of the technical solutions in the embodiments of the present application will be made clearly and completely with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to fall within the scope of the invention.
In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc. indicate orientations or positional relationships based on the drawings are merely for convenience in describing the present invention and simplifying the description, and do not indicate or imply that the apparatus or elements referred to must have a specific orientation, be configured and operated in a specific orientation, and thus should not be construed as limiting the present invention. Furthermore, the terms "first," "second," and the like, are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include one or more of the described features. In the description of the present invention, the meaning of "a plurality" is two or more, unless explicitly defined otherwise.
In this application, the term "exemplary" is used to mean "serving as an example, instance, or illustration. Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments. The following description is presented to enable any person skilled in the art to make and use the invention. In the following description, details are set forth for purposes of explanation. It will be apparent to one of ordinary skill in the art that the present invention may be practiced without these specific details. In other instances, well-known structures and processes have not been described in detail so as not to obscure the description of the invention with unnecessary detail. Thus, the present invention is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.
At present, with the rapid development of internet technology and live broadcasting technology, more and more users (i.e. the host or the blogger) live broadcast through live broadcast applications in intelligent terminals such as mobile phones, tablets, intelligent computers and the like, so as to share programs such as games/talent showing/commodity and the like to spectators in real time. However, when the anchor is broadcasting, the pictures need to pass through a plurality of live broadcast rendering links from shooting to rendering in the live broadcast room, and in the rendering process, the image quality of the live broadcast room is abnormal possibly caused by the abnormality of a certain live broadcast rendering link, so that the anchor or related personnel cannot quickly and effectively locate and repair the abnormal rendering link, and the live broadcast display effect is affected.
Based on the above, the application provides a live broadcast optimization method, a live broadcast optimization device, live broadcast optimization equipment and a computer readable storage medium, so as to solve the technical problem that live broadcast image quality abnormality of a live broadcast room cannot be rapidly checked and repaired in the prior art.
The live broadcast optimizing method in the embodiment of the invention is applied to a live broadcast optimizing device, the live broadcast optimizing device is arranged in a live broadcast optimizing device, one or more processors, a memory and one or more application programs are arranged in the live broadcast optimizing device, wherein the one or more application programs are stored in the memory and are configured to be executed by the processors to implement the live broadcast optimizing method; the live broadcast optimizing device can be an intelligent terminal, such as a mobile phone, a tablet computer, network equipment, an intelligent computer and the like; optionally, the live broadcast optimizing device may be one server or a service cluster formed by a plurality of servers.
As shown in fig. 1, fig. 1 is a schematic view of a scenario of a live broadcast optimization method according to an embodiment of the present application, where in the live broadcast optimization scenario in the embodiment of the present invention, the live broadcast optimization scenario includes a live broadcast optimization device 100 (a live broadcast optimization device is integrated in the live broadcast optimization device 100) and a target service terminal 200, and a computer readable storage medium corresponding to the live broadcast optimization method is run in the live broadcast optimization device 100 to execute steps of the live broadcast optimization method. The target service terminal 200 is an intelligent terminal which performs communication interaction with the live broadcast optimizing device 100 and is provided with a live broadcast client. Alternatively, in a specific embodiment, the live broadcast optimizing device 100 and the target service terminal may be the same intelligent terminal.
It may be understood that the live broadcast optimizing device in the live broadcast optimizing method scene shown in fig. 1, or the apparatus included in the live broadcast optimizing device, does not limit the embodiments of the present invention, that is, the number of devices and the type of devices of the live broadcast optimizing device included in the live broadcast optimizing method scene, or the number of apparatuses and the type of apparatuses included in each device do not affect the overall implementation of the technical solution in the embodiments of the present invention, and may be calculated as equivalent replacement or derivation of the technical solution claimed in the embodiments of the present invention.
The live broadcast optimizing device 100 in the embodiment of the invention is mainly used for: acquiring a live broadcast picture frame displayed in a target live broadcast room to be detected and live broadcast picture quality information of the live broadcast picture frame; detecting abnormal images of live broadcast picture frames in the target live broadcast room according to the live broadcast picture quality information, and determining the abnormal picture frames in the target live broadcast room; acquiring the rendering log information of each live broadcast rendering stage associated with the abnormal picture frame, comparing the rendering log information of each live broadcast rendering stage, and positioning the abnormal rendering stage of the target live broadcast room; and optimizing the abnormal rendering stage to obtain an image quality optimizing result.
The live broadcast optimizing device 100 in the embodiment of the present invention may be an independent live broadcast optimizing device, for example, an intelligent terminal such as a mobile phone, a tablet computer, a network device, a server, an intelligent computer, or a live broadcast optimizing network or a live broadcast optimizing cluster formed by a plurality of live broadcast optimizing devices.
The embodiment of the application provides a live broadcast optimization method, a live broadcast optimization device, live broadcast optimization equipment and a computer readable storage medium, and the live broadcast optimization method, the live broadcast optimization device and the live broadcast optimization equipment are respectively described in detail below.
It will be understood by those skilled in the art that the application environment shown in fig. 1 is only one application scenario related to the present application scenario, and is not limited to the application scenario of the present application scenario, and other application environments may further include more or fewer live broadcast optimization devices than those shown in fig. 1, or a live broadcast optimization network connection relationship, for example, only one live broadcast optimization device is shown in fig. 1, and it is understood that the scenario of the live broadcast optimization method may further include one or more live broadcast optimization devices, which is not limited herein in particular; a memory may also be included in the live optimization device 100 for storing live image data and other data.
It should be noted that, the schematic view of the scenario of the live broadcast optimization method shown in fig. 1 is only an example, and the scenario of the live broadcast optimization method described in the embodiment of the present invention is for more clearly describing the technical solution of the embodiment of the present invention, and does not constitute a limitation to the technical solution provided by the embodiment of the present invention.
Based on the scene of the live broadcast optimization method, various embodiments of the live broadcast optimization method disclosed by the invention are provided.
As shown in fig. 2, fig. 2 is a schematic flow chart of one embodiment of a live broadcast optimization method in the embodiment of the present application, where the live broadcast optimization method includes the following steps 201 to 204:
201. acquiring a live broadcast picture frame displayed in a target live broadcast room to be detected and live broadcast picture quality information of the live broadcast picture frame;
the live broadcast optimizing method in this embodiment is applied to a live broadcast optimizing device, and the type and number of the live broadcast optimizing device are not specifically limited, that is, the live broadcast optimizing device may be one or more intelligent terminals or servers for detecting and optimizing image quality of a target live broadcast room in a target service terminal installed with a target live broadcast application, in a specific embodiment, the live broadcast optimizing device is a live broadcast server (including a streaming media server, a cloud server, an entity server, and the like), and the target service terminal is a live broadcast intelligent device (such as an intelligent terminal of a mobile phone, a tablet computer, a personal computer, and the like). In other embodiments, the live broadcast optimization device may also be the same intelligent device as the target service terminal. That is, a certain intelligent device can be either a live broadcast optimizing device or a target service terminal for live broadcast.
The target live broadcasting room is a virtual space for transmitting audio and video contents in real time through the Internet in the target live broadcasting application. The host user can share the programs such as games/talent showing/commodity carrying and the like in real time through the target live broadcasting room. The audience user can enter the target live broadcast room to watch the audio and video program content displayed by the anchor user.
Specifically, in the running process of the live broadcast optimizing device, a live broadcast optimizing event of the target live broadcast room is responded, wherein the live broadcast optimizing event is an operation instruction event for driving the live broadcast optimizing device to detect live broadcast picture frames of the target live broadcast room and optimizing the picture quality when the picture quality of the live broadcast picture frames is abnormal. Optionally, the triggering manner of the live broadcast optimization event is not specifically limited herein, that is, the live broadcast optimization event may be triggered by a user, for example, in a specific embodiment, the user is a host user, and in the process of performing live broadcast in the target live broadcast room, the live broadcast optimization button in the target live broadcast application is clicked by a control manner such as a mouse, a keyboard, a controller or a touch control, so as to actively trigger the live broadcast optimization event. In another specific embodiment, the user may also be a viewer user, and in the process of watching the live broadcast in the target live broadcast room, click on a live broadcast optimization button in the target live broadcast application in a control manner such as a mouse, a keyboard, a controller or a touch control, and actively trigger the live broadcast optimization event. Optionally, the live broadcast optimizing event may be actively triggered by the live broadcast optimizing device, for example, a live broadcast detecting process is preset in the live broadcast optimizing device, and real-time image quality detection is performed on a target live broadcast room in the on-stream process through the live broadcast detecting process, and the live broadcast optimizing event is automatically triggered when the image quality is abnormal.
Specifically, after the live broadcast optimizing device acquires a live broadcast optimizing event, responding to the live broadcast optimizing event, analyzing the live broadcast optimizing event, determining a target live broadcast room to be detected pointed by the live broadcast optimizing event, acquiring a live broadcast picture frame displayed by the target live broadcast room, and acquiring live broadcast image quality information of the live broadcast picture frame. The live broadcast picture frame is a picture frame sequence which is currently displayed and/or already displayed in the current live broadcast of the target live broadcast room. The live broadcast image quality information is an image quality parameter representing an image quality state of a picture frame of each live broadcast picture frame. Optionally, in a specific embodiment, the live image quality information includes noise information, ambiguity information, sharpening information, and the like. In other embodiments, to improve the accuracy of live image quality detection, the live image quality information can further include more dimensional image quality parameters, for example, in a specific embodiment, the live image quality information further includes aesthetic parameters such as skin abrasion, whitening, color level, and contrast level.
202. Detecting abnormal images of live broadcast picture frames in the target live broadcast room according to the live broadcast picture quality information, and determining the abnormal picture frames in the target live broadcast room;
Specifically, after the live broadcast optimizing device acquires the live broadcast picture frames of the target live broadcast room and the live broadcast image quality information corresponding to each live broadcast picture frame, abnormal image detection is performed on the live broadcast picture frames in the target live broadcast room according to the live broadcast image quality information, so that the abnormal picture frames of the target live broadcast room are determined. The abnormal picture frame is a live picture frame with abnormal live picture quality determined by abnormal image detection.
The abnormal image detection operation is to drive the live broadcast optimizing device to perform image quality detection on live broadcast picture frames according to a preset image quality detection algorithm, and optionally, the image quality detection algorithm may include image quality detection algorithms such as manual detection, structural similarity index detection, peak signal-to-noise ratio detection, visual perception quality detection, VQA (Visual Quality Assessment) image quality detection and the like.
Specifically, the live broadcast optimizing device performs image quality detection on each live broadcast frame based on the live broadcast image quality information of the live broadcast frame, that is, calculates a live broadcast image quality evaluation parameter of each live broadcast frame through an image quality parameter and an image quality detection algorithm in the live broadcast image quality information, and determines whether the live broadcast frame is an abnormal frame through the live broadcast image quality evaluation parameter and a preset image quality evaluation threshold corresponding to each image quality detection algorithm. The live broadcast image quality evaluation parameter is calculated based on live broadcast image quality information and an image detection algorithm and is an index parameter used for representing the frame image quality of a live broadcast image. The image quality evaluation threshold is an index parameter threshold for representing the image quality in each image detection algorithm.
The live image quality evaluation parameters may include a structural similarity index (Structural Similarity Index, SSIM), a Peak Signal-to-Noise Ratio Parameter (PSNR), and the like.
Specifically, after acquiring the live broadcast image quality evaluation parameters of each live broadcast picture frame, the live broadcast optimization device compares the live broadcast image quality evaluation parameters with the image quality evaluation parameters, so as to determine whether the live broadcast picture frame is an abnormal picture frame according to a comparison result.
Optionally, if the live broadcast image quality evaluation parameter is greater than a preset image quality evaluation threshold, the live broadcast optimization device determines that a live broadcast image frame corresponding to the live broadcast image quality evaluation parameter is a normal image frame, that is, the live broadcast image quality of the target live broadcast room is normal.
Optionally, if the live broadcast image quality evaluation parameter is smaller than a preset image quality evaluation threshold, the live broadcast optimization device determines that a live broadcast picture frame corresponding to the live broadcast image quality evaluation parameter is an abnormal picture frame, and the live broadcast optimization device determines that a live broadcast rendering link of the target live broadcast room is abnormal.
Optionally, in other embodiments, the live broadcast optimizing device is further in communication connection with a preset streaming media server, a picture quality detection model is preset in the streaming media server, live broadcast picture frames displayed in a target live broadcast room are collected in real time through the picture quality detection model, and VQA picture quality detection is performed on the live broadcast picture frames, so that abnormal picture frames in the target live broadcast room are determined.
203. Acquiring the rendering log information of each live broadcast rendering stage associated with the abnormal picture frame, comparing the rendering log information of each live broadcast rendering stage, and positioning the abnormal rendering stage of the target live broadcast room;
specifically, when the live broadcast optimizing device detects that the image quality of the target live broadcast room is abnormal, the live broadcast optimizing device drags back the rendering log information of the live broadcast rendering stage associated with the abnormal image frame, and the rendering abnormality detection is carried out on the live broadcast rendering link associated with the target live broadcast room through the rendering log information, so that the abnormal rendering stage of the rendering abnormality in the target live broadcast room is positioned.
As can be seen from fig. 3a and fig. 3b, fig. 3a is a schematic view of a scene of an embodiment of each live rendering stage in a live rendering link of a target live room in the live optimization method provided in the embodiment of the present application. Fig. 3b is a schematic view of a scene of a specific embodiment of a live rendering link of a target live room for rendering each live frame provided in the embodiments of the present application. Specifically, the live broadcast rendering link of the target live broadcast room at least comprises a live broadcast shooting module, a live broadcast rendering module, a live broadcast coding module and a live broadcast distributing module. The live broadcast shooting module is a shooting module for acquiring live broadcast picture images for anchor users. The live broadcast rendering module is a rendering module which performs operations such as beautifying and rendering on live broadcast picture images acquired by the live broadcast shooting module. The live broadcast encoding module is an encoding plug flow module for encoding, compressing and plug flow operations on the rendered live broadcast picture images. The live broadcast distribution module is a content distribution module for transmitting the coded live broadcast picture image to a viewer client side of a target live broadcast room based on a content distribution network.
As can be seen from fig. 3b, the rendering process of each of the anycast frames at least includes the following steps:
the live broadcast shooting module collects live broadcast picture images associated with a target live broadcast room, and throws out each frame of live broadcast picture image to the live broadcast rendering module;
the live broadcast rendering module detects whether a target live broadcast room starts a beautifying filter processor, if the beautifying filter processor is started, the live broadcast rendering module renders and beautifies live broadcast picture images according to beautifying items set by the beautifying filter processor and a preset rendering method, renders the live broadcast picture images according to default rendering logic and the preset rendering method when receiving an original stream recording instruction, beautifies the rendered live broadcast picture images according to beautifying items set by the beautifying filter processor, and outputs the rendered live broadcast picture images to the live broadcast coding module after the rendering is completed.
If the beautifying filter processor is not started, the live broadcast rendering module renders the live broadcast picture image according to a default rendering logic and a preset rendering method, and the live broadcast picture image after the live broadcast coding module is rendered is output. The preset rendering method is a surface texture. The default rendering logic is to render the OES texture as a 2D texture.
And the live broadcast shooting module also distributes the rendered live broadcast picture image to a preset display screen for preview display.
The live broadcast encoding module encodes the rendered live broadcast picture image through a preset push stream SDK (Software Development Kit ) to obtain a live broadcast picture frame and transmits the live broadcast picture frame to the live broadcast distribution module.
And the live broadcast distribution module distributes the coded live broadcast picture image to a corresponding audience terminal of the target live broadcast room for display.
Specifically, a first direct-broadcasting rendering stage and a second direct-broadcasting rendering stage are further arranged in the direct-broadcasting rendering link of the target direct-broadcasting room, and the first direct-broadcasting rendering stage is earlier than the second direct-broadcasting rendering stage. Taking a live broadcast rendering link of the live broadcast shooting module, the live broadcast rendering module, the live broadcast encoding module and the live broadcast distribution module as an example, wherein in an alternative embodiment, a live broadcast rendering stage from the live broadcast shooting module to the live broadcast rendering module is a first live broadcast rendering stage, and a live broadcast rendering stage from the live broadcast rendering module to the live broadcast encoding module is a second live broadcast rendering stage. In another alternative embodiment, the live rendering phase from the live rendering module to the live encoding module is a first live rendering phase, and the live rendering phase from the live encoding module to the live distributing module is a second live rendering phase.
Specifically, the live broadcast optimizing device calculates image quality evaluation parameters corresponding to the abnormal picture frames in each live broadcast rendering stage according to the rendering log information, so that the abnormal rendering stage in the live broadcast rendering link is determined according to the image quality evaluation parameters.
Specifically, the live broadcast optimizing device acquires first rendering log information associated with the abnormal picture frame in a first live broadcast rendering stage and first rendering log information associated with the abnormal picture frame in a second live broadcast rendering stage in the target live broadcast room. The first rendering log information includes a first rendering image of an abnormal picture frame in a first direct-broadcasting rendering stage and first image quality information. The second rendering log information contains a second rendering image of the abnormal picture frame in a second live rendering stage and second image quality information.
Specifically, the live broadcast optimizing device calculates a first image quality evaluation parameter of a first rendered image corresponding to the abnormal picture frame in a first live broadcast rendering stage according to the first image quality information in the first rendering log, and calculates a second image quality evaluation parameter of a second rendered image corresponding to the abnormal picture frame in a second live broadcast rendering stage according to the second image quality information in the second rendering log. And the live broadcast optimizing equipment positions an abnormal rendering stage which leads to the reduction of the live broadcast picture in the live broadcast rendering link according to the first image quality evaluation parameter, the second image quality evaluation parameter and the preset image quality evaluation threshold value.
Specifically, the live broadcast optimizing device compares the acquired first image quality evaluation parameter, the second image quality evaluation parameter and a preset image quality evaluation threshold value, and determines an abnormal rendering stage in the live broadcast rendering link according to a comparison result.
Optionally, if the first image quality evaluation parameter and the second image quality evaluation parameter are both greater than a preset image quality evaluation threshold, and a difference between the first image quality evaluation parameter and the second image quality evaluation parameter is less than a preset difference threshold, the live broadcast optimization device determines that the first live broadcast rendering stage and the second live broadcast rendering stage are normal rendering stages.
Optionally, if the second image quality evaluation parameter is lower than the first image quality evaluation parameter and lower than a preset image quality evaluation threshold, that is, the second image quality of the second rendered image in the second live broadcast rendering stage is lower than the first rendered image quality of the first live broadcast rendering stage, that is, the live broadcast picture image is processed by the second live broadcast rendering stage, the image quality abnormality problem occurs, so that the live broadcast optimizing device sets the second live broadcast rendering stage as an abnormal rendering stage.
Optionally, in other embodiments, before comparing the rendering log information of each live rendering stage, the live optimization device further performs anomaly detection for an initial stage, that is, an image capturing stage, of a live rendering link corresponding to the target live room, so as to determine whether the live image is abnormal caused by the image capturing stage.
The live broadcast optimizing equipment acquires shooting log information in an image shooting stage of a target live broadcast room, wherein the shooting log information is a log record recording target shooting images and image information of the target shooting images in a live broadcast shooting process. Wherein the image information includes image noise data and image sharpening data.
Specifically, the live broadcast optimizing device compares the image noise data with a preset noise threshold value, and compares the image sharpening data with a preset sharpening parameter threshold value, so as to determine whether the target shooting image is an abnormal shooting image with poor image quality.
Optionally, if the image noise data is smaller than a preset noise threshold and the image sharpening data is smaller than a preset sharpening parameter threshold, the live broadcast optimization device determines that the target shooting image is a normal shooting image with normal image quality, and determines that the image shooting stage is a normal operation image shooting stage.
Optionally, if the image noise data is greater than a preset noise threshold and/or the image sharpening data is greater than a preset sharpening parameter threshold, determining that the target shot image is a shot image with abnormal image quality, and determining that the image shooting stage is an abnormal rendering stage of the target live broadcasting room.
204. And optimizing the abnormal rendering stage to obtain an image quality optimizing result.
Specifically, after the live broadcast optimizing device locates the abnormal rendering stage in the live broadcast rendering link corresponding to the target live broadcast room, the abnormal rendering stage is optimized according to the image quality optimizing strategy corresponding to the abnormal rendering stage, so that an image quality optimizing result is obtained. The image quality optimization strategy is an optimization rule set which comprises image quality optimization for an abnormal link module in an abnormal rendering stage. Optionally, the image quality optimization strategy includes a shooting optimization strategy, a beautifying optimization strategy, a coding optimization strategy and the like.
Specifically, after determining an abnormal rendering stage of a target live broadcasting room, the live broadcasting optimization device determines an abnormal link module corresponding to the abnormal rendering stage, acquires an image quality optimization strategy corresponding to the abnormal link module, and performs optimization processing on the abnormal rendering stage based on the image quality optimization strategy to obtain an image quality optimization result. The abnormal link module is a live broadcast rendering module which causes abnormal degradation of image quality in a live broadcast rendering link. The abnormal link module in the live broadcast rendering link at least comprises any one or more of an abnormal shooting module, an abnormal rendering module and an abnormal coding module.
Optionally, in a specific embodiment, if the live broadcast optimizing device determines that the abnormal rendering stage is an abnormal encoding stage, determining that the abnormal link module is an abnormal encoding module, and obtaining an encoding optimization policy corresponding to the abnormal encoding module, where the encoding optimization policy includes a target encoding policy and a target encoding format.
Specifically, the live broadcast optimizing device checks the encoding compression format and the initial encoding strategy of the abnormal encoding module, and optimizes the abnormal encoding module through the target encoding strategy and the target encoding format in the encoding optimizing strategy after detecting the abnormal encoding compression format and/or the abnormal encoding strategy to obtain the optimized encoding module.
Specifically, after the live broadcast optimizing device acquires the optimizing coding module, the optimizing coding device acquires an optimizing coding image coded by the optimizing coding module, and detects the image quality of the optimizing coding image, and if the image quality evaluation parameter of the optimizing coding image is greater than a preset image quality evaluation threshold, the optimizing coding module outputs an optimizing result of the image quality.
As shown in fig. 4, fig. 4 is a timing diagram of one embodiment of a live broadcast optimization method according to an embodiment of the present application. As can be seen from fig. 4, in the live broadcast optimization process of the embodiment, the live broadcast optimization device is a live broadcast server, and the target service terminal is a live broadcast client. The live broadcast optimizing equipment can detect live broadcast pictures of the target service terminal, drive the target service terminal to collect live broadcast picture quality information corresponding to live broadcast picture frames and live broadcast picture frames of the target live broadcast room, receive uploaded live broadcast picture frames and live broadcast picture quality information which are sent by target service emphasis, detect the picture quality of the live broadcast picture frames and the live broadcast picture quality information, if abnormal picture frames are detected, retrieve rendering log information of each live broadcast rendering stage which is related to the abnormal picture frames of the target live broadcast room, analyze the abnormal rendering stages in the target live broadcast room through the rendering log information, send picture quality optimizing strategies to the target service terminal, drive the target service emphasis to conduct live broadcast rendering optimizing processing based on the picture quality optimizing strategies, and obtain picture quality optimizing results so as to improve the live broadcast picture quality of the target live broadcast room.
In this embodiment, the live broadcast optimizing device determines whether the live broadcast frame is an abnormal frame by acquiring the live broadcast frame displayed in the target live broadcast room and live broadcast image quality information in the live broadcast frame and performing image quality detection on the live broadcast frame according to the live broadcast image quality information, acquires the rendering log information of each live broadcast rendering stage associated with the abnormal frame in the live broadcast rendering link when determining that the abnormal frame exists in the target live broadcast room, compares the rendering log information of each live broadcast rendering stage, determines an abnormal rendering stage in the target live broadcast room, and performs optimization processing on the abnormal rendering stage to obtain an image quality optimizing result. The method and the device can accurately and rapidly position the image quality abnormal factors in the live broadcast process, and can pertinently optimize the abnormal rendering stage corresponding to the image quality abnormal factors, so that the image quality stability in the live broadcast process is improved.
As shown in fig. 5, fig. 5 is a schematic flow chart of an embodiment of performing image quality optimization on an abnormal shooting module in the live broadcast optimization method provided in the embodiment of the present application, and specifically, based on the foregoing embodiment, in this embodiment, the live broadcast optimization method further includes steps 301 to 303:
301. If the abnormal link module is an abnormal shooting module, determining the image quality optimization strategy as a shooting optimization strategy;
specifically, if the live broadcast optimizing device analyzes the shooting log information, it is determined that the abnormal rendering stage of the target live broadcast room is an abnormal shooting stage, that is, the live broadcast optimizing device determines that the abnormal link module of the target live broadcast room is an abnormal camera module. That is, the frame captured by the camera module used for collecting the live image frame in the target live broadcasting room is abnormal, so that the image quality of the live image frame displayed in the subsequent live broadcasting room is poor.
Specifically, after determining that the abnormal link module is an abnormal shooting module, the live broadcast optimizing device further determines that the image quality optimizing strategy of the target live broadcast room is a shooting optimizing strategy. The shooting optimization strategy is a preset optimization rule set containing at least one camera optimization parameter such as focusing optimization parameters, white balance optimization parameters and camera switching parameters.
The focusing optimization parameters are optimization parameters for performing focusing mode debugging optimization on the abnormal shooting module.
The white balance optimization parameters are optimization parameters for performing white balance parameter debugging optimization on the abnormal shooting module.
The camera switching parameters are optimized parameters for switching the camera of the abnormal shooting module.
302. Optimizing the abnormal shooting module based on focusing optimization parameters, white balance optimization parameters and/or camera switching parameters in the shooting optimization strategy to obtain an optimized shooting module;
specifically, after acquiring a shooting optimization strategy, the live broadcast optimization device performs image quality optimization processing on the abnormal camera module according to the shooting optimization strategy to obtain an optimized shooting module.
Specifically, the live broadcast optimizing device acquires an initial focusing parameter and an initial white balance parameter in the abnormal shooting module, compares the initial focusing parameter with the focusing optimizing parameter, and updates the initial focusing parameter according to the focusing optimizing parameter if the initial focusing parameter is different from the focusing optimizing parameter, so as to obtain an updated focusing parameter.
Specifically, the live broadcast optimizing device can also compare the initial white balance parameter with the white balance optimizing parameter, and if the initial white balance parameter and the white balance optimizing parameter are different, the initial focusing parameter is updated according to the white balance optimizing parameter to obtain an updated white balance parameter.
Optionally, in other embodiments, the live broadcast optimizing device further compares a current camera identifier of the abnormal shooting module, and if the current camera identifier is different from a target camera identifier corresponding to the camera switching parameter, switches the current shooting unit in the abnormal shooting module to the target shooting unit according to the camera switching parameter.
Specifically, the live broadcast optimizing device optimizes the image quality of the abnormal shooting module according to the shooting optimizing strategy, and then sets the optimized abnormal camera module as the optimized shooting module.
303. And acquiring an optimized shooting image acquired by the optimized shooting module, and outputting an image quality optimization result of the optimized shooting module according to the optimized shooting image.
Specifically, after the live broadcast optimizing device optimizes the abnormal shooting module of the target live broadcast room, the optimizing shooting module acquires an optimizing shooting image acquired by the optimizing shooting module, and detects the image quality of the optimizing shooting image, and if the image quality evaluation parameter of the optimizing shooting image is greater than a preset image quality evaluation threshold, an image quality optimizing result obtained by optimizing the shooting module is output.
The image quality detection method is the same as that of the above embodiment, and the embodiment is not described in detail.
In this embodiment, if the live broadcast optimization device determines that the abnormal link module is an abnormal shooting module, the image quality optimization policy is determined to be a shooting optimization policy; optimizing the abnormal shooting module based on focusing optimization parameters, white balance optimization parameters and/or camera switching parameters in the shooting optimization strategy to obtain an optimized shooting module; and acquiring an optimized shooting image acquired by the optimized shooting module, and outputting an image quality optimization result of the optimized shooting module according to the optimized shooting image. The abnormal shooting module for live broadcast acquisition is subjected to targeted image quality optimization, so that the image quality of live broadcast display picture frames is improved.
As shown in fig. 6, fig. 6 is a schematic flow chart of an embodiment of performing image quality optimization on an abnormal rendering module in the live broadcast optimization method provided in the embodiment of the present application, and specifically, based on the foregoing embodiment, in this embodiment, the live broadcast optimization method further includes steps 401 to 404:
401. if the abnormal link module is an abnormal rendering module, determining that the image quality optimization strategy is a rendering optimization strategy;
specifically, when comparing the rendering log information and judging that the rendered image has image quality problems such as picture noise, serious sharpening and the like, the live broadcast optimizing device determines an abnormal rendering stage as an abnormal rendering stage, and after the abnormal link module is an abnormal rendering module, the live broadcast optimizing device acquires a rendering optimizing strategy corresponding to the abnormal rendering module. The rendering optimization strategy is a rule set which comprises target beautifying items and corresponding target beautifying parameters and can adjust and optimize the abnormal rendering module. Wherein, the target beautification item is an image/portrait beautification item for improving the image quality effect. The target beautification parameters are optimized image/portrait beautification parameters corresponding to the target beautification items. Wherein, in one particular embodiment, the exception rendering module is a rendering SDK (Software Development Kit ) of the target live application.
402. Identifying an abnormal beautification item associated with the abnormal picture frame in the abnormal rendering module and an abnormal beautification parameter of the abnormal beautification item;
specifically, the live broadcast optimizing device checks the initial beautification item set by the user in the abnormal rendering module according to the rendering optimizing strategy, and locates the abnormal beautification item which causes the abnormal picture frame image quality to be reduced in the initial beautification item and the abnormal beautification parameter of the abnormal beautification item.
Specifically, the live broadcast optimizing device acquires initial beautification items in the abnormal rendering module, judges whether the initial beautification parameters in the initial beautification items exceed corresponding target beautification thresholds according to the rendering optimizing strategy, sets the initial beautification items corresponding to the initial beautification parameters exceeding the target beautification thresholds as abnormal beautification items, and sets the initial beautification parameters exceeding the target beautification thresholds as abnormal beautification parameters.
403. Adjusting the abnormal beautification parameters based on the target beautification parameters of the target beautification items in the rendering optimization strategy to obtain an optimized rendering module;
specifically, after the live broadcast optimizing device acquires the abnormal beautification item and the corresponding abnormal beautification parameter, the live broadcast optimizing device also determines whether the abnormal beautification item is an abnormal beautification item capable of adjusting and optimizing, and if the abnormal beautification parameter of the abnormal beautification item can be adjusted, the abnormal beautification item and the abnormal beautification parameter in the abnormal rendering module are corrected according to the target beautification item in the rendering optimizing strategy and the target beautification parameter corresponding to the target beautification item, so as to obtain the optimized rendering module. In one embodiment, the abnormal beautification items include beautification rendering items such as skin abrasion amplitude, whitening amplitude, tone scale amplitude, contrast amplitude and the like.
Specifically, the live broadcast optimizing device sends a rendering adjustment instruction to a target service terminal corresponding to the target live broadcast room according to the target beautifying item and the target beautifying parameter so as to adjust and optimize the adjustable abnormal beautifying item and the adjustable abnormal beautifying parameter in the abnormal rendering module, thereby obtaining the optimized rendering module.
404. And obtaining an optimized rendering image rendered by the optimized rendering module, and determining an image quality optimization result of the optimized rendering module according to the optimized rendering image.
Specifically, after the image quality of the abnormal rendering module is optimized, the live broadcast optimizing device further obtains an optimized rendering image rendered by the optimized rendering module, and detects the image quality of the optimized rendering image, and if the image quality evaluation parameter of the optimized rendering image is greater than a preset image quality evaluation threshold, an image quality optimizing result obtained by optimizing the rendering module is output.
Optionally, if the image quality evaluation parameter of the optimized rendered image is lower than a preset image quality evaluation threshold, the live broadcast optimization device determines that the abnormal beautification item and the abnormal beautification parameter of the abnormal rendering module are non-adjustable abnormal beautification item and abnormal beautification parameter. The live broadcast optimizing device reads the current version number of the optimizing rendering module, and obtains a rendering update package of the optimizing rendering module from the application update server based on the current version number.
Specifically, the live broadcast optimizing device updates the optimized rendering module based on the rendering update package to obtain an updated rendering module, acquires an updated rendering image rendered by the updated rendering module, calculates an updated image quality evaluation parameter of the updated rendering image, and outputs an image quality optimizing result optimized by the live broadcast rendering module if the updated image quality evaluation parameter is higher than a preset image quality evaluation threshold.
In this embodiment, the live broadcast optimizing device determines the image quality optimizing policy as the rendering optimizing policy by determining the abnormal link module as the abnormal rendering module; identifying an abnormal beautification item associated with the abnormal picture frame in the abnormal rendering module and an abnormal beautification parameter of the abnormal beautification item; adjusting the abnormal beautification parameters based on the target beautification parameters of the target beautification items in the rendering optimization strategy to obtain an optimized rendering module; and obtaining an optimized rendering image rendered by the optimized rendering module, and determining an image quality optimization result of the optimized rendering module according to the optimized rendering image. The method and the device realize the image quality optimization of the abnormal beautifying items in the abnormal rendering module in the live broadcast rendering link so as to improve the image quality of live broadcast display picture frames.
In order to better implement the live broadcast optimization method in the embodiment of the present application, on the basis of the live broadcast optimization method, a live broadcast optimization device is further provided in the embodiment of the present application, as shown in fig. 7, fig. 7 is a schematic structural diagram of the live broadcast optimization device provided in the embodiment of the present application, and specifically, the live broadcast optimization device 500 includes:
an information obtaining module 501 configured to obtain a live video frame displayed in a target live broadcasting room to be detected and live video quality information of the live video frame;
the anomaly identification module 502 is configured to detect an anomaly image of a live broadcast picture frame in the target live broadcast room according to the live broadcast image quality information, and determine the anomaly picture frame in the target live broadcast room;
a link positioning module 503 configured to acquire the rendering log information of each live rendering stage associated with the abnormal picture frame, compare the rendering log information of each live rendering stage, and position the abnormal rendering stage of the target live room;
and the live broadcast optimizing module 504 is configured to perform optimizing processing on the abnormal rendering stage to obtain an image quality optimizing result.
In one possible implementation manner of this embodiment, the live broadcast optimizing apparatus obtains the rendering log information of each live broadcast rendering stage associated with the abnormal picture frame, compares the rendering log information of each live broadcast rendering stage, and locates the abnormal rendering stage of the target live broadcast room, including:
Acquiring first rendering log information associated with the abnormal picture frame at a first live broadcast rendering stage in the target live broadcast room and second rendering log information associated with the abnormal picture frame at a second live broadcast rendering stage;
calculating a first image quality evaluation parameter of a first rendered image in the first rendering log information and a second image quality evaluation parameter of a second rendered image in the second rendering log;
and if the second image quality evaluation parameter is lower than the first image quality evaluation parameter and lower than a preset image quality evaluation threshold, setting the second live broadcast rendering stage as an abnormal rendering stage.
In one possible implementation manner of this embodiment, the live broadcast optimizing apparatus obtains the rendering log information of each live broadcast rendering stage associated with the abnormal picture frame, compares the rendering log information of each live broadcast rendering stage, and locates the abnormal rendering stage of the target live broadcast room, including:
acquiring shooting log information of an image shooting stage of the target live broadcasting room, wherein the shooting log information comprises a target shooting image, and image noise data and image sharpening data corresponding to the target shooting image;
and if the image noise data is larger than a preset noise threshold value and/or the image sharpening data is larger than a preset sharpening parameter threshold value, setting the image shooting stage as an abnormal rendering stage of the target live broadcasting room.
In one possible implementation manner of this embodiment, the optimizing process of the abnormal rendering stage by the live broadcast optimizing device, to obtain an image quality optimizing result, includes:
acquiring an abnormal link module corresponding to the abnormal rendering stage, wherein the abnormal link module comprises any one or more of an abnormal shooting module, an abnormal rendering module and an abnormal coding module;
and obtaining an image quality optimization strategy corresponding to the abnormal link module, and performing optimization processing on the abnormal rendering stage based on the image quality optimization strategy to obtain an image quality optimization result.
In one possible implementation manner of this embodiment, the live broadcast optimizing device obtains an image quality optimizing policy corresponding to the abnormal link module, performs optimizing processing on the abnormal rendering stage based on the image quality optimizing policy, and obtains an image quality optimizing result, including:
if the abnormal link module is an abnormal shooting module, determining the image quality optimization strategy as a shooting optimization strategy;
optimizing the abnormal shooting module based on focusing optimization parameters, white balance optimization parameters and/or camera switching parameters in the shooting optimization strategy to obtain an optimized shooting module;
and acquiring an optimized shooting image acquired by the optimized shooting module, and outputting an image quality optimization result of the optimized shooting module according to the optimized shooting image.
In one possible implementation manner of this embodiment, the live broadcast optimizing device obtains an image quality optimizing policy corresponding to the abnormal link module, performs optimizing processing on the abnormal rendering stage based on the image quality optimizing policy, and obtains an image quality optimizing result, including:
if the abnormal link module is an abnormal rendering module, determining that the image quality optimization strategy is a rendering optimization strategy;
identifying an abnormal beautification item associated with the abnormal picture frame in the abnormal rendering module and an abnormal beautification parameter of the abnormal beautification item;
adjusting the abnormal beautification parameters based on the target beautification parameters of the target beautification items in the rendering optimization strategy to obtain an optimized rendering module;
and obtaining an optimized rendering image rendered by the optimized rendering module, and determining an image quality optimization result of the optimized rendering module according to the optimized rendering image.
In one possible implementation manner of this embodiment, the determining, by the live broadcast optimizing device, an image quality optimizing result of the optimized rendering module according to the optimized rendering image includes:
if the image quality evaluation parameter of the optimized rendering image is lower than a preset image quality evaluation threshold, a rendering update package of the optimized rendering module is obtained;
Updating the optimized rendering module based on the rendering update package to obtain an updated rendering module;
and acquiring an updated rendering image of the updated rendering module, and outputting an image quality optimization result corresponding to the updated rendering image.
In one possible implementation manner of this embodiment, the live broadcast optimizing device obtains an image quality optimizing policy corresponding to the abnormal link module, performs optimizing processing on the abnormal rendering stage based on the image quality optimizing policy, and obtains an image quality optimizing result, including:
if the abnormal link module is an abnormal coding module, determining the image quality optimization strategy as a coding optimization strategy;
optimizing the abnormal coding module based on a target coding strategy and a target coding format in the coding optimization strategy to obtain an optimized coding module;
and obtaining an optimized coding image coded by the optimized coding module, and outputting an image quality optimization result corresponding to the optimized coding image.
In this embodiment, the live broadcast optimizing apparatus determines whether the live broadcast frame is an abnormal frame by acquiring the live broadcast frame displayed in the target live broadcast room and live broadcast image quality information in the live broadcast frame, and performing image quality detection on the live broadcast frame according to the live broadcast image quality information, and acquires, when determining that the abnormal frame exists in the target live broadcast room, rendering log information of each live broadcast rendering stage associated with the abnormal frame in the live broadcast rendering link, and compares the rendering log information of each live broadcast rendering stage, determines an abnormal rendering stage in the target live broadcast room, and performs optimization processing on the abnormal rendering stage to obtain an image quality optimizing result. The method and the device can accurately and rapidly position the image quality abnormal factors in the live broadcast process, and can pertinently optimize the abnormal rendering stage corresponding to the image quality abnormal factors, so that the image quality stability in the live broadcast process is improved.
The embodiment of the invention also provides a live broadcast optimizing device, as shown in fig. 8, and fig. 8 is a schematic structural diagram of one embodiment of the live broadcast optimizing device provided in the embodiment of the application.
The live broadcast optimizing device integrates any one of the live broadcast optimizing devices provided by the embodiment of the invention, and the live broadcast optimizing device comprises:
one or more processors;
a memory; and
one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to perform the steps of the live optimization method described in any of the live optimization method embodiments above.
Specifically, the present invention relates to a method for manufacturing a semiconductor device. The live optimization device may include one or more processing cores 'processors 601, one or more computer-readable storage media's memory 602, power supply 603, and input unit 604, among other components. It will be appreciated by those skilled in the art that the live optimization device structure shown in fig. 6 does not constitute a limitation of the live optimization device, and may include more or fewer components than shown, or certain components in combination, or a different arrangement of components. Wherein:
the processor 601 is a control center of the live broadcast optimizing device, connects various parts of the whole live broadcast optimizing device by various interfaces and lines, and performs various functions and processes of the live broadcast optimizing device by running or executing software programs and/or modules stored in the memory 602 and calling data stored in the memory 602, thereby performing overall monitoring of the live broadcast optimizing device. Optionally, the processor 601 may include one or more processing cores; preferably, the processor 601 may integrate an application processor and a modem processor, wherein the application processor primarily handles operating systems, user interfaces, applications, etc., and the modem processor primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 601.
The memory 602 may be used to store software programs and modules, and the processor 601 may execute various functional applications and data processing by executing the software programs and modules stored in the memory 602. The memory 602 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like; the storage data area may store data created from the use of the live optimization device, etc. In addition, the memory 602 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 602 may also include a memory controller to provide access to the memory 602 by the processor 601.
The live optimization device further includes a power supply 603 for powering the various components, and preferably, the power supply 603 may be logically connected to the processor 601 through a power management system, so as to implement functions of managing charging, discharging, and power consumption management through the power management system. The power supply 603 may also include one or more of any components, such as a direct current or alternating current power supply, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and the like.
The live optimization device may also include an input unit 604, which input unit 604 may be used to receive entered numeric or character information and to generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.
Although not shown, the live broadcast optimizing apparatus may further include a display unit or the like, which is not described herein. Specifically, in this embodiment, the processor 601 in the live broadcast optimizing device loads executable files corresponding to the processes of one or more application programs into the memory 602 according to the following instructions, and the processor 601 executes the application programs stored in the memory 602, so as to implement various functions as follows:
acquiring a live broadcast picture frame displayed in a target live broadcast room to be detected and live broadcast picture quality information of the live broadcast picture frame;
detecting abnormal images of live broadcast picture frames in the target live broadcast room according to the live broadcast picture quality information, and determining the abnormal picture frames in the target live broadcast room;
acquiring the rendering log information of each live broadcast rendering stage associated with the abnormal picture frame, comparing the rendering log information of each live broadcast rendering stage, and positioning the abnormal rendering stage of the target live broadcast room;
And optimizing the abnormal rendering stage to obtain an image quality optimizing result.
To this end, embodiments of the present invention provide a computer-readable storage medium, which may include: read-only memory (ROM, read On ly Memory), random access memory (RAM, random Access Memory), magnetic or optical disk, and the like. On which a computer program is stored, which computer program is loaded by a processor for executing the steps of any of the live broadcast optimization methods provided by the embodiments of the present invention. For example, the loading of the computer program by the processor may perform the steps of:
acquiring a live broadcast picture frame displayed in a target live broadcast room to be detected and live broadcast picture quality information of the live broadcast picture frame;
detecting abnormal images of live broadcast picture frames in the target live broadcast room according to the live broadcast picture quality information, and determining the abnormal picture frames in the target live broadcast room;
acquiring the rendering log information of each live broadcast rendering stage associated with the abnormal picture frame, comparing the rendering log information of each live broadcast rendering stage, and positioning the abnormal rendering stage of the target live broadcast room;
and optimizing the abnormal rendering stage to obtain an image quality optimizing result.
In the foregoing embodiments, the descriptions of the embodiments are focused on, and the portions of one embodiment that are not described in detail in the foregoing embodiments may be referred to in the foregoing detailed description of other embodiments, which are not described herein again.
In the implementation, each unit or structure may be implemented as an independent entity, or may be implemented as the same entity or several entities in any combination, and the implementation of each unit or structure may be referred to the foregoing method embodiments and will not be repeated herein.
The specific implementation of each operation above may be referred to the previous embodiments, and will not be described herein.
The foregoing describes in detail a live broadcast optimization method provided by the embodiments of the present application, and specific embodiments are applied to describe the principles and implementations of the present invention, where the foregoing embodiments are only used to help understand the method and core ideas of the present invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in light of the ideas of the present invention, the present description should not be construed as limiting the present invention.

Claims (11)

1. The live broadcast optimization method is characterized by comprising the following steps of:
Acquiring a live broadcast picture frame displayed in a target live broadcast room to be detected and live broadcast picture quality information of the live broadcast picture frame;
detecting abnormal images of live broadcast picture frames in the target live broadcast room according to the live broadcast picture quality information, and determining the abnormal picture frames in the target live broadcast room;
acquiring the rendering log information of each live broadcast rendering stage associated with the abnormal picture frame, comparing the rendering log information of each live broadcast rendering stage, and positioning the abnormal rendering stage of the target live broadcast room;
and optimizing the abnormal rendering stage to obtain an image quality optimizing result.
2. The live optimization method of claim 1, wherein the live rendering phase comprises a first live rendering phase and a second live rendering phase, the first live rendering phase being a previous live rendering phase of the second live rendering phase;
the step of obtaining the rendering log information associated with the abnormal picture frame in each live broadcast rendering stage, comparing the rendering log information of each live broadcast rendering stage, and positioning the abnormal rendering stage of the target live broadcast room comprises the following steps:
acquiring first rendering log information associated with the abnormal picture frame at a first live broadcast rendering stage in the target live broadcast room and second rendering log information associated with the abnormal picture frame at a second live broadcast rendering stage;
Calculating a first image quality evaluation parameter of a first rendered image in the first rendering log information and a second image quality evaluation parameter of a second rendered image in the second rendering log;
and if the second image quality evaluation parameter is lower than the first image quality evaluation parameter and lower than a preset image quality evaluation threshold, setting the second live broadcast rendering stage as an abnormal rendering stage.
3. The live broadcast optimization method of claim 1, wherein the obtaining the render log information associated with the abnormal picture frame in each live broadcast rendering stage, comparing the render log information of each live broadcast rendering stage, and locating the abnormal rendering stage of the target live broadcast room, comprises:
acquiring shooting log information of an image shooting stage of the target live broadcasting room, wherein the shooting log information comprises a target shooting image, and image noise data and image sharpening data corresponding to the target shooting image;
and if the image noise data is larger than a preset noise threshold value and/or the image sharpening data is larger than a preset sharpening parameter threshold value, setting the image shooting stage as an abnormal rendering stage of the target live broadcasting room.
4. The live broadcast optimizing method as claimed in claim 1, wherein the optimizing the abnormal rendering stage to obtain an image quality optimizing result comprises:
Acquiring an abnormal link module corresponding to the abnormal rendering stage, wherein the abnormal link module comprises any one or more of an abnormal shooting module, an abnormal rendering module and an abnormal coding module;
and obtaining an image quality optimization strategy corresponding to the abnormal link module, and performing optimization processing on the abnormal rendering stage based on the image quality optimization strategy to obtain an image quality optimization result.
5. The live broadcast optimization method according to claim 4, wherein the obtaining the image quality optimization policy corresponding to the abnormal link module, and performing optimization processing on the abnormal rendering stage based on the image quality optimization policy, to obtain an image quality optimization result, includes:
if the abnormal link module is an abnormal shooting module, determining the image quality optimization strategy as a shooting optimization strategy;
optimizing the abnormal shooting module based on focusing optimization parameters, white balance optimization parameters and/or camera switching parameters in the shooting optimization strategy to obtain an optimized shooting module;
and acquiring an optimized shooting image acquired by the optimized shooting module, and outputting an image quality optimization result of the optimized shooting module according to the optimized shooting image.
6. The live broadcast optimization method according to claim 4, wherein the obtaining the image quality optimization policy corresponding to the abnormal link module, and performing optimization processing on the abnormal rendering stage based on the image quality optimization policy, to obtain an image quality optimization result, includes:
If the abnormal link module is an abnormal rendering module, determining that the image quality optimization strategy is a rendering optimization strategy;
identifying an abnormal beautification item associated with the abnormal picture frame in the abnormal rendering module and an abnormal beautification parameter of the abnormal beautification item;
adjusting the abnormal beautification parameters based on the target beautification parameters of the target beautification items in the rendering optimization strategy to obtain an optimized rendering module;
and obtaining an optimized rendering image rendered by the optimized rendering module, and determining an image quality optimization result of the optimized rendering module according to the optimized rendering image.
7. The live broadcast optimization method of claim 6, wherein the determining an image quality optimization result of the optimized rendering module from the optimized rendering image comprises:
if the image quality evaluation parameter of the optimized rendering image is lower than a preset image quality evaluation threshold, a rendering update package of the optimized rendering module is obtained;
updating the optimized rendering module based on the rendering update package to obtain an updated rendering module;
and acquiring an updated rendering image of the updated rendering module, and outputting an image quality optimization result corresponding to the updated rendering image.
8. The live broadcast optimization method according to claim 4, wherein the obtaining the image quality optimization policy corresponding to the abnormal link module, and performing optimization processing on the abnormal rendering stage based on the image quality optimization policy, to obtain an image quality optimization result, includes:
if the abnormal link module is an abnormal coding module, determining the image quality optimization strategy as a coding optimization strategy;
optimizing the abnormal coding module based on a target coding strategy and a target coding format in the coding optimization strategy to obtain an optimized coding module;
and obtaining an optimized coding image coded by the optimized coding module, and outputting an image quality optimization result corresponding to the optimized coding image.
9. A live broadcast optimizing device, characterized in that the live broadcast optimizing device comprises:
the information acquisition module is configured to acquire live broadcast picture frames displayed in a target live broadcast room to be detected and live broadcast image quality information of the live broadcast picture frames;
the abnormal identification module is configured to detect abnormal images of live broadcast picture frames in the target live broadcast room according to the live broadcast picture quality information, and determine the abnormal picture frames in the target live broadcast room;
The link positioning module is configured to acquire the rendering log information of each live broadcast rendering stage associated with the abnormal picture frame, compare the rendering log information of each live broadcast rendering stage and position the abnormal rendering stage of the target live broadcast room;
and the live broadcast optimization module is configured to perform optimization processing on the abnormal rendering stage to obtain an image quality optimization result.
10. A live broadcast optimizing device, characterized in that the live broadcast optimizing device comprises:
one or more processors;
a memory; and
one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the steps of the live optimization method of any of claims 1 to 8.
11. A computer readable storage medium, characterized in that it has stored thereon a computer program, which is loaded by a processor to perform the steps of the live optimization method of any of claims 1 to 8.
CN202311656917.2A 2023-12-05 2023-12-05 Live broadcast optimization method, device, equipment and storage medium Pending CN117615211A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311656917.2A CN117615211A (en) 2023-12-05 2023-12-05 Live broadcast optimization method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311656917.2A CN117615211A (en) 2023-12-05 2023-12-05 Live broadcast optimization method, device, equipment and storage medium

Publications (1)

Publication Number Publication Date
CN117615211A true CN117615211A (en) 2024-02-27

Family

ID=89956018

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311656917.2A Pending CN117615211A (en) 2023-12-05 2023-12-05 Live broadcast optimization method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN117615211A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021139235A1 (en) * 2020-06-30 2021-07-15 平安科技（深圳）有限公司 Method and apparatus for system exception testing, device, and storage medium
CN114513655A (en) * 2022-02-25 2022-05-17 广州方硅信息技术有限公司 Live video quality evaluation method, video quality adjustment method and related device
JP2023019828A (en) * 2021-07-29 2023-02-09 株式会社ユピテル Information processing system, image processing device, and program and the like
WO2023050967A1 (en) * 2021-09-29 2023-04-06 中兴通讯股份有限公司 System abnormality detection processing method and apparatus
CN116016460A (en) * 2021-10-22 2023-04-25 华为技术有限公司 Communication method and device
CN116567291A (en) * 2022-01-27 2023-08-08 腾讯科技（深圳）有限公司 Image quality improving method and device, computer readable storage medium and computer equipment
CN116723081A (en) * 2023-05-31 2023-09-08 视联动力信息技术股份有限公司 Packet loss optimization method and device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021139235A1 (en) * 2020-06-30 2021-07-15 平安科技（深圳）有限公司 Method and apparatus for system exception testing, device, and storage medium
JP2023019828A (en) * 2021-07-29 2023-02-09 株式会社ユピテル Information processing system, image processing device, and program and the like
WO2023050967A1 (en) * 2021-09-29 2023-04-06 中兴通讯股份有限公司 System abnormality detection processing method and apparatus
CN116016460A (en) * 2021-10-22 2023-04-25 华为技术有限公司 Communication method and device
CN116567291A (en) * 2022-01-27 2023-08-08 腾讯科技（深圳）有限公司 Image quality improving method and device, computer readable storage medium and computer equipment
CN114513655A (en) * 2022-02-25 2022-05-17 广州方硅信息技术有限公司 Live video quality evaluation method, video quality adjustment method and related device
CN116723081A (en) * 2023-05-31 2023-09-08 视联动力信息技术股份有限公司 Packet loss optimization method and device

Similar Documents

Publication Publication Date Title
US9277165B2 (en) Video surveillance system and method using IP-based networks
US8923611B2 (en) Automatic background identification in video images
CN111316650A (en) Three-dimensional model encoding device, three-dimensional model decoding device, three-dimensional model encoding method, and three-dimensional model decoding method
CN104349056A (en) Image processing apparatus, image processing method, and program
CN110620924B (en) Method and device for processing coded data, computer equipment and storage medium
CN112672149B (en) Video processing method and device, storage medium and server
CN111405312A (en) Live broadcast stream pushing method, device, terminal, server and storage medium
CN113192164A (en) Avatar follow-up control method and device, electronic equipment and readable storage medium
CN110532837B (en) Image data processing method in article picking and placing process and household appliance
CN111050027B (en) Lens distortion compensation method, device, equipment and storage medium
CN111885371A (en) Image occlusion detection method and device, electronic equipment and computer readable medium
CN117615211A (en) Live broadcast optimization method, device, equipment and storage medium
CN109672829B (en) Image brightness adjusting method and device, storage medium and terminal
CN114143429B (en) Image shooting method, device, electronic equipment and computer readable storage medium
CN114945097B (en) Video stream processing method and device
CN112118457B (en) Live broadcast data processing method and device, readable storage medium and computer equipment
CN114079777A (en) Video processing method and device
CN113873325B (en) Sound processing method, device, equipment and computer readable storage medium
CN117459757A (en) Video playing method, device, equipment and storage medium
CN117132716B (en) Power environment monitoring method and device, electronic equipment and storage medium
CN115278305B (en) Video processing method, video processing system, and storage medium
CN114170289A (en) Image processing method, image processing device, computer equipment and computer readable storage medium
CN117412013A (en) Image quality adjustment method, image quality adjustment device, electronic device, and computer storage medium
CN116362985A (en) Image processing method, device, equipment and storage medium
CN116434321A (en) Human body posture recognition method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination