CN112541858A

CN112541858A - Video image enhancement method, device, equipment, chip and storage medium

Info

Publication number: CN112541858A
Application number: CN201910895085.7A
Authority: CN
Inventors: 周爱彬
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2019-09-20
Filing date: 2019-09-20
Publication date: 2021-03-23
Also published as: WO2021052040A1

Abstract

The application provides a video image enhancement method, a video image enhancement device, video image enhancement equipment, a video image enhancement chip and a storage medium. The method comprises the following steps: the server receives a request message sent by the terminal equipment, wherein the request message comprises the identification of the video image. And the server acquires the picture parameters of at least one view angle area in the video image according to the identification of the video image and sends the picture parameters of at least one view angle area to the terminal equipment. And the terminal equipment performs enhancement processing on the video image according to the picture parameters of at least one view angle area. The method can improve the video image display effect.

Description

Video image enhancement method, device, equipment, chip and storage medium

Technical Field

The present application relates to the field of video image processing technologies, and in particular, to a method, an apparatus, a device, a chip, and a storage medium for enhancing a video image.

Background

When the terminal device plays a Virtual Reality (VR) 360-degree film source, if the configuration of the terminal device is low, the terminal device may cut the film source into a plurality of small blocks in order to play a high-resolution film source, and when the film source is played, only a part of the blocks in the view angle area is spliced and displayed. In addition, to avoid the problem that the data stream in the view angle region cannot be downloaded and displayed in time, the terminal device may superimpose a layer of background stream with lower resolution and lower code rate on the background portion, for example: the resolution of the background stream is 4K, the resolution of the data stream in the viewing angle area is 8K (i.e. high definition stream), and the contents of the background stream and the high definition stream are completely the same and completely overlapped after projection, based on which, when the user viewing angle is switched to the above viewing angle area, if the high definition stream cannot be displayed in time, the user sees the contents of the background stream. For example: fig. 1 is a schematic diagram of a film source provided by the prior art, which is cut into 72 pieces, and as shown in fig. 1, a viewing angle area 1 is a portion that a user can actually see at the same time. When the terminal device plays the film source, if the terminal device can download the high definition stream in time, the high definition stream is played in the view angle area 1, and if the terminal device cannot download the high definition stream in time, the low definition stream (namely, the background stream) is played in the view angle area 1, and the low definition stream is still played in other parts of the film source.

For video images such as VR360 film sources, the brightness, contrast, and color saturation values of the video images are for the entire video images during encoding, so if the terminal device plays the content in the view angle area, the brightness, contrast, and color saturation values of the entire 360-degree image are used, which will cause the problem of poor display effect, such as dark appearance, insufficient vivid color, and the like, in the view angle area.

Disclosure of Invention

The application provides a video image enhancement method, a video image enhancement device, video image enhancement equipment, a video image enhancement chip and a storage medium. The method can improve the video image display effect.

In a first aspect, the present application provides a video image enhancement method, including: the server receives a request message sent by the terminal equipment, wherein the request message comprises the identification of the video image. And the server acquires the picture parameters of at least one view angle area in the video image according to the identification of the video image. And the server sends the picture parameters of at least one view angle area to the terminal equipment. Wherein, the picture parameters of at least one view angle region include: and the enhancement parameters corresponding to any one of the at least one view angle area are used for the terminal equipment to perform enhancement processing on the view angle area.

Namely, the method can improve the video image display effect. Furthermore, according to the technical scheme provided by the application, the video image can be enhanced and refined to each visual angle area or main visual angle area, each visual angle area has corresponding enhancement parameters, and the video image enhancement is not performed on the whole video image, so that the video image display effect can be further improved.

Optionally, before the server receives the request message sent by the terminal device, the method further includes: the server determines picture parameters for at least one view angle region.

Optionally, the server determines a picture parameter of at least one view angle area, including: if the mean value of the brightness components of the pixels in the video image is smaller than the brightness threshold value and the number of the first pixels is larger than a first preset number, determining the brightness enhancement parameters respectively corresponding to at least one viewing angle area, wherein the first pixels are pixels of which the brightness components are smaller than the mean value of the brightness components in the pixels. And/or determining saturation enhancement parameters respectively corresponding to at least one viewing angle area if the saturation component mean value of each pixel in the video image is smaller than the saturation threshold value and the number of second pixels is larger than a second preset number, wherein the second pixels are pixels of which the saturation components are smaller than the saturation component mean value in each pixel. And/or if the contrast component mean value of each pixel in the video image is smaller than the contrast threshold value and the number of the third pixels is larger than the second preset number, determining the contrast enhancement parameters respectively corresponding to at least one viewing angle area, wherein the third pixels are pixels of which the contrast components are smaller than the contrast component mean value in each pixel. And/or if the sharpening degree component mean value of each pixel in the video image is smaller than the sharpening degree threshold value and the number of the fourth pixels is larger than the second preset number, determining sharpening degree enhancement parameters respectively corresponding to at least one view angle area, wherein the fourth pixels are pixels of which the sharpening degree components are smaller than the sharpening degree component mean value in each pixel.

That is, when each pixel in the video image satisfies the condition, the server determines the picture parameter of at least one view angle area, and when each pixel in the video image does not satisfy the condition, the server does not determine the picture parameter of at least one view angle area, and accordingly, the terminal device does not perform video image enhancement processing, so that the flexibility of video image enhancement processing can be improved, and the power consumption of the server and the terminal device can be reduced. Optionally, the plurality of view angle areas cover the video image.

Alternatively, the encoder may encode a video image, which may be injected into a service/media management server that generates a unique identification for the video image. The encoder may also inject the video images to a streaming server, i.e. the streaming server is used to store the video images. The terminal device and the image enhancement server can obtain the identification of the video image from the service/media management server. When the terminal equipment needs to play the video image, the terminal equipment sends a request message carrying the identification of the video image to the image enhancement server so as to request to acquire the picture parameter corresponding to the at least one view angle area. And the terminal device may obtain the video image from the streaming server.

Alternatively, the service/media management server, the streaming server and the image enhancement server are one server, and in this case, the encoder may encode the video image to generate a video image, and the video image may be injected into the image enhancement server, and the image enhancement server generates a unique identifier of the video image. The encoder may also inject the video images to an image enhancement server, i.e. the image enhancement server is used to store the video images. Wherein, the terminal device can obtain the identification of the video image from the image enhancement server. When the terminal equipment needs to play the video image, the terminal equipment sends a request message carrying the identification of the video image to the image enhancement server so as to request to acquire the picture parameters and the video image corresponding to the at least one view angle area.

Alternatively, the service/media management server and the streaming media server are one server, and assuming that the server is referred to as a media server, the encoder may encode the video image to generate a video image, and may inject the video image into the media server, and the media server generates a unique identifier of the video image. The encoder may also inject the video images to a media server, i.e., the media server is used to store the video images. The terminal device and the image enhancement server can obtain the identification of the video image from the media server. When the terminal equipment needs to play the video image, the terminal equipment sends a request message carrying the identification of the video image to the image enhancement server so as to request to acquire the picture parameter corresponding to the at least one view angle area. And the terminal device may obtain the video image from the media server.

Optionally, the picture parameters of the at least one view angle region further include: and the at least one view angle area corresponds to the time stamp and the space range respectively.

The following provides a method for enhancing a video image executed by a terminal device, and an apparatus, a device, a chip, a storage medium and a computer program product for enhancing a video image, where the effects of the method for enhancing a video image refer to the effects corresponding to the method for enhancing a video image, and are not described in detail below.

In a second aspect, the present application provides a method for enhancing a video image, including: the terminal equipment sends a request message to the server, wherein the request message comprises an identifier of a video image, and the identifier of the video image is used for the server to acquire the picture parameters of at least one view angle area in the video image. And the terminal equipment receives the picture parameters of at least one view angle area sent by the server. And the terminal equipment performs enhancement processing on the video image according to the picture parameters of at least one view angle area. Wherein, the picture parameters of at least one view angle region include: and the enhancement parameters corresponding to any one of the at least one view angle area are used for the terminal equipment to perform enhancement processing on the view angle area.

Optionally, the picture parameters of at least one view angle region further include: and the at least one view angle area corresponds to the time stamp and the space range respectively. Correspondingly, the enhancement processing of the video image by the terminal device according to the picture parameter of at least one view angle area comprises the following steps: and the terminal equipment determines the enhancement parameters corresponding to the target visual angle area according to the timestamp and the spatial range of the target visual angle area and the timestamp and the spatial range which correspond to at least one visual angle area respectively. And performing enhancement processing on the target visual angle area according to the enhancement parameters corresponding to the target visual angle area. Wherein the target view angle region is a part or all of at least one view angle region.

Optionally, the enhancement parameter corresponding to any one of the viewing angle regions includes at least one of: a brightness enhancement parameter, a saturation enhancement parameter, a contrast enhancement parameter, and a sharpness enhancement parameter of the view angle region.

In a third aspect, the present application provides an apparatus for enhancing a video image, comprising:

and the receiving module is used for receiving a request message sent by the terminal equipment, wherein the request message comprises the identification of the video image.

And the acquisition module is used for acquiring the picture parameters of at least one view angle area in the video image according to the identification of the video image.

And the sending module is used for sending the picture parameters of at least one visual angle area to the terminal equipment.

Wherein, the picture parameters of at least one view angle region include: and the enhancement parameters corresponding to any one of the at least one view angle area are used for the terminal equipment to perform enhancement processing on the view angle area.

In a fourth aspect, the present application provides an apparatus for enhancing a video image, including:

the sending module is used for sending a request message to the server, wherein the request message comprises an identifier of the video image, and the identifier of the video image is used for the server to acquire the picture parameters of at least one view angle area in the video image.

And the receiving module is used for receiving the picture parameters of at least one visual angle area sent by the server.

And the processing module is used for enhancing the video image according to the picture parameters of at least one view angle area.

In a fifth aspect, the present application provides a server, comprising: a memory and a processor. The memory is for storing computer instructions to cause the processor to execute the computer instructions to implement the method of enhancing a video image as the first aspect or the alternatives of the first aspect.

In a sixth aspect, the present application provides a terminal device, including: a memory and a processor. The memory is for storing computer instructions to cause the processor to execute the computer instructions to implement the method of enhancing a video image as the second aspect or the alternatives of the second aspect.

In a seventh aspect, the present application provides a chip for implementing the method for enhancing a video image according to the first aspect or the optional manner of the first aspect.

In an eighth aspect, the present application provides a chip for implementing the method for enhancing a video image as described in the second aspect or the alternatives of the second aspect.

In a tenth aspect, the present application provides a computer storage medium comprising: computer-executable instructions for implementing a method of enhancement of a video image as the first aspect or an alternative to the first aspect.

In an eleventh aspect, the present application provides a computer storage medium comprising: computer-executable instructions for implementing a method of enhancement of a video image as per the second aspect or alternative forms of the second aspect.

In a twelfth aspect, the present application provides a computer program product comprising: computer-executable instructions for implementing a method of enhancement of a video image as the first aspect or an alternative to the first aspect.

In a thirteenth aspect, the present application provides a computer program product comprising: computer-executable instructions for implementing a method of enhancement of a video image as per the second aspect or alternative forms of the second aspect.

The application provides a video image enhancement method, a video image enhancement device, video image enhancement equipment, a video image enhancement chip and a storage medium. The method comprises the following steps: the server receives a request message sent by the terminal equipment, wherein the request message comprises the identification of the video image. And the server acquires the picture parameters of at least one view angle area in the video image according to the identification of the video image. And the server sends the picture parameters of at least one view angle area to the terminal equipment. Wherein, the picture parameters of at least one view angle region include: and the enhancement parameters corresponding to any one of the at least one view angle area are used for the terminal equipment to perform enhancement processing on the view angle area. The method can improve the video image display effect.

Drawings

FIG. 1 is a schematic diagram of a prior art film source cut into 72 pieces;

fig. 2 is an application scenario diagram of the technical solution of the present application according to an embodiment of the present application;

fig. 3 is an interaction flowchart of a method for enhancing a video image according to an embodiment of the present application;

FIG. 4 is a schematic diagram of a video image provided in an embodiment of the present application;

fig. 5A to 5C are schematic views of video images according to another embodiment of the present application;

FIG. 6 is a schematic diagram of brightness enhancement provided by an embodiment of the present application;

FIG. 7 is a flowchart of a method for enhancing a video image according to another embodiment of the present application;

FIG. 8 is an interaction flow diagram of a method for enhancing video images according to yet another embodiment of the present application;

FIG. 9 is a flowchart of a method for enhancing a video image according to another embodiment of the present application;

fig. 10 is a schematic diagram of an apparatus for enhancing a video image according to an embodiment of the present application;

fig. 11 is a schematic diagram of an apparatus for enhancing a video image according to another embodiment of the present application;

fig. 12 is a schematic diagram of a server according to an embodiment of the present application;

fig. 13 is a schematic diagram of a terminal device according to an embodiment of the present application.

Detailed Description

As described above, for a video image such as a VR360 video source, the brightness, contrast, and color saturation values of the video image are for the entire 360-degree picture when encoding, so if the terminal device plays the content in the viewing angle area, the brightness, contrast, and color saturation values of the entire 360-degree picture are adopted, which may cause the problem of poor display effect, such as the viewing angle area appears darker and the color is not bright enough. In order to solve the technical problem, the present application provides a method, an apparatus, a device, a chip and a storage medium for enhancing a video image.

Exemplarily, fig. 2 is an application scenario diagram of the technical solution provided in an embodiment of the present application, as shown in fig. 2, a network element related to the technical solution of the present application includes: an encoder 21, a service/media management server 22, a terminal device 23, a streaming server 24 and an image enhancement server 25. Wherein, the encoder 21 is connected with the service/media management server 22, the streaming server 24 and the image enhancement server 25, respectively, and the service/media management server 22, the streaming server 24 and the image enhancement server 25 are connected with the terminal device 23, respectively. Wherein, the encoder 21 is used for encoding to generate a video image and transmitting the video image to the service/media management server 22, the streaming server 24 and the image enhancement server 25, respectively. The service/media management server 22 generates an identification of the video image. The service/media management server 22 sends the identification of the video image to the terminal device 23. The image enhancement server 25 determines a picture parameter corresponding to at least one view angle area in the video image, and the terminal device 23 may acquire the picture parameter from the image enhancement server 25 and acquire the video image from the streaming server 24 to perform enhancement processing on the video image by the picture parameter.

The terminal device referred to in this application may refer to a device having a video or video image playing function, which may be a handheld device having a wireless connection function, or other processing device connected to a wireless modem. The terminal device may communicate with at least one core Network via a Radio Access Network (RAN). The terminal equipment may be mobile terminals such as mobile telephones (or so-called "cellular" telephones) and computers, which may be portable, pocket, hand-held, computer-included or vehicle-mounted mobile devices, for example, that exchange data with a radio access network. The Terminal device may also be referred to as a Subscriber Unit (Subscriber Unit), a Subscriber Station (Subscriber Station), a Mobile Station (Mobile Station), a Remote Station (Remote Station), an Access Point (Access Point), a Remote Terminal (Remote Terminal), an Access Terminal (Access Terminal), a User Terminal (User Terminal), a User Agent (User Agent), or a User device (User Equipment), which is not limited herein. In summary, as long as the terminal device has a device with a video or video image playing function and can communicate with the server, the form of the terminal device is not limited in the present application.

For example, the at least one view angle region may be a plurality of view angle regions or a main view angle region in the video image, and the following describes the video image enhancement method in detail for these two cases respectively:

fig. 3 is an interaction flowchart of a method for enhancing a video image according to an embodiment of the present application, where a network element involved in the method includes: part or all of the server, and part or all of the terminal device. The part of the server may be a processor in the server or a chip with a processing function, and the like, and the part of the terminal device may be a processor in the terminal device or a chip with a processing function, and the like. To distinguish this server from other servers in the present application, this server may be referred to as an image enhancement server in the present application. The following describes a video image enhancement method using an image enhancement server and a terminal device as execution subjects. As shown in fig. 3, the method comprises the steps of:

optional step S301: the image enhancement server determines picture parameters corresponding to a plurality of view angle areas in the video image.

Step S302: the terminal equipment sends a request message to the image enhancement server, wherein the request message comprises: identification of the video image.

Step S303: and the image enhancement server sends the picture parameters corresponding to the plurality of visual angle areas to the terminal equipment according to the identification of the video image.

Step S304: and the terminal equipment performs enhancement processing on the video image according to the picture parameters corresponding to the plurality of view angle areas.

Step S301 will be described:

for example, fig. 4 is a schematic diagram of a video image provided in an embodiment of the present application, the video image may be a VR360 film source, but, as shown in fig. 4, the video image is divided into 5 view areas, namely, a view area 1, a view area 2, a view area 3, a view area 4, and a view area 5, each view area is a rectangular area, the 5 view areas intersect each other by more than 120 degrees, and the 5 view areas cover the video image. It should be noted that the video image is actually a circular film source, i.e. the first column of content and the last column of content shown in fig. 4 are adjacent. The first column of contents includes: data block 1, data block 13, data block 25, data block 37, data block 49, data block 61. The last column of contents includes: data block 12, data block 24, data block 36, data block 48, data block 60, data block 72.

The image enhancement server may generate picture parameters corresponding to a plurality of view angle regions, and for any one of the plurality of view angle regions, the picture parameters corresponding to the plurality of view angle regions include: and the enhancement parameters correspond to the visual angle area, and the enhancement parameters are used for the terminal equipment to carry out enhancement processing on the visual angle area. Optionally, the enhancement parameter of the viewing angle region includes at least one of: a brightness enhancement parameter, a saturation enhancement parameter, a contrast enhancement parameter, and a sharpness enhancement parameter of the view angle region.

Optionally, the picture parameters corresponding to the multiple view angle regions further include: the timestamp and spatial extent of any one view region.

The image enhancement server may obtain, through training, enhancement algorithm models corresponding to the brightness enhancement parameter, the saturation enhancement parameter, the contrast enhancement parameter, and the sharpness enhancement parameter, for example: the enhancement algorithm model corresponding to the brightness enhancement parameter is as follows:

y (new) y (original) + B (when y (original) <200)

Y (new) ═ y (original) + D (when y (original) > 200)

Where, for any pixel in any view region, y (original) represents the luminance component before the enhancement processing is performed on the pixel, y (new) represents the luminance component after the enhancement processing is performed on the pixel, and A, B, C and D are luminance enhancement parameters.

Further, the image enhancement server may determine an enhancement parameter corresponding to each of the plurality of view angle regions. It should be noted that, in the present application, no limitation is made on how the image enhancement server trains to obtain the enhancement algorithm model and how to determine the enhancement parameter corresponding to each viewing angle region.

Since the video image has a plurality of view areas, in order to enable the terminal device to determine the enhancement parameters of each view area when playing the video image, as described above, the parameters of each view area further include the timestamp and the spatial range of the view area. The time stamp is the playing time of the view angle area, the time stamp is generally in milliseconds (ms), when the video is played, actually, one frame of continuous pictures are displayed smoothly at fixed time intervals, for example, a video with a frame rate of 25 frames means that 25 frames of pictures are played every second, the interval between every two frames is 40 ms (1 second/25 frames), the definition of the time stamp is from 0, the time stamp of the first frame of picture is 0, the time stamp of the second frame of picture is 40, the time stamp of the third frame of picture is 80, and the like. The spatial range is defined in terms of latitude and longitude.

For example: the parameters of a certain viewing angle region are: 133| (0,90) - (72, -90) |1,1.15,5.5,1.05, 3.5. Where 133 denotes that the time stamp of the view angle area is 133ms, the spatial range is (0,90) - (72, -90), and 1 denotes an excessively dark enhancement scene, i.e., 1 is a scene identifier, which is an optional parameter. 1.15,5.5,1.05,3.5 respectively represent a ═ 1.15, B ═ 5.5, and C ═ 1.05D ═ 3.5.

It should be noted that the image enhancement server may further set a condition for determining whether to determine the picture parameters corresponding to the multiple viewing angle regions: for example: if the mean value of the luminance components of each pixel in the video image is less than the luminance threshold, for example, 255 × 0.3, and the number of the first pixels is greater than the first preset number, determining the luminance enhancement parameters respectively corresponding to the plurality of viewing angle regions, where the first pixels are pixels whose luminance components are less than the mean value of the luminance components in each pixel. And/or determining saturation enhancement parameters respectively corresponding to the plurality of view angle areas if the saturation component mean value of each pixel in the video image is smaller than the saturation threshold value and the number of second pixels is larger than a second preset number, wherein the second pixels are pixels of which the saturation components are smaller than the saturation component mean value in each pixel. And/or if the contrast component mean value of each pixel in the video image is smaller than the contrast threshold value and the number of third pixels is larger than a second preset number, determining the contrast enhancement parameters respectively corresponding to the multiple viewing angle areas, wherein the third pixels are pixels of which the contrast components are smaller than the contrast component mean value in each pixel. And/or if the sharpening degree component mean value of each pixel in the video image is smaller than the sharpening degree threshold value and the number of the fourth pixels is larger than a second preset number, determining sharpening degree enhancement parameters respectively corresponding to the multiple view angle areas, wherein the fourth pixels are pixels of which the sharpening degree components are smaller than the sharpening degree component mean value in each pixel.

Step S302 is explained as follows:

illustratively, the encoder may encode a video image, which may be injected into a service/media management server that generates a unique identification for the video image, such as: a894093847378394, the unique identifier being used to identify the video image. The encoder may also inject the video images to a streaming server, i.e. the streaming server is used to store the video images. The terminal device and the image enhancement server can obtain the identification of the video image from the service/media management server. When the terminal equipment needs to play the video image, the terminal equipment sends a request message carrying the identification of the video image to the image enhancement server so as to request to acquire the picture parameters corresponding to the multiple visual angle areas. And the terminal device may obtain the video image from the streaming server.

Alternatively, the first and second electrodes may be,

illustratively, the service/media management server, the streaming server and the image enhancement server are one server, and it is assumed that the server is also referred to as an image enhancement server, in this case, the encoder may encode to generate a video image, and may inject the video image into the image enhancement server, and the image enhancement server generates a unique identifier of the video image, such as: a894093847378394, the unique identifier being used to identify the video image. The encoder may also inject the video images to an image enhancement server, i.e. the image enhancement server is used to store the video images. Wherein, the terminal device can obtain the identification of the video image from the image enhancement server. When the terminal equipment needs to play the video image, the terminal equipment sends a request message carrying the identification of the video image to the image enhancement server so as to request to acquire the picture parameters and the video image corresponding to the multiple visual angle areas.

Alternatively, the first and second electrodes may be,

illustratively, the service/media management server and the streaming media server are one server, and assuming that the server is referred to as a media server, the encoder may encode a video image, and may inject the video image into the media server, and the media server generates a unique identifier of the video image, such as: a894093847378394, the unique identifier being used to identify the video image. The encoder may also inject the video images to a media server, i.e., the media server is used to store the video images. The terminal device and the image enhancement server can obtain the identification of the video image from the media server. When the terminal equipment needs to play the video image, the terminal equipment sends a request message carrying the identification of the video image to the image enhancement server so as to request to acquire the picture parameters corresponding to the multiple visual angle areas. And the terminal device may obtain the video image from the media server.

The following description is made with reference to step S303 and step S304:

as described above, the video image includes multiple view angle regions, so that after the image enhancement server obtains the identifier of the video image, the image parameters corresponding to the multiple view angle regions can be obtained. Sending the picture parameters corresponding to the multiple view angle areas to the terminal equipment, and determining the enhancement parameters corresponding to the target view angle area by the terminal equipment according to the time stamp and the space range of the target view angle area and the time stamp and the space range respectively corresponding to the multiple view angle areas; according to the enhancement parameters corresponding to the target visual angle area, enhancement processing is carried out on the target visual angle area; wherein the target view angle area is part or all of the plurality of view angle areas. For example: fig. 5A to 5C are schematic diagrams of video images according to another embodiment of the present application, as shown in fig. 5A, since the target view angle region 51 belongs to the view angle region 1, the enhancement parameter corresponding to the target view angle region 51 is the enhancement parameter corresponding to the view angle region 1. As shown in fig. 5B, since the target view angle region 52 belongs to the view angle region 1 and the view angle region 2, the enhancement parameter corresponding to the target view angle region 51 is the enhancement parameter corresponding to the view angle region 1 or the view angle region 2. As shown in fig. 5C, since the target view angle region 53 belongs to the view angle region 3, the enhancement parameter corresponding to the target view angle region 53 is the enhancement parameter corresponding to the view angle region 3.

Assume that the luminance enhancement parameter a obtained by the terminal device is 1.15, B is 5.5, and C is 1.05D is 3.5. The terminal device may perform the following enhancement processing for each pixel:

y (new) ═ 1.15 y (original) +5.5 (when y (original) <200)

Y (new) 1.05 y (original) +3.5 (when 200 y (original) <230)

Where, for any pixel in any view region, y (original) represents the luminance component before the enhancement processing is performed on the pixel, y (new) represents the luminance component after the enhancement processing is performed on the pixel, and A, B, C and D are luminance enhancement parameters. Fig. 6 is a schematic diagram of luminance enhancement according to an embodiment of the present application, where as shown in fig. 6, the abscissa represents the luminance component of each pixel before the enhancement processing is performed, and the ordinate represents the luminance component of each pixel after the enhancement processing is performed.

Optionally, after the terminal device performs enhancement processing on the video image, the terminal device may also render the video image.

In summary, the present application provides a video image enhancement method, including: the terminal equipment sends a request message to the image enhancement server, wherein the request message comprises: identification of the video image. And the image enhancement server sends the picture parameters corresponding to the plurality of visual angle areas to the terminal equipment according to the identification of the video image. And the terminal equipment performs enhancement processing on the video image according to the picture parameters corresponding to the plurality of view angle areas. Namely, the method can improve the video image display effect. Furthermore, according to the technical scheme provided by the application, the video image can be enhanced and refined into each view angle area, each view angle area has corresponding enhancement parameters, and the video image enhancement is not performed on the whole video image, so that the video image display effect can be further improved.

As described above, the encoder may encode a video image, which may be injected into a service/media management server that generates a unique identifier for the video image, which is used to identify the video image. The encoder may also inject the video images to a streaming server, i.e. the streaming server is used to store the video images. The terminal device and the image enhancement server can obtain the identification of the video image from the service/media management server. When the terminal equipment needs to play the video image, the terminal equipment sends a request message carrying the identification of the video image to the image enhancement server so as to request to acquire the picture parameters corresponding to the multiple visual angle areas. And the terminal device may obtain the video image from the streaming server. This scheme is explained in detail below:

fig. 7 is a flowchart of a method for enhancing a video image according to another embodiment of the present application, as shown in fig. 7, the method includes the following steps:

step S701: the encoder encodes and generates video images.

Step S702: the encoder sends the video image to the service/media management server.

Step S703: the service/media management server generates an identification of the video image.

Step S704: and the service/media management server sends the identification of the video image to the terminal equipment.

Step S705: the encoder sends the video image to a streaming server.

Step S706: the encoder sends the video image to an image enhancement server.

Step S707: and the image enhancement server determines the picture parameters corresponding to the plurality of visual angle areas.

Step S708: the terminal equipment sends a request message to the image enhancement server, wherein the request message comprises: identification of video images.

Step S709: the image enhancement server sends a response message to the terminal equipment, wherein the response message comprises: and the first storage address corresponding to the video image and the second storage address corresponding to the parameter corresponding to each visual angle area.

Wherein the second memory address comprises: the identification of the video image, for example: the second storage address is: http://10.135.13.12/A894093847378394_ enhance. dat, A894093847378394 is the identification of the video image.

Step S710: and the terminal equipment acquires the video image from the streaming media server according to the first storage address.

Step S711: and the terminal equipment acquires the picture parameters corresponding to the plurality of visual angle areas from the image enhancement server according to the second storage address.

Step S712: and the terminal equipment performs enhancement processing on the video image according to the picture parameters corresponding to the plurality of view angle areas.

It should be noted that this embodiment is mainly applied to a case where there are a service/media management server, a streaming media server, and an image enhancement server, which are respectively used to determine an identifier of a video image, store the video image, and acquire parameters corresponding to each view angle region of the video image, and details of this embodiment may refer to the previous embodiment, which is not described herein again.

Fig. 8 is an interaction flowchart of a method for enhancing a video image according to yet another embodiment of the present application, where the method involves a network element including: part or all of the server, and part or all of the terminal device. The part of the server may be a processor in the server or a chip with a processing function, and the like, and the part of the terminal device may be a processor in the terminal device or a chip with a processing function, and the like. To distinguish this server from other servers in the present application, this server may be referred to as an image enhancement server in the present application. The following describes a video image enhancement method using an image enhancement server and a terminal device as execution subjects. As shown in fig. 8, the method includes the steps of:

optional step S801: and the image enhancement server determines picture parameters corresponding to the main visual angle area in the video image.

Step S802: the terminal equipment sends a request message to the image enhancement server, wherein the request message comprises: identification of the video image.

Step S803: and the image enhancement server sends the picture parameters corresponding to the main visual angle area to the terminal equipment according to the identification of the video image.

Step S804: and the terminal equipment performs enhancement processing on the video image according to the picture parameters corresponding to the main visual angle area.

Step S801 is explained as follows:

in the video image, the main viewing angle area is a portion that can be actually seen by the user at the same time.

The image enhancement server may generate picture parameters corresponding to a main viewing angle region, where the picture parameters corresponding to the main viewing angle region include: and the enhancement parameters of the main visual angle area are used for enhancing the main visual angle area by the terminal equipment. The enhancement parameter of the main viewing angle region includes at least one of: a brightness enhancement parameter, a saturation enhancement parameter, a contrast enhancement parameter, a sharpness enhancement parameter of the main viewing angle region.

Optionally, the picture parameters corresponding to the main view angle region further include: the timestamp and the spatial range of the main view angle region, wherein the image enhancement server may obtain, through training, enhancement algorithm models corresponding to the brightness enhancement parameter, the saturation enhancement parameter, the contrast enhancement parameter, and the sharpness enhancement parameter, respectively, for example: the enhancement algorithm model corresponding to the brightness enhancement parameter is as follows:

y (new) y (original) + B (when y (original) <200)

Y (new) ═ y (original) + D (when y (original) > 200)

Where, for any pixel in the main viewing angle region, y (original) represents the luminance component before the enhancement processing is performed on the pixel, y (new) represents the luminance component after the enhancement processing is performed on the pixel, and A, B, C and D are luminance enhancement parameters.

Further, the image enhancement server may determine an enhancement parameter corresponding to the main viewing angle region. It should be noted that, the present application does not limit how the image enhancement server trains to obtain the enhancement algorithm model and how to determine the enhancement parameters corresponding to the main viewing angle region.

Since the video image has a plurality of view areas, in order to enable the terminal device to determine the enhancement parameters of the main view area when playing the video image, as described above, the parameters of the main view area further include the timestamp and the spatial range of the main view area.

It should be noted that, the image enhancement server may further set a condition for determining whether to determine the picture parameter corresponding to the main viewing angle area: for example: if the mean value of the luminance components of each pixel in the video image is less than the luminance threshold, for example, 255 × 0.3, and the number of the first pixels is greater than the first preset number, determining the luminance enhancement parameter corresponding to the main viewing angle region in the video image, where the first pixels are pixels whose luminance components are less than the mean value of the luminance components in each pixel. And/or determining a saturation enhancement parameter corresponding to the main visual angle area in the video image if the saturation component mean value of each pixel in the video image is smaller than the saturation threshold value and the number of second pixels is larger than a second preset number, wherein the second pixels are pixels of which the saturation components are smaller than the saturation component mean value in each pixel. And/or if the contrast component mean value of each pixel in the video image is smaller than the contrast threshold value and the number of the third pixels is larger than the second preset number, determining the contrast enhancement parameter corresponding to the main visual angle area in the video image, wherein the third pixels are pixels of which the contrast components are smaller than the contrast component mean value in each pixel. And/or if the sharpening component mean value of each pixel in the video image is smaller than the sharpening threshold value, and the number of the fourth pixels is larger than the second preset number, determining a sharpening enhancement parameter corresponding to a main view area or a sharpening enhancement parameter corresponding to each of a plurality of view areas in the video image, wherein the fourth pixels are pixels of which the sharpening component mean value is smaller than the sharpening component mean value in each pixel.

The following describes step S802:

illustratively, the encoder may encode a video image, which may be injected into a service/media management server that generates a unique identification for the video image, such as: a894093847378394, the unique identifier being used to identify the video image. The encoder may also inject the video images to a streaming server, i.e. the streaming server is used to store the video images. The terminal device and the image enhancement server can obtain the identification of the video image from the service/media management server. When the terminal equipment needs to play the video image, the terminal equipment sends a request message carrying the identification of the video image to the image enhancement server so as to request to acquire the picture parameter corresponding to the main view angle area. And the terminal device may obtain the video image from the streaming server.

Alternatively, the first and second electrodes may be,

illustratively, the service/media management server, the streaming server and the image enhancement server are one server, and it is assumed that the server is also referred to as an image enhancement server, in this case, the encoder may encode to generate a video image, and may inject the video image into the image enhancement server, and the image enhancement server generates a unique identifier of the video image, such as: a894093847378394, the unique identifier being used to identify the video image. The encoder may also inject the video images to an image enhancement server, i.e. the image enhancement server is used to store the video images. Wherein, the terminal device can obtain the identification of the video image from the image enhancement server. When the terminal equipment needs to play the video image, the terminal equipment sends a request message carrying the identification of the video image to the image enhancement server so as to request to acquire the picture parameters and the video image corresponding to the main visual angle area.

Alternatively, the first and second electrodes may be,

illustratively, the service/media management server and the streaming media server are one server, and assuming that the server is referred to as a media server, the encoder may encode a video image, and may inject the video image into the media server, and the media server generates a unique identifier of the video image, such as: a894093847378394, the unique identifier being used to identify the video image. The encoder may also inject the video images to a media server, i.e., the media server is used to store the video images. The terminal device and the image enhancement server can obtain the identification of the video image from the media server. When the terminal equipment needs to play the video image, the terminal equipment sends a request message carrying the identification of the video image to the image enhancement server so as to request to acquire the picture parameter corresponding to the main view angle area. And the terminal device may obtain the video image from the media server.

The following description is made with reference to step S803 and step S804:

as described above, the video image includes the main view area, so that after the image enhancement server obtains the identifier of the video image, the image parameter corresponding to the main view area can be obtained. Sending the picture parameters corresponding to the main visual angle area to the terminal equipment, and determining the enhancement parameters corresponding to the target visual angle area by the terminal equipment according to the time stamp and the space range of the target visual angle area and the time stamp and the space range corresponding to the main visual angle area; according to the enhancement parameters corresponding to the target visual angle area, enhancement processing is carried out on the target visual angle area; wherein the target view angle area is a part or all of the main view angle area.

y (new) ═ 1.15 y (original) +5.5 (when y (original) <200)

Y (new) 1.05 y (original) +3.5 (when 200 y (original) <230)

Where, for any pixel in the main viewing angle region, y (original) represents the luminance component before the enhancement processing is performed on the pixel, y (new) represents the luminance component after the enhancement processing is performed on the pixel, and A, B, C and D are luminance enhancement parameters. Optionally, after the terminal device performs enhancement processing on the video image, the terminal device may also render the video image.

In summary, the present application provides a video image enhancement method, including: the terminal equipment sends a request message to the image enhancement server, wherein the request message comprises: identification of the video image. And the image enhancement server sends the picture parameters corresponding to the main visual angle area to the terminal equipment according to the identification of the video image. And the terminal equipment performs enhancement processing on the video image according to the picture parameters corresponding to the main visual angle area. Namely, the method can improve the video image display effect. Furthermore, according to the technical scheme provided by the application, the video image can be enhanced and refined into the main view angle area, the main view angle area has corresponding picture parameters, and the video image enhancement is not performed on the whole video image, so that the video image display effect can be further improved.

As described above, the encoder may encode a video image, which may be injected into a service/media management server that generates a unique identifier for the video image, which is used to identify the video image. The encoder may also inject the video images to a streaming server, i.e. the streaming server is used to store the video images. The terminal device and the image enhancement server can obtain the identification of the video image from the service/media management server. When the terminal equipment needs to play the video image, the terminal equipment sends a request message carrying the identification of the video image to the image enhancement server so as to request to acquire the picture parameter corresponding to the main view angle area. And the terminal device may obtain the video image from the streaming server. This scheme is explained in detail below:

fig. 9 is a flowchart of a method for enhancing a video image according to another embodiment of the present application, as shown in fig. 9, the method includes the following steps:

step S901: the encoder encodes and generates video images.

Step S902: the encoder sends the video image to the service/media management server.

Step S903: the service/media management server generates an identification of the video image.

Step S904: and the service/media management server sends the identification of the video image to the terminal equipment.

Step S905: the encoder sends the video image to a streaming server.

Step S906: the encoder sends the video image to an image enhancement server.

Step S907: and the image enhancement server determines picture parameters corresponding to the main visual angle area in the video image.

Step S908: the terminal equipment sends a request message to the image enhancement server, wherein the request message comprises: identification of video images.

Step S909: the image enhancement server sends a response message to the terminal equipment, wherein the response message comprises: and a first storage address corresponding to the video image and a second storage address corresponding to the parameter corresponding to the main visual angle area.

Step S910: and the terminal equipment acquires the video image from the streaming media server according to the first storage address.

Step S911: and the terminal equipment acquires the picture parameters corresponding to the main visual angle area from the image enhancement server according to the second storage address.

Step S912: and the terminal equipment performs enhancement processing on the video image according to the picture parameters respectively corresponding to the main visual angle areas.

Fig. 10 is a schematic diagram of an apparatus for enhancing a video image according to an embodiment of the present application, where the apparatus for enhancing a video image may be part or all of a server, as shown in fig. 10, the apparatus includes:

a receiving module 1001, configured to receive a request message sent by a terminal device, where the request message includes an identifier of a video image.

An obtaining module 1002, configured to obtain a picture parameter of at least one view angle area in the video image according to the identifier of the video image.

A sending module 1003, configured to send the screen parameter of at least one view angle area to the terminal device.

Optionally, the apparatus further comprises: a determining module 1004, configured to determine a picture parameter of at least one view angle area before the receiving module receives the request message sent by the terminal device.

Optionally, the determining module 1004 is specifically configured to: if the mean value of the brightness components of the pixels in the video image is smaller than the brightness threshold value and the number of the first pixels is larger than a first preset number, determining the brightness enhancement parameters respectively corresponding to at least one viewing angle area, wherein the first pixels are pixels of which the brightness components are smaller than the mean value of the brightness components in the pixels. And/or determining saturation enhancement parameters respectively corresponding to at least one viewing angle area if the saturation component mean value of each pixel in the video image is smaller than the saturation threshold value and the number of second pixels is larger than a second preset number, wherein the second pixels are pixels of which the saturation components are smaller than the saturation component mean value in each pixel. And/or if the contrast component mean value of each pixel in the video image is smaller than the contrast threshold value and the number of the third pixels is larger than the second preset number, determining the contrast enhancement parameters respectively corresponding to at least one viewing angle area, wherein the third pixels are pixels of which the contrast components are smaller than the contrast component mean value in each pixel. And/or if the sharpening degree component mean value of each pixel in the video image is smaller than the sharpening degree threshold value and the number of the fourth pixels is larger than the second preset number, determining sharpening degree enhancement parameters respectively corresponding to at least one view angle area, wherein the fourth pixels are pixels of which the sharpening degree components are smaller than the sharpening degree component mean value in each pixel.

Optionally, the picture parameters of at least one view angle region further include: and the at least one view angle area corresponds to the time stamp and the space range respectively.

The video image enhancement device provided by the present application can be used for executing the video image enhancement method executed by the image enhancement server, and the content and effect thereof can refer to the method embodiment section, which is not described again.

Fig. 11 is a schematic diagram of an apparatus for enhancing a video image according to another embodiment of the present application, where the apparatus for enhancing a video image may be part or all of a server, as shown in fig. 11, the apparatus includes:

the sending module 1101 is configured to send a request message to the server, where the request message includes an identifier of a video image, and the identifier of the video image is used for the server to obtain a picture parameter of at least one view angle area in the video image.

A receiving module 1102, configured to receive a picture parameter of at least one view area sent by a server.

A processing module 1103, configured to perform enhancement processing on the video image according to the picture parameter of the at least one view angle area.

Optionally, the picture parameters of at least one view angle region further include: and the at least one view angle area corresponds to the time stamp and the space range respectively. Correspondingly, the processing module 1103 is specifically configured to: and determining the enhancement parameters corresponding to the target visual angle area according to the time stamp and the space range of the target visual angle area and the time stamp and the space range respectively corresponding to at least one visual angle area. And performing enhancement processing on the target visual angle area according to the enhancement parameters corresponding to the target visual angle area. Wherein the target view angle region is a part or all of at least one view angle region.

The video image enhancement device provided by the present application can be used for executing the video image enhancement method executed by the terminal device, and the content and effect thereof can refer to the method embodiment section, which is not described again.

Fig. 12 is a schematic diagram of a server according to an embodiment of the present application, and as shown in fig. 12, the server includes: a memory 1201 and a processor 1202. The memory is used for storing computer instructions, so that the processor executes the computer instructions to implement the method for enhancing the video image executed by the server, and the content and effect of the method can refer to the embodiment part of the method, which is not described again. Optionally, the server further includes a transceiver 1203, which is used for implementing data transmission with the terminal device or other devices.

Fig. 13 is a schematic diagram of a terminal device according to an embodiment of the present application, and as shown in fig. 13, the terminal device includes: memory 1301 and processor 1302. The memory is used for storing computer instructions, so that the processor executes the computer instructions to implement the method for enhancing the video image executed by the terminal device, and the content and effect of the method can refer to the embodiment part of the method, which is not described again. Optionally, the terminal device further includes a transceiver 1303, which is used to implement data transmission with a server or other devices.

The application provides a chip for realizing a video image enhancement method executed by a server. The content and effect of the method can refer to the embodiment of the method, and are not described in detail.

The application provides a chip for realizing a video image enhancement method executed by a terminal device. The content and effect of the method can refer to the embodiment of the method, and are not described in detail.

The present application provides a computer storage medium comprising: computer-executable instructions for implementing a method for enhancing a video image performed by a server. The content and effect of the method can refer to the embodiment of the method, and are not described in detail.

The present application provides a computer storage medium comprising: computer-executable instructions for implementing a method for enhancing video images performed by a terminal device. The content and effect of the method can refer to the embodiment of the method, and are not described in detail.

Claims

1. A method for enhancing a video image, comprising:

the method comprises the steps that a server receives a request message sent by a terminal device, wherein the request message comprises an identifier of a video image;

the server acquires picture parameters of at least one view angle area in the video image according to the identification of the video image;

the server sends the picture parameters of the at least one view angle area to the terminal equipment;

wherein the picture parameters of the at least one view angle region include: and the enhancement parameters corresponding to any one of the at least one view angle area are used for the terminal equipment to perform enhancement processing on the view angle area.

2. The method of claim 1, wherein before the server receives the request message sent by the terminal device, the method further comprises:

the server determines picture parameters of the at least one view angle region.

3. The method according to claim 1 or 2, wherein the server determines the picture parameters of the at least one view angle region, comprising:

if the mean value of the brightness components of each pixel in the video image is smaller than a brightness threshold value, and the number of first pixels is larger than a first preset number, determining brightness enhancement parameters respectively corresponding to the at least one view angle area, wherein the first pixels are pixels of which the brightness components are smaller than the mean value of the brightness components in each pixel; and/or the presence of a gas in the gas,

if the saturation component mean value of each pixel in the video image is smaller than a saturation threshold value and the number of second pixels is larger than a second preset number, determining saturation enhancement parameters respectively corresponding to the at least one view angle area, wherein the second pixels are pixels of which the saturation components are smaller than the saturation component mean value in each pixel; and/or the presence of a gas in the gas,

if the contrast component mean value of each pixel in the video image is smaller than a contrast threshold value, and the number of third pixels is larger than a second preset number, determining a contrast enhancement parameter corresponding to each of the at least one view angle area, wherein the third pixels are pixels of which the contrast components are smaller than the contrast component mean value in each pixel; and/or the presence of a gas in the gas,

and if the sharpening degree component mean value of each pixel in the video image is smaller than a sharpening degree threshold value, and the number of fourth pixels is larger than a second preset number, determining sharpening degree enhancement parameters respectively corresponding to the at least one view angle area, wherein the fourth pixels are pixels of which the sharpening degree components are smaller than the sharpening degree component mean value in each pixel.

4. The method according to any of claims 1-3, wherein the picture parameters of the at least one view region further comprise: the at least one view angle region respectively corresponds to a time stamp and a spatial range.

5. A method for enhancing a video image, comprising:

the method comprises the steps that terminal equipment sends a request message to a server, wherein the request message comprises an identifier of a video image, and the identifier of the video image is used for the server to acquire picture parameters of at least one view angle area in the video image;

the terminal equipment receives the picture parameters of the at least one visual angle area sent by the server;

the terminal equipment performs enhancement processing on the video image according to the picture parameters of the at least one view angle area;

6. The method according to claim 5, wherein the picture parameters of the at least one view region further comprise: the time stamp and the space range respectively correspond to the at least one view angle area;

correspondingly, the enhancing processing of the video image by the terminal device according to the picture parameter of the at least one view angle area includes:

the terminal equipment determines an enhancement parameter corresponding to a target visual angle area according to the timestamp and the spatial range of the target visual angle area and the timestamp and the spatial range respectively corresponding to the at least one visual angle area;

according to the enhancement parameters corresponding to the target visual angle area, enhancement processing is carried out on the target visual angle area;

wherein the target view angle region is a part or all of the at least one view angle region.

7. The method according to claim 5 or 6, wherein the enhancement parameter corresponding to any one of the view angle regions comprises at least one of: a brightness enhancement parameter, a saturation enhancement parameter, a contrast enhancement parameter, and a sharpness enhancement parameter of the view angle region.

8. An apparatus for enhancing a video image, comprising:

the receiving module is used for receiving a request message sent by the terminal equipment, wherein the request message comprises an identifier of a video image;

the acquisition module is used for acquiring the picture parameters of at least one view angle area in the video image according to the identification of the video image;

a sending module, configured to send the picture parameter of the at least one view area to the terminal device;

9. The apparatus of claim 8, further comprising:

a determining module, configured to determine a picture parameter of the at least one view angle area before the receiving module receives the request message sent by the terminal device.

10. The apparatus of claim 9, wherein the determining module is specifically configured to:

11. The apparatus according to any one of claims 8-10, wherein the picture parameters of the at least one view region further comprise: the at least one view angle region respectively corresponds to a time stamp and a spatial range.

12. A video image enhancement apparatus, comprising:

the device comprises a sending module, a receiving module and a processing module, wherein the sending module is used for sending a request message to a server, the request message comprises an identifier of a video image, and the identifier of the video image is used for the server to acquire the picture parameters of at least one view angle area in the video image;

a receiving module, configured to receive the picture parameter of the at least one view area sent by the server;

the processing module is used for enhancing the video image according to the picture parameters of the at least one view angle area;

13. The apparatus of claim 12, wherein the picture parameters of the at least one view region further comprise: the time stamp and the space range respectively correspond to the at least one view angle area;

correspondingly, the processing module is specifically configured to:

determining an enhancement parameter corresponding to a target visual angle area according to the timestamp and the spatial range of the target visual angle area and the timestamp and the spatial range respectively corresponding to the at least one visual angle area;

14. The apparatus according to claim 12 or 13, wherein the enhancement parameter corresponding to any one of the view areas comprises at least one of: a brightness enhancement parameter, a saturation enhancement parameter, a contrast enhancement parameter, and a sharpness enhancement parameter of the view angle region.

15. A server, comprising: a memory and a processor;

the memory is used for storing computer instructions to cause the processor to execute the computer instructions to implement the method of enhancing a video image according to any one of claims 1 to 4.

16. A terminal device, comprising: a memory and a processor;

the memory is configured to store computer instructions to cause the processor to execute the computer instructions to implement the method of enhancing a video image according to any one of claims 5 to 7.