WO2021218430A1

WO2021218430A1 - Image processing method and apparatus, and electronic device

Info

Publication number: WO2021218430A1
Application number: PCT/CN2021/080248
Authority: WO
Inventors: 徐亮
Original assignee: 荣耀终端有限公司
Priority date: 2020-04-26
Filing date: 2021-03-11
Publication date: 2021-11-04
Also published as: CN111565337A

Abstract

The present application relates to the technical field of image processing. Provided are an image processing method and apparatus, and an electronic device. The image processing method comprises: acquiring video information; determining a video image layer, and information of the position where a video stream is displayed on the video image layer; performing PQ enhancement on the video stream displayed on the video image layer; and superimposing the video image layer that has been subjected to PQ enhancement, and an instruction image layer, and then sending the superimposed video image layer and instruction image layer to a display screen for displaying. In the present application, after a video stream and an instruction set are obtained and information of the position where the video stream is displayed on an image layer is determined, PQ enhancement is performed on the video stream; according to the information of the position, and interaction content converted from the instruction set, the specific position of an instruction image layer is configured to be in a transparent state, and the interaction content is displayed; and a video image layer that has been subjected to PQ enhancement, and a processed instruction image layer are then superimposed and displayed. Therefore, a video which has high image quality and displays interaction content is obtained, such that a user can also see interaction information while watching the video with high image quality.

Description

Image processing method, device and electronic equipment

This application claims the priority of a Chinese patent application filed with the State Intellectual Property Office of China, the application number is 202010338390.9, and the application name is "Image Processing Method, Apparatus and Electronic Equipment" on April 26, 2020, the entire content of which is incorporated by reference In this application.

Technical field

The present invention relates to the technical field of image processing, in particular to an image processing method, device and electronic equipment.

Background technique

At present, the most popular video applications (applications, APPs) on the market, such as Douyu, Douyin, and iQiyi, all have a large number of interactive functions (such as likes, comments, etc.). With the promotion of 5G and 4K technologies, video apps will provide a better experience on TVs, but currently on the market, the main function of video apps on smart TVs is still basic video playback, and interactive functions are not available on TVs. There are very good applications, which greatly reduces the user experience.

Summary of the invention

In order to overcome the above-mentioned problem that interactive information cannot be displayed on electronic equipment, embodiments of the present application provide an image processing method, apparatus and electronic equipment.

In order to achieve the foregoing objectives, the embodiments of the present application adopt the following technical solutions:

In a first aspect, the present application provides an image processing method, which is executed by a terminal device and includes: acquiring video information, the video information includes a video stream and an instruction set, the instruction set includes the input when the user watches the video for interaction Determine the position information of the video layer and the video stream displayed on the video layer; perform image quality PQ enhancement on the video stream displayed on the video layer; PQ enhanced video image Layer and instruction layer are superimposed, and then sent to the display screen for display. The instruction layer is used to display interactive content converted by each instruction in the instruction set, and the instruction layer includes information determined according to the position information. The first area in a transparent state.

In the present invention, after the video stream and the instruction set are obtained, the layer displayed by the video stream is first identified. After determining the position information of the video stream displayed on the layer, when the video stream is displayed on the video layer, the video stream is displayed on the video layer. The video image in the stream is PQ enhanced, and then the specific position of the instruction layer is set to a transparent state according to the position information and the interactive content converted by the instruction set, and the interactive content is displayed, and then the PQ enhanced video layer and processing are performed The latter instruction layer is superimposed and displayed, thereby obtaining a video with high image quality and displaying interactive content, so that the user can see the interactive information while watching the video with high image quality.

In another possible implementation, the determining the video layer includes: identifying the video layer through a video layer recognition technology.

In another possible implementation, the method further includes: adding an identifier to the video layer, where the identifier is used to determine that the data for PQ enhancement is the video stream displayed on the video layer.

In another possible implementation, the determining the position information of the video stream displayed on the video layer includes: determining according to the size of the video image in the video stream and the size of the video layer The position where the video image in the video stream is displayed on the video layer; and the coordinate information or margin information of the video image in the video stream on the video layer is recorded.

In a second aspect, the present application provides an image processing device, including: an acquisition unit that acquires video information, the video information includes a video stream and an instruction set, the instruction set includes instructions input when a user interacts while watching a video; a determining unit , Determine the position information of a video layer and the video stream displayed on the video layer; a processing unit, perform PQ enhancement on the video stream displayed on the video layer; and the PQ enhanced video image Layer and instruction layer are superimposed, and then sent to the display screen for display. The instruction layer is used to display interactive content converted by each instruction in the instruction set, and the instruction layer includes information determined according to the position information. The first area in a transparent state.

In another possible implementation, the determining unit is specifically configured to identify the video layer through a video layer recognition technology.

In another possible implementation, the determining unit is further configured to add an identifier to the video layer, and the identifier is used to determine that the data for PQ enhancement is the video stream displayed on the video layer.

In another possible implementation, the determining unit is specifically configured to determine that the video image in the video stream is in the video image according to the size of the video image in the video stream and the size of the video layer. The position displayed on the layer; and record the coordinate information or margin information of the video image in the video stream on the video layer.

In a third aspect, the present application provides an electronic device, including: a transceiver to obtain video information, the video information includes a video stream and an instruction set, the instruction set includes instructions input by a user when watching a video for interaction; a first chip To determine the position information of the video layer and the video stream displayed on the video layer; the second chip to perform PQ enhancement on the video stream displayed on the video layer; the PQ-enhanced video image Layer and instruction layer are superimposed, and then sent to the display screen for display. The instruction layer is used to display interactive content converted by each instruction in the instruction set, and the instruction layer includes information determined according to the position information. The first area in a transparent state.

In another possible implementation, a first channel and a second channel are included between the first chip and the second chip, and the first channel is used to identify the video identified by the first chip. The stream is sent to the second chip; the second channel is used to send the position information of the video stream of the first chip and the instruction set to the second chip.

In the present invention, the video stream and the location information and the instruction set are sent to the second chip separately, so that the second chip can process the video stream and the location information and the instruction set separately.

In another possible implementation, the first channel is a data channel DP, and the second channel is a standard PCIe channel for quick peripheral component interconnection.

In another possible implementation, the first chip is specifically configured to recognize the video layer through a video layer recognition technology.

In another possible implementation, the first chip is further configured to add an identifier to the video layer, and the identifier is used to determine that the data for PQ enhancement performed by the second chip is on the video layer The displayed video stream.

In another possible implementation, the first chip is specifically configured to determine that the video image in the video stream is in the video according to the size of the video image in the video stream and the size of the video layer. The position displayed on the layer; and record the coordinate information or margin information of the video image in the video stream on the video layer.

In a fourth aspect, the present application provides a computer-readable storage medium for storing instructions/executable code. When the instructions/executable code are executed by the processor of an electronic device, the electronic device realizes the same as the first Any possible implementation of the aspect.

In the fifth aspect, the present application provides a computer program product containing instructions, which when the instructions run on a computer, cause the computer to execute any possible embodiment in the first aspect.

Description of the drawings

The following briefly introduces the drawings needed in the description of the embodiments or the prior art.

FIG. 1 is a schematic structural diagram of a terminal device for processing video according to an embodiment of the application;

2 is a schematic diagram of the internal structure of a first chip and a second chip provided by an embodiment of the application;

FIG. 3 is a schematic diagram of video synthesis provided by an embodiment of the application;

FIG. 4 is a flowchart of an image processing method provided by an embodiment of the application;

FIG. 5 is a schematic structural diagram of an image processing device provided by an embodiment of the application.

Detailed ways

The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

In order to solve the problem that users cannot watch interactive information while watching TV, in the prior art, such as Huawei’s existing smart TVs, the received video stream and the interactive data of the user interacting with the video are processed. The integrated processing generates a video stream that not only includes the user's interactive content, and then sends it to the display screen for display, so that the user can see the user's interactive content while watching the video.

With the development of technology and users' pursuit of video image quality, high-quality video is becoming more and more important. The existing Huawei Hi3751 V811 chip has a picture quality (PQ) enhancement feature, which can enhance the image display effect during video playback. However, if the Hi3751 V811 chip directly performs PQ enhancement on the new Hecheng video image, it will cause the barrage, likes and other information in the video image to be unclear on the screen (for example, the edge of the text is jagged due to the PQ enhancement Status, etc.).

Therefore, in the existing solution, when a user wants to realize an interactive function when watching a video, he cannot watch a high-image quality video; if he wants to watch a high-image quality video, he cannot realize an interactive function. This "cannot have both fish and bear's paws" situation is obviously unacceptable to increasingly picky users.

In the embodiments of the present application, terminal devices include but are not limited to smart TVs, tablet computers, smart phones, notebook computers, etc., for example, can also include terminal devices and automated control devices independently developed for various specific business scenarios.

In order to solve the above-mentioned situation that the interactive function and watching high-quality video cannot be realized at the same time, an embodiment of the present application provides a terminal device. After acquiring the video stream and the interactive instruction set, the video layer where the video stream is Perform PQ enhancement, then convert the interactive content according to the instruction set and present it on the instruction layer, and set the corresponding area of the instruction layer to a transparent state according to the position information of the video layer, and finally add the video layer and the PQ enhanced video layer The processed instruction layers are superimposed to obtain a video with high image quality and interactive content.

In the following, taking a smart TV as the terminal device as an example, as shown in FIG. 1, the smart TV 100 includes a first chip 101, a second chip 102 and a display screen 103. Among them, the first chip 101 is used for processing the received data, and the second chip 102 is used for synthesizing the processed data.

In addition, the smart TV 100 also includes a first channel and a second channel. The first channel and the second channel may be two physical connections, which are connected between the first chip 101 and the second chip 102, and are respectively used to send data processed by the first chip 101 to the second chip 102.

Exemplarily, as shown in FIG. 2, the first chip 101 is divided into a layer recognition module 1011, a video layer processing module 1012, and a 2D instruction stream module 1013 according to the functions performed by the first chip 101.

The layer recognition module 1011 recognizes the layer displayed by the video stream through the video layer recognition technology, and then displays the video stream on the layer after the smart TV 100 downloads the video stream, instruction set and other data from the cloud through the communication unit .

Generally, the video image displayed on the display screen 103 is formed by superimposing content images displayed on layers including a video layer, an instruction layer, and the like. Among them, the video layer is to display video images in the video stream, and the instruction layer is to display virtual buttons for controlling the playback of the video stream, virtual buttons for playing the video stream, content images corresponding to instructions input when the user interacts, and so on.

In the embodiment of the present application, the instruction set mainly includes the instructions input by the user when interacting according to watching the video, such as inputting text, clicking the "Like" virtual button, clicking the "Send a gift" virtual button, and so on. After receiving the instruction set, the smart TV 100 converts each instruction to display images on the instruction layer, such as text, "thumbs up" corresponding to likes, and "rocket" corresponding to gifts.

After the first chip 101 receives the data downloaded from the cloud, it uses the video layer recognition technology to identify the video layer, so that the video stream data displayed on the video layer can be subsequently sent to the second chip 102 through a separate channel. ; After the video layer is identified, the video layer is marked with a mark for subsequent transmission to the second chip 102. The second chip 102 recognizes the video layer according to the mark, and then compares the video displayed on the video layer The image is PQ enhanced.

The video layer processing module 1012 is configured to send the video stream to the second chip 102 through the first channel, and at the same time calculate the position information of the video layer, and send it to the 2D instruction stream module 1013.

Generally speaking, the size of the video image in the video stream is not exactly the same as the size of the smart TV 100 display 103, so usually when we watch a video, the upper and lower areas of the video image displayed on the display 103 have " "Black" part, or the left and right areas of the video image have "black" parts. Therefore, it is necessary to record the display position of the video image on the display screen 103, so as to ensure that the display position of the video stream will not be obscured by the instruction layer when it is superimposed with the instruction layer.

In a possible embodiment, when the size of the video image in the video stream and the display screen 103 are not the same, the video layer processing module 1012 sets the video image at the set position of the video layer according to the set requirements, or Set the video image in the center of the video layer according to the principle of "centering", or because the video image is too large or too small, the video image in the video stream is enlarged or reduced, so that the left and right lengths of the video image are the same as the video layer. After the left and right lengths are the same, or the vertical width of the video image is the same as the vertical width of the video layer, set it in the setting position of the video layer. After determining the display position of the video image on the video layer, record the position of the video image on the video layer.

Among them, the position information can be coordinate information. For example, take the lower left corner of the video layer as the left origin to record the video image (the existing video images are all rectangular in shape. For those made on our Douyin, Meitu, etc. apps, such as " The “heart” and “star”-shaped videos are all adding a “heart”-shaped frame to the original video image to obtain the “heart”-shaped video) the coordinates of the four vertices on the video layer; it can also be distance information, for example, the video The distance between the left border of the image and the left border of the video layer, the distance between the right border of the video image and the right border of the video layer, the distance between the top border of the video image and the top border of the video layer, And the distance between the bottom border of the video image and the bottom border of the video layer.

The 2D instruction stream module 1013 is configured to send the instruction set and the position information of the video layer to the second chip 102 through the second channel.

In the embodiment of the present application, the video layer processing module 1012 and the second chip 102 establish a first channel, and the 2D instruction stream module 1013 and the second chip 102 establish a second channel. After the first chip 101 receives data such as a video stream, instruction set, etc., the video stream is recognized by the layer recognition module 1011, and the video stream is sent to the second chip 102 through the first channel established by the video layer processing module 1012, The instruction set and the position information of the video layer calculated in the video layer processing module 1012 are sent to the second chip 102 through the second channel established by the 2D instruction stream module 1013. In this application, the position information of the video stream and the instruction set and the video layer are sent to different modules in the second chip 102 through two different channels for processing, so as to avoid the second chip from performing PQ enhancement on all data.

In a possible embodiment, the first channel uses a data path (DP), and the second channel uses a peripheral component interconnect express (PCIe) channel.

According to the functions performed by the second chip 102, the second chip 102 is divided into a 2D instruction flow module 1021 and a PQ enhancement module 1022.

The 2D instruction stream module 1021 establishes a connection with the 2D instruction stream module 1013 through the second channel, and is used to receive the position information and instruction set of the video layer, and superimpose the instruction layer with the video layer according to the position information of the video layer The overlapping position of is set to a transparent state, and then each instruction in the instruction set is converted into text, thumbs, rockets and other images input by the user during interaction, and displayed on the instruction layer.

In the embodiment of this application, since the shape and size of the instruction layer are exactly the same as the display screen 103, the position information of the video layer is received, and the video layer is determined according to the coordinates or margins in the position information of the video layer. The video image display area in the video stream when superimposed with the instruction layer, and then set this area to a transparent state, so that when the subsequent video layer and instruction layer are superimposed and displayed, the video stream displayed by the video layer will not be obscured by the instruction layer , The display effect is shown in Figure 3(a).

In addition, the interactive image can be displayed in any area of the instruction layer, and can also be displayed in the overlapping area when the video layer and the instruction layer are superimposed, which is not limited in this application.

The PQ enhancement module 1022 establishes a connection with the video layer processing module 1012 through the first channel, and is used to identify the video layer by identifying the identifier on the video layer, and then perform PQ on the video image in the video stream displayed on the video layer Enhance, display the enhanced video image on the video layer, as shown in Figure 3(b).

Finally, the second chip 102 will use the PQ enhancement module 1022 to perform the PQ enhancement of the video layer and the 2D instruction stream module 1021 to process the instruction layer after the instruction layer is superimposed, and then send it to the display screen 103 for display .

In the embodiment of this application, after the terminal device obtains the video stream, instruction set and other data, it recognizes the video layer of the video stream through the first chip, then sends it to the second chip through the first channel, and calculates the video at the same time. The position information of the image displayed on the video layer, and then the position information and instruction set are sent to the second chip through the second channel. After receiving the video stream, the second chip performs PQ enhancement on the video image displayed on the video layer. After receiving the position information and the instruction set, set the overlapping area of the original instruction layer and the video layer to a transparent state, and display the interactive image on the processed instruction layer, and then perform PQ enhancement The video layer and the processed instruction layer are superimposed and displayed, thereby obtaining a video with high image quality and displaying interactive content, so that the user can see the interactive information while watching the video with high image quality.

It should be noted that the hardware requirements implemented by the foregoing embodiments of the present application are not limited to two chips, but can be any number of chips. Although the above is implemented by two chips, it is known to those skilled in the art that the chip is generally composed of multiple modules, but if all the modules in the first chip 101 and the second chip 102 are packaged together, the above implementation can be considered The example is realized by a chip.

The technical solution of the present application will be described below through the software aspect.

FIG. 4 is a flowchart of an image processing method provided by an embodiment of the application. As shown in Figure 4, the image processing method provided by this application is executed by a terminal device, and the specific execution steps are as follows:

Step S401: Obtain video information.

Among them, the acquired video information includes a video stream and an instruction set. The video stream is the video watched by the user. The instruction set mainly includes the instructions that the user enters when interacting with the video, such as inputting text, clicking the "Like" virtual button, and clicking the "Send a gift" virtual button. After receiving the instruction set, the smart TV 100 converts each instruction to display images on the instruction layer, such as text, "thumbs up" corresponding to likes, and "rocket" corresponding to gifts.

Step S403: Determine the position information of the video layer and the video stream on the video layer.

Generally, the video image displayed on the display screen is formed by superimposing content images displayed by layers including video layers, instruction layers, etc., and the size and dimensions of each layer are exactly the same as those of the display screen. Among them, the video layer is to display video images in the video stream, and the instruction layer is to display virtual buttons for controlling the playback of the video stream, virtual buttons for playing the video stream, content images corresponding to instructions input when the user interacts, and so on.

In the embodiments of this application, the video layer is identified through the video layer recognition technology, so that the video stream data displayed on the video layer can be subsequently transmitted through a separate channel; after the video layer is identified, the video image The layer is marked with a mark for subsequent PQ enhancement of the video stream displayed on the video layer by identifying the video layer.

In addition, the size of the video image in the video stream is usually not exactly the same as the size of the display screen, so usually when we watch a video, the upper and lower areas of the video image displayed on the display screen have "black" parts, or the video There are "black" parts in the left and right areas of the image. Therefore, it is necessary to record the display position of the video image on the display screen, so that when it is superimposed with the instruction layer later, it is determined that the display position of the video stream will not be obscured by the instruction layer.

In a possible embodiment, when the size of the video image in the video stream and the display screen are not the same, the terminal device sets the video image in the set position of the video layer according to the set requirements, or sets the video image in accordance with " The principle of "centering" is set at the center of the video layer, or because the video image is too large or too small, the video image in the video stream is enlarged or reduced so that the left and right lengths of the video image are the same as the left and right lengths of the video layer. Or make the up and down width of the video image the same as the up and down width of the video layer, and set it at the setting position of the video layer. After determining the display position of the video image on the video layer, record the position of the video image on the video layer.

Wherein, the position information can be coordinate information, for example, the coordinates of the four vertices of the video image on the video layer are recorded with the lower left corner of the video layer as the left origin; it can also be distance information, for example, the left border of the video image The distance from the left border of the video layer, the distance between the right border of the video image and the right border of the video layer, the distance between the top border of the video image and the top border of the video layer, and the distance between the top border of the video image and the top border of the video layer. The distance between the bottom border and the bottom border of the video layer.

Step S405: Perform PQ enhancement on the video stream displayed on the video layer.

In step S407, the PQ enhanced video layer and the instruction layer are superimposed, and then sent to the display screen for display.

Specifically, after the position information of the video stream on the video layer is obtained, since the shape and size of the instruction layer are exactly the same as the display screen 103, the video image is determined according to the coordinates or margins in the position information of the video layer. The video image display area in the video stream when the layer and instruction layer are superimposed, and then set this area to a transparent state, so that when the subsequent video layer and instruction layer are superimposed, the video stream displayed by the video layer will not be the instruction layer Occlude. Then, each instruction in the instruction set is converted into the text, thumbs up, rocket and other images input by the user during interaction, and displayed on the instruction layer.

In addition, the terminal device recognizes the video layer by recognizing the mark on the video layer, performs PQ enhancement on the video image in the video stream displayed on the video layer, and then displays the enhanced video image on the video layer.

Finally, when the terminal device displays the video on the display screen, the video layer enhanced by PQ and the processed instruction layer are superimposed together and sent to the display screen for display. The image processing method provided in the embodiment of the application first identifies the layer displayed by the video stream after obtaining the video stream and the instruction set. After determining the position information of the video stream displayed on the layer, when the video stream is When the video layer is displayed, perform PQ enhancement on the video image in the video stream, and then set the specific position of the instruction layer to a transparent state according to the position information and the interactive content converted by the instruction set, and display the interactive content, and then perform The PQ-enhanced video layer and the processed instruction layer are superimposed and displayed, thereby obtaining a video with high image quality and displaying interactive content, so that users can see the interactive information while watching the high-quality video.

FIG. 5 is a schematic structural diagram of an image processing device provided by an embodiment of the application. As shown in FIG. 5, the image processing apparatus 500 provided by the embodiment of the present application includes: an acquisition unit 501, a determination unit 503, and a processing unit 505. Wherein, the obtaining unit 501 is used to obtain video information. The video information includes a video stream and an instruction set. The instruction set includes instructions input when the user is watching the video for interaction; the determining unit 503 is used to determine that the video layer and the video stream are on the video layer. Displayed position information; the processing unit 505 is used to perform PQ enhancement on the video stream displayed on the video layer; and superimpose the PQ enhanced video layer and instruction layer, and then send it to the display screen for display, the instruction layer It is used to display interactive content converted by each instruction in the instruction set, and the instruction layer includes a first area in a transparent state determined according to position information. For the specific implementation scheme of each unit, refer to the introduction of the previous embodiment.

A person of ordinary skill in the art may realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered as going beyond the scope of the embodiments of the present application.

In addition, various aspects or features of the embodiments of the present application can be implemented as methods, devices, or products using standard programming and/or engineering techniques. The term "article of manufacture" used in this application encompasses a computer program accessible from any computer-readable device, carrier, or medium. For example, computer-readable media may include, but are not limited to: magnetic storage devices (for example, hard disks, floppy disks, or tapes, etc.), optical disks (for example, compact discs (CD), digital versatile discs (DVD)) Etc.), smart cards and flash memory devices (for example, erasable programmable read-only memory (EPROM), cards, sticks or key drives, etc.). In addition, various storage media described herein may represent one or more devices and/or other machine-readable media for storing information. The term "machine-readable medium" may include, but is not limited to, wireless channels and various other media capable of storing, containing, and/or carrying instructions and/or data.

In the foregoing embodiment, the image processing apparatus 500 in FIG. 5 may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented by software, it can be implemented in the form of a computer program product in whole or in part. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website, computer, server, or data center. Transmission to another website, computer, server or data center via wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or a data center integrated with one or more available media. The usable medium may be a magnetic medium (for example, a floppy disk, a hard disk, and a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, a solid state disk (SSD)).

It should be understood that in the various embodiments of the embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution. The execution order of the processes should be determined by their functions and internal logic, and should not be dealt with. The implementation process of the embodiments of the present application constitutes any limitation.

Those skilled in the art can clearly understand that, for the convenience and conciseness of description, the specific working process of the system, device and unit described above can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, device, and method can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components may be combined or It can be integrated into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the embodiments of the present application are essentially or the part that contributes to the prior art or the part of the technical solutions can be embodied in the form of a software product, and the computer software product is stored in a storage medium. , Including several instructions to make a computer device (which may be a personal computer, a server, or an access network device, etc.) execute all or part of the steps of the methods described in the various embodiments of the embodiments of the present application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disks or optical disks and other media that can store program codes. .

The above are only specific implementations of the embodiments of the present application, but the protection scope of the embodiments of the present application is not limited to this. Anyone familiar with the technical field in the technical scope disclosed in the embodiments of the present application can easily Any change or replacement should be included in the protection scope of the embodiments of the present application.

Claims

An image processing method, which is executed by a terminal device, and is characterized in that it includes:

Acquiring video information, where the video information includes a video stream and an instruction set, and the instruction set includes instructions input by a user when watching a video for interaction;

Determining the position information of a video layer and the video stream displayed on the video layer;

Performing image quality PQ enhancement on the video stream displayed on the video layer;

The PQ enhanced video layer and instruction layer are superimposed, and then sent to the display screen for display. The instruction layer is used to display interactive content converted by each instruction in the instruction set, and the instruction layer includes The first area in a transparent state is determined according to the position information.
The method according to claim 1, wherein said determining a video layer comprises:

The video layer is identified through the video layer recognition technology.
The method according to claim 2, wherein the method further comprises:

An identifier is added to the video layer, and the identifier is used to determine that the data for PQ enhancement is the video stream displayed on the video layer.
The method according to claim 1, wherein the determining the position information of the video stream displayed on the video layer comprises:

Determine the display position of the video image in the video stream on the video layer according to the size of the video image in the video stream and the size of the video layer;

Recording the coordinate information or margin information of the video image in the video stream on the video layer.
An image processing device, characterized in that it comprises:

An acquiring unit, configured to acquire video information, the video information including a video stream and an instruction set, and the instruction set includes instructions input by a user when watching a video for interaction;

The determining unit is used to determine the position information of the video layer and the video stream displayed on the video layer;

A processing unit, configured to perform PQ enhancement on the video stream displayed on the video layer; and

The PQ enhanced video layer and instruction layer are superimposed, and then sent to the display screen for display. The instruction layer is used to display interactive content converted by each instruction in the instruction set, and the instruction layer includes The first area in a transparent state is determined according to the position information.
The device according to claim 5, wherein the determining unit is specifically configured to recognize the video layer through a video layer recognition technology.
The device according to claim 6, wherein the determining unit is further configured to add an identifier to the video layer, and the identifier is used to determine that the data for PQ enhancement is displayed on the video layer Video stream.
The device according to claim 5, wherein the determining unit is specifically configured to determine the video image in the video stream according to the size of the video image in the video stream and the size of the video layer The position displayed on the video layer;

Recording the coordinate information or margin information of the video image in the video stream on the video layer.
An electronic device, characterized in that it comprises:

A transceiver to obtain video information, where the video information includes a video stream and an instruction set, and the instruction set includes an instruction input by a user while watching the video and interacting;

The first chip determines the position information of the video layer and the video stream displayed on the video layer;

The second chip performs PQ enhancement on the video stream displayed on the video layer;

The PQ enhanced video layer and instruction layer are superimposed, and then sent to the display screen for display. The instruction layer is used to display interactive content converted by each instruction in the instruction set, and the instruction layer includes The first area in a transparent state is determined according to the position information.
The electronic device according to claim 9, wherein the first chip and the second chip comprise a first channel and a second channel,

The first channel is used to send the video stream identified by the first chip to the second chip;

The second channel is used to send the position information of the video stream of the first chip and the instruction set to the second chip.
11. The electronic device according to claim 10, wherein the first channel is a data channel DP, and the second channel is a standard PCIe channel for quick peripheral component interconnection.
The electronic device according to claim 9, wherein the first chip is specifically configured to recognize the video layer through a video layer recognition technology.
The electronic device according to claim 9, wherein the first chip is further used to add an identifier to the video layer, and the identifier is used to determine that the data for PQ enhancement of the second chip is The video stream displayed on the video layer.
The electronic device according to claim 9, wherein the first chip is specifically configured to determine the size of the video image in the video stream according to the size of the video image in the video stream and the size of the video layer. The display position of the video image on the video layer;

Recording the coordinate information or margin information of the video image in the video stream on the video layer.
A computer-readable storage medium for storing instructions/executable code. When the instructions/executable code are executed by the processor of an electronic device, the electronic device realizes the requirements described in any one of claims 1-4. The method described.
A computer program product containing instructions that, when the instructions run on a computer, cause the computer to execute the method according to any one of claims 1-4.