CN111294649A

CN111294649A - Content display method and device based on screen combination, electronic equipment and storage medium

Info

Publication number: CN111294649A
Application number: CN202010400016.7A
Authority: CN
Inventors: 邓朔
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2020-05-13
Filing date: 2020-05-13
Publication date: 2020-06-16
Anticipated expiration: 2040-05-13
Also published as: CN111294649B

Abstract

The invention provides a content display method and device based on a group screen, electronic equipment and a storage medium; the method comprises the following steps: receiving a group screen display instruction aiming at target content, wherein the group screen display instruction is used for indicating that the target content is displayed through at least two screen devices in a combined mode; responding to a screen combination display instruction, and acquiring pixel data corresponding to target content and color gamut parameters of at least two screen devices; performing color gamut adjustment on the pixel data according to the color gamut parameters of the at least two screen devices to obtain target pixel data, wherein the color gamut corresponding to the target pixel data is covered by the color gamuts of the at least two screen devices; and performing screen rendering based on the target pixel data to obtain first screen content, wherein the first screen content has the same color with the second screen content, and the first screen content and the second screen content are combined to obtain the target content. By the method and the device, the colors of the target contents displayed by the at least two screen devices in a combined mode can be consistent, and the user experience is improved.

Description

Content display method and device based on screen combination, electronic equipment and storage medium

Technical Field

The invention relates to the technical field of computers, in particular to a method and a device for displaying content of a combined screen, electronic equipment and a storage medium.

Background

When the content is displayed, in order to obtain a wider display size, the content to be displayed can be displayed in a group screen mode through a plurality of screen devices. However, due to the fact that screen qualities of different screen devices are different, when the same color is displayed on different screens, the situation of inconsistency exists, the effect of screen combination display is poor, and user experience is poor.

Disclosure of Invention

The embodiment of the invention provides a method and a device for displaying contents of a combined screen, electronic equipment and a storage medium, which can enable colors of target contents displayed by combining at least two screen devices to be consistent.

The technical scheme of the embodiment of the invention is realized as follows:

the embodiment of the invention provides a content display method for a combined screen, which comprises the following steps:

receiving a group screen display instruction aiming at target content, wherein the group screen display instruction is used for indicating that the target content is displayed through at least two screen devices in a combined mode;

responding to the group screen display instruction, and acquiring pixel data corresponding to the target content and color gamut parameters of the at least two screen devices;

performing screen rendering based on the target pixel data to obtain first screen content, wherein the first screen content and the second screen content have the same color, and are combined with the second screen content to obtain the target content;

and the second screen content is obtained by rendering the screen of other screen equipment in the at least two screen equipment based on the target pixel data.

The embodiment of the invention provides a content display device for screen assembly, which comprises:

the display device comprises a receiving module, a display module and a display module, wherein the receiving module is used for receiving a group screen display instruction aiming at target content, and the group screen display instruction is used for indicating that the target content is displayed by at least two screen devices in a combined mode;

the acquisition module is used for responding to the group screen display instruction, and acquiring pixel data corresponding to the target content and color gamut parameters of the at least two screen devices;

the adjusting module is used for adjusting the color gamut of the pixel data according to the color gamut parameters of the at least two screen devices to obtain target pixel data, and the color gamut corresponding to the target pixel data is covered by the color gamuts of the at least two screen devices;

the rendering module is used for performing screen rendering based on the target pixel data to obtain first screen content, wherein the first screen content and the second screen content have the same color, and are combined with the second screen content to obtain the target content;

In the above scheme, the apparatus further comprises:

and the conversion module is used for converting the pixel data expressed in the red, green and blue RGB format into the pixel data expressed by the spectral tristimulus values XYZ.

In the above scheme, the adjusting module is further configured to determine a coincidence color gamut of the at least two screen devices according to the color gamut parameters of the at least two screen devices;

and performing color gamut adjustment on the pixel data according to the overlapped color gamuts of the at least two screen devices.

In the foregoing solution, the adjusting module is further configured to obtain each color value in a color gamut corresponding to the pixel data;

and when the color value is determined to exceed the overlapped color gamut, mapping the color value to a boundary value of the overlapped color gamut so as to perform color gamut adjustment on the pixel data.

In the above scheme, the adjusting module is further configured to determine a connection line between the color value and a white point value in the overlapped color gamut and an intersection point between the connection line and a boundary line of the overlapped color gamut;

and adjusting the color value to the color value corresponding to the intersection point so as to realize the mapping of the color value to the boundary value of the overlapped color gamut.

In the foregoing solution, the adjusting module is further configured to determine a mapping center point in the superposition color gamut;

and linearly compressing each color value in the color gamut corresponding to the pixel data towards the position of the mapping center point until the color gamut corresponding to the pixel data is compressed into the superposed color gamut, so as to realize the color gamut adjustment of the pixel data.

In the foregoing solution, the adjusting module is further configured to determine a mapping center point in the coincidence color gamut;

selecting a partial area in the superposed color gamut as a core area;

and linearly compressing each color value exceeding the core area in the color gamut corresponding to the pixel data towards the position of the mapping center point until each color value exceeding the core area is compressed to a position between the boundary of the core area and the boundary of the overlapped color gamut.

In the above scheme, the adjusting module is further configured to divide the pixel data to obtain sub-pixel data corresponding to each screen device;

and performing color gamut adjustment on the sub-pixel data corresponding to the current screen device according to the color gamut parameters of the at least two screen devices.

In the above scheme, the adjusting module is further configured to determine, according to the color gamut parameters of the at least two screen devices, a screen device with a minimum color gamut coverage rate;

and when the color gamut of the screen device with the minimum color gamut coverage rate cannot cover the color gamut corresponding to the corresponding sub-pixel data, performing color gamut adjustment on the sub-pixel data corresponding to the current screen device according to the color gamut parameter of the screen device with the minimum color gamut coverage rate.

In the above scheme, the obtaining module is further configured to obtain a video file corresponding to the target video when the target content is the target video;

and decoding the video file to obtain pixel data corresponding to each video frame in the video file.

In the above scheme, the obtaining module is further configured to obtain a page file corresponding to the target page when the target content is the target page;

analyzing the page file to obtain the style and the position of each element in the target page;

and determining pixel data corresponding to the target page according to the style and the position of each element in the target page.

In the above scheme, the rendering module is further configured to divide the target pixel data to obtain pixel data corresponding to content to be displayed by each of the screen devices;

and performing screen rendering on pixel data corresponding to the content required to be displayed by the current screen equipment to obtain first screen content.

An embodiment of the present invention provides an electronic device, including:

a memory for storing executable instructions;

and the processor is used for realizing the content display method of the group screen provided by the embodiment of the invention when the executable instructions stored in the memory are executed.

The embodiment of the invention provides a storage medium, which stores an executable instruction, wherein the executable instruction is used for executing the content display method of the group screen provided by the embodiment of the invention.

The embodiment of the invention has the following beneficial effects:

according to the method, the color gamut of the pixel data is adjusted according to the color gamut parameters of at least two screen devices to obtain target pixel data, and the color gamut corresponding to the target pixel data is covered by the color gamuts of the at least two screen devices; because the color gamut of all the screen devices used for displaying the target content can cover the color gamut corresponding to the target pixel data, when the target content is displayed, the color displayed by each screen device can be the same as the color corresponding to the target pixel data, and further, the colors of the target content displayed by at least two screen device combinations are consistent.

Drawings

Fig. 1 is a schematic flow chart of a video playing process provided by the related art;

fig. 2 is a schematic diagram illustrating a principle of generating color difference in video playing according to an embodiment of the present invention;

FIG. 3 is a schematic diagram illustrating a principle of color difference generated in a group screen playing of a video according to an embodiment of the present invention;

FIG. 4 is an alternative architectural diagram of a group screen-based content presentation system 100 provided by embodiments of the present invention;

FIG. 5 is a schematic flow chart of an alternative method for presenting content based on a group screen according to an embodiment of the present invention;

FIG. 6 is a schematic diagram of a color gamut of a screen device provided by an embodiment of the present invention;

FIG. 7 is a schematic diagram of a coincidence color gamut provided by an embodiment of the present invention;

fig. 8 is a schematic diagram of color gamut adjustment provided by an embodiment of the present invention;

fig. 9 is a schematic diagram of color gamut adjustment provided by an embodiment of the present invention;

fig. 10 is a schematic diagram of color gamut adjustment provided by an embodiment of the present invention;

fig. 11 is a schematic diagram of color gamut adjustment provided by an embodiment of the present invention;

FIG. 12 is a schematic diagram of a combined rendering provided by an embodiment of the invention;

FIG. 13 is an alternative flowchart of a method for presenting content based on a group screen according to an embodiment of the present invention;

FIG. 14 is a software module diagram of a content presentation system based on group screens provided by an embodiment of the present invention;

FIG. 15 is a diagram of a screen device for group screen playing according to an embodiment of the present invention;

FIG. 16 is a flowchart illustrating an exemplary process of adjusting pixel data by a screen device A according to the present invention;

FIG. 17 is a flow chart illustrating the adjustment of pixel data by the screen device B, C, D according to the embodiment of the present invention;

FIG. 18 is a schematic structural component diagram of a content presentation device based on group screen according to an embodiment of the present invention;

fig. 19 is an alternative structural diagram of an electronic device 500 according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail with reference to the accompanying drawings, the described embodiments should not be construed as limiting the present invention, and all other embodiments obtained by a person of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

In the following description, reference is made to "some embodiments" which describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or different subsets of all possible embodiments, and may be combined with each other without conflict.

In the description that follows, references to the terms "first \ second \ third" are intended merely to distinguish similar objects and do not denote a particular order, but rather are to be understood that the terms "first \ second \ third" may be interchanged under certain circumstances or sequences of events to enable embodiments of the invention described herein to be practiced in other than those illustrated or described herein.

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used herein is for the purpose of describing embodiments of the invention only and is not intended to be limiting of the invention.

Before further detailed description of the embodiments of the present invention, terms and expressions mentioned in the embodiments of the present invention are explained, and the terms and expressions mentioned in the embodiments of the present invention are applied to the following explanations.

1) A color gamut refers to a color set represented by an entity in a color space, including an image color gamut, a device color gamut, a color space color gamut, and the like, for example, an image color gamut is a set of all colors owned on a specific image; device gamut, i.e., the set of all colors a particular device can produce on a medium; color space gamut is the set of all colors that are owned in a particular color space.

2) And the group screen display means that a plurality of screen devices respectively display a part of the target content to jointly form the complete target content.

3) In response to the condition or state on which the performed operation depends, one or more of the performed operations may be in real-time or may have a set delay when the dependent condition or state is satisfied; there is no restriction on the order of execution of the operations performed unless otherwise specified.

Before explaining a content display method, a content display device, an electronic device, and a storage medium of a group screen according to an embodiment of the present invention, a flow related to color in a video playing process is introduced first, fig. 1 is a schematic flow diagram of a video playing process provided in the related art, and referring to fig. 1, the video playing process includes:

step 101: and acquiring a video file to be played.

Step 102: and decoding the video file through a decoder to obtain pixel data corresponding to each video frame in the video file.

Step 103: and rendering the pixel data according to the color gamut parameters of the screen device.

In practical implementation, using a CIEXYZ color space as a reference standard, for example, sRGB, AdobeRGB, and the like can be expressed in the CIEXYZ color space. Here, pixel data of a video file may be represented in a CIEXYZ color space.

Fig. 2 is a schematic diagram illustrating a principle of generating color difference in video playing according to an embodiment of the present invention, and referring to fig. 2, the inventor finds that, in a process of implementing an embodiment of the present invention, when a color gamut parameter of a screen device does not match a color gamut (a color gamut of a video file) corresponding to pixel data, a difference exists between a rendered color (a color observed by a user) and a color (a color desired by a movie producer) corresponding to the pixel data itself. For example, the color gamut corresponding to the pixel data includes green, but the color gamut of the screen device does not include green, i.e., the screen device cannot present green, so that the color presented by the screen device is different from the color of the pixel data itself, and thus color difference occurs. If the gamut of the screen device can completely cover the gamut corresponding to the pixel data (the gamut of the video file), the color difference in fig. 2 is eliminated.

Fig. 3 is a schematic diagram illustrating a principle that a video generates a color difference during a group screen playing process according to an embodiment of the present invention, and referring to fig. 3, taking group screen playing of a video through a screen device a and a screen device B as an example, a process of playing a video through a group screen includes:

step 301: and acquiring a video file to be played.

Step 302: and decoding the video file through a decoder to obtain pixel data corresponding to each video frame in the video file.

Step 303: and rendering the pixel data according to the color gamut parameters of the screen device A and the screen device B.

When a video file is played in a group screen mode, due to the fact that color gamut parameters of different screen devices are different, the display effect of the same video on different screen devices has the problem of inconsistent color, for example, the color quality of a screen is poor, the color gamut of the video file cannot be completely covered, or the parameters are not calibrated when the screen leaves a factory, and display color cast is caused. It should be noted that the color inconsistency refers to the color rendering inconsistency between screen devices, not the display inaccuracy.

Based on this, the content display method and apparatus based on group screen, the electronic device and the storage medium of the embodiments of the invention are proposed to at least solve the above problems in the related art, and are respectively described below.

Referring to fig. 4, fig. 4 is an alternative architecture diagram of the content presentation system 100 based on group screen according to the embodiment of the present invention, in order to support an exemplary application, terminals (including a terminal 400-1, a terminal 400-2, and a terminal 400-3) are connected to the server 200 through the network 300, where the terminal 400-1, the terminal 400-2, and the terminal 400-3 are used to combine and present target content, and the number of the terminals is not limited to three, and may be two or more; the network 300 may be a wide area network or a local area network, or a combination of both, using wireless links for data transmission.

The terminal 400-1 is used for receiving a group screen display instruction aiming at the target content, and the group screen display instruction is used for indicating that the target content is displayed through the combination of the terminal 400-1, the terminal 400-2 and the terminal 400-3; responding to the screen combination display instruction, and sending an acquisition request of a file corresponding to the target content and acquisition requests of color gamut parameters of the terminal 400-1, the terminal 400-2 and the terminal 400-3 to the server;

the server 200 is used for sending the file corresponding to the target content and the color gamut parameters of the terminal 400-1, the terminal 400-2 and the terminal 400-3 to the terminal 400-1;

the terminal 400-1 is configured to obtain pixel data corresponding to a target content according to a file corresponding to the target content; according to the color gamut parameters of the terminal 400-1, the terminal 400-2 and the terminal 400-3, the color gamut of the pixel data is adjusted to obtain target pixel data, and the corresponding color gamut in the target pixel data is covered by the color gamuts of the terminal 400-1, the terminal 400-2 and the terminal 400-3.

The terminal 400-1, the terminal 400-2 and the terminal 400-3 are used for performing combined rendering on target pixel data.

In practical application, the terminal can be a smart phone, a tablet computer, a notebook computer, a desktop computer, a media player, a game machine, a television and the like; the server 200 may be a single server configured to support various services, may also be configured as a server cluster, may also be a cloud server, and the like.

Based on the above description of the content display system based on the group screen according to the embodiment of the present invention, a content display method based on the group screen according to the embodiment of the present invention is described next. In some embodiments, the content display method based on the group screen provided by the embodiment of the present invention may be implemented by a terminal alone, or implemented by a server and a terminal in a cooperation manner.

Referring to fig. 5, fig. 5 is an alternative flowchart of a content presentation method based on a group screen according to an embodiment of the present invention, which will be described with reference to the steps shown in fig. 5.

Step 501: the terminal receives a group screen display instruction aiming at the target content, wherein the group screen display instruction is used for indicating that the target content is displayed through at least two screen devices in a combined mode.

In actual implementation, the terminal is provided with a client, such as a video client, a browser client, an instant messaging client, an education client, and the like, and a user can select target content to be subjected to group screen display and screen equipment for group screen display through the client. Wherein, the terminal provided with the client is also screen equipment. Here, the target content may be any content such as video, image, page, and the like.

It should be noted that at least two screen devices for group screen display may be connected through bluetooth, WiFi, USB interface, or other methods.

Step 502: and responding to the group screen display instruction, and acquiring pixel data corresponding to the target content and color gamut parameters of at least two screen devices.

In actual implementation, the pixel data comprises the color value of each pixel point in the target content; the color gamut parameters at least include XYZ coordinate values of colors that can be displayed by the screen device in a CIEXYZ color space, and the color gamut of the screen device, that is, a set of all colors that can be displayed by the screen device, can be determined according to the color gamut parameters. For example, fig. 6 is a schematic diagram of the color gamut of the screen device provided by the embodiment of the present invention, referring to fig. 6, a portion of a triangular region is a representation of the color gamut of the screen device on the CIEXYZ color space, and a point E in the triangular region is a white point value.

In some embodiments, the terminal may obtain the pixel data corresponding to the target content by: when the target content is a target video, acquiring a video file corresponding to the target video; and decoding the video file to obtain pixel data corresponding to each video frame in the video file.

In actual implementation, when the target content is a target video, the group screen display instruction may be triggered by the video player, and when the group screen display instruction is received, an acquisition request of the video file is sent to the server, so as to acquire a corresponding video file from the server storing the video file; video files are usually in a packaging format, such as MP4, MKV, RMVB, TS, FLV, AVI, etc., and it is used to put compressed and encoded video data and audio data together according to a certain format, and decoding is performed after the video files in the packaging format need to be unpacked; by decoding, the compression-encoded video data is output as uncompressed pixel data, where the pixel data is color data, such as YUV420P, RGB, and the like.

In some embodiments, the terminal may obtain the pixel data corresponding to the target content by: when the target content is a target page, acquiring a page file corresponding to the target page; analyzing the page file to obtain the style and the position of each element in the target page; and determining pixel data corresponding to the target page according to the style and the position of each element in the target page.

In actual implementation, when the target content is a target page, the group screen display instruction may be triggered by a browser, and when the group screen display instruction is received, an acquisition request of the target page is sent to a server to acquire a corresponding page file from the server storing the page file, where the page file is an HTML file, and when the HTML file is acquired, the HTML file is analyzed according to an HTML protocol to obtain each element in the page, and a style and a position of the element. Wherein the style includes the color, size, etc. of the element. And drawing each element according to the style and the position of each element in the target page to determine the pixel data corresponding to the target page.

In some embodiments, the terminal may obtain the gamut parameters for at least two screen devices by: the server stores the color gamut parameters of each screen device, the terminal sends an acquisition request of the color gamut parameters of at least two screen devices to the server, and the server searches for the corresponding color gamut parameters according to the identification information, such as the model number, of the at least two screen devices and sends the corresponding color gamut parameters to the terminal.

Step 503: and performing color gamut adjustment on the pixel data according to the color gamut parameters of at least two screen devices to obtain target pixel data.

Here, the color gamut corresponding to the target pixel data is covered by the color gamuts of the at least two screen devices.

In practical implementation, the color gamut corresponding to the pixel data is the color set of each pixel point in the target content, so that the color gamut of the pixel data is adjusted, that is, the color value of each pixel point in the target content is adjusted. Here, the color gamut corresponding to the target pixel data is covered by the color gamuts of at least two screen devices, indicating that each screen device can present without color difference for each color value in the color gamut corresponding to the target pixel data.

In some embodiments, the terminal may need to convert pixel data represented in red, green, and blue (RGB) format to pixel data represented in spectral tristimulus values (XYZ) before performing gamut adjustment on the pixel data.

In practical implementation, to accurately render pixel data, it is necessary to represent the pixel data and the color gamut of each screen device in the same color space. Since the acquired color gamut of each screen device is represented by XYZ coordinate values on the CIEXYZ color space, and the pixel data is usually expressed in RGB form, it is necessary to convert the pixel data expressed in RGB format into pixel data expressed in XYZ.

Here, RGB means that the amount of red is defined as an X coordinate axis, the amount of yellow is defined as a Y coordinate axis, and the amount of blue is defined as a Z coordinate axis, so that a three-dimensional space is obtained, and each possible color has a unique position in the three-dimensional space; XYZ selects the three ideal primary colors instead of the actual primary colors, thereby changing R, G, B to positive values.

It should be noted that, in some embodiments, other color spaces may be used as the reference color space to represent the pixel data and the color gamut of the screen device by the coordinate values of the reference color space.

In some embodiments, the terminal may perform gamut adjustment on the pixel data by: determining the coincidence color gamut of the at least two screen devices according to the color gamut parameters of the at least two screen devices; and performing color gamut adjustment on the pixel data according to the overlapped color gamuts of the at least two screen devices.

Here, the overlapped color gamut refers to a portion where the color gamuts of the at least two screen devices overlap, and in actual implementation, the terminal determines the portion where the color gamuts of the at least two screen devices overlap according to the color gamut parameters of the at least two screen devices, where the portion where the color gamuts of the at least two screen devices overlap is necessarily covered by the color gamuts of the at least two screen devices, and therefore, the color gamut adjustment is performed on the pixel data based on the overlapped color gamut, so that the color gamut corresponding to the target pixel data is completely covered by the overlapped color gamut.

For example, fig. 7 is a schematic diagram of a coincidence color gamut provided by an embodiment of the present invention, and referring to fig. 7, a screen device for performing group screen display includes a screen device a and a screen device B, a portion where a color gamut 701 of the screen device a intersects with a color gamut 702 of the screen device B is a coincidence color gamut, and a gray portion in fig. 7 is a coincidence color gamut.

It should be noted that, if the color gamut of a certain screen device is completely covered by the color gamuts of other screen devices, the color gamut of the screen device is the overlapped color gamut. For example, the screen device for performing the group screen display includes a screen device a and a screen device B, where the color gamut of the screen device B is larger than the color gamut of the screen device a and can completely cover the color gamut of the screen device a, then the color gamut adjustment may be performed on the pixel data directly according to the color gamut of the screen device a.

In some embodiments, the terminal may perform gamut adjustment on the pixel data by: acquiring each color value in a color gamut corresponding to the pixel data; and when the color value is determined to exceed the overlapped color gamut, mapping the color value to the boundary value of the overlapped color gamut so as to perform color gamut adjustment on the pixel data.

In practical implementation, a color gamut clipping mode is adopted to adjust the color gamut of the pixel data, namely, color values exceeding the overlapped color gamut in the color gamut corresponding to the pixel data are all mapped to the boundary of the overlapped color gamut; for colors within the coincidence gamut, the original color values are preserved.

For example, referring to fig. 8, fig. 8 is a schematic diagram of color gamut adjustment provided by the embodiment of the present invention, where a color value P in a color gamut 801 corresponding to pixel data is outside an overlap color gamut 802, and is mapped to a boundary value P' of the overlap color gamut.

In some embodiments, to reduce the color difference between the adjusted color value and the original color value, the terminal may map the color value to a boundary value of the coinciding gamut by: determining a connecting line of the color value and a white point value in the overlapped color gamut and an intersection point of the connecting line and a boundary line of the overlapped color gamut; and adjusting the color value to the color value corresponding to the intersection point so as to realize the mapping of the color value to the boundary value of the overlapped color gamut.

In practical implementation, for color values outside the coincidence gamut, mapping is performed in a direction toward the white point value to sequentially map the color values outside the coincidence gamut onto the boundary of the coincidence gamut.

For example, referring to fig. 9, fig. 9 is a schematic diagram of color gamut adjustment provided in the embodiment of the present invention, a color value Q in a color gamut 901 corresponding to pixel data is outside an overlap color gamut 902, the color value Q is connected to a white point value E by a straight line, so as to obtain a connecting line of the color value Q and the white point value E, and the connecting line intersects with a boundary of the overlap color gamut at Q ', so that the color value is mapped to a boundary value Q' of the overlap color gamut.

The original color saturation of the target content can be maintained by determining the intersection point of the connecting line of the color value and the white point value in the overlapped color gamut and the boundary line of the connecting line and the overlapped color gamut and adjusting the color value to the color value corresponding to the intersection point.

In some embodiments, the terminal may perform gamut adjustment on the pixel data by: determining a mapping center point in the coincident color gamut; and linearly compressing each color value in the color gamut corresponding to the pixel data towards the position of the mapping center point until the color gamut corresponding to the pixel data is compressed into the overlapped color gamut, so as to realize the color gamut adjustment of the pixel data.

Here, the mapping center point may be a white point value, or may be another value. For example, referring to fig. 10, fig. 10 is a schematic diagram of color gamut adjustment provided by the embodiment of the present invention, where F is a mapping center point, a color value R in a color gamut 1001 corresponding to pixel data is outside an overlapped color gamut 1002, and linear compression is performed along a connecting line between the color values R and F in a direction of F, so that the color value R is compressed to R'; and linear compression is also performed on the color value S in the overlapped gamut, that is, linear compression is performed along the connecting line of the color values S to F in the direction of F, so that the color value S is compressed to S'.

By means of color gamut compression, each color value in the color gamut corresponding to the pixel data is compressed, and the interrelation among colors can be ensured so as to maintain the detail part in the target content.

In actual implementation, for each color value, a straight line passing through the mapping center and the color value may be determined, then a first intersection point of the straight line and the overlapped gamut boundary and a second intersection point of the straight line and the gamut boundary corresponding to the pixel data are determined, and a compression ratio of linear compression is determined according to a distance between the mapping center and the first intersection point and a distance between the mapping center and the second intersection point, so as to linearly compress the color value based on the compression ratio.

In some embodiments, the terminal may perform gamut adjustment on the pixel data by: determining a mapping center point in the coincident color gamut; selecting partial areas in the superposed color gamut as core areas; and linearly compressing each color value exceeding the core area in the color gamut corresponding to the pixel data towards the position of the mapping center point until each color value exceeding the core area is compressed to a position between the boundary of the core area and the boundary of the overlapped color gamut.

In practical implementation, a certain proportion of the area in the overlapped color gamut can be selected as a core area, and only the color values exceeding the core area are compressed, namely the color values exceeding the core area are compressed to be between the boundary of the core area and the boundary of the overlapped color gamut; while the color values in the core area remain unchanged. Thus, most of the color values in the color gamut corresponding to the pixel data can be maintained, and the saturation of the colors in the color gamut corresponding to the pixel data is prevented from being excessively compressed.

For example, referring to fig. 11, fig. 11 is a schematic diagram of color gamut adjustment provided by the embodiment of the present invention, taking 90% of an overlapped color gamut 1101 as a core region 1102, where a color value T in a color gamut 1103 corresponding to pixel data is outside the core region 1102, and performing linear compression along a connection line between the color value T and a mapping center point G toward the direction of the mapping center point G, so that the color value T is compressed to T ', where T' is located between a boundary of the core region and a boundary of the overlapped color gamut.

In some embodiments, the terminal may perform gamut adjustment on the pixel data by: dividing the pixel data to obtain sub-pixel data corresponding to each screen device; and respectively carrying out color gamut adjustment on the sub-pixel data corresponding to the current screen device through each screen device according to the color gamut parameters of at least two screen devices.

In actual implementation, after the pixel data is obtained, the terminal may determine a portion to be rendered of each screen device according to information such as the size and the position of each screen device, and divide the pixel data based on the portion to be rendered of each screen device to obtain sub-pixel data of each screen device, so that each screen device performs color gamut adjustment on the corresponding sub-pixel data according to color gamut parameters of at least two screen devices. Therefore, the calculation amount of the terminal can be reduced, and the color gamut adjusting process is more efficient.

In some embodiments, the color gamut adjustment may be performed on the sub-pixel data corresponding to the current screen device by: determining the screen equipment with the minimum color gamut coverage rate according to the color gamut parameters of at least two screen equipment; and when the color gamut of the screen equipment with the minimum color gamut coverage rate cannot cover the color gamut corresponding to the corresponding sub-pixel data is determined through the screen equipment with the minimum color gamut coverage rate, performing color gamut adjustment on the sub-pixel data corresponding to the current screen equipment according to the color gamut parameter of the screen equipment with the minimum color gamut coverage rate.

Here, the gamut coverage is sRGB gamut coverage, which refers to the overlapping range of the gamut of the screen device and the sRGB gamut, for example, 99% coverage means that the coverage reaches 99% of sRGB. Here, the sRGB color gamut and the color gamut of the screen device are expressed in the CIEXYZ color space.

In practical implementation, the color gamut parameters further include sRGB color gamut coverage rates of the screen devices, sRGB color gamut coverage rates of at least two screen devices are compared, the screen device with the minimum sRGB color gamut coverage rate is determined, and color gamut adjustment is performed on corresponding sub-pixel data with the color gamut of the screen device with the minimum sRGB color gamut coverage rate as a standard. Here, the color gamut of the screen device with the minimum sRGB color gamut coverage rate must be completely covered by the color gamuts of the other screen devices.

After the screen device with the smallest screen performs color gamut adjustment on the corresponding sub-pixel data, sending notification information to other screen devices to notify the other screen devices of the color gamut adjustment mode, for example, to notify the other screen devices of the adjustment of the color values and how to adjust the color values, so that the other screen devices perform the same color gamut adjustment mode on the corresponding sub-pixel data as the screen device with the smallest color gamut coverage rate.

In some embodiments, the pixel data may also be sent to a screen device with the minimum sRGB gamut coverage, and the screen device with the minimum sRGB gamut coverage performs gamut adjustment on the entire pixel data according to its own gamut, and after the gamut adjustment, distributes the adjusted pixel data to each screen device.

Step 504: and performing screen rendering based on the target pixel data to obtain first screen content.

The first screen content and the second screen content are consistent in color and combined with each other to obtain the target content; and the second screen content is obtained by rendering the screen of other screen equipment in the at least two screen equipment based on the target pixel data.

Referring to fig. 12, fig. 12 is a schematic diagram of combined rendering according to an embodiment of the present invention, where target pixel data is combined and rendered through a screen device a, a screen device B, a screen device C, and a screen device D, and content rendered by each screen device is combined into a complete image.

In some embodiments, when the target pixel data is obtained by performing gamut adjustment on the pixel data, the first screen content may be obtained by: dividing the target pixel data to obtain pixel data corresponding to the display content required by each screen device; and performing screen rendering on pixel data corresponding to the content required to be displayed by the current screen equipment to obtain first screen content.

In actual implementation, according to the positions of at least two screen devices and the screen size, pixel data corresponding to the content required to be displayed by each screen device is determined, and the pixel data corresponding to the content required to be displayed by each screen device is transmitted to each screen device, so that each screen device respectively renders and displays the corresponding pixel data, and the content displayed by each screen device is spliced to obtain complete target content.

In some embodiments, the target pixel data may also be completely transmitted to each screen device, so that each screen device determines, according to the position where the screen device is located and the size of the screen, a portion of pixel data to be rendered in the target pixel data, and then renders the determined portion of pixel data.

In some embodiments, when the target pixel data is obtained by performing color gamut adjustment on the corresponding sub-pixel data through each screen device, each screen device performs color gamut adjustment on the corresponding sub-pixel data to obtain corresponding sub-target pixel data, and the obtained sub-pixel data can be directly rendered.

The following describes the content display method based on the group screen, taking the target content as the target video as an example. Fig. 13 is an alternative flowchart of a content presentation method based on a group screen according to an embodiment of the present invention, which will be described with reference to the steps shown in fig. 13.

Step 1301: the screen device a receives a combined presentation instruction for the target video.

Wherein the combined presentation instruction is for instructing combined presentation of the target video by the screen device A, B. The screen device A, B may be connected via bluetooth, WiFi, USB, or other means.

Step 1302: in response to the group screen presentation instruction, the screen device a sends, to the server, an acquisition request of a file corresponding to the target content and an acquisition request of the color gamut parameter of the screen device A, B.

Step 1303: the server sends the video file of the target video, and the color gamut parameters of the screen device A, B to screen device a.

Step 1304: the screen device A decodes the video file to obtain pixel data corresponding to each video frame in the video file.

Here, the pixel data includes color values of respective pixel points in the video frame; the color gamut parameters at least include XYZ coordinate values of colors that can be displayed by the screen device in a CIEXYZ color space, and the color gamut of the screen device, that is, a set of all colors that can be displayed by the screen device, can be determined according to the color gamut parameters.

Step 1305: the screen device a determines the coincidence of the two screen device gamuts based on the gamut parameters of the screen device A, B.

For example, referring to fig. 7, the screen device for performing the group screen display includes a screen device a and a screen device B, a portion where a color gamut 701 of the screen device a intersects with a color gamut 702 of the screen device B is an overlapped color gamut, and a gray portion in fig. 7 is an overlapped color gamut.

Step 1306: and the screen device A maps the color values exceeding the coincidence color gamut in the pixel data of each video frame to the boundary value of the coincidence color gamut to obtain the target pixel data of each video frame.

In practical implementation, for each color value exceeding the coincidence gamut, the color value may be mapped to the boundary value of the coincidence gamut by: determining a connecting line of the color value and a white point value in the overlapped color gamut and an intersection point of the connecting line and a boundary line of the overlapped color gamut; and adjusting the color value to the color value corresponding to the intersection point so as to realize the mapping of the color value to the boundary value of the overlapped color gamut.

For example, referring to fig. 9, the color value Q is outside the overlapped color gamut 902, and the color value Q is connected to the white point value E by a straight line to obtain a connecting line of the color value Q and the white point value E, and the connecting line intersects with the boundary of the overlapped color gamut at Q ', so that the color value is mapped to the boundary value Q' of the overlapped color gamut.

Step 1307: the screen size and the relative positional relationship of the screen device A, B are acquired.

Step 1308: the target pixel data of each video frame is divided according to the screen size and the relative position relationship of the screen device A, B to obtain two sub-target pixel data.

Step 1309: and the screen equipment A transmits the data of the sub-target pixels corresponding to the screen equipment B.

Step 1310 a: the screen device a renders the corresponding sub-target pixel data.

Step 1310 b: the screen device B renders the corresponding sub-target pixel data.

The following description will describe an exemplary application of the embodiments of the present invention in a practical application scenario.

In content display based on group screen, the reason that the colors across the screens are inconsistent is caused by different color gamut parameters of different screen devices, so that the colors of target content displayed by at least two screen devices in a combined manner are consistent by acquiring the color gamut parameters of at least two screen devices for group screen display and then performing parameter configuration on the different screen devices.

Fig. 14 is a schematic software module diagram of a group screen-based content presentation system according to an embodiment of the present invention, and referring to fig. 14, the group screen-based content presentation system is used for group screen playing of a video, and the software module of the group screen-based content presentation system includes a front-end rendering part and a background service part.

Wherein the front-end rendering section includes: the system comprises an acquisition module, an adjustment module and a rendering module; the background service part comprises a screen parameter access module.

The front-end rendering section will be explained first.

An obtaining module 1401, configured to obtain a playing source (video file) to be played, and decode the obtained video file to obtain pixel data of each frame of image corresponding to the video file and color gamut parameters of the playing source; and dividing the pixel data of each frame of image and sending the divided pixel data to corresponding screen equipment.

When dividing pixel data of a frame image, the pixel data may be divided according to the position of each screen device and the screen size.

The obtaining module 1401 is further configured to request background screen parameters, and obtain color gamut parameters of each screen for performing group screen playing.

Here, the gamut parameters include the gamut, screen white point value, sRGB coverage expressed by XYZ coordinate values on the CIEXYZ color space.

The adjusting module 1402 is configured to perform color adjustment on the pixel data of each frame of image according to the color gamut parameter of the playback source and the color gamut parameter of each screen device.

A rendering module 1403, configured to perform rendering based on the adjusted pixel data.

The background services section is explained next.

A screen parameter access module 1404 for storing the manually obtained screen color gamut parameters.

Next, a specific operation procedure of the adjusting module 1403 is explained.

In practical implementation, due to the fact that the difference between different screen devices may be too large, for example, the screen qualities of a high-end machine and a low-end machine may be very different, and the display effect of the low-end machine cannot be consistent with that of the high-end machine no matter how the parameters are adjusted, the following method is provided for achieving color consistency through a color adjustment mode, and the cross-screen experience is guaranteed.

sRGB coverage is a quantization parameter for manufacturers to promote their screen quality, specifically referring to the overlapping range of their display color gamut and sRGB color gamut, for example, 99% coverage means that its coverage reaches 99% of sRGB (in CIEXYZ color space).

To obtain maximum compatibility, sRGB coverage is used as a criterion. And comparing the sRGB coverage rates of a plurality of screen devices for performing group screen playing, determining the screen device with the lowest sRGB coverage rate, and taking the color gamut of the screen device as a standard for performing color consistency processing.

In practical implementation, the pixel data of each video frame is converted into the pixel data in the CIEXYZ color space, and if the converted coordinates exceed the color gamut of the screen device with the minimum sRGB coverage, color gamut clipping is performed, that is, the coordinate point outside the color gamut of the screen device with the minimum sRGB coverage is mapped onto the color gamut boundary, so as to adjust the color value of each pixel point in the pixel data. Here, the color gamut of the screen device with the minimum sRGB coverage is completely covered by the color gamuts of the other screen devices.

It should be noted that other color spaces may be used as the reference color space, that is, the color gamut parameters of the screen device and the pixel data of each video frame are converted into the reference color space for representation.

The color value of each pixel point in the pixel data is adjusted, so that the color displayed by each screen device can be consistent with the adjusted color, and the color consistency of the target content displayed by the combination of the two screen devices for group screen playing is realized.

Fig. 15 is a schematic diagram of a screen device for group screen playing according to an embodiment of the present invention, referring to fig. 15, a video file is compositely played by the screen device A, B, C, D, where sRGB coverage of the screen device a is the lowest, and then, pixel data should be adjusted according to the color gamut of the screen device a, and the execution flow is as follows:

fig. 16 is a schematic flow chart of the screen device a according to the embodiment of the present invention for adjusting pixel data, and referring to fig. 16, a process of the screen device a for adjusting pixel data includes:

step 1601: pixel data corresponding to the screen device a in each video frame is received.

Here, the pixel data is color data such as YUV420P, RGB, or the like.

Step 1602: the pixel data of the corresponding screen device a is converted into pixel data in the CIEXYZ color space.

Step 1603: the color gamut of the screen device a is acquired.

Here, the color gamut is expressed in a CIEXYZ color space.

Step 1604: respectively judging whether each color value in the pixel data exceeds the color gamut of the screen device A; if yes, go to step 1605 a; otherwise, step 1606b is performed.

Step 1605 a: the color values are mapped to the gamut boundary of the screen device a.

Step 1605 b: remain unchanged.

Step 1606: adjusted pixel data is acquired.

Step 1607: and rendering the adjusted pixel data.

After the screen device a adjusts the pixel data, it notifies other screen devices so that the other screen devices render with the corrected color values.

Fig. 17 is a schematic flowchart of a process of adjusting pixel data by the screen device B, C, D according to the embodiment of the present invention, and referring to fig. 17, a process of adjusting pixel data by the screen device a includes:

step 1701: notification information of the screen device a is received.

Step 1702: and acquiring pixel data corresponding to the current screen equipment.

Step 1703: the pixel data corresponding to the current screen device is converted to pixel data in the CIEXYZ color space.

Step 1704: the pixel data is adjusted according to the same adjustment manner as the screen device a.

Step 1705: adjusted pixel data is acquired.

Step 1706: and rendering the adjusted pixel data.

In some embodiments, the pixel data corresponding to the entire video file may be adjusted by the screen device a, and then the adjusted pixel data is divided and transmitted to the corresponding screen device, so that each screen device may directly render the adjusted pixel data.

Through the mode, when the user plays the video in the group screen, the user can obtain more perfect consistent watching experience, and the display difference among the screen devices is reduced to the minimum.

Referring to fig. 18, fig. 18 is a schematic structural composition diagram of a content presentation device based on a group screen according to an embodiment of the present invention, and as shown in fig. 18, a content presentation device 555 based on a group screen according to an embodiment of the present invention includes:

a receiving module 5551, configured to receive a group screen display instruction for target content, where the group screen display instruction is used to instruct to display the target content by at least two screen devices in combination;

an obtaining module 5552, configured to obtain, in response to the group screen display instruction, pixel data corresponding to the target content and color gamut parameters of the at least two screen devices;

an adjusting module 5553, configured to perform color gamut adjustment on the pixel data according to the color gamut parameters of the at least two screen devices to obtain target pixel data, where a color gamut corresponding to the target pixel data is covered by the color gamuts of the at least two screen devices;

a rendering module 5554, configured to perform screen rendering based on the target pixel data to obtain a first screen content, where the first screen content and a second screen content have the same color, and are combined with the second screen content to obtain the target content;

In some embodiments, the apparatus further comprises:

In some embodiments, the adjusting module 5553 is further configured to determine a coincidence color gamut of the at least two screen devices according to the color gamut parameters of the at least two screen devices;

In some embodiments, the adjusting module 5553 is further configured to obtain each color value in a color gamut corresponding to the pixel data;

In some embodiments, the adjusting module 5553 is further configured to determine a connection line between the color value and a white point value in the overlapped color gamut, and an intersection point between the connection line and a boundary line of the overlapped color gamut;

In some embodiments, the adjusting module 5553 is further configured to determine a mapped center point in the merged color gamut;

In some embodiments, the adjusting module 5553 is further configured to determine a mapping center point in the merged color gamut;

selecting a partial area in the superposed color gamut as a core area;

In some embodiments, the adjusting module 5553 is further configured to divide the pixel data to obtain sub-pixel data corresponding to each screen device;

In some embodiments, the adjusting module 5553 is further configured to determine, according to the color gamut parameters of the at least two screen devices, a screen device with a minimum color gamut coverage;

In some embodiments, the obtaining module 5552 is further configured to, when the target content is a target video, obtain a video file corresponding to the target video;

In some embodiments, the obtaining module 5552 is further configured to, when the target content is a target page, obtain a page file corresponding to the target page;

In some embodiments, the rendering module 5554 is further configured to divide the target pixel data to obtain pixel data corresponding to display content required by each of the screen devices;

According to the method, the color gamut of the pixel data is adjusted through an adjusting module according to the color gamut parameters of at least two screen devices to obtain target pixel data, and the color gamut corresponding to the target pixel data is covered by the color gamuts of the at least two screen devices; because the color gamut of all the screen devices used for displaying the target content can cover the color gamut corresponding to the target pixel data, when the target content is displayed, the color displayed by each screen device can be the same as the color corresponding to the target pixel data, and further, the colors of the target content displayed by at least two screen device combinations are consistent.

An embodiment of the present invention provides an electronic device, referring to fig. 19, where fig. 19 is an optional schematic structural diagram of the electronic device 500 provided in the embodiment of the present invention, in practical applications, the electronic device 500 may be a terminal or a server in fig. 4, and an example of the electronic device being the terminal shown in fig. 4 is described as an example of the electronic device, where the electronic device implementing the content display method based on a group screen in the embodiment of the present invention includes:

a memory 550 for storing executable instructions;

the processor 510 is configured to implement the method for displaying content based on a group screen according to the embodiment of the present invention when the executable instructions stored in the memory are executed.

Here, the Processor 510 may be an integrated circuit chip having Signal processing capabilities, such as a general purpose Processor, a Digital Signal Processor (DSP), or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like, wherein the general purpose Processor may be a microprocessor or any conventional Processor, or the like.

The memory 550 may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid state memory, hard disk drives, optical disk drives, and the like. Memory 550 optionally includes one or more storage devices physically located remote from processor 510.

The memory 550 may comprise volatile memory or nonvolatile memory, and may also comprise both volatile and nonvolatile memory. The nonvolatile Memory may be a Read Only Memory (ROM), and the volatile Memory may be a Random Access Memory (RAM). The memory 550 described in connection with embodiments of the invention is intended to comprise any suitable type of memory.

At least one network interface 520 and user interface 530 may also be included in some embodiments. The various components in the electronic device 500 are coupled together by a bus system 540. It is understood that the bus system 540 is used to enable communications among the components. The bus system 540 includes a power bus, a control bus, and a status signal bus in addition to a data bus. For clarity of illustration, however, the various buses are labeled as bus system 540 in FIG. 19.

The embodiment of the invention provides a computer-readable storage medium, which stores executable instructions, wherein the executable instructions are used for executing the content display method based on the group screen provided by the embodiment of the invention.

In some embodiments, the storage medium may be memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disk, or CD-ROM; or may be various devices including one or any combination of the above memories.

By way of example, executable instructions may correspond, but do not necessarily have to correspond, to files in a file system, and may be stored in a portion of a file that holds other programs or data, such as in one or more scripts in a hypertext markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files that store one or more modules, sub-programs, or portions of code).

In some embodiments, executable instructions may be written in any form of programming language (including compiled or interpreted languages), in the form of programs, software modules, scripts or code, and may be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.

As an example, executable instructions may be deployed to be executed on one electronic device or on multiple electronic devices located at one site or distributed across multiple sites and interconnected by a communication network.

The above description is only an example of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, and improvement made within the spirit and scope of the present invention are included in the protection scope of the present invention.

Claims

1. A content display method based on screen grouping is characterized by comprising the following steps:

performing color gamut adjustment on the pixel data according to the color gamut parameters of the at least two screen devices to obtain target pixel data, wherein the color gamut corresponding to the target pixel data is covered by the color gamuts of the at least two screen devices;

2. The method of claim 1, wherein prior to performing the gamut adjustment on the pixel data, the method further comprises:

converting the pixel data expressed in red, green and blue RGB format into the pixel data expressed in spectral tristimulus values XYZ.

3. The method of claim 1, wherein the gamut adjusting the pixel data according to the gamut parameters of the at least two screen devices comprises:

determining the coincidence color gamut of the at least two screen devices according to the color gamut parameters of the at least two screen devices;

4. The method of claim 3, wherein the gamut adjusting the pixel data according to the overlapping gamuts of the at least two screen devices comprises:

acquiring each color value in a color gamut corresponding to the pixel data;

5. The method of claim 4, wherein said mapping the color values to boundary values of the coincident color gamut comprises:

determining a connecting line of the color value and a white point value in the overlapped color gamut and an intersection point of the connecting line and a boundary line of the overlapped color gamut;

6. The method of claim 3, wherein the gamut adjusting the pixel data according to the overlapping gamuts of the at least two screen devices comprises:

determining a mapped center point in the coincident color gamut;

7. The method of claim 3, wherein the gamut adjusting the pixel data according to the overlapping gamuts of the at least two screen devices comprises:

determining a mapping center point in the coincident color gamut;

selecting a partial area in the superposed color gamut as a core area;

8. The method of claim 1, wherein the gamut adjusting the pixel data according to the gamut parameters of the at least two screen devices comprises:

dividing the pixel data to obtain sub-pixel data corresponding to each screen device;

9. The method of claim 8, wherein the performing the color gamut adjustment on the sub-pixel data corresponding to the current screen device according to the color gamut parameters of the at least two screen devices comprises:

determining the screen equipment with the minimum color gamut coverage rate according to the color gamut parameters of the at least two screen equipment;

10. The method of claim 1, wherein the obtaining pixel data corresponding to the target content comprises:

when the target content is a target video, acquiring a video file corresponding to the target video;

11. The method of claim 1, wherein the obtaining pixel data corresponding to the target content comprises:

when the target content is a target page, acquiring a page file corresponding to the target page;

12. The method of claim 1, wherein the screen rendering based on the target pixel data resulting in a first screen content, comprises:

dividing the target pixel data to obtain pixel data corresponding to the display content required by each screen device;

13. A group screen-based content presentation apparatus, the apparatus comprising:

14. An electronic device, comprising:

a memory for storing executable instructions;

a processor configured to implement the method of any of claims 1-12 when executing the executable instructions stored in the memory.

15. A storage medium storing executable instructions for performing the group screen-based content presentation method of any one of claims 1 to 12.