WO2021249504A1

WO2021249504A1 - Distributed display method and related device

Info

Publication number: WO2021249504A1
Application number: PCT/CN2021/099491
Authority: WO
Inventors: 杨婉艺; 张茹; 居然; 曹原; 林尤辉
Original assignee: 华为技术有限公司
Priority date: 2020-06-12
Filing date: 2021-06-10
Publication date: 2021-12-16
Also published as: CN113805830B; CN113805830A

Abstract

Disclosed in embodiments of the present application are a distributed display method and a related device, which can be specifically applied to the field of distributed display and the like. The method comprises: obtaining first information of a first interface, the first information comprising a first luminance value and a first saturation value of each of P pixels in the first interface, and the first interface being an interface displayed in a first device; determining N first pixels and M second pixels in the first interface; if the ratio of the sum of the first luminance values of the N first pixels to the sum of the first luminance values of the P pixels is greater than or equal to a second threshold, determining second saturation values of the N first pixels; and generating second information, the second information being used by the second device to display a second interface according to the second information. In this way, the problem of over-bright and over-exposed pictures when a local interface is displayed on other devices can be improved, and the user's comfort when watching the distributed display interfaces on different devices can be ensured.

Description

A distributed display method and related equipment

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on June 12, 2020, the application number is 202010537460.3, and the application name is "a distributed display method and related equipment", the entire content of which is incorporated into this application by reference middle.

Technical field

This application relates to the field of distributed display technology, and in particular to a distributed display method and related equipment.

Background technique

With the development of smart mobile hardware devices, collaboration between multiple devices has become a high-frequency demand for consumers. At present, there have been many solutions for multiple devices to display the content of the opposite end of the interface, but there are major shortcomings in the display optimization for different hardware devices.

TVs, computers and other large LCD screens use light-emitting diodes (Light-Emitting Diode, LED), organic light-emitting diodes (Organic Light-Emitting Diode, OLED) or liquid crystal displays (Liquid Crystal Display, LCD), and their color performance will Affected by multiple links such as backlight module, polarizer, Thin Film Transistor (TFT) structure, liquid crystal, color filter structure, color filter substrate, etc., the screens of different manufacturers and different equipment are affected. The restoration of colors such as blue, red, and black is quite different. At the same time, TV manufacturers will deliberately make their display screens more "bright", causing the original display effect of mobile devices such as mobile phones to be normal, and when they are distributed to other large-screen devices for display, the colors appear overexposed. , Over-brightness, etc. Studies have shown that viewing a display screen that is too bright with the naked eye is more likely to cause fatigue (such as itchy eyes, swelling, tearing, difficulty focusing, headaches, nausea) and other discomforts, which affect the consumer experience.

Therefore, how to improve the display effect when the display interfaces of mobile terminals such as mobile phones are distributed to other large screens such as LCD TVs and ensure the comfort of users' viewing is an urgent problem to be solved.

Summary of the invention

The embodiments of the present application provide a distributed display method and related equipment, which can improve the problem of over-bright and over-exposed pictures when the source interface is distributed and displayed on other devices, optimize the display effect, and ensure that users watch the distributed display interfaces on different devices Comfort at the time.

In a first aspect, an embodiment of the present application provides a distributed display method, including: acquiring first information of a first interface, where the first information includes first brightness values of P pixels in the first interface and A first saturation value; the first interface is an interface displayed in a first device; P is an integer greater than or equal to 1; determining N first pixels and M second pixels in the first interface; The first brightness value of each first pixel in the N first pixels is greater than a first threshold; the first brightness value of each second pixel in the M second pixels is less than or equal to The first threshold; N and M are integers greater than or equal to 1; if the sum of the first brightness values of the N first pixels is equal to the sum of the first brightness values of the P pixels If the ratio is greater than or equal to the second threshold, the second saturation value of the N first pixels is determined; the second saturation value is less than the first saturation value; second information is generated, the second information Including the first brightness value and the second saturation value of the N first pixels, and the first brightness value and the first saturation value of the M second pixels; The second information is used by the second device to display the second interface according to the second information.

With the method provided in the first aspect, when the interface displayed on the terminal device needs to be distributed to other devices for display, the interface can be preprocessed before the distributed display starts, such as reducing the pixels with larger brightness in the interface The saturation value and so on, and then distribute the display to other devices, thereby optimizing the display effect on other devices. Under normal circumstances, due to the differences in display devices between different devices, there are differences in screen brightness and color saturation between different devices. This can easily lead to the normal display of the interface on the terminal device, which is distributed to other devices. The display effect is poor when displayed on the device. For example, when the interface on mobile terminal devices such as mobile phones is displayed on large-screen devices such as LCD TVs, the screen size, picture clarity, brightness, and color brightness of the large-screen devices are often larger than that of the mobile phone, which is easy to cause In the process of distributed display, the pictures displayed on large-screen devices such as LCD TVs are overexposed and bright, and the colors are too bright, which greatly affects the user's viewing experience. Specifically, before the interface on the terminal device is distributed and displayed on other devices, the brightness and saturation values of some or all of the pixels in the interface can be extracted. When the brightness of a large number of pixels in the interface exceeds a certain threshold, Then, the interface can be processed first, for example, the saturation value of pixels whose brightness value exceeds the threshold can be reduced, and then the interface distribution whose saturation value of some pixels has been reduced can be displayed on other devices. Therefore, compared with the prior art, directly distributing the interface on mobile terminal devices such as mobile phones and displaying them on large-screen devices such as LCD TVs can easily cause problems such as overexposure and bright colors and excessively bright colors displayed on large-screen devices. , And cause long-term discomfort and eye fatigue for users. In the embodiment of the present application, before distributing the interface on terminal devices such as mobile phones to other devices (such as LCD TVs or other large-screen devices with poor color reproduction) for display, the pixels with larger brightness in the interface to be displayed can be distributed. The saturation value of is replaced with a smaller saturation value, so that when other devices are performing distributed display, the color of the display interface is comfortable and will not be overexposed and bright, which greatly improves the viewing comfort of the user.

In a possible implementation manner, if the ratio of the sum of the first brightness values of the N first pixels to the sum of the first brightness values of the P pixels is greater than or equal to the second Threshold, determining the second saturation value of the N first pixels, including: if the sum of the first brightness values of the N first pixels and the first brightness values of the P pixels If the ratio of the sum is greater than or equal to the second threshold, it is determined that the first saturation value of the i-th first pixel among the N first pixels is located in the k-th interval; i is greater than or equal to 1, and An integer less than or equal to N; k is an integer greater than 1; the random value in the k-1th interval is determined as the second saturation value of the i-th first pixel; the k-1th interval It is adjacent to the kth interval, and the maximum value in the k-1th interval is smaller than the minimum value in the kth interval.

In the embodiments of the present application, when the interface displayed on the terminal device needs to be distributed to other devices for display, if there are a large number of pixels in the interface displayed on the terminal device whose brightness values exceed the threshold, or there are more than a certain proportion The brightness value of the pixel is greater than the threshold value (that is, there is a brighter area in the interface. If this area is directly distributed and displayed on other devices such as LCD TVs without processing, it will easily cause the screen displayed on other devices to be overexposed and bright. Causes long-term eyestrain, eye swelling, itching, or even tearing of the user's eyes, etc.), the terminal device can determine the interval where the saturation value of the pixel whose brightness value exceeds the threshold is the kth interval, and then In the second-level interval, that is, in the k-1th interval, a random value is selected as the new saturation value of the pixel. Wherein, the k-1th interval and the kth interval may be adjacent, and the maximum value in the k-1th interval may be smaller than the minimum value in the kth interval (for example, the k-1th interval The interval can be (1,2), and the k-th interval can be (2, 3), etc.). As a result, the new saturation value of the pixel whose brightness value exceeds the threshold can be quickly determined, that is, the saturation value of the pixel whose brightness value exceeds the threshold is reduced, so that when other devices are displayed in a distributed display, the picture color is appropriate and will not be too high. Excessive exposure will not cause discomfort to users and ensure user experience.

In a possible implementation manner, the obtaining the first information of the first interface includes: obtaining the first color value of each of the P pixels in the first interface; The first color value is calculated through color space transformation to obtain the first brightness value and the first saturation value of each of the P pixels.

In the embodiment of the present application, since the terminal device cannot directly obtain the brightness value and saturation value of the pixel, you can first obtain the respective color values of some or all of the pixels in the interface of the terminal device (for example, 00A5FF, 7FFFD4, and 8A2BE2). And so on), and then through color space transformation (for example, from RGB color space to HSL color space), the brightness and saturation values corresponding to the respective color values of the part or all of the pixels can be calculated. Optionally, you can also calculate the corresponding hue value, and so on. As a result, the respective brightness and saturation values of some or all of the pixels in the interface of the terminal device can be quickly and accurately obtained, so that the brightness value can be used to determine whether there is a brighter area in the interface. Whether to reduce the saturation value of the pixels with larger brightness, etc., to improve the display effect of the interface when it is distributed to other devices, and to ensure the user's viewing experience.

In a possible implementation manner, the first interface includes one or more image regions; the acquiring the first color value of each of the P pixels in the first interface includes: extracting the first color value of the P pixels in the first interface. The pixel array of each image area in the one or more image areas in an interface; calculating the first color value of each pixel in the pixel array of each image area to obtain the first The first color value of each of the P pixels in the interface.

In the embodiment of the present application, the first interface displayed on the first device may include one or more image areas, and the pixel array (for example, one w*h two-dimensional matrix); then, the first color value of each pixel in the pixel array of each image area is calculated, so that the first color value of each P pixel in the first interface can be obtained, In order to facilitate subsequent calculations to obtain the first brightness value and the first saturation value of each of the P pixels.

In a possible implementation manner, the first interface further includes one or more text areas; the obtaining the first information of the first interface further includes: obtaining the one or more of the first interface The first color value of each text in each text area in each text area; according to the first color value of each text in each text area, through color space transformation, the calculated value is obtained The first brightness value and the first saturation value of each character in each character area.

In the embodiment of the present application, the first interface displayed on the first device may further include one or more text areas, and the first information of the first interface may also include each of the one or more text areas. The first brightness value and the first saturation value of each text in the text area. Thus, the first color value of each text in each text area can be obtained; then, according to the first color value of each text in each text area, the color space is transformed (for example, from RGB The color space is converted to the HSL color space), and the first brightness value and the first saturation value of each text in each text area are calculated. Optionally, the first hue value of each text can also be calculated. In order to facilitate the subsequent calculation of the second saturation value of the text in the text area in the first interface according to the first brightness value and the first saturation value, so as to obtain a lower saturation value, so that the effect of the distributed display better. In this way, if there is a text area in the first interface, the text area can have a better display effect when the text area is distributed and displayed on the second device, and it will not be overexposed and bright, which affects the user's viewing experience.

In a possible implementation, the method further includes: calculating the second color values of the N first pixels and the first color values of the M second pixels according to the second information Generating third information, the third information including the second color values of the N first pixels and the first color values of the M second pixels; the third information is used for all The second device displays the second interface according to the third information.

In the embodiment of the present application, it can be based on the second information (for example, including the first brightness value and the second saturation value of the N first pixels, and the first brightness value and the first saturation value of the M second pixels) , Calculate the respective second color values of the N first pixels and the respective first color values of the M second pixels, and generate third information (for example, including the respective second color values of the N first pixels and the M second The first color value of each pixel); then, the first device can transmit the third information to the second device, and the second device can display the second interface based on the third information, thereby improving the distribution display time of the second device The display effect makes the display screen not glare, and is comfortable to watch with the naked eye, ensuring the user's viewing experience.

In a possible implementation manner, the second device is a device whose screen light-emitting brightness and/or color saturation is greater than that of the first device.

In the embodiment of the present application, the second device is generally a device with a screen whose brightness and/or color saturation are greater than that of the first device. Optionally, the second device may also be a device whose screen luminous brightness is less than or equal to that of the first device, but whose color display is more vivid than the first device, and so on. For example, the second device may be a large-screen device such as an LCD TV, a desktop computer, etc., or it may be another device with poor color reproduction effect and particularly brilliant display of certain colors. The first device may be, for example, a smart phone, Mobile terminal devices such as tablets and laptops. Therefore, if the interface displayed on the first device is directly distributed to the second device for display, it is easy to cause the screen displayed on the second device to be overexposed and bright, the color is too bright, etc. Etc., the user’s viewing comfort cannot be guaranteed. With the distributed display method provided by this application, the interface can be judged and preprocessed before the distributed display of the first device, so that the interface displayed on the first device has a better performance when the distributed display on the second device is performed. Good display effect, the display screen is not glaring, and it is comfortable to watch with the naked eye, that is, to achieve the purpose of optimizing the display effect after changing the display of the device, which can ensure the consistency of the user's viewing experience on different devices.

In the second aspect, an embodiment of the present application provides a distributed display device, which includes:

The acquiring unit is configured to acquire first information of the first interface, where the first information includes the first brightness value and the first saturation value of each of the P pixels in the first interface; the first interface is The interface displayed in the first device; P is an integer greater than or equal to 1;

The first determining unit is configured to determine N first pixels and M second pixels in the first interface; the first brightness value of each first pixel in the N first pixels is greater than the first brightness value of the first pixel A threshold; the first brightness value of each second pixel of the M second pixels is less than or equal to the first threshold; N and M are integers greater than or equal to 1;

The second determining unit is configured to determine if the ratio of the sum of the first brightness values of the N first pixels to the sum of the first brightness values of the P pixels is greater than or equal to a second threshold value The second saturation value of the N first pixels; the second saturation value is less than the first saturation value;

The first generating unit is configured to generate second information, the second information including the first brightness value and the second saturation value of the N first pixels, and the information of the M second pixels The first brightness value and the first saturation value; the second information is used by the second device to display a second interface according to the second information.

In a possible implementation manner, the second determining unit is specifically configured to:

If the ratio of the sum of the first brightness values of the N first pixels to the sum of the first brightness values of the P pixels is greater than or equal to a second threshold, determine the N first pixels The first saturation value of the i-th first pixel in is located in the k-th interval; i is an integer greater than or equal to 1 and less than or equal to N; k is an integer greater than 1;

The random value in the k-1th interval is determined as the second saturation value of the i-th first pixel; the k-1th interval is adjacent to the kth interval, and the The maximum value in the k-1 interval is smaller than the minimum value in the k-th interval.

In a possible implementation manner, the acquiring unit is specifically configured to:

Acquiring the first color value of each of the P pixels in the first interface;

According to the first color value of each of the P pixels, the first brightness value and the first saturation value of each of the P pixels are calculated through color space transformation.

In a possible implementation manner, the first interface includes one or more image areas; the acquiring unit is further specifically configured to:

Extracting the pixel array of each of the one or more image areas in the first interface;

The first color value of each pixel in the pixel array of each image area is calculated to obtain the first color value of each of the P pixels in the first interface.

In a possible implementation manner, the first interface further includes one or more text areas; the acquiring unit is further configured to:

Acquiring the first color value of each text in each text area of the one or more text areas in the first interface;

According to the first color value of each text in each text area, the first brightness value and the first brightness value of each text in each text area are calculated through color space transformation. Saturation value.

In a possible implementation manner, the device further includes:

A calculation unit, configured to calculate the second color values of the N first pixels and the first color values of the M second pixels according to the second information;

The second generating unit is configured to generate third information, where the third information includes the second color values of the N first pixels and the first color values of the M second pixels; The third information is used by the second device to display the second interface according to the third information.

In a third aspect, an embodiment of the present application provides a terminal device, the terminal device is a first device, the terminal device includes a processor, and the processor is configured to support the terminal device to implement the distributed display provided in the first aspect The corresponding function in the method. The terminal device may also include a memory, which is used for coupling with the processor, and stores the necessary program instructions and data of the terminal device. The terminal device may also include a communication interface for the terminal device to communicate with other devices or a communication network.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium that stores a computer program that, when executed by a processor, implements the distribution described in any one of the above-mentioned first aspects Show method flow.

In a fifth aspect, an embodiment of the present application provides a computer program, the computer program includes instructions, when the computer program is executed by a computer, the computer can execute the process of the distributed display method described in any one of the first aspect.

In a sixth aspect, an embodiment of the present application provides a chip system, which includes the distributed display device according to any one of the above-mentioned first aspects, and is used to implement the distributed display according to any one of the above-mentioned first aspects. The functions involved in the method flow. In a possible design, the chip system further includes a memory for storing program instructions and data necessary for the distributed display method. The chip system can be composed of chips, or include chips and other discrete devices.

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application, the following will describe the drawings that need to be used in the embodiments of the present application or the background art.

Fig. 1 is a schematic diagram of a McAdam ellipse in the prior art.

Fig. 2 is a schematic diagram of a CMC (1:c) chromatic aberration ellipse in the prior art.

FIG. 3 is a schematic diagram of a system architecture of a distributed display method provided by an embodiment of the present application.

Fig. 4 is a functional block diagram of a terminal device provided by an embodiment of the present application.

Fig. 5 is a software structure block diagram of a terminal device provided by an embodiment of the present application.

Fig. 6a is a schematic diagram of an application scenario of a distributed display method provided by an embodiment of the present application.

Fig. 6b is a schematic diagram of an application scenario of another distributed display method provided by an embodiment of the present application.

Figures 7a-7b are schematic diagrams of a set of interfaces provided by an embodiment of the present application.

FIG. 8 is a schematic flowchart of a distributed display method provided by an embodiment of the present application.

FIG. 9 is a schematic flowchart of another distribution display method provided by an embodiment of the present application.

FIG. 10 is a schematic diagram of a set of distribution display effects comparison provided by an embodiment of the present application.

FIG. 11 is a schematic structural diagram of a distributed display device provided by an embodiment of the present application.

FIG. 12 is a schematic structural diagram of a terminal device provided by an embodiment of the present application.

detailed description

The embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

The terms "first", "second", "third" and "fourth" in the specification and claims of this application and the drawings are used to distinguish different objects, not to describe a specific order . In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes unlisted steps or units, or optionally also includes Other steps or units inherent in these processes, methods, products or equipment.

Reference to "embodiments" herein means that a specific feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art clearly and implicitly understand that the embodiments described herein can be combined with other embodiments.

The terms "component", "module", "system", etc. used in this specification are used to denote computer-related entities, hardware, firmware, a combination of hardware and software, software, or software in execution. For example, the component may be, but is not limited to, a process, a processor, an object, an executable file, a thread of execution, a program, and/or a computer running on a processor. Through the illustration, both the application running on the terminal device and the terminal device can be components. One or more components may reside in processes and/or threads of execution, and components may be located on one computer and/or distributed between two or more computers. In addition, these components can be executed from various computer readable media having various data structures stored thereon. A component may be based on a signal having one or more data packets (for example, data from two components that interact with another component in a local system, a distributed system, and/or a network, such as the Internet that interacts with other systems through a signal) Communicate through local and/or remote processes.

First, some terms in this application are explained to facilitate the understanding of those skilled in the art.

(1) Hue Saturation Lightness (Hue Saturation Lightness, HSL). The HSL color mode is a color standard in the industry. It uses the three color channels of hue (H), saturation (S), and brightness (L). Variations and their mutual superposition to obtain a variety of colors, HSL represents the color of the three channels of hue, saturation, and brightness. This standard includes almost all colors that human vision can perceive. One of the most widely used color systems. The H component of HSL represents the range of colors that the human eye can perceive. These colors are distributed on a flat hue circle, with a value range of 0° to 360° central angle, and each angle can represent a color. The significance of the hue value is that we can change the color by rotating the hue ring without changing the light perception. In practical applications, we need to remember the six main colors on the hue circle as a basic reference: 360°/0°red, 60°yellow, 120°green, 180°cyan, 240°blue, 300°magenta, They are arranged on the hue circle at intervals of 60° central angle. The S component of HSL refers to the saturation of the color. It uses a value from 0% to 100% to describe the change of color purity under the same hue and brightness. The larger the value, the less gray in the color and the brighter the color, showing a change from rational (grayscale) to perceptual (pure color). The L component of HSL refers to the brightness of the color, and its function is to control the brightness and darkness of the color. It also uses a value range of 0% to 100%. The smaller the value, the darker the color, and the closer to black; the larger the value, the brighter the color, and the closer to white.

(2) The Red, Green, and Blue (RGB) color mode is a color standard in the industry. It changes the three color channels of red (R), green (G), and blue (B) and their mutual A variety of colors can be obtained by superimposing between them. RGB represents the colors of the three channels of red, green and blue. This standard includes almost all the colors that human vision can perceive, and it is currently the most widely used color. One of the systems.

(3) Color difference, that is, the difference between two colors. Generally, under certain conditions, the human eye can easily distinguish whether there is a difference between two color samples. In practical applications, especially in engineering calculations, this difference needs to be quantified and expressed by mathematical formulas, that is, color difference formulas. The calculation of color difference is an important subject of color science, and it has a history of more than 80 years. It is not a simple matter to establish a color difference calculation formula. First, a model is needed to describe the color. Currently, the CIE1931-XYZ standard color system is the most widely used. CIE1931-XYZ is a chromaticity system recommended by the Commission Internationale de L'Eclairage (CIE) in 1931. Most color measurement and calculations use this system. However, the tristimulus values or chromaticity coordinates used in this system model have no direct correspondence with color perception and are not uniform. Please refer to Figure 1. Figure 1 is a schematic diagram of a MacAdam ellipse in the prior art. As shown in Figure 1, on the CIE1931xy chromaticity diagram, when the green area changes greatly, the human eye can distinguish two colors. The difference (the circle is large), but in the blue-purple area, a small change can cause a visual difference (the circle is small). As shown in Figure 1, the actual area with the same chromatic aberration perception is not a sphere, but an ellipsoid. Therefore, most of the subsequent improvements in the color difference formula were based on CIELAB, and made a fuss on this ellipsoid, such as the CMC (l:c) recommended by the Society's Color Measurement Committee (CMC). ) Color difference formula. Among them, the CMC(l:c) color difference formula is as follows:

ΔE _CMC =[{Δl ^* /lS _L } ² +{ΔC _ab ^* /(cS _C )} ² +(ΔH _ab ^* /S _H ) ² ] ^1/2

Among them, the textile industry generally sets the values of l and c as l=2, c=1, S _L , S _C , and S _H are the correction coefficients of brightness, chroma and hue angle respectively, and the specific values are as follows:

S _L ＝0.511 forL ^* ≤16

S _L ＝0.040975L ^* (1+0.01765L*) forL ^* ≤16

SL={0.0638C _ab ^* /(1+0.0131C _ab ^* )}+0.638

SL=(FT+1-F)S _C

F=[(C _ab ^* ) ⁴ /{(C _ab ^* ) ⁴ +1900}] ^1/2

T＝0.56+|0.2cos(h _ab +168°)| for164°＜h _ab ＜358°

T＝0.36+|0.4cos(h _ab +35°)| forh _ab ≤164°orh _ab ≤345°

After correction, the spheres in the CIELAB color space (the two-dimensional plane is a circle) have become a series of ellipsoids (the two-dimensional plane is an ellipse). Please refer to Figure 2. Figure 2 is the prior art A schematic diagram of a CMC (l:c) color difference ellipse. As shown in Figure 2, the closer to the center of the circle, the lower the saturation, and the closer to the circle, the higher the saturation and the brighter the color.

With the rapid development of various display devices, more and more display devices have a wider display color gamut, which can display more high-definition, colorful, and bright pictures. In the existing textile, printing and dyeing and design industries, display devices with high color reproduction are often selected or corresponding color management technical solutions are adopted to make the color display of devices of different color gamuts as consistent as possible to reduce or even eliminate The color difference between the color displayed by the device and the color of the final output object (for example, a product such as cloth). In the field of distributed display, when the interface on the source device is distributed and displayed to the peer device, often due to the difference in display devices between different devices, there are differences in screen brightness and color saturation between different devices. The difference, in this way, can easily lead to a display effect of a normal interface on the source device, and poor display effect when it is distributed to the peer device for display. For example, when the interfaces on mobile terminal devices such as mobile phones are distributed and displayed on large-screen devices such as LCD TVs, it is easy to cause the images displayed on large-screen devices such as LCD TVs to be overexposed and bright, while the user’s naked eyes are too bright, overexposed, or colors. Too gorgeous pictures are prone to fatigue, causing itchy eyes, swelling, tears, difficulty focusing, headaches, nausea, and other discomforts, which cannot satisfy the user's comfort when watching large-screen devices.

As described above, the distributed display solution in the prior art cannot satisfy the requirement of ensuring that the display effect on different devices is comfortable and not glaring when the distributed display is performed between different devices. Therefore, in order to solve the problem that the current distributed display technology does not meet the actual business needs, the technical problems to be solved in this application include the following aspects: Based on the existing terminal device, realize the distributed display of the interface displayed on the terminal device to other When on the device, ensure the display effect of other devices, improve the original display screen is easy to be overexposed, dazzling, and the color is too bright, and improve the user's comfort when watching the interface displayed on other devices.

Please refer to FIG. 3. FIG. 3 is a schematic diagram of a system architecture of a distributed display method provided by an embodiment of the present application. The technical solution of the embodiment of the present application may be implemented in the system architecture illustrated in FIG. 3 or a similar system architecture. As shown in FIG. 3, the system architecture may include a first device 100a and multiple second devices, and specifically may include second devices 200a, 200b, and 200c. Wherein, the first device 100a can establish a communication connection with the second devices 200a, 200b, and 200c through a wired or wireless network (such as Wireless-Fidelity (WiFi), Bluetooth, and mobile network, etc.), and connect the first The interface displayed on the device is distributed and displayed on the second devices 200a, 200b, and 200c.

Hereinafter, the first device 100a and the second device 200a will be taken as examples to describe in detail a distributed display method provided in an embodiment of the present application. As shown in FIG. 3, when the user needs to distribute the interface displayed on the first device 100a to the second device 200a for display, the user can first establish a connection with the second device 200a through WiFi or Bluetooth. Optionally, also The device information of the second device 200a can be obtained after the connection is established (for example, it can include the machine model and display screen information of the second device 200a, such as the screen size, screen brightness, color saturation, and color gamut of the second device 200a) Etc.). If the brightness and/or color saturation of the screen of the second device 200a is greater than that of the first device 100a (for example, the first device 100a may be a smart phone, and the second device 200a may be an LCD TV or the like with bright colors. Screen device), and then, the first device 100a can acquire the first information of the first interface displayed on the first device 100a, and the first information can include the respective first brightness values of the multiple pixels in the first interface And the first saturation value. If the first device 100a calculates that the first brightness values of more pixels in the plurality of pixels exceed the preset value, it can be considered that when the second device 200a performs distributed display based on the first information, it is likely to cause The interface displayed on the second device is overexposed and bright, which causes discomfort when viewed by the user. Then the first device 100a can calculate the second saturation value of each pixel whose first brightness value exceeds the preset value, the second saturation value is less than the first saturation value, and generate second information, the second The information may include respective second saturation values and first brightness values of pixels whose first brightness value exceeds the preset value, and respective first saturation values and first brightness values of pixels whose first brightness value is less than or equal to the preset value value. Finally, the second device 200a can perform distributed display based on the second information, and display a second interface (it is understandable that in general, the content of the second interface is the same as that of the first interface). During display, the first saturation value of the pixel with the larger first brightness value is reduced, so that the color of the display interface of the second device is suitable, and the screen will not be overexposed and bright, which optimizes the distributed display effect and ensures the user's viewing experience . It should be noted that the first interface may be the content displayed on the entire screen of the first device 100a, or part of the content displayed on the screen, such as pictures, text, and videos. The distribution display between the two devices 200a may be real-time, which is not specifically limited in the embodiment of the present application. Optionally, the first device 100a may also distribute and display the displayed interfaces on the second devices 200a, 200b, and 200c at the same time, etc., which is not specifically limited in the embodiment of the present application.

In summary, the first device 100a may be a terminal device such as a smart phone, a smart wearable device, a tablet computer, a notebook computer, and a desktop computer with the above-mentioned functions. The second devices 200a, 200b, and 200c can be notebook computers, desktop computers, large-screen displays, LCD TVs, and other devices with the above-mentioned functions. Optionally, the second devices 200a, 200b, and 200c can also be devices with the above-mentioned functions. Smart phones, tablet computers, etc., which are not specifically limited in the embodiments of the present application.

Please refer to FIG. 4, which is a functional block diagram of a terminal device provided by an embodiment of the present application. Optionally, the terminal device 100 may be the first device 100a in the system architecture described in FIG. 3 above. Optionally, in one embodiment, the terminal device 100 may be configured to fully or partially automatically distribute the display mode. For example, the terminal device 100 may be in a timer and continuous automatic distribution display mode, or according to computer instructions when connected to a preset target device, perform automatic distribution display mode, or detect that the interface contains a preset target object (such as preset Video, documents, slides, etc.) are automatically distributed in the display mode, etc., which are not specifically limited in the embodiment of the present application. When the terminal device 100 is in the automatic distributed display mode, the terminal device 100 can be set to operate without interacting with people.

Hereinafter, the embodiment will be described in detail by taking the terminal device 100 as an example. It should be understood that the terminal device 100 may have more or fewer components than shown in the figure, may combine two or more components, or may have different component configurations. The various components shown in the figure may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and/or application specific integrated circuits.

The terminal device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2. Mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, buttons 190, motor 191, indicator 192, camera 193, display 194, And subscriber identification module (subscriber identification module, SIM) card interface 195 and so on. The sensor module 180 can include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light Sensor 180L, bone conduction sensor 180M, etc.

It can be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may include more or fewer components than those shown in FIG. 4, or combine certain components, or split certain components, or arrange different components, and so on. The components shown in FIG. 4 may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Among them, the different processing units may be independent devices or integrated in one or more processors.

The controller may be the nerve center and command center of the terminal device 100. The controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching and executing instructions.

A memory may also be provided in the processor 110 to store instructions and data. In some embodiments, the memory in the processor 110 may be a cache memory. The memory can store instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. The repeated access of instructions or data is avoided, and the waiting time of the processor 110 is reduced, thereby greatly improving the operating efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. The interface can include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, and a universal asynchronous transmitter (universal asynchronous transmitter) interface. receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and / Or Universal Serial Bus (USB) interface, etc.

It can be understood that the interface connection relationship between the modules illustrated in the embodiment of the present application is merely a schematic description, and does not constitute a structural limitation of the terminal device 100. In some other embodiments of the present application, the terminal device 100 may also adopt a different interface connection manner from the foregoing embodiments, or a combination of multiple interface connection manners.

The charging management module 140 is used to receive charging input from the charger. Among them, the charger can be a wireless charger or a wired charger.

The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.

The wireless communication function of the terminal device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor. In some embodiments, the terminal device 100 may establish a connection with one or more other devices in a wireless manner, so as to distribute and display the interface displayed on the terminal device 100 to the other one or more devices connected to it.

The terminal device 100 implements a display function through a GPU, a display screen 194, and an application processor. The GPU is an image processing microprocessor, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and is used for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information. In some embodiments, the terminal device 100 may preprocess the display information of the interface before distributing and displaying the displayed interface on other devices (for example, to change the saturation value of multiple pixels in the interface, and also That is to change the color values of multiple pixels in the interface, etc.). For example, if there is a brighter area in the interface, it is easy to cause other devices to overexpose and brighten the screen during distributed display, which can be reduced The saturation of the area with greater brightness in the interface generates new display information, and then other devices are used to perform distributed display according to the new display information, thereby greatly improving the distributed display effect and ensuring the user's viewing experience.

The display screen 194 is used to display images, videos, and the like. The display screen 194 includes a display panel. The display panel can adopt liquid crystal display (LCD), organic light-emitting diode (OLED), active matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light-emitting diode). AMOLED, flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (QLED), etc. In some embodiments, the terminal device 100 may include one or more display screens 194. In the embodiment of the present application, the terminal device 100 may distribute and display the interface displayed on the display screen 194 on other devices, for example, on an LCD TV, a desktop computer, or other large-screen devices.

The terminal device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

The ISP is used to process the data fed back from the camera 193. For example, when taking a picture, the shutter is opened, the light is transmitted to the photosensitive element of the camera through the lens, the light signal is converted into an electrical signal, and the photosensitive element of the camera transfers the electrical signal to the ISP for processing and is converted into an image visible to the naked eye. ISP can also optimize the image noise, brightness, contrast, and facial skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be provided in the camera 193.

The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and is projected to the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transfers the electrical signal to the ISP to convert it into a digital image signal. ISP outputs digital image signals to DSP for processing. The DSP converts the digital image signal into a standard RGB or YUV format image signal.

The camera 193 may be located on the front of the terminal device 100, for example, above the touch screen, or may be located at other locations, such as on the back of the terminal device. For example, the RGB camera and infrared camera used for face recognition can generally be located on the front of the terminal device 100, such as on the top of the touch screen, or at other locations, such as the back of the terminal device 100. This embodiment of the present application does not Make specific restrictions. Among them, the infrared lamp used for infrared photography is generally also located on the front of the terminal device 100, for example, located above the touch screen. It can be understood that the infrared lamp and the infrared camera are generally located on the same side of the terminal device 100 to perform infrared image viewing. collection. In some embodiments, the terminal device 100 may also include other cameras. In some embodiments, the terminal device 100 may further include a dot matrix transmitter (not shown in FIG. 4) for emitting light.

Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the terminal device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.

Video codecs are used to compress or decompress digital video. The terminal device 100 may support one or more video codecs. In this way, the terminal device 100 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, and so on.

NPU is a neural-network (NN) computing processor. By drawing on the structure of biological neural networks, for example, the transfer mode between human brain neurons, it can quickly process input information, and it can also continuously self-learn. Through the NPU, applications such as intelligent cognition of the terminal device 100 can be implemented, such as distributed display, image recognition, face recognition, voice recognition, text understanding, histogram equalization, and so on.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example, save music, videos, photos and other files in an external memory card.

The internal memory 121 may be used to store computer executable program code, where the executable program code includes instructions. The processor 110 executes various functional applications and data processing of the terminal device 100 by running instructions stored in the internal memory 121. The internal memory 121 may include a storage program area and a storage data area. Among them, the storage program area can store an operating system and at least one application required for a function, such as a distributed display, a video recording function, a photographing function, an image processing function, and so on. The data storage area can store data created during the use of the terminal device 100 and the like. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like.

The terminal device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. For example, music playback, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal.

The speaker 170A, also called "speaker", is used to convert audio electrical signals into sound signals.

The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals.

The microphone 170C, also called "microphone", "microphone", is used to convert sound signals into electrical signals.

The earphone interface 170D is used to connect wired earphones. The earphone interface 170D may be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be provided on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors and so on.

The gyro sensor 180B may be used to determine the movement posture of the terminal device 100. In some embodiments, the angular velocity of the terminal device 100 around three axes (ie, x, y, and z axes) can be determined by the gyroscope sensor 180B.

The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector such as a photodiode. The light emitting diode may be an infrared light emitting diode.

The ambient light sensor 180L is used to sense the brightness of the ambient light. The terminal device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived brightness of the ambient light. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures, etc., which will not be repeated here.

The fingerprint sensor 180H is used to collect fingerprints. The terminal device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photographs, fingerprint answering calls, and so on. Wherein, the fingerprint sensor 180H can be arranged under the touch screen, the terminal device 100 can receive a user's touch operation on the touch screen in the area corresponding to the fingerprint sensor, and the terminal device 100 can collect the fingerprint of the user's finger in response to the touch operation. Information to realize related functions.

The temperature sensor 180J is used to detect temperature. In some embodiments, the terminal device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy.

Touch sensor 180K, also called "touch panel". The touch sensor 180K may be provided on the display screen 194, and the touch screen is composed of the touch sensor 180K and the display screen 194, which is also called a “touch screen”. The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. The visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K may also be disposed on the surface of the terminal device 100, which is different from the position of the display screen 194.

The button 190 includes a power-on button, a volume button, and so on. The button 190 may be a mechanical button. It can also be a touch button. The terminal device 100 may receive key input, and generate key signal input related to user settings and function control of the terminal device 100.

The indicator 192 can be an indicator light, which can be used to indicate the charging status, power change, and can also be used to indicate messages, missed calls, notifications, etc., for example, it can indicate that the terminal device 100 is performing a distributed display, prompting the user that the terminal is currently displaying The interface displayed on the device 100 can be viewed on other devices. In some embodiments, the terminal device 100 may include one or more indicators 192.

The SIM card interface 195 is used to connect to the SIM card. The SIM card can be inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 to achieve contact and separation with the terminal device 100. In some embodiments, the terminal device 100 adopts an eSIM, that is, an embedded SIM card. The eSIM card can be embedded in the terminal device 100 and cannot be separated from the terminal device 100.

The terminal device 100 may be a smart phone, a smart wearable device, a tablet computer, a notebook computer, a desktop computer, a computer, etc., with the above-mentioned functions, which is not specifically limited in the embodiment of the present application.

The software system of the terminal device 100 may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. The embodiment of the present application takes an Android system with a layered architecture as an example to illustrate the software structure of the terminal device 100 by way of example.

Please refer to FIG. 5, which is a software structure block diagram of a terminal device provided by an embodiment of the present application. The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Communication between layers through software interface. In some embodiments, the Android system is divided into four layers, from top to bottom, the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

The application layer can include a series of application packages.

As shown in Figure 5, the application package may include applications (also referred to as applications) such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc. It may also include the related distributed display application involved in this application. Through the distributed display application, a distributed display method in this application can be used to improve the terminal device 100 in distributing its displayed interface to other devices (such as LCD TVs). When displaying on the screen device), the display screen on other devices is too bright and overexposed, so as to ensure the user's comfort when watching the interface displayed on different devices.

The application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

As shown in Figure 5, the application framework layer can include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and so on.

The window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, and display the interface distribution.

The content provider is used to store and retrieve data and make these data accessible to applications. The data may include video, image, audio, phone calls made and received, browsing history and bookmarks, phone book, etc. In the embodiment of the present application, the data may also include related information of the display interface on the terminal device 100, such as the color value (or brightness value, saturation value, and hue value) of multiple pixels in the image area in the interface. , And the color values (or brightness value, saturation value, and hue value) of multiple texts in the text area of the interface, etc. These data can be used by the related application programs for distributed display related to the embodiments of this application access.

The view system includes visual controls, such as controls that display text, controls that display pictures, and so on. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface that includes a short message notification icon may include a view that displays text and a view that displays pictures. For example, in some embodiments, a distributed display interface of related distributed display controls may be included. By clicking on the distributed display control, one of the distributed display methods in this application can be used, according to the information ( For example, it can include the respective brightness values and saturation values of multiple pixels in the interface, etc.) for related calculations and judgments. If there are areas with large brightness in the interface that easily affect the display effects of other devices, you can The information is preprocessed, for example, the saturation value of the area where the brightness is larger is reduced, and new information of the interface is generated. Then, other devices connected to the terminal device 100 can perform distributed display based on the new information. When other devices are distributing the interface on the display terminal device 100, the display screen is too bright and overexposed, etc., so as to ensure the user's viewing comfort.

The phone manager is used to provide the communication function of the terminal device 100. For example, the management of the call status (for example, including connecting, hanging up, etc.).

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.

The notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and it can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, and so on. The notification manager can also be a notification that appears in the status bar at the top of the system in the form of a chart or a scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialogue interface. For example, prompt text messages in the status bar, sound a prompt tone, terminal equipment vibration, flashing indicator lights, etc. For another example, when performing the distributed display involved in the present application, the user may be prompted through text messages on the distributed display interface to prompt the user that the current terminal device is currently being distributed and displayed, as well as the number, name, and model of other devices that are being distributed. For example, when the distributed display cannot be performed correctly, such as when the connection between the terminal device and other devices is disconnected (for example, the network condition is poor, or the Bluetooth connection is disconnected, etc.), you can use text messages on the distributed display interface The user is prompted to check the network connection or the Bluetooth connection status to re-establish the connection, etc., which is not specifically limited in the embodiment of the present application.

Android Runtime includes core libraries and virtual machines. Android runtime is responsible for the scheduling and management of the Android system.

The core library consists of two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.

The application layer and the application framework layer run in a virtual machine. The virtual machine executes the java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

The system library can include multiple functional modules. For example: surface manager (surface manager), media library (Media Libraries), three-dimensional graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc.

The surface manager is used to manage the display subsystem and provides a combination of 2D and 3D layers for multiple applications.

The media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The video format involved in this application can be, for example, RM, RMVB, MOV, MTV, AVI, AMV, DMV, FLV, etc.

The 3D graphics processing library is used to realize 3D graphics drawing, image rendering, synthesis, and layer processing.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is the layer between hardware and software. The core layer includes at least display driver, camera driver (for example, infrared camera driver and RGB camera driver), audio driver, and sensor driver.

In order to facilitate the understanding of the embodiments of the present application, the following exemplarily enumerates the applicable application scenarios of a distributed display method in the present application, which may include the following scenarios.

Scenario 1: Distribute the interface displayed on the mobile phone to a large-screen device for display.

Please refer to FIG. 6a, which is a schematic diagram of an application scenario of a distributed display method provided by an embodiment of the present application. As shown in Fig. 6a, the application scenario includes a first device (a smart phone is taken as an example in Fig. 6a) and a second device (a liquid crystal TV is taken as an example in Fig. 6a). And both the first device and the second device may include related displays and processors. Among them, the display and the processor can transmit data through the system bus. Wherein, the display of the first device can display the interface of the first device to be distributed and displayed on the second device, or display the interface that is being distributed and displayed in the first device, etc., the display of the second device can display The interface when the first device is distributed to the second device, etc. The interface may include images, text, and video, and so on. Optionally, the screen brightness and/or color saturation of the second device may be greater than that of the first device, that is, a normal interface is displayed on the first device, and if it is directly distributed and displayed on the second device without processing, The pictures distributed and displayed on the second device are often overexposed and bright, the colors are too bright, and are dazzling, which makes the user's eyes tired and uncomfortable when viewing the interface distributed and displayed on the second device for a long time. As shown in Figure 6a, in the embodiment of the present application, after the user triggers the distributed display through the first device, the first device may display first information according to the first interface currently displayed on the first device (for example, it may include the first information). The first brightness value and the first saturation value of the multiple pixels in the interface), the first information is preprocessed, for example, if there are more pixels in the first interface, the first brightness value exceeds the preset value , You can reduce the saturation value of the pixel whose first brightness value exceeds the preset value, calculate the second saturation value, and generate corresponding second information (for example, it may include that the first brightness value is less than or equal to the preset value The first brightness value and first saturation value of the pixel, and the first brightness value and second saturation value of the pixel whose first brightness value exceeds the preset value, etc.), and then through the second device, according to the The second information displays the second interface, thereby completing the distributed display from the first device to the second device. Please refer to FIG. 6b, which is a schematic diagram of an application scenario of another distributed display method provided by an embodiment of the present application. As shown in Figure 6b, the first interface (ie, the source interface) displayed on the first device (the smart phone is taken as an example in Figure 6b) is displayed on the second device (the LCD TV is taken as an example in Figure 6b) The content of the second interface (that is, the distributed display interface, or the peer interface) is the same, and after the distributed display, the display effect of the second interface displayed on the second device is ensured, and there is no screen overexposure Bright, the color is too gorgeous, greatly improving the user’s viewing experience.

In the embodiment of the present application, when the user wants to perform distributed display, the user's operation process on the first device can refer to Figures 7a and 7b. Figures 7a-7b are schematic diagrams of a set of interfaces provided by the embodiments of the present application. As shown in FIG. 7a, the first device displays a Bluetooth connection interface 701, where the Bluetooth connection interface 701 may include a setting control 702, a Bluetooth on/off control 703, and other controls (such as a return control, etc.). As shown in Figure 7a, the device name of the first device can be the first device A10. As shown in Figure 7a, after the user turns on the Bluetooth of the first device, the first device can detect nearby available devices (that is, you can Devices that have established a Bluetooth connection with the first device) and displayed, for example, include the second device B10, the second device B11, the second device B12, and the second device B13 shown in FIG. 7a. As shown in FIG. 7a, the Bluetooth connection interface 701 may also include a second device B10 connection control 704a, a second device B11 connection control 704b, a second device B12 connection control 704c, and a second device B13 connection control 704d. For example, as shown in Figure 7a, when the user wants to display the interface on the first device through the second device B13, he can establish the first device and the second device through an input operation 705 (for example, clicking the second device B13 connection control 704d). The connection between the two devices B13 to trigger the distributed display operation. At this time, as shown in FIG. 7b, after the user clicks the second device B13 connection control 704d, the first device can display a distributed display interface 706, where the distributed display interface 706 can display the currently distributed display connected devices, for example, "Currently connected device: second device B13" shown in Figure 7b. Wherein, the distributed display interface 706 may include a normal mode control 707a, an optimized mode control 707b, a start distribution display control 709, and so on. The user can select the optimization mode through the input operation 708 (for example, click), so that a distributed display method in this application can be used in the distributed display process to optimize the interface on the first device to be distributed to the second device B13 for display The display effect. After the user clicks the optimization mode control 707b, as shown in FIG. 7b, the user can click the start distribution display control 709 to start distributed display. First, the first device obtains the first information of the first interface currently displayed (for example, it may include the first brightness value and the first saturation value of each of the multiple pixels in the first interface); Preprocessing, for example, if there are more pixels in the first interface whose first brightness value exceeds a preset value, the saturation value of the pixel whose first brightness value exceeds the preset value can be reduced, and the second saturation value can be calculated And generate corresponding second information (for example, it may include the first brightness value and first saturation value of pixels whose first brightness value is less than or equal to the preset value, and the pixels whose first brightness value exceeds the preset value The first brightness value and the second saturation value, etc.); then, the second interface is displayed according to the second information through the second device (for example, the second device B13) connected to it, so far, the first device to The distribution of the second device is displayed. And it makes the interface displayed on the second device have better color comfort, and is not too bright and dazzling, which meets the actual needs of users. Optionally, the user can also select the normal mode by clicking the normal mode control 707a. Therefore, according to the actual needs of the user, during the distributed display process, one of the distributed display methods in this application is not used, but directly The first interface displayed on the first device is distributed and displayed on the second device. In this way, the calculation amount of the first device can be reduced, the delay of distributed display can be reduced, the fluency of distributed display can be improved, and so on. There is no specific limitation.

Optionally, in this embodiment of the application, when a developer wants to perform a distributed display to test a distributed display method in this application, the developer can also refer to FIG. 7a and FIG. 7b for the operation process of the first device. I will not repeat them here. The developer can continuously optimize the calculation method of the second saturation value in this application according to the obtained distribution display result, etc., so as to continuously improve the distribution display effect and effectively enhance the user's viewing experience.

As described above, the first device may be a smart phone, a smart wearable device, a tablet computer, a laptop computer, a desktop computer, and other devices with the above-mentioned functions, which are not specifically limited in the embodiment of the present application. The second device may be a tablet computer, a laptop computer, a desktop computer, an LCD TV, a large-screen display, etc., with the above-mentioned functions, which is not specifically limited in the embodiment of the present application.

It is understandable that the distributed display method provided in this application can also be applied to other scenarios besides the above-mentioned application scenarios, for example, when the user wants to share an image or a slide show in the first device to connect with it. When viewing through the second device on the second device, you can use the first device to preprocess the image or slideshow to reduce the saturation of the excessively bright area, and then combine the processed image with The slideshow is shared to the second device, etc., which is not specifically limited in the embodiment of the present application. As a result, the display effect of the second device when displaying the image or playing the slideshow can be improved, which will not be repeated here.

Please refer to FIG. 8. FIG. 8 is a schematic flowchart of a distributed display method provided by an embodiment of the present application. The method can be applied to the system architecture described in FIG. 3 and the application scenario described in FIG. 6a or FIG. 6b. And it can be specifically applied to the terminal device 100 of FIG. 4 described above. In the following, description will be made with reference to FIG. 8 taking the execution subject as the terminal device 100 in FIG. 4 as an example. The method may include the following steps S801-S804:

Step S801: Acquire first information of the first interface, where the first information includes the first brightness value and the first saturation value of each of the P pixels in the first interface.

Specifically, the first device (that is, the source device, for example, the terminal device 100 in FIG. 4) obtains the first information of the first interface, and the first information may include the respective information of the P pixels in the first interface. The first brightness value and the first saturation value, optionally, the first information may also include the first hue value of each of the P pixels in the first interface, and so on. Where P is an integer greater than or equal to 1, and the first interface is an interface displayed on the first device. Optionally, the first interface may include text, images, and other interface elements, for example, the first interface may include one or more image areas, and may also include one or more text areas, then the first information is also It may include the respective first brightness value and first saturation value of multiple texts in one or more text areas in the first interface, etc., which are not specifically limited in the embodiment of the present application.

Optionally, the first device may first obtain the first color value of each of the P pixels in the first interface, and then according to the first color value of each of the P pixels, through color space conversion (for example, from the RGB color space Transform to HSL color space), calculate the first brightness value and the first saturation value of each of the P pixels, and so on. Optionally, the first device may extract the pixel array of each image area in one or more image areas in the first interface, and calculate the first color value of each pixel in the pixel array of each image area , So that the first color value of each of the P pixels in the first interface can be obtained. Optionally, the first device may also obtain the first color value of each text in each text area of the one or more text areas in the first interface; and then according to each text area in each text area. The first color value of a text is converted by color space (for example, from RGB color space to HSL color space), and the first brightness value and first saturation value of each text in each text area are calculated, etc. Wait.

Optionally, please refer to FIG. 9, which is a schematic flowchart of another distribution display method provided by an embodiment of the present application. As shown in step S11 in FIG. 9, before the distributed display starts, the first device may interact with the opposite device (that is, the second device, for example, the second devices 200a, 200b, and 200b) in the system architecture described in FIG. Any one of 200c) establishes a connection via WiFi, Bluetooth, etc., and then obtains the device information of the peer device (for example, it may include the model of the peer device, screen size, screen brightness and color saturation, etc.). As shown in step S12 in Figure 9, after the first device obtains the device information of the opposite device, the first device can determine whether the opposite device meets the first color replacement condition according to the device information. Optionally, The first color replacement condition may be that the brightness and/or color saturation of the screen of the opposite device is greater than that of the first device, that is, the opposite device is a device with a brighter and more vivid color display. The first color replacement condition may also include that the screen size of the peer device is much larger than the first device, or larger than a certain size threshold, etc., which is not specifically limited in the embodiment of the present application. As shown in Figure 9, if the peer device meets the first color replacement condition, the subsequent step S13 can be performed to extract the color data of the first interface (for example, it can include the first color of each pixel in the first interface). Value, and the first color value of each text, etc.) to obtain the first information of the first interface; if the opposite device does not meet the first color replacement condition, the first device can directly perform interface distribution , Without the need for subsequent steps. Thereby, the effect of distributed display is more reasonable, the color is comfortable, and it is not glare, ensuring the consistency of user viewing experience when displaying on different devices such as the first device and the second device, and it does not increase the extra calculation amount of the first device.

As described above, the first device may first obtain the color data of the first interface, and then use the color space transformation to obtain the first information of the first interface. Wherein, the color data of the first interface may include, for example, the first color value (that is, the original color value) of various elements in the first interface, such as the value of each pixel in each image area in the first interface. The first color value, and the first color value of each text in each text area, etc., will not be repeated here. Obviously, the above-mentioned first color value is a color expression method in the RGB color space, and the above-mentioned first brightness value and the first saturation value are color expression methods in the HSL color space, which will not be repeated here.

Optionally, the method for the first device to obtain the color data of the first interface to be distributed and displayed may include, but is not limited to, the following solutions:

a. Obtain the first color value of the interface element through the method provided by the Android system, as shown in Figure 9, which may include:

(1) For the text information in the interface, the text color can be extracted through getTextColor() provided by the androidtextView class to obtain the first color value of each text;

(2) For the picture information in the interface, you can use the getPixels() method provided by the android bitmap class, such as getPixels(int[]pixels,int offset,int stride,int x,int y,int width, as shown in Figure 9 int height) method, extract the pixel array of the picture (where the pixel array is a two-dimensional matrix), and then calculate the first color value of each pixel in the pixel array to extract the first color value of each pixel in the picture And store it in the pixel array;

(3) For other interface elements, the resource file of the control can be obtained through the getDrawable() method provided by the android view class (the resource file generally refers to the Drawable resource of the view. Drawable is used for the background of the android control and can include pictures (png, etc.), Pure color background and other visual resources), the resource file is converted into a picture, and then read and calculated through the getPixels() method provided by the android bitmap class.

b. Obtain the layer of the application through the surfaceflinger in the android system, and obtain the drawing data of the application from the layer of the application.

c. By taking a screenshot of the application, the bitmap of the screenshot is processed and analyzed.

Step S802: Determine N first pixels and M second pixels in the first interface.

Specifically, the first device determines the N first pixels and M second pixels in the first interface according to the first information of the first interface. Wherein, the first brightness value of each first pixel in the N first pixels is greater than a first threshold; the first brightness value of each second pixel in the M second pixels is less than or equal to the first threshold ; Among them, N and M are integers greater than or equal to 1. In general, the sum of N and M is P. Optionally, the first device may also determine one or more characters in the first interface whose first brightness value is greater than the first threshold, and determine that the first brightness value in the first interface is less than or equal to the first threshold One or more of the text, and so on.

Step S803: If the ratio of the sum of the first brightness values of the N first pixels to the sum of the first brightness values of the P pixels is greater than or equal to the second threshold, the second saturation values of the N first pixels are determined.

Specifically, the first device may respectively calculate the sum of the first brightness values of the N first pixels and the sum of the first brightness values of the P pixels, and calculate the first brightness values of the N first pixels. The ratio of the sum of and the sum of the first brightness values of the P pixels. Then the ratio is compared with the second threshold, and if the ratio is greater than or equal to the second threshold, the first device can determine the second saturation value of the N first pixels. Among them, the second saturation value is less than the first saturation value, which can reduce the saturation of pixels with larger brightness, so that when the second device performs distributed display, the picture color is comfortable, and the user will not be overexposed and over bright. Viewing experience.

Optionally, the first brightness value of the j-th pixel in _{the P pixels can be denoted as L j} , and the first saturation value of the j-th pixel in the P pixels can be denoted as S _j ; where j It is an integer greater than or equal to 1 and less than or equal to P. The first brightness value of the i-th first pixel in the N first pixels can be denoted as _Li ', _Li ' is greater than the first threshold, and the i-th first pixel in the N first pixels The first saturation value can be denoted as S _i '; where i is an integer greater than or equal to 1 and less than or equal to N.

According to Weber Fechner's law, when the amount of difference is greater than a certain threshold than the stimulus amount, the difference can be felt psychologically, which is called the minimum noticeable difference, which satisfies the following formula (1):

Among them, I is the basic stimulus amount, and ΔI is the difference amount. In the embodiment of the present application, I can be the sum of the first brightness values of the P pixels, and ΔI can be the sum of the first brightness values of the N first pixels. And, Q can be the second threshold. According to the above formula (1), the ratio of the sum of the first brightness values of the N first pixels to the sum of the first brightness values of the P pixels can be calculated, and it is determined whether the ratio is greater than or equal to the second threshold. It is understandable that when the overall brightness of the first interface is very low, users can also notice the overexposure in a small area; when the overall brightness of the first interface is high, a large area or strong local overexposure is required. Let users notice.

Optionally, the first device may calculate the sum of the first brightness values of the P pixels by using the following formula (2),

I=∑L _j (2)

Wherein, as described above, L _j is the first brightness value of the j-th pixel in the P pixels, and the first brightness values of the P pixels can be added and summed by formula (2). For example, if P is 10, that is, the first interface includes 10 pixels. At this time, the value of j ranges from 1 to 10. For example, the first brightness values of the 10 pixels are L ₁ =20 and L ₂ =30, respectively. , L ₃ ＝70, L ₄ ＝15, L ₅ ＝130, L ₆ ＝80, L ₇ ＝45, L ₈ ＝55, L ₉ ＝33, L ₁₀ ＝27, then the 10 pixels can be calculated The sum of the first brightness values is I=(L ₁ +L ₂ +L ₃ +L ₄ +L ₅ +L ₆ +L ₇ +L ₈ +L ₉ +L ₁₀ )=505.

Optionally, the first device may calculate the sum of the first brightness values of the N first pixels by using the following formula (2),

ΔI=∑Trunc(L _i ') (3)

Wherein, as described above, L _i ′ is the first brightness value of the i-th first pixel in the N first pixels, that is, the first brightness value of the over-bright or over-exposed pixel in the P pixels. The first brightness values of the N first pixels can be summed up by formula (3). In addition, Trunc() in formula (3) is a cut-off function. In general, when the brightness value of a pixel exceeds a certain threshold, it is considered that the stimulus to the human eye is no longer increased. Therefore, the cut-off function The effect may be to keep the first brightness value exceeding a certain threshold at the threshold. Let the above P be 10, and the first brightness values of the 10 pixels are respectively L ₁ =20, L ₂ =30, L ₃ =70, L ₄ =15, L ₅ =130, L ₆ =80, L ₇ ＝45, L ₈ ＝55, L ₉ ＝33, L ₁₀ ＝27 as an example. If the first threshold is 50, then the first interface includes 4 first interfaces whose first brightness value exceeds 50. Pixel (that is, N is 4). At this time, the value of i ranges from 1 to 4. The first brightness values of the four first pixels are respectively L ₁ '=70, L ₂ '=130, L ₃ '= 80. L ₄ '=55. For example, the threshold of the truncation function is 75, then ΔI=Trunc(L ₁ ')+Trunc(L ₁ ')+Trunc(L ₁ ')+Trunc(L ₁ ')=70+75+75+55=275 .

Optionally, step S803 may refer to step S14 shown in FIG. 9 to determine whether the color data of the first interface meets the second color replacement condition, for example, calculate the color data according to the above formulas (1), (2) and (3). The ratio of the sum of the first brightness values of the N first pixels to the sum of the first brightness values of the P pixels. If the ratio is greater than or equal to the second threshold, it can be determined that the color data of the first interface meets the second color The replacement condition is to perform step S15 of subsequent color replacement, that is, to calculate the second saturation value of each of the N first pixels. If the ratio is less than the second threshold, it can be determined that the color data of the first interface does not meet the second color replacement condition. As shown in FIG. 9, the first device can directly perform interface distribution without performing subsequent steps.

Optionally, for the N first pixels, the first saturation value may be replaced with the value of the sub-level radial saturation in the CMC color ellipse. For example, the first device may determine that the first saturation value of the i-th first pixel among the N first pixels is located in the k-th interval of the CMC color ellipse, where the CMC color ellipse may include radially divided z intervals. Among them, z is an integer greater than or equal to 1, and k is an integer greater than or equal to 1, and less than or equal to z. Then, the random value in the k-1th interval is determined as the second saturation value of the i-th first pixel, so that the second saturation value of each of the N first pixels can be determined. The k-1th interval is an interval next to the kth interval in the CMC color ellipse, the k-1th interval is adjacent to the kth interval, and in general, the kth interval The maximum value in an interval is smaller than the minimum value in the k-th interval.

Optionally, the first device may calculate the interval in which the first saturation value of the i-th first pixel among the N pixels is located by the following formula (4),

Among them, S _i _{”is the saturation value obtained after normalizing the first saturation value S i} 'of the i-th first pixel to [0,1], and ε is the smallest quantized value that can be expressed in the computer (For example, 0.01, 0.02, or 0.1, etc.), z means that the CMC color ellipse is radially divided into z intervals, and k means that the first saturation value of the i-th pixel is located in the kth of the n intervals Intervals. Among them,

For right

Is rounded down. For example, if the saturation in the range of 0 to 255, S _i 'of 153, then S _i' normalized to [0, 1] is obtained S _i "is 0.6, while, if ε is 0.01, z is 10, at this time the calculation is

Then it is 8 after rounding down, and k=8-1=7 is calculated, that is, the first saturation value of the i-th first pixel is calculated to be located in the seventh interval of the n intervals. According to the above formula (4), if calculated

That is, k>0, a random value is selected in the k-1th interval as the second saturation value of the i-th first pixel. It is understandable that under normal circumstances, there will be no overexposure when the saturation value is extremely small or even 0. Therefore, if k is equal to 0 by calculation, the second saturation value can no longer be calculated, and the first device can Direct interface distribution.

Optionally, if k is greater than 0 by calculation, the first device may calculate the value range of the k-1th interval by the following formula (5), and select a random value in the interval, thereby calculating the N pixels The second saturation value of the i-th first pixel in

Among them, S _i ^* is the second saturation value of the i-th first pixel calculated according to the normalized first saturation value of the i-th first pixel (that is, S _i ^* is normalized to The second saturation value of [0,1]), rand() is a random number generation function, through which a random number can be generated within a certain range, S _i ^{* is}

A random number in the range. For example, if z=10, and k=7 calculated by formula (4) as described above, then

That is to say, the value range of the sixth interval can be

Then the S _i ^* can be

The random value within, such as 0.4, 0.42, 0.48, 0.5 and so on. For example, when S _i ^* is 0.4 (that is, the second saturation value of the i-th first pixel is normalized to [0,1], the second saturation value is 0.4), and the saturation value range is the above-mentioned 0 to 255 When, the second saturation value of the i-th first pixel can be calculated to be 102. Obviously, the second saturation value 102 is smaller than the first saturation value 153. And, as described above, if k=7 is calculated, that is, the first saturation value of the i-th first pixel is calculated to be located in the seventh interval of the n intervals, then based on the above formula (5), It can be calculated that the value range of the seventh interval can be

Obviously, the maximum value in the 6th interval is smaller than the minimum value in the 7th interval, that is, the maximum value in the k-1th interval is smaller than the minimum value in the kth interval, so that it can be achieved The purpose of reducing the saturation value of the pixels with larger brightness to optimize the display effect will not be repeated here.

Step S804, generating second information, the second information including the first brightness value and the second saturation value of the N first pixels, and the first brightness value and the first saturation value of the M second pixels.

Specifically, the first device may generate second information after calculating the second saturation value of each of the N first pixels, and the second information may include the first brightness value and the second saturation value of the N first pixels Value, and the first brightness value and first saturation value of the M second pixels. Optionally, the second information can be used by the second device to display the second interface according to the second information, so as to complete the interface distribution display from the first device to the second device, and make the second device be based on the first device. When the second interface is displayed on the first interface, the color of the screen is reasonable and comfortable, and it will not be overexposed and bright. It is understandable that the first brightness value of the M second pixels is less than or equal to the first threshold value, and generally will not cause the picture to be over-bright and over-exposed when being distributed and displayed on the second device, so there is no need to change the first brightness value. Saturation value.

Optionally, the computing device may also calculate the second color values of the N first pixels and the M second color values through color space conversion (for example, conversion from HSL color space to RGB color space) according to the second information. The first color value of the pixel, and the third information is generated. Specifically, the computing device may calculate the second color value of the N first pixels according to the first brightness value and the second saturation value of the N first pixels, and may also obtain the second color value of the M second pixels according to the first brightness value and the second saturation value of the N first pixels. A brightness value and a first saturation value are calculated to obtain the first color values of the M first pixels. The third information may include the second color values of the N first pixels and the first color values of the M second pixels. The computing device may specifically display the second interface according to the third information.

Optionally, referring to step S16 in FIG. 9, the first device updates the interface color, and the method of generating the corresponding third information may include but is not limited to the following:

a. Perform color replacement through the method provided by the android system, as shown in Figure 9, which can include:

(1) For the text information in the interface, use the setTextColor(int color) method provided by the android textView class to set the second color value of the text;

(2) For the picture information in the interface, first traverse the pixel array obtained by the getPixels method, and use the calculated second color value to replace the first color value of the overexposed pixels (ie N first pixels), use The setPixels() method provided by the android bitmap class updates the modified pixel array back to the picture;

(3) For other interface elements in the interface, first process the picture generated by the view.getDrawable() method. After the picture processing method is completed, regenerate the drawable and update it through the view.setDrawable(Drawable drawable) method.

b. Complete the interface update by modifying the layer information applied in the surfaceflinger.

Please refer to FIG. 10, which is a schematic diagram of a set of distribution display effects comparison provided by an embodiment of the present application. As shown in Figure 10, in Figure 10, the source interface on the mobile phone is displayed on the LCD TV as an example. For large-screen devices such as LCD TVs, the normal display interface on the source device such as the mobile phone is displayed in the distribution. On large-screen devices, there are often problems such as over-exposure, over-exposure, dazzling, and over-bright colors. Among them, as shown in Fig. 10, the opposite terminal interface 1 is the interface displayed after the source interface on the mobile phone is directly distributed on the LCD TV. Among them, the opposite terminal interface 2 adopts a distributed display method in this application. The relevant display information of the source interface on the mobile phone is processed accordingly (for example, to reduce the saturation value of multiple pixels in the source interface, thereby changing its color value, etc.), and then distributed to the LCD TV and then displayed interface. Obviously, as shown in Figure 10, the display effect of the opposite terminal interface 1 is poor, the screen color is too bright and the color is too bright, and the user’s long-term viewing will cause discomfort such as eye fatigue, eye swelling, and itching, while the opposite terminal interface 2 The display effect is better, the color of the picture is reasonable and comfortable, and it is not dazzling, which ensures the comfort of the user's viewing. At the same time, the display effect of the peer interface 2 is relatively consistent with the display effect of the source interface on the mobile phone, which ensures the consistency of the user viewing experience of the display interfaces on different devices in the distributed display scenario.

As mentioned above, in order to solve the problem that individual devices display excessively bright colors such as green, blue, and red, embodiments of the present application provide a distributed display method. When the display screen on a mobile terminal device such as a mobile phone needs to be distributed to other peer devices , First judge the peer device. If it is determined that the peer device is a large-screen device with poor color display, such as LCD TVs or other large-screen devices with poor color reproduction, you can extract the information of the interface to be displayed on mobile terminal devices such as mobile phones. The brightness of the color. When the brightness exceeds a certain threshold, that is, there is an area with greater brightness on the interface, which is likely to cause problems such as overexposure and brightness of the screen when it is displayed on the opposite device. You can first The color of the interface is processed, for example, the saturation value of pixels whose brightness exceeds the threshold can be reduced. For example, other approximate color ellipses with lower brightness and saturation close to the center of the CMC color difference ellipse can be extracted according to certain selection rules. The color value of the center point (the range of color difference that can be distinguished by the naked eye) replaces the original color that may display poorly. Then, according to the processed colors, the distributed display is performed on the peer device, so that the display effect on the peer device can be optimized, and the final effect of the display content is not glaring, not too explosive, and comfortable to the naked eye after the display of the device is changed.

Optionally, the embodiment of the present application also provides a method to solve the problem that individual devices tend to cast red and blue lights. For a small number of screens that display a color cast of a certain color, the screen type can be obtained and the database can be maintained, and then the color can be replaced by the screen color management database, to achieve the final effect that the naked eye looks closer to the original color after the device is changed.

Please refer to FIG. 11. FIG. 11 is a schematic structural diagram of a distributed display device provided by an embodiment of the present application. The distributed display device may include a device 30, which may include an acquiring unit 301, a first determining unit 302, and a second determining unit. The unit 303 and the first generating unit 304, wherein the detailed description of each unit is as follows.

The acquiring unit 301 is configured to acquire first information of a first interface, where the first information includes the first brightness value and the first saturation value of each of the P pixels in the first interface; the first interface is The interface displayed in the first device; P is an integer greater than or equal to 1;

The first determining unit 302 is configured to determine N first pixels and M second pixels in the first interface; the first brightness value of each first pixel in the N first pixels is greater than A first threshold; the first brightness value of each second pixel of the M second pixels is less than or equal to the first threshold; N and M are integers greater than or equal to 1;

The second determining unit 303 is configured to: if the ratio of the sum of the first brightness values of the N first pixels to the sum of the first brightness values of the P pixels is greater than or equal to a second threshold, Determine the second saturation value of the N first pixels; the second saturation value is less than the first saturation value;

The first generating unit 304 is configured to generate second information, the second information including the first brightness value and the second saturation value of the N first pixels, and the M second pixels The first brightness value and the first saturation value of, and the second information is used by the second device to display a second interface according to the second information.

In a possible implementation manner, the second determining unit 303 is specifically configured to:

In a possible implementation manner, the acquiring unit 301 is specifically configured to:

Acquiring the first color value of each of the P pixels in the first interface;

In a possible implementation manner, the first interface includes one or more image areas; the acquiring unit 301 is also specifically configured to:

In a possible implementation manner, the first interface further includes one or more text areas; the obtaining unit 301 is further configured to:

In a possible implementation manner, the device 30 further includes:

A calculation unit 305, configured to calculate the second color values of the N first pixels and the first color values of the M second pixels according to the second information;

The second generating unit 306 is configured to generate third information, the third information including the second color values of the N first pixels and the first color values of the M second pixels; The third information is used by the second device to display the second interface according to the third information.

It should be noted that the functions of each functional unit in the distributed display device described in the embodiment of the present application can refer to the related description of step S801 to step S804 in the method embodiment described in FIG. 8, and details are not repeated here. .

Each unit in FIG. 11 can be implemented by software, hardware, or a combination thereof. The hardware-implemented units can include circuits and electric furnaces, arithmetic circuits or analog circuits, etc. A unit implemented in software may include program instructions, which is regarded as a software product, is stored in a memory, and can be run by a processor to implement related functions. For details, refer to the previous introduction.

Based on the description of the foregoing method embodiment and device embodiment, an embodiment of the present application also provides a terminal device. Please refer to FIG. 12, which is a schematic structural diagram of a terminal device provided by an embodiment of the present application. The terminal device 40 includes at least a processor 401, an input device 402, an output device 403, and a computer-readable storage medium 404. The terminal device It can also include other common components, which will not be described in detail here. Among them, the processor 401, the input device 402, the output device 403, and the computer-readable storage medium 404 in the terminal device may be connected by a bus or other means, which is not specifically limited in the embodiment of the present application.

The processor 401 may be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits used to control the execution of the above program programs.

The memory 406 in the terminal device can be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, random access memory (RAM), or can store Other types of dynamic storage devices for information and instructions can also be Electrically Erasable Programmable Read-Only Memory (EEPROM), Compact Disc Read-Only Memory, CD-ROM or Other optical disc storage, optical disc storage (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or can be used to carry or store desired commands or data structures Program code and any other medium that can be accessed by the computer, but not limited to this. The memory 406 may exist independently, and is connected to the processor 401 through a bus. The memory 406 may also be integrated with the processor 401.

The computer-readable storage medium 404 may be stored in the memory 406 of the terminal device. The computer-readable storage medium 404 is used to store a computer program. The computer program includes program instructions. The processor 401 is used to execute the computer program. Read the program instructions stored in the storage medium 404. The processor 401 (or CPU (Central Processing Unit, central processing unit)) is the computing core and control core of the terminal device. It is suitable for implementing one or more instructions, and specifically for loading and executing one or more instructions to achieve The corresponding method flow or corresponding function; in one embodiment, the processor 401 described in the embodiment of the present application may be used to perform a series of processing of distributed display, including: acquiring first information of the first interface, the first information Including the first brightness value and the first saturation value of each of the P pixels in the first interface; the first interface is the interface displayed in the first device; P is an integer greater than or equal to 1; N first pixels and M second pixels in the first interface; the first brightness value of each first pixel in the N first pixels is greater than a first threshold; the M second pixels The first brightness value of each second pixel in the pixels is less than or equal to the first threshold; N and M are integers greater than or equal to 1; if the first brightness value of the N first pixels If the ratio of the sum of the first brightness values of the P pixels to the sum of the first brightness values is greater than or equal to a second threshold, the second saturation value of the N first pixels is determined; the second saturation value is less than The first saturation value; generating second information, the second information including the first brightness value and the second saturation value of the N first pixels, and the M second pixels The first brightness value and the first saturation value of, the second information is used by the second device to display a second interface according to the second information, and so on.

It should be noted that, for the functions of each functional unit in the terminal device described in the embodiment of the present application, refer to the related description of step S801 to step S804 in the method embodiment described in FIG. 8, which will not be repeated here.

In the above-mentioned embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in an embodiment, reference may be made to related descriptions of other embodiments.

The embodiment of the present application also provides a computer-readable storage medium (Memory). The computer-readable storage medium is a memory device in a terminal device for storing programs and data. It can be understood that the computer-readable storage medium herein may include a built-in storage medium in the terminal device, and of course, may also include an extended storage medium supported by the terminal device. The computer-readable storage medium provides storage space, and the storage space stores the operating system of the terminal device. In addition, one or more instructions suitable for being loaded and executed by the processor 401 are stored in the storage space, and these instructions may be one or more computer programs (including program codes). It should be noted that the computer-readable storage medium here may be a high-speed RAM memory, or a non-volatile memory (non-volatile memory), such as at least one disk memory; optionally, it may also be at least one located far away from the foregoing The processor is a computer-readable storage medium.

The embodiments of the present application also provide a computer program, which includes instructions, when the computer program is executed by a computer, the computer can execute part or all of the steps of any distributed display method.

It should be noted that for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should know that this application is not limited by the described sequence of actions. Because according to this application, some steps may be performed in other order or at the same time. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by this application.

In the several embodiments provided in this application, it should be understood that the disclosed device may be implemented in other ways. For example, the device embodiments described above are merely illustrative, for example, the division of the above-mentioned units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or integrated. To another system, or some features can be ignored, or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical or other forms.

The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

In addition, the functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.

If the aforementioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the technical solution of the present application essentially or the part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , Including several instructions to make a computer device (which may be a personal computer, a server or a network device, etc., specifically a processor in a computer device) execute all or part of the steps of the foregoing methods of the various embodiments of the present application. Among them, the aforementioned storage medium may include: U disk, mobile hard disk, magnetic disk, optical disk, read-only memory (Read-Only Memory, abbreviation: ROM) or Random Access Memory (Random Access Memory, abbreviation: RAM), etc. The medium of the program code.

As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: The technical solutions recorded in the embodiments are modified, or some of the technical features are equivalently replaced; these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

A distributed display method, characterized in that it comprises:

Acquire first information of the first interface, where the first information includes the first brightness value and the first saturation value of each of the P pixels in the first interface; the first interface is displayed on the first device The interface; P is an integer greater than or equal to 1;

Determine N first pixels and M second pixels in the first interface; the first brightness value of each first pixel in the N first pixels is greater than a first threshold; the M The first brightness value of each second pixel in the second pixels is less than or equal to the first threshold; N and M are integers greater than or equal to 1;

If the ratio of the sum of the first brightness values of the N first pixels to the sum of the first brightness values of the P pixels is greater than or equal to a second threshold, determine the N first pixels The second saturation value of; the second saturation value is less than the first saturation value;

Generate second information, the second information including the first brightness value and the second saturation value of the N first pixels, and the first brightness value and the sum of the M second pixels The first saturation value; the second information is used by the second device to display a second interface according to the second information.
The method according to claim 1, wherein the ratio of the sum of the first brightness values of the N first pixels to the sum of the first brightness values of the P pixels is greater than Or equal to the second threshold, determining the second saturation value of the N first pixels includes:

If the ratio of the sum of the first brightness values of the N first pixels to the sum of the first brightness values of the P pixels is greater than or equal to a second threshold, determine the N first pixels The first saturation value of the i-th first pixel in is located in the k-th interval; i is an integer greater than or equal to 1 and less than or equal to N; k is an integer greater than 1;

The random value in the k-1th interval is determined as the second saturation value of the i-th first pixel; the k-1th interval is adjacent to the kth interval, and the The maximum value in the k-1 interval is smaller than the minimum value in the k-th interval.
The method according to any one of claims 1-2, wherein the acquiring first information of the first interface comprises:

Acquiring the first color value of each of the P pixels in the first interface;

According to the first color value of each of the P pixels, the first brightness value and the first saturation value of each of the P pixels are calculated through color space transformation.
The method according to claim 3, wherein the first interface includes one or more image regions; and the acquiring the first color value of each of the P pixels in the first interface includes:

Extracting the pixel array of each of the one or more image areas in the first interface;

The first color value of each pixel in the pixel array of each image area is calculated to obtain the first color value of each of the P pixels in the first interface.
The method according to claim 4, wherein the first interface further comprises one or more text areas; and the obtaining the first information of the first interface further comprises:

Acquiring the first color value of each text in each text area of the one or more text areas in the first interface;

According to the first color value of each text in each text area, the first brightness value and the first brightness value of each text in each text area are calculated through color space transformation. Saturation value.
The method according to any one of claims 1-5, wherein the method further comprises:

Calculating the second color values of the N first pixels and the first color values of the M second pixels according to the second information;

Generate third information, where the third information includes the second color values of the N first pixels and the first color values of the M second pixels; the third information is used for the The second device displays the second interface according to the third information.
The method according to any one of claims 1 to 6, wherein the second device is a device with a screen whose brightness and/or color saturation are greater than that of the first device.
A distributed display device, characterized in that it comprises:

The acquiring unit is configured to acquire first information of the first interface, where the first information includes the first brightness value and the first saturation value of each of the P pixels in the first interface; the first interface is The interface displayed in the first device; P is an integer greater than or equal to 1;

The first determining unit is configured to determine N first pixels and M second pixels in the first interface; the first brightness value of each first pixel in the N first pixels is greater than the first brightness value of the first pixel A threshold; the first brightness value of each second pixel of the M second pixels is less than or equal to the first threshold; N and M are integers greater than or equal to 1;

The second determining unit is configured to determine if the ratio of the sum of the first brightness values of the N first pixels to the sum of the first brightness values of the P pixels is greater than or equal to a second threshold value The second saturation value of the N first pixels; the second saturation value is less than the first saturation value;

The first generating unit is configured to generate second information, the second information including the first brightness value and the second saturation value of the N first pixels, and the information of the M second pixels The first brightness value and the first saturation value; the second information is used by the second device to display a second interface according to the second information.
8. The device according to claim 8, wherein the second determining unit is specifically configured to: if the sum of the first brightness values of the N first pixels and the P pixels If the ratio of the sum of the first brightness values is greater than or equal to the second threshold, it is determined that the first saturation value of the i-th first pixel among the N first pixels is located in the k-th interval; i is greater than or An integer equal to 1 and less than or equal to N; k is an integer greater than 1; the random value in the k-1th interval is determined as the second saturation value of the i-th first pixel; the kth -1 interval is adjacent to the kth interval, and the maximum value in the k-1th interval is smaller than the minimum value in the kth interval.
The device according to any one of claims 8-9, wherein the acquiring unit is specifically configured to:

Acquiring the first color value of each of the P pixels in the first interface;

According to the first color value of each of the P pixels, the first brightness value and the first saturation value of each of the P pixels are calculated through color space transformation.
The device according to claim 10, wherein the first interface includes one or more image areas; and the acquiring unit is further specifically configured to:

Extracting the pixel array of each of the one or more image areas in the first interface;

The first color value of each pixel in the pixel array of each image area is calculated to obtain the first color value of each of the P pixels in the first interface.
The device according to claim 11, wherein the first interface further comprises one or more text areas; and the acquiring unit is further configured to:

Acquiring the first color value of each text in each text area of the one or more text areas in the first interface;

According to the first color value of each text in each text area, the first brightness value and the first brightness value of each text in each text area are calculated through color space transformation. Saturation value.
The device according to any one of claims 8-12, wherein the device further comprises:

A calculation unit, configured to calculate the second color values of the N first pixels and the first color values of the M second pixels according to the second information;

The second generating unit is configured to generate third information, where the third information includes the second color values of the N first pixels and the first color values of the M second pixels; The third information is used by the second device to display the second interface according to the third information.
The device according to any one of claims 8-13, wherein the second device is a device with a screen whose brightness and/or color saturation are greater than that of the first device.
A terminal device, characterized in that the terminal device is a first device, including a processor and a memory, the processor and the memory are connected, wherein the memory is used to store program codes, and the processor is used to call all The program code is used to execute the method according to any one of claims 1 to 7.
A computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, which when executed by a processor implements the method according to any one of claims 1 to 7.
A computer program, characterized in that the computer program includes instructions, when the computer program is executed by a computer, the computer is caused to execute the method according to any one of claims 1 to 7.