WO2020215861A1

WO2020215861A1 - Picture display method, picture display apparatus, electronic device and storage medium

Info

Publication number: WO2020215861A1
Application number: PCT/CN2020/075654
Authority: WO
Inventors: 李咸珍; 管恩慧; 赵天月; 李志超; 王志懋
Original assignee: 京东方科技集团股份有限公司
Priority date: 2019-04-22
Filing date: 2020-02-18
Publication date: 2020-10-29
Also published as: CN110060203A

Abstract

Provided are a picture display method, a picture display apparatus, an electronic device and a computer-readable storage medium, belonging to the technical field of image display. The method is applied to a display device, and the display device presents a display area. The method comprises: acquiring a target picture to be displayed (S210); detecting whether the size of the target picture matches that of the display area (S220); if the size of the target picture matches that of the display area, displaying the target picture in the display area (S230); and if the size of the target picture does not match that of the display area, displaying the target picture in the display area, and displaying a background image in at least one sub-area of an unfilled area where the target picture is not displayed (S240). By means of the method, the aesthetics and flexibility of picture display can be improved.

Description

Picture display method, picture display device, electronic equipment and storage medium

This application claims the priority of the Chinese patent application 201910325380.9 filed on April 22, 2019, the content of which is incorporated herein by reference in its entirety.

Technical field

The present disclosure relates to the field of image display technology, and in particular to a picture display method, picture display device, electronic equipment, and computer-readable storage medium.

Background technique

On electronic devices with display screens such as computers and electronic drawing screens, it is often necessary to display pictures in full screen, such as full-screen playback, picture display, screen protection and other scenarios. However, the size or proportion of the picture and the display screen often do not match. The current common method is to stretch the picture to make it adapt to the size of the screen, but this will destroy the original proportion of the picture and cause the picture Distortion of objects in the middle and visual inconsistency affect the aesthetics of the picture.

It should be noted that the information disclosed in the above background section is only used to strengthen the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to those of ordinary skill in the art.

Summary of the invention

The present disclosure provides a picture display method, a picture display device, an electronic device, and a computer-readable storage medium, thereby at least to some extent overcome the problem of low aesthetics of the existing picture display method.

Other characteristics and advantages of the present disclosure will become apparent through the following detailed description, or partly learned through the practice of the present disclosure.

According to one aspect of the present disclosure, there is provided a picture display method applied to a display device, the display device presents a display area; the method includes: acquiring a target picture to be displayed; detecting the target picture and the display area If the size of the target picture matches the size of the display area, display the target picture in the display area; if the target picture does not match the size of the display area and the target picture If the degree of overlap between the picture and the display area is lower than a preset value, the target picture is displayed in the display area, and a background image is displayed in at least one sub-area of an unfilled area where the target picture is not displayed.

In an exemplary embodiment of the present disclosure, the displaying the target picture in the display area and displaying a background image in at least one sub-region of an unfilled area where the target picture is not displayed includes: The target picture is displayed in the display area, and the background image is displayed in an unfilled area where the target picture is not displayed, so that the display area is filled with the target picture and the background image.

In an exemplary embodiment of the present disclosure, the method further includes: determining a background image matching the target picture according to the picture information of the target picture.

In an exemplary embodiment of the present disclosure, the picture information includes a representative color of the target picture; the method further includes: counting the types of colors that appear in the target picture and the appearance frequency of each color, At least one color with the highest frequency is selected as the representative color of the target picture.

In an exemplary embodiment of the present disclosure, the method further includes: acquiring characteristic information of the frame of the display device; and determining a background image matching the target picture according to the picture information of the target picture , Including: determining a background image matching the target picture and the frame based on the characteristic information of the frame and the picture information.

In an exemplary embodiment of the present disclosure, the picture information includes a representative color of the target picture, and the characteristic information includes the color of the frame; the characteristic information based on the frame and the picture information , Determining a background image that matches the target picture and the frame includes: determining an intermediate color between the color of the frame and the representative color; and determining the background image that matches the target picture and the frame based on the intermediate color Background image.

In an exemplary embodiment of the present disclosure, the representative color includes m colors that appear most frequently in the target picture; the intermediate color is determined by the following formula:

Where i is any integer within [1, m], C _i is the value of the i-th color in the m colors, f _i is the frequency of occurrence of C _i in the target picture, and F is the The value of the color of the border, and E is the value of the middle color.

In an exemplary embodiment of the present disclosure, the m colors are colors that appear more frequently than a preset threshold in the target picture.

In an exemplary embodiment of the present disclosure, the determining a background image matching the target picture according to the picture information of the target picture includes: according to the picture information of the target picture, in the effect material library Find a background image that matches the target picture.

In an exemplary embodiment of the present disclosure, the method further includes: acquiring a plurality of sample pictures and a plurality of background materials, the background materials including any one or more of the following: solid color filling, gradient color filling, texture Filling or pattern filling; for each of the sample pictures, a matching relationship between the sample picture and one or more of the background materials is obtained to construct the effect material library.

In an exemplary embodiment of the present disclosure, the matching relationship includes a degree of matching; the acquiring a plurality of sample pictures and a plurality of background materials includes: searching the Internet for examples of matching the sample pictures and background materials; For each of the sample pictures, obtaining the matching relationship between the sample picture and one or more of the background materials to construct the effect material library includes: analyzing the samples to obtain each of the The degree of matching between the sample picture and one or more of the background materials is used to construct the effect material library.

In an exemplary embodiment of the present disclosure, the searching for a background image matching the target picture in an effect material library according to the picture information of the target picture includes: searching and Sample pictures with the same or similar target pictures are used as target sample pictures; the background image is generated according to background materials in the effect material library that match the target sample pictures.

In an exemplary embodiment of the present disclosure, the searching for a sample picture identical or similar to the target picture in the effect material library as the target sample picture includes: calculating the target picture and the effect For the similarity of each sample picture in the material library, the sample picture with the highest similarity to the target picture is taken as the target sample picture.

In an exemplary embodiment of the present disclosure, the displaying the target picture in the display area and displaying a background image in at least one sub-region of an unfilled area where the target picture is not displayed includes: The target picture and the background image are merged into a new image, and the new image is displayed in the display area.

According to one aspect of the present disclosure, there is provided a picture display device applied to a display device, the display device presents a display area, the device includes: a picture acquisition module for acquiring a target picture to be displayed; a size detection module, It is used to detect whether the size of the target picture matches the display area; the first display module is used to display the target picture in the display area if the target picture matches the size of the display area ; A second display module, configured to display the target picture in the display area if the target picture does not match the size of the display area, and display the target picture in at least the unfilled area where the target picture is not displayed The background image is displayed in a sub area.

In an exemplary embodiment of the present disclosure, the second display module is configured to display the target picture in the display area, and display the background image in an unfilled area where the target picture is not displayed, So that the display area is filled with the target picture and the background image.

In an exemplary embodiment of the present disclosure, the device further includes: a background determining module, configured to determine a background image matching the target picture according to the picture information of the target picture.

In an exemplary embodiment of the present disclosure, the picture information includes a representative color of the target picture; the picture acquisition module further includes: a picture information acquisition unit configured to count the colors appearing in the target picture The type and frequency of each color, and at least one color with the highest frequency is selected as the representative color of the target picture.

In an exemplary embodiment of the present disclosure, the picture obtaining module further includes: a frame information obtaining unit, configured to obtain characteristic information of the frame of the display device; and the background determining module is configured to obtain information based on the frame The feature information and the picture information determine a background image matching the target picture and the frame.

In an exemplary embodiment of the present disclosure, the picture information includes a representative color of the target picture, and the characteristic information includes the color of the frame; the background determining module includes: an intermediate color determining unit for Determine an intermediate color between the color of the frame and the representative color; a background image determination unit is configured to determine a background image matching the target picture and the frame based on the intermediate color.

Where i is any integer within [1, m], C _i is the value of the i-th color in the m colors, f _i is the frequency of occurrence of C _i in the target picture, and F is the The color of the border, E is the value of the middle color.

In an exemplary embodiment of the present disclosure, the background determining module is further configured to search for a background image matching the target picture in the effect material library according to the picture information of the target picture.

In an exemplary embodiment of the present disclosure, the device further includes a material library construction module, and the material library construction module further includes: a sample acquisition unit for acquiring multiple sample pictures and multiple background materials, The background material includes any one or more of the following: pure color filling, gradient color filling, texture filling or pattern filling; a matching determination unit for obtaining the sample picture and one or more of the sample pictures The matching relationship of the background materials to construct the effect material library.

In an exemplary embodiment of the present disclosure, the matching relationship includes a degree of matching; the sample acquisition unit is used to search the Internet for examples of matching sample pictures and background materials; and the matching determination unit is used to pass The samples are analyzed to obtain the degree of matching between each sample picture and one or more of the background materials, so as to construct the effect material library.

In an exemplary embodiment of the present disclosure, the background determining module includes: a target sample searching unit, configured to find a sample picture that is the same or similar to the target picture in the effect material library, as the target sample picture The background image generating unit is used to generate the background image according to the background material matching the target sample picture in the effect material library.

In an exemplary embodiment of the present disclosure, the target sample searching unit is configured to calculate the similarity between the target picture and each sample picture in the effect material library, which will have the highest similarity with the target picture As the target sample picture.

In an exemplary embodiment of the present disclosure, the second display module is further configured to merge the target picture and the background image into a new image, and display the new image in the display area.

According to one aspect of the present disclosure, there is provided an electronic device including: a processor; a memory for storing executable instructions of the processor; and a display for presenting a display area; wherein the processor is configured to The image display method described in any one of the foregoing is executed by executing the executable instruction, and the execution result of the executable instruction is displayed in the display area.

In an exemplary embodiment of the present disclosure, it further includes: an image sensor for acquiring characteristic information of the frame of the display.

According to one aspect of the present disclosure, there is provided a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the picture display method described in any one of the above is implemented.

The exemplary embodiments of the present disclosure have the following beneficial effects:

When the size of the target picture and the display area do not match, the background image is added to the unfilled area where the target picture is not displayed to show the effect of full-screen display of the picture, which has a strong sense of overallness and harmony in the vision, and improves the picture The aesthetics of the display. In addition, if the size of the target picture matches the size of the display area, no background image is added, so that different display methods are adopted for pictures of different sizes, which has higher flexibility.

In an exemplary embodiment of the present disclosure, the matching background image is determined according to the picture information of the target picture, and different background images can be determined for different pictures, thereby increasing the diversity of picture display.

It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure.

Description of the drawings

The drawings herein are incorporated into the specification and constitute a part of the specification, show embodiments in accordance with the disclosure, and together with the specification are used to explain the principle of the disclosure. Obviously, the drawings in the following description are only some embodiments of the present disclosure. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.

Figure 1 shows a schematic diagram of a full-screen display of pictures in the related art;

Fig. 2 shows a flow chart of a picture display method in this exemplary embodiment;

Fig. 3 shows a schematic diagram of a picture display effect in this exemplary embodiment;

Fig. 4 shows a flow chart of another picture display method in this exemplary embodiment;

Figure 5 shows a schematic diagram of the hue circle;

FIG. 6 shows a schematic flowchart of a picture display method in this exemplary embodiment;

FIG. 7 shows a schematic flowchart of another picture display method in this exemplary embodiment;

FIG. 8 shows a schematic diagram of another picture display effect in this exemplary embodiment;

Fig. 9 shows a structural block diagram of a picture display device in this exemplary embodiment;

FIG. 10 shows an electronic device for implementing the above method in this exemplary embodiment;

Figure 11 shows another electronic device for implementing the above method in this exemplary embodiment

Fig. 12 shows a computer-readable storage medium for implementing the above-mentioned method in this exemplary embodiment.

Detailed ways

Example embodiments will now be described more fully with reference to the accompanying drawings. However, the example embodiments can be implemented in various forms, and should not be construed as being limited to the examples set forth herein; on the contrary, the provision of these embodiments makes the present disclosure more comprehensive and complete, and fully conveys the concept of the example embodiments To those skilled in the art. The described features, structures or characteristics may be combined in one or more embodiments in any suitable way.

In a related art solution, as shown in FIG. 1, when the size of the picture 110 is adaptively adjusted according to the size of the display screen 100, the original ratio of the picture 110 is retained. A certain "black border" 120 (or "white border") is left outside the picture 110. Although this can ensure that the ratio of the picture is not destroyed, the picture is not really complete full-screen display. The existence of "black borders" will affect the overall look and feel of the picture, and its aesthetics is still low.

In view of the foregoing various problems, the exemplary embodiments of the present disclosure first provide a picture display method, which can be applied to a display device that presents a display area. In this exemplary embodiment, a display device refers to an electronic device with a display screen, such as a computer, a mobile phone, a smart TV, an electronic photo frame, an electronic drawing screen, etc. The display screen includes a display area, which refers to all that can be used to present a graphical user interface area. As shown in Figure 2, the method may include the following steps:

Step S210, obtaining a target picture to be displayed;

Step S220, detecting whether the size of the target picture matches the size of the display area;

Step S230, if the target picture matches the size of the display area, display the target picture in the display area;

In step S240, if the size of the target picture does not match the size of the display area, display the target picture in the display area, and display the background image in at least one sub-region of the unfilled area where the target picture is not displayed.

The target picture may be a local picture designated by the user, a picture downloaded from the network, or a picture synchronized (transmitted through a wired or wireless connection) from other electronic devices, which is not limited in the present disclosure. The size matching of the target picture and the display area means that the target picture can be displayed in the display area in full screen (or close to full screen). In this exemplary embodiment, the size of the target picture can be gradually scaled until: the target picture is enlarged to the maximum size ( If you zoom in again, the picture may be blurred). At this time, if the overlap between the target picture and the display area is lower than the preset value (for example, 95%, etc.), the two sizes do not match; or the length or width of the target picture It is equal to the display area. At this time, if the overlap between the target picture and the display area is lower than the preset value, the sizes of the two do not match. Of course, it is also possible to calculate whether it matches the display area based on the original size or pixel information of the target picture.

If the two sizes match, the target image can be displayed in full screen. Of course, if the preset value such as 95% is used as the standard when the above detection matches, then after the target image is displayed, there may be 5% unfilled area remaining in the display area, which is beautiful The degree of influence is small and can be ignored.

If the sizes of the two do not match, the target picture is displayed normally, and there are still more unfilled areas (that is, the area where the target picture is not displayed). For example, more unfilled areas may remain around the target picture. For another example, if there is a hollow area in the target picture, the hollow area may also be regarded as an unfilled area. Usually, for the sake of beauty, the target image is displayed in the center of the display area. The unfilled area may be located around the target image, or may be located on the upper and lower sides or the left and right sides. Of course, the target image can also be displayed on one side of the display area. , The unfilled area is on the other side, which is not limited in the present disclosure. The background image can be displayed in the unfilled area. The background image can be solid color filling, gradient color filling, texture filling or pattern filling, etc., or a combination of multiple filling effects, such as gradient color plus texture filling, gradient color plus pattern filling, etc. . In this exemplary embodiment, the background image can be displayed in all the unfilled areas, so that the display area is filled with the target picture and the background image to achieve complete full-screen display, or in at least one sub-region of the unfilled area Internal display background image, for example, the background image is only located on one side of the target picture, or there is a certain unfilled area around the background image, etc., so as to meet specific display needs. For example, the frame of the display area has a specific shape to match the background image and Part of the unfilled area can present special effects, or the background image has a specific pattern, which is not suitable for filling the unfilled area completely.

In an exemplary embodiment, the target picture and the background image can also be merged into a new image, and the new image is displayed in the display area. The target picture and the background image can be directly joined to obtain the new image, or the boundary between the two can be Some fading or blurring processing, etc., process the target picture and background image in the form of a new image, which can increase the overall sense, and it is also convenient to store the new image locally for subsequent use.

FIG. 3 shows the display effect of displaying the target picture 310 and the background image 320 in the display area 300. The target picture 310 can be adjusted to any size according to the size of the display area 300, or the original size of the target picture 310 can be maintained, and the target is not displayed. The unfilled area of the picture 310 can display the background image 320, and the two together form a full-screen display effect.

In an exemplary embodiment, the flow of the picture display method may be as shown in FIG. 4, wherein after detecting that the size of the target picture does not match the display area, step S231 may be performed: according to the picture information of the target picture, determine the Picture matching background image. The picture information of the target picture may refer to multiple aspects of feature information such as picture style, color distribution, color composition, and color matching. In this exemplary embodiment, the background image may be determined based on one or more aspects of picture information. The matching of the background image and the target picture specifically refers to the visual presentation of a strong sense of integrity and harmony between the background image and the target picture. For example, the background image filled with a pure color or a gradient color is determined according to the color distribution of the edge of the target picture, so that the background image and the target picture The edge of the target picture has a certain degree of continuity; or according to the style of the target picture, determine a background image that is consistent or similar to its style, so that the background image visually presents the extension of the target picture; or provide multiple according to the main color of the target picture The background image that matches its hue is used as an alternative, allowing the user to select one as the final background image. For different target pictures, because of their different picture information, different background images can be matched. After the background image is determined, step S240 can be executed to display it together with the target image in the display area.

Based on the above description, when the target picture does not match the size of the display area, this exemplary embodiment adds a background image display to the unfilled area where the target picture is not displayed, so as to present the effect of full-screen display of the picture, which has a strong visual overall Sense and harmony, improve the beauty of the picture display. In addition, if the size of the target picture matches the size of the display area, no background image is added, so that different display methods are adopted for pictures of different sizes, which has higher flexibility. In an exemplary embodiment of the present disclosure, the matching background image is determined according to the picture information of the target picture, and different background images can be determined for different pictures, thereby increasing the diversity of picture display.

The above picture information may include the representative color of the target picture, and the representative color may be the background color of the target picture or the representative color of the main tone, etc., which can generally represent the main colors of the target picture. In an exemplary embodiment, the representative color may also be the color with the highest frequency in the target picture, which may be determined by the following steps:

Count the types of colors that appear in the target picture and the frequency of each color, and select at least one color with the highest frequency as the representative color of the target picture.

The following will further illustrate through several specific implementations, but the following content should not limit the protection scope of the present disclosure:

(1) Using the frequency sequence method, first scan the target picture to determine the color value of each pixel, for example, RGB color value or HSL color value, and count the types of colors that appear in the picture and the number of times each color appears. Among them, the color that appears most frequently, that is, the color that appears most frequently, is the representative color of the target image.

(2) Also use the frequency sequence method to count the types of colors that appear in the target picture and the number of times each color appears, and select several colors with the highest frequency and belong to the same hue as the representative colors, or take the average value (Or weighted average) to get the representative color, or use the main color of the hue as the representative color.

(3) Cut a certain area in the middle from the target picture, and the remaining part is the edge area of the target picture, and perform the method (1) or (2) above on the edge area.

(4) The target picture is divided into several sub-regions, for example, it can be divided into 8*8, 16*16, 4*3 or 16*9 sub-regions based on experience. Count the frequency of occurrence of various colors of the target picture in each sub-region. The frequency refers to how many sub-regions in all sub-regions have a certain color. For example, if the target picture is divided into 16*9=144 sub-regions, Magenta (R255, G0, B255) appears in 102 sub-regions, and the frequency of magenta appearance is 102/144=70.8%. According to this method, the color with the highest frequency is the representative color of the target image.

Based on the above-mentioned representative colors, an image filled with a pure color of the representative color can be used as a background image of the target picture, or a gradient fill of the same color system of the representative color, or a pattern fill of the same hue as the background image.

Further, if the m colors with the highest occurrence frequency in the target picture are selected as the representative colors, step S231 can be specifically implemented through the following steps:

Based on the above m colors, the value D of the background color matching the target picture is determined by the following formula (1);

Generate a background image matching the target image according to the value D of the background color;

Among them, m can be any natural number, i is any integer within [1, m], C _i is the value of the i-th color among the m colors (for example, it can be an RGB color value or an HSL color value), f _i is the frequency of C _i in the target picture. The formula (1) can be regarded as taking the appearance frequency of m colors as its weight, and weighting and averaging the m colors to obtain an average color value, that is, the value D of the background color, which is a high summary of the color characteristics of the target image . The background image may be filled with a pure color of the value D of the background color, a gradient filled with the same color of D, a pattern filled with the same hue of D, etc. The present disclosure does not limit this.

It should be noted that if the target image is in RGB mode, the colors in it can be expressed as RGB components, and the RGB components of the background color D can be calculated by formula (1) for each component; HSL components can be calculated separately in HSL mode , The gray value can be calculated in gray mode. In addition, m can be a predetermined value, for example, it is determined to select the 5 or 10 colors with the highest frequency in the target picture as the representative color, or a preset threshold value for the frequency of color appearance can be determined to make the frequency of appearance in the target picture higher than All colors of the preset threshold are used as representative colors, and the value of m is uncertain. For example, all colors with a frequency higher than 10% are used as representative colors. If there are 3 colors that meet the requirements, m is 3. Disclosure does not specifically limit the preset threshold.

In an exemplary embodiment, the characteristic information of the frame of the display device may also be acquired, and based on the characteristic information of the frame and the picture information of the target picture, a background image matching the target picture and the frame may be jointly determined.

Among them, the frame refers to the physical frame of the display device, and its color or texture is usually the same as the color of the housing of the device. Of course, there are exceptions. The characteristic information of the frame can include the color, texture, pattern, shape and other aspects of the frame. , This disclosure does not limit this. In this example embodiment, the image of the frame area can be captured by an external camera to identify the frame characteristics in the image. The external camera can also be replaced by another electronic device with a shooting function, for example, the frame image of an electronic photo frame can be captured by a mobile phone. Then the image is transmitted to the electronic photo frame through Bluetooth, USB, wireless network, etc., so that it can recognize the characteristics of the frame. If the frame is an ordinary solid color frame, its characteristic information mainly includes color, and the color can also be determined by the user in advance. For example, a color palette can be provided to enable the user to select a color in the frame, and preview it through full screen (full screen display user The color of the frame selection) or the edge preview (display the color selected by the user in the edge area near the frame) allows the user to intuitively judge whether the color is consistent with the frame color, so that the frame color can be accurately selected, which is the default The border color. If you change the display device or border of another color later, you can reselect the border color.

After obtaining the characteristic information of the frame and the picture information of the target picture, the background image can be determined jointly based on the two aspects of information. Since the background image is located between the target picture and the frame, a more beautiful display effect can be obtained. In this exemplary embodiment, a transition effect from the target picture to the frame can be generated, for example, a gradient fill from the representative color of the target picture to the frame color, or considering that the frame and the target picture are not on the same plane, it can present a three-dimensional The background image with perspective effect makes the connection between the target image and the frame more natural.

Further, in an exemplary embodiment, the picture information of the target picture mainly refers to the representative color of the target picture, and the characteristic information of the frame mainly refers to the color of the frame. Then, the intermediate color between the color of the frame and the representative color can be determined, and based on this The middle color determines the background image that matches the target picture.

Among them, the intermediate color refers to the color between the color of the border and the representative color of the target image, and it can be a color or a group of colors. When the picture is displayed on the full screen, from the middle to the edge of the display, the target picture, the background image, and the frame are in sequence. In order to show the overall sense, the background image can be used to transition from the target picture to the frame, so it can be based on the middle color Determine the background image. For example: if the border color and the representative color belong to the same hue, the middle color can be a set of gradient colors between the above two colors, and the background image can be filled with a gradient color; if the border color and the representative color belong to different hues, two colors can be used The average value of, the intermediate color can be obtained. The background image can be based on the intermediate color as the main color, adding the effect of the border color and the representative color (or the approximate color of the two colors) pattern; in practical applications, after determining the intermediate color, the intermediate color can be The main color, add arbitrary patterns to form a background image.

The present disclosure provides the following exemplary embodiments for calculating intermediate colors, but the following content should not limit the protection scope of the present disclosure:

(1) RGB color mode is adopted. If the value of the representative color is (R1, G1, B1) and the value of the border color is (R2, G2, B2), it can be calculated by formula (2) (including the following 3 formulas) The value of the middle color is (R3, G3, B3):

Among them, a, b, and c are all constants greater than 0, and a+b+c=1. The calculation process of formula (2) can be expressed as: firstly, the R, G, and B components of the value of the representative color and the value of the border color are averaged, and then R, G, and B are mixed in different proportions to obtain the intermediate color, a The value of, b, c is the mixing ratio, which can be determined based on experience, or adjusted according to different hues and actual needs. For example, if the representative color and the border color are both green, the value of b can be increased appropriately. As shown in the 12-hue circle in Figure 5, usually the color matching should not exceed three, that is, the range of three hues, because when determining the background image, you can use the same hue, the same brightness, and the same saturation. , To ensure that the target image, background image, and frame show a more uniform appearance color, such as red + orange red + orange, blue green + blue + blue purple, etc. The above method can be used to determine the intermediate color to achieve this goal.

(2) If the value of the representative color is (R1, G1, B1) and the value of the border color is (R2, G2, B2), the value of the intermediate color can be calculated by formula (3) (including the following 3 formulas) (R3, G3, B3):

R3=p·R1+q·R2;

G3=p·G1+q·G2;

B3=p·B1+q·B2; (3)

Among them, p and q are not constants greater than 0, and p+q=1. That is, the value of the intermediate color can be obtained by the weighted average of the value of the representative color and the value of the border color. p and q are the weight values of the value of the representative color and the value of the border color, usually in order to emphasize the background image more and the target image Match, p can be greater than 0.5, of course, it can also be adjusted according to the actual situation. For example, when the representative color belongs to the dark color system and the border color belongs to the light color system, the value of p can be appropriately reduced, or the percentage of the color in the target image If it is low, the value of p can also be appropriately reduced.

(3) If the m colors with the highest frequency in the target picture are selected as the representative colors, denoted as C ₁ ～C _m , and the value of the border color is F, then the value E of the intermediate color can be calculated by formula (4):

In other words, the values of m representative colors of the target picture and the value F of the border color are averaged to obtain m average colors, and then the frequency f of the m colors in the target picture is used as the weight, and the m The average color value is weighted and averaged to obtain the value E of the intermediate color. Such a calculation method can fully consider the color distribution characteristics of the target image and the influence of the border color to obtain a background image with a higher degree of matching.

In an exemplary embodiment, the process of the picture display method may be as shown in FIG. 6: Step S610, obtain the target picture; Step S620, detect whether the size of the target picture and the display area match; Step S630, if they match, it can be normal Display the target picture in full screen to make it fill the entire display area; step S640, if it does not match, extract the representative color of the target picture; step S650, detect the border color of the display device at the same time; step S660, determine according to the representative color and the border color Intermediate color; Step S670, determine the background image based on the intermediate color, the background image matches the target picture and the frame; Step S680, combine the target picture and the background image to display in the display area, thereby realizing the full screen display of the picture.

The present disclosure also provides another exemplary embodiment on how to determine the background image. Specifically, step S231 can be implemented through the following steps:

According to the picture information of the target picture, search for a background image matching the target picture in the effect material library.

Among them, the effect material library is a pre-built database that gathers a large number of matching relationships between pictures and materials, such as the matching of colors and colors, the matching of colors and patterns or pictures, the matching of pictures and patterns, etc. Wait. Extract picture information from the target picture, such as representative color, edge color, etc., and search for the matching background image material in the effect material library to obtain the background image.

In an exemplary embodiment, the image display method may further include the following steps of constructing an effect material library:

Obtain multiple sample pictures and multiple background materials. The background materials include any one or more of the following: solid color filling, gradient color filling, texture filling or pattern filling;

For each sample picture, the matching relationship between the sample picture and one or more background materials is obtained to construct the aforementioned effect material library.

Among them, the sample pictures are a large number of representative pictures collected in advance, for example, it can include typical pure color pictures, static pictures of various objects, ink paintings, oil paintings, landscape photos, portraits and other typical pictures of various styles; of course, According to different application scenarios, the coverage of sample pictures can be reduced. For example, when the exemplary embodiment is applied to the display of character selfies, representative pictures of the subject of character selfies can be collected specifically to construct a small effect material library . The sample pictures can be searched on the Internet, and can also be obtained from local or other databases, which is not limited in the present disclosure.

Similarly, the background materials needed to build the effect material library can also be obtained from the Internet, local or other databases, and background materials can also be generated based on certain mechanisms, such as changing colors, textures, and patterns from a seed material. Generate a series of materials.

In this exemplary embodiment, a single color matching method, an approximate color matching method, etc. can be used to extract a single color from a background material, and form a series of colors by changing the hue, saturation, and lightness of the single color. Establish a matching relationship between colors, or establish a matching relationship by collecting color matching relationships, and then map the colors to a sample image to obtain the matching relationship between the sample image and the background material, or establish the relationship between the sample image and the background material through the user’s manual rating The matching relationship, the matching relationship may include a quantitative expression of whether or not it matches or the degree of matching. According to the above method, an effect material library can be constructed to facilitate the subsequent search for a suitable background image.

In an exemplary embodiment, the step of constructing an effect material library may include:

Search for examples of sample pictures and background materials from the Internet;

Through the analysis of the above samples, the matching degree of each sample picture with one or more background materials is obtained to construct an effect material library.

Among them, examples of sample pictures and background materials can include pictures with edge effects (edge effects as background materials), posters with picture inlays (poster backgrounds as background materials), and clothing designs with picture inlays (clothing background colors are used as background materials). Background material), etc., you can use crawler tools to crawl relevant sample information from the Internet. After obtaining the samples, separate the pictures from the background, use the pictures as the sample pictures, and the background as the background material. Then, based on the popularity of each sample, user praise, search frequency and other data, comprehensively analyze the sample pictures and The matching degree of the background material to build the effect material library.

The effect material library constructed based on sample pictures, in practical applications, the background image can be determined through the following steps:

Find sample pictures that are the same or similar to the target picture in the effect material library as the target sample picture;

Generate a background image based on the background material matching the target sample image in the effect material library.

Among them, the similarity between the target picture and each sample picture in the effect material library can be calculated, such as SSIM (Structural Similarity Index, structural similarity), cosine similarity, etc., and the sample picture with the highest similarity to the target picture is used as the target sample picture , The sample picture can also be classified in multiple dimensions, such as picture style, representative color, main color, etc. If all the dimensional information of the sample image and the target picture are the same, or the same number of dimensions is the largest, then it is the target sample picture. In the effect material library, find the background material that matches the target sample image. Based on the material, you can perform appropriate cropping, beautification, color adjustment, etc., to get the background image. If the target sample image matches multiple background materials, you can choose which one to match The one with the highest degree generates a background image.

In an exemplary embodiment, the overall process of the picture display method may be as shown in FIG. 7: Step S710, obtain the target picture; Step S720, detect whether the size of the target picture and the display area match; Step S730, if they match, then Normally display the target picture in full screen so that it just fills the entire screen; step S740, if it does not match, extract the picture information of the target picture; step S750, input the picture information of the target picture into the effect material library, and then go through step S760 or step S770 determines the background image; step S760, automatically finds the background image matching the effect material library with the target picture; step S770, the user manually selects an appropriate background image; step S780, after the background image is determined, the target picture and the background image can be combined and displayed In the display area.

In an exemplary embodiment, the background image may be the effect of simulating the expansion of the scroll; correspondingly, step S231 may be implemented through the following steps:

Determine the edge filling effect matching the target picture according to the picture information of the target picture;

Take the edge filling effect as the background of the scroll to get the effect of simulating the expansion of the scroll.

The unfolding effect of the simulated scroll can be as shown in the background image 820 in Figure 8. The left and right sides are the scroll effect, plus the internal canvas filling effect, which together with the target picture 810 form a visual sense of the scroll. Can further improve the aesthetics. In this exemplary embodiment, the background filling effect can be determined according to the picture information of the target picture. For example, the color matching the target picture is used as the main color, and a certain texture is added to form the filling effect of paper and canvas, which is used as the scroll background. Add the curled image of the scroll on the side to form the final background image, which simulates the effect of scrolling. Of course, some elements such as mosaics, embellishments, text, etc. can also be added to the background image to obtain various effects, which are not particularly limited in the present disclosure.

In an exemplary embodiment, when determining the above-mentioned background filling effect, the color of the frame of the display device may also be referred to. For example, in FIG. 8, the color of the frame 830 of the display area 800 and the picture information of the target picture 810 may be used. Determine the background filling effect together (refer to the method in formulas (2) ~ (4)).

The effect of the picture scroll simulation is only an example of the background image. For example, the effect of simulating the opening of the book, the effect of simulating the drawing board, etc. can also be used.

Exemplary embodiments of the present disclosure also provide a picture display device, which can be applied to a display device, and the display device presents a display area. As shown in FIG. 9, the device 900 may include: a picture acquisition module 910, configured to acquire a target picture to be displayed; a size detection module 920, configured to detect whether the target picture matches the size of the display area; and a first display module 930, If the target picture matches the size of the display area, display the target picture in the display area; the second display module 940 is used to display the target picture in the display area if the size of the target picture does not match the display area, and The background image is displayed in at least one subregion of the unfilled region where the target picture is not displayed.

In an exemplary embodiment, the second display module 940 may be used to display the target picture in the display area, and display the background image in the unfilled area where the target picture is not displayed, so that the display area is filled with the target picture and the background image. full.

In an exemplary embodiment, the picture display device 900 may further include: a background determining module for determining a background image matching the target picture according to picture information of the target picture.

In an exemplary embodiment, the above-mentioned picture information may include the representative color of the target picture; the picture obtaining module 910 may also include: a picture information obtaining unit for counting the types of colors appearing in the target picture and the frequency of each color , And select at least one color with the highest frequency as the representative color of the target image.

In an exemplary embodiment, the picture acquiring module 910 may further include: a frame information acquiring unit for acquiring feature information of the frame of the display device; the background determining module may be configured to determine the target information based on the feature information and picture information of the frame Picture and background image with matching border.

In an exemplary embodiment, the above-mentioned picture information may include the representative color of the target picture, and the above-mentioned characteristic information may include the color of the frame; the background determining module may include: an intermediate color determining unit for determining the middle between the color of the frame and the representative color Color; a background image determining unit for determining a background image matching the target picture and the frame based on the intermediate color.

In an exemplary embodiment, the foregoing representative colors may include m colors with the highest frequency in the target picture; the foregoing intermediate colors may be determined by the following formula:

Among them, i is any integer within [1,m], Ci is the value of the i-th color among m colors, fi is the frequency of appearance of Ci in the target image, F is the value of the color of the frame, and E is the middle The value of the color.

In an exemplary embodiment, the aforementioned m colors are colors in the target picture whose frequency of appearance is higher than a preset threshold.

In an exemplary embodiment, the background determining module may also be used to search for a background image matching the target picture in the effect material library according to the picture information of the target picture.

In an exemplary embodiment, the picture display device 900 may further include a material library building module, and the material library building module may further include: a sample acquisition unit for acquiring multiple sample pictures and multiple background materials, the background materials include any of the following One or more types: solid color filling, gradient color filling, texture filling or pattern filling; matching determination unit for obtaining the matching relationship between the sample image and one or more background materials for each sample image to build an effect material library .

In an exemplary embodiment, the above-mentioned matching relationship may include a degree of matching; the sample acquisition unit may be used to search for examples of sample images and background materials from the Internet; the matching determination unit may be used to analyze the examples to obtain each The matching degree of a sample picture with one or more background materials to construct an effect material library.

In an exemplary embodiment, the background determining module may include: a target sample searching unit, which is used to find a sample picture that is the same or similar to the target picture in the effect material library, as the target sample picture; The background material matching the target sample image in the effect material library generates a background image.

In an exemplary embodiment, the target sample searching unit may be used to calculate the similarity between the target picture and each sample picture in the effect material library, and the sample picture with the highest similarity to the target picture is used as the target sample picture.

In an exemplary embodiment, the second display module 940 may also be used to merge the target picture and the background image into a new image, and display the new image in the display area.

The specific details of each module/unit in the above-mentioned device have been described in detail in the corresponding method part of the embodiment, and therefore will not be repeated.

Exemplary embodiments of the present disclosure also provide an electronic device capable of implementing the above method.

Those skilled in the art can understand that various aspects of the present disclosure can be implemented as systems, methods, or program products. Therefore, various aspects of the present disclosure can be specifically implemented in the following forms, namely: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to herein as "Circuit", "Module" or "System".

The electronic device 1000 according to this exemplary embodiment of the present disclosure will be described below with reference to FIG. 10. The electronic device 1000 shown in FIG. 10 is only an example, and should not bring any limitation to the function and scope of use of the embodiments of the present disclosure.

As shown in FIG. 10, the electronic device 1000 may include a processor 1010, a memory 1020, and a display 1030, where the memory 1020 is used to store executable instructions of the processor 1010, the display 1030 is used to present a display area, and the processor 1010 is configured In order to execute any method in this exemplary embodiment by executing the executable instruction, for example, the method steps shown in FIG. 2, FIG. 3, FIG. 6 or FIG. 7 may be executed, and the instruction execution result may be displayed in the display area. The electronic device 1000 may be a computer, a mobile phone, a tablet computer, a smart TV, an electronic photo frame, or an electronic drawing screen, etc.

In an exemplary embodiment, the electronic device may further include an image sensor for acquiring characteristic information of the frame of the display, and the characteristic information of the frame is used to determine the background image together with the picture information of the target picture. The image sensor can be an external camera. For example, when the electronic device is an electronic drawing screen, an external camera can be set on the opposite wall to capture the frame of the electronic drawing screen to obtain characteristic information.

In an exemplary embodiment, as shown in FIG. 11, the electronic device 1100 may be in the form of a general-purpose computing device, and its components may include but are not limited to: at least one processing unit 1110, at least one storage unit 1120, and connection to different system components (Including the storage unit 1120 and the processing unit 1110) bus 1130 and the display unit 1140.

The storage unit stores program codes, and the program codes can be executed by the processing unit 1110, so that the processing unit 1110 executes the steps according to the exemplary embodiments of the present disclosure described in the "Exemplary Method" section of this specification.

The storage unit 1120 may include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 1121 and/or a cache storage unit 1122, and may further include a read-only storage unit (ROM) 1123.

The storage unit 1120 may also include a program/utility tool 1124 having a set of (at least one) program module 1125. Such program module 1125 includes but is not limited to: an operating system, one or more application programs, other program modules, and program data, Each of these examples or some combination may include the implementation of a network environment.

The bus 1130 may represent one or more of several types of bus structures, including a storage unit bus or a storage unit controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local area using any bus structure among multiple bus structures. bus.

The electronic device 1100 may also communicate with one or more external devices 1300 (such as keyboards, pointing devices, Bluetooth devices, etc.), and may also communicate with one or more devices that enable a user to interact with the electronic device 1100, and/or communicate with Any device (such as a router, modem, etc.) that enables the electronic device 1100 to communicate with one or more other computing devices. This communication can be performed through an input/output (I/O) interface 1150. In addition, the electronic device 1100 may also communicate with one or more networks (for example, a local area network (LAN), a wide area network (WAN), and/or a public network, such as the Internet) through the network adapter 1160. As shown in the figure, the network adapter 1160 communicates with other modules of the electronic device 1100 through the bus 1130. It should be understood that although not shown in the figure, other hardware and/or software modules can be used in conjunction with the electronic device 1100, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives And data backup storage system, etc.

Through the description of the foregoing embodiments, those skilled in the art can easily understand that the exemplary embodiments described herein can be implemented by software, or can be implemented by combining software with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (can be a CD-ROM, U disk, mobile hard disk, etc.) or on the network , Including several instructions to make a computing device (which may be a personal computer, a server, a terminal device, or a network device, etc.) execute the method according to the exemplary embodiment of the present disclosure.

Exemplary embodiments of the present disclosure also provide a computer-readable storage medium on which is stored a program product capable of implementing the above method of this specification. In some possible implementation manners, various aspects of the present disclosure can also be implemented in the form of a program product, which includes program code. When the program product runs on a terminal device, the program code is used to make the terminal device execute the above-mentioned instructions in this specification. The steps according to various exemplary embodiments of the present disclosure are described in the "Exemplary Methods" section.

Referring to FIG. 12, a program product 1200 for implementing the above method according to an exemplary embodiment of the present disclosure is described. It may adopt a portable compact disk read-only memory (CD-ROM) and include program codes, and may be used in a terminal Running on equipment, such as a personal computer. However, the program product of the present disclosure is not limited thereto. In this document, the readable storage medium can be any tangible medium that contains or stores a program, and the program can be used by or in combination with an instruction execution system, device, or device.

The program product can adopt any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or a combination of any of the above. More specific examples (non-exhaustive list) of readable storage media include: electrical connections with one or more wires, portable disks, hard disks, random access memory (RAM), read only memory (ROM), erasable Type programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.

The computer-readable signal medium may include a data signal propagated in baseband or as a part of a carrier wave, and readable program code is carried therein. This propagated data signal can take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The readable signal medium may also be any readable medium other than a readable storage medium, and the readable medium may send, propagate, or transmit a program for use by or in combination with the instruction execution system, apparatus, or device.

The program code contained on the readable medium can be transmitted by any suitable medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.

The program code for performing the operations of the present disclosure can be written in any combination of one or more programming languages. The programming languages include object-oriented programming languages—such as Java, C++, etc., as well as conventional procedural programming. Language-such as "C" language or similar programming language. The program code can be executed entirely on the user's computing device, partly on the user's device, executed as an independent software package, partly on the user's computing device and partly executed on the remote computing device, or entirely on the remote computing device or server Executed on. In the case of a remote computing device, the remote computing device can be connected to a user computing device through any kind of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, using Internet service providers) Business to connect via the Internet).

In addition, the above-mentioned drawings are merely schematic illustrations of the processing included in the method according to the exemplary embodiments of the present disclosure, and are not intended for limitation. It is easy to understand that the processing shown in the above drawings does not indicate or limit the time sequence of these processings. In addition, it is easy to understand that these processes can be executed synchronously or asynchronously in multiple modules, for example.

It should be noted that although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to exemplary embodiments of the present disclosure, the features and functions of two or more modules or units described above may be embodied in one module or unit. Conversely, the features and functions of a module or unit described above can be further divided into multiple modules or units to be embodied.

Those skilled in the art will easily think of other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptive changes of the present disclosure, which follow the general principles of the present disclosure and include common knowledge or conventional technical means in the technical field not disclosed in the present disclosure . The description and embodiments are only regarded as exemplary, and the true scope and spirit of the present disclosure are pointed out by the claims.

It should be understood that the present disclosure is not limited to the precise structure that has been described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is only limited by the appended claims.

Claims

A picture display method applied to a display device, wherein the display device presents a display area; the method includes:

Get the target picture to be displayed;

Detecting whether the size of the target picture matches the size of the display area;

If the target picture matches the size of the display area, displaying the target picture in the display area;

If the size of the target picture does not match the size of the display area and the degree of overlap between the target picture and the display area is lower than a preset value, the target picture is displayed in the display area, and if it is not displayed A background image is displayed in at least one sub-region of the unfilled region of the target picture.
The method of claim 1, wherein the displaying the target picture in the display area and displaying a background image in at least one sub-region of an unfilled area where the target picture is not displayed comprises:

The target picture is displayed in the display area, and the background image is displayed in an unfilled area where the target picture is not displayed, so that the display area is filled with the target picture and the background image.
The method according to claim 1, wherein the method further comprises:

According to the picture information of the target picture, a background image matching the target picture is determined.
The method according to claim 3, wherein the picture information includes a representative color of the target picture; the method further comprises:

The types of colors appearing in the target picture and the appearance frequency of each color are counted, and at least one color with the highest appearance frequency is selected as the representative color of the target picture.
The method according to claim 4, wherein if the m colors with the highest occurrence frequency in the target picture are selected as the representative colors, then the determination is made to match the target picture according to the picture information of the target picture The background image includes:

Determine a background color value matching the target image based on the m colors
Generating a background image matching the target picture according to the background color value D;

Wherein, i is any integer within [1, m], C i is the value of the i-th color in the m colors, and f i is the frequency of occurrence of C i in the target picture.
The method according to claim 3, wherein the method further comprises:

Acquiring characteristic information of the frame of the display device;

The determining a background image matching the target picture according to the picture information of the target picture includes:

Based on the characteristic information of the frame and the picture information, a background image that matches the target picture and the frame is determined.
The method according to claim 6, wherein the picture information includes a representative color of the target picture, and the characteristic information includes the color of the frame;

The determining a background image matching the target picture and the frame based on the characteristic information of the frame and the picture information includes:

Determining an intermediate color between the color of the frame and the representative color;

Determine a background image matching the target picture and the frame based on the intermediate color.
8. The method according to claim 7, wherein the representative colors include m colors with the highest frequency in the target picture; the intermediate colors are determined by the following formula:

Where i is any integer within [1, m], C i is the value of the i-th color in the m colors, f i is the frequency of occurrence of C i in the target picture, and F is the The value of the color of the border, and E is the value of the middle color.
The method according to claim 5 or 8, wherein the m colors are colors in the target picture whose frequency of occurrence is higher than a preset threshold.
The method according to claim 3, wherein the determining a background image matching the target picture according to the picture information of the target picture comprises:

According to the picture information of the target picture, search for a background image matching the target picture in the effect material library.
The method according to claim 10, wherein the method further comprises:

Acquire multiple sample pictures and multiple background materials, where the background materials include any one or more of the following: solid color filling, gradient color filling, texture filling or pattern filling;

For each sample picture, a matching relationship between the sample picture and one or more of the background materials is obtained to construct the effect material library.
The method according to claim 11, wherein the matching relationship includes a matching degree; and the obtaining multiple sample pictures and multiple background materials includes:

Search for examples of sample pictures and background materials from the Internet;

The acquiring, for each sample picture, the matching relationship between the sample picture and one or more of the background materials to construct the effect material library includes:

By analyzing the samples, the degree of matching between each sample picture and one or more of the background materials is obtained to construct the effect material library.
The method according to claim 11, wherein the searching for a background image matching the target picture in an effect material library according to the picture information of the target picture comprises:

Search for a sample picture identical or similar to the target picture in the effect material library, as the target sample picture;

The background image is generated according to the background material matching the target sample picture in the effect material library.
The method according to claim 13, wherein the searching for a sample picture that is the same or similar to the target picture in the effect material library as the target sample picture comprises:

The similarity between the target picture and each sample picture in the effect material library is calculated, and the sample picture with the highest similarity to the target picture is used as the target sample picture.
The method of claim 1, wherein the displaying the target picture in the display area and displaying a background image in at least one sub-region of an unfilled area where the target picture is not displayed comprises:

The target picture and the background image are merged into a new image, and the new image is displayed in the display area.
A picture display device applied to a display device, wherein the display device presents a display area; the device includes:

Picture getter, used to get the target picture to be displayed;

A size detector for detecting whether the target picture matches the size of the display area;

A first display module, configured to display the target picture in the display area if the target picture matches the size of the display area;

The second display module is configured to display the target picture in the display area if the size of the target picture and the display area do not match and the degree of overlap between the target picture and the display area is lower than a preset value. A target picture, and display a background image in at least one sub-region of an unfilled area where the target picture is not displayed.
An electronic device including:

processor;

A memory for storing executable instructions of the processor; and

The display is used to present a display area;

Wherein, the processor is configured to execute the method according to any one of claims 1-15 by executing the executable instruction, and display the execution result of the executable instruction in the display area.
The electronic device according to claim 17, further comprising:

The image sensor is used to obtain characteristic information of the frame of the display.
A computer-readable storage medium with a computer program stored thereon, wherein the computer program is executed by a processor to implement the method of any one of claims 1-15.