WO2022179431A1 - 显示模式切换方法、装置、电子设备和介质 - Google Patents

显示模式切换方法、装置、电子设备和介质 Download PDF

Info

Publication number
WO2022179431A1
WO2022179431A1 PCT/CN2022/076664 CN2022076664W WO2022179431A1 WO 2022179431 A1 WO2022179431 A1 WO 2022179431A1 CN 2022076664 W CN2022076664 W CN 2022076664W WO 2022179431 A1 WO2022179431 A1 WO 2022179431A1
Authority
WO
WIPO (PCT)
Prior art keywords
icon
color
area
recognized
electronic device
Prior art date
Application number
PCT/CN2022/076664
Other languages
English (en)
French (fr)
Inventor
苏达
王守诚
陈翔
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2022179431A1 publication Critical patent/WO2022179431A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0483Interaction with page-structured environments, e.g. book metaphor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour

Definitions

  • the present application relates to the technical field of terminal display, and in particular, to a display mode switching method, apparatus, electronic device and medium.
  • the "dark mode” is proposed to meet the deep demand for reading comfort and legibility during use.
  • the graphical user interface in the "dark mode” usually presents a dark (such as black) background and bright colors (such as white) foreground.
  • mainstream operating systems such as the Android (Android) open source operating system, the mobile operating system (iOS) developed by Apple, and the operating system (Windows) developed by Microsoft all provide support for "dark mode”.
  • the purpose of the present application is to provide an electronic device and a display mode switching method and medium thereof.
  • the electronic device can switch the display interface to the dark mode display style according to the switching instruction of the user to switch the display mode of the electronic device to the dark mode, and at the same time, recognize the icon to be displayed in the display interface, and identify the Display icons that do not adapt to the dark mode display style and perform image processing on them, so that the icons to be displayed can match the dark mode display style.
  • a first aspect of the present application provides a display mode switching method, which is applied to an electronic device.
  • the method includes: the electronic device receives a switching instruction from a user to switch the display mode of the electronic device to a dark mode; the electronic device displays a display mode to the electronic device.
  • the to-be-identified icon in the interface is identified to identify the target icon, wherein the target icon is an icon that does not adapt to the dark mode display style; the electronic device performs color processing on the color of the target icon to make the color of the target icon adapt to the dark mode Display style; electronic equipment displays color-processed target icons on the display interface.
  • the icons displayed on the display interface of the electronic device can match the display style of the display interface of the electronic device in the dark mode.
  • the electronic device may be a mobile phone
  • the display interface of the electronic device may be the display interface of the mobile phone
  • the display interface includes: desktop background, weather icon, text content of weather forecast, shopping icon, clock icon, home network icon, etc., wherein the weather icon , shopping icon, clock icon and home network icon are the icons to be displayed.
  • the mobile phone switches the display interface from the normal mode to the dark mode when receiving a switching instruction from the user to switch the display mode of the mobile phone to the dark mode.
  • the desktop background in the display interface can be switched from a bright color (such as white) to a dark color (such as black or dark gray)
  • the text content (such as the weather forecast text content) in the display interface can be switched from a dark color (such as black) to Bright colors (such as white or light gray).
  • the mobile phone identifies the weather icon, shopping icon, and clock icon waiting to be displayed to identify the target icon, where the target icon is an icon that does not fit the dark mode display style.
  • the cart pattern and the white background bottom plate of the rounded rectangle are formed.
  • the shopping icon can be identified as the target icon.
  • the mobile phone After completing the identification process of the target icon, the mobile phone performs color processing on the target icon (such as a shopping icon) so that the color of the target icon is adapted to the dark mode display style. For example, change the color of the shopping icon's white background base plate from white to dark gray, and change the shopping icon's cart pattern from black to light gray.
  • the shopping icon after the above color processing is consistent with the dark mode display style, which avoids the situation where the brightness of some icon areas is too high in the display interface of the mobile phone.
  • the mobile phone displays the color-processed target icon on the display interface, so that the user can obtain a better experience of using the dark mode.
  • the electronic device compares the icon outline of the icon to be recognized, the distribution of transparent pixels, the color distribution, and the color type with the icon outline of the preset target icon, The distribution of the transparent pixels, the color distribution and the color types are compared respectively to determine whether the icon to be recognized is the target icon. It can be understood that the electronic device recognizes whether the icon to be recognized is the target icon by comparing the features of the icon to be recognized with the preset target icon, wherein the comparison features include icon outline, distribution of transparent pixels, color distribution, and For many of the color types, the reasons for selecting the comparison feature will be explained later.
  • the method for determining whether the icon to be recognized is a target icon includes: the icon outline, the distribution of transparent pixels, the color distribution of the icon to be recognized and the preset target icon of the electronic device, and the In the case where multiple of the color categories satisfy the corresponding comparison conditions, the icon to be recognized is determined as the target icon.
  • the electronic device determines that the icon to be recognized is the target icon only when all of the selected comparison conditions are satisfied. If the to-be-recognized icon does not match the preset target icon in any of the selected comparison conditions, it is determined that the to-be-recognized icon is not the target icon and the recognition process is exited, so that the execution speed required by the display mode switching method can be shortened .
  • the method for determining whether the icon to be recognized is a target icon includes: the icon outline of the icon to be recognized and the preset target icon, the distribution of transparent pixels, the color distribution, and the color of the electronic device
  • the comparison results of the types are given weight parameters respectively, and based on the weight parameters, the icon outline, the distribution of transparent pixels, the color distribution, and the value of the comparison results of the color types are weighted and summed; When the value is greater than the first preset threshold, it is determined that the icon to be recognized is the target icon.
  • the electronic device performs a comparison operation on all the selected comparison conditions, and assigns a weight parameter to each comparison result respectively, according to the weighted summation of the value of the comparison result and the weight parameter.
  • the value of determines whether the icon to be recognized is the target icon.
  • the above recognition method can further improve the fineness of the recognition of the target icons, and has a better recognition effect for some target icons with special designs, thereby reducing the recognition omission rate of the target icons.
  • the user can adjust the emphasis in the identification process of the target icon by adjusting the weight parameters of different comparison items, so that the identification of the target icon by the electronic device is more targeted.
  • the target icon is a circular icon or a rounded rectangular icon. It can be understood that, in a display interface of an electronic device, the outer contour of the display icon is often a circle or a rounded rectangle, and such display icons are called circular icons or rounded rectangle icons.
  • the method for comparing the icon outlines of the icon to be recognized and the preset target icon includes: when the icon outline of the icon to be recognized is a circle or a rounded rectangle by the electronic device, It is determined that the icon outline of the icon to be recognized is consistent with the icon outline of the preset target icon. It can be understood that, in the case where the target icon is a circular icon or a rounded rectangle icon, if the icon outline of the icon to be recognized conforms to the geometric characteristics of a circle or a rounded rectangle, it means that the icon outline of the icon to be recognized is the same as the preset target icon. icon outline.
  • the electronic device recognizes the icon to be recognized in the display interface of the electronic device to recognize the target icon, including: the electronic device obtains icon material of the icon to be recognized, wherein the icon to be recognized The material includes the icon to be recognized and the peripheral part located outside the icon to be recognized; according to the distribution of non-transparent pixels in the icon material of the icon to be recognized, the area to be recognized of the icon to be recognized is determined, wherein the icon material of the icon to be recognized includes the icon material to be recognized.
  • the to-be-recognized area includes the to-be-recognized icon.
  • the icon material of the icon to be recognized may be a vector image, and the vector image includes a portion representing the icon to be recognized and a transparent pixel background portion, wherein the icon portion to be recognized is composed of non-transparent pixels and is located on the upper layer of the transparent pixel background portion, and The area of the transparent pixel background portion is larger than the area of the icon portion to be recognized.
  • the comparison object that can be obtained may be the icon material of the icon to be recognized.
  • the electronic device can determine the area to be recognized according to the distribution of non-transparent pixels in the icon material, and the area to be recognized can be in a regular simple geometric shape (such as circle, rectangle, etc.), including the area occupied by all non-transparent pixels and including all
  • the area occupied by the few transparent pixels may be less, and the area occupied by the transparent pixels located in the peripheral part of the icon to be recognized can be eliminated from the icon material.
  • the to-be-identified area may be a circumscribed rectangle of the area occupied by the non-transparent pixels.
  • the method for comparing the distribution of the transparent pixels of the icon to be recognized and the preset target icon includes: the proportion of the area occupied by the transparent pixels in the partial area of the area to be recognized by the electronic device.
  • the ratio is lower than the second preset threshold, it is determined that the distribution of transparent pixels of the icon to be recognized is consistent with the distribution of transparent pixels of the preset target icon, wherein the partial area includes the center point of the area to be recognized. It can be understood that if there is a large area of transparent pixel distribution in the area near the center point of the area to be recognized, when the icon to be recognized is placed on the desktop background for display, the area occupied by these transparent pixels will change with the color of the desktop background.
  • the electronic device can set a plurality of evenly distributed sampling points in a part of the area near the center point of the area to be identified, identify the color of each sampling point to determine the number of sampling points with transparent pixels, and use the The ratio of the number of sampling points with transparent pixels to the total number of sampling points is taken as the proportion of the area occupied by transparent pixels in the partial area near the center point of the area to be identified, thereby further simplifying the steps for obtaining the distribution of transparent pixels of the icon to be identified , which shortens the execution speed required for the display mode switching method.
  • the method for comparing the color distribution of the icon to be recognized and the preset target icon includes: the proportion of the main color area of the electronic device in the area to be recognized is higher than that of the third preset In the case of the threshold value, it is determined that the color distribution of the icon to be recognized is consistent with the color distribution of the preset target icon.
  • the main color area is the area occupied by the color with the highest frequency in the to-be-identified area.
  • the preset target icon may have a solid-color background plate, such a solid-color background plate can set off the icon pattern and be distinguished from the background of the display interface, and occupy most of the entire area of the icon. In the case where the proportion of the main color area of the icon to be recognized is higher than the preset threshold, it means that the icon to be recognized has a solid color background plate, which is consistent with the color distribution of the preset target icon.
  • the electronic device can set a plurality of evenly distributed sampling points in the area to be identified, and by identifying the color of each sampling point, the color that appears the most frequently among the colors of each sampling point is confirmed as the color that appears most frequently,
  • the ratio of the number of sampling points corresponding to the color with the largest number of occurrences to the number of all sampling points is used as the proportion of the main color area in the area to be identified, thereby further simplifying the steps to obtain the color distribution of the icon to be identified and shortening the display mode.
  • the execution speed required for the switching method is used as the proportion of the main color area in the area to be identified, thereby further simplifying the steps to obtain the color distribution of the icon to be identified and shortening the display mode.
  • the method for comparing the color types of the icon to be recognized and the preset target icon includes: the electronic device counts the color types in the area to be recognized, and when the color type is less than a preset number threshold In the case of , it is determined that the color type of the icon to be recognized is consistent with the color type of the preset target icon.
  • the design language of the display icon is often relatively simple, and the color used is relatively simple. For example, a shopping icon composed of a shopping cart pattern and a white background plate uses only white for the white background plate and black for the shopping cart pattern.
  • the color type of the icon to be recognized is smaller than the preset number threshold, it means that the color of the icon to be recognized is relatively single, which is consistent with the color distribution of the preset target icon.
  • icons to be displayed with too many types of colors it is easy to cause the color deviation of the icons to be displayed after color processing because the colors are too complex, resulting in the icon pattern displayed on the display interface of the electronic device and the original design concept of the icon. A large deviation occurs.
  • icons to be displayed with too many types of colors are not suitable for color processing, and the display brightness of the icons to be displayed can be adjusted to adapt to the dark mode display style.
  • the electronic device can set a plurality of evenly distributed sampling points in the area to be identified, and by identifying the color of each sampling point, count the types of colors that exist in the area to be identified, thereby further simplifying the colors in the icon to be identified.
  • the step of acquiring the type is shortened, and the execution speed required for the display mode switching method is shortened.
  • the color information of each pixel in the area to be recognized is collected to obtain the pixel color of each pixel, Perform color clustering on the color of each pixel point, and identify the color of the pixel points that meet the clustering conditions as the same color.
  • the type of color used for the icon to be recognized should be based on the user's human eye perception as the standard, but there may be small differences between the actual pixel colors that cannot be recognized by the human eye, such as the color of two pixels with small differences in brightness.
  • the human eye cannot distinguish these two pixel colors, but the electronic device will recognize them as two different colors, which will lead to treatment There are too many color types when the color types of the recognition area are counted. Therefore, through the color clustering operation, the colors of the pixels that meet the clustering conditions can be identified as the same color, so that the statistics of the color types of the regions to be identified conform to the cognitive habits of the human eye.
  • the clustering conditions include at least one of the following: the saturation difference of the pixel color is less than the saturation threshold; the brightness difference of the pixel color is all less than the brightness threshold; The hue difference of pixel color is less than the hue threshold. It can be understood that the color of pixels identified as the same color after color clustering, the saturation, hue and lightness of these pixel colors are similar, and the electronic device can preset the saturation threshold, hue threshold and lightness threshold. Whether the pixel color belongs to the same color is determined by at least one of the methods. For example, for two pixel colors with slight differences in lightness, when the lightness difference between the two pixel colors is less than a preset lightness threshold, it can be determined that the two pixel colors belong to the same color.
  • the specific process that the electronic device performs color processing on the color of the target icon so that the color of the target icon is adapted to the dark display style includes: the electronic device performs color processing on the color of the target icon when the icon brightness value of the target icon is greater than In the case of a preset brightness threshold, invert the color of the target icon to adapt to the dark mode display style. It can be understood that when the icon brightness value of the target icon is greater than the preset brightness threshold, it means that the overall brightness of the target icon is in a bright state. The light state is adjusted to a darker state to match the dark mode display style.
  • the color inversion processing of the target icon includes: selecting the center value of the inversion between the minimum value and the maximum value of the brightness value, and comparing the brightness value of each pixel in the target icon Taking the inverted center value as the center, the luminance value that is symmetrical with the current luminance value of the pixel is taken as the luminance value of the pixel after color inversion processing. For example, when the minimum and maximum brightness values are set to 0 and 255, respectively, and the flip center value is set to 127.5, after the white pixel (with a brightness value of 255) is inverted, the brightness value changes from 255 to 0.
  • the color of the white pixel changes from white (with a brightness value of 255) to black (with a brightness value of 0).
  • the minimum value and maximum value of the brightness value are set to 0 and 255 respectively, and the flip center value is set to 155
  • the brightness value changes from 255 to 55
  • the color of the white pixel changes from white (with a brightness value of 255) to dark gray (with a brightness value of 55).
  • inversion processing the brightness value of the highlighted background area in the target icon can be reduced to match the dark mode display style.
  • the icon brightness value of the target icon may be a brightness value corresponding to each pixel in the target icon.
  • the icon brightness value of the target icon may also be an average value of the brightness values of each pixel in the target icon. It can be understood that the average value of the brightness value of each pixel in the target icon reflects the overall brightness of the target icon. Further, the electronic device can set a plurality of evenly distributed sampling points in the target icon, and further simplify the process by calculating the average value of the brightness value of each sampling point as the average value of the brightness value of each pixel point in the target icon. The steps for obtaining the icon brightness value of the target icon are shortened, and the execution speed required by the display mode switching method is shortened.
  • the icon brightness value of the target icon may also be the brightness value of the color with the highest frequency in the target icon. It can be understood that the area occupied by the color with the highest frequency in the target icon is the largest area occupied by a single color in the target icon, and the brightness value of the color with the highest frequency in the target icon can reflect the overall brightness of the target icon. .
  • a second aspect of the present application provides an electronic device, including: a memory for storing a processing program; and a processor, which implements the display mode switching method provided in the foregoing first aspect when the processor executes the processing program.
  • a third aspect of the present application provides a computer-readable storage medium, where a processing program is stored on the computer-readable storage medium, and when the processing program is executed by a processor, the display mode switching method provided in the foregoing first aspect is implemented.
  • FIG. 1 shows an example of switching the mobile phone 100 from the normal display mode to the dark display mode in the prior art
  • FIG. 2 shows an example of switching the desktop display interface of the mobile phone 100 from the normal display mode to the dark display mode in the prior art
  • FIG. 3 shows another example in which the desktop display interface of the mobile phone 100 is switched from the normal display mode to the dark display mode in the prior art
  • FIG. 4 shows an example of switching the desktop display interface of the mobile phone 100 from the normal display mode to the dark display mode according to an embodiment of the present application
  • FIG. 5 shows a display mode switching device according to an embodiment of the present application
  • FIG. 6 shows a display mode switching method according to an embodiment of the present application
  • FIG. 7 shows a method for identifying whether an icon material is a target icon according to an embodiment of the present application
  • Fig. 8a shows a special-shaped icon that does not belong to the target icon according to an embodiment of the present application
  • Fig. 8b shows another special-shaped icon that does not belong to the target icon according to an embodiment of the present application
  • FIG. 9 shows a method for determining a to-be-recognized area during an icon material identification process according to an embodiment of the present application
  • FIG. 10 shows an example of a to-be-recognized area in an icon material according to an embodiment of the present application
  • FIG. 11 shows another method for determining the area to be identified during the icon material identification process according to an embodiment of the present application
  • Fig. 12 shows another example of the to-be-recognized area in the icon material according to an embodiment of the present application
  • FIG. 13 shows an identification method for recognizing icon outlines in an icon material identification process according to an embodiment of the present application
  • Fig. 14a shows an example of identifying the outline of an icon according to an embodiment of the present application
  • Fig. 14b shows another example of identifying the outline of an icon according to an embodiment of the present application.
  • FIG. 15 shows another identification method for identifying icon outlines in the icon material identification process according to an embodiment of the present application
  • Fig. 16 shows another example of identifying the outline of an icon according to an embodiment of the present application.
  • Fig. 17a shows an example of identifying the distribution of transparent pixels in the icon material during the icon material identification process according to an embodiment of the present application
  • Figure 17b shows another example of identifying the distribution of transparent pixels in the icon material during the icon material identification process according to an embodiment of the present application
  • FIG. 18 shows a recognition method for recognizing the color distribution in the icon material during the icon material recognition process according to an embodiment of the present application
  • Fig. 19 shows an identification method for identifying color types in an icon material during an icon material identification process according to an embodiment of the present application.
  • FIG. 20 shows an example of identifying color types in icon material according to an embodiment of the present application.
  • Fig. 21 shows another identification method for identifying whether an icon material is a target icon according to an embodiment of the present application
  • FIG. 22 shows a method for performing image processing on a target icon in order to adapt to the overall display style of the dark mode according to an embodiment of the present application
  • FIG. 23 shows another example of switching the desktop display interface of the mobile phone 100 from the normal display mode to the dark display mode according to an embodiment of the present application
  • FIG. 24 shows a schematic structural diagram of an electronic device according to an embodiment of the present application.
  • FIG. 25 shows a software structural block diagram of an electronic device according to an embodiment of the present application.
  • the present application provides a display mode switching solution.
  • the electronic device will identify the icon material to be displayed in advance according to the turning on of the dark mode, determine whether it belongs to the target icon that causes the display style to be split, and target the identified target icon.
  • the icons perform targeted image processing to allow them to match the overall display style of the phone 100 in dark mode.
  • the shopping icon 001 after the display mode switching scheme of the present application is adopted, the shopping icon 001 , the clock icon 002 , the movie icon 003 , the home network icon 004.
  • Both the browser icon 005 and the search icon 006 can make corresponding display adjustments following the conversion of the system "dark mode": the color of the original white background panel area in these rounded rectangular icons is replaced by dark gray, and at the same time The color of the original black icon pattern area has been replaced with light gray.
  • the electronic devices suitable for the technical solutions of the present application may be various electronic devices with dark mode, such as smart phones, tablet computers, laptop computers, wearable devices, head-mounted displays, mobile email devices , portable game consoles, portable music players, reader devices, as well as smart TVs, smart speakers and other smart home devices with touch screens, etc.
  • the following description takes the mobile phone 100 as an example.
  • FIG. 5 shows a schematic structural diagram related to the dark mode display switching management technology in the mobile phone 100 .
  • the mobile phone 100 includes a storage module 501, an identification module 502, an icon processing module 503, an image fusion module 504 and a human-computer interaction module 500, wherein:
  • the human-computer interaction module 500 is used to provide a user with a human-computer interaction interface.
  • the human-computer interaction interface can accept the switching request input by the user and transmit the switching request to the identification module. 501.
  • the switching request includes switching the display mode of the mobile phone 100 from the normal mode (or light/light mode) to the dark mode and switching the display mode of the mobile phone 100 from the dark mode to the normal mode.
  • the human-computer interaction module 500 may include the touch display screen of the mobile phone 100 and its touch sensing system, as shown in FIG. Mode", you can first enter the relevant setting interface, and switch the display mode by clicking the dark mode enable switch shown on the screen of the mobile phone 100.
  • the user's switching request may also be input by pressing a physical button, an air gesture, or a voice command, etc.
  • the corresponding human-computer interaction module 500 may also include physical buttons, front Hardware structures such as cameras, optical scanners, pickup microphones, and their associated input recognition programs are used to support the reception of user switching requests, which will not be repeated here.
  • the storage module 501 is used to store various types of display materials required for the display of the mobile phone 100, wherein the display materials may include icon materials (for example, icons 001 to 007 shown in FIG. 2 to FIG. 4 ), image materials (for example, the mobile phone 100 is on the desktop state), text material (for example, the text content shown in FIG. 1 ), and video material (for example, the boot animation of the mobile phone 100 ).
  • the image fusion module 504 extracts the display material to be displayed from the storage module 501 and performs display fusion processing: for example, as shown in FIG.
  • the display content includes The white desktop background, icons 001 to 007, and the text content corresponding to the icons are all stored independently in the storage module 501, and the image fusion module 504 needs to be fused into a display screen by means of layer stacking, image splicing, etc. and presented by the display screen of the mobile phone 100 .
  • the identification module 502 is used to pre-extract the icon materials to be displayed from the storage module 501 and identify them one by one when the switching request is "switch the display mode of the mobile phone 100 from the normal mode to the dark mode", and determine whether it belongs to the The dark mode is likely to be inconsistent with the display mode of the desktop background and needs targeted image processing (such as the shopping icon 001 in FIG. 3 ), and the identified target icon is sent to the icon processing module 503 .
  • the target icons may include the most common circular icons and rounded rectangular icons in the mobile phone 100 : for example, icons 001 to 006 as shown in FIG. 2 , as rounded rectangular icons, they often have a solid color of bright color (such as white)
  • the background plate is used to highlight the patterns in the icons.
  • these solid-color background plate areas will have a split display effect with the desktop background and other display contents (such as icon 007), resulting in inconsistent display styles.
  • the circular icon as a common icon in the mobile phone GUI will also have the above problem when the mobile phone 100 is switched to the dark mode.
  • the identification module 502 needs to perform targeted identification in advance for such circular icons and rounded rectangular icons, so that the icon processing module 503 can perform targeted processing on these icons.
  • the target icon is not limited to circular icons and rounded rectangular icons, but can also be icons of other shapes, as long as the icon will have a display effect that is separated from the desktop background and other display contents in dark mode, thereby causing The inconsistency of display styles can be identified and dealt with pertinently through this technology.
  • the identification module 103 may be preset with a number of identification specifications for different types of target icons, and each identification specification may also include multiple identification criteria. The determination of the identification criteria and identification criteria will be carried out below. Detailed explanations and instructions.
  • the icon processing module 503 is configured to perform image processing on the received target icon according to the recognition result of the recognition module 502 to adapt to the overall display style of the dark mode, and transmit the image-processed target icon to the image fusion module 504 .
  • the icon processing module 503 can replace the background panel areas of icons 001 to 006 from white to dark gray, and replace the pattern areas of icons 001 to 006 from black to light gray.
  • the processed icons 001 to 006 are adapted to the desktop background in the dark mode, and the icon background panel shown in FIG. 2 or 3 will not be too bright, so that the overall display style of the mobile phone 100 is unified.
  • the image fusion module 504 is configured to extract the display material to be displayed from the storage module 501, and perform display fusion processing together with the received target icon after image processing.
  • the display materials when in the normal mode, on the display screen of the mobile phone 100 , the display materials include a white desktop background, icons 001 to 007 and the text content corresponding to each icon. These display materials are stored in the storage module 501 are stored independently, and need to be merged by the image fusion module 504 by means of layer stacking, image stitching, etc. to form a pair of display images and present them on the display screen of the mobile phone 100 .
  • the display materials when in the dark mode, on the display screen of the mobile phone 100 , the display materials include a black desktop background, icons 001 to 006 obtained after being processed by the icon processing module 503 , and the dark mode icon 007 and the text content corresponding to each icon in the dark mode, wherein the black desktop background, the icon 007 in the dark mode and the text content corresponding to each icon in the dark mode may be pre-stored in the storage module 501,
  • the image fusion module 504 can perform targeted selection and extraction according to the current display mode (dark mode) of the mobile phone 100.
  • FIG. 6 a schematic diagram of a specific process for the user to switch the display mode of the mobile phone 100 from the normal mode to the dark mode is shown in FIG. 6 , which specifically includes:
  • Step S600 Receive a switching request input by a user.
  • the switching request indicates that the user needs to switch the display mode of the mobile phone 100 from the current normal mode to the dark mode, and the reception of the switching request can be implemented by the human-computer interaction module 500 .
  • Step S601 Identify one by one whether there is a target icon that needs targeted image processing in the dark mode in the icon materials to be displayed. If there is, go to step S602; if not, go to step S604.
  • the icon material to be displayed refers to all the icons that need to be displayed on the display screen of the mobile phone 100, and the target icons may include circular icons and rounded rectangular icons, such as icons 001 to 006.
  • the target icons may include circular icons and rounded rectangular icons, such as icons 001 to 006.
  • the identification of this type of target icon can be implemented by the identification module 502, and the specific technical solution for the identification module 502 to identify the target icon will be explained and described below.
  • Step S602 Perform image processing on the target icon to adapt to the overall display style of the dark mode.
  • the target icons such as icon 001 to icon 006, after the above-mentioned targeted image processing, the background plate area is changed from white to dark gray, and the pattern area is replaced from black to light gray.
  • the desktop background in dark mode is adapted, and the icon background panel as shown in Figure 2 or 3 is no longer too bright.
  • the processing of the target icon can be implemented by the icon processing module 503. As shown in FIG. 4, the image processing of the target icon adopts an asymmetric inverse color processing method, and the related specific technical solutions will be explained and described below.
  • Step S603 Extract the display material to be displayed and perform display fusion processing together with the image-processed target icon to obtain a display screen.
  • the display screen presented to the user through the display screen not only includes icons, but also includes text, images, animations, videos and other content.
  • the display material to be displayed here can be other content to be displayed except the target icon, such as the black desktop background of the mobile phone 100 in the dark mode as shown in FIG. It belongs to the above-mentioned display material.
  • the display fusion processing here refers to the , scaling, arrangement, rotation, layer overlay, image stitching and other conventional image processing means, integrate each display material and target icon into a display screen that can be displayed on the display screen of the mobile phone 100, for example, as shown in Figure 4 , it can be to set the processed target icons 001 to 006 in the lower area of the black desktop background in a 3*2 arrangement and place them on the top layer, and at the same time juxtapose "8°C" with the sunny weather icon 007 and its associated text It is set in the upper area of the black desktop background and placed on the top layer, thereby forming the desktop display image of the mobile phone 100 in the dark mode.
  • the above display fusion process can be implemented by the image fusion module 504 .
  • Step S604 Extract the display material to be displayed and perform display fusion processing to acquire a display screen.
  • step S601 if there is no target icon that needs targeted image processing in the traversed icon materials to be displayed, it can directly jump to step S604 to extract all kinds of display content required for the display screen. Perform display fusion processing to generate a display image; this step can also be implemented by the image fusion module 504, which will not be repeated here.
  • the image processing and display image fusion of the icon processing module 503 and the image fusion module 504 for the target icon are based on the previous recognition of the target icon by the recognition module 502, and the smooth display after dark mode switching is also considered.
  • the recognition module 502 can perform fast and accurate recognition on the target icon, that is, the icon recognition method adopted by the recognition module 502 is required to be able to determine the image features of the target icon in a targeted and fast manner.
  • an icon recognition method is provided for the recognition module 502, specifically, a circular icon and a rounded rectangular icon are used as target icons for targeted recognition.
  • the target icon as the recognition object may also be are icons of other shapes, not limited to circular icons and rounded rectangle icons.
  • the icon outline of the icon material, the distribution of transparent pixels, the color distribution, and the color types can be compared with the preset icon outline of the target icon, transparent pixels
  • the distribution, color distribution, and color types are compared respectively to determine whether the icon to be recognized is the target icon that needs color processing in the dark mode.
  • the icon recognition method specifically includes:
  • Step S700 Obtain the icon material to be identified.
  • Step S701 traverse the icon material, obtain the area occupied by the non-transparent pixels in the icon material, and determine a to-be-identified area.
  • the to-be-identified area 1005 or 1205 may be a circumscribed rectangle of the area occupied by the non-transparent pixels.
  • the icon material stored in the mobile phone 100 is usually a vector image in a standard format, and this type of vector image includes a transparent pixel background (that is, the background portion) and the icon foreground (that is, the foreground portion).
  • the four sides of the icon foreground meet the requirements on the length and width of the icon material in the standard format, and the icon foreground is drawn with vector graphics to support infinite scaling. Since the identification feature of the icon material needs to be based on the foreground area of the icon, the area occupied by the transparent pixels as the background part needs to be removed in advance before the specific identification process: You can traverse each pixel in the icon material to obtain the area occupied by the non-transparent pixels.
  • the icon material includes not only rounded rectangular icons as shown in icons 001 to 007, but also special-shaped icons as shown in icon 007 or icon 008b in FIG. 8b, for the special-shaped icons
  • the area to be recognized needs to meet the following conditions at the same time : Include the area occupied by all non-transparent pixels, circumscribe the area occupied by all non-transparent pixels as much as possible (that is, include the area occupied by as few transparent pixels as possible), and have regular simple geometric shapes (such as rectangles, circles, etc.) .
  • the to-be-identified area 1005 or 1205 may be a rectangular area. The specific way of determining the area to be identified will be explained and explained below.
  • Step S702 Determine whether the outer contour of the area occupied by the non-transparent pixels in the area to be recognized is the contour of the target icon.
  • step S703 the outline of the area occupied by the non-transparent pixels is consistent with the outline of the target icon, and then turn to step S703 to further judge whether other features in the area to be recognized meet the requirements of the target image; if not, then explain the area occupied by the non-transparent pixels.
  • the outline of the icon is different from the outline of the target icon, and the icon material does not belong to the target icon, and then goes to step S707.
  • the area occupied by the non-transparent pixels in the area to be recognized represents the icon part in the icon material, and the outer contour of the area occupied by the non-transparent pixels is also the outer contour of the icon part.
  • the outline of the target icon is usually a circle or a rectangle with rounded corners, which has obvious geometric features, so it can be recognized by the outer outline of the area occupied by the non-transparent pixels. Therefore, in some embodiments, the area to be recognized can be determined by judging the area Whether it is a circle or a rectangle with rounded corners to quickly remove the special-shaped icons (such as icon 007) that do not conform to the outer contour characteristics of the target icon, thereby improving the overall speed of icon recognition. The specific steps for judging the outer contour of the area occupied by the non-transparent pixels will be further described below.
  • the outline of the target icon can also be other shapes than circles and rounded rectangles, such as ovals, hexagons, etc., and the way of judging the outline of the area to be recognized is not limited to the following for circles, rounded corners, etc.
  • the outline of the target icon can also be other shapes than circles and rounded rectangles, such as ovals, hexagons, etc.
  • the way of judging the outline of the area to be recognized is not limited to the following for circles, rounded corners, etc.
  • other existing technologies are also applicable to the technical solution of the present application, which is not limited here.
  • Step S703 Determine whether the area occupied by the non-transparent pixels in the central area of the area to be identified satisfies a preset condition.
  • step S704 If yes, it means that the pixel distribution of the to-be-recognized area in the icon material is relatively similar to the pixel distribution of the target icon, and then go to step S704; The pixel distributions of , do not match, and go to step 707 .
  • the white area in the icon 008a represents the area occupied by transparent pixels, and the black area represents the area occupied by non-transparent pixels
  • the area occupied by the transparent pixels can be changed with the change of the desktop background.
  • the icon 008a can maintain the same display style as the desktop background in the dark mode without image processing. , naturally does not belong to the target icon. Therefore, in some embodiments, whether the area occupied by the non-transparent pixels in the central area of the to-be-identified area reaches a certain proportion may be used as an identification judgment criterion. The specific determination of the central area will be further explained below.
  • Step S704 Determine whether the area occupied by the main color part in the area to be recognized reaches a preset proportion.
  • step S705 If yes, it means that the color distribution of the to-be-recognized area in the icon material is relatively similar to the target icon, and turning to step S705; Then go to step 707 .
  • the main color part refers to the coverage area corresponding to the single color with the highest proportion in the area to be recognized; for example, for the target icons shown as icons 001 to 006 in FIG. 4 , such icons remove the pattern.
  • the part also includes a large area of solid-color background boards. These solid-color background boards occupy most of the overall area of the icon. Therefore, a certain proportion of the main color part representing the solid-color background board can be used as an identification criterion.
  • Step S705 Determine whether the color type in the area to be recognized is less than a preset threshold.
  • step 706 If yes, it means that the color type of the area to be recognized in the icon material is relatively similar to the color type of the target icon, and then go to step 706; If the color types do not match, go to step 707 .
  • the design of the icon pattern tends to be more concise and clear, and the colors used are relatively single.
  • the icon patterns are all represented in black, and the icons as a whole use only two colors. Therefore, in some embodiments, the color type of the icon may be smaller than a preset threshold as an identification criterion.
  • the display brightness of the icon material may be adjusted through the view system of the mobile phone 100 to adapt to the dark mode of the mobile phone 100 .
  • Step S706 Determine that the image material belongs to the target icon.
  • Step S707 It is determined that the image material does not belong to the target icon.
  • steps S702 to S705 of the above icon recognition process when a judgment result contrary to the target icon appears in any step, it is judged that the icon material does not belong to the target icon and directly exits the entire recognition process, which can effectively protect the mobile phone 100 overall display fluency.
  • the white area in the icon 008b represents the area occupied by transparent pixels, and the black area represents the area occupied by non-transparent pixels
  • the outer contour of the area occupied by the non-transparent pixels in the icon material 008b does not belong to a circle or a rectangle with rounded corners.
  • the icon recognition process is exited in step S702 , and the subsequent recognition process does not need to be performed, which improves the recognition and determination efficiency of icon materials.
  • the method shown in FIG. 9 may be adopted in the specific implementation of step S701;
  • a schematic diagram of the identification area division the method specifically includes:
  • Step S901 dividing the icon material 1000 into a plurality of blocks 1001 .
  • Step S902 set one or more sampling points 1002 in each block 1001 .
  • Step S903 traversing the icon material 1000 is completed by traversing all the sampling points 1002 to obtain the non-transparent area 1003 .
  • the non-transparent area 1003 is the area occupied by the non-transparent pixels, and the confirmation of the non-transparent area 1003 is based on the sampling result of the sampling point 1002: each sampling point 1002 may include one pixel, or may include multiple If a sampling point 1002 includes at least one non-transparent pixel point, it is considered to be a non-transparent sampling point; as shown in FIG. 10 , the non-transparent area 1003 may be the smallest continuous area including all non-transparent sampling points.
  • Step S904 according to the minimum circumscribed rectangle 1004 of the non-transparent area 1003, obtain the corresponding to-be-identified area 1005 based on the maximum inclusion rule; wherein, according to the maximum inclusion rule, if any part of a block 1001 is in the minimum circumscribed rectangle 1004, then The block 1001 is included in the area to be identified 1005 .
  • each block 1001 instead of traversing each pixel in the icon material 1000 to determine the area occupied by the non-transparent pixels, the block 1001 is used and the sampling points 1002 are set in each block 1001, which can ensure the traversal. Optimize the traversal process and shorten the traversal time on the basis of reliability.
  • each block 1001 can be set as a square of the same size; the number of sampling points 1002 set in each block 1001 can be the same or random, and the distribution state of the sampling points 1002 can be a regular arrangement The cloth may be distributed randomly; each sampling point 1002 may include one pixel point, or may include multiple pixel points, which is not limited herein.
  • the area 1005 to be recognized is confirmed according to the identified non-transparent area 1003: as shown in FIG. They are respectively parallel to the dividing line of the block 1001 ; and then all the blocks 1001 involved in the minimum circumscribed rectangle 304 are divided into the to-be-identified area 1005 .
  • the to-be-recognized area 1005 includes all the non-transparent areas 1003 and the area occupied by as few transparent pixels as possible, and the to-be-recognized area 305 is in the shape of a regular rectangle and is composed of an integer number of blocks 1001 .
  • the confirmation method of 1005 is conducive to the confirmation of the standardization judgment standard in the subsequent identification process.
  • the method shown in FIG. 11 in order to reduce the traversal of the original image and speed up the confirmation process of the area to be recognized, the method shown in FIG. 11 can also be used in the specific implementation of step S701; in combination with the method shown in FIG. 12
  • the schematic diagram of the area to be identified is divided, and the method specifically includes:
  • Steps S1101 to S1102 are the same as the aforementioned steps S901 to S902, and are not repeated here.
  • Step S1103 complete the traversal of the icon material 1200 by traversing all the sampling points 1202 to obtain all the non-transparent sampling points.
  • each sampling point 1202 may include one pixel point, or may include multiple pixel points, and if a sampling point 1202 includes at least one non-transparent pixel point, it is considered to be a non-transparent sampling point
  • step S1104 a block group 1204 containing all non-transparent sampling points is obtained based on the maximum inclusion rule, and the minimum circumscribed rectangle of the block group 1204 is used as the corresponding area to be identified 1205; wherein, according to the maximum inclusion rule, if a block 1201 contains If there is at least one non-transparent sample point, the block 1201 is included in the block group 1204 .
  • the foregoing embodiment there is no need to strictly identify and confirm the opaque area 1203 : based on the foregoing embodiment, if a block 1201 contains opaque sampling points , it will be directly classified into the block group 1204 (shown by the shaded part in FIG. 12 ). Since the block group 1204 is composed of an integer number of blocks 1201 arranged in an orderly manner, based on the minimum circumscribed rectangle of the block group 1204 Also easy to obtain. In this way, the area to be recognized 1205 is also in the shape of a regular rectangle and includes all the non-transparent areas 1203. At the same time, there is no need to identify and obtain the non-transparent area 1203 based on the distribution of the non-transparent sampling points, which further simplifies the processing of the area to be recognized from the computer processing level. acquisition process.
  • the identification method shown in FIG. 13 can be used in the specific implementation of step S702; combined with the identification schematic diagrams shown in FIGS. Specifically include:
  • step S1301 right-angled triangles 1402 are respectively selected from the four vertex areas of the area to be recognized 1400 .
  • step S1302 the block traversed by the hypotenuse of each right triangle 1402 is taken as the sampling block 1403 .
  • step S1303 it is determined whether the sampling colors in each sampling block 1403 are close to each other.
  • the sampling color of the sampling block 1403 is the color that can represent the most important color feature in the sampling block 1403 , it can be the color of the center point in the sampling block 1403 , or it can be random multi-point sampling in the sampling block 1403 Then calculate the average value of RGB color, which is not limited here.
  • Step S1304 determining that the outer contour of the area occupied by the non-transparent pixels in the icon material is a circle or a rounded rectangle.
  • Step S1305 it is determined that the icon material does not belong to the target icon.
  • the area to be recognized 1400 is approximately the circumscribed rectangle of the area 1401 occupied by non-transparent pixels, and on this basis, the judgment and recognition of the outer contour of the icon can be simplified as non-transparent Whether the area 1401 occupied by the pixel conforms to the dominant shape feature of a circular icon or a rounded rectangular icon: As shown in Figures 14a and 14b, the hypotenuse of the right triangle 1402 can be regarded as the apex angle secant 1404 of the area to be identified 1400, If the area 1400 occupied by the non-transparent pixels is a circular icon or a rounded rectangle icon, the area that the oblique secant line 1404 passes through is the solid-color background area of the icon, that is, the color of the block that the oblique secant line 1404 passes through.
  • the recognition content and determination steps performed by the recognition module 502 are greatly simplified.
  • the selection of the oblique secant line 1404 of the vertex angle that is, the selection of the area of the right triangle 1402 has certain restrictions: if the selection of the right triangle 1402 is too small, the hypotenuse of the right triangle 1402 is too small.
  • the corresponding oblique secant line may be located outside the area occupied by the non-transparent pixels, so that the points on the oblique secant line are all transparent pixels; if the selection of the right triangle 502 is too large, the oblique secant line corresponding to its hypotenuse may not only be After passing through the solid-color background plate area, it will also pass through part of the pattern area, resulting in a variety of dissimilar colors appearing on the oblique secant, resulting in misidentification.
  • the selection of the right triangle 1402 is limited to: when the to-be-recognized area 1400 is composed of M*N blocks 501 (M and N are both positive integers), each right triangle 502
  • M and N are both positive integers
  • each right triangle 502 The lengths of the right-angled sides are set as the lengths of L1 and L2 blocks respectively, where L1 belongs to the value interval of [M/3, M/2], and L2 belongs to the value interval of [N/3, N/2] middle.
  • the selection of the right triangle 1402 is related to the size of the area 1400 to be recognized.
  • the length can be selected as the length of 14 blocks 501; for another example, as shown in FIG. 14b, when the area to be identified 1400 includes 4*4 blocks, the side lengths of the right triangle 1402 can be selected as 2 blocks. length.
  • judging whether the sampling colors in each sampling block 1403 are close to each other may be judging whether the color distance between the sampling colors of any two adjacent sampling blocks 1403 is less than a preset threshold, It is also possible to calculate the average value after obtaining the sampling colors of all the sampling blocks 1403, and then compare whether the color distance between each sampled color and the average value is smaller than a preset threshold, which is not limited here; specifically, the color distance can be determined by It is obtained by calculating the Euclidean distance of the two colors to be judged in the RGB space.
  • the identification method as shown in Figure 15 can also be used in the specific implementation of step S702; in conjunction with the identification schematic diagram shown in Figure 16, this method specifically includes:
  • Step S1501 it is judged whether there are transparent pixels in the four corner areas 1603 of the area 1602 to be recognized.
  • step S1502 If yes, it means that the four corner areas 1603 are not completely covered by non-transparent pixels, and go to step S1502; if not, it means that the four corner areas 1603 are completely covered by non-transparent pixels, and go to step S1504.
  • Step S1502 it is determined whether the area occupied by the transparent pixels reaches a predetermined ratio relative to the vertex area 1603 .
  • step S1503 If yes, it means that the transparent areas in the four corner areas 1603 occupy a larger area, and the process goes to step S1503;
  • Step S1503 determining that the outer contour of the area occupied by the non-transparent pixels in the icon material is a circle or a rounded rectangle.
  • Step S1504 it is determined that the icon material does not belong to the target icon.
  • the to-be-identified area 1602 is similar to the circumscribed rectangle of the area 1601 occupied by non-transparent pixels, and on this basis, the judgment and recognition of the outer contour of the icon can be simplified to the area occupied by non-transparent pixels Whether 1601 conforms to the dominant shape feature of a circular icon or a rounded rectangular icon: As shown in Figure 16, if the area 1601 occupied by the non-transparent pixels is a circular icon or a rounded rectangular icon, the top corner area 1603 of the area to be identified 1602 There should be a certain percentage of the area occupied by transparent pixels. By judging whether the area occupied by the transparent pixels reaches a preset proportion relative to the vertex area 1603, instead of acquiring and identifying the outer contour of the icon, the identification content and determination steps performed by the identification module 502 are also greatly simplified. .
  • the vertex area 1603 may be a block corresponding to the four vertexes in the area to be identified 1602 ; the ratio of the area occupied by transparent pixels relative to the vertex area 1603 may be It is obtained by traversing each pixel or sampling point in the vertex area 1603.
  • the proportion of the area occupied by transparent pixels relative to the vertex area 1603 can be the ratio of the number of transparent pixels to the total number of pixels, or it can be The ratio of the number of transparent sampling points to the total number of sampling points.
  • both the identification method shown in FIG. 13 and the identification method shown in FIG. 15 are for identifying whether the area occupied by the non-transparent pixels in the to-be-identified area conforms to the shape features that a circular icon or a rounded rectangular icon should have. , and the judgment criteria of the two identification methods are different; in the specific implementation process of step S702, any one of the identification methods can be selected, or two identification methods can be selected at the same time to carry out identification and judgment in turn, which can further improve the quality of the target icon. recognition accuracy.
  • the specific determination of the central area of the to-be-identified area may refer to FIG. 17a and FIG. The specific embodiment shown in 17b, wherein:
  • the preset proportion can be set to 90% or 95%. %;
  • the 2*2 blocks in the central area can also be judged by sampling points. If 5 random sampling points are set in each block, at least 17 to 19 sampling points are required. Only when the sampling results of the sampling points are non-transparent sampling points can it be determined that the area occupied by the non-transparent pixels in the central area 1701 of the area to be identified reaches the above preset proportion.
  • the area to be identified 1700 when the area to be identified 1700 includes 8*8 blocks, 4*4 blocks close to the center of the area to be identified 1700 can also be selected as the center area 1702, because the center selected at this time
  • the area 1702 has a larger proportion than the entire area to be recognized.
  • the preset proportion can be set to 80% or 85%; in the specific judgment process, the 4*4 blocks in the central area can also be judged by sampling points.
  • the specific steps for identifying the proportion of the main color portion may include:
  • Step S1801 Acquire the color corresponding to the pixel point in each sampling point in the area to be recognized, and store all the colors and the corresponding number of pixels in a color bucket space.
  • Step S1802 Count the color with the largest number of corresponding pixels in the color bucket space and use it as the main color in the area to be recognized.
  • Step S1803 Determine whether the ratio of the number of pixels corresponding to the main color to the total number of sampling pixels reaches a preset threshold.
  • step S1804 If yes, it means that the pixel corresponding to the main color occupies a larger area, and the process goes to step S1804; if not, it means that the pixel corresponding to the main color occupies a small area, and the process goes to step S1805.
  • Step S1804 Determine that the area occupied by the main color part in the area to be recognized reaches a preset proportion.
  • Step S1805 It is determined that the icon material does not belong to the target icon.
  • the main color part in the area to be recognized can be the area corresponding to the color that occurs the most in the area to be recognized: for example, if the number of red pixels in the area to be recognized is N1, the number of pixels of other different colors is The number is N2 and N1 is greater than N2, then the area corresponding to the red pixel is the main color part in the area to be identified.
  • the proportion of the main color part relative to the area to be recognized can be converted into the number of sampling pixels corresponding to the main color relative to The proportion of the total number of sampled pixels. In this way, the proportion of the main color part can be obtained by traversing the sampling points, which simplifies the identification of the area occupied by the main color part and the judgment process of the proportion, thereby further improving the overall efficiency of the target icon identification.
  • the statistical method for the color types in the to-be-identified area specifically includes:
  • Step S1901 Acquire the color corresponding to the pixel point in each sampling point in the area to be recognized, and store all the colors and the corresponding number of pixels in a color bucket space 2001.
  • Step S1902 traverse the color bucket space 2001, and sequentially extract each color therein as a color to be clustered to perform a color clustering operation.
  • color clustering processing needs to be performed in advance before counting the color types in the area to be identified: for example, two pixels that also belong to the black color area, which are in the color
  • the RGB values obtained during the sampling process may be (0, 0, 1) and (0, 2, 3) respectively. It is difficult for the human eye to distinguish these subtle differences, but in the statistics of the color bucket space 2001, these two The colors corresponding to the pixel points are identified as two different colors, which leads to excessive deviation in the statistics of the color types in the area to be recognized. Therefore, it is necessary to perform color clustering on the colors in the color bucket space 2001 for this situation: color clustering refers to aggregating some similar colors and treating them as the same color, such as the two pixels in the above example.
  • the color clustering process After the color clustering process, it can be regarded as the same type of color (black). By introducing the color clustering process, the statistics of the color types in the area to be recognized are more in line with the cognitive laws of the human eye. The specific steps of the color clustering process are shown in the following steps S1903 to S1907.
  • Step S1903 Obtain the hue, saturation and lightness corresponding to the colors to be clustered.
  • the colors in the color bucket space 2001 are often stored in RGB color mode, and when judging whether the colors are similar in the color clustering process, it is often necessary to base on the hue, saturation and lightness of the colors to be clustered. and other intuitive features.
  • the way to obtain the hue, saturation and lightness of the colors to be clustered may be to convert the colors to be clustered in the RGB color mode to the HSV color mode through the HSV space 2002, wherein the HSV space 2002 is based on the color
  • the HSV space 2002 is based on the color
  • the HSV space 2002 is based on the color
  • the HSV space constructed by intuitive features, its model is in the shape of an inverted cone, and the parameters used to represent colors are hue (H), saturation (S), and lightness (V).
  • the conversion formulas of colors in the RGB mode and the HSV mode belong to the common knowledge of those skilled in the art, and will not be repeated here.
  • Step S1904 Determine whether the saturation of the color to be clustered belongs to a low saturation range. If yes, it means that the saturation of the color to be clustered is low, and the process goes to step S1905; if not, it means that the saturation of the color to be clustered is high, and the process goes to step S1906.
  • Step S1905 Put the colors to be clustered into a redundant space 2003, and then return to step S1902.
  • the low saturation interval may be:
  • s is the saturation of the color to be clustered
  • v is the brightness of the color to be clustered
  • is a preset value and the preset value ⁇ is less than the maximum value of the saturation s; when the above formula is satisfied, it means that the color to be clustered
  • the saturation of the class color belongs to the low-saturation range. It can be understood that the low-saturation interval may be a dynamic interval, and the low-saturation color that needs to be eliminated can be adjusted by adjusting the preset value ⁇ .
  • Step S1906 Determine whether there is a cluster color similar to the color to be clustered in the clustering space 2004: if so, go to step S1907; if not, go to step S1908.
  • the clustering space 2004 is used to store the clustering colors that have completed the clustering at the current moment, and stores the RGB values of the clustering colors at the current moment and the number of pixels corresponding to the clustering colors; The existence of a cluster color similar to the color to be clustered will be described in detail below.
  • Step S1907 Perform cluster update according to the color to be clustered and the similar cluster color, and place the updated cluster color obtained after the cluster update into the cluster space 2004, and then turn to step S1909.
  • the specific steps related to cluster update will be described below.
  • Step S1908 directly put the color to be clustered into the clustering space 2004, and then turn to step S1909.
  • Step S1909 Determine whether all the colors in the color bucket space 2001 have undergone the processes from steps S1903 to S1907 above.
  • step S1910 If yes, it means that all the colors in the color bucket space 2001 have undergone the above-mentioned color clustering processing, and go to step S1910;
  • Step S1910 Obtain the number of cluster colors in the cluster space 2004, where the number of cluster colors is the number of color types in the area to be identified.
  • a cluster update needs to be performed according to the color to be clustered and the similar cluster color: for example, the color to be clustered A and The existing cluster colors B in the cluster space 2004 are similar and belong to the same type of color.
  • the color A to be clustered cannot be directly attributed to the cluster color B and the number of pixels corresponding to the color A to be clustered can be directly merged into In the clustering color B, this is because color clustering needs to aggregate some similar colors and treat them as the same type of color.
  • judging whether there is a cluster color similar to the color to be clustered in the cluster space 2004 can be determined by:
  • ⁇ h is the absolute value of the hue difference between the color to be clustered and the clustering color
  • ⁇ s is the absolute value of the saturation difference between the color to be clustered and the clustered color
  • ⁇ v is the difference between the color to be clustered and the clustered color.
  • the absolute value of the lightness difference, k1 and k2 are both preset values. It can be understood that if the difference in hue, difference in saturation and difference in lightness of the two colors are all small, it means that the two colors are similar and belong to the same color category; similarly, the preset values k1 and k2 can be adjusted to make the difference. Adjust the judgment criteria for similar colors.
  • cluster update can be implemented in the following ways:
  • y is the RGB value of the color to be clustered
  • c is the RGB value of the clustered color
  • a is the RGB value of the updated cluster color after the clustering is updated
  • Ny is the number of pixels corresponding to the color to be clustered
  • Nc is the clustered color. The number of pixels corresponding to the class color
  • Na is the number of pixels to update the cluster color after the cluster is updated.
  • the identification module 503 can realize the targeted identification of the circular icon and the rounded rectangular icon as the target icon according to the icon identification method in the aforementioned steps S700 to S705.
  • another icon identification method is provided for the identification module 502, as shown in FIG. 21, which specifically includes:
  • Steps S2100 to S2101 are the same as the aforementioned steps S700 to S701, and will not be repeated here.
  • Step S2102 Determine whether the outer contour of the area occupied by the non-transparent pixels in the area to be recognized is the contour of the target icon, and record the corresponding first judgment result.
  • the first judgment result includes two cases of "Yes” and "No".
  • Step S2103 Determine whether the area occupied by the non-transparent pixels in the central area of the area to be identified reaches a preset proportion, and record the corresponding second determination result. Similarly, the second judgment result also includes two cases of "Yes” and "No".
  • Step S2104 Determine whether the area occupied by the main color part in the area to be recognized reaches a preset proportion, and record the corresponding third determination result. Similarly, the second judgment result also includes two cases of "Yes” and "No".
  • Step S2105 Determine whether the color type in the area to be recognized is smaller than a preset threshold, and record the corresponding fourth determination result. Similarly, the second judgment result also includes two cases of "Yes” and "No".
  • Step S2106 Calculate a recognition score according to the first judgment result to the fourth judgment result: if the recognition score is greater than or equal to a preset threshold, it is determined that the icon material belongs to the target icon; if the recognition score is less than the preset threshold, it is determined that the icon The material does not belong to the target icon and exits.
  • the steps for obtaining the recognition score will be described in detail below.
  • step S2106 The specific acquisition of the recognition score in step S2106 will be further explained and explained below in conjunction with FIG. 21 :
  • the recognition score is obtained based on the first judgment result to the fourth judgment result: when any judgment result is "Yes", it can be recorded as 1 point; when any judgment result is "No” , it can be recorded as 0; the recognition score is the sum of the scores from the first judgment result to the fourth judgment result. For example, for the icon 010 shown in FIG. 21 (the white area in FIG.
  • the recognition score can be obtained as 3 points; If the preset threshold is 3 points, it can be determined that the icon 010 belongs to the target icon.
  • the icon 010 is a rounded rectangular icon, but it has a special design with a hollow center. Therefore, it is easy to be missed and misjudged as not belonging to the target icon according to the icon recognition method shown in steps S700 to S705.
  • the icon recognition method shown in steps S2100 to S2106 can be used to successfully recognize it.
  • the icon recognition method shown in steps S2100 to S2106 relaxes some of the judgment criteria for target icon recognition, and at the same time facilitates the system operation and maintenance personnel to flexibly adjust the icon recognition standards.
  • the recognition standard can be tightened by appropriately increasing the preset threshold corresponding to the recognition score, without adjusting each judgment process in the recognition method one by one.
  • different weight values may be added to the first judgment result to the fourth judgment result during the calculation process of the recognition score.
  • the icon 010 shown in FIG. 21 is also identified, and the weighting parameter of the first judgment result is set to 30%, the weighting parameter of the second judgment result is 10%, the weighting parameter of the third judgment result is 20%, and the weighting parameter of the third judgment result is 20%.
  • the recognition score can be calculated to be 0.9; if the preset threshold is set to be 0.8, it can also be judged that the icon 010 belongs to the target icon. Adding different weight values to the first judgment result to the fourth judgment result can increase the emphasis in the identification process, making the identification more pertinent.
  • the recognition module 502 can realize effective, fast and accurate recognition of target icons including circular icons and rounded rectangular icons.
  • the target icons obtained by the identification module 502 need to be processed by the image fusion module 504 before they can match the dark display mode of the mobile phone 100 .
  • an image processing method is provided for the image processing module 503, which can make the target icon match the dark display mode of the mobile phone 100, which specifically includes:
  • Step S2201 Determine whether the brightness of the target icon is greater than a preset threshold.
  • step S2202 If yes, it means that the brightness of the target icon is high, which is inconsistent with the overall display effect of the mobile phone 100 in the dark mode, and the process goes to step S2202; The overall display effect of the lower part is unified, and the process goes to step S2203.
  • Step S2202 Perform color inversion processing on each pixel in the target image based on the asymmetric color inversion rule, and then output the target icon.
  • the specific explanation of the asymmetric inverse color rule will be described below.
  • Step S2203 Directly output the target icon.
  • the brightness of the target icon needs to be pre-determined once before the subsequent image processing steps are performed. It can be understood that when the mobile phone 100 is in the dark mode, it has a darker overall visual sense compared to the normal mode; in this case, if the brightness of the target icon is lower than a preset threshold, it means that even without subsequent follow-up In the image processing step, the target icon still has a relatively uniform display effect in the dark display environment of the dark mode of the mobile phone 100, and can be directly displayed.
  • the icon brightness value of the target icon may be a brightness value corresponding to each pixel in the target icon.
  • the brightness of the target icon may be the average brightness value of each pixel in the target icon, or may be the brightness value corresponding to the color with the largest number of pixels in the target icon.
  • the target icon has undergone rapid clustering statistics of color types in the aforementioned icon recognition process
  • the statistical results in the icon recognition process can be directly called to obtain the color corresponding to the color with the largest number of pixels in the target icon.
  • the brightness value is used as the brightness of the target icon to participate in the determination, which can further improve the fluency of the display mode switching process.
  • step S2202 the target icon is processed directly using the conventional color inversion rule.
  • performing color inversion processing based on conventional color inversion rules refers to an image processing method of inverting each pixel in a color image, where inversion refers to subtracting the RGB value of the current color from the RGB value of white. The color corresponding to the resulting RGB value. For example, in inversion processing, black with RGB value (0, 0, 0) is converted to white with RGB value (255, 255, 255).
  • the rendering effect in the mobile phone 100 after the target pattern is processed using the conventional inverse color rule is shown in Figure 23: it can be seen that the white background plates of the icons 001 to 006 are directly converted into black and are consistent with the background color , and the black icon pattern areas in icons 001 to 006 are converted to highlighted white.
  • the target icon is processed by normal inversion rules.
  • the overall display style of the mobile phone 100 is consistent, the boundaries between the icons 001 and 006 become difficult to identify, and the bright white color presented in the icon pattern area will also make the user's human eye experience more dazzling. There is room to further improve the user experience.
  • the asymmetric inverse color rule is used to process the target icon.
  • the asymmetric inverse color rule refers to that for each pixel in the color image, the brightness is flipped based on a preset brightness as the flip center, and the preset brightness needs to be deviated from the center value of the complete brightness range. For example, if the complete brightness interval is set to [0, 100], the brightness value of the preset brightness can be any brightness value except 50; if the preset brightness value ⁇ is set to 45, and the brightness value ⁇ of the current pixel point is 60, then the The luminance value ⁇ of the pixel point after the asymmetric inversion processing is
  • the rendering effect in the mobile phone 100 after the target pattern is processed by the asymmetric inverse color rule is shown in FIG. 4 : it can be seen that the background area of the icons 001 to 006 is The area is replaced from black to light gray, which not only fits well with the desktop background in dark mode, but also ensures the recognizability of the icons, while avoiding the appearance of highlighted colors, greatly optimizing the display look and feel of the mobile phone 100 experience.
  • the luminance value of a pixel point cannot be directly obtained in the RGB space.
  • the pixel point can be converted from the RGB space to the YUV space (luminance-chrominance space) in advance, and then performed.
  • Brightness transformation Those skilled in the art know that there is a conversion coefficient matrix between the RGB space and the YUV space, so the asymmetric inverse color transformation can also be expressed in the form of a conversion coefficient matrix, and the conversion coefficient matrix depends on the determination of the brightness flip center value.
  • the asymmetric inverse color transformation for the target icon can be embodied as:
  • R, G, and B are the RGB values of the target icon before conversion, respectively, and R', G', and B' are the RGB values of the target icon after the asymmetric inverse color conversion.
  • the center value of brightness flip in the asymmetric inverse color rule can also be transformed and adjusted according to the requirements of the dark mode: when the mobile phone 100 turns on the dark mode, the color of the desktop background is not limited to Pure black, in some embodiments of the present application, the desktop background color of the mobile phone 100 can also be dark gray or dark blue when the dark mode is turned on.
  • the asymmetric inverse color rule can be adaptively corrected by adjusting the center value of the brightness flip.
  • FIG. 24 shows a schematic structural diagram of an electronic device (such as the above-mentioned mobile phone 100 ).
  • the electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, Mobile communication module 150, wireless communication module 160, audio module 160, speaker 160A, receiver 160B, microphone 160C, headphone jack 160D, sensor module 170, buttons 190, motor 191, indicator 192, camera 193, display screen 194, and user Identity module (subscriber identification module, SIM) card interface 195 and so on.
  • a processor 110 an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, Mobile communication module 150, wireless communication module 160, audio module 160, speaker 160A, receiver 160B, microphone 160C, headphone jack 160D, sensor module 170, buttons 190, motor 191, indicator 192, camera 193, display screen 194, and user Identity
  • the sensor module 170 may include a pressure sensor 170A, a gyroscope sensor 170B, an air pressure sensor 170C, a magnetic sensor 170D, an acceleration sensor 170E, a distance sensor 170F, a proximity light sensor 170G, a fingerprint sensor 170H, a temperature sensor 170J, a touch sensor 170K, and ambient light.
  • the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the electronic device.
  • the electronic device may include more or less components than shown, or combine some components, or separate some components, or arrange different components.
  • the illustrated components may be implemented in hardware, software, or a combination of software and hardware.
  • the processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (neural-network processing unit, NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processor
  • ISP image signal processor
  • controller video codec
  • digital signal processor digital signal processor
  • baseband processor baseband processor
  • neural-network processing unit neural-network processing unit
  • the controller 110 can generate an operation control signal according to the instruction operation code and the timing signal, and complete the control of fetching and executing the instruction.
  • a memory may also be provided in the processor 110 for storing instructions and data.
  • the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be called directly from memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby increasing the efficiency of the system.
  • the processor 110 may store instructions for executing the display mode switching method, such as an instruction to obtain the first display mode of the operating system, an instruction to switch the second display mode of an application being displayed on the screen to a dark mode, and an instruction to determine The instruction for whether the icon material has the target icon and the instruction for performing asymmetric inverse color rendering on the icon material with the target icon.
  • the interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration, and does not constitute a structural limitation of the electronic device.
  • the electronic device may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.
  • the wireless communication function of the electronic device can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, the baseband processor, and the like.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in an electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • the antenna 1 can be multiplexed as a diversity antenna of the wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
  • the mobile communication module 150 can provide a wireless communication solution including 2G/3G/4G/5G etc. applied on the electronic device.
  • the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA) and the like.
  • the mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation.
  • the mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and then turn it into an electromagnetic wave for radiation through the antenna 1 .
  • at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110 .
  • At least part of the functional modules of the mobile communication module 150 may be provided in the same device as at least part of the modules of the processor 110 .
  • the mobile phone 100 may report error information or warning information that occurs during the display mode switching process to the remote server.
  • the wireless communication module 160 can provide applications on electronic devices including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • WLAN wireless local area networks
  • BT wireless fidelity
  • GNSS global navigation satellite system
  • frequency modulation frequency modulation
  • FM near field communication technology
  • NFC near field communication technology
  • IR infrared technology
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 .
  • the wireless communication module 160 can also receive the signal to be sent from the processor 110 , perform frequency modulation on it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2 .
  • the mobile phone 100 can report the error information or warning information of the display mode switching process to the remote server.
  • the electronic device realizes the display function through the GPU, the display screen 194, and the application processor.
  • the GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • the processor 110 may include one or more GPUs, which execute program instructions to generate or change display information, for example, when the first display mode of the operating system of the mobile phone 100 is the dark mode, the application program being displayed on the screen is displayed in the dark mode. The second display mode is switched to the dark mode.
  • Internal memory 121 may be used to store computer executable program code, which includes instructions.
  • the internal memory 121 may include a storage program area and a storage data area.
  • the storage program area can store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), and the like.
  • the storage data area can store data (such as audio data, phone book, etc.) created during the use of the electronic device.
  • the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like.
  • the processor 110 executes various functional applications and data processing of the electronic device by executing the instructions stored in the internal memory 121 and/or the instructions stored in the memory provided in the processor.
  • the keys 190 include a power-on key, a volume key, and the like. Keys 190 may be mechanical keys. It may also be a touch key, such as a key of a virtual keyboard of the first input method displayed by the electronic device.
  • the electronic device may receive key input and generate key signal input related to user settings and function control of the electronic device.
  • the software system of the electronic device may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.
  • the embodiments of the present invention take an Android system with a layered architecture as an example to illustrate the software structure of an electronic device.
  • FIG. 17 is a block diagram of a software structure of an electronic device in some embodiments of the present application.
  • the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate with each other through software interfaces.
  • the Android system applied to the electronic device can be divided into four layers, which are, from top to bottom, an application layer, an application framework layer, an Android runtime (Android runtime) and a system library, and a kernel layer. .
  • the application layer can include a series of application packages.
  • the application package can include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and so on.
  • the application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
  • the application framework layer includes some predefined functions.
  • the application framework layer may include window managers, content providers, view systems, telephony managers, resource managers, notification managers, and the like.
  • a window manager is used to manage window programs.
  • the window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, take screenshots, etc.
  • Content providers are used to store and retrieve data and make these data accessible to applications.
  • Data can include videos, images, audio, calls made and received, browsing history and bookmarks, phone book, etc.
  • the view system may be a display system of the electronic device, which can manage and modify the display style of the application to be displayed by the electronic device.
  • the view system can acquire the display function corresponding to the dark mode according to the display style parameter included in the display parameter stored by the dotted line of the electronic device.
  • the phone manager is used to provide communication functions to the electronic device. For example, the management of call status (including connecting, hanging up, etc.).
  • the resource manager provides various resources for the application, such as localization strings, icons, pictures, layout files, video files and so on.
  • the resource manager may also be used to store the Overlay configuration file.
  • the notification manager enables applications to display notification information in the status bar, which can be used to convey notification-type messages, and can disappear automatically after a brief pause without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc.
  • the notification manager can also display notifications in the status bar at the top of the system in the form of graphs or scroll bar text, such as notifications of applications running in the background, and notifications on the screen in the form of dialog windows. For example, text information is prompted in the status bar, a prompt sound is issued, the electronic device vibrates, and the indicator light flashes.
  • Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.
  • the core library consists of two parts: one is the function functions that the java language needs to call, and the other is the core library of Android.
  • the application layer and the application framework layer run in virtual machines.
  • the virtual machine executes the java files of the application layer and the application framework layer as binary files.
  • the virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, safety and exception management, and garbage collection.
  • a system library can include multiple functional modules. For example: surface manager (surface manager), media library (Media Libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.
  • surface manager surface manager
  • media library Media Libraries
  • 3D graphics processing library eg: OpenGL ES
  • 2D graphics engine eg: SGL
  • the Surface Manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of a variety of commonly used audio and video formats, as well as still image files.
  • the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
  • 2D graphics engine is a drawing engine for 2D drawing.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer contains at least display drivers, camera drivers, audio drivers, and sensor drivers.
  • the touch operation is a single-click operation
  • the control corresponding to the click operation is the control that invokes the dark mode in the mobile phone 100 as an example
  • the mobile phone 100 invokes the interface of the application framework layer, and starts the dark mode switching program (ie the dark mode). Start the application), and then display the display material corresponding to the dark mode by calling the display driver.
  • the disclosed apparatus and method may be implemented in other manners.
  • the apparatus embodiments described above are only illustrative.
  • the division of modules or units is only a logical function division. In actual implementation, there may be other division methods.
  • multiple units or components may be combined or May be integrated into another device, or some features may be omitted, or not implemented.
  • the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.
  • Units described as separate components may or may not be physically separated, and components shown as units may be one physical unit or multiple physical units, that is, may be located in one place, or may be distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.
  • each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.
  • the above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.
  • the integrated unit if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a readable storage medium.
  • a readable storage medium including several instructions to make a device (which may be a single chip microcomputer, a chip, etc.) or a processor (processor) to execute all or part of the steps of the methods in the various embodiments of the present application.
  • the aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (random access memory, RAM), magnetic disk or optical disk and other media that can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请涉及一种显示模式切换方法、装置、电子设备和介质。其中显示模式切换方法包括:电子设备在接收到用户将电子设备的显示模式切换至深色模式的切换指令的情况下,对电子设备显示界面中的待识别图标进行识别,并对识别出目标图标的颜色进行颜色处理后在显示界面上进行显示,以使得目标图标的颜色适配深色模式显示风格。其中目标图标为不适配深色模式显示风格的图标。通过本申请的方法可以使得电子设备显示界面中的显示图标与电子设备的深色模式显示风格保持一致,解决了电子设备在深色模式开启过程中存在部分图标显示风格不协调的问题。

Description

显示模式切换方法、装置、电子设备和介质
本申请要求于2021年02月24日提交中国专利局、申请号为202110209962.8、申请名称为“显示模式切换方法、装置、电子设备和介质”中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及终端显示技术领域,尤其涉及一种显示模式切换方法、装置、电子设备和介质。
背景技术
随着科学技术的发展,电子设备的使用越来越广泛,功能设置也越来越贴近人们的使用需求。“深色模式”的提出即是为了满足使用过程中对于阅读舒适性和易读性的深层需求,在“深色模式”下的图形用户界面通常呈现深色(如黑色)背景和亮色(如白色)前景。目前主流的操作系统如安卓(Android)开源操作系统、苹果公司开发的移动操作系统(iOS)和微软公司开发的操作系统(Windows)均提供对“深色模式”的支持。
如图1所示,当用户需要在手机100上选择“深色模式”时,可以进入相关的设置界面,并通过点击手机100屏幕中所示的深色模式开启开关进行显示模式切换:可以看到在“深色模式”的开启状态下,通过内部主题资源的切换,将显示背景采用深色(如黑色)进行替换同时将文字前景采用亮色(如白色)进行呈现;但当显示界面切换至主界面时,如图2所示,可以发现由于缺乏相应的适配主体资源,导致图标001至图标006在显示时仍维持着非深色模式下原有的显示形式,造成整体显示风格的割裂;又如图3所示,即使部分系统自带的应用程序和第三方应用程序通过预设资源进行适配,如时钟图标002、浏览器图标005和搜索图标006,其跟随系统“深色模式”的转换在显示上进行了反色处理以匹配整个显示环境,但仍存在不支持适配的第三方应用程序影响用户使用体验的情况,如购物图标001、电影图标003和家庭网络图标004等。因此可以看到,在手机100等电子设备上进行“深色模式”切换时,存在部分图标显示风格与背景不相统一的问题。
发明内容
本申请的目的在于提供一种电子设备及其显示模式切换方法及介质。通过本申请的方法,电子设备能够根据用户将电子设备的显示模式切换至深色模式的切换指令将显示界面切换至深色模式显示风格,同时对显示界面中的待显示图标进行识别,识别出不适配深色模式显示风格的显示图标并对其进行图像处理,使得待显示图标均能与深色模式显示风格相匹配。
本申请的第一方面提供了一种显示模式切换方法,应用于电子设备,该方法包括:电子设备接收到用户将电子设备的显示模式切换至深色模式的切换指令;电子设备对电子设备显 示界面中的待识别图标进行识别以识别出目标图标,其中目标图标为不适配深色模式显示风格的图标;电子设备对目标图标的颜色进行颜色处理以使得目标图标的颜色适配深色模式显示风格;电子设备在显示界面上显示经过颜色处理的目标图标。
即在本申请的实施例中,电子设备显示界面上的显示的图标,能够与深色模式下电子设备显示界面的显示风格相匹配。
例如,电子设备可以是手机,电子设备显示界面可以是手机的显示界面,该显示界面中包括:桌面背景、天气图标、天气预报文字内容、购物图标、时钟图标、家庭网络图标等,其中天气图标、购物图标、时钟图标和家庭网络图标即为待显示图标。
手机在接收到用户将手机的显示模式切换至深色模式的切换指令的情况下,将显示界面从常规模式切换至深色模式。其中,显示界面中的桌面背景可以从亮色(如白色)切换至深色(如黑色或深灰色),显示界面中的文字内容(例如天气预报文字内容)可以从深色(如黑色)切换至亮色(如白色或浅灰色)。同时,手机对天气图标、购物图标、时钟图标等待显示图标进行识别以识别出目标图标,其中目标图标为不适配深色模式显示风格的图标,例如,购物图标作为圆角矩形图标,由购物车图案和圆角矩形的白色背景底板构成,在手机的显示模式切换至深色模式的情况下,购物图标的白色背景底板与深色(如黑色或深灰色)的桌面背景存在巨大的亮度反差,进而导致购物图标与深色模式下手机显示界面的整体显示风格不相符合,影响用户的观看和使用体验,在此情况下可以将购物图标识别为目标图标。
完成对目标图标的识别过程后,手机对目标图标(如购物图标)进行颜色处理以使得目标图标的颜色适配深色模式显示风格。例如,将购物图标的白色背景底板的颜色从白色修改为深灰色,并将购物图标的购物车图案从黑色修改为浅灰色。经过上述颜色处理后的购物图标与深色模式显示风格相一致,避免了手机的显示界面中出现部分图标区域亮度过高的情况。手机将颜色处理后的目标图标在显示界面上进行显示,可以使得用户获得更好的深色模式使用体验。
在上述第一方面的一种可能的实现中,电子设备通过将待识别图标的图标轮廓、透明像素的分布情况、色彩分布情况以及色彩种类中的多项,与预设目标图标的图标轮廓、透明像素的分布情况、色彩分布情况以及色彩种类中的多项分别进行比对,确定待识别图标是否为目标图标。可以理解,电子设备通过将待识别图标与预设目标图标进行特征比对的方式对待识别图标是否为目标图标进行识别,其中比对特征包括了图标轮廓、透明像素的分布情况、色彩分布情况以及色彩种类中的多项,有关比对特征的选取原因将在后文中进行说明。
在上述第一方面的一种可能的实现中,确定待识别图标是否为目标图标的方法包括:电子设备在待识别图标和预设目标图标的图标轮廓、透明像素的分布情况、色彩分布情况以及色彩种类中的多个满足对应的比对条件的情况下,确定待识别图标为目标图标。
即在本申请的实施例中,电子设备在选择的多个比对条件全部满足的情况下,才确定待识别图标为目标图标。若待识别图标在任意一项选择的比对条件中,与预设目标图标不相符合,则确定待识别图标不为目标图标并退出识别流程,从而能够缩短显示模式切换方法所需的执行速度。
在上述第一方面的一种可能的实现中,确定待识别图标是否为目标图标的方法包括:电子设备对待识别图标和预设目标图标的图标轮廓、透明像素的分布情况、色彩分布情况以及 色彩种类的比对结果分别赋予权重参数,并基于权重参数,对图标轮廓、透明像素的分布情况、色彩分布情况以及色彩种类的比对结果的值进行加权求和;电子设备在加权求和的值大于第一预设阈值的情况下,确定待识别图标为目标图标。
即在本申请的实施例中,电子设备对选择的多个比对条件全部执行比对操作,并对每个比对结果分别赋予权重参数,根据比对结果的值和权重参数的加权求和的值确定待识别图标是否为目标图标。采用上述识别方法能够进一步提升对目标图标识别的精细程度,针对部分具有特殊设计的目标图标具有更好的识别效果,从而降低目标图标的识别遗漏率。同时,用户可以通过对不同的比对项目的权重参数的调整来调整目标图标识别过程中的侧重,使得电子设备对目标图标的识别更加具有针对性。
在上述第一方面的一种可能的实现中,目标图标为圆形图标或者圆角矩形图标。可以理解,在电子设备的显示界面中,显示图标的外轮廓往往呈圆形或圆角矩形,这类显示图标被称为圆形图标或圆角矩形图标。
在上述第一方面的一种可能的实现中,对待识别图标和预设目标图标的图标轮廓的比对方法包括:电子设备在待识别图标的图标轮廓为圆形或圆角矩形的情况下,确定待识别图标的图标轮廓与预设目标图标的图标轮廓相符合。可以理解,在目标图标为圆形图标或者圆角矩形图标的情况下,若待识别图标的图标轮廓符合圆形或圆角矩形的几何特征,则说明待识别图标的图标轮廓与预设目标图标的图标轮廓相符合。
在上述第一方面的一种可能的实现中,电子设备对电子设备显示界面中的待识别图标进行识别以识别出目标图标,包括:电子设备获取待识别图标的图标素材,其中待识别的图标素材包括待识别图标和位于待识别图标外部的外围部分;根据待识别图标的图标素材中非透明像素的分布情况,确定出待识别图标的待识别区域,其中待识别图标的图标素材包括待识别区域,待识别区域包括待识别图标。
可以理解,待识别图标的图标素材可以是矢量图像,该矢量图像中包括代表待识别图标部分以及透明像素背景部分,其中待识别图标部分由非透明像素组成,处于透明像素背景部分的上层,且透明像素背景部分的面积大于待识别图标部分的面积。当电子设备对待识别图标进行识别的过程中,能够获取的比对对象可以是待识别图标的图标素材,考虑到待识别图标与预设目标图标的比对特征均存在于待识别图标部分,因此电子设备可以根据图标素材中非透明像素的分布情况确定出待识别区域,待识别区域可以呈规则的简单几何形状(如圆形、矩形等),包含全部的非透明像素所占区域并包含尽可能少的透明像素所占区域,进而能够从图标素材中剔除位于待识别图标外围部分的透明像素所占区域。例如,待识别区域可以是非透明像素所占区域的外接矩形。
在上述第一方面的一种可能的实现中,对待识别图标和预设目标图标的透明像素的分布情况的比对方法包括:电子设备在待识别区域的部分区域中透明像素所占区域的占比低于第二预设阈值的情况下,确定待识别图标的透明像素分布情况与预设目标图标的透明像素分布情况相符合,其中,部分区域包括待识别区域的中心点。可以理解,如果待识别区域的中心点附近的区域存在大面积的透明像素分布,当待识别图标置于桌面背景上进行显示时,这些透明像素所占区域会随桌面背景的颜色改变而改变,从而实现自动适配深色模式显示风格,也就无需作为目标图标进行后续颜色处理。在待识别图标的中心点附近的部分区域中透明像 素所占区域的占比低于预设阈值的情况下,说明待识别图标中的大部分区域无法跟随桌面背景进行颜色改变,需要进行后续颜色处理以适配深色模式显示风格。
进一步的,电子设备可以在待识别区域的中心点附近的部分区域中,设置多个均匀分布的采样点,通过识别每个采样点的颜色,以确定存在透明像素的采样点的数量,并将存在透明像素的采样点数量与全部采样点数量的比值作为待识别区域的中心点附近的部分区域中透明像素所占区域的占比,从而进一步简化了对待识别图标的透明像素分布情况的获取步骤,缩短了显示模式切换方法所需的执行速度。
在上述第一方面的一种可能的实现中,对待识别图标和预设目标图标的色彩分布情况的比对方法包括:电子设备在待识别区域中主色区域的占比高于第三预设阈值的情况下,确定待识别图标的色彩分布情况与预设目标图标的色彩分布情况相符合。其中,主色区域为待识别区域中出现频率最高的颜色所占的区域。可以理解,预设目标图标可以具有纯色背景板,这类纯色背景板能够衬托图标图案并与显示界面的背景形成区分,且占据了图标整体的绝大部分面积。在待识别图标的主色区域的占比高于预设阈值的情况下,说明待识别图标具备纯色背景板,与预设目标图标的色彩分布情况相符合。
进一步的,电子设备可以在待识别区域中设置多个均匀分布的采样点,通过识别每个采样点的颜色,将每个采样点的颜色中出现次数最多的颜色确认为出现频率最高的颜色,并将出现次数最多的颜色对应的采样点数量与全部采样点数量的比值作为待识别区域中主色区域的占比,从而进一步简化了对待识别图标的色彩分布情况的获取步骤,缩短了显示模式切换方法所需的执行速度。
在上述第一方面的一种可能的实现中,对待识别图标和预设目标图标的色彩种类的对比方法包括:电子设备对待识别区域中的色彩种类进行统计,并在色彩种类小于预设数量阈值的情况下,确定待识别图标的色彩种类与预设目标图标的色彩种类相符合。可以理解,在电子设备的显示界面中,显示图标为了吸引用户的注意并标明对应的应用程序的主要功能,设计语言往往是较为简洁的,同时使用色彩较为单一。例如由购物车图案和白色背景底板构成的购物图标,其使用颜色仅有白色背景底板使用的白色以及购物车图案使用的黑色。在待识别图标的颜色种类小于预设数量阈值的情况下,说明待识别图标使用色彩较为单一,与预设目标图标的色彩分布情况相符合。
进一步的,针对色彩种类过多的待显示图标,容易因为色彩过于复杂而导致颜色处理后的待显示图标出现色相偏差等情况,致使呈现在电子设备显示界面上的图标图案与图标原本的设计构想发生较大偏差。在本申请的实施例中,这类色彩种类过多的待显示图标不适合进行颜色处理,可以调整该待显示图标的显示亮度来适配深色模式显示风格。
进一步的,电子设备可以在待识别区域中设置多个均匀分布的采样点,通过识别每个采样点的颜色,对待识别区域中存在的颜色种类进行统计,从而进一步简化了对待识别图标中的色彩种类进行获取的步骤,缩短了显示模式切换方法所需的执行速度。
在上述第一方面的一种可能的实现中,电子设备对待识别区域的色彩种类进行统计时,对待识别区域中的每个像素点的颜色信息进行采集以获得每个像素点的像素点颜色,并对每个像素点颜色执行颜色聚类,将符合聚类条件的像素点颜色认定为同一种颜色。可以理解,待识别图标使用的色彩种类应基于用户的人眼认知为标准,但实际像素点颜色之间可以存在 人眼无法识别的细小差别,例如针对明度存在细小差异的两个像素点颜色(例如明度值为250的浅灰色与明度值为245的浅灰色),人眼并不能将这两个像素点颜色进行区分,但电子设备会将其认定为两个不同的颜色,进而导致对待识别区域的色彩种类进行统计时出现色彩种类过多的情况。因此,可以通过颜色聚类操作,将符合聚类条件的像素点颜色认定为同一种颜色,使得对待识别区域的色彩种类统计符合人眼的认知习惯。
在上述第一方面的一种可能的实现中,聚类条件包括下列中的至少一项:像素点颜色的饱和度差值均小于饱和度阈值;像素点颜色的明度差值均小于明度阈值;像素点颜色的色调差值均小于色调阈值。可以理解,经颜色聚类后被认定为同一种颜色的像素点颜色,这些像素点颜色的饱和度、色调和明度均相接近,电子设备可以通过预先设定饱和度阈值、色调阈值和明度阈值中至少一项的方式对像素点颜色是否属于同一种颜色进行认定。例如,针对明度存在细小差异的两个像素点颜色,当两个像素点颜色的明度差值小于预先设定的明度阈值,即可认定这两个像素点颜色属于同一种颜色。
在上述第一方面的一种可能的实现中,电子设备对目标图标的颜色进行颜色处理以使得目标图标的颜色适配深色显示风格的具体过程包括:电子设备在目标图标的图标亮度值大于预设亮度阈值的情况下,对目标图标进行反色处理以适配深色模式显示风格。可以理解,当目标图标的图标亮度值大于预设亮度阈值时,说明目标图标的整体亮度情况处于偏亮状态,此时对应的颜色处理操作为通过反色处理将目标图标的整体亮度情况从偏亮状态调整为偏暗状态,从而与深色模式显示风格相适配。
在上述第一方面的一种可能的实现中,对目标图标的反色处理包括:在亮度值的最小值和最大值中间,选取出翻转中心值,并将目标图标中各像素点的亮度值以翻转中心值为中心,将与像素点的当前亮度值对称的亮度值作为像素点反色处理后的亮度值。例如,当亮度值的最小值和最大值分别设定为0和255,翻转中心值设定为127.5时,白色像素点(亮度值为255)经反色处理后,亮度值从255转变为0,白色像素点的颜色从白色(亮度值为255)转变为黑色(亮度值为0)。又例如,当亮度值的最小值和最大值分别设定为0和255,翻转中心值设定为155时,白色像素点(亮度值为255)经反色处理后,亮度值从255转变为55,白色像素点的颜色从白色(亮度值为255)转变为深灰色(亮度值为55)。通过反色处理能够将目标图标中的高亮背景板区域的亮度值降低,从而与深色模式显示风格相适配。
在上述第一方面的一种可能的实现中,目标图标的图标亮度值可以是目标图标中每个像素点对应的亮度值。通过遍历目标图标中每个像素点的亮度值,对其中亮度值大于预设亮度阈值的像素点执行前述的反色处理,能够实现目标图标与深色模式显示风格的适配。
在上述第一方面的一种可能的实现中,目标图标的图标亮度值也可以是目标图标中每个像素点的亮度值的平均值。可以理解,目标图标中每个像素点的亮度值的平均值反映了目标图标的整体亮度情况。进一步的,电子设备可以在目标图标中设置多个均匀分布的采样点,通过计算每个采样点的亮度值的平均值以作为目标图标中每个像素点的亮度值的平均值,从而进一步简化了目标图标的图标亮度值的获取步骤,缩短了显示模式切换方法所需的执行速度。
在上述第一方面的一种可能的实现中,目标图标的图标亮度值也可以是目标图标中出现频率最高的颜色的亮度值。可以理解,目标图标中出现频率最高的颜色所占的区域是目标图 标中出现的单一颜色所占的区域中最大的,目标图标中出现频率最高的颜色的亮度值可以反映目标图标的整体亮度情况。
本申请的第二方面提供了一种电子设备,包括:存储器,存储器用于存储处理程序;处理器,处理器执行处理程序时实现如前述第一方面提供的显示模式切换方法。
本申请的第三方面提供了一种计算机可读存储介质,该种计算机可读存储介质上存储有处理程序,处理程序被处理器执行时实现如前述第一方面提供的显示模式切换方法。
附图说明
图1示出了现有技术中手机100从常规显示模式切换至深色显示模式的一种示例;
图2示出了现有技术中手机100的桌面显示界面从常规显示模式切换至深色显示模式的一种示例;
图3示出了现有技术中手机100的桌面显示界面从常规显示模式切换至深色显示模式的另一种示例;
图4根据本申请实施例示出了手机100的桌面显示界面从常规显示模式切换至深色显示模式的一种示例;
图5根据本申请实施例示出了一种显示模式切换装置;
图6根据本申请实施例示出了一种显示模式切换方法;
图7根据本申请实施例示出了一种识别图标素材是否为目标图标的识别方法;
图8a根据本申请实施例示出了一种不属于目标图标的异形图标;
图8b根据本申请实施例示出了另一种不属于目标图标的异形图标;
图9根据本申请实施例示出了于图标素材识别过程中,待识别区域的一种确定方法;
图10根据本申请实施例示出了图标素材中待识别区域的一种示例;
图11根据本申请实施例示出了于图标素材识别过程中,待识别区域的另一种确定方法;
图12根据本申请实施例示出了图标素材中待识别区域的另一种示例;
图13根据本申请实施例示出了于图标素材识别过程中,对图标轮廓进行识别的一种识别方法;
图14a根据本申请实施例示出了对图标轮廓进行识别的一种示例;
图14b根据本申请实施例示出了对图标轮廓进行识别的另一种示例;
图15根据本申请实施例示出了于图标素材识别过程中,对图标轮廓进行识别的另一种识别方法;
图16根据本申请实施例示出了对图标轮廓进行识别的另一种示例;
图17a根据本申请实施例示出了于图标素材识别过程中,对图标素材中透明像素分布情况进行识别的一种示例;
图17b根据本申请实施例示出了于图标素材识别过程中,对图标素材中透明像素分布情况进行识别的另一种示例;
图18根据本申请实施例示出了于图标素材识别过程中,对图标素材中颜色分布情况进行识别的一种识别方法;
图19根据本申请实施例示出了于图标素材识别过程中,对图标素材中颜色种类进行识 别的一种识别方法。
图20根据本申请实施例示出了对图标素材中颜色种类进行识别的一种示例。
图21根据本申请实施例示出了另一种识别图标素材是否为目标图标的识别方法;
图22根据本申请实施例示出了一种为适配深色模式的整体显示风格对目标图标进行图像处理的方法;
图23根据本申请实施例示出了手机100的桌面显示界面从常规显示模式切换至深色显示模式的另一种示例;
图24根据本申请实施例示出了一种电子设备的结构示意图;
图25根据本申请实施例示出了一种电子设备的软件结构框图。
具体实施方式
下面将结合附图对本申请的实施例作进一步地详细描述。
为了解决上述深色模式开启过程中存在部分图标显示风格不一致的问题,本申请提供了一种显示模式切换方案。在本申请实施例的显示模式切换方案中,电子设备会根据深色模式的开启情况,预先对待显示的图标素材进行识别,判断其是否属于造成显示风格割裂的目标图标,并针对识别得到的目标图标执行针对性图像处理以使其得以匹配深色模式下手机100的整体显示风格。
例如,如图4所示,对于上述图1至3所示的深色模式切换场景,在采用了本申请的显示模式切换方案之后,购物图标001、时钟图标002、电影图标003、家庭网络图标004、浏览器图标005和搜索图标006均能够跟随系统“深色模式”的转换而做出相应的显示调整:这些圆角矩形图标中原本的白色背景板区域的颜色被替换为深灰色,同时原本的黑色图标图案区域的颜色被替换为浅灰色。通过对图标001至图标006执行上述图像处理,能够使其匹配手机100在深色模式下的整体显示风格,贴合用户的观看习惯,提升用户的使用体验。
可以理解,适用于本申请技术方案的电子设备可以是具有深色模式的各种电子设备,例如,智能手机、平板电脑、膝上型计算机、可穿戴设备、头戴式显示器、移动电子邮件设备、便携式游戏机、便携式音乐播放器、阅读器设备,以及智能电视机、智能音箱等具有触控屏的智能家居设备等等。为了便于说明,下文以手机100为例进行描述。
图5示出了手机100中与深色模式显示切换管理技术相关的结构示意图。具体地,如图5所示,手机100包括存储模块501、识别模块502、图标处理模块503、图像融合模块504和人机交互模块500,其中:
人机交互模块500用于向使用者提供一个人机交互界面,在深色模式显示切换的应用场景下,该人机交互界面能够接受使用者输入的切换请求并将该切换请求传输至识别模块501。其中,切换请求包括将手机100的显示模式由常规模式(或是亮色/浅色模式)切换至深色模式以及将手机100的显示模式由深色模式切换至常规模式。
例如,在本申请的一些实施例中,人机交互模块500可以包括手机100的触控显示屏及其触控传感系统,如图4所示,当用户需要在手机100上选择“深色模式”时,可以首先进入相关的设置界面,并通过点击手机100屏幕中所示的深色模式开启开关进行显示模式切换。而在本申请的另一些实施例中,用户的切换请求也可以通过实体按键按动、隔空手势或 是语音指令等其他方式进行输入,相应的人机交互模块500也可以包括实体按键、前置摄像头、光学扫描仪、拾音话筒等硬件结构及其配套的输入识别程序,以实现对于用户切换请求的接收支持,在此不做赘述。
存储模块501用于存储手机100显示所需的各类显示素材,其中显示素材可以包括图标素材(例如图2至图4中所示的图标001至图标007)、图像素材(例如手机100处于桌面状态时的桌面背景图)、文字素材(例如图1中所示的文字内容)和视频素材(例如手机100的开机动画)。当手机100处于亮屏状态时,由图像融合模块504从存储模块501中提取需要进行显示的显示素材并进行显示融合处理:例如如图2所示,在手机100的显示屏上,显示内容包括白色桌面背景、图标001至图标007以及图标对应的文字内容,这些显示内容在存储模块501中均是独立存储的,需要由图像融合模块504经过图层叠加、图像拼接等手段融合成一副显示画面并由手机100的显示屏进行呈现。
识别模块502用于在切换请求为“将手机100的显示模式由常规模式切换至深色模式”时,从存储模块501中预先提取需要进行显示的图标素材并逐一进行识别,判断其是否属于在深色模式下容易与桌面背景的显示模式不统一而需要进行针对性图像处理的目标图标(如图3中的购物图标001),并将识别得到的目标图标发送至图标处理模块503。
例如,目标图标可以包括手机100中最为常见的圆形图标和圆角矩形图标:例如如图2中所示的图标001至图标006,作为圆角矩形图标其往往具有亮色(如白色)的纯色背景板以突出显示图标中的图案,当手机100切换至深色模式时,这些纯色背景板区域会与桌面背景和其他显示内容(例如图标007)产生割裂的显示效果进而造成显示风格的不统一;同理圆形图标作为手机图形用户界面中的常用图标也会在手机100切换至深色模式时出现上述问题。因此需要有识别模块502针对这类圆形图标和圆角矩形图标进行预先的针对性识别以便图标处理模块503对这些图标进行针对性处理。可以理解的是,目标图标并不限于圆形图标和圆角矩形图标,也可以是其他形状的图标,只要该图标会在深色模式下与桌面背景和其他显示内容产生割裂的显示效果进而造成显示风格的不统一均可以通过本技术得以针对性识别和处理。
具体地,识别模块103中可以预先设置有多项针对不同类型目标图标的识别规范,每项识别规范中也可以包含多条识别判断标准,有关识别规范和识别判断标准的确定将于下文中进行详细阐释和说明。
图标处理模块503用于根据识别模块502的识别结果,对接收到的目标图标进行图像处理以适配深色模式的整体显示风格,并将经图像处理后的目标图标传输至图像融合模块504。
例如,如图4所示,图标处理模块503可以将图标001至图标006的背景板区域由白色替换为深灰色,并将图标001至图标006的图案区域由黑色替换为浅灰色,经过上述图像处理后的图标001至图标006与深色模式下的桌面背景相适应,不会出现如图2或图3所示的图标背景板过亮的情况,使得手机100的整体显示风格得到了统一。
图像融合模块504用于从存储模块501中提取需要进行显示的显示素材,并与接收到的经图像处理后的目标图标一道进行显示融合处理。
例如,如图4所示,当处于常规模式下时,在手机100的显示屏上,显示素材包括白色 桌面背景、图标001至图标007以及各图标对应的文字内容,这些显示素材在存储模块501中均是独立存储的,需要由图像融合模块504经过图层叠加、图像拼接等手段融合成一副显示画面并由手机100的显示屏进行呈现。
又例如,如图4所示,当处于深色模式下时,在手机100的显示屏上,显示素材包括黑色桌面背景、经图标处理模块503处理后得到的图标001至图标006、深色模式下的图标007以及深色模式下各图标对应的文字内容,其中黑色桌面背景、深色模式下的图标007以及深色模式下各图标对应的文字内容可以是在存储模块501中预先存储的,分别对应常规模式下的前述显示素材,图像融合模块504能够根据手机100当前的显示模式(深色模式)进行针对性的选择提取,而针对图标001至图标006这类目标图标,由于存储模块501中并未预先存储与深色模式相适配的图标素材,需要预先经过识别模块502和目标识别识别以及图标处理模块503的图像处理,再与黑色桌面背景等预设显示素材一道通过图层叠加、图像拼接等手段进行融合以形成最终显示画面并由手机100的显示屏进行呈现。
在本申请的一些实施例中,用户将手机100的显示模式从常规模式切换至深色模式的具体流程示意如图6所示,具体包括:
步骤S600:接收用户输入的切换请求。
其中,切换请求表示用户需要将手机100的显示模式由当前所处的常规模式切换至深色模式,关于切换请求的接收可以由人机交互模块500加以实现。
步骤S601:逐一识别待显示的图标素材中是否存在需要在深色模式下需要进行针对性图像处理的目标图标。若存在则转向步骤S602;若不存在则转向步骤S604。
可以理解的是,基于前述说明,如图2或图3所示,当手机100切换至深色模式后,存在部分图标与整体显示风格不统一,影响用户使用体现的问题,需要对其进行针对性的识别和进一步的图像处理。于步骤S601中,待显示的图标素材指的是需要在手机100中通过显示屏进行显示的全部图标,目标图标可以包括圆形图标和圆角矩形图标,如图标001至图标006,这类图标往往具有亮色(如白色)的纯色背景板以突出显示图标中的图案,导致深色模式下容易与暗色(如黑色)的桌面背景产生割裂的显示效果。
针对这类目标图标的识别可以由识别模块502加以实现,有关识别模块502对目标图标加以识别的具体技术方案将在下文中进行阐释和说明。
步骤S602:对目标图标进行图像处理以适配深色模式的整体显示风格。
可以理解的是,当存在前述目标图标时,需要对其进行针对性的图像处理,通过使处理后的目标图标能够适配深色模式来解决显示风格不统一的问题。例如如图4所示,目标图标如图标001至图标006,在经过上述针对性图像处理后其背景板区域由白色转为深灰色,其图案区域由黑色替换为浅灰色,能够较好地与深色模式下的桌面背景相适应,不再出现如图2或图3所示的图标背景板过亮的情况。
有关目标图标的处理可以由图标处理模块503加以实现,如图4所示,针对目标图标的图像处理采用了非对称反色的处理方式,相关具体技术方案将在下文中进行阐释和说明。
步骤S603:提取待显示的显示素材与经图像处理的目标图标一道进行显示融合处理以获取显示画面。
可以理解的是,当手机100进行亮屏显示时,通过显示屏呈现给用户的显示画面不单单 包含图标,还包括文字、图像、动画、视频等其他内容。这里的待显示的显示素材可以是除目标图标外其他需要显示的内容,如图4中手机100处于深色模式下的黑色桌面背景、各类文字内容以及不属于目标图标的异形图标007,均属于上述的显示素材。这些显示素材通常均是预先存储在手机100内部的并当需要时由手机100的视图系统进行提取,并与经图像处理的目标图标一道进行显示融合处理:这里的显示融合处理指的是通过移动、缩放、排列、旋转、图层叠加、图像拼接等常规图像处理手段,将各显示素材和目标图标集成于一副可通过手机100的显示屏进行显示的显示画面中,例如如图4所示,可以是将经处理的目标图标001至006按照3*2的排列方式设置于黑色桌面背景的下方区域并置于顶层图层,同时将“8℃”和晴朗天气图标007及其关联文字并列设置于黑色桌面背景的上方区域并置于顶层图层,进而形成深色模式下手机100的桌面显示图像。上述显示融合处理过程可由图像融合模块504加以实现。
步骤S604:提取待显示的显示素材进行显示融合处理以获取显示画面。
可以理解的是,于步骤S601中,若遍历待显示的图标素材中均不存在需要进行针对性图像处理的目标图标时,可直接跳转至步骤S604提取显示画面所需的各类显示内容直接进行显示融合处理以生成显示画面;这一步骤同样可以由图像融合模块504加以实现,在此不做赘述。
于上述实施例可知,图标处理模块503和图像融合模块504针对目标图标的图像处理及显示图像融合均是基于识别模块502对于目标图标的在先识别,同时考虑到深色模式切换后的显示流畅性,需要识别模块能够502对目标图标施行快速准确的识别,即要求识别模块502所采用的图标识别方法能够有针对性地、快速地对目标图标所具有的图像特征进行判定。在本申请的一些实施例中,为识别模块502提供了一种图标识别方法,具体以圆形图标及圆角矩形图标作为目标图标进行针对性识别,可以理解,作为识别对象的目标图标也可以是其他形状的图标,并不限于圆形图标和圆角矩形图标。
例如,在图7所示的实施例中,可以通过对图标素材的图标轮廓、透明像素的分布情况、色彩分布情况以及色彩种类中的多项,与预设的目标图标的图标轮廓、透明像素的分布情况、色彩分布情况、以及色彩种类中的多项分别进行比对,来确定待识别图标是否为深色模式下需要进行颜色处理的目标图标。
如图7所示,该种图标识别方法具体包括:
步骤S700:获取待识别的图标素材。
步骤S701:对图标素材进行遍历,获取图标素材中的非透明像素所占区域并确定一待识别区域。其中,如图10或图12所示,待识别区域1005或1205可以是非透明像素所占区域的外接矩形。
可以理解的是,于手机100中存储的图标素材往往是标准格式的矢量图像,这类矢量图像包括透明像素背景(即背景部分)和图标前景(即前景部分),透明像素背景可以环绕设置于图标前景的四周以满足标准格式中有关图标素材长宽大小的要求,图标前景采用矢量图进行绘制以支持无限级缩放。由于对图标素材的识别特征需要针对图标前景区域,故而在具体识别流程前需要预先剔除作为背景部分的透明像素所占区域:可以通过遍历图标素材中的每个像素点以获取非透明像素所占区域,进而据此确定一待识别区域;考虑到图标素材不仅 包含如图标001至图标007所示的圆角矩形图标,也包含如图标007或图8b中图标008b所示的异形图标,对于异形图标直接基于非透明像素所占区域进行识别存在一定难度,故而需要根据非透明像素所占区域的分布情况划定一个待识别区域以便于识别规则的制定;该待识别区域确定需要同时满足以下条件:包含全部的非透明像素所占区域、尽可能外接全部的非透明像素所占区域(即包含尽可能少的透明像素所占区域)以及具有规则的简单几何形状(如矩形、圆形等)。在本申请的一些实施例中,如图10或图12所示,待识别区域1005或1205可以是一矩形区域。有关待识别区域的具体确定方式将于下文中进行阐释和说明。
步骤S702:判断待识别区域中的非透明像素所占区域的外轮廓是否为目标图标的轮廓。
若是,则说明非透明像素所占区域的轮廓与目标图标的轮廓相符,进而转向步骤S703进一步判断待识别区域中的其他特征是否满足目标图像的要求;若否,则说明非透明像素所占区域的轮廓与目标图标的轮廓不同,图标素材不属于目标图标,进而转向步骤S707。
可以理解的是,待识别区域中的非透明像素所占区域代表了图标素材中的图标部分,那么非透明像素所占区域的外轮廓也就是图标部分的外轮廓。例如,目标图标通常的轮廓为圆形或者圆角矩形,具有明显的几何特征,故而可以通过对非透明像素所占区域的外轮廓进行识别,故在一些实施例中,可以通过判断待识别区域是否为圆形或圆角矩形来快速剔除不符合目标图标外轮廓特征的异形图标(如图标007),进而提升图标识别的整体速度。有关非透明像素所占区域的外轮廓判断具体步骤将于下文中进一步说明。
此外,可以理解,目标图标的轮廓还可以是圆形、圆角矩形外的其他形状,例如,椭圆形、六边形等,待识别区域的轮廓判断方式也不限于下文对圆形、圆角矩形轮廓的图标的判断,其他现有技术也适用于本申请的技术方案,在此不做限制。
步骤S703:判断待识别区域的中心区域中非透明像素所占区域是否满足预设条件。
若是,则说明图标素材中的待识别区域的像素分布与目标图标的像素分布较为相近,进而转向步骤S704;若否,则说明待识别区域的中心区域具有较大面积的透明像素,与目标图标的像素分布不相符合,进而转向步骤707。
可以理解的是,对于如图2中图标001至图标006所示的目标图标,这类图标具有完整的纯色背景板部分,即使图标的中心区域因特殊图案设计而出现镂空花纹,因为存在纯色背景板的覆盖,这些镂空花纹所占区域的颜色并不会随桌面背景的改变而改变,需要采用本申请提出的技术方案进行图像处理以适配深色模式的整体显示风格,最后达到如图4所示的显示效果。而针对如图8a中所示的图标008a(图标008a中的白色区域部分表示透明像素所占区域,黑色区域部分表示非透明像素所占区域),该图标的中心区域存在大量的透明像素,这些透明像素所占区域能够随桌面背景的改变而改变,当手机100的显示模式从常规模式切换至深色模式时,图标008a无需图像处理即可与深色模式下的桌面背景保持一致的显示风格,自然不属于目标图标。故在一些实施例中,可以将待识别区域的中心区域中非透明像素所占区域是否达到一定占比来作为一项识别判断标准。有关中心区域的具体确定方式将于下文中进一步说明。
步骤S704:判断待识别区域中主色部分所占区域是否达到一预设占比。
若是,则说明图标素材中的待识别区域与目标图标的色彩分布较为相近,转向步骤S705;若否,则说明待识别区域的色彩分布不具有集中性,与目标图标的色彩分布不相符合, 进而转向步骤707。
可以理解的是,主色部分指的是待识别区域中占比最高的单一颜色所对应的覆盖区域;例如,对于如图4中图标001至图标006所示的目标图标,这类图标除去图案部分还包括大面积的纯色背景板部分,这些纯色背景板占据了图标整体的绝大部分面积,故而可以将代表纯色背景板的主色部分达到一定占比作为一项识别判断标准。
步骤S705:判断待识别区域中的颜色种类是否小于一预设阈值。
若是,则说明图标素材中的待识别区域的颜色种类与目标图标的色彩种类较为相近,进而转向步骤706;若否,则说明待识别区域中的颜色种类过多,与目标图标所普遍具有的色彩种类不相符合,进而进入步骤707。
可以理解的是,对于如图4中图标001至图标006所示的目标图标,这类图标除去纯色背景板外,图标图案的设计往往结构较为简洁明了,使用色彩较为单一。如图标001至图标006所示,除去白色的背景板外,图标图案均采用黑色进行表示,图标整体使用颜色仅有两种。故在一些实施例中,可以将将图标的颜色种类小于预设阈值来作为一项识别判断标准。
进一步的,如果待识别区域中的颜色种类过多,那么说明这类图标虽然满足圆形图标或是圆角矩形图标的一些识别特征,但在由图标处理模块503执行后续图像处理时,容易因为色彩过于复杂而导致处理后的图标出现色相偏差等情况,致使呈现在手机100显示屏上的图标图案与图标原本的设计构想发生较大偏差。针对这类图标,在本申请的另一些实施例中,可以通过手机100的视图系统调整该图标素材的显示亮度来适配手机100的深色模式。
步骤S706:确定图像素材属于目标图标。
步骤S707:确定图像素材不属于目标图标。
可以理解的是,在手机100切换至深色模式后,为了保证用户的使用体验,针对目标图标的识别过程需要做到尽可能的迅速高效,既要能够补足显示风格不统一的缺陷,又需要维持显示内容的稳定性不受影响。因此,在上述图标识别流程的步骤S702至S705中,当任意一个步骤中出现有悖于目标图标的判断结果时,即判断该图标素材不属于目标图标并直接退出整个识别流程,能够有效保障手机100整体显示的流畅性。
例如,当对于如图8b所示的图标素材008b(图标008b中的白色区域部分表示透明像素所占区域,黑色区域部分表示非透明像素所占区域)进行目标图标识别时,根据判断规则可以得出,该图标素材008b中非透明像素所占区域的外轮廓显然不属于圆形或圆角矩形。在如图7所示的图标识别方法中,于步骤S702时即退出图标识别流程,无需再执行后续的识别流程,提升了对于图标素材的识别判定效率。
以下将针对前述步骤S701至步骤S705的具体实现进行进一步阐释和说明。
在本申请的一些实施例中,为了减少对原始图像的遍历以及加快对待识别区域的确认过程,于步骤S701的具体实现中可以采用如图9所示的方法;结合如图10所示的待识别区域划分示意图,该种方法具体包括:
步骤S901,将图标素材1000划分为多个区块1001。
步骤S902,在每个区块1001中设置一个或多个采样点1002。
步骤S903,通过遍历所有采样点1002的方式完成对图标素材1000的遍历以获取非透明区域1003。
其中,非透明区域1003即为非透明像素所占区域,而对非透明区域1003的确认则是基于采样点1002的采样出结果:每个采样点1002中可以包括一个像素点,也可以包括多个像素点,若一个采样点1002中包括至少一个非透明像素点,则认为其属于非透明采样点;如图10所示,非透明区域1003可以是包含所有非透明采样点的最小连续区域。
步骤S904,根据非透明区域1003的最小外接矩形1004,基于最大包含规则获取相应的待识别区域1005;其中,根据最大包含规则,若一个区块1001中的任意一部分处于最小外接矩形1004中,则该区块1001包含于待识别区域1005中。
于上述实施例中,通过区块1001并在每个区块1001中设置采样点1002的方式代替对图标素材1000中每个像素点执行遍历以确定非透明像素所占区域过程,能够在保障遍历可信度的基础上优化遍历流程缩短遍历时间。可以理解的是,每个区块1001可以被设置为大小相同的正方形;每个区块1001中设置的采样点1002的数量可以是相同的或是随机的,采样点1002分布状态可以是规则排布或是随机分布的;每个采样点1002可以包括一个像素点,也可以包括多个像素点,在此不做限定。
于上述实施例中,根据对识别出的非透明区域1003对待识别区域1005进行确认:如图10所示,首先根据非透明区域1003获取一最小外接矩形1004,该最小外接矩形1004的长与宽分别与区块1001的划分线相平行;进而将该最小外接矩形304所涉及的全部区块1001均划入待识别区域1005中。如此,待识别区域1005则包含了全部的非透明区域1003以及尽可能少的透明像素所占区域,且该待识别区域305呈规则矩形,由整数个区块1001所构成,这一待识别区域1005的确认方式有利于在后续识别过程中对规范化判断标准的确认。
而在本申请的一些实施例中,为了减少对原始图像的遍历以及加快对待识别区域的确认过程,于步骤S701的具体实现中还可以采用如图11所示的方法;结合如图12所示的待识别区域划分示意图,该种方法具体包括:
步骤S1101至步骤S1102与前述步骤S901至S902相同,在此不做赘述。
步骤S1103,通过遍历所有采样点1202的方式完成对图标素材1200的遍历以获取全部的非透明采样点。其中,每个采样点1202中可以包括一个像素点,也可以包括多个像素点,若一个采样点1202中包括至少一个非透明像素点,则认为其属于非透明采样点
步骤S1104,基于最大包含规则获取包含全部非透明采样点的区块组1204,将区块组1204的最小外接矩形作为相应的待识别区域1205;其中,根据最大包含规则,若一个区块1201中存在至少一个非透明采样点,则该区块1201包含于区块组1204中。
如图12所示,与前述实施例不同的是,于上述实施例中,无需对非透明区域1203进行严格的识别和确认:基于上述实施例,若一区块1201中包含有非透明采样点,则其将直接划入区块组1204(如图12中斜线阴影部分所示)中,由于区块组1204由整数个区块1201有序排列组成,基于区块组1204的最小外接矩形同样是容易获取的。如此,待识别区域1205同样呈规则矩形且包含了全部的非透明区域1203,同时无需基于非透明采样点的分布情况对非透明区域1203进行识别获取,从计算机处理层面进一步简化了对于待识别区域的获取流程。
进一步的,基于前述实施例中对于图标素材整体的区块划分以及待识别区域的确认,可以依托待识别区域是由多个区块组成的规则矩形这一特征简化有关图标外轮廓是否为圆形 或圆角矩形的判断标准:在本申请的一些实施例中,于步骤S702的具体实现中可以采用如图13所示的识别方法;结合如图14a和14b所示的识别示意图,该种方法具体包括:
步骤S1301,于待识别区域1400的四个顶角区域分别选取一直角三角形1402。
步骤S1302,将每个直角三角形1402的斜边经过的区块作为采样区块1403。
步骤S1303,判断每个采样区块1403中的采样颜色是否均接近。
若是,则说明待识别区域1400的顶角斜割线上的颜色均相近,转向步骤S1304;若否,则说明明待识别区域1400的顶角斜割线上的颜色并不一致,转向步骤S1305。
其中,采样区块1403的采样颜色即是能够代表该采样区块1403中最主要色彩特征的颜色,可以是采样区块1403中的中心点颜色,也可以是采样区块1403中随机多点采样后求取RGB颜色平均值,在此不做限定。
步骤S1304,确定图标素材中非透明像素所占区域的外轮廓为圆形或圆角矩形。
步骤S1305,确定图标素材不属于目标图标。
基于前述实施例可以理解的是,如图14a和14b所示,待识别区域1400近似于非透明像素所占区域1401的外接矩形,在此基础上对于图标外轮廓的判断识别可以简化为非透明像素所占区域1401是否符合圆形图标或圆角矩形图标的显性形状特征:如图14a和14b所示,直角三角形1402的斜边可以视为待识别区域1400的顶角斜割线1404,若非透明像素所占区域1400是圆形图标或圆角矩形图标,该顶角斜割线1404经过的区域是图标的纯色背景板区域,即该顶角斜割线1404所经过的区块的颜色往往是相一致的。通过判断顶角斜割线1404上的采样颜色是否均接近来代替对图标外轮廓的获取和识别,由识别模块502所执行的识别内容和判断步骤均获得了极大的简化。
如图14a和图14b所示,可以理解的是,关于顶角斜割线1404的选取,即直角三角形1402区域的选取具有一定的限定条件:若直角三角形1402的选取过小,则其斜边对应的斜割线可能位于非透明像素所占区域之外,进而导致斜割线上的点均为透明像素;若直角三角形502的选取过大,则其斜边对应的斜割线可能不仅会经过纯色背景板区域,还会经过图案部分区域,从而导致斜割线上出现多种不相近颜色致使误识别的情况产生。故而,在本申请的一些实施例中,对于直角三角形1402的选取限定为:当待识别区域1400由M*N个区块501组成时(M、N均为正整数),每个直角三角形502的直角边长分别设定为L1和L2个区块的长度,其中L1属于[M/3,M/2]的取值区间中,L2属于[N/3,N/2]的取值区间中。
根据前述的限定规则可以理解,直角三角形1402的选取与待识别区域1400大小的大小相关,例如,如图14a所示,当待识别区域1400包含8*8个区块时,直角三角形1402的边长可以均选取为14个区块501的长度;又例如,如图14b所示,当待识别区域1400包含4*4个区块时,直角三角形1402的边长可以均选取为2个区块的长度。
在本申请的一些实施例中,判断每个采样区块1403中的采样颜色是否均接近可以是判断任意两个相邻采样区块1403的采样颜色之间的颜色距离是否小于一预设阈值,也可以是获取全部采样区块1403的采样颜色后计算平均值,再逐一比较各采样颜色和平均值间的颜色距离是否均小于一预设阈值,在此不作限定;具体地,颜色距离可以通过在RGB空间中计算两个待判断颜色的欧式距离来获得。
而在本申请的一些实施例中,于步骤S702的具体实现中还可以采用如图15所示的识别 方法;结合如图16所示的识别示意图,该种方法具体包括:
步骤S1501,判断待识别区域1602的四个顶角区域1603是否存在透明像素。
若是,则说明四个顶角区域1603未完全被非透明像素所覆盖,转向步骤S1502;若否,则说明四个顶角区域1603完全被非透明像素所覆盖,转向步骤S1504。
步骤S1502,判断透明像素所占区域相对于顶角区域1603是否达到一预设占比。
若是,则说明四个顶角区域1603中的透明区域所占面积较大,转向步骤S1503;若否,则说明四个顶角区域1603中的透明区域所占面积较小,转向步骤S1504。
步骤S1503,确定图标素材中非透明像素所占区域的外轮廓为圆形或圆角矩形。
步骤S1504,确定图标素材不属于目标图标。
基于前述实施例可以理解的是,如所示,待识别区域1602近似于非透明像素所占区域1601的外接矩形,在此基础上对于图标外轮廓的判断识别可以简化为非透明像素所占区域1601是否符合圆形图标或圆角矩形图标的显性形状特征:如图16所示,若非透明像素所占区域1601是圆形图标或圆角矩形图标,则待识别区域1602的顶角区域1603应当存在一定比例的透明像素所占区域。通过判断透明像素所占区域相对于顶角区域1603是否达到一预设占比来代替对图标外轮廓的获取和识别,由识别模块502所执行的识别内容和判断步骤同样获得了极大的简化。
如图16所示,在本申请的一些实施例中,顶角区域1603可以是待识别区域1602中四个顶角对应的区块;透明像素所占区域相对于顶角区域1603的占比可以通过遍历顶角区域1603中的每个像素点或是采样点来获得,透明像素所占区域相对于顶角区域1603的占比可以是透明像素点数量与全部像素点数量的比值,也可以是透明采样点数量与全部采样点数量的比值。
可以理解的是,图13所示的识别方法与图15所示的识别方法均是为了识别非透明像素所占区域在待识别区域中是否符合圆形图标或圆角矩形图标应当具有的形状特征,且两种识别方法的判断标准均不相同;于步骤S702的具体实现过程中,可以选择其中任意一种识别方法,也可以同时选取两种识别方法依次进行识别判断,能够进一步提升目标图标的识别准确性。
本申请的一些实施例中,基于前述实施例中对于图标素材整体的区块划分以及待识别区域的确认,于步骤S703的具体实现中,对待识别区域中心区域的确定具体可以参考图17a及图17b所示出的具体实施例,其中:
例如,如图17a所示,当待识别区域1700包括8*8个区块时,可以选择靠近待识别区域1700中央的2*2个区块作为中心区域1701;由于此时选择的中心区域1701相较于待识别区域1700的整体占比较小,考虑到部分圆形图标或圆角矩形图标可能在中心区域做出透明像素花纹的特殊设计,预设占比的设定可以是90%或95%;于具体判定过程中,对于中心区域的2*2个区块同样可以采用采样点的方式进行判断,若设定每个区块中设置5个随机采样点,则至少需要17至19个采样点的采样结果为非透明采样点才能够判定待识别区域的中心区域1701中非透明像素所占区域达到上述预设占比。
还例如,如图17b所示,当待识别区域1700包括8*8个区块时,也可选靠近待识别区域1700中央的4*4个区块作为中心区域1702,由于此时选择的中心区域1702相较于待识 别区域的整体占比较大,考虑到部分圆形图标或圆角矩形图标可能在中心区域做出透明像素花纹的特殊设计,预设占比的设定可以是80%或85%;于具体判定过程中,对于中心区域的4*4个区块同样可以采用采样点的方式进行判断,若设定每个区块中设置5个随机采样点,则至少需要64至68个采样点的采样结果为非透明采样点才能够判定待识别区域的中心区域1702中非透明像素所占区域达到上述预设占比。
在本申请的一些实施例中,于步骤S704的具体实现中,如图18所示,针对主色部分的占比识别的具体步骤可以包括:
步骤S1801:获取待识别区域中每个采样点中像素点对应的颜色,并将所有颜色及其对应的像素数量存储于一颜色桶空间中。
步骤S1802:统计颜色桶空间中对应像素数量最多的颜色并将其作为待识别区域中的主色。
步骤S1803:判断主色对应的像素数量相对于全体采样像素数量的占比是否达到一预设阈值。
若是,则说明主色对应的像素所占区域面积较大,转向步骤S1804;若否,则说明主色对应的像素所占区域面积较小,转向步骤S1805。
步骤S1804:确定待识别区域中主色部分所占区域达到预设占比。
步骤S1805:确定图标素材不属于目标图标。
可以理解的是,待识别区域中的主色部分可以为待识别区域中出现次数最多的颜色对应的区域:例如,若待识别区域中红色像素点的数量为N1,其他不同颜色的像素点的数量均为N2且N1大于N2,则红色像素点对应的区域即为待识别区域中的主色部分。
于上述实施例中,基于前述实施例中对于图标素材整体的区块划分以及待识别区域的确认,可以将主色部分相对于待识别区域的占比转化为主色对应的采样像素数量相对于全体采样像素数量的占比。如此,通过遍历采样点即可获取主色部分的占比情况,简化了对主色部分所占区域的识别以及占比的判断流程,从而进一步提升了对目标图标识别的整体效率。
在本申请的一些实施例中,于步骤S705的具体实现中,如图19和图20所示,针对待识别区域中颜色种类的统计方法具体包括:
步骤S1901:获取待识别区域中每个采样点中像素点对应的颜色,并将所有颜色及其对应的像素数量存储于一颜色桶空间2001中。
步骤S1902:对颜色桶空间2001进行遍历,依次提取其中每个颜色作为待聚类颜色执行颜色聚类操作。
可以理解的是,在本申请的一些实施例中,在针对待识别区域中的颜色种类进行统计之前,需要预先执行颜色聚类处理:例如同样属于黑色颜色区域的两个像素点,其在颜色采样的过程中得到的RGB值可能分别为(0,0,1)和(0,2,3),人眼难以分辨这些细微的差异,但在颜色桶空间2001的统计中会将这两个像素点对应的颜色认定为两种不同的颜色,进而导致对于待识别区域中颜色种类的统计产生过多的偏差。因此,需要针对此情况对颜色桶空间2001中的颜色执行颜色聚类:颜色聚类指的是将一些相近的颜色进行聚合并将其视为同一类颜色,例如上述举例中的两个像素点在颜色聚类处理后即可以被认为是同一类颜色(黑色)。通过引入颜色聚类处理,使得对于待识别区域中颜色种类的统计更符合人眼的认知规 律,颜色聚类处理的具体步骤如下述步骤S1903至S1907所示。
步骤S1903:获取待聚类颜色所对应的色调、饱和度和明度。
可以理解的是,在颜色桶空间2001中的颜色往往以RGB颜色模式进行存储,而在颜色聚类过程中对于颜色是否相近进行判断时,往往需要基于待聚类颜色的色调、饱和度和明度等直观特性。如图20所示,获取待聚类颜色的色调、饱和度以及明度的方式可以是将RGB颜色模式下的待聚类颜色通过HSV空间2002转换至HSV颜色模式,其中HSV空间2002是根据颜色的直观特性构建的一种颜色空间,其模型呈倒圆锥状,用于表示颜色的参数分别即是色调(H),饱和度(S),明度(V)。有关颜色在RGB模式和HSV模式下的转换公式属于本领域技术人员的公知常识,在此不做赘述。
步骤S1904:判断待聚类颜色的饱和度是否属于一低饱和度区间。若是,则说明该待聚类颜色的饱和度较低,转向步骤S1905;若否,则说明该待聚类颜色的饱和度较高,转向步骤S1906。
步骤S1905:将待聚类颜色置入一冗余空间2003,而后返回步骤S1902。
可以理解的是,当待聚类颜色存在饱和度过低的情况则无需参加颜色聚类,这是因为这类低饱和度颜色的色相不明显,通过HSV空间2002的倒圆锥模型示意图可以看出,这类低饱和度颜色处于接近于倒圆锥中轴部分的灰色区域,针对这类颜色人眼并不具有较高的识别度,容易忽略,也就无需对这类颜色将其作为一种颜色种类进行确认,因此,将这类低饱和度颜色置入冗余空间2003进行直接剔除,有利于提升颜色聚类的整体执行效率。
在本发明的一些实施例中,低饱和度区间可以是:
Figure PCTCN2022076664-appb-000001
其中,s为待聚类颜色的饱和度,v为待聚类颜色的明度,ε为一预设值且该预设值ε小于饱和度s的最大值;当上式满足时即说明待聚类颜色的饱和度属于低饱和度区间。可以理解的是,低饱和度区间可以是一个动态区间,可以通过调节预设值ε来对需要剔除的低饱和度的颜色进行调整。
步骤S1906:判断聚类空间2004中是否存在与待聚类颜色相近的聚类颜色:若是则转向步骤S1907;若否则转向步骤S1908。其中,聚类空间2004用于存储当前时刻已完成聚类的聚类颜色,存储有当前时刻聚类颜色的RGB值及聚类颜色对应的像素点的数量;有关如何判断聚类空间2004中是否存在与待聚类颜色相近的聚类颜色将于下文中进行具体说明。
步骤S1907:根据待聚类颜色和相近的聚类颜色进行聚类更新,并将聚类更新后获取的更新聚类颜色置入聚类空间2004中,而后转向步骤S1909。其中,有关聚类更新的具体步骤将于下文中进行说明。
步骤S1908:直接将待聚类颜色置入聚类空间2004中,而后转向步骤S1909。
步骤S1909:判断颜色桶空间2001中的颜色是否均经过上述步骤S1903至步骤S1907的处理。
若是,则说明颜色桶空间2001中的颜色均已经过上述颜色聚类处理,转向步骤S1910;若否,则说明颜色桶空间2001中的颜色尚未全部经过上述颜色聚类处理,返回步骤S1902。
步骤S1910:获取聚类空间2004中的聚类颜色的数量,该聚类颜色的数量即为待识别区域中颜色种类的数量。
可以理解的是,当判断聚类空间2004中是否存在与待聚类颜色相近的聚类颜色时,需要将待聚类颜色与聚类空间2004中已有的全部聚类颜色逐一进行比较:若不存在相近的聚类颜色时,说明该待聚类颜色与其他聚类颜色均不属于同一类颜色,可以作为一个新的聚类颜色种类直接置入聚类空间2004中;若存在相近的聚类颜色时,则说明该待聚类颜色与相近的聚类颜色属于同一类颜色,此时需要根据待聚类颜色和相近的聚类颜色进行一次聚类更新:例如,待聚类颜色A和聚类空间2004中已然存在的聚类颜色B相近,属于同一类颜色,此时不可以直接将待聚类颜色A归于聚类颜色B并将待聚类颜色A对应的像素点数量直接合并至聚类颜色B中,这是因为颜色聚类需要将一些相近的颜色进行聚合并将其视为同一类颜色,于实际应用场景中可能存在新的待聚类颜色a,其与颜色A相近属于同一类颜色,但由于较为严苛的相近判断标准与颜色B并不相近,从而导致聚类效果不理想的情况产生。故而需要根据颜色A与颜色B进行一次聚类更新,生成一新的颜色C,该颜色C可以同时代表颜色A和颜色B的颜色种类。有关聚类更新的具体实现将于下文中进行说明。
在本申请的一些实施例中,判断聚类空间2004中是否存在与待聚类颜色相近的聚类颜色可以通过:
Δh<k1
Δs+Δv<k2
其中,Δh为待聚类颜色和聚类颜色的色调差值的绝对值,Δs为待聚类颜色和聚类颜色的饱和度差值的绝对值,Δv为待聚类颜色和聚类颜色的明度差值的绝对值,k1和k2均为预设值。可以理解的是,若两个颜色的色调差值、饱和度差值和明度差值均较小,则说明两个颜色相近属于同一颜色种类;同样地,可以通过调节预设值k1和k2来对相近颜色的判断标准进行调整,k1和k2的值越大说明对相近颜色的判定相对宽松,例如明度相差较大的深红色和浅红色就可以认定同一类颜色;k1和k2的值越小则说明对相近颜色的判定相对严苛,例如明度相差较大的深红色和浅红色就可能被认定两种不同的颜色,可以根据实际需求对k1和k2两个预设值进行调整。
在本申请的一些实施例中,聚类更新可以通过以下方式加以实现:
a=(y*Ny+c*Nc)/(Ny+Nc)
Na=Ny+Nc
其中,y为待聚类颜色的RGB值,c为聚类颜色的RGB值,a为聚类更新后更新聚类颜色的RGB值,Ny为待聚类颜色对应的像素点数量,Nc为聚类颜色对应的像素点数量,Na为聚类更新后更新聚类颜色的像素点数量。
可以理解的是,通过上述加权平均方式可以需要根据待聚类颜色y和聚类颜色c的RGB值及像素数量信息重新生成新的更新聚类颜色a,更新聚类颜色a同时具有待聚类颜色y和聚类颜色c的色彩特征,且更新聚类颜色a对应的像素点数量等于待聚类颜色y和聚类颜色c的像素点数量之和。
据此,识别模块503能够根据前述步骤S700至S705的图标识别方法,实现对于作为目标图标的圆形图标及圆角矩形图标的针对性识别。而在本申请的另一些实施例中,为识别模块502提供了另一种图标识别方法,如图21所示,具体包括:
步骤S2100至步骤S2101与前述步骤S700至步骤S701相同,在此不做赘述。
步骤S2102:判断待识别区域中的非透明像素所占区域的外轮廓是否为目标图标的轮 廓,并记录相应的第一判断结果。其中,第一判断结果包含“是”和“否”两种情况。
步骤S2103:判断待识别区域的中心区域中非透明像素所占区域是否达到一预设占比,并记录相应的第二判断结果。同样的,第二判断结果也包含“是”和“否”两种情况。
步骤S2104:判断待识别区域中主色部分所占区域是否达到一预设占比,并记录相应的第三判断结果。同样的,第二判断结果也包含“是”和“否”两种情况。
步骤S2105:判断待识别区域中的颜色种类是否小于一预设阈值,并记录相应的第四判断结果。同样的,第二判断结果也包含“是”和“否”两种情况。
步骤S2106:根据第一判断结果至第四判断结果,计算得到一识别分数:若识别分数大于等于一预设阈值,则判断图标素材属于目标图标;若识别分数小于该预设阈值,则判断图标素材不属于目标图标并退出。其中,有关识别分数的获取步骤将于下文中进行具体说明。
与前述图标识别方法不同的是,于上述步骤S2102至步骤S2105中,当任意一项的判断结果出现“否”时不会立刻判断图标素材不属于目标图标并退出,而是需要将全部的判断步骤依次经历完毕后计算一识别分数,通过计算识别分数是否达到预设阈值来判断图标素材是否属于目标图标。
可以理解的是,随着处理器性能的不断提升,对于图像进行识别处理的速度也在不断提升;在处理器性能配置较高的状态下,能够实现对于全部判断步骤的依次执行并保证显示的流畅性不受影响。而在全部判断步骤依次执行完毕后再对图标素材是否属于图标素材进行判断能够进一步提升对目标图标识别的精细程度,针对部分具有特殊设计的目标图标具有更好的识别效果,从而降低目标图标的识别遗漏率。
以下将结合图21,针对步骤S2106中识别分数的具体获取进行进一步阐释和说明:
在本申请的一些实施例中,识别分数基于第一判断结果至第四判断结果以获得:当任意一个判断结果为“是”时,可以记为1分;当任意一个判断结果为“否”时,可以记为0分;识别分数即为第一判断结果至第四判断结果的记分之和。例如,针对图21所示的图标010(图21中的白色区域部分表示透明像素所占区域,黑色区域部分表示非透明像素所占区域且该非透明像素所占区域中的颜色种类为一种单色),基于上述判断过程显然可以得到,第一、第三和第四判断结果均为“是”、而第二判断结果为“否”,可以得到识别分数为3分;若设定的预设阈值为3分,则可以判断该图标010属于目标图标。
可以理解的是,图标010属于圆角矩形图标,但其具有中心镂空的特殊设计,因此根据前述步骤S700至步骤S705所示的图标识别方法中容易被遗漏误判为不属于目标图标。而通过步骤S2100至步骤S2106所示的图标识别方法则可以对其进行成功识别。
可以理解的是,如步骤S2100至步骤S2106所示的图标识别方法放宽了对于目标图标识别的部分判断标准,同时方便系统运维人员对于图标识别标准进行灵活调配,例如若在使用过程中发现识别模块503将一些异形图标也识别为目标图标时,可以通过适当调高识别分数对应的预设阈值来收紧识别标准,而无需就识别方法中的每一个判断过程进行逐一调整。
进一步地,在上述实施例中,在识别分数的计算过程中还可以为第一判断结果至第四判断结果增加不同的权重值。例如,同样针对图21所示的图标010进行识别,设定第一判断结果的加权参数为30%,第二判断结果的加权参数为10%,第三判断结果的加权参数为20%,第四判断结果的加权参数为40%,则可以计算得到识别分数为0.9;若设定的预设阈值为0.8 分,则同样可以判断该图标010属于目标图标。为第一判断结果至第四判断结果增加不同的权重值可以增加识别过程中的侧重性,使得识别更加具有针对性。
通过本申请的前述实施例中所提出的图标识别方法,识别模块502能够实现对于包括圆形图标和圆角矩形图标在内的目标图标的有效、快速、准确识别。而这些经识别模块502获取得到的目标图标还需要经过图像融合模块504的图像处理后方能匹配手机100的深色显示模式。如图22所示,在本申请的一些实施例中为图像处理模块503提供了一种图像处理方法,能够使得目标图标与手机100的深色显示模式相匹配,具体包括:
步骤S2201:判断目标图标的亮度是否大于一预设阈值。
若是,则说明目标图标的亮度较高,与手机100在深色模式下的整体显示效果不统一,转向步骤S2202;若否,则说明目标图标的亮度较低,能够与手机100在深色模式下的整体显示效果相统一,转向步骤S2203。
步骤S2202:基于非对称反色规则对目标图像中的每个像素进行反色处理,而后输出该目标图标。其中,有关非对称反色规则的具体阐释将于下文中进行说明。
步骤S2203:直接输出该目标图标。
于上述图像处理方法中,当存在符合识别条件的目标图标时,在进行后续图像处理步骤前还需要对目标图标的亮度进行一次预先判定。可以理解的是,当手机100处于深色模式时,具有相较于常规模式更暗的整体视觉感官;在此情形下如果目标图标的亮度低于一预设阈值,则说明即使不经过后续的图像处理步骤,该目标图标在手机100深色模式的暗显示环境下仍具有较为统一的显示效果,可以直接进行呈现显示。
在本申请的一些实施例中,目标图标的图标亮度值可以是目标图标中每个像素点对应的亮度值。通过遍历目标图标中每个像素点的亮度值,对其中亮度值大于预设亮度阈值的像素点执行前述的反色处理,能够实现目标图标与深色模式显示风格的适配。
在本申请的一些实施例中,目标图标的亮度可以是目标图标中各像素的平均亮度值,也可以是目标图标中像素数量最多的颜色所对应的亮度值。考虑到在前述的图标识别过程中对于目标图标经历过颜色种类的快速聚类统计,在上述实施例中,可以直接调用图标识别过程中的统计结果,获取目标图标中像素数量最多的颜色对应的亮度值作为目标图标的亮度参与判定,能够进一步提升显示模式切换过程中的流畅性。
在本申请的一些实施例中,于步骤S2202中直接采用常规反色规则对目标图标进行处理。可以理解的是,基于常规反色规则进行反色处理指的是对彩色图像中各个像素点的取反色的图像处理方法,其中反色指的是由白色的RGB值减去当前颜色的RGB值所得到的RGB值相对应的颜色。例如在反色处理中,RGB值为(0,0,0)的黑色会被转换为RGB值为(255,255,255)的白色。又例如,采用常规反色规则对目标图案进行处理后在手机100中的呈现效果如图23所示:可以看出,图标001至图标006的白色背景板被直接转换成黑色并与背景色相一致,而图标001至图标006中的黑色图标图案区域则被转换成高亮的白色。通过常规反色规则对目标图标进行处理。虽然可以看出手机100的整体显示风格得到了一致,但图标001至图标006的边界变得难以识别,同样图标图案区域所呈现的高亮的白色也会致使用户的人眼观感体验较为刺眼,存在进一步提升使用体验的空间。
在本申请的另一些实施例中,于步骤S2202中采用非对称反色规则对目标图标进行处 理。非对称反色规则指的是包括针对彩色图像中的每个像素点,基于一预设亮度为翻转中心进行亮度翻转,并且要求该预设亮度需要偏离于完整亮度区间的中心值。例如设定完整亮度区间为[0,100],则预设亮度的亮度值可以是除50以外的任意亮度值;设定预设亮度值γ为45,当前像素点的亮度值β为60,则经非对称反色处理后的像素点的亮度值δ则为|2*γ-β|即为30。又例如,采用非对称反色规则对目标图案进行处理后在手机100中的呈现效果如图4所示:可以看出,图标001至图标006的背景板区域由白色转为深灰色,而图案区域由黑色替换为浅灰色,既能够较好地与深色模式下的桌面背景相适应,又保证了图标的可识别性,同时避免了高亮色的出现,大幅优化化了手机100的显示观感体验。
可以理解的是,在RGB空间下像素点的亮度值无法直接获取,在本申请的一些实施例中,可以预先将像素点从RGB空间转换至YUV空间(亮度-色度空间)中,再进行亮度变换。本领域技术人员了解在RGB空间和YUV空间之间存在转换系数矩阵,故而非对称反色变换同样可以采用转换系数矩阵的形式进行表示,转换系数矩阵取决于亮度翻转中心值的确定。
例如,在本申请的一具体实施例中,针对目标图标的非对称反色变换可以具体表现为:
R’=0.605420R-0.77494G-0.15038B+199
G’=-0.395077R+0.225241G-0.150164B+199
B’=-0.394384R-0.775088G+0.849472B+199
其中,R、G、B分别为目标图标在转换前的RGB值,R’、G’、B’分别为目标图标在非对称反色转换后的RGB值。
在本申请的一些实施例中,非对称反色规则中的亮度翻转中心值还可以根据深色模式的需求进行变换和调整:当手机100开启深色模式时,桌面背景的颜色并不局限为纯黑色,在本申请的一些实施例中,深色模式开启下手机100的桌面背景颜色同样可以是深灰色或是深蓝色,为了避免在此应用场景下出现图标背景板颜色与桌面背景颜色趋同或是图标图案相较于桌面背景颜色对比度过高的情况出现,可以通过调整亮度翻转中心值的方式对非对称反色规则进行适应性修正。
图24示出了电子设备(如上述手机100)的结构示意图。
电子设备可以包括处理器110,外部存储器接口120,内部存储器121,通用串行总线(universal serial bus,USB)接口130,充电管理模块140,电源管理模块141,电池142,天线1,天线2,移动通信模块150,无线通信模块160,音频模块160,扬声器160A,受话器160B,麦克风160C,耳机接口160D,传感器模块170,按键190,马达191,指示器192,摄像头193,显示屏194,以及用户标识模块(subscriber identification module,SIM)卡接口195等。其中传感器模块170可以包括压力传感器170A,陀螺仪传感器170B,气压传感器170C,磁传感器170D,加速度传感器170E,距离传感器170F,接近光传感器170G,指纹传感器170H,温度传感器170J,触摸传感器170K,环境光传感器170L,骨传导传感器170M等。
可以理解的是,本发明实施例示意的结构并不构成对电子设备的具体限定。在本申请另一些实施例中,电子设备可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
处理器110可以包括一个或多个处理单元,例如:处理器110可以包括应用处理器 (application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
控制器110可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
处理器110中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据,可从存储器中直接调用。避免了重复存取,减少了处理器110的等待时间,因而提高了系统的效率。例如,处理器110中可以存储执行显示模式切换方法的指令,如获取操作系统的第一显示模式的指令、将屏幕上正在显示的应用程序的第二显示模式切换为深色模式的指令、判断图标素材是否具有目标图标的指令以及对具有目标图标的图标素材执行非对称反色渲染的指令。
可以理解的是,本申请实施例示意的各模块间的接口连接关系,只是示意性说明,并不构成对电子设备的结构限定。在本申请另一些实施例中,电子设备也可以采用上述实施例中不同的接口连接方式,或多种接口连接方式的组合。
电子设备的无线通信功能可以通过天线1,天线2,移动通信模块150,无线通信模块160,调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。电子设备中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块150可以提供应用在电子设备上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块150可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。在一些实施例中,移动通信模块150的至少部分功能模块可以被设置于处理器110中。在一些实施例中,移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。例如,手机100可以向远程服务器上报显示模式切换过程中出现的错误信息或示警信息。
无线通信模块160可以提供应用在电子设备上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。例如,手机100可以向 远程服务器上报显示模式切换过程的错误信息或示警信息。
电子设备通过GPU,显示屏194,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏194和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器110可包括一个或多个GPU,其执行程序指令以生成或改变显示信息,例如,当手机100的操作系统的第一显示模式为深色模式时,将屏幕上正在显示的应用程序的第二显示模式切换为深色模式。
内部存储器121可以用于存储计算机可执行程序代码,可执行程序代码包括指令。内部存储器121可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储电子设备使用过程中所创建的数据(比如音频数据,电话本等)等。此外,内部存储器121可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。处理器110通过运行存储在内部存储器121的指令,和/或存储在设置于处理器中的存储器的指令,执行电子设备的各种功能应用以及数据处理。
按键190包括开机键,音量键等。按键190可以是机械按键。也可以是触摸式按键,例如电子设备显示的第一输入法的虚拟键盘的按键。电子设备可以接收按键输入,产生与电子设备的用户设置以及功能控制有关的键信号输入。
电子设备的软件系统可以采用分层架构,事件驱动架构,微核架构,微服务架构,或云架构。本发明实施例以分层架构的Android系统为例,示例性说明电子设备的软件结构。
图17是本申请的一些实施例中电子设备的软件结构框图。
分层架构将软件分成若干个层,每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中,可以将应用于该电子设备的Android系统分为四层,从上至下分别为应用程序层,应用程序框架层,安卓运行时(Android runtime)和系统库,以及内核层。
应用程序层可以包括一系列应用程序包。
如图25所示,应用程序包可以包括相机,图库,日历,通话,地图,导航,WLAN,蓝牙,音乐,视频,短信息等应用程序。
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface,API)和编程框架。应用程序框架层包括一些预先定义的函数。
如图25所示,应用程序框架层可以包括窗口管理器,内容提供器,视图系统,电话管理器,资源管理器,通知管理器等。
窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小,判断是否有状态栏,锁定屏幕,截取屏幕等。
内容提供器用来存放和获取数据,并使这些数据可以被应用程序访问。数据可以包括视频,图像,音频,拨打和接听的电话,浏览历史和书签,电话簿等。
视图系统可以是电子设备的显示系统,能够管理和修改电子设备待显示的应用程序的显示风格。视图系统可以根据电子设备虚线存储的显示参数中包含的显示风格参数,获取与深色模式相对应的显示功能。
电话管理器用于向电子设备提供通信功能。例如通话状态的管理(包括接通,挂断等)。
资源管理器为应用程序提供各种资源,比如本地化字符串,图标,图片,布局文件,视频文件等等。
在本发明的实施例中,资源管理器还可以用于存储Overlay配置文件。
通知管理器使应用程序可以在状态栏中显示通知信息,可以用于传达告知类型的消息,可以短暂停留后自动消失,无需用户交互。比如通知管理器被用于告知下载完成,消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在系统顶部状态栏的通知,例如后台运行的应用程序的通知,还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息,发出提示音,电子设备振动,指示灯闪烁等。
Android Runtime包括核心库和虚拟机。Android runtime负责安卓系统的调度和管理。
核心库包含两部分:一部分是java语言需要调用的功能函数,另一部分是安卓的核心库。
应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理,堆栈管理,线程管理,安全和异常的管理,以及垃圾回收等功能。
系统库可以包括多个功能模块。例如:表面管理器(surface manager),媒体库(Media Libraries),三维图形处理库(例如:OpenGL ES),2D图形引擎(例如:SGL)等。
表面管理器用于对显示子系统进行管理,并且为多个应用程序提供了2D和3D图层的融合。
媒体库支持多种常用的音频,视频格式回放和录制,以及静态图像文件等。媒体库可以支持多种音视频编码格式,例如:MPEG4,H.264,MP3,AAC,AMR,JPG,PNG等。
三维图形处理库用于实现三维图形绘图,图像渲染,合成,和图层处理等。
2D图形引擎是2D绘图的绘图引擎。
内核层是硬件和软件之间的层。内核层至少包含显示驱动,摄像头驱动,音频驱动,传感器驱动。
下面结合深色模式切换场景,示例性说明当电子设备为手机100时,相关软件及硬件的工作流程:当触摸传感器接收到触摸操作时,相应的硬件中断被发给内核层;内核层将触摸操作加工成原始输入事件(包括触摸坐标,触摸操作的时间戳等信息);原始输入时间被存储在内核层;应用程序框架层从内核层获取原始输入事件,识别该输入事件所对应的控件。以该触摸操作是单击操作,该单击操作所对应的控件为手机100中调用深色模式的控件为例,手机100调用应用框架层的接口,启动深色模式切换程序(即深色模式启动应用),进而通过调用显示驱动显示深色模式对应的显示素材。
通过以上实施方式的描述,所属领域的技术人员可以了解到,为描述的方便和简洁,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。
在本申请所提供的几个实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,模块或单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合 或者可以集成到另一个装置,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。
作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是一个物理单元或多个物理单元,即可以位于一个地方,或者也可以分布到多个不同地方。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外,在本申请各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。
集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个可读取存储介质中。基于这样的理解,本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该软件产品存储在一个存储介质中,包括若干指令用以使得一个设备(可以是单片机,芯片等)或处理器(processor)执行本申请各个实施例方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(read only memory,ROM)、随机存取存储器(random access memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
以上内容,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以权利要求的保护范围为准。

Claims (14)

  1. 一种显示模式切换方法,应用于电子设备,其特征在于,包括:
    所述电子设备接收到用户将电子设备的显示模式切换至深色模式的切换指令;
    所述电子设备对电子设备显示界面中的待识别图标进行识别以识别出目标图标,其中所述目标图标为不适配深色模式显示风格的图标;
    所述电子设备对目标图标的颜色进行颜色处理以使得所述目标图标的颜色适配所述深色模式显示风格;
    所述电子设备在显示界面上显示经过颜色处理的目标图标。
  2. 如权利要求1所述的显示模式切换方法,其特征在于,所述电子设备通过将待识别图标的图标轮廓、透明像素的分布情况、色彩分布情况以及色彩种类中的多项,与预设目标图标的图标轮廓、透明像素的分布情况、色彩分布情况以及色彩种类中的多项分别进行比对,确定所述待识别图标是否为目标图标。
  3. 如权利要求2所述的显示模式切换方法,其特征在于,所述确定所述待识别图标是否为目标图标,包括:
    所述电子设备在所述待识别图标和所述预设目标图标的图标轮廓、透明像素的分布情况、色彩分布情况以及色彩种类中的多个满足对应的比对条件的情况下,确定所述待识别图标为目标图标。
  4. 如权利要求2所述的显示模式切换方法,其特征在于,所述确定所述待识别图标是否为目标图标,包括:
    所述电子设备对所述待识别图标和所述预设目标图标的图标轮廓、透明像素的分布情况、色彩分布情况以及色彩种类的比对结果分别赋予权重参数,并基于所述权重参数,对图标轮廓、透明像素的分布情况、色彩分布情况以及色彩种类的比对结果的值进行加权求和;
    所述电子设备在所述加权求和的值大于第一预设阈值的情况下,确定所述待识别图标为目标图标。
  5. 如权利要求2所述的显示模式切换方法,其特征在于,所述目标图标为圆形图标或者圆角矩形图标。
  6. 如权利要求5所述的显示模式切换方法,其特征在于,所述图标轮廓的比对方法包括:
    所述电子设备在所述待识别图标的图标轮廓为圆形或圆角矩形的情况下,确定所述待识别图标的图标轮廓与所述预设目标图标的图标轮廓相符合。
  7. 如权利要求2所述的显示模式切换方法,其特征在于,所述电子设备对电子设备显示界面中的待识别图标进行识别以识别出目标图标,包括:
    所述电子设备获取所述待识别图标的图标素材,其中所述待识别的图标素材包括所述待识别图标和位于所述待识别图标外部的外围部分;
    根据所述待识别图标的图标素材中非透明像素的分布情况,确定出所述待识别图标的待识别区域,其中所述待识别图标的图标素材包括所述待识别区域,所述待识别区域包括所述待识别图标。
  8. 如权利要求7所述的显示模式切换方法,其特征在于,所述透明像素的分布情况的比对方法包括:
    所述电子设备在所述待识别区域的部分区域中透明像素所占区域的占比低于第二预设 阈值的情况下,确定所述待识别图标的透明像素分布情况与所述预设目标图标的透明像素分布情况相符合,其中,所述部分区域包括所述待识别区域的中心点。
  9. 如权利要求7所述的显示模式切换方法,其特征在于,所述色彩分布情况的比对方法包括:
    所述电子设备在所述待识别区域中主色区域的占比高于第三预设阈值的情况下,确定所述待识别图标的色彩分布情况与所述预设目标图标的色彩分布情况相符合;
    其中,所述主色区域为所述待识别区域中出现频率最高的颜色所占的区域。
  10. 如权利要求7所述的显示模式切换方法,其特征在于,所述色彩种类的对比方法包括:
    所述电子设备对所述待识别区域中的色彩种类进行统计,并在所述色彩种类小于预设数量阈值的情况下,确定所述待识别图标的色彩种类与所述预设目标图标的色彩种类相符合。
  11. 如权利要求9所述的显示模式切换方法,其特征在于,还包括:
    所述电子设备对所述待识别区域的色彩种类进行统计时,对所述待识别区域中的每个像素点的颜色信息进行采集以获得每个像素点的像素点颜色,并对每个像素点颜色执行颜色聚类,将符合聚类条件的所述像素点颜色认定为同一种颜色;
    其中,所述聚类条件包括下列中的至少一项:
    所述像素点颜色的饱和度差值均小于预设饱和度阈值;
    所述像素点颜色的明度差值均小于预设明度阈值;
    所述像素点颜色的色调差值均小于预设色调阈值。
  12. 如权利要求1所述的显示模式切换方法,其特征在于,所述电子设备对目标图标的颜色进行颜色处理以使得所述目标图标的颜色适配所述深色模式显示风格,包括:所述电子设备在所述目标图标的图标亮度值大于预设亮度阈值的情况下,对所述目标图标进行反色处理以适配所述深色显示风格;
    其中,所述反色处理包括:
    在所述亮度值的最小值和最大值中间,选取出翻转中心值,并将所述目标图标中各像素点的亮度值以所述翻转中心值为中心,将与像素点的当前亮度值对称的亮度值作为所述像素点反色处理后的亮度值。
  13. 一种电子设备,其特征在于,包括:
    存储器,所述存储器用于存储处理程序;
    处理器,所述处理器执行所述处理程序时实现如权利要求1至12中任意一项所述的显示模式切换方法。
  14. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质上存储有处理程序,所述处理程序被处理器执行时实现如权利要求1至12中任意一项所述的显示模式切换方法。
PCT/CN2022/076664 2021-02-24 2022-02-17 显示模式切换方法、装置、电子设备和介质 WO2022179431A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110209962.8A CN114968009A (zh) 2021-02-24 2021-02-24 显示模式切换方法、装置、电子设备和介质
CN202110209962.8 2021-02-24

Publications (1)

Publication Number Publication Date
WO2022179431A1 true WO2022179431A1 (zh) 2022-09-01

Family

ID=82974130

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/076664 WO2022179431A1 (zh) 2021-02-24 2022-02-17 显示模式切换方法、装置、电子设备和介质

Country Status (2)

Country Link
CN (1) CN114968009A (zh)
WO (1) WO2022179431A1 (zh)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014235553A (ja) * 2013-05-31 2014-12-15 株式会社ニコン 画像処理プログラム
CN107390976A (zh) * 2017-07-26 2017-11-24 上海展扬通信技术有限公司 图标显示处理方法及电子设备
CN110046012A (zh) * 2019-03-15 2019-07-23 努比亚技术有限公司 一种可穿戴设备界面显示方法、可穿戴设备和存储介质
CN110908765A (zh) * 2019-11-29 2020-03-24 五八有限公司 一种界面显示方法、装置、终端设备及存储介质

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104077091B (zh) * 2013-03-29 2017-08-29 联想(北京)有限公司 一种显示处理方法和电子设备
JP6293466B2 (ja) * 2013-12-02 2018-03-14 シャープ株式会社 画像処理装置、画像形成装置、画像処理方法、画像処理プログラム、記録媒体
CN111813492B (zh) * 2020-08-19 2024-05-03 深圳市欢太科技有限公司 快应用的显示方法、装置、电子设备以及存储介质

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014235553A (ja) * 2013-05-31 2014-12-15 株式会社ニコン 画像処理プログラム
CN107390976A (zh) * 2017-07-26 2017-11-24 上海展扬通信技术有限公司 图标显示处理方法及电子设备
CN110046012A (zh) * 2019-03-15 2019-07-23 努比亚技术有限公司 一种可穿戴设备界面显示方法、可穿戴设备和存储介质
CN110908765A (zh) * 2019-11-29 2020-03-24 五八有限公司 一种界面显示方法、装置、终端设备及存储介质

Also Published As

Publication number Publication date
CN114968009A (zh) 2022-08-30

Similar Documents

Publication Publication Date Title
CN109191410B (zh) 一种人脸图像融合方法、装置及存储介质
WO2020038167A1 (zh) 视频识图方法、装置、终端及存储介质
US10366519B2 (en) Operating method for image and electronic device supporting the same
KR102140850B1 (ko) 사진을 이용한 운영체제 색상 세팅
US20160364888A1 (en) Image data processing method and electronic device supporting the same
KR20150059466A (ko) 전자장치에서 이미지 내의 특정 객체를 인식하기 위한 방법 및 장치
CN114669047B (zh) 一种图像处理方法、电子设备及存储介质
CN110290426B (zh) 展示资源的方法、装置、设备及存储介质
EP4109879A1 (en) Image color retention method and device
CN114138215B (zh) 一种显示方法及相关设备
EP4383070A1 (en) Page processing method, apparatus, device, and storage medium
US20230229375A1 (en) Electronic Device, Inter-Device Screen Coordination Method, and Medium
WO2021254113A1 (zh) 一种三维界面的控制方法和终端
CN111031377B (zh) 移动终端及视频制作方法
CN112489006A (zh) 图像处理方法、装置、存储介质及终端
WO2022252810A1 (zh) 显示模式切换方法、装置、电子设备和介质
WO2022179431A1 (zh) 显示模式切换方法、装置、电子设备和介质
CN112231029A (zh) 应用于主题的帧动画处理方法
CN115033138B (zh) 图标排列方法、电子设备和可读介质
WO2022083571A1 (zh) 电子设备及其功能设置的提示方法、提示文件的播放方法
CN117171188B (zh) 搜索方法、装置、电子设备和可读存储介质
CN116450363B (zh) 一种资源调度方法及电子设备
CN115424118B (zh) 一种神经网络训练方法、图像处理方法及装置
CN117152022B (zh) 图像处理方法及电子设备
CN116048349B (zh) 一种图片显示方法、装置及终端设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22758796

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22758796

Country of ref document: EP

Kind code of ref document: A1