CN115686421A

CN115686421A - Image display method, image processing method, device and equipment

Info

Publication number: CN115686421A
Application number: CN202110825867.0A
Authority: CN
Inventors: 钟伟才; 王昱璇; 龚凌
Original assignee: Petal Cloud Technology Co Ltd
Current assignee: Petal Cloud Technology Co Ltd
Priority date: 2021-07-21
Filing date: 2021-07-21
Publication date: 2023-02-03
Also published as: WO2023001084A1

Abstract

The application provides an image display method, an image processing device and equipment, wherein the method comprises the following steps: the terminal device obtains an image searching instruction, the image searching instruction comprises a first searching condition, and a plurality of images corresponding to the first searching condition are displayed in a first interface according to the image searching instruction, wherein the first interface comprises at least two display areas, each display area is used for displaying at least one image, and the main tone of the image displayed in each display area is located in the same tone range. Through the process, the images with the same or similar main tones are displayed in the same display area, and the image display effect can be improved.

Description

Image display method, image processing method, device and equipment

Technical Field

The present application relates to the field of image technologies, and in particular, to an image display method, an image processing method, an image display device, an image processing device, and an image processing apparatus.

Background

With the development of terminal technology and image technology, users increasingly acquire information through images. In various scenes, the terminal device needs to display a plurality of images. For example, in an image search or image recommendation scene, the terminal device needs to display a plurality of images in the search result or recommendation result; in a gallery or theme bank scene, the terminal device needs to display a plurality of images in the gallery or theme bank.

In the related art, when displaying a plurality of images, a terminal device generally displays the images in a fixed order. For example, when a plurality of images in a gallery or a subject gallery are displayed, the images are displayed in the order of the image capturing time. For example, when a plurality of images in the search result or the recommendation result are displayed, the search correlation or the recommendation correlation is displayed in descending order.

However, in the above related art, the image display effect is not good.

Disclosure of Invention

The application provides an image display method, an image processing method, an image display device, an image processing device and image processing equipment, which are used for improving an image display effect.

In a first aspect, the present application provides an image display method, where an execution subject of the method may be a terminal device, or a chip or a processor in the terminal device. The following description will be given taking an execution subject as a terminal device as an example. The method comprises the following steps: the method comprises the steps that terminal equipment obtains an image searching instruction, wherein the image searching instruction comprises a first searching condition; displaying a plurality of images corresponding to the first search condition in a first interface according to the image search instruction; the first interface comprises at least two display areas, each display area is used for displaying at least one image, and the main tone of the image displayed in each display area is located in the same tone range. Another expression of "the keytone of the image displayed in each display region is located in the same tone range" is "the keytone of the image displayed in each display region is the same or similar".

In the process, the main tone of the image displayed in each display area is located in the same tone range, so that the image in each display area is neatly and attractively arranged, the problem of disordered image display can be solved, and the image display effect is improved. Furthermore, the user can quickly and conveniently locate the required image.

In one possible implementation manner, the hue ranges corresponding to the at least two display regions are arranged according to a preset hue order. Wherein the preset tone sequence may be a previously defined tone sequence. Optionally, the preset color tone sequence is a color tone sequence indicated by the color wheel in the clockwise direction. That is, the hue ranges corresponding to the at least two display regions are arranged in the hue order indicated by the color wheel in the clockwise direction. Optionally, the preset color tone sequence is a color tone sequence indicated by the counterclockwise direction of the color wheel. That is, the hue ranges corresponding to the at least two display regions are arranged in the hue order indicated by the counterclockwise direction of the color wheel.

In the above manner, since the color wheel is obtained by arranging the colors according to the human visual perception features of different colors, in the first interface, the color tone ranges corresponding to different display areas are arranged according to the color tone sequence indicated by the clockwise/counterclockwise direction of the color wheel, so that when a user views an image in the first interface, the user does not feel excessive jump in color tone, thereby further improving the display effect of the first interface on the image.

In one possible implementation manner, for any display area, when the number of images displayed by the display area is multiple, the main tones of the images displayed in the display area are arranged according to a preset tone sequence. Optionally, the preset color tone sequence is a color tone sequence indicated by the color wheel in the clockwise direction. That is, the keytones of the image displayed in each display region are arranged in the tone order indicated in the clockwise direction of the color wheel. The preset tone sequence is the tone sequence indicated by the counterclockwise direction of the color wheel. That is, the keytones of the image displayed in each display region are arranged in the tone order indicated by the counterclockwise direction of the color wheel.

In the above manner, since the color wheel is obtained by arranging the hues according to the human visual perception features of different hues, the dominant hues of the images in each display area are arranged according to the hue sequence indicated by the clockwise/counterclockwise direction of the color wheel, so that when a user views the images in each display area, the user does not feel excessive jump of the hues, and the display effect of the first interface on the images is further improved.

In a possible implementation manner, each display area is a rectangular area, the rectangular area is used for displaying N rows of images or N columns of images, and N is an integer greater than or equal to 1. Thus, each display area corresponds to N rows of images or N columns of images, and the image display effect can be further improved.

In a possible implementation manner, the terminal device may display, in the first interface, a plurality of images corresponding to the first search condition in the following manner: according to the image searching instruction, acquiring an image set and image display information, wherein images in the image set meet the first searching condition, and the image display information comprises: the display area corresponding to each image in the image set and the display position of each image in the display area; and displaying the plurality of images in the first interface according to the image display information, wherein the plurality of images are all images or partial images in the image set.

In a possible implementation manner, the terminal device sends a search request to a server, where the search request includes the first search condition; the terminal equipment receives address information of the images in the image set and the image display information from the server; and acquiring the image set according to the address information.

In the implementation mode, after the server searches for the image set according to the search request, the server generates image display information according to the image set and sends the image display information to the terminal equipment, and the terminal equipment only needs to display according to the image display information, so that the display effect can be achieved. The method can reduce the requirement on the computing capacity of the terminal equipment.

In a possible implementation manner, the terminal device sends a search request to the server, where the search request includes the first search condition; the terminal equipment receives address information of the images in the image set from the server, and acquires the image set according to the address information, wherein the images in the image set are arranged according to the degree of correlation with the first search condition; and the terminal equipment determines the image display information according to the dominant hue of the images in the image set.

In the implementation mode, the server searches for the image set according to the search request, then sends the image set to the terminal device, and the terminal device generates the image display information according to the image set and displays the image display information based on the image display information so as to achieve the display effect. The method can increase the realization flexibility of the terminal equipment.

In one possible implementation manner, when the terminal device determines the image display information according to the dominant hue of the images in the image set, the following manner may be adopted: according to the arrangement sequence of the images in the image set, carrying out grouping processing on the images in the image set to obtain a plurality of groups of images; for each group of images, reordering the images in the group of images according to the dominant hue of the images in the group of images to obtain a dominant hue ordering result of the group of images, and determining display information of the group of images according to the dominant hue ordering result, wherein the display information comprises the display area corresponding to each image in the group of images and the display position of each image in the display area; and generating the image display information according to the display information of the plurality of groups of images.

In the above mode, when the image display information is determined, the images in the image set are grouped according to the arrangement sequence of the images in the image set to obtain a plurality of groups of images, and the images in the group of images are reordered within each group of images according to the dominant hue of the images in the group of images, so that the optimization of the image display effect is realized on the basis of substantially retaining the original ordering. In this way, the first interface still retains general search relevancy information when presenting search results, and the efficiency of positioning a desired image in the search results by a user is not reduced.

In one possible implementation, for a first set of images; the dominant tone ordering result for the first set of images may be obtained as follows: determining a location of a dominant hue in a color wheel for each image in the first set of images; according to the position of the main tone of each image in the first group of images in the color wheel, with the position of the 1 st image in the first group of images in the color wheel as a starting point, reordering the images in the first group of images according to the clockwise or counterclockwise direction of the color wheel, and obtaining the main tone ordering result of the first group of images.

In the above manner, by taking the position of the 1 st image in the first group of images in the color wheel as a starting point, it is ensured that the image with the highest search correlation can be displayed in the first image position.

In a possible implementation manner, for the ith group of images, where i is an integer greater than 1, the dominant tone ordering result of the ith group of images may be obtained by: determining a location of a dominant hue in a color wheel for each image in the ith set of images; and according to the position of the main tone of each image in the ith group of images in the color wheel, taking the position of the last 1 image in the ith-1 group of images in the color wheel as a starting point, and according to the clockwise or anticlockwise direction of the color wheel, carrying out reordering processing on the images in the ith group of images to obtain the main tone ordering result of the ith group of images.

In the above manner, the position of the last 1 image in the i-1 group of images in the color wheel is taken as the starting point, so that the main tone transition of the i-group of images and the i-1 group of images is smooth, and the condition of image tone jump cannot occur in the first interface. Therefore, when the user slides up and down to browse the multi-screen images, the tone ranges are circularly arranged according to the tone sequence indicated by the color wheel in the clockwise direction on the whole, and the image display effect of the first interface is further improved.

In a second aspect, the present application provides an image display method, where an execution subject of the method may be a terminal device, or a chip or a processor in the terminal device. The following description will be given taking an execution subject as a terminal device as an example. The method comprises the following steps: the terminal equipment displays images in the image library in a first display sequence in a first interface; acquiring an image rearrangement instruction; displaying the images in the image library in a second display order in the first interface according to the image rearrangement instruction; when the images in the image library are displayed in the second display sequence, the first interface comprises at least two display areas, each display area is used for displaying at least one image, and the main tone of the image displayed in each display area is located in the same tone range.

In the process, the main tone of the image displayed in each display area is located in the same tone range, so that the image in each display area is neatly and attractively arranged, the problem of disordered image display can be solved, and the image display effect is improved. Furthermore, the user can quickly and conveniently position the image required by the user.

In a possible implementation manner, the hue ranges corresponding to the at least two display areas are arranged according to a preset hue order. Wherein the preset tone sequence may be a previously defined tone sequence. Optionally, the preset color tone sequence is a color tone sequence indicated by the color wheel in the clockwise direction. That is, the hue ranges corresponding to the at least two display regions are arranged in the hue order indicated by the color wheel in the clockwise direction. Optionally, the preset color tone sequence is a color tone sequence indicated by the counterclockwise direction of the color wheel. That is, the hue ranges corresponding to the at least two display regions are arranged in the hue order indicated by the counterclockwise direction of the color wheel.

In one possible implementation manner, for any display area, when the number of images displayed by the display area is multiple, the main tones of the images displayed in the display area are arranged according to a preset tone sequence. Optionally, the preset color tone sequence is a color tone sequence indicated by the color wheel in the clockwise direction. That is, the keytones of the image displayed in each display region are arranged in the tone order indicated by the color wheel in the clockwise direction. The preset tone sequence is the tone sequence indicated by the counterclockwise direction of the color wheel. That is, the keytones of the image displayed in each display region are arranged in the tone order indicated by the counterclockwise direction of the color wheel.

In the above manner, since the color wheel is obtained by arranging the respective hues according to the human visual perception features of different hues, the main hues of the images in each display region are arranged according to the hue sequence indicated by the clockwise/counterclockwise direction of the color wheel, so that when a user views the images in each display region, the user does not feel excessive jump of the hues, thereby further improving the display effect of the first interface on the images.

In one possible implementation manner, the first display order may be any one of the following: the sequence of the image shooting time; the sequence of the image receiving time; selecting the sequence of time for the images; the sequence of the correlation degree between the image and the preset condition; and a preset hue order.

In a possible implementation manner, the obtaining of the image rearrangement instruction includes: detecting a first user operation in the first interface, wherein the first user operation is any one of the following operations: icon clicking operation, interface zooming operation and image screening operation; alternatively, a change in the number of images in the image library is detected.

In one possible implementation, displaying the images in the image library in the first interface in a second display order according to the image rearrangement instruction includes: acquiring images in the image library according to the image rearrangement instruction; determining image display information according to a dominant hue of an image in the image library, the image display information comprising: the display area corresponding to each image in the image library on the first interface and the display position of each image in the display area; and displaying the images in the image library in the first interface according to the image display information.

In one possible implementation, determining image display information according to a dominant hue of an image in the image library includes: according to the arrangement sequence of the images in the image library, grouping the images in the image library to obtain a plurality of groups of images; for each group of images, reordering the images in the group of images according to the dominant hue of the images in the group of images to obtain a dominant hue ordering result of the group of images, and determining display information of the group of images according to the dominant hue ordering result, wherein the display information comprises the display area corresponding to each image in the group of images and the display position of each image in the display area; and generating the image display information according to the display information of the plurality of groups of images.

In the above mode, when the image display information is determined, the images in the image library are firstly grouped according to the arrangement sequence of the images in the image library to obtain a plurality of groups of images, and the images in each group of images are reordered according to the main tone of the images in the group of images, so that the optimization of the image display effect is realized on the basis of substantially retaining the original ordering.

In one possible implementation, for a first set of images; according to the main tone of the images in the group of images, reordering the images in the group of images to obtain a main tone ordering result of the group of images, comprising: determining a location of a dominant hue in a color wheel for each image in the first set of images; according to the position of the main tone of each image in the first group of images in the color wheel, with the position of the 1 st image in the first group of images in the color wheel as a starting point, reordering the images in the first group of images according to the clockwise or counterclockwise direction of the color wheel, and obtaining the main tone ordering result of the first group of images.

In a possible implementation manner, for the ith group of images, where i is an integer greater than 1, performing reordering processing on the images in the group of images according to the dominant hue of the images in the group of images to obtain a dominant hue ordering result of the group of images, the method includes: determining a location of a dominant hue in a color wheel for each image in the ith set of images; and according to the position of the main tone of each image in the ith group of images in the color wheel, taking the position of the last 1 image in the ith-1 group of images in the color wheel as a starting point, and according to the clockwise or anticlockwise direction of the color wheel, carrying out reordering processing on the images in the ith group of images to obtain the main tone ordering result of the ith group of images.

In the above manner, the position of the last 1 image in the i-1 group of images in the color wheel is taken as the starting point, so that the main tone transition of the i-group of images and the i-1 group of images is smooth, and the condition of image tone jump cannot occur in the first interface. Therefore, when a user slides up and down to browse the multi-screen images, the tone ranges are circularly arranged according to the tone sequence indicated by the clockwise direction of the color wheel, and the image display effect of the first interface is further improved.

In a third aspect, the present application provides an image processing method, where an execution subject of the method may be a server, or a chip or a processor in the server. The server may be a cloud server. The following description will be given taking an execution subject as a server as an example.

The method comprises the following steps: a server acquires an image set; the server generates image display information according to the dominant hue of the images in the image set, the image display information comprising: a display area corresponding to each image in the image set in the first interface and a display position of each image in the display area; the server sends address information of the images in the image set and the image display information to a terminal device, wherein the image display information is used for indicating the terminal device to display a plurality of images in the image set in the first interface, the first interface comprises at least two display areas, each display area is used for displaying at least one image, and the main tone of the image displayed in each display area is located in the same tone range. Another expression of "the keytone of the image displayed in each display region is located in the same tone range" is "the keytone of the image displayed in each display region is the same or similar".

In one possible implementation, generating image display information from a dominant hue of an image in the set of images includes: according to the arrangement sequence of the images in the image set, carrying out grouping processing on the images in the image set to obtain a plurality of groups of images; for each group of images, reordering the images in the group of images according to the dominant hue of the images in the group of images to obtain a dominant hue ordering result of the group of images, and determining display information of the group of images according to the dominant hue ordering result, wherein the display information comprises the display area corresponding to each image in the group of images and the display position of each image in the display area; and generating the image display information according to the display information of the plurality of groups of images.

In one possible implementation, for a first set of images; reordering the images in the group of images according to the dominant hue of the images in the group of images to obtain a dominant hue ordering result of the group of images, comprising: determining a location of a dominant hue in a color wheel for each image in the first set of images; according to the position of the main tone of each image in the first group of images in the color wheel, with the position of the 1 st image in the first group of images in the color wheel as a starting point, reordering the images in the first group of images according to the clockwise or counterclockwise direction of the color wheel, and obtaining the main tone ordering result of the first group of images.

In a possible implementation manner, for the ith group of images, where i is an integer greater than 1, performing reordering processing on the images in the group of images according to the dominant hue of the images in the group of images to obtain a dominant hue ordering result of the group of images, the method includes: determining a location of a dominant hue in a color wheel for each image in the ith set of images; according to the position of the main tone of each image in the ith group of images in the color wheel, the position of the last 1 image in the ith-1 group of images in the color wheel is taken as a starting point, and the images in the ith group of images are reordered clockwise or anticlockwise according to the color wheel, so that the main tone ordering result of the ith group of images is obtained.

In one possible implementation, the acquiring the set of images includes: receiving a search request, wherein the search request comprises a first search condition; and acquiring the image set according to the first search condition, wherein the images in the image set meet the first search condition.

In one possible implementation, the acquiring the set of images includes: receiving a recommendation request, wherein the recommendation request comprises a recommendation type, and the recommendation type is any one of the following types: recommending according to the image popularity and recommending according to the favorite features of the user; and acquiring the image set according to the recommendation type.

In a fourth aspect, the present application provides an image display apparatus, which may be the terminal device in the first aspect, or an apparatus provided in the terminal device. The image display device includes: the device comprises a processing module and a display module. The processing module is used for acquiring an image searching instruction, and the image searching instruction comprises a first searching condition; the display module is used for displaying a plurality of images corresponding to the first search condition in a first interface according to the image search instruction; the first interface comprises at least two display areas, each display area is used for displaying at least one image, and the main tone of the image displayed in each display area is located in the same tone range.

In one possible implementation manner, the hue ranges corresponding to the at least two display regions are arranged according to a preset hue order.

In one possible implementation manner, for any display area, when the number of images displayed by the display area is multiple, the main tones of the images displayed in the display area are arranged according to a preset tone sequence.

In a possible implementation manner, the preset color tone sequence is a color tone sequence indicated by the color wheel in a clockwise direction; or, the preset tone sequence is the tone sequence indicated by the counterclockwise direction of the color wheel.

In a possible implementation manner, each display area is a rectangular area, the rectangular area is used for displaying N rows of images or N columns of images, and N is an integer greater than or equal to 1.

In a possible implementation manner, the processing module is further configured to: according to the image searching instruction, acquiring an image set and image display information, wherein images in the image set meet the first searching condition, and the image display information comprises: the display area corresponding to each image in the image set and the display position of each image in the display area; the display module is specifically configured to: and displaying the plurality of images in the first interface according to the image display information, wherein the plurality of images are all images or partial images in the image set.

In a possible implementation manner, the processing module is specifically configured to: sending a search request to a server, wherein the search request comprises the first search condition; receiving address information of images in the image set and the image display information from the server; and acquiring the image set according to the address information.

In a possible implementation manner, the processing module is specifically configured to: sending a search request to a server, wherein the search request comprises the first search condition; receiving address information of images in the image set from the server, and acquiring the image set according to the address information, wherein the images in the image set are arranged according to the degree of correlation with the first search condition; and determining the image display information according to the dominant hue of the images in the image set.

In a possible implementation manner, the processing module is specifically configured to: according to the arrangement sequence of the images in the image set, carrying out grouping processing on the images in the image set to obtain a plurality of groups of images; for each group of images, reordering the images in the group of images according to the dominant hue of the images in the group of images to obtain a dominant hue ordering result of the group of images, and determining display information of the group of images according to the dominant hue ordering result, wherein the display information comprises the display area corresponding to each image in the group of images and the display position of each image in the display area; and generating the image display information according to the display information of the plurality of groups of images.

In one possible implementation, for a first set of images; the processing module is specifically configured to: determining a location of a dominant hue in a color wheel for each image in the first set of images; according to the position of the main tone of each image in the first group of images in the color wheel, with the position of the 1 st image in the first group of images in the color wheel as a starting point, reordering the images in the first group of images according to the clockwise or counterclockwise direction of the color wheel, and obtaining the main tone ordering result of the first group of images.

In a possible implementation manner, for the ith group of images, i is an integer greater than 1, and the processing module is specifically configured to: determining a location of a dominant hue in a color wheel for each image in the ith set of images; and according to the position of the main tone of each image in the ith group of images in the color wheel, taking the position of the last 1 image in the ith-1 group of images in the color wheel as a starting point, and according to the clockwise or anticlockwise direction of the color wheel, carrying out reordering processing on the images in the ith group of images to obtain the main tone ordering result of the ith group of images.

In a fifth aspect, the present application provides an image display apparatus, which may be the terminal device in the first aspect, or an apparatus provided in the terminal device. The image display device includes: the device comprises a processing module and a display module. The display module is used for displaying the images in the image library in a first display sequence in a first interface; the processing module is used for acquiring an image rearrangement instruction; the display module is further used for displaying the images in the image library in a second display sequence in the first interface according to the image rearrangement instruction; when the images in the image library are displayed in the second display sequence, the first interface comprises at least two display areas, each display area is used for displaying at least one image, and the main tone of the image displayed in each display area is located in the same tone range.

In a possible implementation manner, the preset color tone sequence is a color tone sequence indicated by the color wheel in a clockwise direction; or,

the preset color tone sequence is the color tone sequence indicated by the counterclockwise direction of the color wheel.

In one possible implementation manner, the first display order may be any one of the following: the sequence of the image shooting time; the sequence of the image receiving time; the sequence of the image selection time; the sequence of the correlation between the images and the preset conditions; and a preset tone order.

In a possible implementation manner, the obtaining module is specifically configured to: detecting a first user operation in the first interface, wherein the first user operation is any one of the following operations: icon clicking operation, interface zooming operation and image screening operation; alternatively, a change in the number of images in the image library is detected.

In a possible implementation manner, the processing module is further configured to: acquiring images in the image library according to the image rearrangement instruction; determining image display information according to a dominant hue of an image in the image library, the image display information comprising: the display area corresponding to each image in the image library on the first interface and the display position of each image in the display area; the display module is specifically configured to display the images in the image library in the first interface according to the image display information.

In a possible implementation manner, the processing module is specifically configured to: according to the arrangement sequence of the images in the image library, grouping the images in the image library to obtain a plurality of groups of images; for each group of images, reordering the images in the group of images according to the dominant hue of the images in the group of images to obtain a dominant hue ordering result of the group of images, and determining display information of the group of images according to the dominant hue ordering result, wherein the display information comprises the display area corresponding to each image in the group of images and the display position of each image in the display area; and generating the image display information according to the display information of the plurality of groups of images.

In a possible implementation manner, for the ith group of images, i is an integer greater than 1, and the processing module is specifically configured to: determining a location of a dominant hue in a color wheel for each image in the ith set of images; according to the position of the main tone of each image in the ith group of images in the color wheel, the position of the last 1 image in the ith-1 group of images in the color wheel is taken as a starting point, and the images in the ith group of images are reordered clockwise or anticlockwise according to the color wheel, so that the main tone ordering result of the ith group of images is obtained.

In a sixth aspect, the present application provides an image processing apparatus, and the image display apparatus may be a server or an apparatus provided in the server. The image processing apparatus includes: a processing module and a transceiver module. The processing module is configured to acquire an image set, and generate image display information according to a dominant hue of an image in the image set, where the image display information includes: a display area corresponding to each image in the image set in the first interface and a display position of each image in the display area; the receiving and sending module is configured to send address information of the images in the image set and the image display information to a terminal device, where the image display information is used to instruct the terminal device to display multiple images in the image set in the first interface, the first interface includes at least two display areas, each display area is used to display at least one image, and a dominant hue of an image displayed in each display area is located in the same hue range.

In a possible implementation manner, for the ith group of images, i is an integer greater than 1, and the processing module is specifically configured to: determining a location in a color wheel of a dominant hue for each image in the ith set of images; according to the position of the main tone of each image in the ith group of images in the color wheel, the position of the last 1 image in the ith-1 group of images in the color wheel is taken as a starting point, and the images in the ith group of images are reordered clockwise or anticlockwise according to the color wheel, so that the main tone ordering result of the ith group of images is obtained.

In a possible implementation manner, the transceiver module is further configured to receive a search request, where the search request includes a first search condition; the processing module is specifically configured to acquire the image set according to the first search condition, where images in the image set satisfy the first search condition.

In a possible implementation manner, the transceiver module is further configured to receive a recommendation request, where the recommendation request includes a recommendation type, and the recommendation type is any one of the following: recommending according to the image popularity and recommending according to the favorite features of the user; the processing module is specifically configured to obtain the image set according to the recommendation type.

In a seventh aspect, the present application provides a terminal device, including: a memory and a processor; the processor is configured to be coupled with the memory, read and execute instructions in the memory to implement the method of any one of the first aspect or to implement the method of any one of the second aspect.

In an eighth aspect, the present application provides a server, comprising: a memory and a processor; the processor is configured to be coupled with the memory, read and execute the instructions in the memory, so as to implement the method of any one of the third aspect.

In a ninth aspect, the present application provides a computer readable storage medium having stored thereon computer instructions which, when executed, implement the method of any one of the first aspect, or the method of any one of the second aspect, or the method of any one of the third aspect.

In a tenth aspect, the present application provides a computer program product comprising a computer program that, when executed, performs the method of any one of the first aspect, or the method of any one of the second aspect, or the method of any one of the third aspect.

The application provides an image display method, an image processing device and equipment, wherein the method comprises the following steps: the method comprises the steps that the terminal equipment obtains an image searching instruction, the image searching instruction comprises a first searching condition, and a plurality of images corresponding to the first searching condition are displayed in a first interface according to the image searching instruction, wherein the first interface comprises at least two display areas, each display area is used for displaying at least one image, and the dominant hue of the images displayed in each display area is located in the same hue range. Through the process, images with the same or similar main tones are displayed in the same display area, so that the problem of disordered image display can be solved, and the image display effect is improved. Furthermore, the user can quickly and conveniently position the image required by the user.

Drawings

FIG. 1 is a schematic diagram of an application scenario;

FIG. 2 is a schematic diagram of another application scenario;

FIG. 3 is a schematic diagram of yet another application scenario;

FIG. 4 is a schematic illustration of yet another application scenario;

fig. 5 is a schematic flowchart of an image display method according to an embodiment of the present disclosure;

FIG. 6 is a schematic diagram of a display area provided by an embodiment of the present application;

FIG. 7 is another schematic diagram of a display area provided by an embodiment of the present application;

fig. 8 is a schematic diagram of a color wheel-based hue range provided by an embodiment of the present application;

fig. 9A is a schematic diagram illustrating a display effect of a first interface according to an embodiment of the disclosure;

fig. 9B is a schematic diagram illustrating another display effect of the first interface according to the embodiment of the disclosure;

fig. 9C is a schematic diagram illustrating still another display effect of the first interface according to the embodiment of the disclosure;

FIG. 9D is a schematic diagram illustrating yet another display effect of the first interface according to the embodiment of the application;

fig. 9E is a schematic diagram illustrating still another display effect of the first interface according to the embodiment of the disclosure;

fig. 10 is an interaction flowchart of an image display method according to an embodiment of the present application;

FIG. 11 is a schematic diagram of an image reordering process according to an embodiment of the present disclosure;

FIG. 12 is a diagram illustrating another exemplary process for reordering images according to an embodiment of the present disclosure;

fig. 13 is an interaction flow diagram of another image display method according to an embodiment of the present application;

FIG. 14 is a schematic diagram illustrating an image display effect in an image search scenario according to an embodiment of the present application;

FIG. 15 is a schematic diagram illustrating an image display effect in an image recommendation scene according to an embodiment of the present application;

fig. 16 is a schematic flowchart of another image display method according to an embodiment of the present application;

FIG. 17 is a diagram illustrating an image display effect in a gallery scene according to an embodiment of the present disclosure;

FIG. 18 is a diagram illustrating another image display effect in a gallery scene according to an embodiment of the present application;

FIG. 19 is a diagram illustrating an image display effect in a jigsaw scene according to an embodiment of the present application;

fig. 20 is a schematic structural diagram of an image display device according to an embodiment of the present application;

fig. 21 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application;

fig. 22 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

fig. 23 is a schematic structural diagram of a terminal device according to an embodiment of the present application.

Detailed Description

The image display method provided by the application can be applied to any terminal equipment with an image display function, and the terminal equipment with the image display function comprises but is not limited to: cell-phone, wisdom screen, panel computer, notebook computer etc.. The drawings of the application are all shown by taking a mobile phone as an example.

For convenience of understanding, concepts or terms referred to in the embodiments of the present application are explained first.

Image searching: the system is a professional search engine system which provides retrieval service for related graphic image data on the Internet for users by searching image texts or visual features, and is a subdivision of search engines. In one way, a keyword similar to the name or content of the picture can be input for searching, and this way can be called keyword searching. Alternatively, the search may be performed by uploading images similar to the search results, which may be referred to as "searching the images with the images". Image search may also be referred to as image retrieval.

Image recommendation: the recommendation engine system is used for providing related image resources on the internet for users. The popular images can be recommended to the user according to the image popularity and the click rate, and the images which are possibly interested in the user can be recommended to the user according to the historical browsing behaviors of the user and the favorite features of the user. In some scenarios, the image recommendation may be initiated by the user, for example, the user clicks on "hit recommendations" or "guess you like" to trigger the system to recommend images to the user. In other scenarios, the image recommendation may also be actively recommended to the user by the system without user triggering, for example, the system actively pushes the image recommended to the user in the page during the process of browsing the page by the user.

Image dominant tone: refers to the general tendency of picture colors in an image, and is a large color effect in an image. The dominant hue of an image indicates the hue with the largest proportion in an image.

In one possible representation, the dominant hue of an image may be represented by a percentage of red (R), green (G), and blue (B) components. For example, the keytone of an image may be represented as [2, 52, 62], indicating that the keytone of the image corresponds to a percentage of 2% for the R component, 52% for the G component, and 62% for the B component. It should be noted that the image keytone may have other representation modes, and this embodiment is not limited to this.

In one possible implementation, the dominant hue of the image may be extracted as follows: and carrying out tone clustering processing on each pixel point in the image, and determining the clustering center of the maximum clustering cluster as the dominant tone of the image. The clustering process may employ various clustering algorithms, such as K-Means (K-Means) or other clustering algorithms. Of course, the dominant hue of the image may be extracted in other ways in the application, which is not limited in this embodiment.

Color wheel: the color wheel may also be referred to as a color ring. And connecting the colors end to end according to a preset sequence to form the color wheel. In practical applications, the color wheel may have a plurality of different forms according to different color spaces. In some scenarios, the color wheel may also be referred to as a color wheel. The color wheel may comprise: color wheel 6, color wheel 12, color wheel 24, color wheel 36, color wheel 48, color wheel 72, etc. As the number of colors included in the color wheel is greater, the colors expressed by the color wheel are richer and finer. When there are a sufficient number of colors included in the color wheel, the color wheel may be considered to express successive colors, i.e., each location in the color wheel may correspond to a color. It should be noted that, in the embodiment of the present application, the type of the color wheel is not limited, and in the following drawings, a 6 color wheel is taken as an example for illustration.

In the drawings of the application, when the terminal device is used for illustrating the display effect of an image, the dominant hue of the image is illustrated by adopting filling modes, and different filling modes show that the dominant hue is different. For example, a certain image is filled with left diagonal lines, indicating that the dominant hue of the image is blue; filling a certain image by adopting right oblique lines to indicate that the main tone of the image is purple; and the like.

The method and the device for displaying the multiple images can be applied to scenes in which the terminal device displays the multiple images. Several exemplary application scenarios are presented below.

Example scenario 1: the image searches for scenes.

Fig. 1 is a schematic diagram of an application scenario. Referring to fig. 1, an interface a of a terminal device is provided with an image search entry. The user may enter a search keyword in interface a, for example, entering the keyword "balloon". When the user clicks the "search" button, the terminal device displays the search result in the interface b, that is, displays a plurality of images related to the "balloon" in the interface b. Wherein each rectangular box in the interface b represents an image.

It should be understood that fig. 1 illustrates a process in which a user inputs a keyword to perform an image search. In practical applications, there may be other image searching manners, which are not limited in the embodiments of the present application. For example, the user may input the search condition to the terminal device by a voice instruction. For another example, the user may also input an image to be searched, i.e., "search for an image with an image" to the terminal device.

Generally, the images displayed on the interface b by the terminal device are displayed in an order according to the search relevance. That is, the higher the degree of correlation between an image and a "balloon", the more forward the image is displayed in the interface b. The lower the relevance of an image to a "balloon", the later the image is displayed in interface b. Therefore, images displayed on the interface b are messy, on one hand, the willingness of the user to continue browsing or click further can be influenced, and on the other hand, the user cannot conveniently and quickly locate the needed images.

Example scenario 2: and recommending scenes by the images.

Fig. 2 is a schematic diagram of another application scenario. Referring to fig. 2, an interface a of the terminal device is provided with an image recommendation entry. For example, the user may click "more" of "hit recommendations" to trigger the terminal device to recommend hit images to the user according to the image popularity. For another example, the user may click on "more" of "guess you like" to trigger the terminal device to recommend images to the user that may be of interest to the user based on the user's preference characteristics. Taking the hot recommendation as an example, when the user clicks more of the hot recommendations in the interface a, the terminal device is triggered to jump to the interface b, and a plurality of images recommended to the user are displayed in the interface b. Wherein each rectangular box in interface b in fig. 2 represents an image.

It should be understood that, there may be a variety of ways for the terminal device to recommend an image to the user, which is not limited in this embodiment of the application, and fig. 2 is only one possible example.

Similar to the image search scenario shown in fig. 1, in the image recommendation scenario, the images displayed in the interface b by the terminal device are displayed in order according to the recommendation relevance. For example, in the "hot recommendation", the image with higher heat is displayed at a position closer to the front in the interface b. In the "guess you like" recommendation, the higher the similarity of the image to the user's favorite feature, the more forward the image is displayed in the interface b. Therefore, images displayed on the interface b are messy, which can influence the user's desire to continue browsing or further click on the one hand, and on the other hand, the user cannot conveniently and quickly locate images in which the user is interested.

Example scenario 3: gallery/theme-gallery scenes.

Fig. 3 is a schematic diagram of another application scenario. Taking a gallery as an example, referring to fig. 3, when a user clicks a "gallery" icon in a main interface a of the terminal device, the terminal device is triggered to jump to an interface b, and an image in the gallery is displayed in the interface b. Wherein each rectangular box in the interface b represents an image.

Generally, the images displayed in the interface b are displayed in the order of the image capturing/receiving time. Therefore, images displayed on the interface b are messy, which can affect the willingness of the user to continue browsing or further clicking on the one hand, and on the other hand, the user cannot conveniently and quickly locate the images needed by the user.

Example scenario 4: and (5) splicing scenes.

Fig. 4 is a schematic diagram of another application scenario. Referring to fig. 4, when a user clicks a "gallery" icon in a main interface a of the terminal device, the terminal device is triggered to jump to an interface b, and an image in the gallery is displayed in the interface b. Wherein each rectangular box in the interface b represents an image. With continued reference to FIG. 4, a user may select a plurality of images in a gallery for authoring. For example, the user selects 9 images in the interface c, and when the user clicks the "create" button, the terminal device generates a puzzle from the 9 images selected by the user, and the resulting puzzle is shown as an interface d in fig. 4. The user may click the "save" button to save the generated mosaic.

In general, as shown in an interface d in fig. 4, in a puzzle generated by a terminal device, images are arranged and displayed in an order in which a user selects the images in the interface c, so that the images in the puzzle are disordered and the puzzle effect is poor.

It should be noted that, besides the above exemplary scenarios, the image display method provided in the present application may also be used in other more scenarios, and the embodiments of the present application are not illustrated in a specific example.

In summary, in each of the above scenarios, when the terminal device displays a plurality of images, the images are usually displayed according to a certain fixed sorting manner, so that the images displayed in the image display interface are relatively disordered, and the image display effect is poor. Further, the user's will be influenced to continue browsing or click further, and the desired image cannot be located quickly.

In order to solve the technical problem, the present application provides an image display method, when a terminal device displays a plurality of images, images having the same or similar keytones may be displayed in the same display area, so that the problem of disordered image display may be solved, and the image display effect may be improved. Furthermore, the user can quickly and conveniently locate the required image.

The image display method provided by the present application will be described below with reference to several specific examples. The following embodiments may be combined with each other and are not described in detail with respect to the same or similar concepts or processes.

Fig. 5 is a flowchart illustrating an image display method according to an embodiment of the present application. The method of the present embodiment can be applied to the image search scene described above. The method of the embodiment may be performed by a terminal device. As shown in fig. 5, the method of the present embodiment includes:

s501: an image search instruction is obtained, and the image search instruction comprises a first search condition.

With reference to the application scenario shown in fig. 1, when the terminal device detects that the user clicks "search", the terminal device obtains an image search instruction. The image search instruction is used for instructing the terminal equipment to search out the image meeting the first search condition. It should be understood that the manner in which the terminal device obtains the image search instruction may be various. When the manner of acquiring the image search instruction is different, the corresponding first search condition may also be different.

For example, in one embodiment, the first search condition may be a keyword input by the user in the interface a shown in fig. 1. In another embodiment, the first search condition may be an image to be searched input by the user, and the image to be searched may be an image stored in the terminal device or an image photographed by the user through the terminal device. In still another embodiment, the first search condition may also be a search condition input by the user to the terminal device in a form of voice.

S502: displaying a plurality of images corresponding to the first search condition in a first interface according to the image search instruction; the first interface comprises at least two display areas, each display area is used for displaying at least one image, and the main tone of the image displayed in each display area is located in the same tone range.

The first interface is used for displaying the search result to the user. For example, the first interface may be interface b in fig. 1. A plurality of images in the search results may be displayed in the first interface. For convenience of description, the present embodiment refers to an area for displaying one image in the first interface as one image bit. The first interface may be divided into M x K image bits, such that M x K images may be displayed in each screen of the first interface. Wherein M and K are both integers greater than 1. For example, interface b of fig. 1 may display M =5 lines of images, and each line may display K =3 images.

In this embodiment, the first interface includes at least two display regions, each of which may be used to display one or more images. That is, one or more image bits may be included in each display region. It should be noted that the present embodiment is not limited to the size and shape of each display region (i.e., the number of image bits included in each display region, and the positional relationship between the image bits included in each display region). Illustratively, one display area may be a rectangular area or a non-rectangular area.

The display area is illustrated below with reference to fig. 6 and 7.

Fig. 6 is a schematic diagram of a display area according to an embodiment of the present application. As shown in FIG. 6, a display area may include an image bit, such as display area 64 in FIG. 6. A display area may also include multiple image bits, such as display area 61, display area 62, display area 63 in fig. 6. With continued reference to fig. 6, the display area 61, the display area 62, and the display area 64 shown in fig. 6 are rectangular areas, and the display area 63 is a non-rectangular area.

In one possible implementation manner, each display area in the first interface may be a rectangular area, and the rectangular area is used for displaying N lines of images. Wherein N is an integer greater than or equal to 1. Fig. 7 is another schematic diagram of a display area provided in an embodiment of the present application. As shown in fig. 7, the area in the first interface where each line of images is displayed is regarded as one display area, and thus the first interface is divided into 5 display areas, which are a display area 71, a display area 72, a display area 73, a display area 74, and a display area 75. The implementation mode is suitable for the terminal equipment supporting the sliding browsing along the up-down direction.

In another possible implementation manner, each display area in the first interface may be a rectangular area, and the rectangular area is used for displaying N columns of images. Wherein N is an integer greater than or equal to 1. The implementation mode is suitable for the terminal equipment supporting the sliding browsing along the left and right directions.

In the embodiment of the present application, the dominant tone of the image displayed in each display region is located in the same tone range. In other words, the keytone of the image displayed in each display region is the same or similar. For example, a plurality of hue ranges may be divided based on a color wheel, and fig. 8 is a schematic diagram of the hue ranges based on the color wheel according to the embodiment of the present application. As shown in fig. 8, the color wheel can be divided into: red hue range, orange hue range, yellow hue range, green hue range, cyan hue range, blue hue range, violet hue range. Wherein each hue range comprises a plurality of similar hues. Fig. 8 is only an illustration of one color tone division, and is not limited. In practical applications, there may be a plurality of dividing manners of the hue range, or more hue ranges may be divided based on the color wheel.

Next, taking the dividing manner of the display area described in fig. 7 as an example, several possible display effects of the first interface in the embodiment of the present application are illustrated.

Fig. 9A is a schematic diagram illustrating a display effect of a first interface according to an embodiment of the present disclosure. As shown in fig. 9A, the keytone of the respective images displayed in each display region is located in the same tone range. For example, the keytone of each image displayed in the display area 71 is located in the blue tone range, the keytone of each image displayed in the display area 72 is located in the red tone range, the keytone of each image displayed in the display area 73 is located in the purple tone range, the keytone of each image displayed in the display area 74 is located in the green tone range, and the keytone of each image displayed in the display area 75 is located in the yellow tone range.

It can be understood that, since the dominant hue of the image displayed in each display region is in the same hue range, the image in each display region is arranged neatly and beautifully, and therefore the display effect of the first interface on the image can be improved.

In one possible implementation manner, the hue ranges corresponding to the at least two display regions are arranged according to a preset hue order. Wherein the preset tone order may be a tone order defined in advance.

Optionally, the preset color tone sequence is a color tone sequence indicated by the color wheel in the clockwise direction. That is, the hue ranges corresponding to the at least two display regions are arranged in the hue order indicated by the color wheel in the clockwise direction.

Fig. 9B is a schematic diagram of another display effect of the first interface according to the embodiment of the present application. As shown in fig. 9B, for example, it is assumed that the hue ranges corresponding to the five display regions in the first interface are: the blue tone range, the green tone range, the red tone range, the purple tone range, and the yellow tone range are arranged in the tone order indicated by the color wheel in the clockwise direction, the image with the main tone in the blue tone range is displayed in the 1 st display region (i.e., display region 71) of the first interface, the image with the main tone in the purple tone range is displayed in the 2 nd display region (i.e., display region 72), the image with the main tone in the red tone range is displayed in the 3 rd display region (i.e., display region 73), the image with the main tone in the yellow tone range is displayed in the 4 th display region (i.e., display region 74), and the image with the main tone in the green tone range is displayed in the 5 th display region (i.e., display region 75).

Optionally, the preset color tone sequence is a color tone sequence indicated by the counterclockwise direction of the color wheel. That is, the hue ranges corresponding to the at least two display regions are arranged in the hue order indicated by the counterclockwise direction of the color wheel.

Fig. 9C is a schematic diagram of another display effect of the first interface according to the embodiment of the present application. As shown in fig. 9C, for example, it is assumed that the hue ranges corresponding to the five display regions in the first interface are: the blue tone range, the green tone range, the red tone range, the purple tone range, and the yellow tone range are arranged in the tone order indicated by the counterclockwise direction of the color wheel, the image with the main tone in the blue tone range is displayed in the 1 st display region (i.e., display region 71) of the first interface, the image with the main tone in the green tone range is displayed in the 2 nd display region (i.e., display region 72), the image with the main tone in the yellow tone range is displayed in the 3 rd display region (i.e., display region 73), the image with the main tone in the red tone range is displayed in the 4 th display region (i.e., display region 74), and the image with the main tone in the purple tone range is displayed in the 5 th display region (i.e., display region 75).

It should be understood that, since the color wheel is obtained by arranging the color tones according to the human visual perception features of different color tones, in the first interface, the color tone ranges corresponding to different display areas are arranged according to the color tone sequence indicated by the clockwise/counterclockwise directions of the color wheel, so that when a user views an image in the first interface, the user does not feel excessive jump in color tone, thereby further improving the display effect of the first interface on the image.

It should be noted that, the above example is exemplified by taking a one-screen display effect of the first interface as an example. In some scenarios, when the number of images meeting the first search condition is large, the terminal device cannot completely display all images meeting the first search condition in one screen, and thus, multiple screens are required to be displayed, that is, a user is required to slide the first interface up and down or slide the first interface left and right to perform multiple-screen browsing. In this scenario, each screen may be displayed according to the above example. Specifically, the plurality of display regions in each screen may be arranged in a tone order indicated by the clockwise/counterclockwise direction of the color wheel. Therefore, the effect that the tone ranges corresponding to different display areas are circularly arranged according to the preset tone sequence is integrally realized, and the image display effect of the first interface is further improved.

In one possible implementation manner, for each display area in the first interface, when the number of images displayed by the display area is multiple, the main tones of the images displayed in the display area are arranged according to a preset tone sequence.

Optionally, the preset color tone sequence is a color tone sequence indicated by the color wheel in the clockwise direction. That is, the keytones of the image displayed in each display region are arranged in the tone order indicated in the clockwise direction of the color wheel. Fig. 9D is a schematic diagram of another display effect of the first interface according to the embodiment of the present application. For example, taking the 1 st display area in the first interface as an example, the display area corresponds to a blue tone range, and the display area needs to display the image a, the image B, and the image C. The positions of the main tones of the 3 images in the color wheel are shown in fig. 9D, and the display order of the 3 images in the 1 st display region is, according to the tone order indicated by the color wheel in the clockwise direction: image a, image C, and image B.

Optionally, the preset color tone sequence is a color tone sequence indicated by the counterclockwise direction of the color wheel. That is, the keytones of the image displayed in each display region are arranged in the tone order indicated by the counterclockwise direction of the color wheel. Fig. 9E is a schematic diagram of another display effect of the first interface according to the embodiment of the present application. For example, taking the 5 th display area in the first interface as an example, the display area corresponds to a purple range, and the display area needs to display the image D, the image E, and the image F. The positions of the main tones of the 3 images in the color wheel are shown in fig. 9E, and the display order of the 3 images in the 5 th display area is, according to the tone order indicated by the counterclockwise direction of the color wheel: image F, image D, and image E.

The color wheel is obtained by arranging the hues according to the visual perception characteristics of human beings on different hues, so that the main hues of the images in each display area are arranged according to the hue sequence indicated by the clockwise/anticlockwise direction of the color wheel, and a user cannot feel excessive jump of the hues when watching the images in each display area, thereby further improving the display effect of the first interface on the images.

The image display method provided by the embodiment comprises the following steps: the terminal device obtains an image searching instruction, the image searching instruction comprises a first searching condition, and a plurality of images corresponding to the first searching condition are displayed in a first interface according to the image searching instruction, wherein the first interface comprises at least two display areas, each display area is used for displaying at least one image, and the main tone of the image displayed in each display area is located in the same tone range. Through the process, images with the same or similar main tones are displayed in the same display area, so that the problem of disordered image display can be solved, and the image display effect is improved. Furthermore, the user can quickly and conveniently locate the required image.

On the basis of the above-described embodiment shown in fig. 5, the embodiment shown in fig. 5 is described in more detail below with reference to several possible implementations.

Fig. 10 is an interaction flow diagram of an image display method according to an embodiment of the present application. The method of the embodiment can be executed by the terminal device and the server interactively. As shown in fig. 10, the method of the present embodiment includes:

s1001: the terminal equipment acquires an image searching instruction, wherein the image searching instruction comprises a first searching condition.

It should be understood that the specific implementation process of S1002 is similar to S501 in fig. 5, and is not described herein again.

S1002: and the terminal equipment sends a search request to a server, wherein the search request comprises the first search condition.

In this embodiment, the server is provided with an image search engine and an image database. After the terminal device obtains the image searching instruction, the first searching condition is carried into the searching request and sent to the server, so that an image searching engine of the server can perform image searching processing on the image database according to the first searching condition.

In a possible implementation manner, the step of sending, by the terminal device, the search request to the server may further include: and displaying parameters of a first interface of the terminal equipment. For example, the display parameters of the first interface may include: the number of images displayed on one screen of the first interface and/or the number of images displayed per row or per column of the first interface.

The display parameters of the first interface are carried in the search request, so that the server can know the display layout condition of the terminal equipment to the images in the first interface, and then the server can reorder the images in the image set based on the display layout condition in the subsequent process, thereby achieving the purpose of improving the image display effect.

S1003: and the server carries out image searching processing according to the searching request to obtain an image set, wherein the images in the image set meet the first searching condition.

Specifically, the server performs an image search process using an image search engine, and searches an image database for an image satisfying a first search condition. These images satisfying the first search condition constitute the above-described image set. It should be noted that, in this embodiment, a specific search process of the image search engine is not limited, and the search may be performed by using an existing image search processing method.

In some possible implementation manners, the server performs image search processing according to the search request to obtain an image set and a first ordering result corresponding to the image set. The first ranking result is a ranking result obtained by ranking the images in the image set according to the order of the degree of correlation between the first ranking result and the first search condition from high to low. For example, if the image set obtained by the image search engine through the search process includes 1000 images, the correlation between the first image and the first search condition in the image set is the highest, the correlation between the second image and the first search condition is the second, and so on, the correlation between the 1000 th image and the first search condition is the lowest.

S1004: the server generates image display information from the dominant hue of the images in the image set, the image display information comprising: the display area of each image in the image set in the first interface corresponds to the display position of each image in the display area.

In this embodiment, the server generates the image display information not directly from the first ordering result corresponding to the image set, but from the keytones of the images in the image set. The image display information comprises a corresponding display area of each image in the image set in the first interface and a display position of each image in the display area. Because the server generates the image display information according to the dominant tone of the image, when the terminal device displays a plurality of images in the image set according to the image display information, the dominant tone of the image displayed in each display area is in the same tone range.

In one possible implementation, the server may generate the image display information as follows.

(1) And according to the first sequencing result corresponding to the image set, carrying out grouping processing on the images in the image set to obtain a plurality of groups of images.

For example, according to the first sorting result corresponding to the image set, the adjacent preset number of images may be divided into one group to obtain multiple groups of images. The preset number may be a preset fixed value, or a dynamic value determined adaptively according to an actual application scenario.

Optionally, under the condition that the search request sent by the terminal device to the server carries the display parameter of the first interface, the value of the preset number may be determined according to the display parameter of the first interface. In one example, assuming that 3 images are displayed per line in the first interface, the preset number may be determined as a multiple of 3, for example, the preset number may be 6, 9, 12, 15, 18, 24, and so on. In another example, the number of display images per screen in the first interface may be determined as a preset number. For example, assuming that the first interface displays 15 images per screen, the preset number may be determined to be 15.

Optionally, in some cases, before the terminal device interacts with the server, the server may already know the display parameters of the first interface in advance, in this case, the terminal device may not carry the display parameters of the first interface in the search request sent to the server, and the server determines the value of the preset number according to the parameters of the first interface known in advance. Similar to the above examples, further description is omitted here.

In the two modes, the value of the preset number (namely the number of the images in each group) is determined according to the display parameters of the first interface, so that the grouping result is more reasonable, and further, the image reordering processing is performed based on the reasonable grouping result in the subsequent process, so that the image display effect can be improved.

Optionally, the server may count a distribution of the dominant hue of each image in the image set, and determine a value of the preset number according to the distribution. For example, if the dominant hue distribution of each image in the image set is more concentrated, the preset number of values may be determined as a smaller value. If the dominant hue distribution of each image in the image set is relatively dispersed, the value of the preset number can be determined as a larger value.

In the mode, the reasonability of the grouping results under different search scenes is ensured by adaptively determining the values of the preset number (namely the number of the images in each group), and further, the image reordering processing is carried out in the subsequent process based on the reasonable grouping results, so that the image display effect can be improved.

(2) And for each group of images, reordering the images in the group of images according to the dominant hue of the images in the group of images to obtain a dominant hue ordering result of the group of images, and determining display information of the group of images according to the dominant hue ordering result, wherein the display information comprises the display area corresponding to each image in the group of images and the display position of each image in the display area.

For the first set of images, the dominant tone ordering result for the first set of images may be determined as follows: the position of the dominant hue in the color wheel for each image in the first set of images is determined. According to the position of the main tone of each image in the first group of images in the color wheel, with the position of the 1 st image in the first group of images in the color wheel as a starting point, reordering the images in the first group of images according to the clockwise or counterclockwise direction of the color wheel, and obtaining the main tone ordering result of the first group of images.

For the ith group of images (i being an integer greater than 1), the dominant tone ordering result for the ith group of images may be determined as follows: determining the position of the dominant hue of each image in the ith group of images in the color wheel; and according to the position of the main tone of each image in the ith group of images in the color wheel, taking the position of the last 1 image in the ith-1 group of images in the color wheel as a starting point, and carrying out reordering processing on the images in the ith group of images in the clockwise or anticlockwise direction of the color wheel to obtain the main tone ordering result of the ith group of images.

The image reordering process described above will be exemplified with reference to fig. 11. Fig. 11 illustrates the color wheel in a clockwise direction as an example.

Fig. 11 is a schematic diagram of an image reordering process according to an embodiment of the present disclosure. As shown in fig. 11, it is assumed that 15 images are included in each group of images after grouping. The first group of images sequentially have the following according to a first ordering result (namely, the result ordered according to the correlation degree with the first search condition from high to low): image 1, image 2, image 3, image 4, image 5, image 6, image 7, image 8, image 9, image 10, image 11, image 12, image 13, image 14, image 15. The second group of images sequentially comprises the following images according to the first sequencing result: image 16, image 17, image 18, image 19, image 20, image 21, image 22, image 23, image 24, image 25, image 26, image 27, image 28, image 29, image 30.

For the first set of images, the positions of the keytones of images 1 to 15 in the color wheel are determined, respectively, as shown in fig. 11. Taking the position of the image 1 in the main tone in the color wheel as a starting point, and reordering the first group of images clockwise according to the color wheel to obtain a main tone ordering result of the first group of images, wherein the main tone ordering result sequentially comprises the following steps: image 1, image 12, image 13, image 11, image 3, image 15, image 2, image 8, image 6, image 5, image 7, image 9, image 10, image 14, image 4.

Further, the display information of the group of images may be determined according to the dominant hue ordering result of the group of images and the display parameter of the first interface according to a preset principle. The display information of the group of images comprises a corresponding display area of each image in the group of images in the first interface and a display position of each image in the display area. That is, the image bits of the several rows and several columns of each image in the group of images in the first interface are determined to be displayed. Wherein, the preset principle may include: the main tones of the images displayed in each line in the first interface are located in the same tone range, the main tones of the images displayed in each line are arranged according to the tone sequence indicated by the clockwise direction of the color wheel, and the tone ranges corresponding to different lines are arranged according to the tone sequence indicated by the clockwise direction of the color wheel. Through the above process, the display scheme of the first group of images is finally determined, which can be seen in fig. 11.

For the second set of images, the positions of the keytones of the images 16 to 30, respectively, in the color wheel are determined, as shown in fig. 11. Taking the position of the main tone of the last image (namely the image 4) in the first group of images in the color wheel as a starting point, and reordering the second group of images according to the clockwise direction of the color wheel to obtain the main tone ordering result of the second group of images, wherein the main tone ordering result sequentially comprises the following steps: image 27, image 29, image 18, image 16, image 20, image 28, image 21, image 17, image 23, image 19, image 30, image 26, image 25, image 22, image 24.

Further, the display information of the group of images can be determined according to the dominant hue sorting result of the group of images and the display parameter of the first interface according to a preset principle. The display information of the group of images comprises a corresponding display area of each image in the group of images in the first interface and the display position of each image in the display area. That is, the image bits of the row and the column in the first interface of each image in the group of images are determined to be displayed. Wherein, the preset principle may include: the main tones of the images displayed in each line in the first interface are located in the same tone range, the main tones of the images displayed in each line are arranged according to the tone sequence indicated by the clockwise direction of the color wheel, and the tone ranges corresponding to different lines are arranged according to the tone sequence indicated by the clockwise direction of the color wheel. Through the above process, the display scheme of the second group of images is finally determined, as shown in fig. 11.

With continued reference to fig. 11, in the finally determined image display scheme, within each group of images, the keytones of the images displayed in each row are located in the same tone range, and the keytones of the images displayed in each row are arranged according to the tone order indicated by the color wheel in the clockwise direction, and the tone ranges corresponding to different rows are arranged according to the tone order indicated by the color wheel in the clockwise direction. Moreover, when the ith group (i is an integer larger than 1) of images are reordered, the position of the last 1 image in the ith-1 group of images in the color wheel is taken as a starting point, so that the main tone transition of the ith group of images and the ith-1 group of images is smooth, and the condition of image tone jump cannot occur in the first interface. Therefore, when a user slides up and down to browse the multi-screen images, the tone ranges are circularly arranged according to the tone sequence indicated by the clockwise direction of the color wheel, and the image display effect of the first interface is further improved.

Fig. 11 is a schematic diagram illustrating an example of a reordering process of a first group of pictures and a second group of pictures. It should be understood that the reordering process for the third and subsequent groups is similar to the reordering process for the second group and is not illustrated.

(3) And generating the image display information according to the display information of the plurality of groups of images.

Specifically, the image display information is generated by merging the display information of the plurality of sets of images.

In this embodiment, when determining the image display information, the images in the image set are first grouped according to the first ordering result corresponding to the image set (i.e., the ordering result of the correlation between the images and the first search condition), so as to obtain a plurality of groups of images, and within each group of images, the images in the group of images are reordered according to the dominant hue of the images in the group of images, so that the optimization of the image display effect is achieved on the basis of substantially retaining the original first ordering. Therefore, when the first interface presents the search result, the general search relevancy information still remains, and the efficiency of positioning the required image in the search result by the user is not reduced.

The above describes a process of reordering each group of images based on the tone order indicated by the color wheel in the clockwise direction or the counterclockwise direction. In practical application, in order to retain the search correlation information to the greatest extent, reordering processing may be performed on each group of images based on the appearance sequence of the tones in the original first ordering result. This is illustrated below with reference to fig. 12.

Fig. 12 is a schematic diagram of another image reordering process according to an embodiment of the present application. As shown in fig. 11, it is assumed that 15 images are included in each group of images after grouping. The first group of images in the first ranking order (i.e. the results ranked from high to low in correlation with the first search criteria) are: image 1, image 2, image 3, image 4, image 5, image 6, image 7, image 8, image 9, image 10, image 11, image 12, image 13, image 14, image 15. The second group of images are sequentially as follows according to the first sequencing result: image 16, image 17, image 18, image 19, image 20, image 21, image 22, image 23, image 24, image 25, image 26, image 27, image 28, image 29, image 30.

For the first group of images, the tone range corresponding to the dominant tone of each image in the group of images and the appearance sequence of each tone range are counted. For example, referring to fig. 12, assume that the dominant hue of each image in the first set of images corresponds to a hue range as follows: image 1 (blue tone range), image 2 (red tone range), image 3 (violet tone range), image 4 (green tone range), image 5 (yellow tone range), image 6 (red tone range), image 7 (yellow tone range), image 8 (red tone range), image 9 (yellow tone range), image 10 (green tone range), image 11 (violet tone range), image 12 (blue tone range), image 13 (blue tone range), image 14 (green tone range), and image 15 (violet tone range). The appearance sequence of each tone range is as follows: blue hue range, red hue range, purple hue range, green hue range, yellow hue range. Therefore, when the images of the first group are reordered, the tone ranges corresponding to different lines in the first interface can be sequentially arranged according to the sequence. For example, referring to FIG. 12, the dominant hue for the line 1 image is in the blue hue range, the dominant hue for the line 2 image is in the red hue range, the dominant hue for the line 3 image is in the purple hue range, the dominant hue for the line 4 image is in the green hue range, and the dominant hue for the line 5 image is in the yellow hue range.

And for the second group of images, counting the tone range corresponding to the dominant tone of each image in the group of images and the appearance sequence of each tone range. For example, referring to fig. 12, assume that the dominant hue of each image in the second set of images corresponds to a hue range as follows: image 16 (violet tone range), image 17 (red tone range), image 18 (blue tone range), image 19 (yellow tone range), image 20 (violet tone range), image 21 (red tone range), image 22 (green tone range), image 23 (red tone range), image 24 (green tone range), image 25 (green tone range), image 26 (yellow tone range), image 27 (blue tone range), image 28 (violet tone range), image 29 (blue tone range), image 30 (yellow tone range). The appearance sequence of each tone range is as follows: violet hue range, red hue range, blue hue range, yellow hue range, green hue range. Therefore, when the images of the second group are reordered, the tone ranges corresponding to different lines in the first interface can be sequentially arranged according to the sequence. For example, referring to fig. 12, the keytone of the image of line 1 is in the purple tone range, the keytone of the image of line 2 is in the red tone range, the keytone of the image of line 3 is in the blue tone range, the keytone of the image of line 4 is in the yellow tone range, and the keytone of the image of line 5 is in the green tone range.

In the example shown in fig. 12, inside each group of images, the hue ranges corresponding to different rows are arranged according to the sequence of appearance of the hue ranges in the group of images, so that the first ordering result is less damaged, and the optimization of the image display effect is realized on the basis of keeping the original first ordering as much as possible.

It should be noted that, in practical applications, the reordering processes shown in fig. 11 and fig. 12 can also be used in combination. For example, the reordering process shown in fig. 12 is used for a first group of images, and the reordering process shown in fig. 11 is used for a second and subsequent groups. Of course, other combinations are possible and are not illustrated here.

S1005: and the server sends the address information of the images in the image set and the image display information to the terminal equipment.

The address information of the image may refer to Uniform Resource Locator (URL) information of the image.

In one example, the server may transmit the address information of the images in the image set and the image display information to the terminal device in the following form.

“image_list”:[

{“img_url”:“http//:…jpg”,“rank”:0,“location_group”:“0”},

{“img_url”:“http//:…jpg”,“rank”:1,“location_group”:“0”},

{“img_url”:“http//:…jpg”,“rank”:2,“location_group”:“0”},

{“img_url”:“http//:…jpg”,“rank”:0,“location_group”:“1”},

{“img_url”:“http//:…jpg”,“rank”:1,“location_group”:“1”},

{“img_url”:“http//:…jpg”,“rank”:2,“location_group”:“1”},

……

{“img_url”:“http//:…jpg”,“rank”:2,“location_group”:“334”}

]

Where img _ URL represents URL information of an image. The location _ group represents the identifier of the display area corresponding to the image, and rank represents the display position of the image in the display area, i.e. the identifier of the image position.

S1006: and the terminal equipment acquires the image set according to the address information of the images in the image set.

The terminal device may download each image from the database according to the address information of each image, thereby obtaining the image set.

S1007: and the terminal equipment displays a plurality of images in the first interface according to the image display information, wherein the plurality of images are all images or partial images in the image set.

The plurality of images are images displayed on one screen of the terminal equipment. Taking the example that the terminal device displays 15 images per screen, if the number of images in the image set is less than or equal to 15, the terminal device displays all images in the image set in the first interface. If the image in the image set is larger than 15, the terminal device displays the partial image in the image set in the first interface. Specifically, the terminal device may display the first 15 images (i.e., images whose location _ group is 0, 1, 2, 3, and 4) in the first screen of the first interface according to the image display information. And when the sliding operation of the user in the first interface is detected, displaying subsequent images according to the sliding operation of the user.

In the implementation shown in fig. 10, after the server searches for the image set according to the search request, the server performs reordering processing on the images in the image set according to the keytones of the images in the image set. In another possible implementation manner, the foregoing reordering process may also be performed by a terminal device. This is explained in detail below with reference to fig. 13.

Fig. 13 is an interaction flow diagram of another image display method according to an embodiment of the present application. The method of the embodiment can be executed by the terminal device and the server interactively. As shown in fig. 13, the method of the present embodiment includes:

s1301: the terminal equipment acquires an image searching instruction, wherein the image searching instruction comprises a first searching condition.

S1302: and the terminal equipment sends a search request to a server, wherein the search request comprises the first search condition.

S1303: and the server carries out image searching processing according to the searching request to obtain an image set, wherein the images in the image set meet the first searching condition.

S1304: the server sends the address information of the images in the image set to the terminal equipment.

In this embodiment, the specific implementation processes of S1301 to S1304 are similar to those of the embodiment shown in fig. 10, and are not described herein again. In the present embodiment, the terminal device performs the reordering process, so that the server searches for the image set and then directly sends the address information of the images in the image set to the terminal device. The server does not need to perform the work of packet reordering, so that the terminal device does not need to carry the display information of the first interface in the search request sent to the server.

S1305: and the terminal equipment acquires the image set according to the address information, and the images in the image set are arranged according to the correlation degree with the first search condition.

S1306: the terminal equipment determines the image display information according to the dominant hue of the images in the image set, and the image display information comprises: the display area corresponding to each image in the image set and the display position of each image in the display area.

It should be understood that the process of determining the image display information by the terminal device is similar to the process of generating the image display information by the server in the embodiment shown in fig. 10, and may refer to the specific description of S1004 in fig. 10, which is not described herein again.

S1307: and the terminal equipment displays the plurality of images in the first interface according to the image display information, wherein the plurality of images are all images or partial images in the image set.

As an example, fig. 14 is a schematic diagram of an image display effect in an image search scene according to an embodiment of the present application. As shown in fig. 14, an interface a of the terminal device is provided with an image search entry. The user may enter a search keyword in interface a, for example, the keyword "balloon". When the user clicks the "search" button, the terminal device displays the search result in the interface b, that is, displays a plurality of images related to the "balloon" in the interface b. Wherein, the images in the interface b are arranged according to the image main tone. Specifically, one line is taken as one display region. The keytone of the image in each display area is located in the same tone range (i.e. the keytone of the image in each display area is the same or similar), the keytone of the image in each display area is arranged according to the tone sequence indicated by the clockwise/anticlockwise direction of the color wheel, and the tone ranges corresponding to different display areas are circularly arranged according to the tone sequence indicated by the clockwise/anticlockwise direction of the color wheel. Therefore, the image in the interface b has rich tone and excessively harmonious tone, and the display effect of the interface b on the image is better. Furthermore, the willingness of the user to continue browsing or click can be improved, so that the user can conveniently and quickly position the image required by the user.

The embodiments shown in fig. 5 to 14 described above are applied to the image search scene. The above embodiments are also applicable to image recommendation scenarios, and the implementation principles thereof are similar. Specifically, the terminal device sends a recommendation request to the server. The recommendation request carries a recommendation type, and the recommendation type may be any one of the following types: recommending according to the image popularity and recommending according to the user preference characteristics. And after receiving the recommendation request, the server acquires an image set from the database by using an image recommendation engine, wherein the images in the image set are images to be recommended to the user. The images in the image set are arranged according to the image heat, or the images in the image set are arranged according to the similarity with the user preference characteristics.

The server generates image display information according to the dominant hue of the images in the image set, and sends the address information and the image display information of each image in the image set to the terminal equipment. And the terminal equipment acquires the image set according to the address information and displays a plurality of images in the first interface according to the image display information. Or

The server sends the address information of the images in the image set to the terminal equipment, and the terminal equipment acquires the image set according to the address information and determines image display information according to the main tone of each image in the image set. Further, the terminal device displays a plurality of images in the first interface according to the image display information.

The embodiment does not describe in detail the specific implementation manner in the image recommendation scene, and reference may be made to the detailed description of the embodiments shown in fig. 5 to fig. 14. As an example, fig. 15 is a schematic diagram of an image display effect in an image recommendation scene according to an embodiment of the present application. As shown in fig. 15, the interface a of the terminal device is provided with an image recommendation entry. For example, the user may click "more" of "hit-and-shoot recommendations" to trigger a hit-and-shoot image recommendation to the user based on the image popularity. For another example, the user may click on "more" of "guess you like" to trigger the terminal device to recommend images to the user that may be of interest to the user based on the user's preference characteristics. Taking the hot recommendation as an example, when the user clicks more of the hot recommendations in the interface a, the terminal device is triggered to jump to the interface b, and a plurality of images recommended to the user are displayed in the interface b. Wherein, the images in the interface b are arranged according to the image main tone. Specifically, one line is taken as one display region. The keytone of the image in each display area is located in the same tone range (i.e. the keytone of the image in each display area is the same or similar), the keytone of the image in each display area is arranged according to the tone sequence indicated by the clockwise/anticlockwise direction of the color wheel, and the tone ranges corresponding to different display areas are circularly arranged according to the tone sequence indicated by the clockwise/anticlockwise direction of the color wheel. Therefore, the image in the interface b has rich tone and excessively harmonious tone, and the display effect of the interface b on the image is better. Furthermore, the willingness of the user to continue browsing or click further can be improved, so that the user can conveniently and quickly locate the image in which the user is interested.

Fig. 16 is a schematic flowchart of another image display method according to an embodiment of the present application. The method of the present embodiment can be applied to the aforementioned gallery/theme-gallery scenes. The method of the present embodiment may be performed by a terminal device. As shown in fig. 16, the method of the present embodiment includes:

s1601: images in the image library are displayed in a first display order in the first interface.

The image library may be a gallery or a subject library. The first interface may be a display interface for displaying images in the image library, for example, the first interface may be interface b in fig. 3.

In this embodiment, the first display order may be any one of the following: the image selecting method comprises the steps of image shooting time sequence, image receiving time sequence, image selecting time sequence, image and preset condition correlation sequence and preset tone sequence.

When the terminal device displays the images in the image library in the first interface according to the sequence of the image shooting time, the sequence of the image receiving time, the sequence of the image selection time, or the sequence of the correlation between the images and the preset conditions, the display effect of the terminal device can be shown in an interface b in fig. 3.

When the terminal device displays the images in the image library in the first interface in the preset tone sequence, the first interface includes a plurality of display areas, each display area is used for displaying one or more images, the dominant tone of the image displayed in each display area is located in the same tone range, and the display effect thereof can be as shown in fig. 9A to 9E, or as shown in interface b in fig. 14.

S1602: and acquiring an image rearrangement instruction.

In this embodiment, the image rearrangement instruction is used to instruct the image in the image library to be rearranged and displayed.

In a possible implementation manner, when the terminal device detects a first user operation in the first interface, the terminal device acquires an image rearrangement instruction. Wherein, the first user operation may be any one of the following operations: icon clicking operation, interface zooming operation, and image screening operation.

In a possible implementation manner, the terminal device acquires the image rearrangement instruction when detecting that the number of images in the image library changes. The changing of the number of images in the image library may include: the number of images increases and the number of images decreases.

S1603: displaying the images in the image library in a second display order in the first interface according to the image rearrangement instruction; when the images in the image library are displayed in the second display sequence, the first interface comprises at least two display areas, each display area is used for displaying at least one image, and the main tone of the image displayed in each display area is located in the same tone range.

In this embodiment, when the terminal device acquires the image rearrangement instruction, the terminal device triggers the image rearrangement in the image library, and displays the images in the image library in the second display order. The second display order is determined according to the dominant hue of the image. When the images in the image library are displayed in the second display sequence, the first interface comprises at least two display areas, each display area is used for displaying at least one image, and the main tone of the image displayed in each display area is located in the same tone range.

In one possible implementation manner, the hue ranges corresponding to the at least two display regions are arranged according to a preset hue order. Optionally, the preset color tone sequence is a color tone sequence indicated by the color wheel in the clockwise direction, or the preset color tone sequence is a color tone sequence indicated by the color wheel in the counterclockwise direction.

In a possible implementation manner, for any display area, when the number of images displayed in the display area is multiple, the main tones of the images displayed in the display area are arranged according to a preset tone sequence. Optionally, the preset color tone sequence is a color tone sequence indicated by the color wheel in the clockwise direction, or the preset color tone sequence is a color tone sequence indicated by the color wheel in the counterclockwise direction.

In a possible implementation manner, each display area is a rectangular area, and the rectangular area is used for displaying N rows of images or N columns of images, where N is an integer greater than or equal to 1.

It should be understood that, in this embodiment, a manner of displaying the images in the image library in the second display order is similar to a manner of displaying the images in the search result by the terminal device in the foregoing embodiment, which is not described herein again, and a display effect thereof may refer to fig. 9A to 9E, or refer to interface b in fig. 14.

In one possible implementation, S1603 may include: acquiring images in an image library according to the image rearrangement instruction; determining image display information based on the dominant hue of the images in the image library, the image display information comprising: the display area of each image in the image library corresponds to the first interface, and the display position of each image in the display area. The terminal device displays a plurality of images in the image library in the first interface according to the image display information, thereby realizing that the images in the image library are displayed in the first interface in the second display order.

For the process of determining the image display information by the terminal device according to the dominant hue of the image in the image library, reference may be made to the detailed description of the above embodiments, which is not repeated herein.

The embodiment shown in fig. 16 is illustrated below with reference to a specific application scenario.

As an example, fig. 17 is a schematic diagram of an image display effect in a gallery scene according to an embodiment of the present application. As shown in a in fig. 17, when the user clicks the "gallery" icon in the main interface of the terminal device, the terminal is triggered to present the first interface, and the images in the gallery are displayed in the first interface according to the first display order (the sequence of the image capturing time), where at this time, the first interface is shown in b in fig. 17. A rearrangement function entry is provided in the first interface, and when the user clicks the "rearrangement" icon in the first interface, the terminal device is triggered to perform rearrangement processing on the images in the gallery, so that the terminal device displays the images in the gallery in the first interface according to the second display order (tone order), and at this time, the first interface is shown as c in fig. 17. Specifically, one line is taken as one display region. The keytone of the image in each display area is located in the same tone range (i.e. the keytone of the image in each display area is the same or similar), the keytone of the image in each display area is arranged according to the tone sequence indicated by the clockwise/anticlockwise direction of the color wheel, and the tone ranges corresponding to different display areas are circularly arranged according to the tone sequence indicated by the clockwise/anticlockwise direction of the color wheel. Therefore, the image in the interface has rich tone, harmonious tone transition and good image display effect. Furthermore, the willingness of the user to continue browsing or click can be improved, so that the user can conveniently and quickly position the image required by the user.

As another example, on the basis of the embodiment shown in fig. 17, after the terminal device displays the images in the gallery according to the preset tone sequence, if the terminal device detects that the number of images in the gallery changes, for example, the terminal device newly captures/receives one or more images and stores the images in the gallery, or the terminal device deletes one or more images in the gallery, the terminal device is triggered to reorder the images in the gallery. And then, the terminal equipment displays the images in the image library according to the second display sequence based on the latest reordering result, so that the interface is updated in time.

As another example, fig. 18 is a schematic diagram of another image display effect in a gallery scene according to an embodiment of the present application. As shown in a in fig. 18, the terminal device displays the images in the gallery in a first interface in a preset tone order, wherein the first interface displays 3 images per line and 15 images per screen. After a user performs interface zooming operation on the first interface, the terminal equipment determines display parameters of the zoomed first interface according to the zooming operation input by the user. And then, the terminal equipment carries out reordering processing on the images in the gallery according to the main tone of the images in the gallery and the display parameters of the zoomed first interface. Assuming that each line of the scaled first interface displays 4 images and each screen displays 28 images, the display effect of the scaled first interface is as shown in b of fig. 18. As can be seen, the zoomed first interface is still displayed according to the following principle: the keytone of the image in each display area is located in the same tone range (i.e. the keytone of the image in each display area is the same or similar), the keytone of the image in each display area is arranged according to the tone sequence indicated by the clockwise/anticlockwise direction of the color wheel, and the tone ranges corresponding to different display areas are circularly arranged according to the tone sequence indicated by the clockwise/anticlockwise direction of the color wheel.

As another example, fig. 19 is a schematic diagram illustrating an image displaying effect in a jigsaw scene according to an embodiment of the present application. As shown in a in fig. 19, the terminal device displays the images in the gallery in the first display order (the chronological order of the image capturing times). The user may select multiple images in the gallery for authoring. For example, when the user selects 9 images in the gallery and clicks the "create" button, the terminal device generates a mosaic from the 9 images selected by the user, the resulting mosaic is shown as b in fig. 19, and the images in the mosaic are arranged in the second display order (hue order). One line of the puzzle is used as a display area. The keytone of the image in each display area is located in the same tone range (i.e. the keytone of the image in each display area is the same or similar), the keytone of the image in each display area is arranged according to the tone sequence indicated by the clockwise/anticlockwise direction of the color wheel, and the tone ranges corresponding to different display areas are circularly arranged according to the tone sequence indicated by the clockwise/anticlockwise direction of the color wheel. Therefore, the image in the jigsaw puzzle has rich color tone, harmonious color tone transition and better display effect on the jigsaw puzzle.

Fig. 20 is a schematic structural diagram of an image display device according to an embodiment of the present application. The means may be in the form of software and/or hardware. The apparatus may be a terminal device, or an apparatus provided in a terminal device. As shown in fig. 20, the present embodiment provides an image display device 2000 including: a processing module 2001 and a display module 2002.

The image display device provided by the embodiment is applied to an image search scene, an image recommendation scene, a gallery/subject gallery scene, a jigsaw scene and the like. The following description will be made by taking an image search scene and a gallery scene as examples.

When the image display apparatus 2000 is applied to an image search scene, a processing module 2001 for acquiring an image search instruction including a first search condition; a display module 2002, configured to display, in a first interface, a plurality of images corresponding to the first search condition according to the image search instruction; the first interface comprises at least two display areas, each display area is used for displaying at least one image, and the dominant hue of the image displayed in each display area is located in the same hue range.

In a possible implementation manner, the processing module 2001 is further configured to: according to the image searching instruction, acquiring an image set and image display information, wherein images in the image set meet the first searching condition, and the image display information comprises: the display area corresponding to each image in the image set and the display position of each image in the display area; the display module 2002 is specifically configured to display the multiple images in the first interface according to the image display information, where the multiple images are all images or partial images in the image set.

In a possible implementation manner, the processing module 2001 is specifically configured to: sending a search request to a server, wherein the search request comprises the first search condition; receiving address information of images in the image set and the image display information from the server; and acquiring the image set according to the address information.

In a possible implementation manner, the processing module 2001 is specifically configured to: sending a search request to a server, wherein the search request comprises the first search condition; receiving address information of images in the image set from the server, and acquiring the image set according to the address information, wherein the images in the image set are arranged according to the degree of correlation with the first search condition; and determining the image display information according to the dominant hue of the images in the image set.

In a possible implementation manner, the processing module 2001 is specifically configured to: according to the arrangement sequence of the images in the image set, grouping the images in the image set to obtain a plurality of groups of images; for each group of images, reordering the images in the group of images according to the dominant hue of the images in the group of images to obtain a dominant hue ordering result of the group of images, and determining display information of the group of images according to the dominant hue ordering result, wherein the display information comprises the display area corresponding to each image in the group of images and the display position of each image in the display area; and generating the image display information according to the display information of the plurality of groups of images.

In one possible implementation, for a first set of images; the processing module 2001 is specifically configured to: determining a location of a dominant hue in a color wheel for each image in the first set of images; and according to the position of the main tone of each image in the first group of images in the color wheel, taking the position of the 1 st image in the first group of images in the color wheel as a starting point, and according to the clockwise or anticlockwise direction of the color wheel, carrying out reordering processing on the images in the first group of images to obtain a main tone ordering result of the first group of images.

In a possible implementation manner, for the ith group of images, where i is an integer greater than 1, the processing module 2001 is specifically configured to: determining a location of a dominant hue in a color wheel for each image in the ith set of images; according to the position of the main tone of each image in the ith group of images in the color wheel, the position of the last 1 image in the ith-1 group of images in the color wheel is taken as a starting point, and the images in the ith group of images are reordered clockwise or anticlockwise according to the color wheel, so that the main tone ordering result of the ith group of images is obtained.

When the image display apparatus 2000 is applied to a gallery scene, the display module 2002 is configured to display images in the image gallery in a first display order in the first interface; the processing module 2001 is used for acquiring an image rearrangement instruction; the display module 2002 is further configured to display, in the first interface, the images in the image library in a second display order according to the image rearrangement instruction; when the images in the image library are displayed in the second display sequence, the first interface comprises at least two display areas, each display area is used for displaying at least one image, and the main tone of the image displayed in each display area is located in the same tone range.

the preset tone sequence is the tone sequence indicated by the counterclockwise direction of the color wheel.

In one possible implementation manner, the first display order may be any one of the following: the sequence of the image shooting time; the sequence of the image receiving time; the sequence of the image selection time; the sequence of the correlation degree between the image and the preset condition; and a preset tone order.

In a possible implementation manner, the processing module 2001 is specifically configured to: detecting a first user operation in the first interface, wherein the first user operation is any one of the following operations: icon clicking operation, interface zooming operation and image screening operation; alternatively, a change in the number of images in the image library is detected.

In a possible implementation manner, the processing module 2001 is further configured to obtain an image in the image library according to the image rearrangement instruction; determining image display information according to a dominant hue of an image in the image library, the image display information comprising: the display area corresponding to each image in the image library on the first interface and the display position of each image in the display area; the display module 2002 is specifically configured to display the image in the image library in the first interface according to the image display information.

In a possible implementation manner, the processing module 2001 is specifically configured to: according to the arrangement sequence of the images in the image library, grouping the images in the image library to obtain a plurality of groups of images; for each group of images, reordering the images in the group of images according to the dominant hue of the images in the group of images to obtain a dominant hue ordering result of the group of images, and determining display information of the group of images according to the dominant hue ordering result, wherein the display information comprises the display area corresponding to each image in the group of images and the display position of each image in the display area; and generating the image display information according to the display information of the plurality of groups of images.

In one possible implementation, for a first set of images; the processing module 2001 is specifically configured to: determining a location of a dominant hue in a color wheel for each image in the first set of images; according to the position of the main tone of each image in the first group of images in the color wheel, with the position of the 1 st image in the first group of images in the color wheel as a starting point, reordering the images in the first group of images according to the clockwise or counterclockwise direction of the color wheel, and obtaining the main tone ordering result of the first group of images.

In a possible implementation manner, for the ith group of images, where i is an integer greater than 1, the processing module 2001 is specifically configured to: determining a location of a dominant hue in a color wheel for each image in the ith set of images; and according to the position of the main tone of each image in the ith group of images in the color wheel, taking the position of the last 1 image in the ith-1 group of images in the color wheel as a starting point, and according to the clockwise or anticlockwise direction of the color wheel, carrying out reordering processing on the images in the ith group of images to obtain the main tone ordering result of the ith group of images.

The image display apparatus provided in this embodiment may be configured to execute the image display method executed by the terminal device in any of the method embodiments described above, and the implementation principle and the technical effect are similar, which are not described herein again.

Fig. 21 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application. The means may be in the form of software and/or hardware. The apparatus may be a server, or an apparatus provided in a server. As shown in fig. 21, the present embodiment provides an image processing apparatus 2100 including: a processing module 2101 and a transceiver module 2102.

The processing module 2101 is configured to acquire an image set, and generate image display information according to a dominant hue of an image in the image set, where the image display information includes: a display area corresponding to each image in the image set in the first interface and a display position of each image in the display area; the transceiver module 2102 is configured to send address information of images in the image set and the image display information to a terminal device, where the image display information is used to instruct the terminal device to display multiple images in the image set in the first interface, where the first interface includes at least two display areas, each display area is used to display at least one image, and a dominant hue of an image displayed in each display area is located in the same hue range.

In a possible implementation manner, the processing module 2101 is specifically configured to: according to the arrangement sequence of the images in the image set, carrying out grouping processing on the images in the image set to obtain a plurality of groups of images; for each group of images, reordering the images in the group of images according to the dominant hue of the images in the group of images to obtain a dominant hue ordering result of the group of images, and determining display information of the group of images according to the dominant hue ordering result, wherein the display information comprises the display area corresponding to each image in the group of images and the display position of each image in the display area; and generating the image display information according to the display information of the plurality of groups of images.

In one possible implementation, for a first set of images; the processing module 2101 is specifically configured to: determining a location of a dominant hue in a color wheel for each image in the first set of images; according to the position of the main tone of each image in the first group of images in the color wheel, with the position of the 1 st image in the first group of images in the color wheel as a starting point, reordering the images in the first group of images according to the clockwise or counterclockwise direction of the color wheel, and obtaining the main tone ordering result of the first group of images.

In a possible implementation manner, for the ith group of images, where i is an integer greater than 1, the processing module 2101 is specifically configured to: determining a location of a dominant hue in a color wheel for each image in the ith set of images; according to the position of the main tone of each image in the ith group of images in the color wheel, the position of the last 1 image in the ith-1 group of images in the color wheel is taken as a starting point, and the images in the ith group of images are reordered clockwise or anticlockwise according to the color wheel, so that the main tone ordering result of the ith group of images is obtained.

In a possible implementation manner, the transceiver module 2102 is further configured to receive a search request, where the search request includes a first search condition; the processing module 2101 is specifically configured to obtain the image set according to the first search condition, where images in the image set satisfy the first search condition.

In a possible implementation manner, the transceiver module 2102 is further configured to receive a recommendation request, where the recommendation request includes a recommendation type, and the recommendation type is any one of the following: the processing module 2101 is specifically configured to recommend according to the image heat and recommend according to the user preference characteristics; and acquiring the image set according to the recommendation type.

The image processing apparatus provided in this embodiment may be configured to execute the image processing method executed by the server in the foregoing method embodiment, and the implementation principle and the technical effect are similar, which are not described herein again.

Fig. 22 is a schematic structural diagram of an electronic device according to an embodiment of the present application. The electronic device may be a terminal device or a server. As shown in fig. 22, the electronic device 2200 provided in this embodiment includes: at least one processor 2201, and at least one memory 2202.

The memory 2202 may be separate and may also be coupled to the processor 2201. Optionally, the memory 2202 and the processor 2201 may be coupled by a bus 2203. Optionally, the memory 2202 may also be integrated with the processor 2201, e.g., within one chip. The memory 2202 stores computer instructions, and the processor 2201 can execute the computer instructions stored in the memory to realize the image display method executed by the terminal device in the above-described embodiment or realize the image processing method executed by the server in the above-described embodiment. The implementation principle and the technical effect are similar, and the detailed description is omitted here.

In the embodiment shown in fig. 22, the Processor may be a Central Processing Unit (CPU), other general-purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present application may be embodied directly in a hardware processor, or in a combination of the hardware and software modules in the processor. The memory may be a memory element on the same chip as the processor, that is, an on-chip memory element, or a separate memory element, which is not limited in this embodiment.

Fig. 23 is a schematic structural diagram of a terminal device according to an embodiment of the present application. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a Universal Serial Bus (USB) interface 130, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display 194, and the like. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an acceleration sensor 180E, a distance sensor 180F, a touch sensor 180K, and the like.

It is to be understood that the illustrated structure of the embodiment of the present application does not specifically limit the electronic device 100. In other embodiments of the present application, electronic device 100 may include more or fewer components than shown, or some components may be combined, some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Processor 110 may include one or more processing units, such as: the processor 110 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. Wherein, the different processing units may be independent devices or may be integrated in one or more processors.

The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.

A memory may also be provided in processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Avoiding repeated accesses reduces the latency of the processor 110, thereby increasing the efficiency of the system.

The processor 110 is configured to adjust a center point of the image to be displayed on the display screen 194 according to the user pupil position offset and the user visibility. And is further configured to determine a distortion correction parameter corresponding to the image to be displayed on the display screen 194 according to the user pupil position offset and the user diopter, and perform distortion correction on the image to be displayed on the display screen 194 according to the distortion correction parameter. And also for adjusting the image height of the image to be displayed by the display screen 194 in accordance with the user's eyesight. Through the image calibration processing, the virtual image seen by the user is not influenced by the position offset of the eyes and the visibility of the eyes. After the two optical systems are calibrated, the two eyes of the user see the same picture, which improves the user experience of the electronic device 100.

In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose-input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.

The I2C interface is a bidirectional synchronous serial bus including a serial data line (SDA) and a Serial Clock Line (SCL). In some embodiments, processor 110 may include multiple sets of I2C buses. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces, respectively. For example: the processor 110 may be coupled to the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through an I2C bus interface to implement a touch function of the electronic device 100.

The I2S interface may be used for audio communication. In some embodiments, processor 110 may include multiple sets of I2S buses. The processor 110 may be coupled to the audio module 170 through an I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may transmit the audio signal to the wireless communication module 160 through the I2S interface, so as to implement a function of receiving a call through a bluetooth headset.

The PCM interface may also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled by a PCM bus interface. In some embodiments, the audio module 170 may also transmit audio signals to the wireless communication module 160 through the PCM interface, so as to implement a function of answering a call through a bluetooth headset. Both the I2S interface and the PCM interface may be used for audio communication.

The UART interface is a universal serial data bus used for asynchronous communications. The bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is generally used to connect the processor 110 with the wireless communication module 160. For example: the processor 110 communicates with a bluetooth module in the wireless communication module 160 through a UART interface to implement a bluetooth function. In some embodiments, the audio module 170 may transmit the audio signal to the wireless communication module 160 through a UART interface, so as to realize the function of playing music through a bluetooth headset.

MIPI interfaces may be used to connect processor 110 with peripheral devices such as display screen 194, camera 193, and the like. The MIPI interface includes a Camera Serial Interface (CSI), a Display Serial Interface (DSI), and the like. In some embodiments, processor 110 and camera 193 communicate through a CSI interface to implement the capture functionality of electronic device 100. The processor 110 and the display screen 194 communicate through the DSI interface to implement the display function of the electronic device 100.

The GPIO interface may be configured by software. The GPIO interface may be configured as a control signal and may also be configured as a data signal. In some embodiments, a GPIO interface may be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface may also be configured as an I2C interface, I2S interface, UART interface, MIPI interface, and the like.

The USB interface 130 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the electronic device 100, and may also be used to transmit data between the electronic device 100 and a peripheral device. And the earphone can also be used for connecting an earphone and playing audio through the earphone. The interface may also be used to connect other electronic devices, such as AR devices and the like.

It should be understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is only an illustration, and does not limit the structure of the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection manners or a combination of multiple interface connection manners in the above embodiments.

The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.

The

antennas

1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a solution including 2G/3G/4G/5G wireless communication applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 150 may receive the electromagnetic wave from the antenna 1, filter, amplify, etc. the received electromagnetic wave, and transmit the electromagnetic wave to the modem processor for demodulation. The mobile communication module 150 may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the same device as at least some of the modules of the processor 110.

The modem processor may include a modulator and a demodulator. The modulator is used for modulating a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then passes the demodulated low frequency baseband signal to a baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional modules, independent of the processor 110.

The wireless communication module 160 may provide a solution for wireless communication applied to the electronic device 100, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), bluetooth (bluetooth, BT), global Navigation Satellite System (GNSS), frequency Modulation (FM), near Field Communication (NFC), infrared (IR), and the like. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, perform frequency modulation and amplification on the signal, and convert the signal into electromagnetic waves through the antenna 2 to radiate the electromagnetic waves.

In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150 and antenna 2 is coupled to wireless communication module 160 so that electronic device 100 can communicate with networks and other devices through wireless communication techniques. The wireless communication technology may include global system for mobile communications (GSM), general Packet Radio Service (GPRS), code division multiple access (code division multiple access, CDMA), wideband Code Division Multiple Access (WCDMA), time-division code division multiple access (time-division code division multiple access, TD-SCDMA), long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and/or IR technologies, etc. The GNSS may include a Global Positioning System (GPS), a global navigation satellite system (GLONASS), a beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and/or a Satellite Based Augmentation System (SBAS).

The electronic device 100 implements display functions via the GPU, the display screen 194, and the application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

The display screen 194 is used to display images, video, and the like. The display screen 194 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-oeld, a quantum dot light-emitting diode (QLED), and the like. In some embodiments, the electronic device 100 may include 1 or N display screens 194, N being a positive integer greater than 1.

The electronic device 100 may implement a shooting function through the ISP, the camera 193, the video codec, the GPU, the display 194, the application processor, and the like.

The ISP is used to process the data fed back by the camera 193. For example, when a photo is taken, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converting into an image visible to naked eyes. The ISP can also carry out algorithm optimization on noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in camera 193.

The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensing element converts the optical signal into an electrical signal, which is then passed to the ISP where it is converted into a digital image signal. And the ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into image signal in standard RGB, YUV and other formats. In some embodiments, electronic device 100 may include 1 or N cameras 193, N being a positive integer greater than 1.

The digital signal processor is used for processing digital signals, and can process digital image signals and other digital signals. For example, when the electronic device 100 selects a frequency bin, the digital signal processor is used to perform fourier transform or the like on the frequency bin energy.

Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 may play or record video in a variety of encoding formats, such as: moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, and the like.

The NPU is a neural-network (NN) computing processor that processes input information quickly by using a biological neural network structure, for example, by using a transfer mode between neurons of a human brain, and can also learn by itself continuously. Applications such as intelligent recognition of the electronic device 100 can be realized through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, and the like.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to extend the memory capability of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music, video, etc. are saved in an external memory card.

The internal memory 121 may be used to store computer-executable program code, which includes instructions. The internal memory 121 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The storage data area may store data (such as audio data, phone book, etc.) created during use of the electronic device 100, and the like. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like. The processor 110 executes various functional applications of the electronic device 100 and data processing by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.

The electronic device 100 may implement audio functions via the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor. Such as music playing, recording, etc.

The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or some functional modules of the audio module 170 may be disposed in the processor 110.

The speaker 170A, also called a "horn", is used to convert the audio electrical signal into a sound signal. The electronic apparatus 100 can listen to music through the speaker 170A or listen to a hands-free call.

The receiver 170B, also called "earpiece", is used to convert the electrical audio signal into an acoustic signal. When the electronic apparatus 100 receives a call or voice information, it is possible to receive voice by placing the receiver 170B close to the human ear.

The microphone 170C, also referred to as a "microphone," is used to convert sound signals into electrical signals. When making a call or transmitting voice information, the user can input a voice signal to the microphone 170C by speaking near the microphone 170C through the mouth. The electronic device 100 may be provided with at least one microphone 170C. In other embodiments, the electronic device 100 may be provided with two microphones 170C to achieve a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 100 may further include three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and perform directional recording.

The earphone interface 170D is used to connect a wired earphone. The headset interface 170D may be the USB interface 130, or may be a 3.5mm open mobile electronic device platform (OMTP) standard interface, a cellular telecommunications industry association (cellular telecommunications industry association of the USA, CTIA) standard interface.

The pressure sensor 180A is used for sensing a pressure signal, and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194. The pressure sensor 180A can be of a wide variety, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a sensor comprising at least two parallel plates having an electrically conductive material. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the strength of the pressure from the change in capacitance. When a touch operation is applied to the display screen 194, the electronic apparatus 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic apparatus 100 may also calculate the touched position from the detection signal of the pressure sensor 180A. In some embodiments, the touch operations that are applied to the same touch position but different touch operation intensities may correspond to different operation instructions. For example: and when the touch operation with the touch operation intensity smaller than the first pressure threshold value acts on the short message application icon, executing an instruction for viewing the short message. And when the touch operation with the touch operation intensity larger than or equal to the first pressure threshold value acts on the short message application icon, executing an instruction of newly building the short message.

The gyro sensor 180B may be used to determine the motion attitude of the electronic device 100. In some embodiments, the angular velocity of electronic device 100 about three axes (i.e., the x, y, and z axes) may be determined by gyroscope sensor 180B. The gyro sensor 180B may be used for photographing anti-shake. For example, when the shutter is pressed, the gyro sensor 180B detects a shake angle of the electronic device 100, calculates a distance to be compensated for by the lens module according to the shake angle, and allows the lens to counteract the shake of the electronic device 100 through a reverse movement, thereby achieving anti-shake. The gyroscope sensor 180B may also be used for navigation, somatosensory gaming scenes.

The acceleration sensor 180E may detect the magnitude of acceleration of the electronic device 100 in various directions (typically three axes). The magnitude and direction of gravity can be detected when the electronic device 100 is stationary. The method can also be used for recognizing the posture of the electronic equipment, and is applied to horizontal and vertical screen switching, pedometers and other applications.

A distance sensor 180F for measuring a distance. The electronic device 100 may measure the distance by infrared or laser. In some embodiments, taking a picture of a scene, electronic device 100 may utilize range sensor 180F to range for fast focus.

The touch sensor 180K is also called a "touch device". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is used to detect a touch operation acting thereon or nearby. The touch sensor can communicate the detected touch operation to the application processor to determine the touch event type. Visual output associated with the touch operation may be provided through the display screen 194. In other embodiments, the touch sensor 180K may be disposed on a surface of the electronic device 100, different from the position of the display screen 194.

The keys 190 include a power-on key, a volume key, and the like. The keys 190 may be mechanical keys. Or may be touch keys. The electronic apparatus 100 may receive a key input, and generate a key signal input related to user setting and function control of the electronic apparatus 100.

The motor 191 may generate a vibration cue. The motor 191 may be used for incoming call vibration cues, as well as for touch vibration feedback. For example, touch operations applied to different applications (e.g., photographing, audio playing, etc.) may correspond to different vibration feedback effects. The motor 191 may also respond to different vibration feedback effects for touch operations applied to different areas of the display screen 194. Different application scenes (such as time reminding, receiving information, alarm clock, game and the like) can also correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization.

Indicator 192 may be an indicator light that may be used to indicate a state of charge, a change in charge, or a message, missed call, notification, etc.

The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. An image display method, comprising:

acquiring an image searching instruction, wherein the image searching instruction comprises a first searching condition;

displaying a plurality of images corresponding to the first search condition in a first interface according to the image search instruction;

the first interface comprises at least two display areas, each display area is used for displaying at least one image, and the main tone of the image displayed in each display area is located in the same tone range.

2. The method of claim 1, wherein the at least two display regions correspond to hue ranges arranged in a predetermined hue order.

3. The method according to claim 1 or 2, wherein, for an arbitrary display region, when the number of images displayed by the display region is plural, the keytones of the images displayed in the display region are arranged in a preset tone order.

4. A method according to claim 2 or 3, wherein the preset hue order is the hue order indicated by the color wheel in a clockwise direction; or,

5. The method according to any one of claims 1 to 4, wherein each display area is a rectangular area for displaying N rows of images or N columns of images, wherein N is an integer greater than or equal to 1.

6. The method according to any one of claims 1 to 5, wherein displaying the plurality of images corresponding to the first search condition in a first interface according to the image search instruction comprises:

according to the image searching instruction, acquiring an image set and image display information, wherein images in the image set meet the first searching condition, and the image display information comprises: the display area corresponding to each image in the image set and the display position of each image in the display area;

and displaying the plurality of images in the first interface according to the image display information, wherein the plurality of images are all images or partial images in the image set.

7. The method of claim 6, wherein obtaining the image set and image display information according to the image search instruction comprises:

sending a search request to a server, wherein the search request comprises the first search condition;

receiving address information of images in the image set and the image display information from the server;

and acquiring the image set according to the address information.

8. The method of claim 6, wherein obtaining the image set and image display information according to the image search instruction comprises:

receiving address information of the images in the image set from the server, and acquiring the image set according to the address information, wherein the images in the image set are arranged according to the correlation degree with the first search condition;

and determining the image display information according to the dominant hue of the images in the image set.

9. The method of claim 8, wherein determining the image display information based on a dominant hue of the images in the set of images comprises:

according to the arrangement sequence of the images in the image set, carrying out grouping processing on the images in the image set to obtain a plurality of groups of images;

for each group of images, reordering the images in the group of images according to the dominant hue of the images in the group of images to obtain a dominant hue ordering result of the group of images, and determining display information of the group of images according to the dominant hue ordering result, wherein the display information comprises the display area corresponding to each image in the group of images and the display position of each image in the display area;

and generating the image display information according to the display information of the plurality of groups of images.

10. The method of claim 9, wherein for a first set of images; according to the main tone of the images in the group of images, reordering the images in the group of images to obtain a main tone ordering result of the group of images, comprising:

determining a location of a dominant hue in a color wheel for each image in the first set of images;

according to the position of the main tone of each image in the first group of images in the color wheel, with the position of the 1 st image in the first group of images in the color wheel as a starting point, reordering the images in the first group of images according to the clockwise or counterclockwise direction of the color wheel, and obtaining the main tone ordering result of the first group of images.

11. The method of claim 9, wherein for the ith group of images, where i is an integer greater than 1, reordering the images in the group of images according to their dominant hue to obtain a dominant hue ordering result for the group of images comprises:

determining a location of a dominant hue in a color wheel for each image in the ith set of images;

according to the position of the main tone of each image in the ith group of images in the color wheel, taking the position of the last 1 image in the ith-1 group of images in the color wheel as a starting point, and according to the clockwise or anticlockwise direction of the color wheel, carrying out reordering processing on the images in the ith group of images to obtain the main tone ordering result of the ith group of images.

12. An image display method, comprising:

displaying images in the image library in a first display order in a first interface;

acquiring an image rearrangement instruction;

displaying the images in the image library in a second display order in the first interface according to the image rearrangement instruction; when the images in the image library are displayed in the second display sequence, the first interface comprises at least two display areas, each display area is used for displaying at least one image, and the main tone of the image displayed in each display area is located in the same tone range.

13. The method of claim 12, wherein the hue ranges corresponding to the at least two display regions are arranged in a predetermined hue order.

14. The method according to claim 12 or 13, wherein, for any display region, when the number of images displayed in the display region is plural, the keytones of the images displayed in the display region are arranged in a preset tone order.

15. The method according to claim 13 or 14, wherein the preset tone sequence is a tone sequence indicated in a clockwise direction of the color wheel; or,

16. The method according to any one of claims 12 to 15, wherein each display area is a rectangular area for displaying N rows of images or N columns of images, wherein N is an integer greater than or equal to 1.

17. The method according to any one of claims 12 to 16, wherein the first display order may be any one of:

the sequence of the image shooting time;

the image receiving time sequence;

the sequence of the image selection time;

the sequence of the correlation degree between the image and the preset condition; and

a preset tone order.

18. The method according to any one of claims 12 to 17, wherein the acquiring of the image rearrangement instruction comprises:

detecting a first user operation in the first interface, wherein the first user operation is any one of the following operations: icon clicking operation, interface zooming operation and image screening operation;

or,

detecting a change in the number of images in the image library.

19. The method according to any one of claims 12 to 18, wherein displaying the images in the image library in a second display order in the first interface according to the image rearrangement instruction comprises:

acquiring images in the image library according to the image rearrangement instruction;

determining image display information according to a dominant hue of an image in the image library, the image display information comprising: the display area corresponding to each image in the image library on the first interface and the display position of each image in the display area;

and displaying the images in the image library in the first interface according to the image display information.

20. The method of claim 19, wherein determining image display information based on a dominant hue of the images in the image library comprises:

according to the arrangement sequence of the images in the image library, grouping the images in the image library to obtain a plurality of groups of images;

21. The method of claim 20, wherein for a first set of images; according to the main tone of the images in the group of images, reordering the images in the group of images to obtain a main tone ordering result of the group of images, comprising:

22. The method of claim 20, wherein for the ith group of images, where i is an integer greater than 1, reordering the images in the group of images according to their dominant hue to obtain a dominant hue ordering result for the group of images comprises:

and according to the position of the main tone of each image in the ith group of images in the color wheel, taking the position of the last 1 image in the ith-1 group of images in the color wheel as a starting point, and carrying out reordering processing on the images in the ith group of images according to the clockwise or anticlockwise direction of the color wheel to obtain the main tone ordering result of the ith group of images.

23. An image processing method, comprising:

acquiring an image set;

generating image display information from the dominant tones of the images in the set of images, the image display information comprising: a display area corresponding to each image in the image set in the first interface and a display position of each image in the display area;

and sending address information of the images in the image set and the image display information to a terminal device, wherein the image display information is used for indicating the terminal device to display a plurality of images in the image set in the first interface, the first interface comprises at least two display areas, each display area is used for displaying at least one image, and the main tone of the image displayed in each display area is in the same tone range.

24. The method of claim 23, wherein the hue ranges corresponding to the at least two display regions are arranged in a predetermined hue order.

25. The method according to claim 23 or 24, wherein, for an arbitrary display region, when the number of images displayed by the display region is plural, the keytones of the images displayed in the display region are arranged in a preset tone order.

26. The method according to claim 24 or 25, wherein the preset tone sequence is a tone sequence indicated in a clockwise direction of the color wheel; or,

27. A terminal device, comprising: a memory and a processor; the processor is configured to be coupled with the memory, read and execute instructions in the memory to implement the method of any one of claims 1 to 11, or to implement the method of any one of claims 12 to 22.

28. A server, comprising: a memory and a processor; the processor is coupled to the memory, and reads and executes instructions in the memory to implement the method of any one of claims 23 to 26.

29. A computer readable storage medium, characterized in that it stores computer instructions which, when executed, implement the method of any one of claims 1 to 11, or implement the method of any one of claims 12 to 22, or implement the method of any one of claims 23 to 26.

30. A computer program product, characterized in that the computer program product comprises a computer program which, when executed, implements the method of any one of claims 1 to 11, or implements the method of any one of claims 12 to 22, or implements the method of any one of claims 23 to 26.