CN115344148A

CN115344148A - Image processing method, image processing device, electronic equipment and computer readable storage medium

Info

Publication number: CN115344148A
Application number: CN202110519175.3A
Authority: CN
Inventors: 郑任君; 韩瑞; 王丽云; 李婷婷
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2021-05-12
Filing date: 2021-05-12
Publication date: 2022-11-15

Abstract

The application provides an image processing method, an image processing device, electronic equipment and a computer readable storage medium; the method comprises the following steps: displaying at least one piece of information in the information flow and a corresponding thumbnail image in a human-computer interaction interface; responding to screenshot operation, and displaying a screenshot of a human-computer interaction interface and a screenshot storing inlet; displaying at least one thumbnail image identified based on the screenshot in response to a triggering operation for the screenshot entry; in response to the save operation, an original image of at least one thumbnail image is acquired, and the original image is stored. By the method and the device, the image in the information can be efficiently operated in the information browsing process.

Description

Image processing method, image processing device, electronic equipment and computer readable storage medium

Technical Field

The present application relates to image processing technologies, and in particular, to an image processing method and apparatus, an electronic device, and a computer-readable storage medium.

Background

With the development and popularization of terminal applications, terminals are widely used for information browsing, such as news, social dynamics, and the like. There are often many images in this information. The user may wish to be able to quickly save the images seen during browsing.

The related technology can only provide a scheme of checking and downloading images one by one, when a lot of images need to be saved, repeated operation is needed, the operation efficiency is low, and the use experience of a user is influenced.

Disclosure of Invention

The embodiment of the application provides an image processing method, an image processing device, electronic equipment and a computer readable storage medium, which can efficiently operate images in information in an information browsing process.

The technical scheme of the embodiment of the application is realized as follows:

an embodiment of the present application provides an image processing method, including:

displaying at least one piece of information in the information stream and a corresponding thumbnail image in a human-computer interaction interface;

responding to screenshot operation, and displaying the screenshot of the human-computer interaction interface and a screenshot storing inlet;

displaying at least one thumbnail image identified based on the screenshot in response to a triggering operation for the screenshot inlet;

and responding to the saving operation, acquiring an original image of the at least one thumbnail image, and storing the original image.

An embodiment of the present application provides an image processing apparatus, including:

the display module is used for displaying at least one piece of information in the information stream and the corresponding thumbnail image in the human-computer interaction interface; responding to screenshot operation, and displaying the screenshot of the human-computer interaction interface and a screenshot storing inlet; displaying at least one thumbnail image identified based on the screenshot in response to a triggering operation for the screenshot inlet;

and the storage module is used for responding to the saving operation, acquiring the original image of the at least one thumbnail image and storing the original image.

In the foregoing solution, when displaying at least one thumbnail image identified based on the screenshot, the display module is further configured to:

displaying a selection control corresponding to each thumbnail image, wherein the corresponding thumbnail image is selected when the selection control is triggered;

in response to a selection operation for the selection control, determining at least one target thumbnail image selected from the at least one thumbnail image identified based on the screenshot;

the acquiring of the original image of the at least one thumbnail image includes: an original image of the at least one target thumbnail image is acquired.

In the foregoing solution, when the selection control corresponding to each image is displayed, the display module is further configured to:

displaying a deselection entry corresponding to all of the thumbnail images;

when receiving a trigger operation for the deselection entry, displaying at least one of the following operation entries for the screenshot: a sharing entry for sending the screenshot; and the editing inlet is used for editing the screenshot.

In the foregoing solution, the display module is further configured to:

when the trigger operation aiming at the screenshot inlet is not received within the preset waiting time, displaying at least one of the following operation inlets aiming at the screenshot: a sharing entry for sending the screenshot; and the editing inlet is used for editing the screenshot.

In the above solution, when the original image is obtained in a pre-obtaining manner, the display module is further configured to:

responding to screenshot operation, displaying a screenshot of the human-computer interaction interface, and performing identification processing based on the screenshot to obtain at least one thumbnail image included in the screenshot;

before the map storage entry is displayed, original images of the at least one thumbnail image are searched from a link page to form a pre-acquired image set, and the map storage entry is displayed.

In the foregoing solution, the display module is further configured to:

acquiring an original image of the at least one thumbnail image from the set of pre-acquired images.

In the foregoing solution, the display module is further configured to:

storing the set of pre-acquired images in a cache space;

and when the number of the original images in the pre-acquired image set exceeds a number threshold, deleting the original images in the pre-acquired image set according to a first-in first-out sequence.

In the above solution, when the original image is obtained passively, the storage module is further configured to:

and responding to a saving operation, performing identification processing based on the screenshot, obtaining at least one thumbnail image included in the screenshot, and searching for an original image of the at least one thumbnail image from a link page.

In the foregoing solution, the storage module is further configured to:

and identifying the screenshot to obtain at least one thumbnail image and a position corresponding to each piece of information displayed in the screenshot, and acquiring an original image of the at least one thumbnail image from the link page according to the at least one thumbnail image and the position.

In the foregoing solution, the storage module is further configured to:

acquiring other original images from the link page and a secondary link page of the link page, wherein the other original images are original images different from the original images of the thumbnail images.

In the foregoing solution, the storage module is further configured to:

acquiring a link of the information from a page of the information stream based on the position of the at least one thumbnail image, and acquiring the link page according to the link;

and comparing the similarity of the at least one thumbnail image with a plurality of original images in the link page to obtain the original images corresponding to the at least one thumbnail image one by one.

In the foregoing solution, the storage module is further configured to:

taking the position of the at least one thumbnail image as a child node to inquire in the information flow page to obtain a parent node corresponding to the child node;

and taking the link of the parent node as the link of the information.

In the foregoing solution, the storage module is further configured to:

obtaining an image filtering condition, wherein the dimension of the image filtering condition comprises at least one of the following: resolution, image volume, specific domain name;

and filtering out original images meeting the image filtering condition from the plurality of original images, and continuing to filter out repeated original images, wherein the repeated original images and the de-duplication reference images comprise the same content.

In the foregoing solution, the storage module is further configured to:

acquiring an image replacement condition, wherein the dimension of the image replacement condition comprises at least one of the following: resolution, image volume, image type;

and acquiring an image which has the same content as the original image meeting the image replacement condition and does not meet the image replacement condition, and replacing the original image meeting the image replacement condition.

In the foregoing solution, when the original image of the at least one thumbnail image is pre-acquired before receiving the trigger operation for the map storage entry, and a plurality of the original images are acquired, the display module is further configured to:

sorting the plurality of original images according to at least one dimension, wherein the dimension of the sorting process comprises at least one of the following: resolution, image type, image preference level;

and displaying a plurality of thumbnail images corresponding to the plurality of original images according to the sequencing processing result of the plurality of original images.

In the foregoing solution, the display module is further configured to:

responding to a trigger operation aiming at the image storage inlet, and sending an identification instruction carrying the screenshot to a server so that the server identifies the screenshot based on the identification instruction to obtain at least one thumbnail image and a position included in the screenshot;

and receiving the at least one thumbnail image and the position sent by the server, and displaying the at least one thumbnail image according to the position.

In the foregoing solution, the display module is further configured to:

acquiring a link of corresponding information based on a position of the at least one thumbnail image in response to the saving operation;

sending an original image acquisition instruction carrying the link to a server, so that the server acquires a plurality of original images in a link page to which the link points based on the original image acquisition instruction, and performing similarity comparison on the at least one thumbnail image and the plurality of original images to obtain original images corresponding to the at least one thumbnail image one by one;

and receiving original images which are sent by the server and correspond to the at least one thumbnail image one by one.

An embodiment of the present application provides an electronic device, including:

a memory for storing executable instructions;

and the processor is used for realizing the image processing method provided by the embodiment of the application when executing the executable instructions stored in the memory.

The embodiment of the present application provides a computer-readable storage medium, which stores executable instructions for causing a processor to implement an image processing method provided by the embodiment of the present application when executed.

The embodiment of the present application provides a computer program product or a computer program, where the computer program product or the computer program includes computer instructions, the computer instructions are stored in a computer-readable storage medium, a processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the image processing method provided by the embodiment of the present application.

The embodiment of the application has the following beneficial effects:

after receiving the trigger operation aiming at the image storage entrance, displaying at least one thumbnail image in the screenshot of the man-machine interaction interface, so that a user can conveniently select at least one thumbnail image through the image storage entrance to store a corresponding original image with higher quality, uninterrupted use experience of information flow browsing is ensured, and the operation efficiency is high.

Drawings

Fig. 1A is a schematic diagram of an architecture of an image processing system 10 according to an embodiment of the present application;

fig. 1B is a schematic diagram of an architecture of an image processing system 10 according to an embodiment of the present application;

fig. 2A is a schematic flowchart of an image processing method provided in an embodiment of the present application;

fig. 2B is a schematic flowchart of an image processing method according to an embodiment of the present application;

fig. 2C is an interaction flow diagram of an image processing method according to an embodiment of the present application;

FIG. 3A is a schematic diagram of a screenshot operation provided by an embodiment of the present application;

FIG. 3B is a schematic diagram of a screenshot operation provided by an embodiment of the present application;

FIG. 4A is a schematic diagram of an information flow page provided by an embodiment of the present application;

FIG. 4B is a schematic diagram of a screenshot provided by an embodiment of the present application;

FIG. 4C is a schematic diagram of a batch graph saving page provided by an embodiment of the present application;

FIG. 4D is a schematic diagram of an image selection page provided by an embodiment of the present application;

FIG. 4E is a schematic diagram of saving an image provided by an embodiment of the present application;

FIG. 4F is a schematic illustration of a deselection provided by an embodiment of the present application;

FIG. 4G is a schematic diagram of processing a screenshot provided by an embodiment of the present application;

FIG. 5 is a schematic flowchart of saving images in batch according to an embodiment of the present disclosure;

fig. 6 is a schematic structural diagram of a terminal 400 according to an embodiment of the present application.

Detailed Description

In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be described in further detail with reference to the accompanying drawings, the described embodiments should not be considered as limiting the present application, and all other embodiments obtained by a person of ordinary skill in the art without making creative efforts fall within the protection scope of the present application.

In the following description, reference is made to "some embodiments" which describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or different subsets of all possible embodiments, and may be combined with each other without conflict.

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of the present application only and is not intended to be limiting of the application.

Before further detailed description of the embodiments of the present application, terms and expressions referred to in the embodiments of the present application will be described, and the terms and expressions referred to in the embodiments of the present application will be used for the following explanation.

1) The article: the client recommends information for reading for the user, the articles can include videos and pictures, and the articles are usually actively edited and released after a media account number registers a public number.

2) Information flow: a message source, a data format through which a web site disseminates up-to-date information to users, is usually arranged in a timeline, which is the most primitive, intuitive, and basic presentation of the information stream, a prerequisite for a user to be able to subscribe to the web site is that the web site provides a source of messages, the source of messages being converged together in what is called a syndication, and the software used for syndication is called an aggregator, which is software dedicated to subscribing to the web site for end users, also commonly called a reader.

3) Application Programming Interface (API): are some predefined interfaces (e.g. functions, HTTP interfaces, etc.) or refer to conventions for the connection of different components of the software system. To provide a set of routines that applications and developers can access based on certain software or hardware without accessing source code or understanding the details of the internal workings.

4) Machine Learning (ML): the method is a multi-field cross discipline and relates to a plurality of disciplines such as probability theory, statistics, approximation theory, convex analysis, algorithm complexity theory and the like. The special research on how a computer simulates or realizes the learning behavior of human beings so as to acquire new knowledge or skills and reorganize the existing knowledge structure to continuously improve the performance of the computer.

5) Document Object Model (DOM): is a standard programming interface for handling extensible markup languages. The DOM is a tree-based API document that treats the document as a tree structure, with each node of the tree representing an HTML tag or text item within the tag. The HTML document is converted into a DOM tree after being analyzed, so that the HTML document can be processed through the operation of the DOM tree. The DOM model not only describes the structure of the document, but also defines the behavior of the node object, and the nodes and the content of the DOM tree can be conveniently accessed, modified, added and deleted by using the method and the attribute of the object.

6) uni-app: the uni-APP is a framework for developing all front-end applications, and codes written by developers can be compiled into small programs, APPs, H5 and other platforms by the uni-APP, so that normal operation of the platforms is guaranteed, and excellent experience is achieved.

7) Artificial Intelligence (AI, artificial Intelligence): the method is a new technical science for researching and developing theories, methods, technologies and application systems for simulating, extending and expanding human intelligence.

In the related art, when screenshot is performed in a terminal (such as a mobile phone), the whole page can be intercepted, but batch interception of a plurality of images in the page cannot be performed. If a plurality of images in the same page need to be stored, information (such as articles) detail pages need to be entered from an information flow page, and the information (such as articles) detail pages enter the detail page of a single image, the single image is stored, and the operation is repeated to realize the storage of the plurality of images. Therefore, the operation is repeated in the process of saving a plurality of images, and the efficiency is low.

In view of the foregoing problems, embodiments of the present application provide an image processing method, an image processing apparatus, an electronic device, and a computer-readable storage medium, which can efficiently operate images in information in an information browsing process to implement batch image storage.

The image processing method provided by the embodiment of the present application may be implemented by various electronic devices, for example, may be implemented by a terminal alone, or may be implemented by a server and a terminal in cooperation. For example, the terminal alone executes the image processing method described below, or the terminal and the server cooperate to execute the image processing method described below. For example, the terminal responds to a trigger operation for a picture storing entrance and sends an identification instruction carrying a screenshot to the server; and the server identifies the screenshot based on the identification instruction, obtains the thumbnail image and the corresponding position included in the screenshot, and sends the thumbnail image and the position to the terminal so as to display the thumbnail image in the terminal. The terminal responds to the storage operation, acquires a link of corresponding information based on the position of the thumbnail image, and sends an original image acquisition instruction carrying the link to the server; the server acquires a plurality of original images in a link page pointed by a link based on an original image acquisition instruction, and compares the similarity of the thumbnail image with the plurality of original images to obtain an original image corresponding to the thumbnail image; and sending the original image to the terminal.

In the embodiment of the application, the server may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing basic cloud computing services such as a cloud service, a cloud database, cloud computing, a cloud function, cloud storage, a network service, cloud communication, a middleware service, a domain name service, a security service, a CDN, a big data and artificial intelligence platform, and the like; the testing device may be, but is not limited to, a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart television, and the like. The test device and the server may be directly or indirectly connected through wired or wireless communication, which is not limited in this embodiment of the present application.

Taking a server as an example, for example, the server cluster may be deployed in a cloud, and an artificial intelligence cloud Service (AI aas, AI as a Service) is opened to a user, the AIaaS platform splits several types of common AI services, and provides an independent or packaged Service in the cloud, this Service mode is similar to an AI theme mall, and all users may access one or more artificial intelligence services provided by the AIaaS platform by using an application programming interface.

For example, one of the artificial intelligence cloud services may be an image processing service, that is, an image processing program provided by the embodiment of the present application is packaged in a cloud server. The terminal responds to screenshot operation, sends an identification instruction carrying the screenshot to the cloud server, and the cloud server calls an encapsulated image processing program after receiving the identification instruction and acquires original images corresponding to all the thumbnail images based on the screenshot. And after receiving the saving operation aiming at the thumbnail image in the screenshot, the terminal sends an original image acquisition instruction to the server so as to acquire the original image corresponding to the thumbnail image.

Referring to fig. 1A, fig. 1A is a schematic diagram of an architecture of an image processing system 10 provided in an embodiment of the present application, a terminal 400 is connected to a server 200-1 through a network 300, and the network 300 may be a wide area network or a local area network, or a combination of both. The terminal 400 sends an identification instruction carrying the screenshot to the server 200-1. Upon receiving the identification instruction, the server 200-1 determines the thumbnail image and the corresponding position included in the screen shot based on the identification instruction, and transmits the thumbnail image and the corresponding position to the terminal 400. When the terminal 400 receives the save operation, it sends an original image acquisition instruction carrying a link of information corresponding to the thumbnail image to the server 200-1, and the server 200-1 acquires a plurality of original images based on the link and sends the plurality of original images to the terminal 400, so that the terminal 400 stores the plurality of original images.

In some embodiments, referring to fig. 1B, fig. 1B is a schematic diagram of an architecture of the image processing system 10 provided in the embodiment of the present application, and both the server and the terminal may join the blockchain network 500 to become one of the nodes (i.e., one of the nodes in the blockchain network 500 is operated). The type of blockchain network 500 is flexible and may be, for example, any of a public chain, a private chain, or a federation chain. Taking a public link as an example, an electronic device such as a server of any service entity may access the blockchain network 500 without authorization to serve as a common node of the blockchain network 500, for example, the server 200-1 is mapped to be a common node 500-2 in the blockchain network 500, the server 200-2 is mapped to be a common node 500-1 in the blockchain network 500, and the server 200-3 is mapped to be a common node 500-0 in the blockchain network 500.

Taking blockchain network 500 as an example of a federation chain, a server may access blockchain network 500 after obtaining authorization. After receiving an identification instruction carrying a screenshot sent by the terminal 400, the server 200-1 determines a thumbnail image and a corresponding position included in the screenshot based on the identification instruction, and sends the screenshot to other servers (such as the server 200-2 and the server 200-3) before sending the thumbnail image and the corresponding position to the terminal 400, and the other servers can identify the screenshot by executing an intelligent contract to verify whether the thumbnail image and the corresponding position included in the screenshot determined by the server 200-1 are correct. When the nodes exceeding the number threshold value are confirmed to pass verification, the nodes are signed with digital signatures (namely endorsements), when the thumbnail images and the corresponding positions have enough endorsements, the server 200-1 sends the thumbnail images and the corresponding positions to the terminal 400, the terminal 400 displays each thumbnail image according to the positions of the thumbnail images, and after the terminal 400 receives the storage operation, an original image acquisition instruction is sent to the server to acquire the original images corresponding to the thumbnail images, and the original images are stored to the local in batches. Meanwhile, the blockchain network 500 performs uplink storage on the original image. When the original image in the local area of the terminal is deleted, the deleted original image can be restored through the block chain network 500.

Therefore, in the embodiment of the application, the thumbnail images and the corresponding positions can be ensured to be accurate by means of the mode of carrying out consensus verification on the thumbnail images and the corresponding positions by the nodes.

The image processing method provided by the embodiment of the present application will be described below with reference to the accompanying drawings, where an execution subject of the image processing method described below may be a terminal, and specifically, the terminal may be implemented by running the above various computer programs; of course, as will be understood from the following description, it is obvious that the image processing method provided by the embodiment of the present application may be implemented by a terminal and a server in cooperation.

Referring to fig. 2A, fig. 2A is a schematic flowchart of an image processing method provided in an embodiment of the present application, and will be described with reference to the steps shown in fig. 2A.

In step 101, at least one piece of information in an information stream and a corresponding thumbnail image are displayed in a human-computer interaction interface.

As an example, an information flow page may be displayed at a human-machine interface, where at least one piece of information in the information flow is included. In the information flow page, a part of the text (for example, an abstract) or the whole text of each piece of information is displayed, and a thumbnail (also called a thumbnail) of the part of the text or the whole text is also displayed.

As an example, the human-computer interaction interface displays a detail page of a certain piece of information of the information stream, and text and an original image of the information are displayed in the detail page.

The thumbnail image is an image obtained by reducing an original image, and contains only sufficient details to recognize the image, and has a resolution lower than that of the original image. The information flow page may be a browser page, an instant messaging application page, a merchandise presentation page in a shopping application, and the like. The information flow page includes a plurality of pieces of information, which may be news, search results, instant messages, recommended content, etc., and the information may be presented in the information flow page in one of the following ways: displaying the abstract; the summary and at least one thumbnail image are displayed. Wherein the thumbnail images may comprise video thumbnails. For example, if a trigger (e.g., click) operation for a summary of a piece of information is received in an information flow page, a details page of the piece of information may be entered. The detail pages of information may include images, text, video, and the like. In some possible examples, the detail page of the information may further include links of other pages, the links may be displayed in the detail page in the form of an abstract or an image, and when a trigger operation for the abstract or the image is received, the page corresponding to the link is skipped to.

As shown in fig. 4A, fig. 4A is a schematic diagram of an information flow page provided in an embodiment of the present application, and multiple pieces of information arranged in sequence are displayed in a browser page (information flow page), where a display area of each piece of information may or may not have a corresponding thumbnail image. For example, the abstract 401 is information "two days in the past keep high temperature, and the places need to pay attention to the heatstroke prevention measures" and there is a corresponding thumbnail image on the right side of the display area.

Therefore, the user can be intuitively felt through the thumbnail image of the information displayed in the human-computer interaction interface, and the user is helped to judge whether the image in the human-computer interaction interface needs to be stored or not.

In step 102, in response to the screenshot operation, displaying the screenshot of the human-computer interaction interface and a screenshot storing entrance.

In some embodiments, the screenshot operation may be implemented by triggering a specific physical key in the terminal, or by performing a touch operation on the terminal screen, for example, clicking a screenshot button in a notification bar, and swiping a single finger or a double finger down the terminal screen. As shown in fig. 3A and 3B, in fig. 3A, the screenshot can be realized by simultaneously pressing the upper left key and the right key of the mobile phone; in fig. 3B, the screen capture can be realized by pressing the main key below the screen of the mobile phone and the key on the right side at the same time. Therefore, the screenshot can be triggered in different modes in different terminals, and the screenshot mode is not limited in the embodiment of the application.

In some possible examples, the map entry may be used for both generic screenshots and batch screenshots (in this case, batch map entry). The common screenshot and the screenshot corresponding to the screenshot for realizing batch image storage may be the same or different. For example, when a main key and a right key of the mobile phone are triggered simultaneously, a common screenshot can be performed; and when the button on the upper left side and the button on the right side of the mobile phone are simultaneously triggered, the screenshot of the batch image storage is carried out. Therefore, common screenshots can be distinguished from screenshots for realizing batch image storage, and the user is prevented from confusing operation.

In some embodiments, in response to the screenshot operation, the displayed screenshot of the human-computer interaction interface may be a complete screenshot of the human-computer interaction interface, a screenshot of a partial region of the human-computer interaction interface, a scrolling screenshot of the human-computer interaction interface, and the like. Scrolling screenshots, i.e., screenshots of pages displayed in a downward scrolling screen, include screenshots of portions beyond the terminal screen area that can be rendered. The screenshot of the human-computer interaction interface can be presented in the terminal screen in the original size, and can also be displayed in a certain area of the terminal screen in the form of a preview. As shown in fig. 4B, after the screen shot, the screen shot of the browser page is displayed in a reduced size in the form of a preview 402 at the lower left of the terminal screen, and at the same time, a map entry 403 is displayed at the lower side of the terminal screen.

In some embodiments, at the same time of displaying the screenshot of the human-computer interaction interface, at least one of the following operation entries for the screenshot is also displayed: a save entry for saving the screenshot; a sharing entry for sending the screenshot; and the editing inlet is used for editing the screenshot. If the trigger operation aiming at the storage entrance is received, storing the screenshot of the human-computer interaction interface to the local terminal; if the triggering operation aiming at the sharing entry is received, sharing the screenshot of the human-computer interaction interface, for example, sharing by calling sharing entries such as instant messaging applications (such as WeChat and nailing) and social applications (such as forum and microblog); and if the trigger operation aiming at the editing entry is received, editing the screenshot of the human-computer interaction interface, such as cutting, adding annotations, setting a filter and the like.

In some embodiments, the original image may be obtained in a pre-obtaining manner, that is, the original image is obtained in advance before the user triggers the map saving entry. When the original image is acquired in a pre-acquisition mode, responding to screenshot operation, displaying a screenshot of a human-computer interaction interface, and performing identification processing based on the screenshot to obtain at least one thumbnail image included in the screenshot; before the map storage entry is displayed, original images of at least one thumbnail image are searched for from the link page to form a pre-acquisition image set, and the map storage entry is displayed. Therefore, a plurality of original images corresponding to the thumbnail images in the screenshot can be obtained in advance before the image storage entrance is triggered, when a user determines that image storage in batches is needed, the needed original images can be directly obtained from the pre-obtained image set, and the image processing efficiency is improved.

In some possible examples, before displaying the map storage entry, a link of information corresponding to at least one thumbnail image may be acquired, a plurality of original images corresponding to the thumbnail images may be acquired from a link page pointed by the link, and the plurality of original images may be combined to obtain a set of pre-acquired images.

In some possible examples, the set of pre-acquired images may be stored in a buffer space of the terminal, and the buffer space may be automatically cleared periodically or aperiodically to ensure sufficient available buffer space because the buffer space has limited storage space. The size of the storage space of the cache space may be a preset value of the terminal system, or may be set manually. The cache space may be stored according to a first-in first-out rule, that is, when the number of the original images in the pre-acquired image set stored in the cache space exceeds a number threshold, the original images in the pre-acquired image set are deleted according to a first-in first-out sequence. For example, the threshold of the number of the cache spaces stored by default is 30, and when the 31 st original image needs to be stored, the image with the earliest storage time in the images stored in the cache spaces is deleted. Therefore, the cache space can remove the unnecessary original image in time, and the occupation of the cache space is avoided.

Therefore, according to the method and the device, the original image can be obtained in advance and stored in the cache space when the user is uncertain whether the image storage requirement exists, when the user is determined to need to store the images in batches, the original image in the cache space can be called in time and stored, and the storage efficiency and the processing speed are improved.

In some embodiments, when a human-computer interaction interface (such as a browser) is browsed in a 'no-image mode', responding to screenshot operation, displaying a screenshot of the human-computer interaction interface, detecting the network condition of a terminal, and displaying an image storage inlet if the network is smooth (if the network speed is higher than a preset network speed); if the network is not smooth (if the network speed is less than or equal to the preset network speed), displaying a network condition prompt, and determining whether to display the image storage entrance according to the feedback of the user to the network condition prompt. For example, a network condition prompt is displayed as 'current network is not good, please determine whether batch image storage is needed', a 'yes' button and a 'no' button are displayed below the network condition prompt, if a user clicks the 'yes' button, a 'no image mode' is closed, and an image storage inlet is displayed; and if the user clicks the 'no' button, the map storage entry is not displayed. Therefore, the corresponding screenshot mode can be provided for the user according to the network condition of the user, and the screenshot mode is matched with the network condition.

And 103, responding to a trigger operation for the image storage entrance, and displaying at least one thumbnail image identified based on the screenshot.

In some embodiments, as shown in fig. 4D, fig. 4D is a schematic diagram of an image selection page provided in an embodiment of the present application, where at least one thumbnail image identified based on the screenshot is to be displayed according to a position of each thumbnail image in a human-computer interaction interface. For example, for the thumbnail image corresponding to the first piece of information in the information flow page, because it is at the upper right in the information flow page, in fig. 4D, this thumbnail image is still at the same position at the upper right, as are the other thumbnail images. Therefore, the information of the thumbnail image and the information to which the thumbnail image belongs can be compared conveniently, and the user is helped to recall the corresponding information according to the thumbnail image.

In some embodiments, the thumbnail images may be sorted in the order of the information to which the thumbnail images belong, and the thumbnail images may be displayed in the sorted order. The thumbnail images may also be displayed in an ordered manner according to the dimensions, such as resolution or image type, of the thumbnail images. For example, the image types include jpg, bmp, and psd, and the thumbnail image of the jpg type may be arranged in a front portion of the image selection page, the thumbnail image of the bmp type may be arranged in a middle portion of the image selection page, and the thumbnail image of the psd type may be arranged in a rear portion of the image selection page. Therefore, the thumbnail images are sequenced according to the image types, so that a user can conveniently search the images of the specific types, and the presentation pages of the thumbnail images are more attractive and the types are clearer.

In some embodiments, when the raw image of at least one thumbnail image is pre-acquired before receiving the trigger operation for the picture store entry (i.e., acquired after receiving the screen capture operation), and a plurality of raw images are acquired. In response to a trigger operation for the map storage entry, performing sorting processing on the plurality of original images according to at least one dimension, wherein the dimension of the sorting processing comprises at least one of the following: resolution, image type, image preference level; and displaying a plurality of thumbnail images corresponding to the plurality of original images according to the sequencing processing result of the plurality of original images. For example, when the original images are sorted from large to small according to resolution, the corresponding thumbnail images are sorted according to the sorting of the original images, accordingly. Since the resolution of the original image is positively correlated with the resolution of the thumbnail image, it is possible by such sorting to cause a thumbnail image with a large resolution to be presented in the front part of the image selection page and a thumbnail image with a small resolution to be presented in the rear part of the image selection page, giving the user a priority to notice a thumbnail image with a larger resolution, and optimizing the presentation page of the thumbnail image.

In some possible examples, the degree of each original image meeting the user preference may be determined by a machine learning method, the original images may be sorted according to the degree of the user preference, and the corresponding thumbnail images may be sorted in the image selection page according to the sorting of the original images. Therefore, the thumbnail image with high user preference degree can be presented before the thumbnail image with low user preference degree, and the user only needs to check the plurality of thumbnail images and select the image needing to be stored from the plurality of thumbnail images, so that the efficiency of searching the image is improved.

In some embodiments, the at least one thumbnail image identified based on the screenshot may be a thumbnail image in the information flow page, an image selected from the thumbnail images of the information flow page, or a thumbnail image corresponding to an original image in a link page pointed to by a link of information in the information flow page. The thumbnail images displayed in the image selection page can be randomly selected from the thumbnail images of the information flow page, and the thumbnail images corresponding to the information published in the information flow page by other users who have interaction relations (such as praise, forward and comment) with the user can also be selected and displayed in the image selection page. In this way, the relevance between the displayed thumbnail image and the user can be increased, and the user can be helped to quickly select the image needing to be saved.

In some embodiments, when at least one thumbnail image identified based on the screenshot is displayed, a selection control corresponding to each thumbnail image is also displayed, and the corresponding thumbnail image is selected when the selection control is triggered; in response to a selection operation for the selection control, at least one target thumbnail image selected from the at least one thumbnail image identified based on the screenshot is determined.

In some possible examples, the selection operation is actually a batch selection operation for selecting the at least one selection control. The selection control can appear after the selection operation is executed on the corresponding thumbnail, and the selection control is in a selected state at the moment; the selection operation can be performed on any one of the thumbnail images, so that the corresponding selection control is displayed in each thumbnail image, at this time, only the selection control in the thumbnail image on which the selection operation is performed is in the selected state, and the selection controls in the rest of the thumbnail images on which the selection operation is not performed are still in the unselected state. The selection operation may be an operation of pressing the thumbnail image for a long time, an operation of clicking the thumbnail image, or the like.

As shown in fig. 4D, there is a corresponding selection control (e.g., the selection control 406 in the first thumbnail image) in the lower right corner of each thumbnail image, and when the thumbnail image receives a click operation, the corresponding selection control is triggered, and the state of the corresponding selection control changes to the selected state. The user may select a plurality of thumbnail images at a time, and when a click operation for the plurality of thumbnail images, that is, a selection operation for a selection control in the plurality of thumbnail images is received, the selected plurality of thumbnail images are taken as target thumbnail images. As can be seen, there are a total of 6 selected target thumbnail images in fig. 4D.

In some embodiments, when the selection control for each image is displayed, a deselection entry for all thumbnail images is also displayed; when a trigger operation for canceling the selection of the entry is received, the selection of the thumbnail image is canceled, and at least one of the following operation entries for screenshot is displayed: a sharing entry for sending the screenshot; an editing entry for editing the screenshot; and the saving entrance is used for saving the screenshot. When the edit entry is triggered, an edit page of the screenshot will be presented, where the screenshot can be edited by a variety of editing tools (e.g., scissors, palette, background template, etc.). And when a trigger operation for deselecting the entrance is received, the thumbnail can be selected again.

As shown in fig. 4D, there is a deselection entry 405 in the upper right corner of the image selection page, and when a trigger operation for the deselection entry 405 is received, the page is as shown in fig. 4F, and a sharing entry 409, an editing entry 410, and a saving entry 411 will appear below the page.

Therefore, according to the embodiment of the application, the previous selection of the user can be cancelled through the deselection entrance, the selection of the thumbnail image is carried out again, the selection error of the thumbnail image is avoided, the screenshot can be shared through the sharing entrance to other terminal applications, the screenshot is edited through the editing entrance, and the screenshot is stored through the storage entrance.

In some possible examples, after receiving a trigger operation for deselecting an entry, if a thumbnail image is reselected, at least one of the following operation entries for the selected thumbnail image is displayed: a sharing entry for transmitting the thumbnail image; and a saving entry for saving the thumbnail image. Therefore, the thumbnail images can be rapidly shared, the thumbnail images occupying less memory can be rapidly stored to the local terminal through simple steps, the detailed page of the information corresponding to the thumbnail images does not need to be clicked, and the thumbnail images are searched in the detailed page and stored.

In some embodiments, when the trigger operation for the screenshot entry is not received within the preset waiting time, at least one of the following operation entries for the screenshot is displayed: a sharing entry for sending the screenshot; and the editing inlet is used for editing the screenshot. In some possible examples, a save entry may also be displayed for saving the screenshot.

As shown in fig. 4G, when the trigger operation for the screenshot entry is not received within the preset waiting time, the share entry 412 and the edit entry 413 for the screenshot are displayed.

Therefore, when the trigger operation aiming at the picture storing entrance is not received after the waiting time is exceeded, the user can be determined that the user does not want to store the thumbnail images in the screenshot in batch, then the screenshot is processed normally, the screenshot can be shared through the sharing entrance, and the screenshot is stored through the storing entrance.

In step 104, in response to the saving operation, an original image of at least one thumbnail image is acquired and the original image is stored.

In some embodiments, the save operation is used to save an original image or images. As shown in fig. 4C, when a trigger operation for the batch save button 404, that is, a save operation, is received, the original images of all the thumbnail images in the batch save page shown in fig. 4C are acquired and saved. Therefore, one-key batch graph storage can be realized, the operation is simple, and the cost of batch graph storage is saved.

In some embodiments, when at least one thumbnail image is selected in the image selection page, the at least one thumbnail image is taken as a target thumbnail image, an original image of the at least one target thumbnail image is acquired in response to a save operation, and the original image is stored. Therefore, only the original image required by the user can be saved, the selection space of the user is larger, and the flexibility is higher.

In some embodiments, the acquisition mode of the original image includes pre-acquisition and passive acquisition, and the acquisition mode of the original image may be determined according to a networking mode of the terminal. For example, the pre-acquisition mode is used when the terminal connects to a wireless network, and the passive acquisition mode is used when the terminal connects to a mobile network. Therefore, the original image can be obtained according to the actual networking condition of the user, and the adaptability is stronger.

In some embodiments, when the original image is captured in a pre-capture manner, a set of pre-captured images will be obtained. In response to the saving operation, an original image of at least one thumbnail image is acquired from the pre-acquisition image set, and the original image is stored. And comparing the similarity of the thumbnail images with the original images in the pre-acquired image set one by one to obtain the original image corresponding to each thumbnail image. Therefore, the original images are obtained in advance, so that the original images can be immediately stored when the original images of the thumbnail images are stored in batches, waiting is not needed, the efficiency of storing the images in batches is improved, and user experience is better.

In some embodiments, when the manner of acquiring the original image is passive acquisition, in response to the save operation, a recognition process is performed based on the screen shot, at least one thumbnail image included in the screen shot is obtained, the original image of the at least one thumbnail image is acquired, and the original image is stored.

In some embodiments, when the original image is captured passively, capturing the original image of at least one thumbnail image may be implemented by

steps

1041 and 1042 in fig. 2B.

In step 1041, the screenshot is identified to obtain at least one thumbnail image and a position corresponding to each piece of information displayed in the screenshot.

In some embodiments, the screenshot may be identified by machine learning, resulting in at least one thumbnail image and a location. In the process of identification processing, the screenshot is converted into a gray image, the gray of an area with the image in the screenshot is relatively darker, and the gray of an area without the image is relatively lighter, so that the position of the thumbnail image can be determined according to the ratio of the area (namely the length and the width) of the gray color block, the position and the size of the image can be determined, the accuracy is higher, and the speed is higher.

In step 1042, an original image of the at least one thumbnail image is retrieved from the linked page according to the at least one thumbnail image and the location.

In some embodiments, the link page is the page to which the link to the information in the screenshot points, i.e. a detail page of the information. Other original images can also be acquired from the link page and a secondary link page of the link page, wherein the secondary link page is a page pointed by a link corresponding to the summary of other information in the link page, and the other original images are original images of original images different from the thumbnail images.

The images in the link page include original images corresponding to at least one thumbnail image and may also include other original images, and these original images are unrelated to the information in the link page and therefore do not appear in the display area of the information corresponding to the information flow page.

For example, there are an advertisement digest irrelevant to information and corresponding original images in a link page of information, which do not appear in a display area of the information in the information flow page, but when original images of thumbnail images are acquired from the link page, the original images corresponding to the advertisement digests may be acquired together. In some possible examples, the original image in the secondary link page pointed to by the link of the advertisement summary may also be obtained together.

In some embodiments, when the original image is taken from only the link page, the corresponding page depth is 1, and when the original image is taken from the link page and the secondary link page, the corresponding page depth is 2. The original image can also be obtained from the tertiary link page pointed by the link of other information in the secondary link page, and at the moment, the corresponding page depth is 3. The page depth may be a default value, may also be opened to the user at the front end (i.e., terminal) for setting, may also be adaptively changed according to the number of the original images that need to be acquired, and deepens layer by layer according to the sequence of linking the page and the secondary page, at this time, the page depth will be determined comprehensively according to the domain name of the information flow page, the user, the information type, and other factors. For example, the upper limit of the acquired original images is set to 10 in advance, when 4 original images are acquired from the link page, the original images are continuously acquired from the secondary link page, and when 4 original images are also acquired from the secondary link page, 2 original images are acquired from the tertiary link page, and the page depth is 3. It can be seen that by identifying and acquiring original images of a page "layer by layer" until the acquired original images reach an upper limit number (or set number), more images that may be of interest to a user can be mined, providing more choices for the user.

In some embodiments, when the captured original image includes other original images captured from other pages having a page depth greater than 1 (e.g., secondary link pages), the other original images are displayed or an expanded entry is displayed behind the other thumbnail images in the batch memory page. When the batch storage page is displayed as an expansion entry, other folded original images are displayed in response to a triggering operation (such as a clicking operation) aiming at the expansion entry, when the batch storage page cannot completely present other original images, a horizontal scroll bar or a vertical scroll bar is displayed, and other original images which are not completely presented can be browsed by dragging the horizontal scroll bar or the vertical scroll bar. Therefore, more original images which can be selected for storage are provided for a user, and the original images are folded and hidden through the expansion entrance, so that the phenomenon that the images in the page stored with images in batches are too crowded and the attractiveness of the page is affected is avoided.

In some embodiments, obtaining the original image of the at least one thumbnail image from the link page according to the at least one thumbnail image and the location may be implemented as follows. First, a link of information is acquired from a page of an information stream based on a position of at least one thumbnail image, and a link page is acquired according to the link. The position of at least one thumbnail image can be used as a child node to inquire in the information flow page to obtain a parent node corresponding to the child node, and the link of the parent node is used as the link of information to obtain a corresponding link page. Wherein the structure of the information flow page is described using a DOM tree (i.e., a node tree) including relationships between elements in the information flow page, an HTML interpreter in the terminal being capable of converting a byte stream of the information flow page acquired from the network into the DOM tree, the DOM tree having a root node and a plurality of leaf nodes, each leaf node being a parent node and having a corresponding child node. Thus, the corresponding parent node, i.e., the link to the information at the coordinates, can be obtained from looking up the position (e.g., coordinates) of the thumbnail image as a child node in the DOM tree of the information flow page. Then, the at least one thumbnail image is compared with the plurality of original images in the link page in terms of similarity, and the original images above the similarity threshold are selected as the original images corresponding to the at least one thumbnail image. Thus, the original image corresponding to each thumbnail image can be accurately obtained.

In some embodiments, after acquiring the original image of the at least one thumbnail image, an image filter term is also acquired, wherein the dimension of the image filter term includes at least one of: resolution, image volume, specific domain name; filtering out an original image satisfying the image filtering condition from the plurality of original images, and continuing to filter out a repeated original image, wherein the repeated original image and the deduplication reference image include the same content, for example, include the same person, the same animal, or the same scene. The duplicate removal reference image can be an original image acquired by the previous screenshot, or can be other images stored locally in the terminal. The original image and the deduplication reference image may be subjected to name comparison or image feature comparison, and when the similarity between the original image and the deduplication reference image is higher than a preset similarity value, it is determined that the original image and the deduplication reference image are repeated. The image volume is the storage space occupied by the image, and the specific domain name is the domain name corresponding to the information flow page, and can be a sensitive domain name or a domain name irrelevant to the image. The image filtering condition may be that the resolution is below a resolution threshold, the image volume is greater than an image volume threshold, the domain name is a specific domain name, and so on. By filtering the original images meeting the image filtering condition, the original images with low resolution can be removed, the original images with overlarge image volume can be removed, the storage resource is saved, and the original images which possibly belong to sensitive images in a specific domain name can be excluded. On the basis, repeated original images are removed, so that the storage space waste caused by the storage of a plurality of similar images can be avoided.

In some embodiments, after acquiring the original image of the at least one thumbnail image, an image replacement condition is also acquired, wherein the dimension of the image replacement condition includes at least one of: resolution, image volume, image type; and acquiring an image which has the same content as the original image meeting the image replacement condition and does not meet the image replacement condition, and replacing the original image meeting the image replacement condition. The image replacement condition may be that the resolution is above a resolution threshold, the image volume is less than an image volume threshold, or the image type is a preset image type. Therefore, the original image with the high resolution can be replaced by the original image with the low resolution which comprises the same content (similar), so that the definition of the saved image is improved; the original image with the smaller image volume is replaced by the original image with the same content and the larger image volume, so that the storage space is saved; the original image can be replaced by an original image of a preset image type (for example, the png type original image is converted into the jpg type original image) which comprises the same content, so that the diversification requirements of the user are met.

For example, when the resolution of the original image obtained from the link page is lower than the resolution threshold, the image search engine may be invoked to search for and replace a high-resolution (i.e., higher than the resolution threshold) image similar thereto. When the resolution of the original image is lower than the resolution threshold value, the high-resolution image can be automatically searched and replaced, a prompt message can be displayed, and when the user confirms that the high-resolution image needs to be replaced, the high-resolution image is obtained through an image search engine to be replaced.

In some embodiments, the original image may be stored locally in the terminal, for example, in fig. 4E, to the album 408, or may be stored in a non-local storage space such as a network disk or a cloud album, so that the local storage space of the terminal may be saved, and when the user deletes an image in the local album by mistake, the mistakenly deleted image may be recovered from the network disk or the cloud album.

In some embodiments, the image processing method provided by the embodiments of the present application may be cooperatively implemented by a terminal and a server. Referring to fig. 2C, fig. 2C is an interaction flow diagram of an image processing method according to an embodiment of the present application. A process of implementing the image processing method provided by the embodiment of the present application by the cooperation of the terminal and the server will be described below with reference to steps 201 to 212 in fig. 2C.

Step 201, the terminal displays at least one piece of information in the information stream and the corresponding thumbnail image in the man-machine interaction interface.

And 202, responding to the screenshot operation, and displaying the screenshot of the human-computer interaction interface and a picture storage entrance by the terminal.

Step 203, responding to the trigger operation aiming at the image storage entrance, and the terminal sends an identification instruction carrying the screenshot to the server.

And step 204, the server identifies the screenshot based on the identification instruction to obtain at least one thumbnail image and a position included in the screenshot.

In step 205, the server sends at least one thumbnail image and a location to the terminal.

In step 206, the terminal displays at least one thumbnail image according to the position of the thumbnail image.

In step 207, the terminal acquires a link of corresponding information based on the position of at least one thumbnail image in response to the save operation.

And step 208, the terminal sends an original image acquisition instruction carrying the link to the server.

In step 209, the server acquires a plurality of original images in a link page to which the link points based on the original image acquisition instruction.

In step 210, the server compares the similarity of at least one thumbnail image with a plurality of original images to obtain original images corresponding to the at least one thumbnail image one to one.

In step 211, the server transmits an original image corresponding to at least one thumbnail image to the terminal.

Step 212, the terminal saves the original image.

It should be noted that the above steps have been described in detail in the foregoing, and are not described again here.

Therefore, in the embodiment of the application, the server determines at least one thumbnail image and a position included in the screenshot, so that the accuracy of the determined thumbnail image and the position thereof can be improved. The original images corresponding to the thumbnail images are obtained through the server and returned to the terminal for storage, batch image storage can be achieved through cooperative processing of the server and the terminal when the terminal capacity is limited and batch storage of the original images cannot be achieved independently, and image storage efficiency is improved. Meanwhile, the server undertakes partial image processing work, so that terminal resources can be saved, terminal processing efficiency can be improved, and the terminal can be protected from interference of possibly risky link pages.

When the user selects the image to be saved from the at least one thumbnail image, the user can select the image to be saved from the at least one thumbnail image; after the storage operation is received, a plurality of original images can be obtained and stored, so that batch storage of the plurality of images is realized, and the stored images are the original images and are clearer.

Next, an exemplary application of the embodiment of the present application in a practical application scenario will be described.

Referring to fig. 4A, fig. 4A is a schematic diagram of an information flow page provided in an embodiment of the present application. In fig. 4A, a plurality of pieces of information are arranged in order from top to bottom. When receiving the screenshot operation, as shown in fig. 4B, a preview 402 and a map saving entry 403 of the screenshot appear in the information flow page, and after receiving the trigger operation for the map saving entry 403, the batch map saving page shown in fig. 4C is displayed, and each image in the information flow page is to be presented at the original position in the batch map saving page. And when receiving the selection operation of the user on at least one thumbnail image in the batch image storage page, determining the thumbnail image which needs to be stored by the user. In response to a trigger operation of the save button 407 in the image selection page shown in fig. 4D, the original image of the thumbnail image selected by the user is saved to the local album

The above-described image saving process will be described with reference to the steps in fig. 5.

Step 301, responding to screenshot operation, the terminal displays the screenshot of the information flow page.

Step 302, responding to the saving operation of the thumbnail image in the screenshot, the terminal sends an identification instruction to the server.

And step 303, the server performs AI identification on the screenshot based on the identification instruction to obtain a thumbnail image and a corresponding position in the screenshot.

And step 304, the server sends the thumbnail image in the screenshot and the corresponding position to the terminal.

In step 305, the terminal displays the thumbnail image based on the position of the thumbnail image.

In step 306, in response to the selection operation of the selection control for at least one thumbnail image, the terminal determines the selected thumbnail image.

In step 307, the terminal acquires a link to information corresponding to the selected thumbnail image.

And 308, the terminal sends an original image acquisition instruction carrying the link to the server.

In step 309, the server acquires the original image corresponding to the selected thumbnail image based on the original image acquisition instruction.

Step 310, the server sends the original image to the terminal.

And 311, the terminal stores the original image.

The key technique used in the above-described image saving process will be described below.

1. Image content understanding

a) After receiving a trigger operation for the image storage inlet 403, calling a server interface to send the screenshot to a server for analysis, identifying the thumbnail images contained in the screenshot by the server in an AI identification mode, reading the position of each thumbnail image, and returning the thumbnail images and the positions thereof contained in the screenshot to the terminal.

In the process of AI identification, the screenshot is converted into a gray image, the gray of the area with the image in the screenshot is relatively darker, and the gray of the area without the image is relatively lighter, so that the position area of the image can be determined according to the area occupation ratio of the gray color blocks.

b) And after receiving the thumbnail images and the positions thereof contained in the screenshot, the terminal displays the thumbnail images in a floating layer mode.

2. Crawler capture images

a) And determining a thumbnail image which is selected by a user from the plurality of images displayed in the floating layer and is wanted to be saved, and obtaining a link of corresponding information of the thumbnail image in the information flow page according to the position of the selected thumbnail image. The DOM elements (i.e., child nodes) at the same position in the information flow page can be obtained according to the coordinates of the selected thumbnail image, query is performed upwards in the information flow page, the parent elements (i.e., parent nodes) of the DOM elements are determined, and jump links, i.e., links of information corresponding to the image (e.g., links of an article containing the image), are obtained.

b) Crawling the link of the information by a crawler technology to obtain all original images in the link page corresponding to the information.

And for crawling of the static webpage, analyzing and matching can be performed according to the webpage source code. Python is used to operate because the regular expression of Python is powerful, and in addition, when using the crawler technology, some libraries may be used to simplify the operation, for example, two libraries, i.e., a request for a network request and bs4 for parsing the web page source code to obtain the desired data, may be used. And finally, storing the crawled data through a MySQLdb database.

3. Image similarity matching

a) And performing similarity matching on all original images crawled by the crawler and the thumbnail image selected by the user to obtain the original image of the thumbnail image selected by the user.

4. The uni-app saves the original image to the system album.

And downloading and storing the original image to the local album by using the two APIs of the uni-app, downloading the original image to the local through the API of file downloading, obtaining a temporary path if the downloading is successful, and storing the original image to the local album through the API of picture storage.

It can be seen that in the embodiment of the application, a user can save a plurality of images of a plurality of pieces of information in an information flow page through simple operation, the cost of saving the images in batches is greatly saved, the user operation efficiency is improved, the user experience is improved, and the improvement of the activity of sharing the images by the user is facilitated.

An exemplary structure of the terminal described above is explained below. Referring to fig. 6, fig. 6 is a schematic structural diagram of a terminal 400 provided in an embodiment of the present application, where the terminal 400 shown in fig. 6 includes: at least one processor 410-1, memory 450, at least one network interface 420, and a user interface 430. The various components in the terminal 400 are coupled together by a bus system 440. It is understood that the bus system 440 is used to enable connected communication between these components. The bus system 440 includes a power bus, a control bus, and a status signal bus in addition to a data bus. For clarity of illustration, however, the various buses are labeled as bus system 440 in fig. 6.

The Processor 410-1 may be an integrated circuit chip having Signal processing capabilities, such as a general purpose Processor, a Digital Signal Processor (DSP), or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like, wherein the general purpose Processor may be a microprocessor or any conventional Processor, or the like.

The user interface 430 includes one or more output devices 431, including one or more speakers and/or one or more visual displays, that enable the presentation of media content. The user interface 430 also includes one or more input devices 432, including user interface components to facilitate user input, such as a keyboard, mouse, microphone, touch screen display screen, camera, other input buttons and controls.

The memory 450 may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid state memory, hard disk drives, optical disk drives, and the like. Memory 450 may optionally include one or more storage devices physically located remote from processor 410-1.

The memory 450 includes both volatile memory and nonvolatile memory, and can include both volatile and nonvolatile memory. The nonvolatile memory may be a Read Only Memory (ROM), and the volatile memory may be a Random Access Memory (RAM). The memory 450 described in embodiments herein is intended to comprise any suitable type of memory.

In some embodiments, memory 450 is capable of storing data to support various operations, examples of which include programs, modules, and data structures, or subsets or supersets thereof, as exemplified below.

The operating system 451, which includes system programs for handling various basic system services and performing hardware-related tasks, such as a framework layer, a core library layer, a driver layer, etc., is used for implementing various basic services and for processing hardware-based tasks.

A network communication module 452 for communicating to other computing devices via one or more (wired or wireless) network interfaces 420, exemplary network interfaces 420 including: bluetooth, wireless fidelity (WiFi), and Universal Serial Bus (USB), among others.

A rendering module 453 for enabling the rendering of information (e.g., user interfaces for operating peripherals and displaying content and information) via one or more output devices 43 (e.g., display screens, speakers, etc.) associated with the user interface 430.

An input processing module 454 for detecting one or more user inputs or interactions from one of the one or more input devices 432 and translating the detected inputs or interactions.

In some embodiments, the image processing apparatus provided in the embodiments of the present application may be implemented in software, and fig. 6 illustrates an image processing apparatus 455 stored in a memory 450, which may be software in the form of programs and plug-ins, and includes a display module 4551 and a storage module 4552.

The functions of the respective modules will be explained below.

A display module 4551, configured to display at least one piece of information in the information stream and a corresponding thumbnail image in the human-computer interaction interface; responding to screenshot operation, and displaying a screenshot of a human-computer interaction interface and a screenshot storing entrance; displaying at least one thumbnail image identified based on the screenshot in response to a trigger operation for the screenshot entry; a storage module 4552 configured to acquire an original image of at least one thumbnail image in response to a save operation, and store the original image.

In some embodiments, when the original image is obtained in a pre-obtaining manner, the display module 4551 is further configured to display a screenshot of the human-computer interaction interface in response to a screenshot operation, perform recognition processing based on the screenshot, and obtain at least one thumbnail image included in the screenshot; before displaying the map entry, the original images of at least one thumbnail image are searched from the link page to form a pre-acquired image set, and the map entry is displayed.

In some embodiments, the display module 4551 is further configured to acquire an original image of at least one thumbnail image from the set of pre-acquired images.

In some embodiments, the display module 4551 is further configured to store the set of pre-acquired images in a buffer space; and when the number of the original images in the pre-acquired image set exceeds a number threshold, deleting the original images in the pre-acquired image set according to a first-in first-out sequence.

In some embodiments, when the original image is obtained passively, the storage module 4552 is further configured to perform an identification process based on the screenshot in response to the saving operation, obtain at least one thumbnail image included in the screenshot, and search for the original image of the at least one thumbnail image from the link page.

In some embodiments, the storage module 4552 is further configured to perform an identification process on the screenshot, obtain at least one thumbnail image and a location corresponding to each piece of information displayed in the screenshot, and obtain an original image of the at least one thumbnail image from the link page according to the at least one thumbnail image and the location.

In some embodiments, the storage module 4552 is further configured to obtain other original images from the link page and a secondary link page of the link page, where the other original images are original images different from the original image of the thumbnail image.

In some embodiments, the storage module 4552 is further configured to obtain a link to information from a page of the information stream based on a location of the at least one thumbnail image, and obtain a linked page according to the link; and comparing the similarity of at least one thumbnail image with a plurality of original images in the link page to obtain the original images in one-to-one correspondence with the at least one thumbnail image.

In some embodiments, the storage module 4552 is further configured to query, in an information flow page, a location of at least one thumbnail image as a child node, to obtain a parent node of the corresponding child node; the link of the parent node is used as the link of the information.

In some embodiments, the storage module 4552 is further configured to obtain the image filtering condition, wherein the dimension of the image filtering condition includes at least one of: resolution, image volume, specific domain name; and filtering out original images meeting the image filtering condition from the plurality of original images, and continuing to filter out repeated original images, wherein the repeated original images and the deduplication reference image comprise the same content.

In some embodiments, the storage module 4552 is further configured to obtain the image replacement condition, wherein the dimension of the image replacement condition includes at least one of: resolution, image volume, image type; and acquiring an image which has the same content as the original image meeting the image replacement condition and does not meet the image replacement condition, and replacing the original image meeting the image replacement condition.

In some embodiments, when the original image of the at least one thumbnail image is pre-acquired before receiving the trigger operation for the map storage entry, and a plurality of original images are acquired, the display module 4551 is further configured to perform an ordering process on the plurality of original images according to at least one dimension, where the dimension of the ordering process includes at least one of: resolution, image type, degree of image preference; and displaying a plurality of thumbnail images corresponding to the plurality of original images according to the sequencing processing result of the plurality of original images.

In some embodiments, the display module 4551 is further configured to send, in response to a trigger operation for the image saving entry, an identification instruction carrying a screenshot to the server, so that the server performs identification processing on the screenshot based on the identification instruction, to obtain at least one thumbnail image and a location included in the screenshot; and receiving at least one thumbnail image and a position sent by the server, and displaying the at least one thumbnail image according to the position.

In some embodiments, the display module 4551 is further configured to, in response to the save operation, obtain a link to the corresponding information based on a position of the at least one thumbnail image; sending an original image acquisition instruction carrying a link to a server so that the server acquires a plurality of original images in a link page pointed by the link based on the original image acquisition instruction, and comparing the similarity of at least one thumbnail image with the plurality of original images to obtain original images corresponding to the at least one thumbnail image one by one; and receiving the original images which are sent by the server and correspond to the at least one thumbnail image one by one.

Embodiments of the present application provide a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and executes the computer instructions, so that the computer device executes the image processing method described in the embodiment of the present application.

Embodiments of the present application provide a computer-readable storage medium having stored therein executable instructions, which when executed by a processor, will cause the processor to execute an image processing method provided by embodiments of the present application, for example, the image processing method as shown in fig. 2A.

In some embodiments, the computer-readable storage medium may be memory such as FRAM, ROM, PROM, EP ROM, EEPROM, flash memory, magnetic surface memory, optical disk, or CD-ROM; or may be various devices including one or any combination of the above memories.

In some embodiments, executable instructions may be written in any form of programming language (including compiled or interpreted languages), in the form of programs, software modules, scripts or code, and may be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.

By way of example, executable instructions may correspond, but do not necessarily have to correspond, to files in a file system, and may be stored in a portion of a file that holds other programs or data, such as in one or more scripts in a hypertext Markup Language (H TML) document, in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files that store one or more modules, sub-programs, or portions of code).

By way of example, executable instructions may be deployed to be executed on one computing device or on multiple computing devices at one site or distributed across multiple sites and interconnected by a communication network.

In summary, in screenshot, if a trigger operation for a screenshot entry is received, at least one thumbnail image in the screenshot of the human-computer interaction interface is displayed, so that a user can select an image to be saved from the at least one thumbnail image conveniently; after the storage operation is received, a plurality of original images can be obtained and stored, so that batch storage of the plurality of images is realized, and the stored images are the original images and are clearer.

The above description is only an example of the present application, and is not intended to limit the scope of the present application. Any modification, equivalent replacement, and improvement made within the spirit and scope of the present application are included in the protection scope of the present application.

Claims

1. An image processing method, characterized in that the method comprises:

displaying at least one piece of information in the information flow and a corresponding thumbnail image in a human-computer interaction interface;

in response to a save operation, an original image of the at least one thumbnail image is acquired and the original image is stored.

2. The method of claim 1, wherein when the original image is obtained in a pre-obtaining manner, the displaying the screenshot of the human-computer interaction interface and the map storage entry in response to the screenshot operation comprises:

before the map storage entry is displayed, original images of the at least one thumbnail image are searched from a link page to form a pre-acquired image set, and the map storage entry is displayed;

the acquiring of the original image of the at least one thumbnail image comprises:

3. The method of claim 2, further comprising:

storing the set of pre-acquired images in a cache space;

4. The method according to claim 1, wherein said obtaining the original image of the at least one thumbnail image in response to the save operation when the original image is obtained passively comprises:

and responding to a saving operation, performing identification processing based on the screenshot, obtaining at least one thumbnail image included in the screenshot, and searching an original image of the at least one thumbnail image from a link page.

5. The method according to claim 2 or 4, wherein said searching for the original image of the at least one thumbnail image from the link page comprises:

identifying the screenshot to obtain at least one thumbnail image and a position corresponding to each piece of information displayed in the screenshot, and acquiring an original image of the at least one thumbnail image from the link page according to the at least one thumbnail image and the position;

the method further comprises the following steps:

6. The method according to claim 5, wherein the obtaining the original image of the at least one thumbnail image from the link page according to the at least one thumbnail image and the position comprises:

7. The method of claim 6, wherein the obtaining the link to the information from the information flow page displayed by the human-computer interaction interface based on the position of the at least one thumbnail image comprises:

and taking the link of the parent node as the link of the information.

8. The method of claim 1, wherein after the obtaining the original image of the at least one thumbnail image, the method further comprises:

acquiring an image filtering condition, wherein the dimension of the image filtering condition comprises at least one of the following: resolution, image volume, specific domain name;

and filtering out original images meeting the image filtering condition from a plurality of original images, and continuing to filter out repeated original images, wherein the repeated original images and the de-duplication reference images comprise the same content.

9. The method of claim 1, wherein after the obtaining the original image of the at least one thumbnail image, the method further comprises:

10. The method according to claim 1, wherein when an original image of the at least one thumbnail image is pre-acquired before receiving a trigger operation for a map entry, and a plurality of the original images are acquired, displaying the at least one thumbnail image identified based on the screenshot comprises:

sorting the plurality of original images according to at least one dimension, wherein the dimension of the sorting process comprises at least one of the following: resolution, image type, degree of image preference;

11. The method of claim 1, wherein displaying at least one thumbnail image identified based on the screenshot in response to a triggering operation for the screenshot entry comprises:

12. The method of claim 1, wherein said retrieving an original image of the at least one thumbnail image in response to a save operation comprises:

sending an original image acquisition instruction carrying the link to a server, so that the server acquires a plurality of original images in a link page pointed by the link based on the original image acquisition instruction, and comparing the similarity of the at least one thumbnail image with the plurality of original images to obtain original images corresponding to the at least one thumbnail image one by one;

13. An image processing apparatus characterized by comprising:

14. An electronic device, comprising:

a memory for storing executable instructions;

a processor for implementing the image processing method of any one of claims 1 to 12 when executing executable instructions stored in the memory.

15. A computer-readable storage medium having stored thereon executable instructions for causing a processor to, when executed, implement the image processing method of any one of claims 1 to 12.