CN115994051A

CN115994051A - Picture backup system, method and equipment

Info

Publication number: CN115994051A
Application number: CN202111202758.XA
Authority: CN
Inventors: 李雪峰
Original assignee: Petal Cloud Technology Co Ltd
Current assignee: Petal Cloud Technology Co Ltd
Priority date: 2021-10-15
Filing date: 2021-10-15
Publication date: 2023-04-21
Also published as: WO2023061298A1

Abstract

The application provides a picture backup system, a picture backup method and picture backup equipment. The picture backup system comprises a terminal device and a storage device. In the system, when the terminal equipment needs to backup the target picture on the storage equipment, the terminal equipment sends a backup request to the storage equipment, and the picture backup system can determine the picture information of the reference picture corresponding to the target picture from at least one stored candidate picture. The at least one candidate picture comprises pictures backed up in the storage device by at least one second user associated with the first user, and the reference pictures are screened from the pictures backed up by the at least one second user, so that the range of the candidate pictures can be narrowed, and the efficiency of determining the reference pictures is improved. After the reference picture is determined, the picture backup system can determine the difference information of the target picture relative to the reference picture, so that the bandwidth cost and the storage cost of picture backup are saved, and the picture backup is efficiently realized.

Description

Picture backup system, method and equipment

Technical Field

The present disclosure relates to the field of image backup systems, methods, and apparatuses.

Background

With the enhancement of photographing capability of the terminal device, the data volume of the picture stored by the user using the terminal device is also increasing. Considering that the storage capacity of the terminal equipment is limited, more and more users select to store the pictures in the cloud server in a backup mode. For example, the user may upload pictures local to the terminal device to the server at the picture-backup software. When a user needs to view the picture, the picture can be searched in the picture backup software at any time and downloaded to the local.

The mode of the terminal equipment backing up the pictures to the server has great requirements on the bandwidth cost and the storage cost of the server. At present, under the condition of the same bandwidth, the commonly adopted modes for improving the photo transmission performance are as follows: and when the terminal equipment uploads the picture, after recoding the picture into the high-definition thumbnail, uploading the high-definition thumbnail to the server. In this way, the picture transmission bandwidth is saved and the storage cost is saved. However, this processing method may cause the picture stored in the server to be actually a changed picture, and cannot be restored, thereby affecting the user experience.

In summary, there is a need for an efficient picture backup method.

Disclosure of Invention

The application provides a picture backup system, a picture backup method and picture backup equipment.

In a first aspect, the present application provides a picture backup system, where the system includes a terminal device and a storage device.

The terminal device is configured to send the backup request to the storage device, where the backup request is used to request to backup a target picture in the storage device;

the system is used for determining the picture information of the reference picture corresponding to the target picture from the stored picture information of at least one candidate picture; the at least one candidate picture comprises pictures backed up in the storage device by at least one second user associated with a first user corresponding to the terminal device; and determining difference information of the target picture relative to the reference picture.

In the system, when the terminal device needs to backup the target picture on the storage device, the storage device or the terminal device can determine the picture information of the reference picture corresponding to the target picture from at least one stored candidate picture. The at least one candidate picture comprises pictures backed up in the storage device by at least one second user associated with the first user, and the reference pictures are screened from the pictures backed up by the at least one second user, so that the range of the candidate pictures can be narrowed, and the efficiency of determining the reference pictures is improved. After determining the reference picture, the storage device or the terminal device may determine difference information of the target picture with respect to the reference picture. By the scheme, the terminal equipment does not need to actually upload the target picture, the storage equipment does not need to store the target picture, but stores the difference information of the target picture, so that the backup of the target picture can be realized, the bandwidth cost of the picture backup is saved, the storage cost is saved, and the picture backup is realized efficiently.

Optionally, the similarity between the reference picture and the target picture is greater than a set threshold.

That is, the reference picture is a picture similar to the target picture, and the picture backup system may determine the reference picture and calculate difference information between the target picture and the reference picture, thereby backing up the target picture using the difference information.

In one possible design, the system is further configured to: acquiring user information of the first user; at least one second user associated with the first user is determined from the user information of the first user.

By this design, the storage device or the terminal device may obtain user information of the first user and determine at least one second user associated with the first user. The first user is associated with the second user, and the picture backed up by the second user in the storage device may be similar to the target picture requested to be backed up by the first user, so that the range of selecting the picture when searching the reference picture can be reduced, and the efficiency of determining the reference picture is improved.

In one possible design, the user information of the first user includes at least one of:

a user identification of the first user;

a common wireless local area network of the first user;

an internet protocol address corresponding to the first user;

a usual address of the first user;

a motion trail of the first user;

social application information of the first user;

the first user's label is information selected by the first user to represent the first user's preference or characteristics.

In one possible design, the first user and the second user satisfy at least one of the following conditions:

the first user and the second user have the same common wireless local area network;

the first user and the second user have the same internet protocol address;

the distance between the liveness address of the first user and the liveness address of the second user is smaller than a first threshold value;

the contact ratio of the motion trail of the first user and the motion trail of the second user is larger than a second threshold value;

the number of times that the first user and the second user are connected through the social application is larger than a third threshold value;

the second user is a user which is selected by the first user and has close relation with the first user;

the first user has the same tag as the second user.

Through the design, at least one second user associated with the first user can be determined according to the user information, and the user information can comprise information such as user preference or user characteristics, so that the determined second user is associated with the first user.

In one possible design, the step of determining the picture information of the reference picture corresponding to the target picture from the stored picture information of the at least one candidate picture is performed by the terminal device or the storage device.

Through the design, the storage device or the terminal device can be used for determining the picture information of the reference picture, and the picture backup method provided by the application is flexibly realized.

In one possible design, the backup request includes picture information of the target picture; the system is particularly used for: and acquiring the picture information of the at least one candidate picture, and determining the picture information of the reference picture according to the picture information of the target picture and the picture information of the at least one candidate picture.

By the design, when the terminal equipment backs up the target picture to the storage equipment, the picture information of the target picture can be carried in the backup request. The storage device or the terminal device can determine a reference picture corresponding to the target picture from at least one candidate picture according to the picture information of the target picture and the picture information of the candidate picture, so that the reference picture found out is a picture similar to the target picture and can be used for calculating the difference information.

Optionally, the picture information of the target picture is matched with the picture information of at least one candidate picture, which may be that the content included in the picture information of the target picture is the same as some or all of the content included in the picture information of the candidate picture, or some or all of the content meets a preset matching condition.

For example, if the picture size of the target picture is the same as the picture size of a candidate picture, the candidate picture may be determined to be the reference picture.

For another example, if the difference between the shooting location of the target picture and the shooting time of one candidate picture is smaller than a preset threshold, and the distance between the shooting location of the target picture and the shooting location of the candidate picture is smaller than the preset threshold, the candidate picture may be determined as the reference picture.

Of course, the contents contained in the picture information of the target picture and the candidate picture may involve a plurality of dimensions, such as the picture itself and attribute information of the picture, photographing information of the picture, and the like. When determining the reference picture, the matching condition may be that a similarity of information of one or more dimensions in the picture information of the target picture and the picture information of the candidate picture is greater than a preset threshold.

In one possible design, the backup request includes picture information of the reference picture; the storage device is further configured to: acquiring picture information of the at least one candidate picture, and sending the picture information of the at least one candidate picture to the terminal equipment; the terminal device is further configured to: receiving the picture information of at least one candidate picture sent by the storage device, and determining the picture information of the reference picture according to the picture information of the target picture and the picture information of the at least one candidate picture.

Through the design, the terminal equipment can determine the picture information of the reference picture corresponding to the target picture and carry the picture information of the reference picture in the backup request, so that the storage equipment can acquire the picture information of the reference picture after receiving the backup request, the calculated amount of the storage equipment is reduced, and the backup efficiency is improved.

In one possible design, the picture information of any one candidate picture or the picture information of the target picture includes at least one of:

the picture itself, picture identification, picture size, shooting time, shooting position and thumbnail;

the picture information of the target picture and the picture information of the reference picture satisfy at least one of the following conditions:

the picture size of the target image is the same as the picture size of the reference picture;

the difference between the shooting time of the target picture and the shooting time of the reference picture is smaller than a fourth threshold;

a distance between a photographing position of the target picture and a photographing position of the reference picture is smaller than a fifth threshold.

Through the design, the picture information can comprise at least one of an identifier, a picture size, a shooting time, a shooting position and a thumbnail, so that when the picture information of the reference picture of the target picture is determined, the storage device or the terminal device can screen the candidate picture meeting the conditions according to the picture information of the target picture and the picture information of the candidate picture to serve as the reference picture, and ensure that the determined reference picture is a picture similar to the target picture, and can be used for calculating the difference information.

In one possible design, the step of determining difference information of the target picture with respect to the reference picture is performed by the terminal device or the storage device.

Through the design, the difference information of the target picture can be determined by the terminal equipment and then sent to the storage equipment, and can also be determined by the storage equipment, so that the difference information of the target picture can be calculated flexibly.

In one possible design, the picture information of the reference picture determined by the storage device is the reference picture itself. The storage device is specifically configured to: determining at least one similar picture from the at least one candidate picture according to the picture information of the target picture and the picture information of the at least one candidate picture; the reference picture is determined from the at least one similar picture based on a deep learning algorithm.

In one possible design, the storage device is specifically configured to: inputting a thumbnail of at least one similar picture and a thumbnail of the target picture into a deep learning model respectively; obtaining the similarity between each similar picture output by the deep learning model and the target picture; and taking a similar picture with the similarity with the target picture being larger than a set threshold value as the reference picture.

Through the design, when the storage device determines the reference picture corresponding to the target picture, at least one similar picture can be determined from at least one candidate picture, then the reference picture is determined from at least one similar picture based on the deep learning algorithm, the search space during reference picture screening is further optimized, and the efficiency and accuracy of reference picture determination are improved.

In one possible design, the terminal device is further configured to: sending a downloading request to the storage equipment, wherein the downloading request is used for requesting to acquire the target picture; receiving the difference information and the picture information of the reference picture, which are sent by the storage equipment; generating the target picture according to the difference information and the picture information of the reference picture;

the storage device is further configured to: and sending the difference information and the picture information of the reference picture to the terminal equipment.

By the design, after the terminal equipment backs up the target picture to the storage equipment, the terminal equipment can send a downloading request to the storage equipment when the terminal equipment needs to download the target picture to the local again. The storage device may transmit picture information and difference information of the reference picture to the terminal device, and the terminal device may generate the target picture according to the picture information and the difference information of the reference picture. By the scheme, the difference information and the picture information of the reference picture stored in the storage device can be used for recovering and obtaining the target picture, so that the accuracy of the backup target picture is ensured.

In one possible design, the storage device is a server or a home storage device.

In a second aspect, the present application provides a picture backup method, which is applied to a storage device. The method comprises the following steps:

receiving a backup request sent by a terminal device, wherein the backup request is used for requesting to backup a target picture in the storage device; determining picture information of a reference picture corresponding to the target picture from stored picture information of at least one candidate picture; the at least one candidate picture comprises pictures backed up in the storage device by at least one second user associated with a first user corresponding to the terminal device; and determining difference information of the target picture relative to the reference picture.

In one possible design, the method further comprises: acquiring user information of the first user; at least one second user associated with the first user is determined from the user information of the first user.

a user identification of the first user;

a common wireless local area network of the first user;

an internet protocol address corresponding to the first user;

A usual address of the first user;

a motion trail of the first user;

social application information of the first user;

the first user and the second user have the same internet protocol address;

the first user has the same tag as the second user.

In one possible design, the determining, from the stored picture information of the at least one candidate picture, the picture information of the reference picture corresponding to the target picture includes: and acquiring the picture information of the at least one candidate picture, and determining the picture information of the reference picture according to the picture information of the target picture and the picture information of the at least one candidate picture.

In one possible design, the method further comprises: receiving a downloading request sent by the terminal equipment, wherein the downloading request is used for requesting to acquire the target picture; and sending the difference information and the picture information of the reference picture to the terminal equipment so that the terminal equipment generates the target picture according to the difference information and the picture information of the reference picture.

In a third aspect, the present application provides a picture backup method, which is applied to a terminal device. The method comprises the following steps:

acquiring picture information of a target picture to be backed up; determining picture information of a reference picture corresponding to the target picture from stored picture information of at least one candidate picture; the at least one candidate picture comprises pictures backed up in the storage device by at least one second user associated with a first user corresponding to the terminal device; determining difference information of the target picture relative to the reference picture; and sending a backup request to a storage device so that the storage device backs up the target picture, wherein the backup request comprises picture information of the reference picture and the difference information.

In one possible design, before determining the picture information of the reference picture corresponding to the target picture from the stored picture information of the at least one candidate picture, the method further includes: and receiving the picture information of the at least one candidate picture sent by the storage equipment.

In one possible design, the method further comprises: transmitting user information of the first user to the storage device, so that the storage device determines at least one second user associated with the first user according to the user information of the first user; or determining the at least one second user selected by the first user, and sending the user identification of the at least one second user to the storage device, so that the storage device determines at least one second user associated with the first user according to the user identification of the at least one second user.

a user identification of the first user;

a common wireless local area network of the first user;

an internet protocol address corresponding to the first user;

a usual address of the first user;

a motion trail of the first user;

social application information of the first user;

the first user and the second user have the same internet protocol address;

the first user has the same tag as the second user.

In one possible design, the method further comprises: sending a downloading request to the storage equipment, wherein the downloading request is used for requesting to acquire the target picture; receiving the difference information and the picture information of the reference picture, which are sent by the storage equipment; and generating the target picture according to the difference information and the picture information of the reference picture.

In a fourth aspect, the present application provides a picture backup apparatus, the apparatus including a plurality of functional modules; the plurality of functional modules interact to implement the method of any of the aspects and embodiments thereof described above. The plurality of functional modules may be implemented based on software, hardware, or a combination of software and hardware, and the plurality of functional modules may be arbitrarily combined or divided based on the specific implementation.

In a fifth aspect, the present application provides a storage device comprising at least one processor and at least one memory, the at least one memory storing computer program instructions that, when the storage device is operating, the at least one processor performs the method performed by the storage device of any of the above aspects and embodiments thereof.

In a sixth aspect, the present application provides a terminal device, including at least one processor and at least one memory, where the at least one memory stores computer program instructions, and where the at least one processor performs the method performed by the terminal device in any of the above aspects and embodiments thereof when the electronic device is running.

In a seventh aspect, the present application also provides a computer program which, when run on a computer, causes the computer to perform the method of any of the above aspects and embodiments thereof.

In an eighth aspect, the present application further provides a computer readable storage medium having a computer program stored therein, which when executed by a computer, causes the computer to perform the method of any one of the aspects and embodiments thereof.

In a ninth aspect, the present application further provides a chip for reading a computer program stored in a memory, and performing the method of any one of the above aspects and embodiments thereof.

In a tenth aspect, the present application further provides a chip system, which includes a processor for supporting a computer device to implement the method in any one of the above aspects and embodiments thereof. In one possible design, the chip system further includes a memory for storing programs and data necessary for the computer device. The chip system may be formed of a chip or may include a chip and other discrete devices.

Drawings

Fig. 1 is a schematic diagram of a picture backup scenario provided in an embodiment of the present application;

fig. 2 is an interface schematic diagram of a picture backup application provided in an embodiment of the present application;

fig. 3 is a schematic structural diagram of a terminal device according to an embodiment of the present application;

fig. 4 is a software structural block diagram of a terminal device provided in an embodiment of the present application;

fig. 5 is a flowchart of a picture backup method provided in an embodiment of the present application;

fig. 6 is a schematic diagram of a terminal device reporting user information to a server according to an embodiment of the present application;

fig. 7A is a schematic diagram of a server accessing a backup picture set of a user according to an embodiment of the present application;

FIG. 7B is a schematic diagram of a server accessing a backup picture set of a user according to an embodiment of the present application;

fig. 8 is a flowchart of a method for determining a reference picture according to an embodiment of the present application;

FIG. 9 is a schematic diagram of a differential calculation according to an embodiment of the present application;

FIG. 10 is a flowchart of a method for providing a first example of picture backup;

FIG. 11 is a flowchart of a second exemplary picture backup method provided in the present application;

FIG. 12 is a flowchart of a third exemplary method for picture backup provided herein;

FIG. 13 is a flowchart of a method for providing a fourth example of picture backup;

fig. 14 is a schematic block diagram and a functional schematic diagram of a server according to an embodiment of the present application.

Detailed Description

To facilitate an understanding of embodiments of the present application, the following terms relating to embodiments of the present application are presented:

(1) Differential calculation means that differential calculation is performed on at least two pictures to determine difference information between the pictures, and the difference information can be used to represent a difference part between the pictures.

(2) Thumbnail refers to a picture with reduced pixels after recoding the picture, and the data volume of the thumbnail is reduced compared with that of the original picture.

Fig. 1 is a schematic diagram of a picture backup scenario provided in an embodiment of the present application. Referring to fig. 1, the scenario includes a plurality of terminal devices and at least one storage device, and three terminal devices (terminal device a, terminal device B, and terminal device C) and one storage device are illustrated in fig. 1. The storage device may be a server or a home storage device, such as a network attached storage (network attached storage, NAS), among others. For ease of description, in the following description, a storage device is illustrated as a server.

When the user needs to carry out the picture backup, the user can operate to upload the picture on the terminal equipment to the server, so that the uploaded picture is stored in the server to realize the picture backup. After the user uploads the picture to the server, the user can choose to delete the picture stored on the terminal device, so that the storage space of the terminal device is released. When the user wants to view these pictures, the pictures uploaded to the server can be viewed through the picture backup application and selected to be downloaded locally, so that the pictures are acquired again.

Optionally, a picture backup application may be installed on the terminal device, and the user may operate to upload the picture to the server in the application. For example, fig. 2 is an interface schematic diagram of a picture backup application provided in an embodiment of the present application. Referring to fig. 2, the user may click on "upload picture" and select a picture to be uploaded in the picture preview interface. And the terminal equipment uploads the picture selected by the user to the server, and the server receives the picture and stores the received picture in a storage space of the server.

It should be noted that, the image backup application may be an application carried by an operating system of the terminal device or a preset function, such as a cloud disk application carried by the operating system; or the photo backup application may be an embedded application developed for a third party vendor. The embodiments of the present application are not limited in this regard.

The above description can show that the picture backup mode has larger requirements on the bandwidth cost and the storage cost of the server, and the following description is made on two modes for improving the picture transmission performance.

And the terminal equipment uploads the thumbnail to the server.

And after the terminal equipment responds to an uploading instruction triggered by a user, recoding the picture to be uploaded into a high-definition thumbnail, and uploading the high-definition thumbnail to a server so as to save the picture transmission bandwidth and save the storage cost of the server.

Mode two, second transmission function

After the terminal equipment responds to an uploading instruction triggered by a user, a request for uploading the picture is sent to a server, and the request can carry an identification of the picture to be uploaded. After receiving the request for uploading the picture, the server determines that the identification of the picture to be uploaded is the same as the identification of the picture stored in the server, and indicates that the picture to be uploaded is stored in the server, at this time, the server only needs to newly establish a picture reference in a folder corresponding to the user of the picture to be uploaded, and the picture reference can include the identification and/or the storage address of the picture uploaded to the server.

For example, assuming that the terminal device requests to backup the picture a to the server, the server searches for the picture stored in the server according to the identification of the picture a, and determines that the picture B has the same identification as the picture a, that is, the picture a and the picture B are the same picture. The server may inform the terminal device that no uploading of the picture a is required, but newly builds a picture reference in a folder corresponding to the user who requests uploading of the picture a, where the picture reference includes an identifier and/or a storage address of the picture B. And the server stores the picture information of the picture A into a folder corresponding to the user, so that the picture A is backed up. When the user operates the terminal device to request the server to download the picture A, the server can search the picture B stored in the server according to the identification and/or the storage address of the picture B in the picture reference, the server sends the picture information of the picture B and the picture A to the terminal device, and the terminal device stores the picture information of the picture B and the picture A locally to finish downloading the backed-up picture A.

Through the second transmission function, when the same pictures are stored in the server, the terminal equipment can realize picture backup without actually uploading the pictures to be uploaded to the server. That is, for the same picture, only one picture needs to be stored in the server, and the picture may be associated with a plurality of picture information, each including related data when the user uploads the picture.

It can be seen from the above that, in the first mode, in order to improve the transmission performance of the picture, the definition of the picture needs to be lost, and the recoding into the thumbnail can lead to that the picture stored by the server is actually a changed picture, and cannot be restored, so that the user experience is affected. The second transmission function in the second mode can obtain larger benefits only in a scene with higher repetition rate of uploading pictures by the user, but the benefits in the scene of uploading pictures by the individual user are smaller, and the picture transmission performance cannot be obviously improved.

In summary, there is a need for an efficient picture backup method.

Based on the above problems, the embodiments of the present application provide a picture backup method, which is used to save bandwidth cost and storage cost in the picture backup method. In the picture backup method provided by the embodiment of the application, when a user has a picture backup requirement, the server can acquire the user information and determine the user set. When a terminal device corresponding to any user in the user set sends an uploading request to the server to request for backing up the target picture, the server can determine a reference picture of the target picture in a candidate picture set formed by the backup pictures of all users in the user set, and determine difference information of the target picture compared with the reference picture. Therefore, the server can take the reference picture identification and the difference information as the backup information of the target picture, and the backup of the target picture can be realized without uploading the target picture by the terminal equipment.

It may be appreciated that in the embodiments of the present application, the terminal device may be a mobile phone, a tablet computer, a wearable device (e.g., a watch, a bracelet, a helmet, an earphone, etc.), a vehicle-mounted device, an augmented reality (augmented reality, AR)/Virtual Reality (VR) device, a notebook computer, an ultra-mobile personal computer, a UMPC, a netbook, a personal digital assistant (personal digital assistant, PDA), an intelligent home device (e.g., an intelligent television, an intelligent speaker, an intelligent camera, etc.), and so on.

The structure of the terminal device in the embodiment of the present application will be described below with reference to the accompanying drawings.

Fig. 3 is a schematic structural diagram of a terminal device 100 according to an embodiment of the present application. As shown in fig. 3, the terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display 194, a user identification module (subscriber identification module, SIM) card interface 195, and the like.

The processor 110 may include one or more processing units, such as: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors. The controller may be a neural center and a command center of the terminal device 100. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution. A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby improving the efficiency of the system.

The USB interface 130 is an interface conforming to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, or the like. The USB interface 130 may be used to connect a charger to charge the terminal device 100, or may be used to transfer data between the terminal device 100 and a peripheral device. The charge management module 140 is configured to receive a charge input from a charger. The power management module 141 is used for connecting the battery 142, and the charge management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140 and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, the wireless communication module 160, and the like.

The wireless communication function of the terminal device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like. The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the terminal device 100 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a solution including 2G/3G/4G/5G wireless communication applied to the terminal device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 150 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be provided in the same device as at least some of the modules of the processor 110.

The wireless communication module 160 may provide solutions for wireless communication including wireless local area network (wireless local area networks, WLAN) (e.g., wireless fidelity (wireless fidelity, wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field wireless communication technology (near field communication, NFC), infrared technology (IR), etc., applied to the terminal device 100. The wireless communication module 160 may be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.

In some embodiments, antenna 1 and mobile communication module 150 of terminal device 100 are coupled, and antenna 2 and wireless communication module 160 are coupled, such that terminal device 100 may communicate with a network and other devices via wireless communication techniques. The wireless communication techniques may include the Global System for Mobile communications (global system for mobile communications, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC, FM, and/or IR techniques, among others. The GNSS may include a global satellite positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a beidou satellite navigation system (beidou navigation satellite system, BDS), a quasi zenith satellite system (quasi-zenith satellite system, QZSS) and/or a satellite based augmentation system (satellite based augmentation systems, SBAS).

The display 194 is used to display a display interface of an application, for example, a desktop of the terminal device 100, on which icons of the application installed by the terminal device 100 may be included, and the like. The display 194 includes a display panel. The display panel may employ a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED) or an active-matrix organic light-emitting diode (matrix organic light emitting diode), a flexible light-emitting diode (flex), a mini, a Micro led, a Micro-OLED, a quantum dot light-emitting diode (quantum dot light emitting diodes, QLED), or the like. In some embodiments, the terminal device 100 may include 1 or N display screens 194, N being a positive integer greater than 1.

The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, the terminal device 100 may include 1 or N cameras 193, N being a positive integer greater than 1.

The internal memory 121 may be used to store computer executable program code including instructions. The processor 110 executes various functional applications of the terminal device 100 and data processing by executing instructions stored in the internal memory 121. The internal memory 121 may include a storage program area and a storage data area. The storage program area may store an operating system, software code of at least one application program, and the like. The storage data area may store data (e.g., photographed images, recorded videos, etc.) generated during use of the terminal device 100, and the like. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and the like.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to realize expansion of the memory capability of the terminal device. The external memory card communicates with the processor 110 through an external memory interface 120 to implement data storage functions. For example, files such as pictures and videos are stored in an external memory card.

The terminal device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playing, recording, etc.

The sensor module 180 may include a pressure sensor 180A, an acceleration sensor 180B, a touch sensor 180C, and the like, among others.

The pressure sensor 180A is used to sense a pressure signal, and may convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194.

The touch sensor 180C, also referred to as a "touch panel". The touch sensor 180C may be disposed on the display 194, and the touch sensor 180C and the display 194 form a touch screen, which is also referred to as a "touch screen". The touch sensor 180C is used to detect a touch operation acting thereon or thereabout. The touch sensor may communicate the detected touch operation to the application processor to determine the touch event type. Visual output related to touch operations may be provided through the display 194. In other embodiments, the touch sensor 180C may also be disposed on the surface of the terminal device 100 at a different location than the display 194.

The keys 190 include a power-on key, a volume key, etc. The keys 190 may be mechanical keys. Or may be a touch key. The terminal device 100 may receive key inputs, generating key signal inputs related to user settings and function controls of the terminal device 100. The motor 191 may generate a vibration cue. The motor 191 may be used for incoming call vibration alerting as well as for touch vibration feedback. For example, touch operations acting on different applications (e.g., photographing, audio playing, etc.) may correspond to different vibration feedback effects. The touch vibration feedback effect may also support customization. The indicator 192 may be an indicator light, may be used to indicate a state of charge, a change in charge, a message indicating a missed call, a notification, etc. The SIM card interface 195 is used to connect a SIM card. The SIM card may be contacted and separated from the terminal apparatus 100 by being inserted into the SIM card interface 195 or by being withdrawn from the SIM card interface 195.

It will be appreciated that the components shown in fig. 3 do not constitute a particular limitation of the terminal device 100, and that the terminal device may also include more or less components than illustrated, or may combine certain components, or split certain components, or may be arranged in different components. Furthermore, the combination/connection relationship between the components in fig. 3 is also adjustable and modifiable.

Fig. 4 is a software structural block diagram of a terminal device according to an embodiment of the present application. As shown in fig. 4, the software structure of the terminal device may be a hierarchical architecture, for example, the software may be divided into several layers, each layer having a clear role and division of work. The layers communicate with each other through a software interface. In some embodiments, the operating system is divided into four layers, from top to bottom, an application layer, an application framework layer (FWK), runtime and system libraries, and a kernel layer, respectively.

The application layer may include a series of application packages. As shown in fig. 4, the application layer may include a camera, settings, skin modules, user Interfaces (UIs), three-way applications, and the like. The three-party application program can comprise a gallery, calendar, conversation, map, navigation, WLAN, bluetooth, music, video, short message, and the like.

The application framework layer provides an application programming interface (application programming interface, API) and programming framework for application programs of the application layer. The application framework layer may include some predefined functions. As shown in fig. 4, the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

The window manager is used for managing window programs. The window manager can acquire the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like. The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebooks, etc.

The view system includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a display interface including a text message notification icon may include a view displaying text and a view displaying a picture.

The telephony manager is arranged to provide communication functions for the terminal device. Such as the management of call status (including on, hung-up, etc.).

The resource manager provides various resources for the application program, such as localization strings, icons, pictures, layout files, video files, and the like.

The notification manager allows the application to display notification information in a status bar, can be used to communicate notification type messages, can automatically disappear after a short dwell, and does not require user interaction. Such as notification manager is used to inform that the download is complete, message alerts, etc. The notification manager may also be a notification in the form of a chart or scroll bar text that appears on the system top status bar, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in a status bar, a prompt tone is emitted, the terminal equipment vibrates, and an indicator light blinks.

The runtime includes a core library and a virtual machine. The runtime is responsible for the scheduling and management of the operating system.

The core library consists of two parts: one part is a function which needs to be called by java language, and the other part is a core library of an operating system. The application layer and the application framework layer run in a virtual machine. The virtual machine executes java files of the application program layer and the application program framework layer as binary files. The virtual machine is used for executing the functions of object life cycle management, stack management, thread management, security and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface manager (surface manager), media library (media library), three-dimensional graphics processing library (e.g., openGL ES), 2D graphics engine (e.g., SGL), etc.

The surface manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.

Media libraries support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio and video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc.

The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.

The 2D graphics engine is a drawing engine for 2D drawing.

In some embodiments, a three-dimensional graphics processing library may be used to render three-dimensional motion trail images, and a 2D graphics engine may be used to render two-dimensional motion trail images.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.

The hardware layer may include various sensors such as acceleration sensors, gyroscopic sensors, touch sensors, and the like.

The picture backup method according to the embodiment of the present application is described below with reference to the accompanying drawings.

Fig. 5 is a flowchart of a picture backup method provided in an embodiment of the present application. Referring to fig. 5, the method includes the steps of:

s501: the server obtains user information of the first user and determines at least one second user associated with the first user.

Alternatively, the user information may include a user identification of the first user, first user common wireless local area network (wireless local area network, wlan) information, an IP address of a terminal device to which the first user corresponds, a resident location of the first user, and the like. The location of the first user may be, for example, a GPS location of the terminal device or a location of a base station of the terminal device.

It should be noted that, in the embodiment of the present application, when the first user has a picture backup requirement, the terminal device may report the user information of the first user to the server. Before reporting user information to the server, the terminal device needs to acquire user authorization. For example, the terminal device displays a message for obtaining the authorization of the user on the display screen, and after the user agrees to the authorization, the terminal device sends the user information of the first user to the server.

In some embodiments, the terminal device may report the encrypted user information to the server, and the server may determine the user set of the first user according to the encrypted user information after receiving the encrypted user information. The terminal device may encrypt the user information, for example, by using an encryption algorithm.

It can be understood that, before uploading the picture to be backed up to the server, the terminal device corresponding to each user having the picture backup requirement can report the user information of the user to the server. For example, fig. 6 is a schematic diagram of a terminal device reporting user information to a server according to an embodiment of the present application. Fig. 6 illustrates 3 terminal devices, each corresponding to a user, and each reporting user information of the user to the server. The server can receive the user information reported by all the terminal devices, analyze the received user information and determine a plurality of user sets. The users included in each user set may be considered closely related users, and similar pictures may exist in the pictures that the users need to backup.

In an alternative embodiment, after acquiring the user information of the first user, the server may determine at least one second user associated with the first user, where the at least one second user and the first user may form a first user set corresponding to the first user. Wherein the second user may be a second user in close relationship to the first user. For example, a second user that is closely related to the first user may be a user that is frequently located closer to the first user than the address, or a user that is frequently in contact with the first user.

In another alternative embodiment, the first user may select the second user closely related to the first user by itself, where the first user and the second user together form the first user set. The terminal device may then send the user identification of the first user and its selected second user to the server so that the server may determine the first set of users.

Optionally, the manner of determining the first user set according to the server is different, and the relationship between the first user and the second user in the first user set is different. The manner in which the server determines the first set of users in embodiments of the present application is described below.

Mode 1, the first user and the second user have the same common wlan.

For example, the server may determine second users having the same common wlan as the first user, and the terminal devices used by the second users and the terminal devices used by the first user access the same wireless local area network, and may consider that the second users may have close relationships with the first user, and the server may divide the first user and the determined second users into the first user set.

Mode 2, the first user and the second user have the same internet protocol (internet protocol address, IP) address.

For example, the server may determine that the second user has the same IP address as the first user, that is, the first user and the second user log on to their own account using the same terminal device, and may consider that the first user and the second user may have close relationships, and the server may divide the first user and the second user into the first user set.

Mode 3, the distance between the liveness address of the first user and the liveness address of the second user is less than the first threshold value.

For example, the server may determine a second user within a distance from the home address of the first user that is less than a first threshold, and the server may divide the first user and the second user into a first set of users. When the constant addresses of the first user and the second user are close, the working or learning sites of the first user and the second user may be the same or the distance is close, and at this time, the pictures uploaded by the first user and the second user may be similar.

It should be noted that the constant address of the first user may be, for example, a GPS address of the terminal device, or may be a location of a constant base station of the terminal device.

And 4, the contact ratio of the motion trail of the first user and the motion trail of the second user is larger than a second threshold value.

For example, the user information of the first user may include a motion trail of the first user, the server may determine a second user having a motion trail overlapping the first user greater than a second threshold, and the server may divide the first user and the second user into the first user set. The second user and the first user determined according to the mode have similar active areas, and at the moment, the first user and the second user may upload similar pictures.

Mode 5, the number of times the first user is contacted with the second user through the social application is greater than a third threshold.

For example, the user information of the first user may further include a user and a number of times of connection of the first user through the social application, and the server may divide the second user and the first user, which are connected with the first user through the social application by more than a third threshold, into the first user set. When the frequency of the first user and the second user connected through the social application is high, the pictures uploaded by the first user and the second user may be similar, for example, the first user may send the picture to the second user through the social application, and the first user and the second user select to backup the picture to the server.

Mode 6, the second user is the user selected by the first user to be closely related to the first user.

For example, the user information of the first user may further include an identification of the second user selected by the first user as the affinity user. After receiving the user information of the first user, the server may divide the first user and the second user into a first user set.

Mode 7, the first user and the second user are users having the same tag.

Illustratively, the user information of the first user may further include a label of the user, where the label of the user may be selected by the user, for example, the label of the user may be a preference of the user: travel, food, etc. The server may divide the first user and the second user having the same tag as the first user into the first set of users.

It should be noted that the manner in which the server determines the first set of users is merely an example, and in implementation, the server may determine the first set of users in combination with at least one of the foregoing manners, which is not limited in this embodiment of the present application. For example, when the server determines the first user set according to a plurality of ways, each way of determining the first user set may correspond to a different weight, so that the server may determine the first user set according to a plurality of ways and the weight corresponding to each way, or may set priorities for a plurality of ways, and the server may select a way in which the priorities are higher to determine the first user set.

In the picture backup method provided by the embodiment of the invention, the server determines the first user set corresponding to the first user, and when more similar pictures are in the backup picture set of the second user in the first user set and the pictures to be uploaded by the first user, the picture backup method provided by the invention can obtain larger benefits. Based on the design thought, the server may further add a third user in the first user set, where the third user may be a virtual user. The backup picture set of the third user may include a picture preset by the server. For example, when the first user and the second user in the first user set are users with close frequent addresses, the backup picture set of the third user may include pictures of landmark buildings near the frequent addresses of the first user. For another example, when a first user and a second user in the first set of users have the same travel tag, a third user's backup set of pictures may include pictures of common attractions.

S502: and the server receives the uploading request sent by the terminal equipment.

The terminal equipment is corresponding to the first user, and the uploading request is used for requesting uploading of the target picture to the server so as to realize picture backup.

Optionally, the uploading request may include picture information of the target picture, where the picture information of the target picture may include part or all of a picture identifier, a picture size, a shooting time, a shooting position, a thumbnail, and a pixel feature value. The picture identifier may be, for example, a hash value of a picture, and it can be known from the foregoing description that the hash value of the picture may be used as a unique identifier of the picture to distinguish different pictures. The thumbnail may be a picture recoded for the target icon, the thumbnail having pixels lower than the target picture. The pixel characteristic value is a vector characteristic extracted based on pixel information of the picture, and for example, the pixel characteristic value may include brightness of the picture, shape of an object in the picture, and the like.

S503: and the server determines the picture information of the reference picture corresponding to the target picture.

Optionally, after determining the first user set of the first user, the server may use, as candidate pictures, pictures in the backup picture set corresponding to some or all of the users in the first user set, where at least one candidate picture forms the candidate picture set.

It can be understood that when the server receives an upload request sent by any user in the first user set, the server may access a backup picture set of some or all users in the first user set to determine picture information of a reference picture corresponding to a picture to be uploaded. For example, the server may determine the picture itself of the reference picture from at least one candidate picture of the set of candidate pictures. Before accessing the backup picture set of the user, the server can send an authorization request to the terminal equipment used by the user, and access the backup picture set of the user after receiving the message sent by the terminal equipment and approved by the user. Alternatively, the user may choose to open the functionality of sharing the backup picture set, at which point the server may access the user's backup picture set. Further, when the server accesses the backup picture set of the user, the server may access the backup picture after the encryption processing, that is, the server may obtain the ciphertext obtained after the encryption processing for the backup picture.

For example, fig. 7A is a schematic diagram of a server accessing a backup picture set of a user according to an embodiment of the present application. Referring to fig. 7A, the first user is user a, the second user is user B and user C, and user D does not belong to the first user set. The server may access the backup picture sets of the user B and the user C when receiving the upload request sent by the terminal device corresponding to the user a after obtaining the authorizations of the user a, the user B and the user C. Meanwhile, the server cannot access the backup picture set of the user D at this time.

For another example, fig. 7B is a schematic diagram of a backup picture set of a server access user according to an embodiment of the present application. Referring to fig. 7B, the first user is user a, and the second user is user B, user C, and user D. When the server receives an uploading request sent by the terminal equipment corresponding to the user A, if the server determines that the authorization of the user D is not obtained or the server determines that the user D has closed the function of sharing the backup picture set, the server cannot access the backup picture set of the user D.

In an alternative embodiment, the server may store picture information for at least one candidate picture in the candidate picture set. After receiving the uploading request sent by the terminal device, the server can determine the reference picture from at least one candidate picture according to the picture information of the target picture and the picture information of the at least one candidate picture in the uploading request.

In another alternative embodiment, the server may further send the picture information of at least one candidate picture in the candidate picture set to the terminal device. For example, the server may send the picture information of the at least one candidate picture to the terminal device via a wireless fidelity (wireless fidelity, wiFi) direct technology or bluetooth technology. The terminal equipment stores the picture information of at least one candidate picture, and determines the picture information of the reference picture according to the picture information of the target picture and the picture information of at least one candidate picture. After determining the picture information of the reference picture, the terminal device may carry the picture information of the reference picture in the upload request, for example, the picture identifier of the reference picture is carried in the upload request. The server may determine the reference picture according to picture information of the reference picture in the upload request.

In summary, in the embodiment of the present application, the server may determine the picture information of the reference picture, or the terminal device may determine the picture information of the reference picture, and then send the picture information of the reference picture to the server through an upload request. The method for determining the reference picture provided in the embodiment of the present application will be described below by taking the determination of the reference picture by the server as an example.

Fig. 8 is a flowchart of a method for determining a reference picture according to an embodiment of the present application. Referring to fig. 8, the method includes the steps of:

s801: and the server acquires the picture information of the target picture from the received uploading request.

S802: the server judges whether a candidate picture with the same identification as the target picture exists in the candidate picture set; if yes, go to S803; otherwise, S804 is entered.

S803: the server transmits the target picture in seconds.

Optionally, if the server determines that the candidate picture set has the candidate picture with the same identifier as the target picture, which indicates that the target picture has been uploaded to the server before, the server may then upload the target picture in seconds. That is, the terminal device does not need to actually upload the target picture, and the server can newly create a reference of the target picture in the backup picture set of the first user, so as to realize the backup of the target picture by the first user.

S804: the server judges whether a similar picture similar to the target picture exists in the candidate picture set; if yes, go to S805; otherwise, S807 is entered.

In an alternative embodiment, S804 may be considered as a step in which the server sifts through the candidate picture set for pictures similar to the target picture. Alternatively, the server may determine whether a similar picture similar to the target picture exists in the candidate picture set according to the information such as the picture size, the shooting time, the shooting position, and the like included in the picture information.

For example, the server may regard a candidate picture having the same picture size as the picture size of the target picture as the similar picture. For another example, the server may regard, as the similar picture, a candidate picture whose difference between the photographing time and the photographing time of the target picture is smaller than the fourth threshold. For another example, the server may further regard, as the similar picture, a candidate picture in which the distance between the photographing location and the photographing location of the target picture is smaller than the fifth threshold.

It should be noted that, when determining whether the candidate picture set has a similar picture, the server in the embodiment of the present application is not limited to the above examples in the embodiment of the present application, for example, the picture information may also include information such as brightness and contrast of the picture, and the information may also be used to determine whether the candidate picture set has a similar picture, which is not limited in the embodiment of the present application.

S805: the server judges whether a reference picture exists in the similar pictures or not based on a deep learning algorithm; if yes, go to S806; otherwise, S807 is entered.

S806: and the server determines a reference picture corresponding to the target picture.

In an alternative embodiment, the server may input the thumbnail of the similar picture and the thumbnail of the target picture into the deep learning model, and obtain the similarity between the similar picture output by the deep learning model and the target picture. The server may use, as the reference picture, a similar picture having a similarity to the target picture greater than the set threshold.

It should be noted that, the deep learning model in the embodiment of the present application may be a trained model that may be used to calculate the similarity of pictures, for example, the deep learning module may be a support vector machine (support vector machines, SVM) model, a convolutional neural network model, and the like. The deep learning model in the embodiment of the application may be obtained based on training feature information of the picture, where the feature information of the picture may include, for example, a feature of a directional gradient histogram (histogram of oriented gradient, HOG) of the picture, cosine similarity, similarity obtained based on histogram calculation, and the like.

In another alternative embodiment, the server may further input the similar picture and the target picture into the deep learning model to determine the similarity of the similar picture and the target picture. In this design, the terminal device is required to upload the target picture to the server first, and at this time, the server may determine the reference picture corresponding to the target picture in the candidate picture set according to the above method, instead of storing the target picture in the backup picture set of the first user. Of course, in this embodiment, the bandwidth cost of the terminal device does not change during the process of backing up the target picture, but when the server determines that the reference picture corresponding to the target picture exists in the candidate picture set, the difference information of the target picture can be determined according to the picture backup method provided by the embodiment of the present application, and the difference information is stored in the server, so that the storage cost is saved.

In some embodiments, the server may determine a plurality of pictures with similarity greater than a set threshold from the similar pictures, where the server may use a picture with highest similarity as the reference picture; alternatively, the server may take the plurality of pictures as reference pictures.

S807: the server determines that a reference picture corresponding to the target picture does not exist in the candidate picture set.

Optionally, if the server determines that the candidate picture set does not have a similar picture, or if the similar picture does not have a reference picture, the server determines that the candidate picture set does not have a reference picture corresponding to the target picture. At this time, the terminal device needs to upload the target picture normally, and the server stores the target picture in the backup picture set corresponding to the first user after receiving the target picture.

It can be appreciated that the manner of determining the reference picture may also be performed by the terminal device, and may be specifically implemented in the manner shown in fig. 8, which is not described herein.

S504: the server determines difference information between the target picture and the reference picture.

The difference information may be binary data corresponding to a difference portion between the target picture and the reference picture, or the difference information may be information of a position where a difference exists between the target picture and the reference picture.

In an alternative embodiment, the server may perform differential calculation on the target picture and the reference picture to determine the difference information corresponding to the target picture.

In still another optional embodiment, the terminal device may perform differential calculation on the target picture and the reference picture, determine difference information corresponding to the target picture, and send the difference information corresponding to the target picture to the server. The server may receive the message sent by the terminal device and obtain the difference information corresponding to the target picture from the message.

For example, fig. 9 is a schematic diagram of differential calculation according to an embodiment of the present application. Referring to fig. 9, when the server or the terminal device performs differential calculation on the target picture and the reference picture, the pixel values at the same position of the target picture and the reference picture may be calculated, for example, the pixel values are subtracted to obtain differential information; or the server or the terminal device may take information of a position where there is a difference between the target picture and the reference picture as the difference information.

In some embodiments, if multiple reference pictures are determined, the server or the terminal device may perform differential calculation on each reference picture and the target picture, determine multiple difference information, and retain the difference information with the smallest data amount and the reference picture corresponding to the difference information.

S505: and the server stores the difference information corresponding to the target picture.

Optionally, after determining the difference information corresponding to the target picture, the server may use the reference picture identifier and the difference information as backup information of the target icon, and store the backup information. That is, the terminal device does not need to upload the target picture, and the server does not need to store the target picture, but stores backup information to realize the backup of the target picture.

When the backup information of the target picture is stored in the server, if the server receives a downloading request sent by the terminal device, the downloading request is used for requesting to download the target picture, the server can send the backup information of the target picture and the reference picture to the terminal device, and the terminal device synthesizes the target picture according to the backup information and the reference picture; or the server can synthesize the target picture according to the backup information of the target picture and the reference picture to obtain the target picture, and then send the target picture to the terminal equipment.

By means of the picture backup method provided by the embodiment of the application, when the terminal equipment needs to backup the target picture on the server, the server can firstly determine at least one second user associated with the first user, and the picture backed up by the at least one second user in the storage equipment can serve as at least one candidate picture. And screening the reference pictures from the pictures backed up by at least one second user, so that the range of the candidate pictures can be narrowed, and the efficiency of determining the reference pictures is improved. After determining the reference picture, the storage device or the terminal device may determine difference information of the target picture with respect to the reference picture. By the scheme, the terminal equipment does not need to actually upload the target picture, the storage equipment does not need to store the target picture, but stores the difference information of the target picture, so that the backup of the target picture can be realized, the bandwidth cost of the picture backup is saved, the storage cost is saved, and the picture backup is realized efficiently.

In some embodiments, the first set of users may further comprise a plurality of subsets, different subsets may correspond to different relationships of the first user to the second user. For example, the first set of users may include subset a, subset B, subset C, and subset D. The second users in the subset A are users with the same common wlan as the first users, the second user motion trail in the subset B is a user with the motion trail overlapping the first user more than a second threshold, the second users in the subset C are users with the same travel label as the first user, and the second users in the subset D are users with the same food label as the first user.

In some scenarios, the terminal device may request to upload multiple pictures to the server in batch, where the terminal device may classify the multiple pictures, and different types of pictures may correspond to different subsets in the first user set. For example, a picture of the type "scenic spot" may correspond to the subset C, and a picture of the type "food" may correspond to the subset D. By the method, when uploading pictures of different types, the server or the terminal equipment can search the reference pictures corresponding to the pictures to be uploaded in the backup pictures of the subsets corresponding to the types, so that the search space is prioritized, and the efficiency of searching the reference pictures is improved.

The picture backup method provided in the embodiment of the present application is further described below by using several specific examples:

example 1

Fig. 10 is a flowchart of a method for providing a first example of picture backup. Referring to fig. 10, in this example, after receiving an upload request from a terminal device, a server determines a reference picture corresponding to a target picture that the terminal device requests to upload, and calculates difference information corresponding to the target picture. Specifically, the method comprises the following steps:

s1001: the server acquires user information of a first user and determines a first user set corresponding to the first user.

Wherein the first set of users includes at least one second user associated with the first user.

S1002: the server determines a candidate picture set corresponding to the first user set.

Wherein the candidate picture set comprises at least one candidate picture.

S1003: and the terminal equipment sends an uploading request to the server.

The uploading request is used for requesting to upload the target picture, and the uploading request comprises the target picture and picture information of the target picture.

S1004: and the server determines a reference picture corresponding to the target picture according to the picture information of the target picture and the picture information of at least one candidate picture.

S1005: and the server performs differential calculation on the target picture and the reference picture, and determines the differential information corresponding to the target picture.

S1006: and the server stores the difference information corresponding to the target picture.

Example 2

Fig. 11 is a flowchart of a second example of picture backup provided in the present application. Referring to fig. 11, in this example, after the server receives an upload request of the terminal device, the server determines a reference picture corresponding to a target picture that the terminal device requests to upload, but calculates difference information corresponding to the target picture by the terminal device. Specifically, the method comprises the following steps:

s1101: the server acquires user information of a first user and determines a first user set corresponding to the first user.

S1102: the server determines a candidate picture set corresponding to the first user set.

Wherein the candidate picture set comprises at least one candidate picture.

S1103: and the terminal equipment sends an uploading request to the server.

The uploading request is used for requesting to upload the target picture, and the uploading request comprises picture information of the target picture.

S1104: the server determines a reference picture corresponding to the target picture according to the picture information of the target picture and the picture information of at least one candidate picture in the candidate picture set.

S1105: the server transmits the thumbnail of the reference picture to the terminal device.

S1106: and the terminal equipment performs differential calculation on the thumbnail of the target picture and the thumbnail of the reference picture, and determines the difference information corresponding to the target picture.

S1107: and the terminal equipment sends the difference information corresponding to the target picture to the server.

S1108: and the server stores the difference information corresponding to the target picture.

Example 3

Fig. 12 is a flowchart of a method for providing a third example of picture backup. Referring to fig. 12, in this example, when the terminal device needs to backup the target picture to the server, the terminal device determines a reference picture corresponding to the target picture, and calculates difference information corresponding to the target picture by the server. Specifically, the method comprises the following steps:

s1201: the server acquires user information of a first user and determines a first user set corresponding to the first user.

S1202: the server determines a candidate picture set corresponding to the first user set.

Wherein the candidate picture set comprises at least one candidate picture.

S1203: and the server sends the picture information of at least one candidate picture in the candidate picture set to the terminal equipment.

S1204: and the terminal equipment determines the picture information of the reference picture corresponding to the target picture according to the picture information of the target picture and the picture information of at least one candidate picture.

S1205: and the terminal equipment sends an uploading request to the server.

The uploading request is used for requesting to upload the target picture, and the uploading request can include picture information of the target picture and picture information of the reference picture.

S1206: the server acquires the picture information of the reference picture in the uploading request, performs differential calculation on the target picture and the reference picture, and determines the difference information corresponding to the target picture.

S1207: and the server stores the difference information corresponding to the target picture.

Example 4

Fig. 13 is a flowchart of a method for a fourth example of picture backup provided in the present application. Referring to fig. 13, in this example, when the terminal device needs to backup the target picture to the server, the terminal device determines a reference picture corresponding to the target picture and calculates difference information corresponding to the target picture. Specifically, the method comprises the following steps:

s1301: the server acquires user information of a first user and determines a first user set corresponding to the first user.

S1302: the server determines a candidate picture set corresponding to the first user set.

Wherein the candidate picture set comprises at least one candidate picture.

S1303: and the server sends the picture information of at least one candidate picture in the candidate picture set to the terminal equipment.

S1304: and the terminal equipment determines the picture information of the reference picture corresponding to the target picture according to the picture information of the target picture and the picture information of at least one candidate picture.

S1305: and the terminal equipment performs differential calculation on the thumbnail of the target picture and the thumbnail of the reference picture, and determines the difference information corresponding to the target picture.

S1306: and the terminal equipment sends an uploading request to the server.

The uploading request comprises picture information of a reference picture corresponding to the target picture and difference information corresponding to the target picture.

S1307: and the server stores the difference information corresponding to the target picture.

Optionally, in the picture backup method shown in fig. 10, the server determines a reference picture corresponding to the target picture requested to be uploaded by the terminal device, and calculates difference information corresponding to the target picture by the server. At this time, referring to fig. 14, according to the functions implemented by the server, the server may include the following modules: the device comprises a user set identification module, a candidate picture set determination module, a reference picture identification module, a differential calculation module and a backup information storage module. Fig. 14 is a schematic block diagram and a functional schematic diagram of a server according to an embodiment of the present application. The function of each module in the server is further described below in conjunction with fig. 14.

And the user set identification module is used for determining a first user set corresponding to the first user according to the user information of the first user and the user information of other users after receiving the user information of the first user reported by the terminal equipment. In specific implementation, the manner in which the user set identification module determines the first user set may be implemented with reference to S501 in fig. 5, which is not described herein.

And the candidate picture set determining module is used for forming a candidate picture set from all pictures in the backup picture set uploaded to the server by all users in the first user set. All pictures in the candidate picture set may be used to find whether there is a reference picture similar to the target picture to be uploaded.

And the reference picture identification module is used for determining a reference picture corresponding to the target picture from the candidate picture set. Specifically, the reference picture module may perform preliminary screening according to the picture information of the target picture and the picture information of all candidate pictures in the candidate picture set, so as to determine similar pictures corresponding to the target picture. The reference picture module may then determine a reference picture corresponding to the target picture from among the similar pictures based on a deep learning algorithm.

And the difference calculation module is used for carrying out difference calculation on the target picture and the reference picture to obtain difference information corresponding to the target picture. Optionally, the difference calculating module may calculate a thumbnail of the target picture and a thumbnail of the reference picture to determine difference information corresponding to the target picture.

And the backup information storage module is used for generating backup information of the target picture and storing the backup information. Optionally, the backup information of the target picture may be a reference picture identifier and difference information corresponding to the target picture.

It should be noted that, referring to the picture backup method shown in fig. 10 to fig. 13, in the embodiment of the present application, the steps of determining the reference picture corresponding to the target picture and determining the difference information corresponding to the target picture may be performed by a server or may be performed by a terminal device, and in different methods, the reference picture identification module and the difference calculation module may be considered to be in different devices, and the functions implemented by each module may be referred to fig. 14, which will not be described herein.

Based on the above embodiments, the present application further provides a picture backup apparatus, where the apparatus includes a plurality of functional modules; the functional modules interact to implement the methods described in the embodiments of the present application. The plurality of functional modules may be implemented based on software, hardware, or a combination of software and hardware, and the plurality of functional modules may be arbitrarily combined or divided based on the specific implementation.

Based on the above embodiments, the present application also provides a storage device including at least one processor and at least one memory, where the at least one memory stores computer program instructions, and when the storage device is running, the at least one processor performs the methods described in the embodiments of the present application.

Based on the above embodiments, the present application also provides a computer program which, when run on a computer, causes the computer to perform the methods described in the embodiments of the present application.

Based on the above embodiments, the present application also provides a computer-readable storage medium having stored therein a computer program which, when executed by a computer, causes the computer to perform the methods described in the embodiments of the present application.

Based on the above embodiments, the present application further provides a chip, where the chip is configured to read a computer program stored in a memory, and implement the methods described in the embodiments of the present application.

Based on the above embodiments, the present application provides a chip system including a processor for supporting a computer device to implement the methods described in the embodiments of the present application. In one possible design, the chip system further includes a memory for storing programs and data necessary for the computer device. The chip system can be composed of chips, and can also comprise chips and other discrete devices.

It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present application without departing from the scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims and the equivalents thereof, the present application is intended to cover such modifications and variations.

Claims

1. A picture backup system, wherein the system comprises a terminal device and a storage device;

2. The system of claim 1, wherein the system is further configured to:

acquiring user information of the first user;

at least one second user associated with the first user is determined from the user information of the first user.

3. The system of claim 2, wherein the user information of the first user comprises at least one of:

a user identification of the first user;

a common wireless local area network of the first user;

An internet protocol address corresponding to the first user;

a usual address of the first user;

a motion trail of the first user;

social application information of the first user;

4. The system of claim 3, wherein the first user and the second user satisfy at least one of the following conditions:

the first user and the second user have the same internet protocol address;

the first user has the same tag as the second user.

5. The system according to any of claims 2-4, wherein the step of determining picture information of a reference picture corresponding to the target picture from stored picture information of at least one candidate picture is performed by the terminal device or the storage device.

6. The system of claim 5, wherein the backup request includes picture information of the target picture; the system is particularly used for:

and acquiring the picture information of the at least one candidate picture, and determining the picture information of the reference picture according to the picture information of the target picture and the picture information of the at least one candidate picture.

7. The system of claim 5, wherein the backup request includes picture information of the reference picture;

the storage device is further configured to: acquiring picture information of the at least one candidate picture, and sending the picture information of the at least one candidate picture to the terminal equipment;

the terminal device is further configured to: receiving the picture information of at least one candidate picture sent by the storage device, and determining the picture information of the reference picture according to the picture information of the target picture and the picture information of the at least one candidate picture.

8. The system of claim 6 or 7, wherein the picture information of any one candidate picture or the picture information of the target picture comprises at least one of:

9. The system according to any of claims 1-8, wherein the step of determining difference information of the target picture relative to the reference picture is performed by the terminal device or the storage device.

10. The system of any of claims 1-9, wherein the terminal device is further configured to:

sending a downloading request to the storage equipment, wherein the downloading request is used for requesting to acquire the target picture;

Receiving the difference information and the picture information of the reference picture, which are sent by the storage equipment; generating the target picture according to the difference information and the picture information of the reference picture;

the storage device is further configured to:

and sending the difference information and the picture information of the reference picture to the terminal equipment.

11. The system of any of claims 1-10, wherein the storage device is a server or a home storage device.

12. A picture backup method applied to a storage device, the method comprising:

receiving a backup request sent by a terminal device, wherein the backup request is used for requesting to backup a target picture in the storage device;

determining picture information of a reference picture corresponding to the target picture from stored picture information of at least one candidate picture; the at least one candidate picture comprises pictures backed up in the storage device by at least one second user associated with a first user corresponding to the terminal device;

and determining difference information of the target picture relative to the reference picture.

13. The method of claim 12, wherein the method further comprises:

Acquiring user information of the first user;

14. The method of claim 13, wherein the user information of the first user comprises at least one of:

a user identification of the first user;

a common wireless local area network of the first user;

an internet protocol address corresponding to the first user;

a usual address of the first user;

a motion trail of the first user;

social application information of the first user;

15. The method of claim 14, wherein the first user and the second user satisfy at least one of the following conditions:

the first user and the second user have the same internet protocol address;

the first user has the same tag as the second user.

16. The method according to any one of claims 12-15, wherein determining, from the stored picture information of the at least one candidate picture, the picture information of the reference picture corresponding to the target picture comprises:

17. The method of claim 16, wherein the picture information of any candidate picture or the picture information of the target picture comprises at least one of:

18. The method of any one of claims 12-17, wherein the method further comprises:

receiving a downloading request sent by the terminal equipment, wherein the downloading request is used for requesting to acquire the target picture;

and sending the difference information and the picture information of the reference picture to the terminal equipment so that the terminal equipment generates the target picture according to the difference information and the picture information of the reference picture.

19. The method of any of claims 12-18, wherein the storage device is a server or a home storage device.

20. A picture backup method applied to a terminal device, the method comprising:

acquiring picture information of a target picture to be backed up;

determining picture information of a reference picture corresponding to the target picture from stored picture information of at least one candidate picture; the at least one candidate picture comprises pictures backed up in the storage device by at least one second user associated with a first user corresponding to the terminal device; determining difference information of the target picture relative to the reference picture;

And sending a backup request to a storage device so that the storage device backs up the target picture, wherein the backup request comprises picture information of the reference picture and the difference information.

21. The method of claim 20, further comprising, prior to the determining picture information of a reference picture corresponding to the target picture from the stored picture information of at least one candidate picture:

and receiving the picture information of the at least one candidate picture sent by the storage equipment.

22. The method of claim 20 or 21, wherein the method further comprises:

transmitting user information of the first user to the storage device, so that the storage device determines at least one second user associated with the first user according to the user information of the first user; or alternatively

Determining the at least one second user selected by the first user, and sending the user identification of the at least one second user to the storage device, so that the storage device determines at least one second user associated with the first user according to the user identification of the at least one second user.

23. The method of claim 22, wherein the user information of the first user comprises at least one of:

A user identification of the first user;

a common wireless local area network of the first user;

an internet protocol address corresponding to the first user;

a usual address of the first user;

a motion trail of the first user;

social application information of the first user;

24. The method of claim 23, wherein the first user and the second user satisfy at least one of the following conditions:

the first user and the second user have the same internet protocol address;

The first user has the same tag as the second user.

25. The method according to any one of claims 20-24, wherein determining picture information of a reference picture corresponding to the target picture from stored picture information of at least one candidate picture comprises:

26. The method of claim 25, wherein the picture information of any candidate picture or the picture information of the target picture comprises at least one of:

27. The method of any one of claims 20-26, wherein the method further comprises:

receiving the difference information and the picture information of the reference picture, which are sent by the storage equipment;

and generating the target picture according to the difference information and the picture information of the reference picture.

28. A storage device comprising at least one processor coupled to at least one memory, the at least one processor to read a computer program stored by the at least one memory to perform the method of any of claims 12-19.

29. A terminal device comprising at least one processor coupled to at least one memory, the at least one processor configured to read a computer program stored by the at least one memory to perform the method of any of claims 20-27.

30. A computer readable storage medium having instructions stored therein which, when run on a computer, cause the computer to perform the method of any of claims 12-19 or to perform the method of any of claims 20-27.