WO2019037038A1

WO2019037038A1 - Image processing method and device, and server

Info

Publication number: WO2019037038A1
Application number: PCT/CN2017/098854
Authority: WO
Inventors: 骆磊
Original assignee: 深圳前海达闼云端智能科技有限公司
Priority date: 2017-08-24
Filing date: 2017-08-24
Publication date: 2019-02-28
Also published as: CN107690673A; CN107690673B

Abstract

The present disclosure relates to an image processing method and device, and a server, for use in improving the definition of an image. The method comprises: determining a target sub-image comprised in a target image sent by a terminal; determining a target three-dimensional model that matches a target object corresponding to the target sub-image from a three-dimensional model library; replacing the target sub-image in the target image according to the target three-dimensional model; and sending the target image after image replacement, to the terminal.

Description

Image processing method, device and server

Technical field

The present disclosure relates to the field of image processing, and in particular, to an image processing method, apparatus, and server.

Background technique

When people take pictures or browse photos using devices such as cameras or mobile phones, they often encounter image blurring caused by various reasons. For example, when the image is taken, the image is enlarged, and the enlarged image may cause a decrease in resolution due to digital zoom, thereby causing the image to be blurred; or, for example, the image taken during the photographing due to the shaking of the hand or the slower shutter speed. blurry.

At present, hardware technologies such as optical zoom, optical image stabilization, and large aperture can be applied to cameras or mobile phones. These hardware technologies can improve the sharpness of captured images to a certain extent and prevent image blur.

However, for non-professional photographers with insufficient shooting experience, it may not be possible to take clearer images with the above hardware technology, or in some scenes, such as in low light conditions, the photos may be taken. Still blurry.

Summary of the invention

In order to overcome the problems in the related art, the present disclosure provides an image processing method, apparatus, and server for improving the sharpness of an image.

According to a first aspect of the embodiments of the present disclosure, there is provided an image processing method, applied to a server, the method comprising:

Determining a target sub-image included in the target image transmitted by the terminal;

Determining, from the three-dimensional model library, a target three-dimensional model that matches the target object corresponding to the target sub-image;

Performing image replacement on the target sub-image in the target image based on the target three-dimensional model;

The image after the image replacement is transmitted to the terminal.

According to a second aspect of the embodiments of the present disclosure, there is provided an image processing method, which is applied to a terminal, the method comprising:

Determining a target sub-image included in the target image;

Image replacement of the target sub-image in the target image based on the target three-dimensional model.

According to a third aspect of the embodiments of the present disclosure, there is provided an image processing apparatus, which is applied to a server, the apparatus comprising:

a first determining module configured to determine a target sub-image included in a target image sent by the terminal;

a second determining module configured to determine, from the three-dimensional model library, a target three-dimensional model that matches a target object corresponding to the target sub-image;

a replacement module configured to perform image replacement on the target sub-image in the target image based on the target three-dimensional model;

The first sending module is configured to send the image after the image replacement to the terminal.

According to a fourth aspect of the embodiments of the present disclosure, there is provided an image processing apparatus, which is applied to a terminal, the apparatus comprising:

a first determining module configured to determine a target sub-image included in the target image;

The replacement module is configured to perform image replacement on the target sub-image in the target image based on the target three-dimensional model.

According to a fifth aspect of an embodiment of the present disclosure, a computer program product is provided, the calculation The program product comprises a computer program executable by a programmable device, the computer program having code for performing the method of any of the first or second aspect when executed by the programmable device section.

According to a sixth aspect of the embodiments of the present disclosure, there is provided a non-transitory computer readable storage medium comprising one or more programs for performing The method of any of the first aspect or the second aspect.

According to a seventh aspect of the embodiments of the present disclosure, a server is provided, including:

Non-transitory computer readable storage medium;

One or more processors for executing the program in the non-transitory computer readable storage medium; the non-transitory computer readable storage medium storing the method for performing the method of any of the first aspects instruction.

According to an eighth aspect of the embodiments of the present disclosure, a terminal is provided, including:

Non-transitory computer readable storage medium;

One or more processors for executing the program in the non-transitory computer readable storage medium; the non-transitory computer readable storage medium storing instructions for performing the method of the second aspect.

The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:

In the present disclosure, after receiving the target image sent by the terminal, the server may find a matching target three-dimensional model from the three-dimensional model library, and then perform image replacement on the target sub-image in the target image based on the target three-dimensional model, thereby The target sub-image that may be blurred in the image is replaced with a clear image, and the target image after the image replacement is sent to the terminal, and the terminal can obtain a clear image, and the image processing capability of the server is strong.

DRAWINGS

FIG. 1 is a flowchart of an image processing method according to an exemplary embodiment;

2 is a schematic diagram of a location range, according to an exemplary embodiment;

FIG. 3 is a schematic diagram of a shooting target image, according to an exemplary embodiment; FIG.

FIG. 4 is a flowchart of an image processing method according to an exemplary embodiment;

FIG. 5 is a block diagram of an image processing apparatus according to an exemplary embodiment;

FIG. 6 is a block diagram of an image processing apparatus according to an exemplary embodiment.

Detailed ways

The specific embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. It is to be understood that the specific embodiments described herein are not to be construed

FIG. 1 is a flowchart of an image processing method according to an exemplary embodiment. As shown in FIG. 1, the image processing method can be applied to a server, and includes the following steps.

Step S11: Determine a target sub-image included in the target image transmitted by the terminal.

Step S12: Determine a target three-dimensional model that matches the target object corresponding to the target sub-image from the three-dimensional model library.

Step S13: Perform image replacement on the target sub-image in the target image based on the target three-dimensional model.

Step S14: transmitting the image after the image replacement to the terminal.

In the embodiment of the present disclosure, the server may be a cloud device, and the terminal may implement image transmission with the cloud device through the network; or the server may be another device different from the terminal, and the terminal may be connected by wire or wirelessly. The other device is connected, thereby implementing image transfer, and the like. Any device that can receive the target image of the transmission of the terminal and process the target image may be the server in the embodiment of the present disclosure.

The target image may be a certain frame image in a frame preview image acquired by the terminal when shooting by the camera, or the target image may also be an image stored in the terminal, etc. This is not limited. The target sub image may be a partial image corresponding to the subject in the target image when the target image is captured.

The 3D model library can be a pre-built database, and the 3D model library can contain three-dimensional models of landmark buildings, places of interest, objects, and the like. The 3D model library can be stored in the server's own memory or it can be stored in another device that can communicate with the server.

After receiving the target image sent by the terminal, the server may parse the target image to determine the target sub-image included in the target image. Of course, the same target image may include one or more target sub-images. This is not limited. Then, a target three-dimensional model matching the target object corresponding to the target sub-image can be found from the three-dimensional model library. For example, the target image includes the sub-image corresponding to the target object “Zhaozhou Bridge”, and then the three-dimensional model library can be obtained from the three-dimensional model library. Match the three-dimensional model of "Zhaozhou Bridge".

Determining the target 3D model matching the target object corresponding to the target sub-image from the 3D model library, directly matching the target sub-image in the entire 3D model library to find the target 3D model, or first determining a range relative A small set of 3D models is used to match the target sub-images in the 3D model set to find the target 3D model.

Optionally, the location information of the target image may also be obtained, where the location information may be used to indicate a geographic location when the target image is collected; and then the location range including the location corresponding to the location information is determined according to the location information, and then the location range included in the location range is determined. For all the identification objects, the identification object may be an object corresponding to the three-dimensional model in the three-dimensional model library, and then the target three-dimensional model may be determined in the three-dimensional model set corresponding to all the identification objects.

The location information may be used to indicate the geographic location when the target image is acquired. The manner of acquiring the location information of the target image is not limited in the embodiment of the present disclosure. The manner of acquiring the location information may be different according to the target image. The target image may be a certain frame image in the continuous preview image acquired by the terminal at the time of shooting, and the location information of the acquired target image may be the location information of the current terminal sent by the terminal (for example, the GPS through the terminal (Global Positioning System) , Global Positioning System module to get, etc.); or, the target image may be stored in the terminal For an image, the image information of the target image may include location information at the time of shooting, and the server may directly obtain the location information from the information carried by the target image.

After the location information of the target image is obtained, the location range may be determined according to the location information. The manner of determining the location range is not limited in this embodiment, as long as it is a location range that determines the geographic location corresponding to the location information. For example, the geographic location corresponding to the location information may be directly centered, and the radius is a set value (for example, 500 meters, etc.), and the obtained circular area is the required position range. Alternatively, the location information may be combined with other parameters to determine the location range. The manner in which the location range is determined will be described below.

Optionally, the height information of the target image may also be acquired, and the height information may be used to indicate the altitude when the target image is collected, and then the location range may be determined according to the location information and the height information.

Depending on the target image, the way to get height information may vary. The target image may be a certain frame image in the continuous preview image acquired by the terminal at the time of shooting, and the height information of the acquired target image may be the height information of the altitude at which the current terminal is sent by the terminal (for example, can be obtained by the altitude meter of the terminal). Or; the target image may be an image stored in the terminal, and the image information of the target image may include height information at the time of shooting, and the server may directly obtain the height information from the information carried by the target image.

In practical applications, the altitude of the photographer is different, and the distance of the scene that can be photographed may be different. Generally, the higher the position, the more distant the scene can be seen, and the range of shooting can be larger. Therefore, The position range determined by the position information can be adjusted by the height information. For example, when the altitude is 0, the position range is a circle centered on the position indicated by the position information, and R is a circular area of the radius. For every 10 meters of elevation, the radius of the position range is increased by R1, and so on. In this way, the determined range of positions is more accurate, avoiding missing objects that the target image may capture, and the image processing capability of the server is strong.

Optionally, the focus distance of the target image can also be obtained, and then the location information can be Focus distance to determine the position range.

Depending on the target image, the way to get the focus distance may be different. The target image may be a certain frame image in the continuous preview image acquired by the terminal at the time of shooting, and the focus distance of the target image may be the focus distance set by the current shooting sent by the terminal; or the target image may be stored in the terminal. An image of the target image may include a focus distance at the time of shooting, and the server may directly obtain a focus distance from the information carried by the target image.

For the manner of determining the location range according to the location information and the focus distance, the embodiment of the present disclosure is not limited. For example, the location range may be a circular area formed by the geographic location corresponding to the location information, and the focal length f is a radius; or A margin x can be set, and the position range can be a circle centered on the geographic location corresponding to the position information, a circle having a radius of fx and a circle having a radius of f+x, and the like. By the above manner, it is possible to determine a relatively small and relatively accurate representation of the range of possible subjects corresponding to the target image, thereby reducing the number of three-dimensional models that may be compared with the target sub-image in the next step, and reducing the number of models. The amount of data processed by the server improves the speed of server image processing.

Of course, the position range can also be determined by the position information, the height information, and the focus distance. For example, the position range can be determined first by the above-mentioned position information and the focus distance to determine the position range, and then the height information is used to determine the position range. Adjust the range of locations, and so on.

After determining the location range, all the identification objects corresponding to the three-dimensional model included in the location range can be found on the map. For example, if the determined location range is as shown in FIG. 2, then all the identification objects corresponding to the three-dimensional model included in the three-dimensional model library included in the location range may be determined, for example, “Leshan Dafoshan Gate”, “Big Buddha”, “ The three-dimensional model set may include the three-dimensional model of all the above-mentioned identification objects, such as Haishidong, Tianwangdian, Daxiongdian and Moruotang.

When the target three-dimensional model matched by the target object corresponding to the target sub-image is determined, the target sub-image may be compared in each three-dimensional model corresponding to all the identification objects, thereby obtaining a matching target three-dimensional model. It can be seen that the position information can be used to accurately find the comparison of the target sub-images. The scope can further quickly find the three-dimensional model matched by the target object corresponding to the target sub-image, improve the response speed of the server, and improve the image processing capability of the server.

After the target three-dimensional model is determined, the target sub-image in the target image may be replaced by the target three-dimensional model, and then the target image after the image replacement is sent back to the terminal, and the user of the terminal can directly see through the server. The target image after the image is replaced. Of course, if a matching target three-dimensional model is not found, information indicating that the matching fails may be sent to the terminal, and the terminal may directly display an image that cannot be processed.

Optionally, the image replacement may be performed by first intercepting the target three-dimensional model to obtain a two-dimensional image that matches the target sub-image, and then replacing the target sub-image with the two-dimensional image in the target image.

That is to say, after the target three-dimensional model is found, the target sub-image can be compared with the target three-dimensional model, and the target three-dimensional model is taken out, and the angle of the target sub-image is captured, the position of the target object is captured, and the target sub-image is A two-dimensional image in which the parameters such as the size of the target image are the same, and the intercepted two-dimensional image completely replaces the target sub-image in the target image. Of course, when performing image replacement, it is possible to replace only the details of the target sub-image, while retaining the original shooting effects, such as sunlight reflection, rain and fog, and the like.

For example, referring to FIG. 3, when the target image is photographed, the finder frame is directed to a part of the middle of the "Eiffel Tower", and therefore, the target sub-image in the target image is an image formed by the "Eiffel Tower" in the middle portion. Then, after finding the 3D model of the target (ie, the 3D model of the Eiffel Tower), the angle of the target image, the size of the imaged sub-image of the image, etc., can be imaged according to the "Eiffel Tower", and the "Eiffel Tower" The three-dimensional model intercepts, extracts a two-dimensional image that matches the target sub-image, and then replaces the target sub-image in the target image with the intercepted two-dimensional image.

Since the target three-dimensional model can be a three-dimensional model previously constructed by a computer, the two-dimensional image intercepted from the target three-dimensional model is a higher-definition image, regardless of the user of the terminal. Zooming in, as long as the target 3D model is fine enough, the image of the target object in the processed target image is always in an extremely clear state, and the zoom is no longer limited by the terminal capability. On the other hand, image blurring caused by hand shake or slow shutter speed can also be solved. By replacing the target sub-image which may be relatively blurred in the original target image by using the intercepted high-resolution two-dimensional image, the clarity of the subject in the target image can be improved, and the image processing capability of the server is strong.

Optionally, after the target three-dimensional model is intercepted to obtain a two-dimensional image that matches the target sub-image, the image parameters of the two-dimensional image may also be set according to the image parameters of the target image.

Image parameters may include brightness, contrast, color temperature, color values, and the like of the image. The image parameters of the target image may be directly sent by the terminal, or may be obtained from the image information carried by the target image, which is not limited by the embodiment of the present disclosure.

After obtaining the image parameters of the target image, the image parameters of the two-dimensional image intercepted from the target three-dimensional model may be set to the same or similar parameters, so that the target image after the image replacement is more matched, and the image processing capability of the server is better. Strong.

Optionally, the server stores another location range determined according to another image, determining a geographic location corresponding to the location information of the target image, and a distance between the geographic location corresponding to the location information of the other image exceeds a preset. a distance threshold; when the distance exceeds the preset distance threshold, determining a location range corresponding to the target image according to the location information of the target image, and updating the location range stored by the server; when the distance does not exceed the preset distance threshold, the other is The position range is determined as the position range.

The preset distance threshold may be a preset value for determining whether to re-determine the location range. For the preset distance threshold, the embodiment of the present disclosure is not limited. For example, the preset distance threshold may be set to 10 meters. , 15 meters, and so on.

The target image is a frame image of a frame preview image acquired by the terminal when shooting through the camera, and the terminal can send each frame image collected to the server in real time, and the server processes each frame image. Send it back to the terminal. In this case, the position information of many consecutive frames may be the same or little change, and the server does not have to have bits for each frame of the image. The information is calculated by the location range. Therefore, the server can record the location range determined last time according to another image. If the distance between the received image and the recorded image capturing geographic location does not exceed the preset distance threshold, Directly use the stored location range to find the target 3D model; conversely, if the distance between the received image and the recorded image capture location exceeds the preset distance threshold, the location range can be recalculated and the location recorded by the server can be updated. range. In this way, the accuracy of the location range can be ensured, the calculation amount of the server can be reduced, and the image processing speed of the server can be improved.

Optionally, the feature information of the target object may be acquired, where the feature information includes at least one of historical information, geographic information, and travel information; and the feature information is sent to the terminal.

For example, if the target object is "Eiffel Tower", then the server can get the information of "Eiffel Tower" from the network, such as historical information, fare information, best photo location information, nearby restaurant information, etc., and send this information. To the terminal, the terminal can be directly displayed on the screen, which improves the user experience and improves the information processing capability of the server.

FIG. 4 is a flowchart of an image processing method according to an exemplary embodiment. As shown in FIG. 4, the image processing method may be applied to a terminal, including the following steps.

Step S41: Determine a target sub-image included in the target image.

Step S42: Determine a target three-dimensional model that matches the target object corresponding to the target sub-image from the three-dimensional model library.

Step S43: Perform image replacement on the target sub-image in the target image based on the target three-dimensional model.

That is to say, the image processing method executed by the server side described above may also be executed by the terminal, and then the three-dimensional model library may be stored in the terminal, or may be stored in another device connected to the terminal, and the terminal does not need to target the image to be processed. Send it to the server and directly perform the steps of searching and replacing the target 3D model. For the specific implementation of the image processing method on the terminal side, refer to the description of the corresponding part on the server side, and details are not described herein.

Based on the same inventive concept, an embodiment of the present disclosure provides an image processing apparatus. As shown in FIG. 5, FIG. 5 is a block diagram of an image processing apparatus 500 according to an exemplary embodiment, where the apparatus 500 can be applied. The server, the device 500 can include:

The first determining module 501 is configured to determine a target sub-image included in the target image sent by the terminal;

The second determining module 502 is configured to determine, from the three-dimensional model library, a target three-dimensional model that matches the target object corresponding to the target sub-image;

The replacement module 503 is configured to perform image replacement on the target sub-image in the target image based on the target three-dimensional model;

The first sending module 504 is configured to send the image after the image replacement to the terminal.

Optionally, the apparatus 500 further includes:

a first acquiring module configured to acquire location information of the target image, where the location information is used to indicate a geographic location when the target image is collected;

a third determining module, configured to determine a location range according to the location information, where the location range includes a location indicated by the location information;

a fourth determining module configured to determine all the identification objects included in the location range, where the identification object is an object corresponding to the three-dimensional model in the three-dimensional model library;

The second determining module includes 502:

The first determining submodule is configured to determine the target three-dimensional model in the three-dimensional model set corresponding to all the identification objects.

Optionally, the apparatus 500 further includes:

a second acquiring module configured to acquire height information of the target image, where the height information is used to indicate an altitude when the target image is collected;

The third determining module includes:

The second determining submodule is configured to determine the location range according to the location information and the altitude information.

Optionally, the apparatus 500 further includes:

a third obtaining module configured to acquire a focusing distance of the target image;

The third determining module further includes:

The third determining submodule is configured to determine the location range according to the location information and the focus distance.

Optionally, the server stores another location range determined according to another image, and the apparatus 500 further includes:

a fifth determining module, configured to determine whether a geographic location corresponding to the location information of the target image, and a distance between the geographic location corresponding to the location information of the other image exceeds a preset distance threshold;

The third determining module further includes:

a fourth determining submodule configured to determine a location range corresponding to the target image according to the location information of the target image when the distance exceeds the preset distance threshold; and

An update module configured to update a range of locations stored by the server;

The fifth determining submodule is configured to determine the other location range as the location range when the distance does not exceed the preset distance threshold.

Optionally, the replacement module 503 includes:

An intercepting module configured to intercept the target three-dimensional model to obtain a two-dimensional image that matches the target sub-image;

The replacement sub-module is configured to replace the target sub-image with the two-dimensional image in the target image.

Optionally, the apparatus 500 further includes:

The setting module is configured to set the image parameters of the two-dimensional image according to the image parameters of the target image after the target three-dimensional model is intercepted to obtain a two-dimensional image that matches the target sub-image.

Optionally, the apparatus 500 further includes:

a fourth acquiring module, configured to acquire feature information of the target object, where the feature information includes at least one of historical information, geographic information, and travel information;

The second sending module is configured to send the feature information to the terminal.

Based on the same inventive concept, an embodiment of the present disclosure provides an image processing apparatus. As shown in FIG. 6, FIG. 6 is a block diagram of an image processing apparatus 600 according to an exemplary embodiment, where the apparatus 600 can be applied to Terminal, the device 600 can include:

a first determining module 601 configured to determine a target sub-image included in the target image;

The second determining module 602 is configured to determine, from the three-dimensional model library, a target three-dimensional model that matches the target object corresponding to the target sub-image;

The replacement module 603 is configured to perform image replacement on the target sub-image in the target image based on the target three-dimensional model.

With regard to the apparatus in the above embodiments, the specific manner in which the respective modules perform the operations has been described in detail in the embodiment relating to the method, and will not be explained in detail herein.

In the embodiments provided by the present disclosure, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be used. Combinations can be integrated into another system, or some features can be ignored or not executed.

The functional modules in the various embodiments of the present application may be integrated into one processing unit, or each module may exist physically separately, or two or more modules may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application, in essence or the contribution to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium. , including a number of instructions to make a computer device (can be a A human computer, server, or network device, or the like, or a processor, performs all or part of the steps of the methods described in various embodiments of the present application. The foregoing storage medium includes: a U disk, a mobile hard disk, a ROM (Read-Only Memory), a RAM (Random Access Memory), a disk or an optical disk, and the like, which can store program codes. .

The above embodiments are only used to describe the technical solutions of the present disclosure in detail, but the description of the above embodiments is only for helping to understand the method of the present disclosure and its core ideas, and should not be construed as limiting the disclosure. Those skilled in the art will be able to devise changes or substitutions that are conceivable within the scope of the present disclosure.

Claims

An image processing method is applied to a server, the method comprising:

Determining a target sub-image included in the target image transmitted by the terminal;

Determining, from the three-dimensional model library, a target three-dimensional model that matches the target object corresponding to the target sub-image;

Performing image replacement on the target sub-image in the target image based on the target three-dimensional model;

The image after the image replacement is transmitted to the terminal.
The method of claim 1 further comprising:

Obtaining location information of the target image, where the location information is used to indicate a geographic location when the target image is collected;

Determining a location range according to the location information, where the location range includes a location indicated by the location information;

Determining all of the identification objects included in the location range, the identification object being an object corresponding to the three-dimensional model in the three-dimensional model library;

Determining, from the three-dimensional model library, a target three-dimensional model that matches the target object corresponding to the target sub-image, including:

The target three-dimensional model is determined in the three-dimensional model set corresponding to all the identification objects.
The method of claim 2, wherein the method further comprises:

Obtaining height information of the target image, where the height information is used to indicate an altitude when the target image is acquired;

Determining the location range according to the location information, including:

The location range is determined based on the location information and the height information.
The method of claim 2, wherein the method further comprises:

Obtaining a focus distance of the target image;

Determining the location range according to the location information, including:

The position range is determined based on the position information and the focus distance.
The method of claim 2, wherein the server stores another location range determined according to another image, the method further comprising:

Determining, by the geographic location corresponding to the location information of the target image, whether the distance between the geographic location corresponding to the location information of the another image exceeds a preset distance threshold;

Determining the location range according to the location information, including:

And determining, according to the location information of the target image, a location range corresponding to the target image, and updating a location range stored by the server, when the distance exceeds the preset distance threshold;

The other location range is determined as the location range when the distance does not exceed the preset distance threshold.
The method according to claim 1, wherein image replacement of the target sub-image in the target image based on the target three-dimensional model comprises:

Intercepting the target three-dimensional model to obtain a two-dimensional image that matches the target sub-image;

In the target image, the target sub-image is replaced with the two-dimensional image.
The method according to claim 6, wherein after the intercepting the target three-dimensional model to obtain a two-dimensional image that matches the target sub-image, the method further comprises:

An image parameter of the two-dimensional image is set according to an image parameter of the target image.
The method of claim 1, wherein the method further comprises:

Obtaining feature information of the target object, the feature information including at least one of historical information, geographic information, and travel information;

Sending the feature information to the terminal.
An image processing method is applied to a terminal, the method comprising:

Determining a target sub-image included in the target image;

Determining, from the three-dimensional model library, a target three-dimensional model that matches the target object corresponding to the target sub-image;

Image replacement of the target sub-image in the target image based on the target three-dimensional model.
An image processing apparatus is applied to a server, the apparatus comprising:

a first determining module configured to determine a target sub-image included in a target image sent by the terminal;

a second determining module configured to determine, from the three-dimensional model library, a target three-dimensional model that matches a target object corresponding to the target sub-image;

a replacement module configured to perform image replacement on the target sub-image in the target image based on the target three-dimensional model;

The first sending module is configured to send the image after the image replacement to the terminal.
The device according to claim 10, wherein the device further comprises:

a first acquiring module, configured to acquire location information of the target image, where the location information is used to indicate a geographic location when the target image is collected;

a third determining module, configured to determine a location range according to the location information, where the location range includes a location indicated by the location information;

a fourth determining module, configured to determine all the identifier objects included in the location range, where the identifier object is an object corresponding to the three-dimensional model in the three-dimensional model library;

The second determining module includes:

The first determining submodule is configured to determine the target three-dimensional model in the three-dimensional model set corresponding to all the identification objects.
The device according to claim 11, wherein the device further comprises:

a second acquiring module, configured to acquire height information of the target image, where the height information is used to indicate an altitude when the target image is acquired;

The third determining module includes:

The second determining submodule is configured to determine the location range according to the location information and the altitude information.
The device according to claim 11, wherein the device further comprises:

a third acquiring module configured to acquire a focus distance of the target image;

The third determining module further includes:

The third determining submodule is configured to determine the location range according to the location information and the focus distance.
The device according to claim 11, wherein the server stores another location range determined according to another image, the device further comprising:

a fifth determining module, configured to determine whether a geographic location corresponding to the location information of the target image, and a distance between the geographic location corresponding to the location information of the another image exceeds a preset distance threshold;

The third determining module further includes:

a fourth determining submodule configured to determine, according to the location information of the target image, a location range corresponding to the target image when the distance exceeds the preset distance threshold; and

An update module configured to update a range of locations stored by the server;

And a fifth determining submodule configured to determine the another location range as the location range when the distance does not exceed the preset distance threshold.
The device according to claim 10, wherein the replacement module comprises:

An intercepting module configured to intercept the target three-dimensional model to obtain a two-dimensional image that matches the target sub-image;

A replacement sub-module configured to replace the target sub-image with the two-dimensional image in the target image.
The device according to claim 15, wherein the device further comprises:

And a setting module configured to set image parameters of the two-dimensional image according to image parameters of the target image after intercepting the target three-dimensional model to obtain a two-dimensional image that matches the target sub-image.
The device according to claim 10, wherein the device further comprises:

a fourth acquiring module, configured to acquire feature information of the target object, where the feature information includes at least one of historical information, geographic information, and travel information;

The second sending module is configured to send the feature information to the terminal.
An image processing apparatus is applied to a terminal, the apparatus comprising:

a first determining module configured to determine a target sub-image included in the target image;

a second determining module configured to determine, from the three-dimensional model library, a target three-dimensional model that matches a target object corresponding to the target sub-image;

The replacement module is configured to perform image replacement on the target sub-image in the target image based on the target three-dimensional model.
A computer program product, comprising: a computer program executable by a programmable device, the computer program having instructions for performing claims 1 to 9 when executed by the programmable device The code portion of the method of any of the preceding claims.
A non-transitory computer readable storage medium, characterized in that the non-transitory computer readable storage medium comprises one or more programs for performing any of claims 1 to 9. One of the methods described.
A server, comprising:

Non-transitory computer readable storage medium;

One or more processors for executing the non-transitory computer readable storage medium The program of the non-transitory computer readable storage medium storing instructions for performing the method of any of claims 1-8.
A terminal, comprising:

Non-transitory computer readable storage medium;

One or more processors for executing the program in the non-transitory computer readable storage medium; the non-transitory computer readable storage medium storing instructions for performing the method of claim 9.