CN113452897B - Image processing method, system, equipment and computer readable storage medium - Google Patents
Image processing method, system, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN113452897B CN113452897B CN202010229679.7A CN202010229679A CN113452897B CN 113452897 B CN113452897 B CN 113452897B CN 202010229679 A CN202010229679 A CN 202010229679A CN 113452897 B CN113452897 B CN 113452897B
- Authority
- CN
- China
- Prior art keywords
- image
- test
- optical center
- deviation information
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Studio Devices (AREA)
Abstract
The application discloses an image processing method, a system, equipment and a computer readable storage medium, which are used for determining optical center deviation information of camera equipment in the zooming process; and based on the optical center deviation information, performing deviation elimination on the image shot by the camera equipment to obtain a target image. In the process of zooming of the camera equipment, the optical center deviation information can cause the relative position relationship of the object in the shot image to change before and after zooming. The image processing system, the image processing equipment and the computer readable storage medium solve the corresponding technical problems.
Description
Technical Field
The present application relates to the field of image processing technologies, and in particular, to an image processing method, system, device, and computer-readable storage medium.
Background
At present, with the development of the camera technology, the application scenes of the camera device are also abundant, for example, the camera device is applied to video monitoring, and in the application process of the camera device, sometimes in order to shoot a clear image, a target scene needs to be zoomed to shoot, so that the shot image can be still clear after being amplified, however, in the process, due to the change of the focal length of the camera device, the situation that the position relationship between the shot images is also changed easily occurs, so that the shot images are not consistent with the real situation of the shot object.
In summary, how to improve the shooting accuracy of the image pickup apparatus in the zooming process is a problem to be solved urgently by those skilled in the art.
Disclosure of Invention
The application aims to provide an image processing method which can solve the technical problem of improving the shooting accuracy of the image pickup equipment in the zooming process to a certain extent. The application also provides an image processing system, an image processing device and a computer readable storage medium.
In order to achieve the above object, the present application provides an image processing method comprising:
determining optical center deviation information of the camera in the zooming process;
and based on the optical center deviation information, performing deviation elimination on the image shot by the camera equipment to obtain a target image.
Preferably, the determining optical center deviation information occurring during zooming of the image pickup apparatus includes:
acquiring a test image obtained after the camera shooting equipment shoots a test scene at different focal lengths;
determining the optical center deviation information based on position information between objects located at the geometric center of the test image.
Preferably, the acquiring a test image obtained after the image capturing device captures a test scene at different focal lengths includes:
acquiring a first test image obtained by shooting the test scene by the camera equipment under a first focal length;
acquiring a second test image obtained by shooting the test scene by the camera equipment under a second focal length;
the determining the optical center deviation information based on the position information between the objects positioned at the geometric center of the test image comprises:
and in a shot image of the test scene by the camera equipment, taking the relative position relationship between the objects positioned at the geometric centers of the first test image and the second test image as the optical center deviation information.
Preferably, the taking a relative positional relationship between the objects located at the geometric centers of the first test image and the second test image in one shot image of the test scene by the image pickup apparatus as the optical center deviation information includes:
in the first test image, determining a target object positioned at a geometric center;
and in the second test image, determining the relative position relationship between the geometric centers of the target object and the second test image as the optical center deviation information.
Preferably, the determining the relative position relationship between the geometric centers of the target object and the second test image as the optical center deviation information includes:
determining a first position of the target object in the second test image;
determining a second location of a geometric center of the second test image;
and taking the ratio of the first position to the second position as the optical center deviation information.
Preferably, the first position comprises a first abscissa and a first ordinate; the second position comprises a second abscissa and a second ordinate;
the taking the ratio between the first position and the second position as the optical center deviation information includes:
determining an abscissa ratio between the first abscissa and the second abscissa;
determining a vertical coordinate ratio between the first vertical coordinate and the second vertical coordinate;
and taking the abscissa proportion and the ordinate proportion as the optical center deviation information.
Preferably, the offset canceling an image captured by the image capturing apparatus based on the optical center offset information to obtain a target image includes:
if the focal length is increased when the image is shot by the camera equipment, taking the product of the coordinate of the object to be adjusted in the image and the optical center deviation information as a new coordinate of the object to be adjusted in the target image;
and if the focal length is reduced when the image is shot by the camera equipment, taking the ratio of the coordinates of the object to be adjusted in the image and the optical center deviation information as the new coordinates of the object to be adjusted in the target image.
Preferably, the offset canceling an image captured by the image capturing apparatus based on the optical center offset information to obtain a target image includes:
acquiring an image processing task;
based on the image processing task and the optical center deviation information, deviation elimination is carried out on the image shot by the camera equipment to obtain the target image;
the types of the image processing task include: the method comprises a privacy sheltering task, a 3D positioning task and an AR label tracking task.
To achieve the above object, the present application further provides an image processing system comprising:
the deviation determining module is used for determining optical center deviation information of the camera equipment in the zooming process;
and the deviation elimination module is used for eliminating the deviation of the image shot by the camera equipment based on the optical center deviation information to obtain a target image.
To achieve the above object, the present application further provides an image processing apparatus comprising:
a memory for storing a computer program;
a processor for implementing the steps of the image processing method as described in any one of the above when executing the computer program.
To achieve the above object, the present application further provides a computer-readable storage medium, in which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the image processing method as described in any one of the above.
The image processing method can determine the optical center deviation information of the camera in the zooming process; and based on the optical center deviation information, performing deviation elimination on the image shot by the camera equipment to obtain a target image. In the method and the device, the optical center deviation information which appears in the zooming process is determined, and the optical center deviation information can cause the relative position relation of the object in the shot image to change before and after zooming, so that the image shot by the camera equipment can be subjected to deviation elimination based on the optical center deviation information, a target image with the relative position relation which cannot change along with zooming is obtained, and the shooting accuracy is high. The image processing system, the image processing equipment and the computer readable storage medium solve the corresponding technical problems.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments or the background art of the present application, the drawings required to be used in the description of the embodiments or the background art will be briefly introduced below, it is obvious that the drawings in the description below are only the embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a first flowchart of an image processing method according to an embodiment of the present disclosure;
fig. 2 is a second flowchart of an image processing method according to an embodiment of the present application;
fig. 3 is a third flowchart of an image processing method according to an embodiment of the present application;
fig. 4 is a fourth flowchart of an image processing method according to an embodiment of the present application;
FIG. 5 is a zoom imaging process for privacy-masked leaves in an image with a rectangular frame according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of an image processing system according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application;
fig. 8 is another schematic structural diagram of an image processing apparatus according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
At present, with the development of the image capturing technology, the application scenes of the image capturing apparatus are also abundant, for example, the image capturing apparatus is applied to video monitoring, and in the application process of the image capturing apparatus, sometimes in order to capture a clear image, the image capturing apparatus needs to be zoomed to capture, so that it can be ensured that the captured image is still clear after being amplified, however, in the process, the situation that the position relationship between the captured images changes easily occurs, so that the captured image is not consistent with the real situation of the object to be captured. The image processing method provided by the application can solve the problem that the position relation between the shot images changes due to zooming, and improves the shooting accuracy of the camera shooting equipment in the zooming process.
Referring to fig. 1, fig. 1 is a first flowchart of an image processing method according to an embodiment of the present disclosure.
An image processing method provided by the embodiment of the application may include the following steps:
step S11: optical center deviation information occurring during zooming of the image pickup apparatus is determined.
In practical applications, the optical center deviation information of the image pickup apparatus occurring during zooming may be determined first. That is, the present application finds that an optical center shift phenomenon occurs in a zooming process of an image pickup apparatus, the optical center is an optical center, the optical center shift phenomenon refers to a shift of a position of the optical center before and after zooming, a cause of the shift may be a production error of the image pickup apparatus, or a shift of the optical center of the image pickup apparatus due to a collision or the like, and after the optical center shift, a positional relationship between an imaged image and the optical center changes, so that a relative positional relationship between objects in the imaged image also changes, that is, the zoom causes a relative positional relationship between the objects in the imaged image to change, so that the image has a shift.
It should be noted that the optical center in this application refers to the optical center of the lens, which is the point where the light in any direction passes through the lens, and the propagation direction of the light is unchanged, i.e. the outgoing direction and the incoming direction are parallel to each other, when the light in any direction passes through the lens, the light is deflected to change the propagation direction of the light.
Step S12: and based on the optical center deviation information, performing deviation elimination on the image shot by the camera equipment to obtain a target image.
In practical application, after the optical center deviation information is determined, deviation elimination can be performed on an image shot by the camera device, and a target image is obtained.
The image processing method can determine the optical center deviation information of the camera in the zooming process; and based on the optical center deviation information, performing deviation elimination on the image shot by the camera equipment to obtain a target image. In the method and the device, the optical center deviation information which appears in the zooming process is determined, and the optical center deviation information can cause the relative position relation of the object in the shot image to change before and after zooming, so that the image shot by the camera equipment can be subjected to deviation elimination based on the optical center deviation information, a target image with the relative position relation which cannot change along with zooming is obtained, and the shooting accuracy is high.
In an image processing method provided by the embodiment of the application, optical center deviation information of an image pickup apparatus may be determined by testing the image pickup apparatus, in this process, in order to reduce the testing difficulty, a test scene may be selected in advance, and optical center deviation information may be determined by taking a zoom image of the test scene by the image pickup apparatus, and in addition, in the taken image, a geometric center of the image is also an optical center of the image pickup apparatus, so the optical center deviation information of the image pickup apparatus may be determined by the geometric center, that is, the step of determining the optical center deviation information occurring in the zoom process of the image pickup apparatus in step S11 may specifically be: acquiring test images obtained by shooting test scenes by camera equipment under different focal lengths; optical center deviation information is determined based on positional information between objects located at the geometric center of the test image.
In practical application, in order to reduce the test complexity, a target object may be specified in a test scene, and optical center deviation information may be determined according to position change information of the target object in a zooming process, for example, a test image obtained by shooting the test scene by an image pickup apparatus at different focal lengths is obtained, and the step of determining the optical center deviation information based on position information between objects located at a geometric center of the test image may specifically be: the method comprises the steps of determining a target object in a test scene, adjusting the focal length of the camera to be maximum, aligning the geometric center of a screen of the camera to the target object, keeping the position between the camera and the test scene unchanged, adjusting the focal length of the camera to be minimum, and shooting to obtain a test image.
Referring to fig. 2, fig. 2 is a second flowchart of an image processing method according to an embodiment of the present disclosure.
An image processing method provided by the embodiment of the application may include the following steps:
step S21: and acquiring a first test image obtained by shooting the test scene by the camera equipment under the first focal length.
Step S22: and acquiring a second test image obtained by shooting the test scene by the camera equipment under the second focal length.
In practical applications, because the optical center deviation information of the image capturing apparatus does not change with the change of the zoom multiple, the optical center deviation information can be determined through the test images at two focal lengths, that is, the step of acquiring the test image obtained by the image capturing apparatus shooting the test scene at different focal lengths may specifically be: acquiring a first test image obtained by shooting a test scene by camera equipment under a first focal length; and acquiring a second test image obtained by shooting the test scene by the camera equipment under the second focal length.
In practical applications, the multiple of the first focal length and the second focal length may be determined according to actual needs, for example, the first focal length may be a maximum focal length, and the second focal length may be an original focal length.
Step S23: and in one shot image of the test scene by the camera equipment, taking the relative position relation between the objects positioned at the geometric centers of the first test image and the second test image as optical center deviation information.
In practical application, after the first test image and the second test image are obtained, in one shot image of a test scene by the camera device, the relative position relationship between the objects located at the geometric centers of the first test image and the second test image can be used as optical center deviation information, specifically, the relative position relationship between the objects located at the geometric centers of the first test image and the second test image can be directly used as optical center deviation information in the first test image or the second test image, and the like; for example, in the first test image, a target object located at the geometric center may be determined, and in the second test image, a relative positional relationship between the target object and the geometric center of the second test image may be determined as the optical center deviation information.
It should be noted that, since the imaging ranges of the same object at different focal lengths are different, the range of the target object in the first test image in the second test image may be changed, and in order to determine the position of the target object, the range of the target object may be flexibly selected according to the shooting focal length; in addition, in the process, the range shape of the target object, such as a rectangle, a triangle, etc., can be flexibly selected, and the geometric center of the target object can be used as the position of the target object, etc.
Step S24: and based on the optical center deviation information, performing deviation elimination on the image shot by the camera equipment to obtain a target image.
Referring to fig. 3, fig. 3 is a third flowchart of an image processing method according to an embodiment of the present disclosure.
An image processing method provided by the embodiment of the application may include the following steps:
step S31: and acquiring a first test image obtained by shooting the test scene by the camera equipment under the first focal length.
Step S32 obtains a second test image obtained by shooting the test scene by the image pickup apparatus at the second focal length.
Step S33: in the first test image, a target object located at the geometric center is determined.
Step S34: determining a first position of the target object in the second test image; determining a second location of a geometric center of a second test image;
step S35: and taking the ratio of the first position to the second position as optical center deviation information.
Step S36: and based on the optical center deviation information, performing deviation elimination on the image shot by the camera equipment to obtain a target image.
In practical application, a first position of the target object in the second test image can be determined, a second position of a geometric center of the second test image can be determined, and a ratio of the first position to the second position can be used as optical center deviation information; the coordinate ratio between the objects positioned at the geometric centers of the two test images can be used as the optical center deviation information, so that when the image shot by the camera equipment is subjected to deviation elimination based on the optical center deviation information to obtain a target image, the image coordinate and the optical center deviation information can be directly multiplied or divided, and then the deviation elimination can be carried out.
In practical application, in order to reduce the complexity of the optical center deviation information, the optical center deviation information may be divided into abscissa deviation information and ordinate deviation information, that is, the first position includes a first abscissa and a first ordinate; the second position comprises a second abscissa and a second ordinate; correspondingly, the step of using the ratio between the first position and the second position as the optical center deviation information may specifically be: determining the abscissa ratio between the first abscissa and the second abscissa; determining the vertical coordinate proportion between the first vertical coordinate and the second vertical coordinate; and taking the abscissa proportion and the ordinate proportion as optical center deviation information. It should be noted that the abscissa scale is also the abscissa deviation information, and the ordinate scale is also the ordinate deviation information.
In a specific application scenario, based on the optical center deviation information, deviation elimination is performed on an image shot by the camera device, and in the process of obtaining a target image, if a focal length is increased when the image is shot by the camera device, that is, the currently shot image is an image obtained through a focal length increasing operation, a product of a coordinate of an object to be adjusted in the image and the optical center deviation information needs to be used as a new coordinate of the object to be adjusted in the target image.
In a specific application scenario, based on the optical center deviation information, deviation elimination is performed on an image shot by the camera device, and in the process of obtaining a target image, if a focal length is reduced when the image is shot by the camera device, that is, the currently shot image is an image obtained through a focal length reduction operation, a ratio of a coordinate of an object to be adjusted in the image to the optical center deviation information needs to be used as a new coordinate of the object to be adjusted in the target image.
In practical applications, the abscissa and the ordinate in the present application may be coordinate values in a screen coordinate system of the image capturing apparatus. That is, the optical center deviation information can be determined according to the screen coordinate system, and since the screen coordinate system is related to the screen resolution of the image pickup apparatus, the optical center deviation information can be determined based on the screen resolution of the image pickup apparatus, for example, if the resolution of the image pickup apparatus is (width, height), the object a originally located at the geometric center of the first test image, and the coordinates in the second test image are (x, y), then (2 x/width) can be taken as the abscissa ratio, and (2 y/height) can be taken as the ordinate ratio, and so on.
Referring to fig. 4, fig. 4 is a fourth flowchart of an image processing method according to an embodiment of the present disclosure.
An image processing method provided by the embodiment of the application may include the following steps:
step S41: optical center deviation information occurring during zooming of the image pickup apparatus is determined.
Step S42: acquiring an image processing task; the types of image processing tasks include: the method comprises a privacy sheltering task, a 3D positioning task and an AR label tracking task.
Step S43: and based on the image processing task and the optical center deviation information, eliminating the deviation of the image shot by the camera equipment to obtain a target image.
In practical application, in the process of performing offset cancellation on an image captured by an image capturing apparatus, an offset cancellation mode may need to be determined according to an application scenario, that is, according to an image processing task, that is, based on optical center offset information, the step of performing offset cancellation on the image captured by the image capturing apparatus to obtain a target image may specifically be: acquiring an image processing task; based on the image processing task and the optical center deviation information, eliminating the deviation of the image shot by the camera equipment to obtain a target image; the types of image processing tasks include: the method comprises a privacy blocking task, a 3D positioning task and an AR label tracking task.
For ease of understanding, the image processing method provided herein will now be described in conjunction with the privacy-mask task. Referring to fig. 5, fig. 5 is a zoom imaging process of using a rectangular frame to privacy-mask leaves in an image according to an embodiment of the present disclosure, where an upper left diagram is an imaging diagram at a highest focal length, an upper right diagram is an imaging diagram at a second high focal length, a lower left diagram is an imaging diagram at a second low focal length, and a lower right diagram is an imaging diagram at a lowest focal length, as can be seen from fig. 5, at the highest focal length, the rectangular frame can also mask the leaves, and at the lowest focal length, the rectangular frame cannot mask the leaves, at this time, the image processing method provided by the present disclosure needs to be applied to perform offset cancellation on the rectangular frame or the leaves in the imaging diagram, so that in each imaging diagram, the rectangular frame can mask the leaves.
Referring to fig. 6, fig. 6 is a schematic structural diagram of an image processing system according to an embodiment of the present disclosure.
An image processing system provided in an embodiment of the present application may include:
a deviation determining module 11, configured to determine optical center deviation information occurring during zooming of the image capturing apparatus;
and the deviation elimination module 12 is used for eliminating the deviation of the image shot by the camera equipment based on the optical center deviation information to obtain a target image.
In an image processing system provided in an embodiment of the present application, the deviation determining module may include:
the first acquisition submodule is used for acquiring a test image which is obtained by shooting a test scene by the camera equipment under different focal lengths;
a first determining sub-module for determining optical center deviation information based on position information between objects located at a geometric center of the test image.
In an image processing system provided in an embodiment of the present application, the first obtaining sub-module may include:
the first acquisition unit is used for acquiring a first test image obtained by shooting a test scene by the camera equipment under a first focal length;
the second acquisition unit is used for acquiring a second test image obtained by shooting the test scene by the camera equipment under the second focal length;
the first determination submodule may include:
and the second determining submodule is used for determining the relative position relation between the objects positioned at the geometric centers of the first test image and the second test image as optical center deviation information in one shot image of the test scene by the camera equipment.
In an image processing system provided in an embodiment of the present application, the second determining sub-module may include:
the third determining sub-module is used for determining a target object positioned at the geometric center in the first test image;
and the fourth determining submodule is used for determining the relative position relation between the geometric centers of the target object and the second test image in the second test image as optical center deviation information.
In an image processing system provided in an embodiment of the present application, the fourth determining sub-module may include:
a fifth determining sub-module, configured to determine a first position of the target object in the second test image; determining a second location of a geometric center of a second test image;
and the first setting submodule is used for setting the ratio of the first position to the second position as optical center deviation information.
In an image processing system provided by an embodiment of the present application, the first position may include a first abscissa and a first ordinate; the second location may include a second abscissa, a second ordinate;
the first setting sub-module may include:
the first determining unit is used for determining an abscissa ratio between the first abscissa and the second abscissa;
the second determining unit is used for determining the vertical coordinate proportion between the first vertical coordinate and the second vertical coordinate;
and the first setting unit is used for setting the abscissa proportion and the ordinate proportion as optical center deviation information.
In an image processing system provided in an embodiment of the present application, an abscissa and an ordinate are coordinate values in a screen coordinate system of an image capturing apparatus.
In an image processing system provided in an embodiment of the present application, the offset removing module may include:
and the first eliminating unit is used for taking the product of the coordinates of the object to be adjusted in the image and the optical center deviation information as the new coordinates of the object to be adjusted in the target image if the focal length is increased when the image is shot by the image pickup equipment.
In an image processing system provided in an embodiment of the present application, the offset removing module may include:
and the second eliminating unit is used for taking the ratio of the coordinates of the object to be adjusted in the image and the optical center deviation information as the new coordinates of the object to be adjusted in the target image if the focal length is reduced when the image is shot by the image pickup equipment.
According to the image processing system provided by the embodiment of the application, the first focal length can be the maximum focal length, and the second focal length can be the original focal length.
In an image processing system provided in an embodiment of the present application, the offset removing module may include:
a third acquiring unit, configured to acquire an image processing task;
the third elimination unit is used for eliminating deviation of the image shot by the camera equipment based on the image processing task and the optical center deviation information to obtain a target image;
the types of image processing tasks include: the method comprises a privacy blocking task, a 3D positioning task and an AR label tracking task.
The application also provides an image processing device and a computer readable storage medium, which have the corresponding effects of the image processing method provided by the embodiment of the application. Referring to fig. 7, fig. 7 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present disclosure.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program:
determining optical center deviation information of the camera in the zooming process;
and based on the optical center deviation information, performing deviation elimination on the image shot by the camera equipment to obtain a target image.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: acquiring test images obtained by shooting test scenes by camera equipment at different focal lengths; optical center deviation information is determined based on positional information between objects located at the geometric center of the test image.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: acquiring a first test image obtained by shooting a test scene by camera equipment under a first focal length; acquiring a second test image obtained by shooting the test scene by the camera equipment under a second focal length; in a shot image of the test scene by the camera equipment, the relative position relation between the objects positioned at the geometric center of the first test image and the geometric center of the second test image is used as optical center deviation information.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: determining a target object positioned at a geometric center in a first test image; in the second test mapping, the relative position relation between the geometric centers of the target object and the second test image is determined as optical center deviation information.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: determining a first position of the target object in the second test image; determining a second location of a geometric center of a second test image; and taking the ratio of the first position to the second position as optical center deviation information.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: the first position comprises a first abscissa and a first ordinate; the second position comprises a second abscissa and a second ordinate; determining the abscissa ratio between the first abscissa and the second abscissa; determining the vertical coordinate proportion between the first vertical coordinate and the second vertical coordinate; the abscissa ratio and the ordinate ratio are used as optical center deviation information.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: the abscissa and the ordinate are coordinate values in a screen coordinate system of the image pickup apparatus.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: and if the focal length is increased when the image is shot by the image pickup equipment, taking the product of the coordinates of the object to be adjusted in the image and the optical center deviation information as new coordinates of the object to be adjusted in the target image.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: and if the focal length is reduced when the image is shot by the image pickup equipment, taking the ratio of the coordinates of the object to be adjusted in the image and the optical center deviation information as the new coordinates of the object to be adjusted in the target image.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: the first focal length is the maximum focal length and the second focal length is the original focal length.
An image processing apparatus provided in an embodiment of the present application includes a memory 201 and a processor 202, where the memory 201 stores a computer program, and the processor 202 implements the following steps when executing the computer program: acquiring an image processing task; based on the image processing task and the optical center deviation information, eliminating the deviation of the image shot by the camera equipment to obtain a target image; the types of image processing tasks include: the method comprises a privacy sheltering task, a 3D positioning task and an AR label tracking task.
Referring to fig. 8, another image processing apparatus provided in the embodiment of the present application may further include: an input port 203 connected to the processor 202, for transmitting an externally input command to the processor 202; a display unit 204 connected to the processor 202, for displaying the processing result of the processor 202 to the outside; and the communication module 205 is connected with the processor 202 and is used for realizing the communication between the image processing device and the outside. The display unit 204 may be a display panel, a laser scanning type display, or the like; the communication method adopted by the communication module 205 includes, but is not limited to, mobile high definition link technology (HML), universal Serial Bus (USB), high Definition Multimedia Interface (HDMI), and wireless connection: wireless fidelity technology (WiFi), bluetooth communication technology, bluetooth low energy communication technology, ieee802.11s based communication technology.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps:
determining optical center deviation information of the camera in the zooming process;
and based on the optical center deviation information, performing deviation elimination on the image shot by the camera equipment to obtain a target image.
A computer-readable storage medium provided in an embodiment of the present application stores a computer program, and when executed by a processor, the computer program implements the following steps: acquiring test images obtained by shooting test scenes by camera equipment under different focal lengths; optical center deviation information is determined based on positional information between objects located at the geometric center of the test image.
A computer-readable storage medium provided in an embodiment of the present application stores a computer program, and when executed by a processor, the computer program implements the following steps: acquiring a first test image obtained by shooting a test scene by camera equipment under a first focal length; acquiring a second test image obtained by shooting the test scene by the camera equipment under a second focal length; and in one shot image of the test scene by the camera equipment, taking the relative position relation between the objects positioned at the geometric centers of the first test image and the second test image as optical center deviation information.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: determining a target object positioned at a geometric center in a first test image; in the second test image, the relative position relationship between the geometric centers of the target object and the second test image is determined as optical center deviation information.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: determining a first position of the target object in the second test image; determining a second location of a geometric center of a second test image; and taking the ratio of the first position to the second position as optical center deviation information.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: the first position comprises a first abscissa and a first ordinate; the second position comprises a second abscissa and a second ordinate; determining the abscissa ratio between the first abscissa and the second abscissa; determining the vertical coordinate proportion between the first vertical coordinate and the second vertical coordinate; the abscissa ratio and the ordinate ratio are used as optical center deviation information.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: the abscissa and the ordinate are coordinate values in a screen coordinate system of the image pickup apparatus.
A computer-readable storage medium provided in an embodiment of the present application stores a computer program, and when executed by a processor, the computer program implements the following steps: and if the focal length is increased when the image is shot by the image pickup equipment, taking the product of the coordinates of the object to be adjusted in the image and the optical center deviation information as new coordinates of the object to be adjusted in the target image.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: and if the focal length is reduced when the image is shot by the image pickup equipment, taking the ratio of the coordinates of the object to be adjusted in the image and the optical center deviation information as the new coordinates of the object to be adjusted in the target image.
A computer-readable storage medium provided in an embodiment of the present application stores a computer program, and when executed by a processor, the computer program implements the following steps: the first focal length is the maximum focal length and the second focal length is the original focal length.
A computer-readable storage medium is provided in an embodiment of the present application, in which a computer program is stored, and when the computer program is executed by a processor, the computer program implements the following steps: acquiring an image processing task; based on the image processing task and the optical center deviation information, eliminating the deviation of the image shot by the camera equipment to obtain a target image; the types of image processing tasks include: the method comprises a privacy sheltering task, a 3D positioning task and an AR label tracking task.
The computer-readable storage media to which this application relates include Random Access Memory (RAM), memory, read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage media known in the art.
For a description of a relevant part in the image processing system, the image processing apparatus, and the computer-readable storage medium provided in the embodiments of the present application, reference is made to detailed descriptions of a corresponding part in the image processing method provided in the embodiments of the present application, and details are not repeated here. In addition, parts of the above technical solutions provided in the embodiments of the present application, which are consistent with the implementation principles of the corresponding technical solutions in the background art, are not described in detail so as to avoid redundant description.
It is further noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising one of 8230; \8230;" 8230; "does not exclude the presence of additional like elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (9)
1. An image processing method, comprising:
determining optical center deviation information of the camera in the zooming process;
based on the optical center deviation information, eliminating deviation of the image shot by the camera equipment to obtain a target image;
the method for determining the optical center deviation information of the image pickup device in the zooming process comprises the following steps:
acquiring test images obtained by shooting test scenes by the camera equipment at different focal lengths;
determining the optical center deviation information based on position information between objects positioned at the geometric center of the test image;
the acquiring of the test image obtained by shooting the test scene by the camera device under different focal lengths includes:
acquiring a first test image obtained by shooting the test scene by the camera equipment under a first focal length;
acquiring a second test image obtained by shooting the test scene by the camera equipment under a second focal length;
the determining the optical center deviation information based on the position information between the objects positioned at the geometric center of the test image comprises:
and in a shot image of the test scene by the camera equipment, taking the relative position relation between the objects positioned at the geometric centers of the first test image and the second test image as the optical center deviation information.
2. The method according to claim 1, wherein the regarding a relative positional relationship between the objects located at the geometric centers of the first test image and the second test image in one captured image of the test scene by the imaging apparatus as the optical center deviation information includes:
in the first test image, determining a target object positioned at a geometric center;
and in the second test image, determining the relative position relationship between the geometric centers of the target object and the second test image as the optical center deviation information.
3. The method according to claim 2, wherein the determining a relative positional relationship between the geometric centers of the target object and the second test image as the optical center deviation information comprises:
determining a first position of the target object in the second test image;
determining a second location of a geometric center of the second test image;
and taking the ratio of the first position to the second position as the optical center deviation information.
4. The method of claim 3, wherein the first location comprises a first abscissa, a first ordinate; the second position comprises a second abscissa and a second ordinate;
the determining, as the optical center deviation information, a ratio between the first position and the second position includes:
determining an abscissa ratio between the first abscissa and the second abscissa;
determining a vertical coordinate ratio between the first vertical coordinate and the second vertical coordinate;
and taking the abscissa proportion and the ordinate proportion as the optical center deviation information.
5. The method according to claim 4, wherein the performing offset cancellation on the image captured by the image capturing device based on the optical center offset information to obtain a target image comprises:
if the focal length is increased when the image is shot by the camera equipment, taking the product of the coordinate of the object to be adjusted in the image and the optical center deviation information as a new coordinate of the object to be adjusted in the target image;
and if the focal length is reduced when the image is shot by the camera equipment, taking the ratio of the coordinate of the object to be adjusted in the image and the optical center deviation information as the new coordinate of the object to be adjusted in the target image.
6. The method according to any one of claims 1 to 5, wherein the offset canceling the image captured by the image capturing apparatus based on the optical center offset information to obtain a target image comprises:
acquiring an image processing task;
based on the image processing task and the optical center deviation information, performing deviation elimination on the image shot by the camera equipment to obtain the target image;
the types of the image processing task include: the method comprises a privacy sheltering task, a 3D positioning task and an AR label tracking task.
7. An image processing system, comprising:
the deviation determining module is used for determining optical center deviation information of the camera in the zooming process;
the deviation elimination module is used for eliminating the deviation of the image shot by the camera equipment based on the optical center deviation information to obtain a target image;
the method for determining the optical center deviation information of the image pickup device in the zooming process comprises the following steps:
acquiring test images obtained by shooting test scenes by the camera equipment at different focal lengths;
determining the optical center deviation information based on position information between objects positioned at the geometric center of the test image;
the acquiring of the test image obtained by shooting the test scene by the camera device under different focal lengths includes:
acquiring a first test image obtained by shooting the test scene by the camera equipment under a first focal length;
acquiring a second test image obtained by shooting the test scene by the camera equipment under a second focal length;
the determining the optical center deviation information based on the position information between the objects positioned at the geometric center of the test image comprises:
and in a shot image of the test scene by the camera equipment, taking the relative position relationship between the objects positioned at the geometric centers of the first test image and the second test image as the optical center deviation information.
8. An image processing apparatus characterized by comprising:
a memory for storing a computer program;
a processor for implementing the steps of the image processing method according to any one of claims 1 to 6 when executing the computer program.
9. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the steps of the image processing method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010229679.7A CN113452897B (en) | 2020-03-27 | 2020-03-27 | Image processing method, system, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010229679.7A CN113452897B (en) | 2020-03-27 | 2020-03-27 | Image processing method, system, equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113452897A CN113452897A (en) | 2021-09-28 |
| CN113452897B true CN113452897B (en) | 2023-04-07 |
Family
ID=77807840
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010229679.7A Active CN113452897B (en) | 2020-03-27 | 2020-03-27 | Image processing method, system, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113452897B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104980730A (en) * | 2014-04-01 | 2015-10-14 | 宁波舜宇光电信息有限公司 | Method for positioning optical center on the basis of concentric circle theory |
| CN105825493A (en) * | 2015-01-09 | 2016-08-03 | 华为技术有限公司 | Image registration method and device |
| CN108171673A (en) * | 2018-01-12 | 2018-06-15 | 京东方科技集团股份有限公司 | Image processing method, device, vehicle-mounted head-up-display system and vehicle |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2006191181A (en) * | 2004-12-28 | 2006-07-20 | Canon Marketing Japan Inc | Imaging device, its control method, and its control program |
| JP2007058028A (en) * | 2005-08-26 | 2007-03-08 | Fujinon Corp | Lens system and camera system |
| JP6476701B2 (en) * | 2014-09-30 | 2019-03-06 | カシオ計算機株式会社 | Imaging apparatus, lens position shift correction method, and program |
| CN110858872B (en) * | 2018-08-23 | 2021-06-22 | 浙江宇视科技有限公司 | Optical axis offset compensation method and device |
-
2020
- 2020-03-27 CN CN202010229679.7A patent/CN113452897B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104980730A (en) * | 2014-04-01 | 2015-10-14 | 宁波舜宇光电信息有限公司 | Method for positioning optical center on the basis of concentric circle theory |
| CN105825493A (en) * | 2015-01-09 | 2016-08-03 | 华为技术有限公司 | Image registration method and device |
| CN108171673A (en) * | 2018-01-12 | 2018-06-15 | 京东方科技集团股份有限公司 | Image processing method, device, vehicle-mounted head-up-display system and vehicle |
Non-Patent Citations (1)
| Title |
|---|
| 袁保宗.光心位置计算.《信息技术促成人机融合》.北京：北京交通大学出版社,2018, * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113452897A (en) | 2021-09-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10306165B2 (en) | Image generating method and dual-lens device | |
| CN110717942B (en) | Image processing method and device, electronic equipment and computer readable storage medium | |
| US5602584A (en) | Apparatus for producing a panoramic image using a plurality of optical systems | |
| US9581436B2 (en) | Image processing device, image capturing apparatus, and image processing method | |
| US10070038B2 (en) | Image processing apparatus and method calculates distance information in a depth direction of an object in an image using two images whose blur is different | |
| US10306210B2 (en) | Image processing apparatus and image capturing apparatus | |
| JP2019510234A (en) | Depth information acquisition method and apparatus, and image acquisition device | |
| CN111083458B (en) | Brightness correction method, system, equipment and computer readable storage medium | |
| CN103222258B (en) | Mobile terminal, image procossing method | |
| CN111935398B (en) | Image processing method and device, electronic equipment and computer readable medium | |
| CN111242987B (en) | Target tracking method and device, electronic equipment and storage medium | |
| CN109951641B (en) | Image shooting method and device, electronic equipment and computer readable storage medium | |
| JP2013123123A (en) | Stereo image generation device, stereo image generation method and computer program for stereo image generation | |
| CN103402058A (en) | Shot image processing method and device | |
| CN111246100A (en) | Anti-shake parameter calibration method and device and electronic equipment | |
| CN110458870B (en) | Image registration, fusion and occlusion detection method and device and electronic equipment | |
| JP2013126135A (en) | Stereo image generation device, stereo image generation method and computer program for stereo image generation | |
| CN113452897B (en) | Image processing method, system, equipment and computer readable storage medium | |
| CN114786001B (en) | 3D picture shooting method and 3D shooting system | |
| JP2007049266A (en) | Picture imaging apparatus | |
| KR102389916B1 (en) | Method, apparatus, and device for identifying human body and computer readable storage | |
| JP2020048034A (en) | Electronic device and notification method | |
| CN114095644B (en) | Image correction method and computer equipment | |
| US8994846B2 (en) | Image processing apparatus and image processing method for detecting displacement between images having different in-focus positions | |
| CN112907704B (en) | Image fusion method, computer equipment and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |