CN112312041B - Shooting-based image correction method and device, electronic equipment and storage medium - Google Patents
Shooting-based image correction method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN112312041B CN112312041B CN202011142299.6A CN202011142299A CN112312041B CN 112312041 B CN112312041 B CN 112312041B CN 202011142299 A CN202011142299 A CN 202011142299A CN 112312041 B CN112312041 B CN 112312041B
- Authority
- CN
- China
- Prior art keywords
- image
- position information
- relative position
- perspective
- played
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Abstract
The application provides a shooting-based image correction method, a shooting-based image correction device, electronic equipment and a storage medium, and relates to the technical field of image processing. The image correction method based on shooting comprises the following steps: acquiring relative position information between shooting equipment and a shot screen; correcting the to-be-played image according to the relative position information and the pre-stored perspective relation of the visual angle to obtain a corrected image; the corrected image is transmitted to the screen. According to the embodiment of the video recording method and device, the relative position information between the shooting equipment and the shot screen is obtained in real time, the pre-stored perspective view relation is utilized to correct the to-be-broadcast image under the obtained current relative position information, the corrected image is finally obtained, the image correction processing can be timely carried out according to the position change of the shooting equipment, the position requirement on the shooting equipment and the perspective degree of recorded video are reduced, and the video recording quality is improved.
Description
Technical Field
The present invention relates to the field of image processing technologies, and in particular, to a shooting-based image correction method, device, electronic apparatus, and storage medium.
Background
In some shooting scenes, an application scheme using an LED screen as a performance background is provided, actors perform in front of the LED screen, scene props are arranged in front of the LED screen, video materials are played on the LED screen, and then the actors and the video materials on the LED screen are recorded together through shooting equipment, so that a performance mode that the actors use real props and perform in a virtual environment is formed. Because the video film sources broadcast on the LED screen are all 2D videos recorded in advance, parameters such as visual angles, focuses and the like cannot be modified, so that in a film shooting scene, along with the change of the machine position of the shooting equipment, the visual angles of the machine position of the video film sources in shooting are not overlapped with the shooting equipment for shooting on the scene, further, the shot picture figures, props and LEDs are not unified in a virtual scene, and the visual perspective deviation exists, so that the scene is quite unreal.
In order to avoid the above problems, most of the current photographing schemes are to place photographing devices near the normal direction of an LED screen, and keep the photographing devices as fixed as possible, so as to avoid the influence of perspective deviation.
The existing solution has higher position requirement on shooting equipment and poor shooting effect.
Disclosure of Invention
In order to solve the problems in the prior art, the application provides a shooting-based image correction method, a shooting-based image correction device, electronic equipment and a storage medium.
In order to achieve the above purpose, the technical scheme adopted in the application is as follows:
a first aspect of the present application provides a shooting-based image correction method, including:
acquiring relative position information between shooting equipment and a shot screen;
correcting the to-be-played image according to the relative position information and a pre-stored perspective view relationship to obtain a corrected image, wherein the pre-stored perspective view relationship comprises: the corresponding relation between different relative position information and image deformation data, wherein the image to be played is a two-dimensional image;
transmitting the corrected image to the photographed screen.
Optionally, the correcting the to-be-played image according to the relative position information and the pre-stored perspective view relationship, before obtaining the corrected image, further includes:
and converting the two-dimensional image into a three-dimensional space according to the ratio of 1:1, and obtaining a converted three-dimensional image.
Optionally, the method further comprises:
acquiring a reference image shot by the shooting equipment at the relative position of the central axis of the shot screen and an offset perspective image shot by the shooting equipment at the sampling position of different included angles with the central axis of the shot screen, wherein the shot screen plays an image converted into a three-dimensional space;
and according to the reference image and the offset perspective image, calculating and acquiring the corresponding relation between different relative position information and image deformation data.
Optionally, the relative position information includes: position information and axial information.
Optionally, the correcting the to-be-played image according to the relative position information and the pre-stored perspective view relationship to obtain a corrected image includes:
acquiring image deformation data of the to-be-played image in a three-dimensional space according to the relative position information and a pre-stored perspective view relation;
correcting the image to be played according to the image deformation data of the image to be played in the three-dimensional space, and obtaining the corrected image.
Optionally, the obtaining the image deformation data of the to-be-played image in the three-dimensional space according to the relative position information and the pre-stored perspective view relationship includes:
according to the relative position information and a pre-stored perspective view relationship, calculating and acquiring steering data and position quantity of the to-be-played image in a three-dimensional space;
correcting the image to be played according to the image deformation data of the image to be played in the three-dimensional space, and obtaining the corrected image, wherein the method comprises the following steps:
according to the steering data and the position quantity of the image to be broadcast in the three-dimensional space, adjusting the perspective data of the image to be broadcast to obtain the corrected image, wherein the perspective data of the angle comprises one or more of the following: position, axial direction, dimension, amount of deformation.
A second aspect of the present application provides a photographing-based image correction apparatus, including: the device comprises an acquisition unit, an acquisition unit and a transmission unit;
the acquisition unit is used for acquiring relative position information between the shooting equipment and the shot screen;
the obtaining unit is configured to correct the to-be-played image according to the relative position information and a pre-stored perspective view relationship, and obtain a corrected image, where the pre-stored perspective view relationship includes: the corresponding relation between different relative position information and image deformation data, wherein the image to be played is a two-dimensional image;
the transmission unit is used for transmitting the corrected image to the photographed screen.
Optionally, the acquiring unit is configured to convert the two-dimensional image into a three-dimensional space according to a ratio of 1:1, and acquire a converted three-dimensional image.
Optionally, the apparatus further comprises: a calculation unit;
the acquisition unit is used for acquiring a reference image shot by the shooting equipment at the relative position of the central axis of the shot screen and an offset perspective image shot by the shooting equipment at the sampling position with different included angles with the central axis of the shot screen, wherein the shot screen plays an image converted into a three-dimensional space;
the calculating unit is used for calculating and acquiring the corresponding relation between different relative position information and image deformation data according to the reference image and the offset perspective image.
Optionally, the relative position information includes: position information and axial information.
Optionally, the acquiring unit is configured to acquire image deformation data of the to-be-played image in a three-dimensional space according to the relative position information and a pre-stored perspective view relationship;
correcting the image to be played according to the image deformation data of the image to be played in the three-dimensional space, and obtaining the corrected image.
Optionally, the acquiring unit is configured to calculate and acquire steering data and a position quantity of the to-be-played image in a three-dimensional space according to the relative position information and a pre-stored perspective view relationship;
according to the steering data and the position quantity of the image to be broadcast in the three-dimensional space, adjusting the perspective data of the image to be broadcast to obtain the corrected image, wherein the perspective data of the angle comprises one or more of the following: position, axial direction, dimension, amount of deformation.
A third aspect of the present application provides an electronic device, comprising: a processor, a storage medium and a bus, the storage medium storing machine-readable instructions executable by the processor, the processor and the storage medium communicating over the bus when the electronic device is operating, the processor executing the machine-readable instructions to perform the steps of the method as described in the first aspect above.
A fourth aspect of the present application provides a storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the method according to the first aspect described above.
The embodiment of the application provides a shooting-based image correction method, a shooting-based image correction device, electronic equipment and a storage medium. The image correction method based on shooting comprises the following steps: acquiring relative position information between shooting equipment and a shot screen; correcting the to-be-played image according to the relative position information and a pre-stored perspective view relationship to obtain a corrected image, wherein the pre-stored perspective view relationship comprises: the corresponding relation between different relative position information and image deformation data, wherein the image to be played is a two-dimensional image; transmitting the corrected image to the screen. According to the embodiment of the video recording method and device, the relative position information between the shooting equipment and the shot screen is obtained in real time, the pre-stored perspective view relation is utilized to correct the to-be-broadcast image under the obtained current relative position information, the corrected image is finally obtained, the image correction processing can be timely carried out according to the position change of the shooting equipment, the position requirement on the shooting equipment and the perspective degree of recorded video are reduced, and the video recording quality is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments will be briefly described below, it being understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered limiting the scope, and that other related drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 is a flowchart of a shooting-based image correction method according to an embodiment of the present application;
fig. 2 is a flowchart of a method for correcting a photographing-based image according to another embodiment of the present application;
fig. 3 is a schematic view of a view camera according to an embodiment of the present disclosure;
FIG. 4 is a schematic diagram of a reference image and an offset perspective image according to an embodiment of the present application;
FIG. 5 is an image deformation map of an offset perspective image according to one embodiment of the present application;
FIG. 6 is a graph of the correction result of an offset perspective image according to an embodiment of the present application;
fig. 7 is a flowchart of a method for correcting a photographing-based image according to another embodiment of the present application;
fig. 8 is a schematic diagram of a photographing-based image correction device according to an embodiment of the present application;
fig. 9 is a schematic diagram of a photographing-based image correction device according to another embodiment of the present application;
fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present application more clear, the technical solutions of the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application, and it should be understood that the accompanying drawings in the present application are only for the purpose of illustration and description, and are not intended to limit the protection scope of the present application. In addition, it should be understood that the schematic drawings are not drawn to scale. A flowchart, as used in this application, illustrates operations implemented according to some embodiments of the present application. It should be understood that the operations of the flow diagrams may be implemented out of order and that steps without logical context may be performed in reverse order or concurrently. Moreover, one or more other operations may be added to the flow diagrams and one or more operations may be removed from the flow diagrams as directed by those skilled in the art.
In addition, the described embodiments are only some, but not all, of the embodiments of the present application. The components of the embodiments of the present application, which are generally described and illustrated in the figures herein, may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, as provided in the accompanying drawings, is not intended to limit the scope of the application, as claimed, but is merely representative of selected embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present application without making any inventive effort, are intended to be within the scope of the present application.
It should be noted that the term "comprising" will be used in the embodiments of the present application to indicate the presence of the features stated hereinafter, but not to exclude the addition of other features.
It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further definition or explanation thereof is necessary in the following figures.
Furthermore, the terms first, second and the like in the description and in the claims and in the above-described figures, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
It should be noted that, without conflict, features in embodiments of the present application may be combined with each other.
In order to clearly show the shooting-based image correction method provided in the embodiment of the present application, a brief description will be made of an application background of the method.
In some shooting scenes, for example, in the movie and television theatre shooting industry, there is an application scheme that a light emitting diode (Light Emitting Diode, abbreviated as LED) display screen is used as a performance background, so that actors perform in front of the LED screen, scene props are arranged in front of the LED screen, video materials are played on the LED screen, and then the real props are used by the actors and the video materials on the LED screen through shooting equipment to record together, so that a performance mode that the actors perform in a virtual environment is formed. Because the video film sources broadcast on the LED screen are all 2D videos recorded in advance, parameters such as visual angles, focuses and the like cannot be modified, the visual angles of the video film sources in shooting are not overlapped with shooting equipment in the scene due to the change of the camera positions of the shooting equipment, and the shot picture characters, props and LEDs are not unified in a virtual scene, have perspective deviation in vision and are quite unreal.
In order to avoid the influence of visual perspective on the quality of the shot video as much as possible, most of the current shooting schemes are to place shooting equipment near the normal direction of an LED screen and keep the shooting equipment as fixed as possible. The video shot by the existing shooting means cannot be used for explaining the scene content well, so that the expression of a camera operator on the lens language is greatly restrained.
In order to solve the technical problems in the prior art, the present application provides an inventive concept: the method comprises the steps of acquiring relative position information between shooting equipment and a shot screen in real time, correcting an image to be played under the acquired current relative position information by utilizing a pre-stored perspective view relationship, and finally obtaining a corrected image, so that the shooting equipment can move randomly within a certain range in front of the shot screen and is not limited by the shooting position. The position requirement of shooting equipment and the perspective degree of recorded video are reduced, and the picture sense and recording quality of video recording are improved.
The specific technical solutions provided in the present application are described below through possible implementation manners.
Fig. 1 is a schematic flow chart of a shooting-based image correction method according to an embodiment of the present application, where an execution subject of the method may be a computer, a server, or a processing device. As shown in fig. 1, the method includes:
s101, acquiring relative position information between the shooting equipment and a shot screen.
Alternatively, the photographing device may be a camera, an intelligent terminal, a video camera, various electronic devices with cameras, and the like. The photographed screen generally includes: cathode Ray Tube (CTR) displays, liquid crystal display (Liquid Crystal Display, LCD) displays, light emitting diode (light emitting diode, LED) displays, etc., in the embodiment of the present application, the photographed screen is mainly studied for a screen that may generate a visual perspective when the photographing position of the photographing apparatus is moved, for example, an LED screen.
It should be noted that, in the embodiment of the present application, the relative position information between the photographing device and the photographed screen may be obtained through an optical motion capturing technology. Among them, the infrared optical mode is the most accurate and reliable in the optical motion capturing technology, and mainly comprises an active mode and a passive mode. Alternatively, in the embodiment of the present application, the relative position information of the photographing device with respect to the photographed screen may be acquired using a passive infrared motion capturing technology.
Specifically, in the embodiment of the present application, the spatial positioning system with the infrared motion capturing technology may be used to obtain the relative position information of the shooting device in front of the shooting screen, and specifically, the process of obtaining the information by using the spatial positioning system is as follows: a plurality of infrared sensing cameras are erected in a physical space, are mutually at a certain angle and are mutually overlapped, and aim to enable shooting equipment and a shot screen to be digitally recorded in real time when the shooting equipment and the shot screen act in the physical space. Firstly, infrared light with a certain wavelength emitted by an infrared LED lamp on an infrared induction camera is reflected by a shooting device or a reflective mark point fixedly installed on a shot screen, an infrared image is captured frame by the infrared camera, then the image is calculated frame by an embedded calculation unit of the infrared induction camera, two-dimensional coordinates of each mark point are obtained, and relative position information between the shooting device and the shot screen is obtained through the two-dimensional coordinates of the mark point.
S102, correcting the to-be-played image according to the relative position information and the pre-stored perspective relation of the visual angle, and obtaining a corrected image.
Optionally, in an embodiment of the present application, the pre-stored perspective relationship includes: correspondence between different relative positional information and image deformation data.
The image to be played may be a two-dimensional image, and further, in the embodiment of the present application, the image to be played may be an image obtained by performing three-dimensional space conversion on the two-dimensional image or performing four-dimensional space conversion. It should be noted that, in the embodiment of the present application, the converted to-be-played image may generate a visual perspective when photographed at different angles.
And correcting the to-be-played image under the current relative position information by utilizing a pre-stored perspective view relation according to the acquired relative position information between the current shooting equipment and the shot screen, so as to obtain a corrected image. For example, the current relative position information may be corresponding to the relative position information in the pre-stored perspective view relationship, a mapping relationship under the current relative position information in the pre-stored perspective view relationship may be obtained, and the image to be played may be corrected by using the mapping relationship, so as to obtain the corrected image.
S103, transmitting the corrected image to the shot screen.
Alternatively, in the embodiment of the present application, for different relative positions between the photographing apparatus and the photographed screen, a corresponding corrected image is obtained, and finally the compensated image is transmitted to the photographed screen.
The embodiment of the application provides a shooting-based image correction method, which comprises the following steps: acquiring relative position information between shooting equipment and a shot screen; correcting the to-be-played image according to the relative position information and a pre-stored perspective view relationship to obtain a corrected image, wherein the pre-stored perspective view relationship comprises: the corresponding relation between different relative position information and image deformation data, wherein the image to be played is a two-dimensional image; transmitting the corrected image to the screen. According to the embodiment of the video recording method and device, the relative position information between the shooting equipment and the shot screen is obtained in real time, the pre-stored perspective view relation is utilized to correct the to-be-broadcast image under the obtained current relative position information, the corrected image is finally obtained, the image correction processing can be timely carried out according to the position change of the shooting equipment, the position requirement on the shooting equipment and the perspective degree of recorded video are reduced, and the video recording quality is improved.
In the embodiment of the present application, a specific description will be mainly made with respect to an image in which a two-dimensional image is converted into a three-dimensional space.
Optionally, correcting the to-be-played image according to the relative position information and the pre-stored perspective relation of the viewing angle, and before acquiring the corrected image, the method further comprises:
and converting the two-dimensional image into a three-dimensional space according to the ratio of 1:1, and acquiring a converted three-dimensional image.
In order to restore the real size of a scene in a two-dimensional image, so that the shot video is more real and has stronger picture feel, in the embodiment of the application, the two-dimensional image is converted into a three-dimensional space according to the ratio of 1:1 by using a scaling technology, and the converted three-dimensional image is obtained.
On the basis of the above embodiment, the above pre-stored perspective relationship of viewing angle needs to be established before the method is implemented.
Fig. 2 is a schematic flow chart of a shooting-based image correction method according to another embodiment of the present application, and as shown in fig. 2, the method further includes:
s201, acquiring a reference image shot by shooting equipment at the relative position of the central axis of a shot screen and an offset perspective image shot by the shooting equipment at the sampling position of different included angles with the central axis of the shot screen.
S202, according to the reference image and the offset perspective image, calculating and obtaining corresponding relations between different relative position information and image deformation data.
In the embodiment of the present application, the captured image displayed on the screen is an image converted into a three-dimensional space. The image shot by the shooting device at the relative position of the central axis of the shooting screen is used as a reference image, as shown in fig. 3, which is a schematic diagram of the picture shot by the viewfinder camera provided in the embodiment of the present application, where the shooting device can be as consistent as possible with the position of the viewfinder camera when shooting the object when shooting the screen at the relative position of the central axis of the shooting screen.
Fig. 4 is a schematic diagram of a reference image captured by a capturing device at a position (machine position 1) opposite to a central axis of a captured screen and an offset perspective image captured by the capturing device at a position having a certain included angle (machine position 2) with the captured screen, where a virtual rotation picture behind the captured screen may be a picture captured by a viewfinder camera or a virtual picture after the reference image is rotated. Image deformation data of the shooting equipment at the position of the machine position 2 are obtained according to the reference image and the offset perspective image as shown in fig. 5. According to the offset perspective relation, the virtual rotation picture is mapped to the offset perspective relation corresponding to the machine position 2, and a corrected image of the machine position 2 is obtained, as shown in fig. 6.
And moving the shooting equipment to a plurality of positions in front of the shooting screen, and storing image deformation data corresponding to the positions to obtain corresponding relations between different relative position information and the image deformation data.
In the embodiment of the present application, the correspondence between the different relative position information and the image deformation data is obtained through a plurality of relative position information, which may be implemented by a neural network prediction, a device software simulation, and a plurality of experimental records, which is not limited in the embodiment of the present application.
Optionally, the relative position information includes: position information and axial information.
It should be noted that, in the embodiment of the present application, the relative position information of the photographing apparatus and the photographed screen may include: positional information and axial information. The position information is used for representing the horizontal position and the height position of the shooting device relative to the shooting device, and can be represented by coordinates in different directions of x, y and z in a three-dimensional space; the axial information is used to represent the angle information of the photographing apparatus relative to the photographed apparatus.
Fig. 7 is a flowchart of a shooting-based image correction method according to another embodiment of the present application, as shown in fig. 7, step S102 may specifically include:
and S301, acquiring image deformation data of the image to be played in a three-dimensional space according to the relative position information and a pre-stored perspective view perspective relation.
S302, correcting the image to be broadcast according to the image deformation data of the image to be broadcast in the three-dimensional space, and obtaining a corrected image.
In the embodiment of the application, the image deformation data corresponding to the current position information and the axial information is searched in the pre-stored perspective view through the acquired current position information and the axial information of the shooting equipment, and the image deformation data is used for correcting the image to be played to obtain a corrected image.
In the embodiment of the present application, the image deformation data may be a degree of change in image size, such as stretching and compressing, of the image.
In the embodiment of the present application, it is assumed that the reference image photographed by the photographing apparatus is a quadrangle, and four sides of the quadrangle have display lengths (100, 150, 100, 150) in the photographed reference image, respectively, and when the photographing apparatus moves to another machine position, the display lengths of the four sides obtained by the perspective view relationship are (100, 170, 60, 120), the reference image is scaled to the size of (100, 170, 60, 120) according to the perspective view relationship. And (3) obtaining image deformation data of the shooting equipment at a plurality of positions in front of the shooting screen by moving the shooting equipment for a plurality of times, and taking the plurality of image deformation data as a pre-stored perspective relation of the visual angle. And in the image correction stage, when the shooting equipment moves to a certain relative position in the pre-stored perspective relation, correcting the image to be played according to the image deformation data of the corresponding relation of the relative position, and obtaining a corrected image.
It can be understood that in the embodiment of the application, by acquiring the position and the axial information between the shooting device and the shot screen in real time and correcting the to-be-played image under the acquired current position and the axial information by utilizing the pre-stored perspective relation of the viewing angle, the corrected image is finally obtained, so that the shooting device can move randomly within a certain range in front of the shot screen and is not limited by the shooting position any more. The position requirement of shooting equipment and the perspective degree of recorded video are reduced, and the picture sense and recording quality of video recording are improved.
Optionally, according to the relative position information and the pre-stored perspective view, obtaining image deformation data of the image to be played in the three-dimensional space includes:
according to the relative position information and the pre-stored perspective view, calculating and acquiring steering data and position quantity of the image to be played in the three-dimensional space;
correcting the image to be played according to the image deformation data of the image to be played in the three-dimensional space, and obtaining a corrected image, wherein the method comprises the following steps:
and adjusting perspective data of the visual angle of the image to be played according to the steering data and the position quantity of the image to be played in the three-dimensional space, and obtaining a corrected image.
In this embodiment of the present application, according to the relative position information, specifically, the relative position information between the current photographing device and the photographed screen and the pre-stored perspective view relationship, the current relative position information is matched with the relative position information in the pre-stored perspective view relationship, so as to obtain steering data and position quantity of the image under the current relative position information.
And adjusting the perspective data of the visual angle of the image to be played by utilizing the steering data and the position quantity corresponding to the images at different positions to obtain a corrected image. Wherein, in the embodiment of the application, the perspective data includes one or more of the following: position, axial direction, dimension, amount of deformation.
The following describes a device, a storage medium, and the like corresponding to the image correction method based on shooting provided in the present application, and specific implementation processes and technical effects thereof are referred to above, which are not described in detail below.
Fig. 8 is a schematic diagram of a photographing-based image correction device according to an embodiment of the present application, and as shown in fig. 8, the device may include: an acquisition unit 601, an acquisition unit 602, and a transmission unit 603;
an acquisition unit 601, configured to acquire relative position information between a photographing apparatus and a photographed screen;
an obtaining unit 602, configured to correct the to-be-played image according to the relative position information and a pre-stored perspective relationship, and obtain a corrected image, where the pre-stored perspective relationship includes: the corresponding relation between the different relative position information and the image deformation data, and the image to be played is a two-dimensional image;
a transmission unit 603 for transmitting the corrected image to the photographed screen.
Optionally, an acquiring unit 602, configured to convert the two-dimensional image into a three-dimensional space according to a ratio of 1:1, and acquire a converted three-dimensional image;
fig. 9 is a schematic diagram of a photographing-based image correction device according to another embodiment of the present application, and as shown in fig. 9, the device may further include: a calculation unit 604;
an obtaining unit 602, configured to obtain a reference image captured by a capturing device at a position opposite to a central axis of a captured screen, and an offset perspective image captured by the capturing device at a sampling position with a different included angle from the central axis of the captured screen, where an image converted into a three-dimensional space is played in the captured screen;
and a calculating unit 604, configured to calculate and acquire corresponding relations between different relative position information and image deformation data according to the reference image and the offset perspective image.
Optionally, the relative position information includes: position information and axial information.
Optionally, an acquiring unit 602, configured to acquire image deformation data of the image to be played in the three-dimensional space according to the relative position information and a pre-stored perspective view relationship;
correcting the image to be played according to the image deformation data of the image to be played in the three-dimensional space, and obtaining a corrected image.
Optionally, an obtaining unit 602, configured to calculate and obtain steering data and a position amount of the image to be played in the three-dimensional space according to the relative position information and a pre-stored perspective view relationship;
according to steering data and position quantity of the image to be broadcast in a three-dimensional space, adjusting perspective view data of the image to be broadcast to obtain a corrected image, wherein the perspective view data comprises one or more of the following: position, axial direction, dimension, amount of deformation.
Fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present application, including: processor 710, storage medium 720 and bus 730, storage medium 720 storing machine-readable instructions executable by processor 710, processor 710 executing machine-readable instructions to perform steps of the above-described method embodiments when the electronic device is operating, processor 710 communicating with storage medium 720 via bus 730. The specific implementation manner and the technical effect are similar, and are not repeated here.
The present embodiments provide a storage medium having a computer program stored thereon, which when executed by a processor performs the above method.
In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in hardware plus software functional units.
The integrated units implemented in the form of software functional units described above may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium, and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (english: processor) to perform part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: u disk, mobile hard disk, read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), magnetic disk or optical disk, etc.
The foregoing is merely a specific embodiment of the present application, but the protection scope of the present application is not limited thereto, and any person skilled in the art can easily think about changes or substitutions within the technical scope of the present application, and the changes or substitutions are covered by the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (7)
1. A shooting-based image correction method, characterized by comprising:
acquiring relative position information between shooting equipment and a shot screen;
correcting the to-be-played image according to the relative position information and a pre-stored perspective view relationship to obtain a corrected image, wherein the pre-stored perspective view relationship comprises: the corresponding relation between different relative position information and image deformation data, wherein the image to be played is a two-dimensional image;
transmitting the corrected image to the photographed screen;
the method further comprises the steps of:
acquiring a reference image shot by the shooting equipment at the relative position of the central axis of the shot screen and an offset perspective image shot by the shooting equipment at the sampling position of different included angles with the central axis of the shot screen, wherein the shot screen plays an image converted into a three-dimensional space;
according to the reference image and the offset perspective image, calculating and acquiring corresponding relations between different relative position information and image deformation data;
correcting the to-be-played image according to the relative position information and the pre-stored perspective view relation to obtain a corrected image, wherein the method comprises the following steps:
acquiring image deformation data of the to-be-played image in a three-dimensional space according to the relative position information and a pre-stored perspective view relation;
correcting the image to be played according to the image deformation data of the image to be played in a three-dimensional space, and obtaining the corrected image, wherein the relative position information comprises: position information and axial information.
2. The method according to claim 1, wherein correcting the to-be-played image according to the relative position information and the pre-stored perspective view relationship, before obtaining the corrected image, further comprises:
and converting the two-dimensional image into a three-dimensional space according to the ratio of 1:1, and obtaining a converted three-dimensional image.
3. The method according to claim 1, wherein the obtaining the image deformation data of the image to be broadcast in the three-dimensional space according to the relative position information and the pre-stored perspective view relationship includes:
according to the relative position information and a pre-stored perspective view relationship, calculating and acquiring steering data and position quantity of the to-be-played image in a three-dimensional space;
correcting the image to be played according to the image deformation data of the image to be played in the three-dimensional space, and obtaining the corrected image, wherein the method comprises the following steps:
according to the steering data and the position quantity of the image to be broadcast in the three-dimensional space, adjusting the perspective data of the image to be broadcast to obtain the corrected image, wherein the perspective data of the angle comprises one or more of the following: position, axial direction, dimension, amount of deformation.
4. An image correction apparatus based on photographing, comprising: the device comprises an acquisition unit, an acquisition unit and a transmission unit;
the acquisition unit is used for acquiring relative position information between the shooting equipment and the shot screen;
the obtaining unit is configured to correct the to-be-played image according to the relative position information and a pre-stored perspective view relationship, and obtain a corrected image, where the pre-stored perspective view relationship includes: the corresponding relation between different relative position information and image deformation data, wherein the image to be played is a two-dimensional image;
the transmission unit is used for transmitting the corrected image to the photographed screen;
the apparatus further comprises: a calculation unit;
the acquisition unit is used for acquiring a reference image shot by the shooting equipment at the relative position of the central axis of the shot screen and an offset perspective image shot by the shooting equipment at the sampling position with different included angles with the central axis of the shot screen, wherein the shot screen plays an image converted into a three-dimensional space;
the calculating unit is used for calculating and acquiring the corresponding relation between different relative position information and image deformation data according to the reference image and the offset perspective image;
the acquisition unit is also used for acquiring image deformation data of the image to be played in a three-dimensional space according to the relative position information and a pre-stored perspective view perspective relation; correcting the image to be played according to the image deformation data of the image to be played in the three-dimensional space, and obtaining corrected images, wherein the relative position information comprises: position information and axial information.
5. The apparatus according to claim 4, wherein the acquiring unit is configured to convert the two-dimensional image into a three-dimensional space according to a ratio of 1:1, and acquire the converted three-dimensional image.
6. An electronic device, comprising: a processor, a storage medium and a bus, the storage medium storing machine-readable instructions executable by the processor, the processor and the storage medium communicating over the bus when the electronic device is operating, the processor executing the machine-readable instructions to perform the steps of the method of any one of claims 1-3.
7. A storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the method according to any of claims 1-3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011142299.6A CN112312041B (en) | 2020-10-22 | 2020-10-22 | Shooting-based image correction method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011142299.6A CN112312041B (en) | 2020-10-22 | 2020-10-22 | Shooting-based image correction method and device, electronic equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112312041A CN112312041A (en) | 2021-02-02 |
| CN112312041B true CN112312041B (en) | 2023-07-25 |
Family
ID=74326969
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011142299.6A Active CN112312041B (en) | 2020-10-22 | 2020-10-22 | Shooting-based image correction method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112312041B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112965606A (en) * | 2021-03-31 | 2021-06-15 | 西安诺瓦星云科技股份有限公司 | Display screen correction method and device and display screen installation method and device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107424126A (en) * | 2017-05-26 | 2017-12-01 | 广州视源电子科技股份有限公司 | Method for correcting image, device, equipment, system and picture pick-up device and display device |
| JP2018029343A (en) * | 2017-09-12 | 2018-02-22 | 辰巳電子工業株式会社 | Image processing apparatus, image processing method, and program |
| CN108289220A (en) * | 2018-01-15 | 2018-07-17 | 深圳市奥拓电子股份有限公司 | Virtual image processing method, image processing system and storage medium |
| CN108509173A (en) * | 2018-06-07 | 2018-09-07 | 北京德火科技有限责任公司 | Image shows system and method, storage medium, processor |
| CN110086982A (en) * | 2019-03-12 | 2019-08-02 | 浙江艺旗教育科技有限公司 | A kind of perspective image antidote and device |
| CN110675348A (en) * | 2019-09-30 | 2020-01-10 | 杭州栖金科技有限公司 | Augmented reality image display method and device and image processing equipment |
-
2020
- 2020-10-22 CN CN202011142299.6A patent/CN112312041B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107424126A (en) * | 2017-05-26 | 2017-12-01 | 广州视源电子科技股份有限公司 | Method for correcting image, device, equipment, system and picture pick-up device and display device |
| JP2018029343A (en) * | 2017-09-12 | 2018-02-22 | 辰巳電子工業株式会社 | Image processing apparatus, image processing method, and program |
| CN108289220A (en) * | 2018-01-15 | 2018-07-17 | 深圳市奥拓电子股份有限公司 | Virtual image processing method, image processing system and storage medium |
| CN108509173A (en) * | 2018-06-07 | 2018-09-07 | 北京德火科技有限责任公司 | Image shows system and method, storage medium, processor |
| CN110086982A (en) * | 2019-03-12 | 2019-08-02 | 浙江艺旗教育科技有限公司 | A kind of perspective image antidote and device |
| CN110675348A (en) * | 2019-09-30 | 2020-01-10 | 杭州栖金科技有限公司 | Augmented reality image display method and device and image processing equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112312041A (en) | 2021-02-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2328125B1 (en) | Image splicing method and device | |
| CN108805917B (en) | Method, medium, apparatus and computing device for spatial localization | |
| KR102013978B1 (en) | Method and apparatus for fusion of images | |
| US20030012410A1 (en) | Tracking and pose estimation for augmented reality using real features | |
| CN112311965B (en) | Virtual shooting method, device, system and storage medium | |
| CN111766951B (en) | Image display method and apparatus, computer system, and computer-readable storage medium | |
| CN110874818B (en) | Image processing and virtual space construction method, device, system and storage medium | |
| US10063792B1 (en) | Formatting stitched panoramic frames for transmission | |
| US11580616B2 (en) | Photogrammetric alignment for immersive content production | |
| JP2014071850A (en) | Image processing apparatus, terminal device, image processing method, and program | |
| CN112207821B (en) | Target searching method of visual robot and robot | |
| JP2023546739A (en) | Methods, apparatus, and systems for generating three-dimensional models of scenes | |
| CN108282650B (en) | Naked eye three-dimensional display method, device and system and storage medium | |
| CN109978945B (en) | Augmented reality information processing method and device | |
| CN111563961A (en) | Three-dimensional modeling method and related device for transformer substation | |
| CN112312041B (en) | Shooting-based image correction method and device, electronic equipment and storage medium | |
| CN112017242B (en) | Display method and device, equipment and storage medium | |
| KR101529820B1 (en) | Method and apparatus for determing position of subject in world coodinate system | |
| CN110047035B (en) | Panoramic video hot spot interaction system and interaction equipment | |
| US11758101B2 (en) | Restoration of the FOV of images for stereoscopic rendering | |
| WO2021149509A1 (en) | Imaging device, imaging method, and program | |
| CN111242107B (en) | Method and electronic device for setting virtual object in space | |
| CN113822936A (en) | Data processing method and device, computer equipment and storage medium | |
| CN116168076A (en) | Image processing method, device, equipment and storage medium | |
| CN108986183B (en) | Method for manufacturing panoramic map |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |