CN116156132B - Projection image correction method, projection image correction device, electronic equipment and readable storage medium - Google Patents

Projection image correction method, projection image correction device, electronic equipment and readable storage medium Download PDF

Info

Publication number
CN116156132B
CN116156132B CN202211685275.4A CN202211685275A CN116156132B CN 116156132 B CN116156132 B CN 116156132B CN 202211685275 A CN202211685275 A CN 202211685275A CN 116156132 B CN116156132 B CN 116156132B
Authority
CN
China
Prior art keywords
image
projection
correction
area
corrected
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202211685275.4A
Other languages
Chinese (zh)
Other versions
CN116156132A (en
Inventor
周雪强
卢波
黄章勤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Yutong Lianfa Technology Co ltd
Original Assignee
Shenzhen Yutong Lianfa Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Yutong Lianfa Technology Co ltd filed Critical Shenzhen Yutong Lianfa Technology Co ltd
Priority to CN202211685275.4A priority Critical patent/CN116156132B/en
Publication of CN116156132A publication Critical patent/CN116156132A/en
Application granted granted Critical
Publication of CN116156132B publication Critical patent/CN116156132B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The application discloses a projection image correction method, a device, electronic equipment and a storage medium, which are applied to the technical field of laser projection, wherein the projection image correction method comprises the following steps: acquiring the area flatness of an image to be corrected and a corresponding target projection area; determining corresponding image correction information according to a standard correction image projected to the target projection area by the image to be corrected, wherein the standard correction image is a rectangular image with a preset projection effect; and correcting the image to be corrected according to the region flatness and the image correction information to obtain an image to be projected. The application solves the technical problem of low correction accuracy of the projection image.

Description

Projection image correction method, projection image correction device, electronic equipment and readable storage medium
Technical Field
The present application relates to the field of laser projection technologies, and in particular, to a method and apparatus for correcting a projection image, an electronic device, and a readable storage medium.
Background
Along with the continuous development of technology, laser projection equipment can be widely applied in many aspects such as people's work and life, at present, laser projection equipment is commonly used in coordination with projection display areas such as wall or curtain to reach better sight shadow effect, and simultaneously, the relative position between projection display area and the laser projection equipment has crucial influence to the display effect of projection image.
In the ideal use process of the laser projection device, if the laser projection device faces the projection display area, the display effect is enough to be ensured, and in the practical application scene, an ideal state that the laser projection device and the projection display area are not vertical to each other inevitably exists, and further the projected image is distorted, at present, the projected image is usually corrected in the horizontal direction or the vertical direction through the trapezoid correction function of the laser projection device, however, because the flatness of the projection display area in the same direction is different, the limitation of automatic trapezoid correction is higher, the corrected projected image still cannot achieve the ideal display effect easily, and therefore, the correction accuracy of the current projected image is low.
Disclosure of Invention
The application mainly aims to provide a projection image correction method, a projection image correction device, electronic equipment and a readable storage medium, and aims to solve the technical problem of low correction accuracy of projection images in the prior art.
In order to achieve the above object, the present application provides a projected image correction method comprising:
acquiring the area flatness of an image to be corrected and a corresponding target projection area;
Determining corresponding image correction information according to a standard correction image projected to the target projection area by the image to be corrected, wherein the standard correction image is a rectangular image with a preset projection effect;
and correcting the image to be corrected according to the region flatness and the image correction information to obtain an image to be projected.
Optionally, the step of determining the corresponding image correction information according to the standard correction image projected by the image to be corrected to the target projection area includes:
projecting a position calibration image corresponding to the image to be corrected in the target projection area to obtain a calibration shooting image;
determining a standard correction image in the calibration shooting image according to the first position characteristic point of the position calibration image;
and taking the position information of the second position characteristic point of the standard correction image as the image correction information.
Optionally, the step of acquiring the area flatness of the image to be corrected and the corresponding target projection area includes:
acquiring a first region detection image corresponding to the shot target projection region;
and determining the area flatness of the target projection area according to the distance between at least one first area detection point of the first area detection image and the area pixel point corresponding to each first area detection point.
Optionally, the step of acquiring the area flatness of the image to be corrected and the corresponding target projection area includes:
acquiring a second region detection image and a third region detection image of a shooting overlapping region corresponding to the target projection region;
generating a three-dimensional detection image according to the plane detection phase images respectively corresponding to the second region detection image and the third region detection image;
and calculating the area flatness of the target projection area according to the three-dimensional detection image.
Optionally, the step of correcting the image to be corrected according to the region flatness and the image correction information to obtain the image to be projected includes:
detecting whether the flatness of the area is larger than a preset flatness threshold value;
if yes, performing mapping transformation on the image to be corrected according to a homography matrix corresponding to the image correction information to obtain the image to be projected;
if not, inquiring a projection correction parameter corresponding to the image correction information in a preset correction mapping table, and replacing the projection initial parameter of the image to be corrected with the projection correction parameter.
Optionally, the step of performing mapping transformation on the image to be corrected according to the homography matrix corresponding to the image correction information to obtain the image to be projected includes:
According to at least one second homography matrix corresponding to the image correction information, adjusting a leveling grid image constructed by at least one preset leveling grid to obtain a correction grid image;
and mapping the image to be corrected on the correction grid image to obtain the image to be projected.
Optionally, after the step of correcting the image to be corrected according to the area flatness and the image correction information to obtain the image to be projected, the projection image correction method further includes:
projecting the image to be projected to the target projection area, and acquiring projection deformation information of a reflecting mirror of the laser projection equipment in the projection process;
predicting the projection deformation amount of the reflecting mirror according to the projection deformation information;
and if the projection deformation is larger than a preset projection deformation threshold, adjusting the laser projection equipment to correct the projection distance of the image to be projected to the target projection area.
In order to achieve the above object, the present application also provides a projection image correction apparatus including:
the acquisition module is used for acquiring the image to be corrected and the area flatness of the corresponding target projection area;
The determining module is used for determining corresponding image correction information according to a standard correction image projected to the target projection area by the image to be corrected, wherein the standard correction image is a rectangular image with a preset projection effect;
and the correction module is used for correcting the image to be corrected according to the region flatness and the image correction information to obtain the image to be projected.
Optionally, the determining module is further configured to:
projecting a position calibration image corresponding to the image to be corrected in the target projection area to obtain a calibration shooting image;
determining a standard correction image in the calibration shooting image according to the first position characteristic point of the position calibration image;
and taking the position information of the second position characteristic point of the standard correction image as the image correction information.
Optionally, the acquiring module is further configured to:
acquiring a first region detection image corresponding to the shot target projection region;
and determining the region flatness 5 of the target projection region according to the distance between at least one first region detection point of the first region detection image and the region pixel point corresponding to each first region detection point.
Optionally, the acquiring module is further configured to:
acquiring a second region detection image and a third region detection image of a shooting overlapping region corresponding to the target projection region;
generating a three-dimensional detection image according to the plane detection 0 phase image corresponding to the second region detection image and the third region detection image respectively;
and calculating the area flatness of the target projection area according to the three-dimensional detection image.
Optionally, the correction module is further configured to:
detecting whether the flatness of the area is larger than a preset flatness threshold value;
if yes, carrying out 5-line mapping transformation on the image to be corrected according to a homography matrix corresponding to the image correction information to obtain the image to be projected;
if not, inquiring a projection correction parameter corresponding to the image correction information in a preset correction mapping table, and replacing the projection initial parameter of the image to be corrected with the projection correction parameter.
Optionally, the correction module is further configured to:
according to at least one second homography matrix corresponding to the image correction information, adjusting a leveling grid image constructed by at least 0 preset leveling grid to obtain a correction grid image;
And mapping the image to be corrected on the correction grid image to obtain the image to be projected.
Optionally, the projection image correction apparatus is further configured to:
projecting the image to be projected to the target projection area, and acquiring projection deformation information of a reflecting mirror of the laser projection equipment in the projection process;
5, predicting the projection deformation of the reflector according to the projection deformation information;
and if the projection deformation is larger than a preset projection deformation threshold, adjusting the laser projection equipment to correct the projection distance of the image to be projected to the target projection area.
The application also provides an electronic device comprising: at least one processor and a memory communicatively coupled to the at least one processor, the memory storing instructions executable by the at least one processor to enable the at least one processor to perform the steps of the projected image correction method as described above.
The present application also provides a computer-readable storage medium having stored thereon a program for implementing a projection image correction method, which when executed by a processor implements the steps of the projection image correction method as described above.
The application also provides a computer program product comprising a computer program which, when executed by a processor, implements the steps of a projection image correction method as described above.
The application provides a projection image correction method, a projection image correction device, electronic equipment and a readable storage medium, namely, the method comprises the steps of obtaining the area flatness of an image to be corrected and a corresponding target projection area; determining corresponding image correction information according to a standard correction image projected to the target projection area by the image to be corrected, wherein the standard correction image is a rectangular image with a preset projection effect; and correcting the image to be corrected according to the region flatness and the image correction information. The standard correction image is a rectangular image with a preset projection effect, and then the image correction information corresponding to the standard correction image is used for correcting the image to be corrected, so that the preset projection effect consistent with the standard correction image can be achieved when the corrected image to be corrected is projected to a target projection area, meanwhile, the aim that the flatness of a projection display area influences the display effect of the corrected projection image in the projection correction process can be achieved due to the fact that the area flatness of the target projection area is considered in the correction process of the image to be corrected, the aim that the flatness of the projection display area influences the display effect of the corrected projection image can be achieved, rather than the aim that the laser projection device and the projection display area do not keep a vertical state, the trapezoidal correction function of the laser projection device is used for directly correcting the projection image in the horizontal direction or the vertical direction, namely, the aim that the projection image is subjected to targeted correction of the flatness of the projection display area and the user viewing angle is achieved is overcome, the defect that the flatness of the projection display area in the same direction is different, the limitation of automatic trapezoidal correction is high, the technical defect that the corrected projection image cannot achieve ideal display effect easily is still achieved, and the accuracy of the projection image is improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.
In order to more clearly illustrate the embodiments of the application or the technical solutions of the prior art, the drawings which are used in the description of the embodiments or the prior art will be briefly described, and it will be obvious to a person skilled in the art that other drawings can be obtained from these drawings without inventive effort.
Fig. 1 is a flowchart of a projection image correction method according to an embodiment of the application;
FIG. 2 is a schematic diagram of a projection area corresponding to a standard correction image of a projection image correction method according to the present application;
fig. 3 is a flowchart of a projection image correction method according to a second embodiment of the present application;
fig. 4 is a schematic structural diagram of a projection image correction apparatus according to a third embodiment of the present application;
fig. 5 is a schematic structural diagram of an electronic device according to a fourth embodiment of the present application.
The achievement of the objects, functional features and advantages of the present application will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
In order to make the above objects, features and advantages of the present application more comprehensible, the following description of the embodiments accompanied with the accompanying drawings will be given in detail. It will be apparent that the described embodiments are only some, but not all, embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
Example 1
An embodiment of the present application provides a method for correcting a projection image, in a first embodiment of the method for correcting a projection image, referring to fig. 1, the method for correcting a projection image includes:
step S10, obtaining the area flatness of an image to be corrected and a corresponding target projection area;
step S20, corresponding image correction information is determined according to a standard correction image projected to the target projection area by the image to be corrected, wherein the standard correction image is a rectangular image with a preset projection effect;
and step S30, correcting the image to be corrected according to the region flatness and the image correction information to obtain an image to be projected.
In this embodiment, it should be noted that, in the present method for correcting a trapezoid of a projected image, there are usually digital trapezoid correction and optical correction, where the correction range and the correction range are limited, and the angle and the position of a device in an optical path need to be changed, and both of them are lacking in correction accuracy, and the method for correcting a projected image according to the present embodiment of the present application is applied to an intelligent projector system, which specifically includes a camera, a laser projection device, a processor, and a memory, where when the laser projection device projects an image onto a projection display area, since it is difficult to continuously maintain a mutually perpendicular state, and further when they cannot be mutually perpendicular, the image projected by the laser projection device is corrected, so that the corrected image has a preset projection effect, that is, a user can continue to view an image or a video on the projection display area under the current viewing angle, where the type of distortion may be image distortion, image proportion, or image distortion.
Additionally, it should be noted that, the target projection area is used for representing a medium carrying a projection picture of the laser projection device, where the target projection area may be a plane projection area formed by one or more planes on a same plane, such as a background wall and a projection curtain, or may be a stereoscopic projection area formed by one or more planes on different planes, such as a circular arc landing window and a corner, where the image to be corrected is an image waiting for correction, specifically an original image, and the flatness of the area is used for representing the flatness of the area, and when the laser projection device projects the image onto the target projection area, no matter how the pose relation between the projector and the target projection area changes, when the user views the target projection area along the projection direction of the laser projection device, the image viewed by the user is a projected image close to no distortion, where the distortion is limited by the difference of optical properties of the human eye and the laser projection device and the user cannot be spatially formed by the laser projection device, but the image is negligible, the image waiting for correction is carried by the image, and the image is calibrated by the reference image, where the image is not superimposed by the preset image, and the image is calibrated by the reference image, and the image is no image is calibrated by the image, and the position of the reference image is calibrated, and the image is not calibrated by the image, and the position of the image is calibrated, the position reference mark can be a position reference point or a position reference line.
In addition, it should be noted that, the laser projection device projects the position calibration image to the target projection area, and the camera shoots the position calibration image displayed in the target projection area, and then intercepts a rectangular area (standard correction image) with a preset projection effect from the shot position calibration image displayed in the target projection area, and takes the projection area corresponding to the rectangular area as the image projection area for projecting the image to be corrected, where the image correction information is used for characterizing the area position of the projection area corresponding to the standard correction image, and further according to the area flatness and the image correction information, when the image to be corrected is corrected and projected in the target projection area, since the image displayed in the target projection area is consistent with the image displayed in the projection area corresponding to the standard correction image, when the user is located at the position of the camera for viewing, that is, the pose of the camera is the simulated user viewing pose, and the undistorted rectangular image displayed under the simulated viewpoint of the camera can be seen, so that the user views the projection image with the preset projection effect, that is, and the accuracy of correcting the projection image is improved.
As an example, steps S10 to S30 include: acquiring an image to be corrected and a corresponding position calibration image on a laser projection device, and acquiring the area flatness of a target projection area, wherein the image to be corrected and the position calibration image have the same image size; projecting the position calibration image to the target projection area, shooting the position calibration image projected by the target projection area through a camera, determining a standard correction image in the position calibration image, and determining corresponding image correction information according to the standard correction image, wherein the standard correction image has a preset projection effect; and correcting the image to be corrected according to the area flatness and the image correction information to obtain an image to be projected, wherein the image to be projected is an image waiting to be projected on a modulation plane of the laser projection equipment.
In an embodiment, referring to fig. 2, fig. 2 is a schematic diagram showing a projection area corresponding to a standard correction image, where the location calibration image 11 includes a target projection area 12 and a projection image 13, the location calibration image 11 may determine the standard correction image 14, and then the projection area corresponding to the standard correction image 14 is used as the projection area of the image to be corrected.
Wherein the step of determining corresponding image correction information according to the standard correction image projected by the image to be corrected to the target projection area includes:
step A10, projecting a position calibration image corresponding to the image to be corrected in the target projection area to obtain a calibration shooting image;
step A20, determining a standard correction image in the calibration shooting image according to a first position feature point of the position calibration image;
and step A30, taking the position information of the second position characteristic point of the standard correction image as the image correction information.
In this embodiment, it should be noted that, the calibration captured image is used to represent a position calibration image captured by a camera and displayed in a target projection area, the first position feature point and the second position feature point are both position feature points, the position feature points are used to represent feature points forming the position calibration image, and specifically may be one or more, for example, four corner points and an image centroid point of the position calibration image, and any point of the calibration captured image is used as an origin to construct a coordinate system, and since the first position feature point is known, a standard correction image may be determined in the calibration captured image according to a homography matrix between the first position feature point and the second position feature point, where the homography matrix is used to represent a position change generated when the first position feature point of the position calibration image is transformed to the camera by the laser projection device.
As an example, steps a10 to a30 include: projecting a position calibration image corresponding to the image to be corrected in the target projection area to obtain a calibration shooting image; determining a standard correction image in the calibration shooting image according to the first position characteristic point of the position calibration image; and taking the position information of the second position characteristic point of the standard correction image as the image correction information.
The step of obtaining the area flatness of the image to be corrected and the corresponding target projection area comprises the following steps:
step B10, acquiring a first region detection image corresponding to the shot target projection region;
and step B20, determining the area flatness of the target projection area according to the distance between at least one first area detection point of the first area detection image and the area pixel point corresponding to each first area detection point.
In this embodiment, it should be noted that, because the area flatness of the target projection area has an influence on the projection effect of the projection image, the area image of the target display area may be captured by the camera, and then the detection of the area flatness of the target projection area may be implemented based on the area image, so as to lay a foundation for correcting the image to be corrected, where the area detection point is used to characterize the feature point used to detect the area flatness in the target projection area, and the area pixel point is used to characterize the pixel feature point in the first area detection image, and the area pixel point may be divided into two by the dual-pixel detection sensor, and then the two photodiodes are used cooperatively to implement the phase difference detection of focusing.
As an example, steps B10 to B20 include: shooting a first region detection image through a camera, wherein the first region detection image is used for detecting the region flatness of the target projection region, the first region detection image carries image pixel point information, and the image pixel point information comprises image pixel point information such as the number of pixel points, phase differences, pixel point intervals and the like; acquiring at least one first area detection point and corresponding area pixel points in the first area detection image, determining the distance between the at least one first area detection point of the first area detection image and the area pixel point corresponding to each first area detection point according to the phase difference information and the linear relation between each area pixel point and each area detection point, and calculating the area flatness of the target projection area based on the distance determination, wherein the phase difference information comprises the phase difference information of the pixel points corresponding to the same area detection point of each area pixel point.
The step of obtaining the area flatness of the image to be corrected and the corresponding target projection area comprises the following steps:
Step C10, acquiring a second region detection image and a third region detection image of a shooting overlapping region which are shot corresponding to the target projection region;
step C20, generating a three-dimensional detection image according to the plane detection phase images respectively corresponding to the second region detection image and the third region detection image;
and step C30, calculating the area flatness of the target projection area according to the three-dimensional detection image.
In this embodiment, it should be noted that, the second area detection image and the third area detection image are both used to adjust the area flatness of the target projection area, and the second area detection image and the third area detection image may be captured by different cameras, where an overlapping area exists between the second area detection image and the third area detection image.
As an example, steps C10 to C30 include: projecting stripe projection to the target projection area, acquiring a first initial image and a second initial image shot by different cameras, and respectively performing image processing on the first initial image and the second initial image to obtain a second area detection image and a third area detection image, wherein the stripe projection is projected to the whole target projection area, and the image processing mode at least comprises at least one of interpolation, filtering and curved surface fitting; inquiring a corresponding first initial phase image and a corresponding second initial phase image in a preset phase mapping table by taking pixel gray values corresponding to the second area detection image and the third area detection image as indexes, processing the first initial phase image and the second initial phase image based on a preset phase shift method to obtain respective corresponding plane detection phase images, and performing three-dimensional reconstruction according to the respective plane detection phase images and parameter information corresponding to each camera to generate a three-dimensional detection image, wherein the preset phase shift method can be specifically a double-frequency six-step phase shift method; and according to the ratio between the point cloud superposition amount and the point cloud total amount of the reference plane, determining the area flatness of the target projection area.
The step of correcting the image to be corrected according to the region flatness and the image correction information to obtain the image to be projected comprises the following steps:
step D10, detecting whether the flatness of the area is larger than a preset flatness threshold value;
step D20, if yes, performing mapping transformation on the image to be corrected according to a homography matrix corresponding to the image correction information to obtain the image to be projected;
and D30, if not, inquiring projection correction parameters corresponding to the image correction information in a preset correction mapping table, and replacing the projection initial parameters of the image to be corrected with the projection correction parameters.
In this embodiment, it should be noted that, because the flatness of the area of the target projection area has an influence on the projection effect of the projection image, when the image to be projected needs to be projected onto a plane, a homography relationship between the laser projection device and the projection display screen can be established, when the image to be projected needs to be projected onto an irregular surface, parametric modeling cannot be performed to determine the homography relationship, and further, according to different flatness of the target projection area, different correction modes can be used to correct the image to be corrected, so as to improve the accuracy of correcting the projection image.
As an example, steps D10 to D30 include: detecting whether the flatness of the area is larger than a preset flatness threshold value, wherein the preset flatness threshold value can be set by a user according to requirements; if the flatness of the region is detected to be larger than a preset flatness threshold value, performing mapping transformation on the image to be corrected according to a homography matrix corresponding to the image correction information to obtain the image to be projected; if the flatness of the area is detected to be smaller than or equal to the preset flatness threshold value, a projection correction parameter corresponding to the image correction information is queried in a preset correction mapping table, and the projection initial parameter of the image to be corrected is replaced by the projection correction parameter, wherein the projection correction parameter is stored in a storage medium of the intelligent projector system in advance, and the projection correction parameter is used for correcting the angle and the depth of the projection beam of the laser projection device projected to the target projection area.
The step of performing mapping transformation on the image to be corrected according to the homography matrix corresponding to the image correction information to obtain the image to be projected comprises the following steps:
Step E10, according to at least one homography matrix corresponding to the image correction information, adjusting a leveling grid image constructed by at least one preset leveling grid to obtain a correction grid image;
and E20, mapping the image to be corrected to the correction grid image to obtain the image to be projected.
In this embodiment, it should be noted that, the projected image projected onto the target projection area may be divided into areas, and then the image area of the image to be corrected is corrected pertinently based on the flatness of the areas, where the flat grid image is used to represent a rectangular area formed by grid correction points.
As an example, steps E10 to E20 include: according to at least one homography matrix corresponding to the image correction information, adjusting a leveling grid image constructed by at least one preset leveling grid to obtain a correction grid image; and mapping the image to be corrected on the correction grid image to obtain the image to be projected.
Wherein, the adjusting the flat grid image constructed by at least one preset flat grid according to at least one homography matrix corresponding to the image correction information comprises the following specific steps:
Setting a flat grid image of X rows and Y columns according to the correction fineness requirement, constructing an undistorted matrix image under the current view angle on a camera image plane according to the image length-width ratio of the image to be corrected, transmitting a complementary Gray code structure light sequence to the target projection area through a laser projection device, shooting a structure light frame sequence image through a camera, obtaining decoding values of sampling points of the structure light frame sequence image based on a preset Gray code decoding algorithm, reconstructing the flat grid image based on grid correction points corresponding to the decoding values, and obtaining the correction grid image.
The embodiment of the application provides a projection image correction method, namely, the method comprises the steps of obtaining the area flatness of an image to be corrected and a corresponding target projection area; determining corresponding image correction information according to a standard correction image projected to the target projection area by the image to be corrected, wherein the standard correction image is a rectangular image with a preset projection effect; and correcting the image to be corrected according to the region flatness and the image correction information. The standard correction image is a rectangular image with a preset projection effect, and then the image correction information corresponding to the standard correction image is used for correcting the image to be corrected, so that the preset projection effect consistent with the standard correction image can be achieved when the corrected image to be corrected is projected to a target projection area, meanwhile, the aim that the flatness of a projection display area influences the display effect of the corrected projection image in the projection correction process can be achieved due to the fact that the area flatness of the target projection area is considered in the correction process of the image to be corrected, the aim that the flatness of the projection display area influences the display effect of the corrected projection image can be achieved, rather than the aim that the laser projection device and the projection display area do not keep a vertical state, the trapezoidal correction function of the laser projection device is used for directly correcting the projection image in the horizontal direction or the vertical direction, namely, the aim that the projection image is subjected to targeted correction of the flatness of the projection display area and the user viewing angle is achieved is overcome, the defect that the flatness of the projection display area in the same direction is different, the limitation of automatic trapezoidal correction is high, the technical defect that the corrected projection image cannot achieve ideal display effect easily is still achieved, and the accuracy of the projection image is improved.
Example two
Further, referring to fig. 3, in another embodiment of the present application, the same or similar contents as those of the first embodiment may be referred to the description above, and will not be repeated. On the basis, after the step of correcting the image to be corrected according to the region flatness and the image correction information to obtain the image to be projected, the projection image correction method further comprises the following steps:
step F10, projecting the image to be projected to the target projection area, and acquiring projection deformation information of a reflecting mirror of the laser projection equipment in the projection process;
f20, predicting the projection deformation of the reflecting mirror according to the projection deformation information;
and step F30, if the projection deformation is larger than a preset projection deformation threshold, adjusting the laser projection equipment to correct the projection distance of the image to be projected to the target projection area.
In this embodiment, it should be noted that, for a laser projection device with a mirror, when the laser projection device projects the image to be projected onto a target projection area, the device state of the laser projection device is in real-time change, because the mirror is sensitive to the device temperature of the laser projection device, and further the deformation amount of the mirror is different when the laser projection device is at different temperatures, the position projected onto the target projection area changes due to the change of the deformation amount, and further the display effect of the projected image is affected.
Additionally, it should be noted that, due to numerous factors affecting the device temperature, that is, numerous factors affecting the deformation amount of the reflector, the projection deformation information is used for characterizing factors affecting the deformation of the reflector during projection, and specifically includes operation duration information, operation environment information and operation intensity information, where the operation duration information may be specifically duration information, the operation environment information may be specifically environmental temperature information, and the operation intensity information may be specifically luminous flux information.
As an example, steps F10 to F30 include: projecting the image to be projected to the target projection area, and acquiring the operation time information of the laser projection equipment, the operation environment information of the laser projection equipment and the luminous flux information of the reflecting mirror in the projection process; constructing a projection deformation vector according to the operation time information, the operation environment information and the luminous flux information, and inputting the projection deformation vector into a preset deformation prediction model to obtain projection deformation prediction; and if the projection deformation is greater than a preset projection deformation threshold, adjusting the laser projection equipment to correct the projection distance of the image to be projected to the target projection area, wherein the adjustment mode can be specifically a mode of adjusting the heat dissipation efficiency of a heat dissipation component of the laser projection equipment.
The embodiment of the application provides a data acquisition terminal adjusting method, namely, the image to be projected is projected to the target projection area, and projection deformation information of a reflecting mirror of laser projection equipment in the projection process is obtained; predicting the projection deformation amount of the reflecting mirror according to the projection deformation information; and if the projection deformation is larger than a preset projection deformation threshold, adjusting the laser projection equipment to correct the projection distance of the image to be projected to the target projection area. Compared with the mode that the current deformation of the reflecting mirror is calculated through a preset deformation calculation formula, and whether the laser projection equipment is adjusted or not is determined according to the current deformation, the projection deformation of the reflecting mirror is predicted in real time through projection deformation information of the reflecting mirror of the laser projection equipment in the projection process, and then the laser projection equipment is adjusted when the projection deformation is larger than a preset deformation threshold value, so that the projection distance of an image to be projected to the target projection area is ensured, the purpose of accurately predicting the projection deformation of the reflecting mirror can be achieved, and therefore the projection effect of the laser projection equipment on the image projected by the target projection area is improved.
Example III
An embodiment of the present application further provides a projection image correction apparatus, referring to fig. 4, including:
an obtaining module 101, configured to obtain an image to be corrected and an area flatness of a corresponding target projection area;
the determining module 102 is configured to determine corresponding image correction information according to a standard correction image projected onto the target projection area by the image to be corrected, where the standard correction image is a rectangular image with a preset projection effect;
and the correction module 103 is configured to correct the image to be corrected according to the region flatness and the image correction information, so as to obtain an image to be projected.
Optionally, the determining module is further configured to:
projecting a position calibration image corresponding to the image to be corrected in the target projection area to obtain a calibration shooting image;
determining a standard correction image in the calibration shooting image according to the first position characteristic point of the position calibration image;
and taking the position information of the second position characteristic point of the standard correction image as the image correction information.
Optionally, the acquiring module is further configured to:
acquiring a first region detection image corresponding to the shot target projection region;
And determining the area flatness of the target projection area according to the distance between at least one first area detection point of the first area detection image and the area pixel point corresponding to each first area detection point.
Optionally, the acquiring module is further configured to:
acquiring a second region detection image and a third region detection image of a shooting overlapping region corresponding to the target projection region;
generating a three-dimensional detection image according to the plane detection phase images respectively corresponding to the second region detection image and the third region detection image;
and calculating the area flatness of the target projection area according to the three-dimensional detection image.
Optionally, the correction module is further configured to:
detecting whether the flatness of the area is larger than a preset flatness threshold value;
if yes, performing mapping transformation on the image to be corrected according to a homography matrix corresponding to the image correction information to obtain the image to be projected;
if not, inquiring a projection correction parameter corresponding to the image correction information in a preset correction mapping table, and replacing the projection initial parameter of the image to be corrected with the projection correction parameter
Optionally, the correction module is further configured to:
according to at least one second homography matrix corresponding to the image correction information, adjusting a leveling grid image constructed by at least one preset leveling grid to obtain a correction grid image;
and mapping the image to be corrected on the correction grid image to obtain the image to be projected.
Optionally, the projection image correction apparatus is further configured to:
projecting the image to be projected to the target projection area, and acquiring projection deformation information of a reflecting mirror of the laser projection equipment in the projection process;
predicting the projection deformation amount of the reflecting mirror according to the projection deformation information;
and if the projection deformation is larger than a preset projection deformation threshold, adjusting the laser projection equipment to correct the projection distance of the image to be projected to the target projection area.
The projection image correction device provided by the invention solves the technical problem of low correction accuracy of the projection image by adopting the projection image correction method in the embodiment. Compared with the prior art, the beneficial effects of the projection image correction device provided by the embodiment of the invention are the same as those of the projection image correction method provided by the embodiment, and other technical features of the projection image correction device are the same as those disclosed by the method of the embodiment, so that details are not repeated.
Example IV
The embodiment of the invention provides electronic equipment, which comprises: at least one processor; and a memory communicatively coupled to the at least one processor; the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can execute the projection image correction method in the first embodiment.
Referring now to fig. 5, a schematic diagram of an electronic device suitable for use in implementing embodiments of the present disclosure is shown. The electronic devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and the like, and stationary terminals such as digital TVs, desktop computers, and the like. The electronic device shown in fig. 5 is merely an example and should not be construed to limit the functionality and scope of use of the disclosed embodiments.
As shown in fig. 5, the electronic device may include a processing apparatus 1001 (e.g., a central processing unit, a graphics processor, etc.), which may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 1002 or a program loaded from a storage apparatus 1003 into a Random Access Memory (RAM) 1004. In the RAM1004, various programs and data required for the operation of the electronic device are also stored. The processing device 1001, the ROM1002, and the RAM1004 are connected to each other by a bus 1005. An input/output (I/O) interface 1006 is also connected to the bus.
In general, the following systems may be connected to the I/O interface 1006: input devices 1007 including, for example, a touch screen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, and the like; an output device 1008 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage device 1003 including, for example, a magnetic tape, a hard disk, and the like; and communication means 1009. The communication means may allow the electronic device to communicate with other devices wirelessly or by wire to exchange data. While electronic devices having various systems are shown in the figures, it should be understood that not all of the illustrated systems are required to be implemented or provided. More or fewer systems may alternatively be implemented or provided.
In particular, according to embodiments of the present disclosure, the processes described above with reference to flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method shown in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network via the communication device 1009, or installed from the storage device 1003, or installed from the ROM 1002. The above-described functions defined in the method of the embodiment of the present disclosure are performed when the computer program is executed by the processing device 1001.
The electronic equipment provided by the invention solves the technical problem of low correction accuracy of the projection image by adopting the projection image correction method in the embodiment. Compared with the prior art, the electronic device provided by the embodiment of the invention has the same beneficial effects as the projection image correction method provided by the embodiment, and other technical features in the electronic device are the same as the features disclosed by the method of the embodiment, and are not repeated here.
It should be understood that portions of the present disclosure may be implemented in hardware, software, firmware, or a combination thereof. In the description of the above embodiments, particular features, structures, materials, or characteristics may be combined in any suitable manner in any one or more embodiments or examples.
The foregoing is merely illustrative of the present invention, and the present invention is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Example five
The present embodiment provides a computer-readable storage medium having computer-readable program instructions stored thereon for performing the projection image correction method in the above-described embodiment.
The computer readable storage medium according to the embodiments of the present invention may be, for example, a usb disk, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, or device, or a combination of any of the foregoing. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this embodiment, a computer-readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, or device. Program code embodied on a computer readable storage medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, fiber optic cables, RF (radio frequency), and the like, or any suitable combination of the foregoing.
The above-described computer-readable storage medium may be contained in an electronic device; or may exist alone without being assembled into an electronic device.
The computer-readable storage medium carries one or more programs that, when executed by an electronic device, cause the electronic device to: acquiring the area flatness of an image to be corrected and a corresponding target projection area; determining corresponding image correction information according to a standard correction image projected to the target projection area by the image to be corrected, wherein the standard correction image is a rectangular image with a preset projection effect; and correcting the image to be corrected according to the region flatness and the image correction information to obtain an image to be projected.
Computer program code for carrying out operations of the present disclosure may be written in one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules described in the embodiments of the present disclosure may be implemented in software or hardware. Wherein the name of the module does not constitute a limitation of the unit itself in some cases.
The computer readable storage medium provided by the application stores the computer readable program instructions for executing the projection image correction method, and solves the technical problem of low correction accuracy of the projection image. Compared with the prior art, the beneficial effects of the computer readable storage medium provided by the embodiment of the application are the same as those of the projection image correction method provided by the above embodiment, and are not described herein.
Example six
The application also provides a computer program product comprising a computer program which, when executed by a processor, implements the steps of a projection image correction method as described above.
The computer program product provided by the application solves the technical problem of low correction accuracy of the projection image. Compared with the prior art, the beneficial effects of the computer program product provided by the embodiment of the present application are the same as those of the projection image correction method provided by the above embodiment, and are not described herein.
The foregoing description is only of the preferred embodiments of the present application, and is not intended to limit the scope of the application, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein, or any application, directly or indirectly, within the scope of the application.

Claims (8)

1. A projection image correction method, characterized in that the projection image correction method comprises:
acquiring the area flatness of an image to be corrected and a corresponding target projection area;
determining corresponding image correction information according to a standard correction image projected to the target projection area by the image to be corrected, wherein the standard correction image is a rectangular image with a preset projection effect;
correcting the image to be corrected according to the area flatness and the image correction information to obtain an image to be projected, wherein the step of correcting the image to be corrected according to the area flatness and the image correction information to obtain the image to be projected comprises the following steps:
detecting whether the flatness of the area is larger than a preset flatness threshold value;
if yes, performing mapping transformation on the image to be corrected according to a homography matrix corresponding to the image correction information to obtain the image to be projected;
if not, inquiring a projection correction parameter corresponding to the image correction information in a preset correction mapping table, and replacing a projection initial parameter of the image to be corrected with the projection correction parameter, wherein the step of performing the projection transformation on the image to be corrected according to a homography matrix corresponding to the image correction information to obtain the image to be projected comprises the following steps:
According to at least one homography matrix corresponding to the image correction information, adjusting a leveling grid image constructed by at least one preset leveling grid to obtain a correction grid image;
mapping the image to be corrected on the correction grid image to obtain the image to be projected, wherein the specific steps of adjusting a leveling grid image constructed by at least one preset leveling grid according to at least one homography matrix corresponding to the image correction information to obtain the correction grid image are as follows: setting a flat grid image of X rows and Y columns according to the correction fineness requirement, constructing an undistorted matrix image under the current view angle on a camera image plane according to the image length-width ratio of the image to be corrected, transmitting a complementary Gray code structure light sequence to the target projection area through a laser projection device, shooting a structure light frame sequence image through a camera, obtaining a decoding value of a sampling point of the structure light frame sequence image based on a preset Gray code decoding algorithm, and reconstructing the flat grid image based on a grid correction point corresponding to the decoding value to obtain the correction grid image.
2. The projection image correction method according to claim 1, wherein the step of determining corresponding image correction information from a standard correction image of the image to be corrected projected onto the target projection area includes:
Projecting a position calibration image corresponding to the image to be corrected in the target projection area to obtain a calibration shooting image;
determining a standard correction image in the calibration shooting image according to the first position characteristic point of the position calibration image;
and taking the position information of the second position characteristic point of the standard correction image as the image correction information.
3. The projection image correction method according to claim 1, wherein the step of acquiring the area flatness of the image to be corrected and the corresponding target projection area includes:
acquiring a first region detection image corresponding to the shot target projection region;
and determining the area flatness of the target projection area according to the distance between at least one first area detection point of the first area detection image and the area pixel point corresponding to each first area detection point.
4. The projection image correction method according to claim 1, wherein the step of acquiring the area flatness of the image to be corrected and the corresponding target projection area includes:
acquiring a second region detection image and a third region detection image of a shooting overlapping region corresponding to the target projection region;
Generating a three-dimensional detection image according to the plane detection phase images respectively corresponding to the second region detection image and the third region detection image;
and calculating the area flatness of the target projection area according to the three-dimensional detection image.
5. The projection image correction method according to claim 1, wherein after the step of correcting the image to be corrected based on the area flatness and the image correction information to obtain the image to be projected, the projection image correction method further comprises:
projecting the image to be projected to the target projection area, and acquiring projection deformation information of a reflecting mirror of the laser projection equipment in the projection process;
predicting the projection deformation amount of the reflecting mirror according to the projection deformation information;
and if the projection deformation is larger than a preset projection deformation threshold, adjusting the laser projection equipment to correct the projection distance of the image to be projected to the target projection area.
6. A projection image correction apparatus, characterized by comprising:
the acquisition module is used for acquiring the image to be corrected and the area flatness of the corresponding target projection area;
The determining module is used for determining corresponding image correction information according to a standard correction image projected to the target projection area by the image to be corrected, wherein the standard correction image is a rectangular image with a preset projection effect;
the correction module is used for correcting the image to be corrected according to the regional flatness and the image correction information to obtain an image to be projected, wherein the determination module is also used for detecting whether the regional flatness is larger than a preset flatness threshold value; if yes, performing mapping transformation on the image to be corrected according to a homography matrix corresponding to the image correction information to obtain the image to be projected; if not, inquiring projection correction parameters corresponding to the image correction information in a preset correction mapping table, and replacing the projection initial parameters of the image to be corrected with the projection correction parameters, wherein the determining module is further used for adjusting a flat grid image constructed by at least one preset flat grid according to at least one homography matrix corresponding to the image correction information to obtain a corrected grid image; mapping the image to be corrected on the correction grid image to obtain the image to be projected, wherein the determining module is further used for setting a flat grid image of X rows and Y columns according to the correction fineness requirement, constructing an undistorted matrix image under the current view angle on a camera image plane according to the image length-width ratio of the image to be corrected, transmitting a complementary gray code structured light sequence to the target projection area through a laser projection device, shooting a structured light frame sequence image through a camera, obtaining decoding values of sampling points of the structured light frame sequence image based on a preset gray code decoding algorithm, reconstructing the flat grid image based on grid correction points corresponding to the decoding values, and obtaining the correction grid image.
7. An electronic device, the electronic device comprising:
at least one processor;
a memory communicatively coupled to the at least one processor;
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the steps of the projection image correction method of any one of claims 1 to 5.
8. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a program for realizing the projection image correction method, the program for realizing the projection image correction method being executed by a processor to realize the steps of the projection image correction method according to any one of claims 1 to 5.
CN202211685275.4A 2022-12-27 2022-12-27 Projection image correction method, projection image correction device, electronic equipment and readable storage medium Active CN116156132B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211685275.4A CN116156132B (en) 2022-12-27 2022-12-27 Projection image correction method, projection image correction device, electronic equipment and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211685275.4A CN116156132B (en) 2022-12-27 2022-12-27 Projection image correction method, projection image correction device, electronic equipment and readable storage medium

Publications (2)

Publication Number Publication Date
CN116156132A CN116156132A (en) 2023-05-23
CN116156132B true CN116156132B (en) 2023-11-14

Family

ID=86372745

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211685275.4A Active CN116156132B (en) 2022-12-27 2022-12-27 Projection image correction method, projection image correction device, electronic equipment and readable storage medium

Country Status (1)

Country Link
CN (1) CN116156132B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005033703A (en) * 2003-07-11 2005-02-03 Seiko Epson Corp System and method for processing image, projector, program, and information storage medium
CN104811637A (en) * 2014-01-24 2015-07-29 株式会社理光 Projection system, image processing apparatus, and correction method
CN105791786A (en) * 2016-03-09 2016-07-20 上海易景信息科技有限公司 System and method for automatically adjusting smoothness of projection surface
CN114286066A (en) * 2021-12-23 2022-04-05 深圳市火乐科技发展有限公司 Projection correction method, projection correction device, storage medium and projection equipment
CN114339179A (en) * 2021-12-23 2022-04-12 深圳市火乐科技发展有限公司 Projection correction method, projection correction device, storage medium and projection equipment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005033703A (en) * 2003-07-11 2005-02-03 Seiko Epson Corp System and method for processing image, projector, program, and information storage medium
CN104811637A (en) * 2014-01-24 2015-07-29 株式会社理光 Projection system, image processing apparatus, and correction method
CN105791786A (en) * 2016-03-09 2016-07-20 上海易景信息科技有限公司 System and method for automatically adjusting smoothness of projection surface
CN114286066A (en) * 2021-12-23 2022-04-05 深圳市火乐科技发展有限公司 Projection correction method, projection correction device, storage medium and projection equipment
CN114339179A (en) * 2021-12-23 2022-04-12 深圳市火乐科技发展有限公司 Projection correction method, projection correction device, storage medium and projection equipment

Also Published As

Publication number Publication date
CN116156132A (en) 2023-05-23

Similar Documents

Publication Publication Date Title
CN110300292B (en) Projection distortion correction method, device, system and storage medium
JP5902297B2 (en) Method and apparatus for calibrating an imaging device
JP5910157B2 (en) Image projection device
US9344695B2 (en) Automatic projection image correction system, automatic projection image correction method, and non-transitory storage medium
US8953048B2 (en) Information processing apparatus and control method thereof
CN112399158B (en) Projection image calibration method and device and projection equipment
US20150172635A1 (en) Calibration of a three-dimensional acquisition system
EP3273680A1 (en) Projection system, projector device, image capturing device, and program
JP2020187358A (en) Projection system, projection apparatus and calibrating method for displayed image thereof
CN112272292B (en) Projection correction method, apparatus and storage medium
CN104978077B (en) interaction method and system
CN112017133B (en) Image display method and device and electronic equipment
Wilm et al. Accurate and simple calibration of DLP projector systems
CN113256742A (en) Interface display method and device, electronic equipment and computer readable medium
CN115205128A (en) Depth camera temperature drift correction method, system, equipment and medium based on structured light
CN114449249B (en) Image projection method, image projection device, storage medium and projection apparatus
CN112150560A (en) Method and device for determining vanishing point and computer storage medium
US11483528B2 (en) Information processing apparatus and information processing method
CN114286068A (en) Focusing method, focusing device, storage medium and projection equipment
CN114125411A (en) Projection equipment correction method and device, storage medium and projection equipment
CN116156132B (en) Projection image correction method, projection image correction device, electronic equipment and readable storage medium
CN115550619A (en) Projection correction method and device, electronic equipment and readable storage medium
CN116033131A (en) Image correction method, device, electronic equipment and readable storage medium
CN110349109B (en) Fisheye distortion correction method and system and electronic equipment thereof
CN114339179A (en) Projection correction method, projection correction device, storage medium and projection equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant