CN112584112B - Projection method, system and readable storage medium based on size correction - Google Patents

Projection method, system and readable storage medium based on size correction Download PDF

Info

Publication number
CN112584112B
CN112584112B CN202011402175.7A CN202011402175A CN112584112B CN 112584112 B CN112584112 B CN 112584112B CN 202011402175 A CN202011402175 A CN 202011402175A CN 112584112 B CN112584112 B CN 112584112B
Authority
CN
China
Prior art keywords
projection
calibration images
spliced
images
spliced calibration
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011402175.7A
Other languages
Chinese (zh)
Other versions
CN112584112A (en
Inventor
李志�
金凌琳
林锦发
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Dangzhi Technology Co ltd
Original Assignee
Shenzhen Dangzhi Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Dangzhi Technology Co ltd filed Critical Shenzhen Dangzhi Technology Co ltd
Priority to CN202011402175.7A priority Critical patent/CN112584112B/en
Publication of CN112584112A publication Critical patent/CN112584112A/en
Application granted granted Critical
Publication of CN112584112B publication Critical patent/CN112584112B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179Video signal processing therefor
    • H04N9/3185Geometric adjustment, e.g. keystone or convergence
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038Image mosaicing, e.g. composing plane images from plane sub-images
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3141Constructional details thereof

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Geometry (AREA)
  • Projection Apparatus (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The application discloses a projection method, a projection system and a computer readable storage medium based on size correction, wherein the method comprises the following steps: controlling the two light machines to project the spliced calibration images to the projection surfaces in the shooting direction of the camera; based on the collected images of the spliced calibration images shot by the camera, adjusting the projection included angle of the two optical machines; after the two spliced calibration images are spliced seamlessly, the two spliced calibration images are subjected to trapezoidal correction respectively; after the trapezoidal correction is completed on the two spliced calibration images, carrying out projection size correction on the rectangular spliced calibration images; after the two spliced calibration images are subjected to projection size correction, controlling the two optical machines to project images to be displayed to a projection surface, wherein the two images to be displayed are obtained by cutting an original image; the final two projection images synthesize the original image. The application improves the integral effect of the effective projection picture of the wide-screen projection system.

Description

Projection method, system and readable storage medium based on size correction
Technical Field
The present application relates to the field of projection display technologies, and in particular, to a projection method, a projection system, and a computer readable storage medium based on size correction.
Background
With the development of science and technology, projection equipment is becoming more and more popular in offices, multifunctional conference rooms and home theatres, and currently, a single optical machine outputs a single optical path for projection in a projection manner, and the projection area of the projection equipment or a projection system is limited by the projection distance, the imaging physical characteristics of the optical machine, the trapezoidal correction of images and the like.
When the above-mentioned projector apparatus or projection system is in the side projection, the projected image is actually displayed, due to the effect of the trapezoidal correction factor, is scaled down and corrected, impairing the look and feel, and the larger the side projection angle, the smaller the projected area of the image is actually displayed. In particular, when the projection is used for displaying a large-width image, the actual display projection picture can only be scaled down under the condition of keeping the aspect ratio, and the projection has large upper and lower black edges, so that the projection area of the actual display image is smaller, and the overall effect of the effective projection picture is poor.
The foregoing is provided merely for the purpose of facilitating understanding of the technical solutions of the present application and is not intended to represent an admission that the foregoing is prior art.
Disclosure of Invention
The embodiment of the application mainly aims to provide a projection method, a projection system and a computer readable storage medium based on size correction, and aims to solve the technical problems that the projection area of an actual display image of conventional projection equipment or system is smaller and the integrity effect of an effective projection picture is poor.
In order to achieve the above objective, an embodiment of the present application provides a projection method based on size correction, where the wide screen projection system includes two light machines and a camera disposed on the same base plane, and the camera is disposed between the two light machines;
the projection method comprises the following steps:
after the wide screen projection system is started and the two light machines perform projection focusing and trapezoidal correction, controlling the two light machines to project the projection surfaces in the shooting direction of the camera, and respectively projecting and splicing calibration images;
based on the collected images of the spliced calibration images shot by the cameras, determining the position relationship of the two spliced calibration images; according to the position relation, the angle of the projection included angle of the two optical machines is adjusted until the two spliced calibration images are spliced seamlessly;
after the two spliced calibration images are spliced seamlessly, keeping the two spliced calibration images spliced seamlessly, and performing trapezoidal correction on the two spliced calibration images respectively until the two spliced calibration images are rectangular;
after the trapezoidal correction of the two spliced calibration images is completed, carrying out projection size correction on the rectangular spliced calibration images until the sizes of the left spliced calibration image and the right spliced calibration image are consistent, and keeping seamless splicing of the two spliced calibration images in the process;
After the two spliced calibration images are subjected to projection size correction, controlling the two optical machines to project images to be displayed to a projection surface, wherein the two images to be displayed are obtained by cutting an original image; the final two projection images synthesize the original image.
Optionally, the step of performing projection size correction on the rectangular stitched calibration image includes:
longitudinally aligning the two rectangular spliced calibration images, and adjusting the longitudinal widths of the two rectangular spliced calibration images until the two transverse boundaries of the two spliced calibration images are aligned and parallel;
and transversely aligning the two spliced calibration images of the rectangles, and adjusting the transverse length of the spliced calibration images of the two rectangles until the two longitudinal boundary distances of the two spliced calibration images are equal to the projection splicing line distance, wherein the projection splicing line is a splicing line formed by seamlessly splicing the two spliced calibration images.
Optionally, the step of adjusting the longitudinal widths of the two rectangular stitched calibration images until the two lateral boundaries of the two stitched calibration images are aligned and parallel includes:
dividing the two rectangular spliced calibration images into two transverse areas by taking the perpendicular bisector of the projection splicing lines of the two spliced calibration images as a dividing line;
And determining a lateral boundary, which is closer to the perpendicular bisector, in the two lateral regions based on the camera, and taking the closer lateral boundary in the two lateral regions as a reference, and approaching the farther lateral boundary in the two lateral regions to the closer lateral boundary until the two lateral boundaries of the two spliced calibration images are aligned and parallel.
Optionally, the step of adjusting the lateral lengths of the two rectangular stitching calibration images until the two longitudinal boundary distances of the two stitching calibration images are equal to the projected stitching line distance includes:
taking projection stitching lines of the two stitching calibration images as central lines, and dividing the two rectangular stitching calibration images into two longitudinal areas;
and determining a longitudinal boundary which is closer to the central line and does not coincide with the central line in the two longitudinal regions based on the camera, and taking the closer longitudinal boundary in the two longitudinal regions as a reference, and approaching the farther longitudinal boundary in the two longitudinal regions to the central line until the distances between the two longitudinal boundaries of the two spliced calibration images and the central line are equal.
Optionally, the step of determining the positional relationship of the two stitched calibration images based on the acquired images of the stitched calibration images captured by the camera includes:
Performing feature analysis on the acquired images of the spliced calibration images shot by the cameras, and detecting whether an overlapping area exists between the two spliced calibration images;
if the two spliced calibration images have an overlapping area, the position relationship is intersected; if the two spliced calibration images do not have an overlapping area, the position relationship is separated; if no intersection or separation phenomenon occurs, judging that the two spliced calibration images are tangent;
according to the position relation, the projection included angle of the two optical machines is adjusted until the two spliced calibration images are spliced seamlessly, wherein the step of splicing comprises the following steps:
if the position relationship is separated, the projection included angle of the two optical machines is reduced; if the position relationship is intersecting, the projection included angle of the two optical machines is increased; if the position relationship is tangential, judging that the spliced calibration image coincides with the two longitudinal boundaries;
in the process of adjusting the included angle, judging whether the two longitudinal boundaries of the spliced calibration image are coincident or not based on an edge recognition algorithm; and if the two longitudinal boundaries are coincident, judging that the two spliced calibration images are spliced seamlessly, and stopping the rotation of the two optical machines.
Optionally, the wide screen projection system further comprises a focusing motor, wherein the focusing motor is arranged at the lens of the optical machine; the projection method based on the size correction further comprises the following steps:
Before the two light machines of the wide screen projection system carry out projection focusing, controlling the two light machines to project a focal length calibration image to the projection surface;
and controlling a focusing motor to adjust the focal lengths of the two optical machines based on the definition of the focal length calibration image dynamically acquired by the camera until the definition reaches a preset definition threshold.
Optionally, the wide screen projection method further includes:
when the power-on of the optical machine is detected, if a command for canceling the wide screen projection is detected, detecting the current projection brightness requirement of the wide screen projection system;
if the current projection brightness requirement is greater than or equal to a preset brightness threshold, controlling the two photomechanics to project a spliced calibration image to an area where the shooting direction of the camera is vertical to the projection surface until the two spliced calibration images are completely overlapped;
and performing trapezoidal correction on the two light machines, and controlling the two light machines to project the same image to be displayed to the projection surface.
Optionally, the wide screen projection method further includes:
after the detection light machine projects the images to be displayed on the projection surface, detecting the similarity between the images to be displayed projected by the light machine, and counting the duration time when the similarity is greater than or equal to a preset similarity threshold value;
if the duration time is longer than the preset unit time, the wide screen projection system outputs a prompt of whether to shut down, and if the user does not respond after outputting the prompt of whether to shut down, the optical engine is automatically shut down;
If a shutdown instruction or a non-shutdown instruction is received, the method is executed according to the user instruction;
and if the similarity is smaller than the preset similarity threshold, resetting the duration time when the current statistical similarity is larger than or equal to the preset similarity threshold to reckon.
In order to achieve the above object, the present application further provides a wide-screen projection system, where the wide-screen projection system includes two optical machines disposed on the same plane, a camera, a memory, a processor, and a computer program stored in the memory and capable of running on the processor, where the camera is disposed between the two optical machines, and where the computer program when executed by the processor implements the steps of the size correction-based projection method described above.
To achieve the above object, the present application also provides a readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the above-described size correction-based projection method.
In the embodiment of the application, the wide screen projection is realized by arranging two optical machines, after the two optical machines are controlled to respectively carry out projection focusing, the spliced calibration image is projected to a projection surface, and the projection included angle of the two optical machines is adjusted according to the position relation based on the position relation of the spliced calibration image dynamically acquired by the camera until the two spliced calibration images are spliced seamlessly; after the splicing operation is completed, performing trapezoidal correction and projection size correction on the two spliced calibration images respectively; finally, the two light machines are controlled to project the image to be displayed on the projection surface, the image to be displayed is cut to form a left image A to be displayed and a right image B to be displayed as shown in fig. 7, and then the left image and the right image are respectively and simultaneously displayed by the two light machines, so that the two light machines jointly output the projection picture output by the single light machine in the conventional scheme, the amplitude of the equal proportion reduction of the actual projection picture when the single light machine system displays the wide-screen image is reduced, the problems that the upper black side and the lower black side are large and the projection area of the actual display image is small during full-screen projection are avoided, and the integral effect of the effective projection picture of the wide-screen projection system is improved.
Drawings
FIG. 1 is a schematic view of a wide screen projection system according to the present application;
FIG. 2 is a schematic view of a wide screen projection system according to another embodiment of the present application;
fig. 3 is a schematic view of a scene of the projection angle P of two photomechanical apparatuses according to the present application;
FIG. 4 is a schematic diagram illustrating a layout of directions and reference lines of an embodiment of a projection screen in a wide-screen projection system according to the present application;
FIG. 5 is a flow chart illustrating an embodiment of a projection method based on size correction according to the present application;
FIG. 6 is a detailed flowchart of the projection size correction of the rectangular stitched calibration image in step S40 of FIG. 5 according to the present application;
FIG. 7 is a schematic view of the scene of the original image slit projection and the synthesized projection in the present application;
FIG. 8 is a schematic view of a scene of a vertical alignment in a stitched calibration image size correction in accordance with the present application;
FIG. 9 is a schematic view of a scene of lateral alignment in stitching calibration image size correction in accordance with the present application.
Reference numerals illustrate:
reference numerals Name of the name Reference numerals Name of the name
1 Light machine 2 Camera head
3 Circuit board 4 Base seat
5 Image processing chip 6 Optical machine driving chip
71 First motor 72 First mounting table
73 Second mounting table 711 Driving gear
P Included angle 8 Projection screen
91 Second motor 92 Horizontal rotating shaft
10 Focusing motor
The achievement of the objects, functional features and advantages of the present application will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the application.
The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are only some, but not all embodiments of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
It should be noted that all directional indicators (such as up, down, left, right, front, and rear … …) in the embodiments of the present application are merely used to explain the relative positional relationship, movement, etc. between the components in a particular posture (as shown in the drawings), and if the particular posture is changed, the directional indicator is changed accordingly.
In the present application, unless specifically stated and limited otherwise, the terms "connected," "affixed," and the like are to be construed broadly, and for example, "affixed" may be a fixed connection, a removable connection, or an integral body; can be mechanically or electrically connected; either directly or indirectly, through intermediaries, or both, may be in communication with each other or in interaction with each other, unless expressly defined otherwise. The specific meaning of the above terms in the present application can be understood by those of ordinary skill in the art according to the specific circumstances.
Furthermore, descriptions such as those referred to as "first," "second," and the like, are provided for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implying an order of magnitude of the indicated technical features in the present disclosure. Thus, a feature defining "a first" or "a second" may explicitly or implicitly include at least one such feature. In addition, the technical solutions of the embodiments may be combined with each other, but it is necessary to base that the technical solutions can be realized by those skilled in the art, and when the technical solutions are contradictory or cannot be realized, the combination of the technical solutions should be considered to be absent and not within the scope of protection claimed in the present application.
The present application proposes a wide-screen projection system, in one embodiment of the wide-screen projection system, with reference to fig. 1 and 2, comprising: the device comprises two optical machines 1, a camera 2, a circuit board 3 and a base 4, wherein the optical machines 1 are arranged on the base 4 at intervals, a driving component for driving the optical machines 1 to rotate is arranged on the base 4, the camera 2 is arranged on the base 4 between the two optical machines 1, the camera 2 is used for collecting various calibration images output by the optical machines 1, and the calibration images comprise a spliced calibration image, a trapezoidal calibration image and a focal length calibration image; the models of the two light machines 1 are generally the same, that is, the projection optical parameters of the two light machines 1 are basically the same, the base 4 mainly plays a role in installation and support, the light machines 1 are installed on the base 4 at intervals and movably, the light machines 1 are driven by the driving assembly to rotate on the plane of the base 4, and the light emitting direction of the light machines 1 is adjusted, so that the projection area position of the light machines 1 on the projection screen 8 is adjusted. The camera 2 is mainly used for collecting the image content projected to the projection screen 8 by the optical machine 1, the image content can be a calibration image for the projection calibration of the optical machine 1, and can also be a projection picture generated by dividing and cutting an image to be displayed by the projection of the optical machine 1, in general, in order to facilitate the accurate collection of the image content by the camera 2, the camera 2 is arranged on the base 4 between the two optical machines 1, so that the horizontal offset of the image content projected by the relative optical machine 1 is reduced as much as possible, the accuracy of the image content collected by the camera 2 is improved, and the data analysis accuracy of the image processing chip 5 and the optical machine driving chip 6 is further improved.
Referring to fig. 2, a processor is provided on the circuit board 3, and the processor includes an image processing chip 5 and an optical machine driving chip 6 which are communicatively connected to each other; the image processing chip 5 is in communication connection with the optical machine 1, and the optical machine 1 is controlled to respectively output the spliced calibration images by receiving the image data and the logic control signals of the image processing chip 5; the image processing chip 5 is respectively in communication connection with the optical machine driving chip 6, the driving component and the camera, so as to control the driving component to adjust an included angle P formed by the light emitting directions of the two optical machines 1 based on the spliced calibration images acquired by the camera 2, so that the adjacent boundaries of the two spliced calibration images are connected; after the two spliced calibration images are connected, the optical machine driving chip 6 informs the image processing chip 5 and controls the optical machine 1 to output respective projection pictures, wherein the projection pictures are obtained by the image processing chip 5 through proportional splitting of the images to be displayed according to the width proportion of the spliced calibration images.
The circuit board 3 is generally arranged on the base 4 and is arranged at intervals with the optical machine 1, namely, the circuit board 3 is arranged above one side of the base 4 where the optical machine 1 is arranged, a support can be arranged between the circuit board 3 and the base 4, the circuit board 3 is fixedly connected with the support, and the height of the support is greater than that of the optical machine 1, so that the circuit board 3 and the optical machine 1 are arranged at intervals. Optionally, because the power of the optical machine 1 is larger, the heat generation is more, the heat dissipation problem is outstanding, a radiating fin can be arranged on one side of the circuit board 3 towards the optical machine 1, one end of the radiating fin is connected with the circuit board 3, and the other end is connected with a radiating piece of the optical machine 1 or a radiating hole adjacent to the optical machine 1, so that the area between the circuit board 3 and the optical machine 1 is effectively utilized, the radiating area is increased, and the radiating efficiency of the optical machine 1 is improved.
The image processing chip 5 and the optical engine driving chip 6 are both entity chips arranged on the circuit board 3, and the image processing chip 5 is mainly used for controlling the optical engine 1 to output images, splitting images to be displayed and controlling the optical engine 1 to respectively display the split images. The optical engine driving chip 6 is mainly used for adjusting the light emitting direction of the optical engine 1, the inclination angle of the plane of the optical engine 1 and the focal length of the optical engine 1, and the optical engine driving chip 6 is in communication connection with the first motor 71, the second motor 91 and the focusing motor 10.
In this embodiment, referring to fig. 3 and 4, the image processing chip 5 controls the optical engines 1 to output the spliced calibration images respectively for projection onto the projection screen 8, the camera 2 continuously collects the projected spliced calibration images, the optical engine driving chip 6 analyzes the spliced calibration images collected by the camera 2, the driving component is controlled to adjust an included angle P formed by the light emitting directions of the two optical engines 1, adjacent boundaries (two longitudinal boundaries perpendicular to and opposite to the transverse direction of the projection screen 8) of the two spliced calibration images, when the distance between the adjacent boundaries of the two spliced calibration images is too large, the driving component is controlled to adjust the included angle P formed by the light emitting directions of the two optical engines 1, when the distance between adjacent boundaries of the two spliced calibration images is too small, controlling the driving assembly to enlarge an included angle P formed by the light emitting directions of the two optical machines 1 until the adjacent boundaries of the two spliced calibration images are connected, and judging the relative positions of the two spliced calibration images by the image processing chip 5 based on the two spliced calibration images acquired by the camera 2 (if trapezoidal correction is completed before splicing calibration, analyzing the obtained transverse width proportion, for example, the width proportion of the spliced calibration images respectively output by the two optical machines 1 is 1:1, namely, the two optical machines 1 output images with the same size; if the trapezoid is corrected after the splicing calibration, different monocolor images of the whole screen are projected left and right, the splicing calibration is performed by detecting the colors of the similar areas of the two projected images, then the image processing chip 5 controls the optical machine 1 to output the projected images obtained by respectively dividing the images to be displayed according to the width proportion, so that the two optical machines 1 jointly output the projected images output by the single optical machine 1 in the conventional scheme, the method reduces the scale reduction amplitude of the actual projection picture when the single optical-mechanical system displays the wide-screen image, avoids the problems of large upper and lower black edges and small projection area of the actual display image when the full-screen projection is performed, and improves the integral effect of the effective projection picture of the wide-screen projection system.
Further, in still another embodiment of the wide-screen projection system, the driving assembly includes a first motor 71, a first mounting table 72 and a second mounting table 73, the first motor 71 is in communication connection with the optical engine driving chip 6, the first mounting table 72 and the second mounting table 73 are circular gears, the first mounting table 72 and the second mounting table 73 are axially and rotatably connected to the base 4 in a direction perpendicular to the base 4, two vertical rotating shafts can be penetrated in the middle of the first mounting table 72 and the second mounting table 73, the first mounting table 72 and the second mounting table 73 rotate around the vertical rotating shafts, two optical engines 1 are respectively mounted on one sides of the first mounting table 72 and the second mounting table 73, which faces away from the base 4, the optical engines 1 can synchronously rotate along with the rotation of the first mounting table 72 and the second mounting table 73, the lateral outer edges of the first mounting table 72 and the second mounting table 73 are provided with linkage gear teeth, that is, the first mounting table 72 and the second mounting table 73 are circular gears, the first mounting table 72 and the second mounting table 73 are meshed with the driving gear of the first motor 71, when the two optical engines 1 are in the light output directions, the first motor and the second motor 73 need to be adjusted to drive the first motor 1 to rotate, and the two adjacent optical engines are required to be adjusted to realize the adjustment of the two optical engines, and the two optical engines are adjusted to output the two adjacent optical engines 1, and the two optical engines are adjusted to the drive the optical engines and the 1.
Preferably, the first mounting table 72 and the second mounting table 73 are gear members of the same size and mesh with each other, and the driving gear 711 of the first motor 71 meshes with the first mounting table 72 or the second mounting table 73. That is, the gear teeth of the first mounting table 72 and the second mounting table 73 are meshed and linked, the driving gear 711 of the first motor 71 is only required to be meshed with any one of the first mounting table 72 or the second mounting table 73, so that the first motor 71 drives the first mounting table 72 and the second mounting table 73 to synchronously rotate, the rotation directions of the light emergent directions of the two light machines 1 are opposite and the rotation amplitude is consistent, the problem that a single splicing calibration image moves too fast and too much in the splicing process of the splicing calibration image is difficult to occur, the width ratio of the two splicing calibration images is effectively maintained unchanged, and the method is particularly suitable for the situation of splicing high-precision adjustment of the splicing calibration image of which the width ratio of the splicing calibration images of the two light machines 1 is 1:1, and the splicing efficiency and the splicing precision of adjacent boundaries of the splicing calibration images are improved. Of course, two first motors 71 can be set as required, and the two first motors 71 independently drive the first mounting table 72 and the second mounting table 73 (at this time, the two mounting tables are separated), that is, the projection angles of the two light machines can be independently adjusted, and for some high-precision projection scenes with special requirements, the user needs to independently adjust the projection angles of the two light machines 1, so as to meet the multi-scene projection requirement of the wide-screen projection system.
Optionally, the camera 2 is disposed on an angle bisector of an included angle P formed by the light emitting directions of the two light machines 1, and the wide screen projection system further includes a projection screen 8 (i.e. a projection plane or a projection plane curtain) disposed in the light emitting directions of the two light machines 1, where the lighting direction of the camera 2 is perpendicular to the projection screen 8. The camera 2 is arranged on the angular bisector, the lighting direction of the camera 2 can be parallel or coincident with the angular bisector, and the projection screen 8 of the wide screen projection system is arranged right in front of the camera 2, no shielding exists between the camera 2 and the projection screen 8, so that the light emitting direction of the camera 2 is perpendicular to the projection screen 8, the lateral offset of a projection image on the projection screen 8 collected by the camera 2 can be reduced as much as possible, the accuracy of the splicing calibration image collected by the camera 2 is improved, and the splicing efficiency and the splicing accuracy of adjacent boundaries of the splicing calibration image are further improved. In addition, in the structure in which the projection angles of the two photomechanical apparatuses 1 are independently adjusted, the camera 2 is disposed directly in front of the midpoint between the two photomechanical apparatuses 1.
Further, in another embodiment of the wide-screen projection system, the wide-screen projection system further includes a physical horizontal angle correction, which includes a second motor 91 and a horizontal rotating shaft 92, where the second motor 91 is in communication connection with the optical engine driving chip 6, the horizontal rotating shaft 92 is fixedly connected with the base 4, and the second motor 91 drives the horizontal rotating shaft 92 to rotate so as to drive the base 4 to rotate along with the horizontal rotating shaft 92, and a fixedly connected portion between the horizontal rotating shaft 92 and the base 4 may be a plate-shaped member, which may be fixedly connected with a side of the base 4 away from the optical engine 1, and since there is no rotating space between the base 4 and the plate-shaped member, the plate-shaped member and the base 4 will not move relatively, so that the second motor 91 drives the horizontal rotating shaft 92 to drive the base 4 to rotate more accurately, and the base 4 is placed on an inclined supporting surface where the optical engine 1 is located, or the base 4 itself is not horizontal, or the base 4 is not normally placed, so that the base 4 is inclined, and the light-emitting direction of the optical engine 1 is inclined instead of horizontal. Therefore, after the adjacent boundaries of the calibration pictures are connected, the second motor 91 drives the horizontal rotating shaft 92 to rotate so as to drive the base 4 to rotate, the image processing chip 5 controls the light machine to respectively output horizontal calibration images, the light machine driving chip 6 synchronously analyzes the horizontal calibration images acquired by the camera 2, when the horizontal calibration images are determined to be horizontal, namely, the horizontal rotating shaft 92 is taken as an axis, the plane included angles of the planes of the two light machines 1 are adjusted, the planes of the two light machines 1 are in a horizontal state, and then the second motor 91 is controlled to stop rotating, so that the projection of the light machine 1 is ensured to meet the horizontal requirement. In addition, the wide screen projection system further comprises a gyroscope sensor arranged on the base 4, and the optical machine driving chip 6 controls the horizontal rotating shaft 92 to rotate based on the collected data of the gyroscope sensor so as to adjust the planes of the two optical machines 1 to be in a horizontal state.
Optionally, the horizontal rotating shaft 92 is arranged on one side of the base 4 deviating from the optical machine 1, the axial direction of the horizontal rotating shaft 92 is parallel to the lighting direction of the camera 2, and because the axial direction of the horizontal rotating shaft 92 is consistent with the lighting direction of the camera 2, the axial direction of the horizontal rotating shaft 92 is perpendicular to the projection screen 8, in the rotation process of the horizontal rotating shaft 92, the rotation angle of the two optical machines 1 is ensured to be consistent, the included angle P of the light emitting directions of the two optical machines 1 is ensured to be unchanged, and the side shifting of an effective projection picture is avoided when the integral effect of the effective projection picture of the wide-screen projection system is improved. In addition, the mounting surfaces of the first mounting table 72 and the second mounting table 73 are preferably flat planes, and the two optical machines 1 are located on the same horizontal plane, so that when the horizontal rotating shaft 92 drives the base 4 to rotate, the two optical machines 1 are consistent with the rotating angle, the difficulty in adjusting the optical machines 1 to the horizontal plane is reduced, and the debugging efficiency before effective projection is further improved.
Further, referring to fig. 3 and 4, a reference mark is set on the side of the projection screen 8 facing the camera 2, where the reference mark includes a horizontal reference line, a vertical reference line and a stitching boundary reference line, the horizontal width extension direction of the horizontal calibration image should be parallel to the horizontal reference line, the longitudinal width extension direction of each calibration image (horizontal, stitching and focal length calibration images may be all parallel to the vertical reference line), and the projection stitching line when the adjacent boundaries of two stitching calibration images meet should coincide with the stitching boundary reference line, so that the reference mark may assist the optical machine driving chip 6 in judging whether the stitching calibration images are stitched and whether the plane of the optical machine 1 (i.e. the horizontal calibration image) is in a horizontal plane, compared with the analysis performed by the optical machine driving chip 6 according to the collected image data of the camera 2, the calculation amount is less and the calculation efficiency is higher. The reference line of the splicing boundary is the projection splicing line in the claims and the specification of the application.
Optionally, the wide-screen projection system further includes a focusing motor 10, the adjusting motor is communicatively connected to the optical engine driving chip 6, and the focusing motor 10 is disposed at the lens of the optical engine 1 to adjust the focal length of the optical engine 1. Therefore, after the splicing of the spliced calibration images and the horizontal calibration of the plane where the optical machine 1 is located (the horizontal calibration image is located at the horizontal position), the image processing chip 5 can control the optical machine 1 to respectively project two focal length calibration pictures, and control the respective focusing motors 10 of the two optical machines 1 to respectively perform focal length adjustment on the two optical machines 1, so as to obtain a clear projection effect. Finally, the image processing chip 5 performs proportion cutting on the image to be displayed according to the width proportion of the trapezoidal corrected two projection areas, and then sends the image to each optical machine 1 for projection display.
The application also provides a projection method based on size correction, the screen projection method is applied to a wide screen projection system, the wide screen projection system comprises two light machines and a camera which are arranged on the same base plane, the camera is arranged between the two light machines, and referring to fig. 5, the projection method based on size correction comprises the following steps:
step S10, after a wide screen projection system is started and two light machines perform projection focusing and trapezoidal correction, controlling the two light machines to project and splice calibration images to projection surfaces in the shooting direction of a camera;
The wide screen projection system can comprise two optical machines, a camera, a circuit board and a base, wherein the two optical machines and the camera are arranged on the base and are positioned on the same base plane, the two optical machines are arranged on the base at intervals, a driving assembly for driving the optical machines to rotate so as to adjust the projection angle is arranged on the base, and the camera is arranged on the base between the two optical machines so as to collect various calibration images output by the optical machines. The circuit board is provided with a processor, and the processor comprises an image processing chip and an optical machine driving chip which are in communication connection with each other.
The projection surface can be a curtain or a projection screen arranged on the shooting direction of the camera, the projection surface is preferably perpendicular to the shooting direction of the camera, the shooting direction of the camera can be the light entering direction of the camera, the camera is opposite to the projection surface, the image deformation on the projection surface due to the deflection of the camera is avoided, the image acquired by the camera is not required to be corrected, and the acquisition efficiency and the acquisition precision of the image on the projection surface acquired by the camera are improved.
The calibration image may include a spliced calibration image, a trapezoidal calibration image and a focal length calibration image, the spliced calibration image is used for adjusting an included angle of the light emitting directions of the two photomechanics and the projection angle of the two photomechanics, the trapezoidal calibration image is used for correcting the projection surface of the photomechanics into a rectangular shape, and the focal length calibration image is used for adjusting the focal length of the photomechanics.
When the wide screen projection system is powered on or reset, the light-emitting directions of the two light machines can be controlled by the light machine driving chip to be restored to the preset initial direction, the projection surfaces of the two light machines in the shooting direction of the camera are controlled by the image processing chip, the spliced calibration image is projected, and the color difference of the spliced calibration image relative to two longitudinal boundaries is large, so that boundary identification is facilitated.
Step S20, determining the position relationship of two spliced calibration images based on the acquired images of the spliced calibration images shot by the camera; according to the position relation, the angle of the projection included angle of the two optical machines is adjusted until the two spliced calibration images are spliced seamlessly;
the camera performs dynamic real-time acquisition on the spliced calibration image projected by the camera, and the image processing chip performs boundary recognition and distance analysis on the spliced calibration image acquired dynamically in real time.
Under the condition that trapezoidal correction is finished, two spliced calibration images can be identified relative to two longitudinal boundaries (boundaries parallel to the longitudinal direction), and the distance between the two longitudinal boundaries is calculated through analysis, wherein the distance between the two longitudinal boundaries is larger than 0, the backgrounds of the two spliced calibration images are not overlapped, and the fact that the two spliced calibration images have no overlapping area is indicated; the spacing of the two longitudinal boundaries is less than 0 and the backgrounds of the two stitched calibration images coincide, indicating that there is an overlap region for the two stitched calibration images. The distance between two longitudinal boundaries is equal to the difference value between the horizontal coordinates of the two longitudinal boundaries in the horizontal coordinate axis, specifically, the difference value is equal to the horizontal coordinate of the longitudinal boundary of the spliced calibration image far from the zero point (hereinafter referred to as far coordinate) minus the horizontal coordinate of the longitudinal boundary of the spliced calibration image near to the zero point (hereinafter referred to as near coordinate), wherein the distance is a negative value, which indicates that the relatively near coordinate of the far coordinate is closer to the horizontal coordinate axis zero point, and further, the existence of an overlapping region of the two spliced calibration images is determined.
Under the condition that trapezoid correction is not carried out, the projection background (namely the projection surface or the projection screen) is white, one optical machine projects the cyan (cyan splicing calibration image) preset by the whole screen, the other optical machine projects the yellow (yellow splicing calibration image) preset by the whole screen, then the camera acquires the projection image, and if the green color with the preset value similar to the preset value is identified in the middle area of the acquired image, the intersection is judged.
If there is no overlapping area between the two stitched calibration images and there is an area not belonging to the two calibration images, the positional relationship is separated. For example, when the projection background is white, one optical machine projects the preset cyan of the whole screen, the other optical machine projects the preset yellow of the whole screen, then the camera collects the projection image, and if the middle area of the collected image recognizes the non-green color, the position relationship is separated. If no intersection or separation occurs, the two projections are tangential at this time.
Step S30, after the two spliced calibration images are spliced seamlessly, keeping the two spliced calibration images spliced seamlessly, and performing trapezoidal correction on the two spliced calibration images respectively until the two spliced calibration images are rectangular;
After determining that the spliced calibration images projected by the two light machines are overlapped relative to the longitudinal boundary, the light machine driving chip can control the two light machines to output at least one frame of the image to be displayed to the projection surface, and trapezoidal correction is carried out on the two light machines respectively. Optionally, before the light machine performs trapezoidal correction, the image processing chip performs trapezoidal correction on the light machine a with a smaller projected frame to obtain a smaller trapezoidal correction image, uses a longitudinal boundary of the smaller trapezoidal correction image close to the side of the other light machine as a symmetry axis, obtains a symmetrical mapping area of the smaller trapezoidal correction image mapped by the symmetry axis, performs trapezoidal correction on the larger frame projected by the light machine B according to rectangular vertex coordinates of the symmetrical mapping area, thereby obtaining another trapezoidal correction image with the same size as the smaller trapezoidal correction image, and performs seamless splicing of the two trapezoidal correction images because the two light machines have completed splicing correction before, so as to control the two light machines to gradually project all image frames of the image to be displayed to the projection plane. The image to be displayed is formal content which is projected by a user through a wide-screen projection system, such as PPT, a movie, a television program and the like which are required to be displayed by the user.
Step S40, after trapezoidal correction is completed on the two spliced calibration images, carrying out projection size correction on the rectangular spliced calibration images until the sizes of the left spliced calibration image and the right spliced calibration image are consistent, and keeping seamless splicing of the two spliced calibration images in the process;
the size correction operation of the spliced calibration image is divided into two steps of longitudinal alignment and transverse alignment, and the size correction of the spliced calibration image is used for enabling the sizes of the projection image display pictures of the left optical machine and the right optical machine to be equal; the size correction of the two stitched calibration images includes a longitudinal alignment correction and a lateral alignment correction. In the size correction process of the two spliced calibration images, the projection included angle of the optical machine is unchanged, so that the two spliced calibration images are ensured to be spliced seamlessly all the time in the size correction process.
Step S50, after the two spliced calibration images are corrected in projection size, controlling the two optical machines to project images to be displayed on a projection surface respectively, wherein the two images to be displayed are obtained by cutting an original image; the final two projection images synthesize the original image.
As shown in fig. 7, the original image is an image of the left complete M in fig. 7, the original image is subjected to image splitting to obtain two images to be displayed (e.g., two split M sub-images in the middle of fig. 7), two light machines of the projection system respectively project the two images to be displayed, and finally the projected images of the two light machines are combined into the original image (e.g., an image of the right complete M in fig. 7) for displaying on a projection surface.
In the embodiment, the wide screen projection is realized by arranging two optical machines, after the two optical machines are controlled to respectively perform projection focusing and trapezoid correction, the spliced calibration image is projected to a projection surface, and based on the position relation of the spliced calibration image dynamically acquired by a camera, the projection included angle of the two optical machines is adjusted according to the position relation until the two spliced calibration images are spliced seamlessly; after the splicing operation is completed, performing trapezoidal correction and projection size correction on the two spliced calibration images respectively; finally, the two light machines are controlled to project the image to be displayed on the projection surface, the image to be displayed is cut to form a left image A to be displayed and a right image B to be displayed as shown in fig. 7, and then the left image and the right image are respectively and simultaneously displayed by the two light machines, so that the two light machines jointly output the projection picture output by the single light machine in the conventional scheme, the amplitude of the equal proportion reduction of the actual projection picture when the single light machine system displays the wide-screen image is reduced, the problems that the upper black side and the lower black side are large and the projection area of the actual display image is small during full-screen projection are avoided, and the integral effect of the effective projection picture of the wide-screen projection system is improved.
Further, in another embodiment of the size correction-based projection method of the present application, the determining the positional relationship between the two stitched calibration images based on the acquired images of the stitched calibration images captured by the camera in step S20 includes:
Step A1, performing feature analysis on collected images of spliced calibration images shot by a camera, and detecting whether an overlapping area exists between the two spliced calibration images;
a2, if the two spliced calibration images have an overlapping area, the position relationship is intersected; if the two spliced calibration images do not have an overlapping area and the two spliced calibration images have areas which do not belong to the two calibration images, the position relationship is separated; if the intersection or separation phenomenon does not occur, judging that the two spliced calibration images are tangent.
For example, when the projection background is white, one optical machine projects a preset cyan color of the whole screen (one spliced calibration image is cyan), the other optical machine projects a preset yellow color of the whole screen (one spliced calibration image is yellow), then the camera collects the projection image, and if a green color with a preset value being similar is identified in the middle area (two spliced calibration image similar parts) of the collected image, the intersection is judged.
For example, when the projection background is white, one optical machine projects a preset cyan color of the whole screen (one spliced calibration image is cyan), the other optical machine projects a preset yellow color of the whole screen (one spliced calibration image is yellow), then the camera collects the projection image, and if a non-green color is identified in the middle area (the similar parts of the two spliced calibration images) of the collected image, the position relationship is separated.
The analysis mode that the distance between the two longitudinal boundaries is equal to the difference value between the two longitudinal boundaries and the abscissa of the transverse coordinate axis is carried out on the spliced calibration images, whether the two spliced calibration images have an overlapping area or not can be judged more conveniently, and then the two spliced calibration images have the overlapping area, the position relationship is judged to be intersected, the two spliced calibration images have no overlapping area, the difference value is not 0, and the position relationship is judged to be separated.
In step S20, according to the position relationship, the angle of the projection included angle of the two optical machines is adjusted until the seamless splicing of the two spliced calibration images includes:
step B1, if the position relation is separated, reducing the projection included angle of the two optical machines; if the position relationship is intersecting, the projection included angle of the two optical machines is increased; if the position relationship is tangential, judging that the spliced calibration image coincides with the two longitudinal boundaries;
step B2, judging whether the two longitudinal boundaries of the spliced calibration image are coincident or not based on an edge recognition algorithm in the process of adjusting the included angle; and if the two longitudinal boundaries are coincident, judging that the two spliced calibration images are spliced seamlessly, and stopping the rotation of the two optical machines.
In general, most of the two spliced calibration images are in a separated state, even if the two spliced calibration images are in an intersecting state, the intersecting state of the two spliced calibration images can be rapidly judged through image analysis, and the colors of the two spliced calibration images are generally different, for example, one red and one blue. .
Therefore, when the two spliced calibration images are in a separated state, the larger the distance between the two spliced calibration images relative to the two longitudinal boundaries is, the larger the included angle formed by the light emitting directions of the two optical machines is, the smaller the included angle is needed to be adjusted, and when the position relationship is judged to be separated, the angle of the projection included angle of the two optical machines is adjusted, and at least one optical machine is adjusted to rotate towards the direction close to the camera so as to adjust the projection angle of the at least one optical machine, wherein the distance is positively related to the adjustment speed of the projection angle of the optical machine, namely, when the distance is larger, the included angle formed by the light emitting directions of the two optical machines is larger, and the projection angle of the optical machines is adjusted at a larger rotation speed. In the process of continuously adjusting the projection angle of the optical machine, the processor continuously detects the distance between the two spliced calibration images relative to the two longitudinal boundaries based on the camera, and when the distance is 0, the processor indicates that the two spliced calibration images are overlapped relative to the two longitudinal boundaries (namely, the two longitudinal boundaries are spliced seamlessly at the reference line of the spliced boundary), and the projection angle of the optical machine is adjusted.
Further, in still another embodiment of the size correction-based projection method of the present application, referring to fig. 6, the step of performing projection size correction on the rectangular stitched calibration image in step S40 includes:
step S41, longitudinally aligning two rectangular spliced calibration images, and adjusting the longitudinal width of the two rectangular spliced calibration images until the two transverse boundaries of the two spliced calibration images are aligned and parallel;
the longitudinal alignment process mainly comprises the following steps: the projection plane is divided into two transverse areas by the vertical bisector of the projection stitching line of the two stitching calibration images, and the stitching calibration image point far away from the vertical bisector in each transverse area moves to the plane where the transverse boundary of the stitching calibration image is located near to the vertical bisector on the same side until the transverse boundary end points of the two stitching calibration images in each transverse area overlap.
Step S42, transversely aligning two splicing calibration images of the rectangles, and adjusting the transverse length of the splicing calibration images of the two rectangles until the two longitudinal boundary distances of the two splicing calibration images are equal to the projection splicing line distance, wherein the projection splicing line is a splicing line of the two splicing calibration images after seamless splicing.
The transverse alignment process mainly comprises the following steps: the projection stitching line of the two stitching calibration images is taken as a central line, the two stitching calibration images are respectively provided with a correction longitudinal edge which is parallel to the central line but not overlapped with the central line, and the correction longitudinal edge which is far away from the central line is translated in the direction close to the central line until the distances from the two correction longitudinal edges to the central line are equal.
In this embodiment, the two rectangular spliced calibration images after trapezoidal correction are sequentially or simultaneously aligned longitudinally and transversely, the longitudinal alignment and the transverse alignment are not sequential, and the longitudinal alignment aligns and parallels the two transverse boundaries of the two spliced calibration images, that is, the longitudinal widths of the two spliced calibration images are equal; the longitudinal boundary distance projection stitching line distance of the two stitching calibration images is adjusted to be equal by transverse alignment, namely the transverse lengths of the two stitching calibration images are equal; thereby accomplish the size correction of two concatenation calibration images, two concatenation calibration image sizes after the size correction are equal to two ray apparatus of wide screen projection system are to the seamless concatenation of projection plane projection, rectangle and the equal effective image picture of size, promote wide screen projection system's effective projection picture wholeness effect, improved wide screen projection system's sight shadow effect.
Further, in a preferred embodiment of the size correction based projection method of the present application,
step S41 includes: dividing the two rectangular spliced calibration images into two transverse areas by taking the perpendicular bisector of the projection splicing lines of the two spliced calibration images as a dividing line; and determining a lateral boundary, which is closer to the perpendicular bisector, in the two lateral regions based on the camera, and taking the closer lateral boundary in the two lateral regions as a reference, and approaching the farther lateral boundary in the two lateral regions to the closer lateral boundary until the two lateral boundaries of the two spliced calibration images are aligned and parallel.
In the longitudinal alignment process, a projection plane is divided into two transverse areas by a projection stitching line perpendicular bisector of the two stitching calibration images, and a stitching calibration image point far away from the perpendicular bisector in each transverse area moves to the plane where a stitching calibration image transverse boundary close to the perpendicular bisector is located on the same side, so that the situation that the far transverse boundary in the two transverse areas approaches to the near transverse boundary is achieved, and the transverse boundary end points of the two stitching calibration images in each transverse area overlap.
Specifically, in the longitudinal alignment process, a point far from the perpendicular bisector is moved to another point on the same side with the perpendicular bisector of the projection stitching lines of the two stitching calibration images as a reference until overlapping. As shown in fig. 8, since L1 is greater than L2, the upper edge (i.e., upper lateral boundary) of the left projected stitched calibration image needs to be translated downward until L1 is equal to L2; since L3 is smaller than L4, the lower edge (lower lateral boundary) of the right projected stitched calibration image needs to be translated upward until L4 is equal to L3.
Step S42 includes: taking projection stitching lines of the two stitching calibration images as central lines, and dividing the two rectangular stitching calibration images into two longitudinal areas; and determining a longitudinal boundary which is closer to the central line and does not coincide with the central line in the two longitudinal regions based on the camera, and taking the closer longitudinal boundary in the two longitudinal regions as a reference, and approaching the farther longitudinal boundary in the two longitudinal regions to the central line until the distances between the two longitudinal boundaries of the two spliced calibration images and the central line are equal.
In the transverse alignment process, the projection stitching line (i.e. the stitching boundary reference line in fig. 4) of the two stitching calibration images is taken as a central line, and each of the two stitching calibration images has a correction longitudinal edge (i.e. the longitudinal boundary) parallel to the central line but not overlapped with the central line, and the correction longitudinal edge which is far away from the central line translates in the direction close to the central line until the distances from the two correction longitudinal edges to the central line are equal.
Specifically, in the transverse alignment process, the projection stitching lines of the two stitching calibration images are taken as central lines, and the two projection planes are provided with correction longitudinal edges which are parallel to the central lines but not overlapped with the central lines. A correction longitudinal edge which is farther from the central line needs to translate towards the central line until the distance of the correction longitudinal edge is equal to that of the other correction longitudinal edge; as with the lateral pair Ji Suoshi of fig. 9, since L5 is greater than L6, the longitudinal left edge of the left projected stitched calibration image needs to be translated to the right until L5 is equal to L6.
In addition, the two stitched calibration images can only be continuously reduced in size during the lateral alignment or the longitudinal alignment. That is, during the longitudinal alignment (step S41), in the same lateral region, the lateral boundary farther from the perpendicular bisector of the projection splice line is closer to the closer lateral boundary, and the closer lateral boundary does not move; during the lateral alignment (step S42), the longitudinal boundary farther from the centerline translates toward the centerline, keeping the position of the longitudinal boundary nearer to the centerline unchanged; therefore, the sizes of the two spliced calibration images are not enlarged any more, the trapezoidal correction effect of the spliced calibration images is not affected, the spliced calibration images are not changed into trapezoids at the moment, and the effectiveness of trapezoidal correction is ensured. In the trapezoid calibration and size correction processes, the shape change of the spliced calibration image is generally the adjustment of the positions and the sizes of the non-black effective projection area and the black dark display area in the projection area of the optical machine, and is generally not the adjustment of the physical and optical display of the optical machine.
In the embodiment, a size correction mode which is convenient to realize and does not occupy computer resources is provided, the specific processes of transverse alignment and longitudinal alignment are described, and the efficient and accurate size correction of two spliced calibration images after trapezoidal correction is realized.
Optionally, the wide screen projection system further comprises a focusing motor, wherein the focusing motor is arranged at the lens of the optical machine; the projection method based on the size correction further comprises the following steps:
step C, before the two light machines of the wide screen projection system carry out projection focusing, controlling the two light machines to project a focal length calibration image to the projection surface; and controlling a focusing motor to adjust the focal lengths of the two optical machines based on the definition of the focal length calibration image dynamically acquired by the camera until the definition reaches a preset definition threshold.
Before the optical machine carries out splicing calibration, an optical machine focal length calibration flow is set, at this time, the image processing chip controls the two optical machines to project focal length calibration images to the projection plane, and controls the focusing motor to adjust focal lengths of the two optical machines, and compares the definition of the focal length calibration images acquired in real time through the camera with a budget definition threshold, when the definition of the focal length calibration images reaches a preset definition threshold, the focal length adjustment of the two optical machines is finished, the optical machines can project clear projection pictures, the splicing calibration images and the definition of the horizontal calibration images of the subsequent projection of the optical machines are guaranteed, the camera is favorable for acquiring high-definition calibration images, the accurate analysis of the splicing calibration images and the horizontal calibration images is favorable, and the accuracy and the efficiency of image calibration are improved.
Further, in still another embodiment of the size correction-based projection method of the present application, the wide screen projection method further includes:
step D1, when the power-on of the optical machine is detected, if a command for canceling the wide screen projection is detected, detecting the current projection brightness requirement of the wide screen projection system;
under certain scene demands, a user does not need a wide screen projection system to carry out wide screen projection, the user can input a wide screen projection canceling instruction to the wide screen projection system, for example, the user needs to project square note content or document content by using the wide screen projection system, and the user can carry out small screen display and view without needing a wide screen cinema effect.
Step D2, if the current projection brightness requirement is greater than or equal to a preset brightness threshold, controlling two photomechanical machines to project a spliced calibration image to an area at the position of the projection surface, which is perpendicular to the shooting direction of the camera, until the two spliced calibration images completely coincide;
if the current projection brightness requirement is greater than or equal to a preset brightness threshold value, which indicates that the current ambient light of the user is brighter and brightness display needs to be enhanced, the two light machines are controlled to project the spliced calibration images to the area where the shooting direction of the camera is vertical to the projection surface until the two spliced calibration images are completely overlapped, and the brightness of the projection pictures of the two light machines are enhanced mutually to highlight the image to be displayed.
In addition, if the current projection brightness requirement is smaller than the preset brightness threshold, one optical machine is turned off, and only a single optical machine is used for projection, so that the brightness requirement of a user for projecting an image to be displayed is met, and the electric energy consumed by one optical machine is saved.
And D3, performing trapezoidal correction on the two optical machines, and controlling the two optical machines to project the same image to be displayed to the projection surface.
Specifically, the performing the trapezoidal correction on the two optical machines and controlling the two optical machines to project the same image to be displayed onto the projection surface (step S30 and step D3) may include,
performing trapezoidal correction on the two light machines to obtain the width proportion of the trapezoidal corrected images of the projection areas of the two light machines; dividing and cutting the image to be displayed based on the width proportion to obtain sub-images, and distributing the sub-images to respective optical machines for projection display.
In an embodiment of the present application, because the two light machines project to the horizontal or vertical direction of the projection image of the projection surface, the sizes of the projection images of the two light machines are different, so that the image processing chip performs trapezoidal correction on the two light machines, and the sizes of the images after trapezoidal correction in the projection areas of the two light machines may be different, so that the trapezoidal correction and the size correction of the projection surface are required after the splicing is completed, seamless splicing and wide screen display of the images to be displayed after the trapezoidal correction are realized, the scaling-down processing of the trapezoidal correction is carried out by the projection images of the two light machines together under the influence of equal proportion scaling, so that the scaling-down amplitude of the actual projection image is greatly reduced, the problems of large upper and lower black edges of the projection and small projection area of the actual display image are avoided, and the integral effect of the effective projection image of the wide screen projection system is improved.
In addition, after the detection light machine projects the image to be displayed on the projection surface, the wide screen projection method further comprises the following steps: detecting the similarity between images to be displayed projected by the optical machine, and counting the duration time when the similarity is greater than or equal to a preset similarity threshold value; if the duration time is longer than the preset unit time, the wide screen projection system outputs a prompt of whether to shut down, and if the user does not respond after outputting the prompt of whether to shut down, the optical engine is automatically shut down; if a shutdown instruction or a non-shutdown instruction is received, the method is executed according to the user instruction; and if the similarity is smaller than the preset similarity threshold, resetting the duration time when the current statistical similarity is larger than or equal to the preset similarity threshold to reckon.
Therefore, when the light machine projects the basically same image for a long time, the statistics of the duration of the basically same image is started, when the duration is longer than the preset unit duration, the user is indicated to be possibly asleep or busy with other matters in the process of watching the light machine projection, at the moment, in order to save electric energy and prolong the service life of the light machine, the wide screen projection system outputs a prompt of whether to shut down or not, and a shutdown instruction or automatic shutdown can be further executed.
In order to achieve the above object, the present application further provides a wide-screen projection system, where the wide-screen projection system includes two optical machines disposed on the same plane, a camera, a memory, a processor, and a computer program stored in the memory and capable of running on the processor, where the camera is disposed between the two optical machines, and where the computer program when executed by the processor implements the steps of the size correction-based projection method described above.
In order to achieve the above object, the present application further provides a readable storage medium having a computer program stored thereon, which when executed by a processor, implements the steps of the above-described size correction-based projection method.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, the element defined by the phrase "comprising one … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element, and furthermore, elements having the same name in different embodiments of the application may have the same meaning or may have different meanings, the particular meaning of which is to be determined by its interpretation in this particular embodiment or by further combining the context of this particular embodiment.
It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, these information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope herein. The word "if" as used herein may be interpreted as "at … …" or "at … …" or "responsive to a determination", depending on the context. Furthermore, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It will be further understood that the terms "comprises," "comprising," "includes," and/or "including" specify the presence of stated features, steps, operations, elements, components, items, categories, and/or groups, but do not preclude the presence, presence or addition of one or more other features, steps, operations, elements, components, items, categories, and/or groups. The terms "or" and/or "as used herein are to be construed as inclusive, or meaning any one or any combination. Thus, "A, B or C" or "A, B and/or C" means "any of the following: a, A is as follows; b, a step of preparing a composite material; c, performing operation; a and B; a and C; b and C; A. b and C). An exception to this definition will occur only when a combination of elements, functions, steps or operations are in some way inherently mutually exclusive.
It should be understood that, although the steps in the flowcharts in the embodiments of the present application are shown in order as indicated by the arrows, these steps are not necessarily performed in order as indicated by the arrows. The steps are not strictly limited in order and may be performed in other orders, unless explicitly stated herein. Moreover, at least some of the steps in the figures may include multiple sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, the order of their execution not necessarily occurring in sequence, but may be performed alternately or alternately with other steps or at least a portion of the other steps or stages.
It should be noted that, in this document, step numbers such as S10 and S20 are adopted, and the purpose of the present application is to more clearly and briefly describe the corresponding content, and not to constitute a substantial limitation on the sequence, and those skilled in the art may execute S20 first and then execute S10 when implementing the present application, which is within the scope of protection of the present application.
The foregoing embodiment numbers of the present application are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present application.
The embodiments of the present application have been described above with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those having ordinary skill in the art without departing from the spirit of the present application and the scope of the claims, which are to be protected by the present application.

Claims (8)

1. The projection method based on the size correction is characterized in that the projection method is applied to a wide screen projection system, the wide screen projection system comprises two light machines and a camera which are arranged on the same base plane, the camera is arranged between the two light machines, a driving component for driving the light machines to rotate is arranged on the base, the driving component comprises a first motor, a first mounting table and a second mounting table, the two light machines are respectively arranged on one sides of the first mounting table and the second mounting table, which are away from the base, the light machines can synchronously rotate along with the rotation of the first mounting table and the second mounting table, the first mounting table and the second mounting table are meshed with a driving gear of the first motor, and when the light emitting direction of the light machines needs to be adjusted, the first motor controls the driving gear to drive the first mounting table and the second mounting table to rotate, so that the light emitting directions of the two light machines are adjusted, and the adjacent boundaries of two spliced calibration images output by the light machines are controlled to be connected;
the projection method comprises the following steps:
after the wide screen projection system is started and the two light machines perform projection focusing and trapezoidal correction, controlling the two light machines to project the projection surfaces in the shooting direction of the camera, and respectively projecting and splicing calibration images;
Based on the collected images of the spliced calibration images shot by the cameras, determining the position relationship of the two spliced calibration images; according to the position relation, the angle of the projection included angle of the two optical machines is adjusted until the two spliced calibration images are spliced seamlessly;
after the two spliced calibration images are spliced seamlessly, keeping the two spliced calibration images spliced seamlessly, and performing trapezoidal correction on the two spliced calibration images respectively until the two spliced calibration images are rectangular;
after the trapezoidal correction of the two spliced calibration images is completed, the two spliced calibration images of the rectangles are longitudinally aligned, and the longitudinal widths of the spliced calibration images of the two rectangles are adjusted until the two transverse boundaries of the two spliced calibration images are aligned and parallel; transversely aligning two rectangular spliced calibration images, and adjusting the transverse length of the spliced calibration images of the two rectangles until the distance between two longitudinal boundary distances of the two spliced calibration images and a projection splicing line are equal, wherein the projection splicing line is a splicing line formed by seamlessly splicing the two spliced calibration images until the sizes of the left spliced calibration image and the right spliced calibration image are consistent, and keeping the seamless splicing of the two spliced calibration images in the process;
After the two spliced calibration images are subjected to projection size correction, controlling the two optical machines to project images to be displayed to a projection surface, wherein the two images to be displayed are obtained by cutting an original image; finally, synthesizing the two projection images into an original image;
the step of determining the position relationship of the two spliced calibration images based on the acquired images of the spliced calibration images shot by the camera comprises the following steps:
performing feature analysis on the acquired images of the spliced calibration images shot by the cameras, and detecting whether an overlapping area exists between the two spliced calibration images;
if the projection background is white, one spliced calibration image is cyan, one spliced calibration image is yellow, and if the middle area of the projection image acquired by the camera is identified as green, the two spliced calibration images are judged to have an overlapping area, and the position relationship is intersected;
if the two spliced calibration images do not have an overlapping area, the position relationship is separated;
if no intersection or separation phenomenon occurs, judging that the two spliced calibration images are tangent;
according to the position relation, the projection included angle of the two optical machines is adjusted until the two spliced calibration images are spliced seamlessly, wherein the step of splicing comprises the following steps:
If the position relationship is separated, the projection included angle of the two optical machines is reduced; if the position relationship is intersecting, the projection included angle of the two optical machines is increased; if the position relationship is tangential, judging that the spliced calibration image coincides with the two longitudinal boundaries;
in the process of adjusting the included angle, judging whether the two longitudinal boundaries of the spliced calibration image are coincident or not based on an edge recognition algorithm; and if the two longitudinal boundaries are coincident, judging that the two spliced calibration images are spliced seamlessly, and stopping the rotation of the two optical machines.
2. The size correction-based projection method of claim 1, wherein the step of adjusting the longitudinal widths of the two rectangular stitched calibration images until the two lateral boundaries of the two stitched calibration images are aligned and parallel comprises:
dividing the two rectangular spliced calibration images into two transverse areas by taking the perpendicular bisector of the projection splicing lines of the two spliced calibration images as a dividing line;
and determining a lateral boundary, which is closer to the perpendicular bisector, in the two lateral regions based on the camera, and taking the closer lateral boundary in the two lateral regions as a reference, and approaching the farther lateral boundary in the two lateral regions to the closer lateral boundary until the two lateral boundaries of the two spliced calibration images are aligned and parallel.
3. The size correction-based projection method according to claim 1 or 2, wherein the step of adjusting the lateral lengths of the two rectangular stitched calibration images until the two longitudinal boundary distances of the two stitched calibration images are equal to the projected stitching line distance, comprises:
taking projection stitching lines of the two stitching calibration images as central lines, and dividing the two rectangular stitching calibration images into two longitudinal areas;
and determining a longitudinal boundary which is closer to the central line and does not coincide with the central line in the two longitudinal regions based on the camera, and taking the closer longitudinal boundary in the two longitudinal regions as a reference, and approaching the farther longitudinal boundary in the two longitudinal regions to the central line until the distances between the two longitudinal boundaries of the two spliced calibration images and the central line are equal.
4. The size correction-based projection method of claim 1, wherein the wide screen projection system further comprises a focus motor disposed at a lens of the light engine; the projection method based on the size correction further comprises the following steps:
before the two light machines of the wide screen projection system carry out projection focusing, controlling the two light machines to project a focal length calibration image to the projection surface;
And controlling a focusing motor to adjust the focal lengths of the two optical machines based on the definition of the focal length calibration image dynamically acquired by the camera until the definition reaches a preset definition threshold.
5. The size correction-based projection method of claim 4, wherein the wide screen projection method further comprises:
when the power-on of the optical machine is detected, if a command for canceling the wide screen projection is detected, detecting the current projection brightness requirement of the wide screen projection system;
if the current projection brightness requirement is greater than or equal to a preset brightness threshold, controlling the two photomechanics to project a spliced calibration image to an area where the shooting direction of the camera is vertical to the projection surface until the two spliced calibration images are completely overlapped;
and performing trapezoidal correction on the two light machines, and controlling the two light machines to project the same image to be displayed to the projection surface.
6. The size correction-based projection method of claim 5, wherein the wide screen projection method further comprises:
after the detection light machine projects the images to be displayed on the projection surface, detecting the similarity between the images to be displayed projected by the light machine, and counting the duration time when the similarity is greater than or equal to a preset similarity threshold value;
If the duration time is longer than the preset unit time, the wide screen projection system outputs a prompt of whether to shut down, and if the user does not respond after outputting the prompt of whether to shut down, the optical engine is automatically shut down;
if a shutdown instruction or a non-shutdown instruction is received, the method is executed according to the user instruction;
and if the similarity is smaller than the preset similarity threshold, resetting the duration time when the current statistical similarity is larger than or equal to the preset similarity threshold to reckon.
7. A wide screen projection system comprising two light engines and a camera arranged in the same plane, a memory, a processor and a computer program stored on the memory and executable on the processor, the camera being arranged between the two light engines, the computer program when executed by the processor implementing the steps of the size correction based projection method according to any of the preceding claims 1 to 6.
8. A readable storage medium, characterized in that the readable storage medium has stored thereon a computer program which, when executed by a processor, implements the steps of the size correction based projection method according to any of claims 1 to 6.
CN202011402175.7A 2020-12-02 2020-12-02 Projection method, system and readable storage medium based on size correction Active CN112584112B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011402175.7A CN112584112B (en) 2020-12-02 2020-12-02 Projection method, system and readable storage medium based on size correction

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011402175.7A CN112584112B (en) 2020-12-02 2020-12-02 Projection method, system and readable storage medium based on size correction

Publications (2)

Publication Number Publication Date
CN112584112A CN112584112A (en) 2021-03-30
CN112584112B true CN112584112B (en) 2023-10-03

Family

ID=75127067

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011402175.7A Active CN112584112B (en) 2020-12-02 2020-12-02 Projection method, system and readable storage medium based on size correction

Country Status (1)

Country Link
CN (1) CN112584112B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113740035A (en) * 2021-08-26 2021-12-03 歌尔光学科技有限公司 Projection quality detection method, device, equipment and readable storage medium

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU3271884A (en) * 1983-09-06 1985-03-14 Sony Corporation Colour television projector
CN1257214A (en) * 1998-12-14 2000-06-21 三星电子株式会社 Large size image projector
JP2005286574A (en) * 2004-03-29 2005-10-13 Seiko Epson Corp Image processing system, projector, program, information storage medium, and image processing method
JP2007181146A (en) * 2005-12-28 2007-07-12 Casio Comput Co Ltd Image projector, method and program for compensating projected image of image projector
JP2008251026A (en) * 2003-07-02 2008-10-16 Seiko Epson Corp Image processing system, projector, program, information storage medium, and image processing method
JP2008306644A (en) * 2007-06-11 2008-12-18 Seiko Epson Corp Image process for projector
JP2010273289A (en) * 2009-05-25 2010-12-02 Seiko Epson Corp Electronic information board system, computer terminal, and calibration method
CN104036475A (en) * 2013-07-22 2014-09-10 成都智慧星球科技有限公司 High-robustness geometric correction method adapted to random projector group and projection screen
WO2018010275A1 (en) * 2016-07-11 2018-01-18 中兴通讯股份有限公司 Projection device
CN108462860A (en) * 2017-02-22 2018-08-28 中兴通讯股份有限公司 A kind of method and projection arrangement for realizing projection process
CN109257583A (en) * 2018-11-23 2019-01-22 四川长虹电器股份有限公司 The seamless joint method and system of projection device image
CN109752907A (en) * 2019-03-22 2019-05-14 深圳市当智科技有限公司 A kind of projection light machine automatically configures the system and method for optimization white balance
CN109951692A (en) * 2019-04-19 2019-06-28 深圳市当智科技有限公司 The automatic trapezoidal distortion correction method of projector is realized based on camera and ray machine optical path angle
CN111083457A (en) * 2019-12-27 2020-04-28 成都极米科技股份有限公司 Method and device for correcting projection images of multiple light machines and projection instrument of multiple light machines

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015026992A (en) * 2013-07-26 2015-02-05 株式会社リコー Projection system, image processing device, projection method, and program
JP6554873B2 (en) * 2015-03-31 2019-08-07 株式会社リコー Projection system, image processing apparatus, calibration method, and program
JP2016224172A (en) * 2015-05-28 2016-12-28 株式会社リコー Projection system, image processing device, calibration method and program
TWI586173B (en) * 2016-07-14 2017-06-01 張修誠 Projection System and Calibration Method of Projected Image

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU3271884A (en) * 1983-09-06 1985-03-14 Sony Corporation Colour television projector
CN1257214A (en) * 1998-12-14 2000-06-21 三星电子株式会社 Large size image projector
JP2008251026A (en) * 2003-07-02 2008-10-16 Seiko Epson Corp Image processing system, projector, program, information storage medium, and image processing method
JP2005286574A (en) * 2004-03-29 2005-10-13 Seiko Epson Corp Image processing system, projector, program, information storage medium, and image processing method
JP2007181146A (en) * 2005-12-28 2007-07-12 Casio Comput Co Ltd Image projector, method and program for compensating projected image of image projector
JP2008306644A (en) * 2007-06-11 2008-12-18 Seiko Epson Corp Image process for projector
JP2010273289A (en) * 2009-05-25 2010-12-02 Seiko Epson Corp Electronic information board system, computer terminal, and calibration method
CN104036475A (en) * 2013-07-22 2014-09-10 成都智慧星球科技有限公司 High-robustness geometric correction method adapted to random projector group and projection screen
WO2018010275A1 (en) * 2016-07-11 2018-01-18 中兴通讯股份有限公司 Projection device
CN108462860A (en) * 2017-02-22 2018-08-28 中兴通讯股份有限公司 A kind of method and projection arrangement for realizing projection process
CN109257583A (en) * 2018-11-23 2019-01-22 四川长虹电器股份有限公司 The seamless joint method and system of projection device image
CN109752907A (en) * 2019-03-22 2019-05-14 深圳市当智科技有限公司 A kind of projection light machine automatically configures the system and method for optimization white balance
CN109951692A (en) * 2019-04-19 2019-06-28 深圳市当智科技有限公司 The automatic trapezoidal distortion correction method of projector is realized based on camera and ray machine optical path angle
CN111083457A (en) * 2019-12-27 2020-04-28 成都极米科技股份有限公司 Method and device for correcting projection images of multiple light machines and projection instrument of multiple light machines

Also Published As

Publication number Publication date
CN112584112A (en) 2021-03-30

Similar Documents

Publication Publication Date Title
CN113163186B (en) Projection method, system and storage medium based on horizontal correction of distance sensor
CN112584113B (en) Wide-screen projection method and system based on mapping correction and readable storage medium
US8272746B2 (en) Projection display apparatus and display method
CN107071376B (en) A kind of projection tiled display bearing calibration and device
US8251524B2 (en) Projection display apparatus and display method
CN1204754C (en) Multi-projector mosaic with automatic registration
US8727539B2 (en) Projector and method of controlling projector
CN103618881A (en) Multi-lens panoramic stitching control method and multi-lens panoramic stitching control device
CN112272292B (en) Projection correction method, apparatus and storage medium
US20170264871A1 (en) Projecting device
JP2010141836A (en) Obstacle detecting apparatus
CN107358577A (en) A kind of quick joining method of cubic panorama
CN113141492B (en) Wide-screen projection method and system based on camera and readable storage medium
CN111988591A (en) Projection picture translation method and device and projection equipment
CN112584112B (en) Projection method, system and readable storage medium based on size correction
CN113141491B (en) Projection method, system and storage medium based on monochromatic light reference line emitter
CN202886820U (en) Spherical-display-based multi-projector superimposed system
CN108718404B (en) Image correction method and image correction system
CN114760451B (en) Projection image correction prompting method, projection image correction prompting device, projection equipment and storage medium
CN112104852B (en) Operation guiding method and system based on wide screen splicing and readable storage medium
CN116055696A (en) Projection equipment and projection method
JP2011199717A (en) Projection type display device and image display method
CN112040210B (en) Wide screen projection system, method, apparatus and readable storage medium
CN115734086A (en) Image processing method, device and system based on off-screen shooting and storage medium
CN114827555B (en) Display system for displaying surrounding image and operation method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant