CN115150597A - Projection display method and device and projection equipment - Google Patents

Projection display method and device and projection equipment Download PDF

Info

Publication number
CN115150597A
CN115150597A CN202110352763.2A CN202110352763A CN115150597A CN 115150597 A CN115150597 A CN 115150597A CN 202110352763 A CN202110352763 A CN 202110352763A CN 115150597 A CN115150597 A CN 115150597A
Authority
CN
China
Prior art keywords
coordinate
projection
zooming
projection picture
determining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110352763.2A
Other languages
Chinese (zh)
Other versions
CN115150597B (en
Inventor
张立造
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chengdu Jimi Technology Co Ltd
Original Assignee
Chengdu Jimi Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chengdu Jimi Technology Co Ltd filed Critical Chengdu Jimi Technology Co Ltd
Priority to CN202110352763.2A priority Critical patent/CN115150597B/en
Priority to PCT/CN2021/120700 priority patent/WO2022205812A1/en
Publication of CN115150597A publication Critical patent/CN115150597A/en
Application granted granted Critical
Publication of CN115150597B publication Critical patent/CN115150597B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179Video signal processing therefor
    • H04N9/3185Geometric adjustment, e.g. keystone or convergence
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3141Constructional details thereof
    • H04N9/317Convergence or focusing systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Geometry (AREA)
  • Transforming Electric Information Into Light Information (AREA)
  • Projection Apparatus (AREA)

Abstract

The application discloses a projection display method and device and projection equipment. Wherein, the method comprises the following steps: determining a first coordinate of a first projection picture and a second coordinate of a second projection picture in the projector, wherein the first projection picture is an initial projection picture when the projector projects, and the second projection picture is a projection picture corrected by the projector; determining a third coordinate of a third projection picture according to the first coordinate and the second coordinate, wherein the third projection picture is obtained by optically zooming the first projection picture; determining a target zooming position of the optical zooming according to the first coordinate and the third coordinate, and determining a preset number of intermediate zooming positions between the first zooming position corresponding to the initial projection picture and the target zooming position; and sequentially adjusting the first zooming position to a target zooming position through the middle zooming position, and after each adjustment, projecting and displaying a projection picture to the projection plane at the adjusted zooming position.

Description

Projection display method and device and projection equipment
Technical Field
The application relates to the technical field of projection, in particular to a projection display method and device and projection equipment.
Background
In an actual projection using process, in order to ensure that a final projection picture viewed by a user appears as a rectangle under the conditions of different projection angles and different projection distances, a projection picture area needs to be adjusted, and the process is called trapezoidal correction of projection.
In the related art, the projected trapezoidal correction usually has two modes, i.e., manual and automatic, in which a user calls up an adjustment setting menu and adjusts the shape of a projection picture by manually controlling the positions of several vertexes of the projection picture; the automatic mode is that the projection plane information is collected through an image collecting module, and the picture is automatically corrected into a rectangle through automatic compensation of the projection position. However, whether manual or automatic, the image is adjusted in a digital adjustment manner, that is, the positions of the projected picture pixels are changed by a software algorithm, and this method has two disadvantages: the adjusted picture resolution and picture quality are lost due to scaling; after the regulation, normal display content can diminish, but ray apparatus inner structure is owing to can't accomplish complete shading, so the user can see normal picture content and have obvious grey limit all around, and the less that the picture was transferred, grey limit is bigger, and these grey limits are very influence user's the experience of watching.
In view of the above problems, no effective solution has been proposed.
Disclosure of Invention
The embodiment of the application provides a projection display method, a projection display device and projection equipment, which realize the effect of continuously reducing the gray edge around a picture to a user while adjusting a projection picture and can strengthen the perception of the user.
According to an aspect of an embodiment of the present application, there is provided a projection display method including: determining a first coordinate of a first projection picture and a second coordinate of a second projection picture in a projector, wherein the first projection picture is an initial projection picture when the projector projects, and the second projection picture is a projection picture corrected by the projector; determining a third coordinate of a third projection picture according to the first coordinate and the second coordinate, wherein the third projection picture is obtained by optically zooming the first projection picture; determining a target zooming position of the optical zooming according to the first coordinate and the third coordinate, and determining a preset number of intermediate zooming positions between a first zooming position corresponding to the initial projection picture and the target zooming position; and sequentially adjusting the first zooming position to the target zooming position through the intermediate zooming position, and after each adjustment, projecting and displaying a projection picture to a projection plane at the adjusted zooming position.
Optionally, determining coordinate information of each corner point of the first projection picture to obtain the first coordinate; and determining coordinate information of each corner point of the second projection picture to obtain the second coordinate.
Optionally, determining an optical zooming reference point, where the optical zooming reference point is a reference point preset for performing optical zooming processing on a projection picture; connecting the optical zooming reference point with each corner point of the first projection picture to obtain a plurality of line segments, and determining a first distance corresponding to each line segment in the plurality of line segments; drawing a straight line parallel to the boundary of the first projection picture based on each corner point of the second projection picture, and intersecting the plurality of line segments at a plurality of intersection points; for any intersection point in the plurality of intersection points, determining a second distance from the intersection point to the optical zooming reference point, and calculating a proportion between the second distance and a first distance corresponding to a line segment where the intersection point is located; determining a maximum proportion from the obtained proportions, and determining a third coordinate of the third projection picture according to the maximum proportion and the first coordinate.
Optionally, the coordinate information of each corner point of the third projection picture is determined according to the coordinate information of each corner point of the first projection picture and the maximum ratio, so as to obtain the third coordinate.
Optionally, a first association relationship between the zoom position and a scaling ratio is determined, wherein the scaling ratio is: and for any zoom position, when the zoom position is used for projection, obtaining the proportion between the fourth distance from the fourth corner point of the fourth projection picture to the optical zoom reference point and the first distance corresponding to the line segment where the fourth corner point is located.
Optionally, a proportional relationship between the first coordinate and the third coordinate is determined, and the target zoom position is determined according to the proportional relationship and the first association relationship.
Optionally, for any one of the intermediate zoom positions, determining a fifth coordinate of a fifth projection picture corresponding to the intermediate zoom position; determining a corresponding first homography transformation matrix when the fifth projection picture is mapped into the first projection picture according to the first coordinate and the fifth coordinate; and calculating the second coordinate according to the first homography transformation matrix to obtain a sixth coordinate.
Optionally, determining a corresponding second homography transformation matrix when the third projection picture is mapped to the first projection picture according to the first coordinate and the third coordinate; and calculating the second coordinate according to the second homography transformation matrix to obtain a seventh coordinate.
Optionally, determining a second association relationship between the zoom position and a control parameter of a zoom control mechanism, wherein the zoom control mechanism is a module in the projector for adjusting the zoom position; when the first zooming position is adjusted to the middle zooming position, adjusting control parameters of the zooming control mechanism according to the middle zooming position and the second incidence relation, and projecting and displaying a projection picture to a projection plane according to the sixth coordinate corresponding to the middle zooming position; and when the first zooming position is adjusted to the target zooming position, adjusting the control parameters of the optical zooming control mechanism according to the target zooming position and the second incidence relation, and projecting and displaying a projection picture to a projection plane according to the seventh coordinate.
Optionally, determining a single zoom step of a zoom control mechanism in the projector; determining a total zoom step length of the zoom control mechanism when the zoom control mechanism is adjusted from the first zoom position to the target zoom position; determining the preset number according to the ratio of the total zoom step length to the single zoom step length; and determining the middle zooming position according to the preset number and the single zooming step length.
According to another aspect of the embodiments of the present application, there is also provided a projection display apparatus including: the projector comprises a first determining module, a second determining module and a correcting module, wherein the first determining module is used for determining a first coordinate of a first projection picture and a second coordinate of a second projection picture in a projector, the first projection picture is an initial projection picture when the projector projects, and the second projection picture is a projection picture corrected by the projector; the second determining module is used for determining a third coordinate of a third projection picture according to the first coordinate and the second coordinate, wherein the third projection picture is obtained by optically zooming the first projection picture; a third determining module, configured to determine a target zoom position of the optical zoom according to the first coordinate and the third coordinate, and determine a preset number of intermediate zoom positions between the first zoom position corresponding to the initial projection image and the target zoom position; and the adjusting module is used for sequentially adjusting the first zooming position to the target zooming position through the middle zooming position, and after each adjustment, projecting and displaying a projection picture to the projection plane by the adjusted zooming position.
According to another aspect of the embodiments of the present application, there is also provided a projection apparatus, including: a processor; a memory coupled to the processor for providing instructions to the processor for processing the following processing steps: determining a first coordinate of a first projection picture and a second coordinate of a second projection picture in a projector, wherein the first projection picture is an initial projection picture when the projector projects, and the second projection picture is a projection picture corrected by the projector; determining a third coordinate of a third projection picture according to the first coordinate and the second coordinate, wherein the third projection picture is obtained by optically zooming the first projection picture; determining a target zooming position of the optical zooming according to the first coordinate and the third coordinate, and determining a preset number of intermediate zooming positions between a first zooming position corresponding to the initial projection picture and the target zooming position; sequentially adjusting the first zooming position to the target zooming position through the middle zooming position, and projecting and displaying a projection picture to a projection plane at the adjusted zooming position after each adjustment; and the projector is provided with a zooming control mechanism and is used for receiving the instruction of the processor, adjusting the control parameter of the zooming control mechanism according to the instruction and displaying a projection picture in a projection plane.
According to another aspect of the embodiments of the present application, there is also provided a non-volatile storage medium, where the non-volatile storage medium includes a stored program, and when the program runs, the apparatus where the non-volatile storage medium is located is controlled to execute the projection display method.
In the embodiment of the application, a first projection picture when the projector projects at the minimum projection ratio is determined, a second projection picture corresponding to the projector after trapezoidal correction is fitted through an algorithm, in order to reduce the generated gray edge as much as possible, a minimum third projection picture which can cover the second projection picture after the first projection picture is subjected to optical zooming and zooming is determined, and a corresponding target zooming position is determined; in order to more intuitively show the process of reducing the gray edge to a user, a preset number of intermediate zoom positions are determined between a first zoom position corresponding to an initial projection picture and a target zoom position, the first zoom position is sequentially adjusted to the target zoom position through the intermediate zoom positions, and after each adjustment, the projection picture is projected to a projection plane and displayed at the adjusted zoom position. The scheme realizes the effect of continuously reducing the gray edge around the picture to the user while adjusting the projection picture, and can strengthen the perception of the user.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
FIG. 1 is a schematic flow chart diagram illustrating a projection display method according to an embodiment of the present application;
fig. 2 is a schematic diagram of a projected picture in a projector according to an embodiment of the present application;
FIG. 3 is a diagram of a projection screen corresponding to different zoom positions according to an embodiment of the present application;
FIG. 4 is a diagram illustrating a determination of a third projection screen according to an embodiment of the present application;
FIG. 5 is a schematic diagram of a relationship between zoom position and zoom ratio according to an embodiment of the present application;
FIG. 6 is a schematic diagram of a projection screen corresponding to an intermediate zoom position according to an embodiment of the present application;
fig. 7 is a schematic diagram of a projected picture in a projector according to an embodiment of the present application;
FIG. 8 is a schematic diagram of a projection display device according to an embodiment of the present application;
fig. 9 is a schematic structural diagram of a projection device according to an embodiment of the present application.
Detailed Description
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that the terms "first," "second," and the like in the description and claims of this application and in the accompanying drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in sequences other than those illustrated or described herein. Moreover, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
For a better understanding of the embodiments of the present application, some of the terms or expressions appearing in the course of describing the embodiments of the present application are to be interpreted as follows:
and (3) trapezoidal correction: in an actual projection using process, in order to ensure that a final projection picture viewed by a user appears as a rectangle under the conditions of different projection angles and different projection distances, a projection picture area needs to be adjusted, and the process is called trapezoidal correction of projection. Generally, there are resolution loss and gray edge effect in the trapezoidal correction process, and the larger the correction ratio is, the more obvious the resolution loss and the gray edge effect are.
Optical zooming: the optical zooming is realized by an optical lens structure, the zooming lens can realize the enlargement or the reduction of the whole projection picture by changing the focal length, all pixels in the projection picture are completely displayed at the moment, the process is different from the trapezoidal correction process, and no resolution loss exists in the optical zooming process.
Example 1
In accordance with an embodiment of the present application, there is provided a projection display method, it should be noted that the steps shown in the flowchart of the figure may be performed in a computer system such as a set of computer executable instructions, and that while a logical order is shown in the flowchart, in some cases the steps shown or described may be performed in an order different than here.
Fig. 1 is a projection display method according to an embodiment of the present application, as shown in fig. 1, the method including the steps of:
step S102, determining a first coordinate of a first projection picture and a second coordinate of a second projection picture in the projector, where the first projection picture is an initial projection picture during projection by the projector, and the second projection picture is a projection picture corrected by the projector.
In some alternative embodiments of the present application, the relationship between the first projection screen and the second projection screen is shown in fig. 2, where 21 denotes the first projection screen, and 22 denotes the second projection screen. Specifically, the first projection screen 21 is rectangular as a whole, but generally, for reasons such as a side projection mode adopted by a projector, the first projection screen is projected to a projection plane directly, and then the displayed projection screen is non-rectangular; in order to adjust the non-rectangular projection picture in the projection plane to be rectangular and simultaneously achieve the effects of projection obstacle avoidance and the like, the first projection picture 21 in the projector may be adjusted to be the second projection picture 22, and it should be noted that the second projection picture 22 is a projection picture which is obtained by the projector through algorithm fitting and is used for trapezoidal correction and projection obstacle avoidance, is used for subsequent calculation processing, and is not projected to the projection plane for display.
After a first projection picture and a second projection picture are respectively determined, determining coordinate information of each corner point of the first projection picture to obtain a first coordinate; and determining coordinate information of each corner point of the second projection picture to obtain a second coordinate. Specifically, since the projection picture is usually rectangular, the first coordinates are coordinates of four corner points of the first projection picture, and the second coordinates are coordinates of four corner points of the second projection picture.
And step S104, determining a third coordinate of a third projection picture according to the first coordinate and the second coordinate, wherein the third projection picture is obtained by optically zooming the first projection picture.
In order to reduce the generated gray edge as much as possible, the projection image may be first optically zoomed and zoomed, and therefore, it is necessary to determine the minimum projection image that can cover the second projection image after the first projection image is optically zoomed and zoomed, that is, the third projection image. In some optional embodiments of the present application, the third projection screen and its corresponding third coordinate may be determined by the following steps.
Step S1041, determining an optical zooming reference point, where the optical zooming reference point is a reference point preset for performing optical zooming processing on the projection image.
Fig. 3 shows a moving track of a projection image corresponding to an optical zoom lens of a projector during an optical zooming process, where 31, 32, 33, 34, 35, and 36 are projection images corresponding to different zooming positions, respectively, and o is an optical zooming reference point, it should be noted that a position of an optical zooming center o in the drawing is only schematic, and the position may be any position in the image, even outside the image, and an actual position is determined according to a specific optical design.
Step S1042, connecting the optical zoom reference point with each corner of the first projection image to obtain a plurality of line segments, and determining a first distance corresponding to each of the plurality of line segments.
Taking fig. 4 as an example, 41 indicates a first projection picture, where four corner points corresponding to the first projection picture are a, B, C, and D, and o is an optical zoom reference point, and are respectively connected to oA, oB, oC, and oD, and determine respective first distances.
And step S1043, drawing a straight line parallel to the boundary of the first projection picture based on each corner point of the second projection picture, and intersecting a plurality of line segments at a plurality of intersection points.
Reference numeral 42 in fig. 4 denotes a second projection picture, and lines parallel to the boundaries AB, BC, CD, DA of the first projection picture are respectively drawn through four corner points A1, B1, C1, D1 of the second projection picture 42, and intersect oA at points a, B, C, D, B, e, f, g, oD, h, i, and oC at a point j.
Step S1044 is to determine a second distance from the intersection point to the optical zoom reference point for any one of the plurality of intersection points, and calculate a ratio between the second distance and the first distance corresponding to the line segment where the intersection point is located.
Distances of oA, oB, oC, oD, oe, of, oj, oh, oi, oj in FIG. 4 are determined, and oA/oA, oB/oA, oC/oA, oD/oA, oe/oB, of/oB, og/oB, oh/oD, oi/oD and oj/oC are calculated, respectively.
Step S1045, determining a maximum ratio from the obtained plurality of ratios, and determining a third coordinate of a third projection frame according to the maximum ratio and the first coordinate. Specifically, the coordinate information of each corner point of the third projection picture is determined according to the coordinate information of each corner point of the first projection picture and the maximum proportion, and a third coordinate is obtained.
For example, the maximum ratio oA/oA is found from the above ratios, and the coordinate information of the four corner points A2, B2, C2, D2 of the third projection picture is calculated according to the ratio and oA, oB, oC, oD, wherein: oA2= oA (oA/oA); oB2= oB (oA/oA); oC2= oC (oA/oA); oD2= oD (oA/oA).
It should be noted that, in some special cases, there may be a case where the scaling ratios from the four corner points of the first projection picture to the optical scaling reference point are not consistent, and then, when determining the third projection picture, calculation needs to be performed by using the maximum scale corresponding to each corner point.
And step S106, determining a target zooming position of the optical zooming according to the first coordinate and the third coordinate, and determining a preset number of intermediate zooming positions between the first zooming position corresponding to the initial projection picture and the target zooming position.
In some optional embodiments of the present application, before determining the target zoom position, a first association relationship between the zoom position and a scaling ratio needs to be determined, where the scaling ratio is: and for any zoom position, when the zoom position is used for projection, obtaining the proportion between the fourth distance from the fourth corner point of the fourth projection picture to the optical zooming reference point and the first distance corresponding to the line segment where the fourth corner point is located.
Taking fig. 3 as an example, the scaling ratio is: a ratio between a fourth distance oTn from the corner Tn of the projection frame to the optical zoom reference point corresponding to a zoom position bn (n > 1) and the corresponding oT 1. It can be seen that the scaling of the four points of the projection screen with respect to the optical zoom reference point is linearly scaled by the same scale when the optical zoom position moves, and therefore, the first correlation can be represented by a linear relationship r = kb + c as shown in fig. 5, where r represents the scaling, and r = OTn/OT1, k, c is a curve parameter, and b is the current zoom position.
It should be noted that if the distance variation relationships between the four corner points of the projection image and the optical zoom reference point are not consistent, four curves need to be fitted respectively to represent the image position; meanwhile, the fitted curve includes, but is not limited to, the linear relationship shown in fig. 5.
After the first association relationship between the zoom position and the zoom ratio is determined, a proportional relationship between the first coordinate and the third coordinate may be determined, and the target zoom position may be determined according to the proportional relationship and the first association relationship. For example, if the ratio between the first coordinate and the third coordinate is r = oA/oA, the target zoom position b = (r-c)/k.
In order to more intuitively show the process of gray edge reduction to the user, after the target zoom position is determined, a preset number of intermediate zoom positions may be determined between the first zoom position corresponding to the initial projection screen and the target zoom position.
In some alternative embodiments of the present application, a single zoom step of a zoom control mechanism in the projector is determined; determining the total zoom step length when the zoom control mechanism is adjusted from the first zoom position to the target zoom position; determining a preset number according to the ratio of the total zoom step length to the single zoom step length; and determining the middle zooming position according to the preset number and the single zooming step length.
For example, assuming that the first zoom position is b1 and the target zoom position is b2, the total zoom step Z1= | b1-b2|, when the zoom control mechanism is adjusted from the first zoom position to the target zoom position, and the single zoom step is Z2, the total zoom number is n = ceil (Z1/Z2), where ceil operation means rounding up, and since the position of the last zoom is the target zoom position, n-1 intermediate zoom positions need to be determined between the first zoom position b1 and the target zoom position b 2; then, based on the first zoom position b1, an intermediate zoom position is obtained for each single zoom step increase until the target zoom position b2 is finally obtained. Fig. 6 is a schematic diagram of projection pictures at n =3, and 2 intermediate zoom positions b3 and b4 are determined between b1 and b2, where 61 is a first projection picture corresponding to the first zoom position b1, 62 is a second projection picture, 633 is a third projection picture corresponding to the target zoom position b2, and 631 and 632 between 61 and 633 are projection pictures corresponding to the intermediate zoom positions b3 and b4, respectively.
And S108, sequentially adjusting the first zooming position to a target zooming position through the intermediate zooming position, and projecting and displaying a projection picture to the projection plane at the adjusted zooming position after each adjustment.
In some optional embodiments of the present application, when the first zoom position is sequentially adjusted to the target zoom position through the intermediate zoom position, a second association relationship between the zoom position and a control parameter of the zoom control mechanism may be determined, where the zoom control mechanism is a module in the projector for adjusting the zoom position.
For example, a second correlation between the zoom position and a control parameter such as a step angle of a stepping motor in the zoom control mechanism, or a motor step number of a gear motor may be determined, and then specific control parameters of the zoom control mechanism are sequentially adjusted according to the intermediate zoom positions b3 and b4, the target zoom position b2, and the second correlation, so as to drive the zoom control mechanism to move to the corresponding positions, and at this time, the first projection screen 61 in fig. 6 is gradually zoomed into projection screens 631 and 632, and is finally zoomed into the third projection screen 633.
It can be understood that after the optical zoom is performed, if the projection display is still performed with the coordinate information of the second projection screen, the actual projection area in the projection plane may be smaller than the originally expected projection area, and in order to ensure that the final projection area remains unchanged, the coordinate information of the second projection screen needs to be adjusted after each zoom. Taking fig. 6 as an example, 61 is a first projection picture before zooming, 62 is a second projection picture before zooming, and after optical zooming, the first projection picture 61 is zoomed into a third projection picture 63, but at this time, the second projection picture 62 is also zoomed into a projection picture 64, and in order to ensure that the final projection area is not changed, it is necessary to adjust the corner coordinates of the original second projection picture 62, so that the projection picture obtained after zooming is overlapped with the original second projection picture 62.
Specifically, for any intermediate zoom position, determining a fifth coordinate of a fifth projection picture corresponding to the intermediate zoom position; determining a corresponding first homography transformation matrix when the fifth projection picture is mapped into the first projection picture according to the first coordinate and the fifth coordinate; calculating the second coordinate according to the first homography transformation matrix to obtain a sixth coordinate; and when the first zooming position is adjusted to the middle zooming position, adjusting the control parameters of the zooming control mechanism according to the middle zooming position and the second association relation, and projecting and displaying a projection picture to the projection plane according to a sixth coordinate corresponding to the middle zooming position.
Taking the middle zoom position b3 as an example, determining that the middle zoom position b3 corresponds to the fifth projection picture 731 in fig. 7, calculating a homography transformation matrix H1 corresponding to the projection picture 731 when the projection picture is mapped to the first projection picture 71 by using mature methods such as a direct linear transformation DLT and the like according to four corner coordinates of the fifth projection picture 731 and four corner coordinates of the first projection picture 71, then performing homography transformation on the four corner coordinates of the second projection picture 72 according to the transformation matrix H1 to obtain a sixth coordinate, and projecting the projection picture to a projection plane for display according to the sixth coordinate.
For the target zooming position, determining a corresponding second homography transformation matrix when the third projection picture is mapped into the first projection picture according to the first coordinate and the third coordinate; calculating the second coordinate according to the second homography transformation matrix to obtain a seventh coordinate; and when the first zooming position is adjusted to the target zooming position, adjusting the control parameters of the optical zooming control mechanism according to the target zooming position and the second incidence relation, and projecting and displaying a projection picture to the projection plane according to the seventh coordinate.
Specifically, according to the coordinates of the four corner points of the third projection picture 733 and the coordinates of the four corner points of the first projection picture 71, a homography transformation matrix H2 corresponding to the third projection picture 733 as the first projection picture 71 is calculated, then homography transformation is performed on the coordinates of the four corner points of the second projection picture 72 according to the transformation matrix H2 to obtain a seventh coordinate, and the projection picture is projected to a projection plane for display according to the seventh coordinate.
In the embodiment of the application, an initial first projection picture during projection in a projector is determined, a second projection picture corresponding to the first projection picture after correction is fitted through an algorithm, in order to reduce the generated gray edge as much as possible, a minimum third projection picture which can cover the second projection picture after the first projection picture is subjected to optical zoom scaling is determined, and a corresponding target zoom position is determined; in order to more intuitively show the process of reducing the gray edge to a user, a preset number of intermediate zoom positions are determined between a first zoom position corresponding to an initial projection picture and a target zoom position, the first zoom position is sequentially adjusted to the target zoom position through the intermediate zoom positions, and after each adjustment, the projection picture is projected to a projection plane and displayed at the adjusted zoom position. The scheme realizes the effect of continuously reducing the gray edge around the picture when the projection picture is adjusted, and can strengthen the perception of the user.
Example 2
According to an embodiment of the present application, there is further provided a projection display apparatus for implementing the projection display method, as shown in fig. 8, the apparatus includes a first determining module 80, a second determining module 82, a third determining module 84, and an adjusting module 86, where:
the first determining module 80 is configured to determine a first coordinate of a first projection picture and a second coordinate of a second projection picture in the projector, where the first projection picture is an initial projection picture during projection by the projector, and the second projection picture is a projection picture corrected by the projector.
In some optional embodiments of the present application, in order to reduce the generated gray edge as much as possible, the projection image may be first optically zoomed and zoomed, and therefore, a minimum projection image that can cover the second projection image after the first projection image is optically zoomed and zoomed, that is, a third projection image, needs to be determined first.
The second determining module 82 is configured to determine a third coordinate of a third projection image according to the first coordinate and the second coordinate, where the third projection image is obtained by performing optical zoom on the first projection image.
In some optional embodiments of the present application, in order to reduce the generated gray edge as much as possible, the projection image may be first optically zoomed and zoomed, and therefore, a minimum projection image that can cover the second projection image after the first projection image is optically zoomed and zoomed, that is, a third projection image, needs to be determined first.
Specifically, an optical zooming reference point is determined, wherein the optical zooming reference point is a preset reference point for carrying out optical zooming processing on a projection picture; connecting the optical zoom reference point with each corner point of the first projection picture to obtain a plurality of line segments, and determining a first distance corresponding to each line segment in the plurality of line segments; drawing a straight line parallel to the boundary of the first projection picture based on each corner point of the second projection picture, and intersecting a plurality of line segments at a plurality of intersection points; determining a second distance from the intersection point to the optical zooming reference point for any one of the plurality of intersection points, and calculating a proportion between the second distance and a first distance corresponding to a line segment where the intersection point is located; and determining a maximum proportion from the obtained proportions, and determining a third coordinate of the third projection picture according to the maximum proportion and the first coordinate.
And a third determining module 84, configured to determine a target zoom position of the optical zoom according to the first coordinate and the third coordinate, and determine a preset number of intermediate zoom positions between the first zoom position corresponding to the initial projection image and the target zoom position.
In some optional embodiments of the present application, before determining the target zoom position, a first association relationship between the zoom position and a scaling ratio needs to be determined, where the scaling ratio is: and for any zoom position, when the zoom position is used for projection, obtaining the proportion between the fourth distance from the fourth corner point of the fourth projection picture to the optical zooming reference point and the first distance corresponding to the line segment where the fourth corner point is located.
After the first association relationship between the zoom position and the zoom ratio is determined, the proportional relationship between the first coordinate and the third coordinate can be determined, and the target zoom position is determined according to the proportional relationship and the first association relationship; in order to more intuitively show the process of gray edge reduction to the user, after the target zoom position is determined, a preset number of intermediate zoom positions may be determined between the first zoom position corresponding to the initial projection screen and the target zoom position.
And the adjusting module 86 is configured to sequentially adjust the first zoom position to a target zoom position through the intermediate zoom position, and after each adjustment, project and display a projection picture to the projection plane at the adjusted zoom position.
In some optional embodiments of the present application, when the first zoom position is sequentially adjusted to the target zoom position through the intermediate zoom position, a second association relationship between the zoom position and a control parameter of the zoom control mechanism may be determined first, where the zoom control mechanism is a module for adjusting the zoom position in the projector; meanwhile, in order to ensure that the final projection area remains unchanged, the coordinate information of the second projection picture needs to be adjusted.
Specifically, for any intermediate zoom position, determining a fifth coordinate of the fifth projection screen corresponding to the intermediate zoom position; determining a corresponding first homography transformation matrix when the fifth projection picture is mapped into the first projection picture according to the first coordinate and the fifth coordinate; calculating the second coordinate according to the first homography transformation matrix to obtain a sixth coordinate; and when the first zooming position is adjusted to the middle zooming position, adjusting the control parameters of the zooming control mechanism according to the middle zooming position and the second association relation, and projecting and displaying a projection picture to the projection plane according to a sixth coordinate corresponding to the middle zooming position.
For the target zooming position, determining a corresponding second homography transformation matrix when the third projection picture is mapped into the first projection picture according to the first coordinate and the third coordinate; calculating the second coordinate according to the second homography transformation matrix to obtain a seventh coordinate; and when the first zooming position is adjusted to the target zooming position, adjusting the control parameters of the optical zooming control mechanism according to the target zooming position and the second incidence relation, and projecting and displaying a projection picture to the projection plane according to the seventh coordinate.
It should be noted that, each module in the projection display apparatus in the embodiment of the present application corresponds to the implementation steps of the projection display method in embodiment 1 one to one, and because the detailed description is already given in embodiment 1, some details that are not shown in this embodiment may refer to embodiment 1, and are not described here again.
Example 3
According to an embodiment of the present application, there is also provided a projection apparatus, as shown in fig. 9, the projection apparatus 90 includes a projector 900 having a zoom control mechanism, a processor 902, and a memory 904, where:
the memory 904 is coupled to the processor 902 for providing instructions to the processor 902 to process the following process steps: determining a first coordinate of a first projection picture and a second coordinate of a second projection picture in the projector, wherein the first projection picture is an initial projection picture when the projector projects, and the second projection picture is a projection picture corrected by the projector; determining a third coordinate of a third projection picture according to the first coordinate and the second coordinate, wherein the third projection picture is obtained by optically zooming the first projection picture; determining a target zooming position of the optical zooming according to the first coordinate and the third coordinate, and determining a preset number of intermediate zooming positions between the first zooming position corresponding to the initial projection picture and the target zooming position; and sequentially adjusting the first zooming position to the target zooming position through the middle zooming position, and projecting and displaying the projection picture to the projection plane at the adjusted zooming position after each adjustment.
The projector 900 with the zoom control mechanism is configured to receive an instruction from the processor, adjust a control parameter of the zoom control mechanism according to the instruction, and project the projection image onto the projection plane for display.
Example 4
According to an embodiment of the application, a non-volatile storage medium is further provided, and the non-volatile storage medium includes a stored program, wherein when the program runs, the device where the non-volatile storage medium is located is controlled to execute the projection display method.
Optionally, the apparatus in which the non-volatile storage medium is controlled when the program is running executes the following steps: determining a first coordinate of a first projection picture and a second coordinate of a second projection picture in the projector, wherein the first projection picture is an initial projection picture when the projector projects, and the second projection picture is a projection picture corrected by the projector; determining a third coordinate of a third projection picture according to the first coordinate and the second coordinate, wherein the third projection picture is obtained by optically zooming the first projection picture; determining a target zooming position of the optical zooming according to the first coordinate and the third coordinate, and determining a preset number of intermediate zooming positions between the first zooming position corresponding to the initial projection picture and the target zooming position; and sequentially adjusting the first zooming position to a target zooming position through the middle zooming position, and after each adjustment, projecting and displaying a projection picture to the projection plane at the adjusted zooming position.
The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.
In the above embodiments of the present application, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described apparatus embodiments are merely illustrative, and for example, a division of a unit may be a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or may be integrated into another system, or some features may be omitted, or may not be executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may also be implemented in the form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application, or portions or all or portions of the technical solutions that contribute to the prior art, may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
The foregoing is only a preferred embodiment of the present application and it should be noted that those skilled in the art can make several improvements and modifications without departing from the principle of the present application, and these improvements and modifications should also be considered as the protection scope of the present application.

Claims (13)

1. A projection display method, comprising:
determining a first coordinate of a first projection picture and a second coordinate of a second projection picture in a projector, wherein the first projection picture is an initial projection picture during projection of the projector, and the second projection picture is a projection picture corrected by the projector;
determining a third coordinate of a third projection picture according to the first coordinate and the second coordinate, wherein the third projection picture is obtained by optically zooming the first projection picture;
determining a target zooming position of the optical zooming according to the first coordinate and the third coordinate, and determining a preset number of intermediate zooming positions between a first zooming position corresponding to the initial projection picture and the target zooming position;
and sequentially adjusting the first zooming position to the target zooming position through the intermediate zooming position, and after each adjustment, projecting and displaying a projection picture to a projection plane at the adjusted zooming position.
2. The method of claim 1, wherein determining first coordinates of a first projection screen and second coordinates of a second projection screen in a projector comprises:
determining coordinate information of each corner point of the first projection picture to obtain the first coordinate;
and determining coordinate information of each corner point of the second projection picture to obtain the second coordinate.
3. The method of claim 1, wherein determining a third coordinate of a third projection frame according to the first coordinate and the second coordinate comprises:
determining an optical zooming reference point, wherein the optical zooming reference point is a preset reference point for carrying out optical zooming processing on a projection picture;
connecting the optical zooming reference point with each corner point of the first projection picture to obtain a plurality of line segments, and determining a first distance corresponding to each line segment in the plurality of line segments;
drawing a straight line parallel to the boundary of the first projection picture based on each corner point of the second projection picture, and intersecting the line segments at a plurality of intersection points;
for any intersection point in the intersection points, determining a second distance from the intersection point to the optical zooming reference point, and calculating a proportion between the second distance and a first distance corresponding to a line segment where the intersection point is located;
determining a maximum proportion from the obtained proportions, and determining a third coordinate of the third projection picture according to the maximum proportion and the first coordinate.
4. The method of claim 3, wherein determining a third coordinate of the third projection picture according to the maximum scale and the first coordinate comprises:
and determining the coordinate information of each corner point of the third projection picture according to the coordinate information of each corner point of the first projection picture and the maximum proportion to obtain the third coordinate.
5. The method of claim 3, wherein prior to determining a target zoom position from the first and third coordinates, the method further comprises:
determining a first association relationship between a zoom position and a scale, wherein the scale is: and for any zoom position, when the zoom position is used for projection, obtaining the proportion between the fourth distance from the fourth corner point of the fourth projection picture to the optical zooming reference point and the first distance corresponding to the line segment where the fourth corner point is located.
6. The method of claim 5, wherein determining a target zoom position for the optical zoom from the first coordinate and the third coordinate comprises:
and determining a proportional relation between the first coordinate and the third coordinate, and determining the target zooming position according to the proportional relation and the first incidence relation.
7. The method of claim 1, wherein after determining a preset number of intermediate zoom positions between the first zoom position corresponding to the initial projection screen and the target zoom position, the method further comprises:
for any one intermediate zoom position, determining a fifth coordinate of a fifth projection picture corresponding to the intermediate zoom position;
determining a corresponding first homography transformation matrix when the fifth projection picture is mapped into the first projection picture according to the first coordinate and the fifth coordinate;
and calculating the second coordinate according to the first homography transformation matrix to obtain a sixth coordinate.
8. The method of claim 7, wherein before projecting and displaying the projection screen to the projection plane at the adjusted zoom position, the method further comprises:
determining a corresponding second homography transformation matrix when the third projection picture is mapped into the first projection picture according to the first coordinate and the third coordinate;
and calculating the second coordinate according to the second homography transformation matrix to obtain a seventh coordinate.
9. The method of claim 8, wherein adjusting the first zoom position to the target zoom position sequentially via the intermediate zoom positions and, after each adjustment, projecting and displaying a projection screen to a projection plane at the adjusted zoom position comprises:
determining a second incidence relation between the zoom position and a control parameter of a zoom control mechanism, wherein the zoom control mechanism is a module used for adjusting the zoom position in the projector;
when the first zooming position is adjusted to the middle zooming position, adjusting control parameters of the zooming control mechanism according to the middle zooming position and the second association relation, and projecting and displaying a projection picture to a projection plane according to the sixth coordinate corresponding to the middle zooming position;
and when the first zooming position is adjusted to the target zooming position, adjusting the control parameters of the optical zooming control mechanism according to the target zooming position and the second incidence relation, and projecting and displaying a projection picture to a projection plane according to the seventh coordinate.
10. The method of claim 1, wherein determining a preset number of intermediate zoom positions between a first zoom position corresponding to an initial projection screen and the target zoom position comprises:
determining a single zooming step length of a zooming control mechanism in the projector;
determining a total zoom step length of the zoom control mechanism when the zoom control mechanism is adjusted from the first zoom position to the target zoom position;
determining the preset number according to the ratio of the total zoom step length to the single zoom step length;
and determining the middle zooming position according to the preset number and the single zooming step length.
11. A projection display device, comprising:
the projector comprises a first determining module, a second determining module and a correcting module, wherein the first determining module is used for determining a first coordinate of a first projection picture and a second coordinate of a second projection picture in a projector, the first projection picture is an initial projection picture when the projector projects, and the second projection picture is a projection picture corrected by the projector;
a second determining module, configured to determine a third coordinate of a third projection image according to the first coordinate and the second coordinate, where the third projection image is obtained by optically zooming the first projection image;
a third determining module, configured to determine a target zoom position of the optical zoom according to the first coordinate and the third coordinate, and determine a preset number of intermediate zoom positions between the first zoom position corresponding to the initial projection image and the target zoom position;
and the adjusting module is used for sequentially adjusting the first zooming position to the target zooming position through the middle zooming position, and after each adjustment, projecting and displaying a projection picture to the projection plane by the adjusted zooming position.
12. A projection device, comprising:
a processor;
a memory coupled to the processor for providing instructions to the processor for processing the following processing steps: determining a first coordinate of a first projection picture and a second coordinate of a second projection picture in a projector, wherein the first projection picture is an initial projection picture when the projector projects, and the second projection picture is a projection picture corrected by the projector; determining a third coordinate of a third projection picture according to the first coordinate and the second coordinate, wherein the third projection picture is obtained by optically zooming the first projection picture; determining a target zooming position of the optical zooming according to the first coordinate and the third coordinate, and determining a preset number of intermediate zooming positions between a first zooming position corresponding to the initial projection picture and the target zooming position; sequentially adjusting the first zooming position to the target zooming position through the middle zooming position, and projecting and displaying a projection picture to a projection plane at the adjusted zooming position after each adjustment;
and the projector is provided with a zooming control mechanism and is used for receiving the instruction of the processor, adjusting the control parameter of the zooming control mechanism according to the instruction and displaying a projection picture in a projection plane.
13. A non-volatile storage medium, comprising a stored program, wherein when the program runs, a device in which the non-volatile storage medium is located is controlled to execute the projection display method according to any one of claims 1 to 10.
CN202110352763.2A 2021-03-31 2021-03-31 Projection display method and device and projection equipment Active CN115150597B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202110352763.2A CN115150597B (en) 2021-03-31 2021-03-31 Projection display method and device and projection equipment
PCT/CN2021/120700 WO2022205812A1 (en) 2021-03-31 2021-09-26 Projection display method and apparatus, and projection device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110352763.2A CN115150597B (en) 2021-03-31 2021-03-31 Projection display method and device and projection equipment

Publications (2)

Publication Number Publication Date
CN115150597A true CN115150597A (en) 2022-10-04
CN115150597B CN115150597B (en) 2023-08-15

Family

ID=83405063

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110352763.2A Active CN115150597B (en) 2021-03-31 2021-03-31 Projection display method and device and projection equipment

Country Status (2)

Country Link
CN (1) CN115150597B (en)
WO (1) WO2022205812A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101553863A (en) * 2006-07-13 2009-10-07 Lg电子株式会社 Method of controllong touch panel display device and touch panel display device using the same
CN103426149A (en) * 2013-07-24 2013-12-04 玉振明 Large-viewing-angle image distortion correction and processing method
CN110290364A (en) * 2019-06-04 2019-09-27 成都极米科技股份有限公司 Electrodeless Zooming method, device and readable storage medium storing program for executing under side throwing mode
JP2020178248A (en) * 2019-04-18 2020-10-29 キヤノン株式会社 Projection control device, projection control method, projection system, program, and storage medium
CN112040206A (en) * 2020-08-21 2020-12-04 广景视睿科技(深圳)有限公司 Zooming projection method and projector

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000241874A (en) * 1999-02-19 2000-09-08 Nec Corp Method and device for automatically adjusting screen position for projector
JP3722146B1 (en) * 2004-06-16 2005-11-30 セイコーエプソン株式会社 Projector and image correction method
CN112584113B (en) * 2020-12-02 2022-08-30 深圳市当智科技有限公司 Wide-screen projection method and system based on mapping correction and readable storage medium
CN112422939A (en) * 2021-01-25 2021-02-26 深圳市橙子数字科技有限公司 Trapezoidal correction method and device for projection equipment, projection equipment and medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101553863A (en) * 2006-07-13 2009-10-07 Lg电子株式会社 Method of controllong touch panel display device and touch panel display device using the same
CN103426149A (en) * 2013-07-24 2013-12-04 玉振明 Large-viewing-angle image distortion correction and processing method
JP2020178248A (en) * 2019-04-18 2020-10-29 キヤノン株式会社 Projection control device, projection control method, projection system, program, and storage medium
CN110290364A (en) * 2019-06-04 2019-09-27 成都极米科技股份有限公司 Electrodeless Zooming method, device and readable storage medium storing program for executing under side throwing mode
CN112040206A (en) * 2020-08-21 2020-12-04 广景视睿科技(深圳)有限公司 Zooming projection method and projector

Also Published As

Publication number Publication date
CN115150597B (en) 2023-08-15
WO2022205812A1 (en) 2022-10-06

Similar Documents

Publication Publication Date Title
RU2417446C2 (en) System and method for head size correction in 360-degree panoramic images
US9591237B2 (en) Automated generation of panning shots
JP5224721B2 (en) Video projection system
CN104954769B (en) A kind of immersion ultra high-definition processing system for video and method
CN101572787B (en) Computer vision precision measurement based multi-projection visual automatic geometric correction and splicing method
CN112118435B (en) Multi-projection fusion method and system for special-shaped metal screen
JP2022524806A (en) Image fusion method and mobile terminal
CN112261387B (en) Image fusion method and device for multi-camera module, storage medium and mobile terminal
EP2472859A1 (en) Image processing method and device
CN105721767B (en) The method for handling video flowing
US20220182595A1 (en) Optical flow based omnidirectional stereo video processing method
JP2003348500A (en) Projection image adjustment method, image projection method, and projector
JP2006285482A (en) Device for correcting image geometry
JP2017143354A (en) Image processing apparatus and image processing method
CN115150597B (en) Projection display method and device and projection equipment
CN115150596B (en) Projection display method and device and projection equipment
CN116109681A (en) Image fusion method, device, electronic equipment and readable storage medium
EP4091319B1 (en) Method of controlling a camera
CN114092316A (en) Image processing method, apparatus and storage medium
GB2616188A (en) Method and apparatus for creating panoramic picture on basis of large screen, and intelligent terminal and medium
CN113938578A (en) Image blurring method, storage medium and terminal device
CN115150600B (en) Method and device for determining display area of projection picture and projector
CN104777700A (en) Multi-projector optimized deployment method realizing high-immersion projection
CN115150599B (en) Method and device for determining target coordinates
CN114449233B (en) Projection device and trapezoid correction method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant