CN114286069A - Projection picture processing method and device, storage medium and projection equipment - Google Patents

Projection picture processing method and device, storage medium and projection equipment Download PDF

Info

Publication number
CN114286069A
CN114286069A CN202111672543.4A CN202111672543A CN114286069A CN 114286069 A CN114286069 A CN 114286069A CN 202111672543 A CN202111672543 A CN 202111672543A CN 114286069 A CN114286069 A CN 114286069A
Authority
CN
China
Prior art keywords
projection
corner point
moving
projection picture
point
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202111672543.4A
Other languages
Chinese (zh)
Other versions
CN114286069B (en
Inventor
孙世攀
张聪
胡震宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Huole Science and Technology Development Co Ltd
Original Assignee
Shenzhen Huole Science and Technology Development Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Huole Science and Technology Development Co Ltd filed Critical Shenzhen Huole Science and Technology Development Co Ltd
Priority to CN202111672543.4A priority Critical patent/CN114286069B/en
Publication of CN114286069A publication Critical patent/CN114286069A/en
Application granted granted Critical
Publication of CN114286069B publication Critical patent/CN114286069B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Transforming Electric Information Into Light Information (AREA)
  • Projection Apparatus (AREA)

Abstract

The disclosure relates to a projection picture processing method, a projection picture processing device, a storage medium and a projection device, wherein the method comprises the following steps: responding to a preset correction trigger event aiming at a projection picture, and determining target coordinates of each corner point of the projection picture; controlling a modulation plane of an optical machine of the projection equipment, and moving the actual coordinates of each angular point to the target coordinates corresponding to the angular point through multiple movements; in each moving process of each corner point, the moving speed of the corner point is related to the distance between the actual coordinate of the corner point and the target coordinate, and in each moving process of each corner point, the content of the projection picture is generated by the projection equipment in real time according to data to be projected. The method and the device can enable the transition of the projection picture in the correction process to be smoother, and ensure that the picture content can be normally played, thereby improving the user experience.

Description

Projection picture processing method and device, storage medium and projection equipment
Technical Field
The present disclosure relates to the field of projection technologies, and in particular, to a method and an apparatus for processing a projection image, a storage medium, and a projection device.
Background
The projection equipment is a device capable of projecting images or videos onto a projection screen, the images or videos projected onto the projection screen are magnified by several times or tens of times under the condition of keeping definition, so that the projection equipment is convenient for people to watch and also gives people a wide visual field, and therefore, the projection equipment is popular with users.
The existing projection devices usually have a correction function, and can correct the shape or position of the projection picture of the projection device.
However, in the related art, when the projection device corrects the projection picture, the current picture content played by the projection device is usually interrupted, and the projection picture is directly switched from the current state to the finally corrected state, which may cause the change of the projection picture presented in front of the user to be visually obtrusive and hard in the correction process, thereby reducing the user experience.
Disclosure of Invention
The invention aims to provide a projection picture processing method, a projection picture processing device, a storage medium and projection equipment, so as to improve the user experience of the projection equipment in the process of correcting a projection picture.
In order to achieve the above object, in a first aspect, the present disclosure provides a projection picture processing method, including:
responding to a preset correction trigger event aiming at a projection picture, and determining target coordinates of each corner point of the projection picture;
controlling a modulation plane of an optical machine of the projection equipment, and moving the actual coordinates of each angular point to the target coordinates corresponding to the angular point through multiple movements;
in each moving process of each corner point, the moving speed of the corner point is related to the distance between the actual coordinate of the corner point and the target coordinate, and in each moving process of each corner point, the content of the projection picture is generated by the projection equipment in real time according to data to be projected.
In a second aspect, the present disclosure provides a method for processing a projection picture, applied to a projection device, where the projection device includes a system layer, an application layer, and a driver layer, the method including:
the application layer responds to a preset correction trigger event aiming at a projection picture, determines target coordinates of each corner point of the projection picture and sends the target coordinates to the system layer;
the system layer determines the moving step length of each angular point moving on a modulation plane of an optical machine of the projection equipment each time according to the target coordinates and preset moving times, determines the display range of the projection picture moving on the modulation plane each time according to the moving step length of each angular point, maps the projection picture into the display range, and sends the projection picture in the display range to the driving layer;
the driving layer controls an optical machine of the projection equipment to project a projection picture in the display range of the modulation plane, so that the actual coordinates of each corner point move to the corresponding target coordinates;
in each moving process of each corner point, the moving step length of the corner point is related to the distance between the actual coordinate of the corner point and the target coordinate, and in each moving process of each corner point, the content of the projection picture is generated by the projection equipment in real time according to data to be projected.
In a third aspect, the present disclosure provides a projection screen processing apparatus, including:
the target coordinate determination module is used for responding to a preset correction trigger event aiming at a projection picture and determining the target coordinates of each corner point of the projection picture;
the corner point moving module is used for controlling a modulation plane of an optical machine of the projection equipment and moving the actual coordinates of each corner point to the target coordinates corresponding to the corner points through multiple times of movement; in each moving process of each corner point, the moving speed of the corner point is related to the distance between the actual coordinate of the corner point and the target coordinate, and in each moving process of each corner point, the content of the projection picture is generated by the projection equipment in real time according to data to be projected.
In a fourth aspect, the present disclosure provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the method of the first aspect.
In a fifth aspect, the present disclosure provides a projection device comprising:
a memory having a computer program stored thereon;
a processor for executing the computer program in the memory to implement the steps of the method of the first aspect.
The projection picture processing method provided by the present disclosure determines target coordinates of each corner point of a projection picture by responding to a preset correction trigger event for the projection picture; and then controlling a modulation plane of an optical machine of the projection equipment, and moving the actual coordinates of each angular point to the target coordinates corresponding to the angular points through multiple movements. In each moving process of each corner point, the moving speed of the corner point is related to the distance between the actual coordinate of the corner point and the target coordinate, and in each moving process of each corner point, the content of the projection picture is generated in real time by the projection equipment according to the data to be projected. Therefore, when the projection equipment performs picture correction on the projection picture, the picture seen by the user moves to the position to be finally corrected in a progressive mode, so that the change of the picture is smoother, and the picture does not give a hard feeling to the user visually. In addition, in the process of correcting the picture, the picture content can be normally played, so that a user can not feel abrupt and uncomfortable due to the interruption of the picture content, and the user experience is effectively improved.
Additional features and advantages of the disclosure will be set forth in the detailed description which follows.
Drawings
The accompanying drawings, which are included to provide a further understanding of the disclosure and are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the description serve to explain the disclosure without limiting the disclosure. In the drawings:
fig. 1 is a flowchart illustrating a method for processing a projection screen according to an exemplary embodiment.
Fig. 2 is a schematic diagram of movement of each corner point of the projection screen provided in the embodiment of fig. 1.
Fig. 3 is a schematic diagram of a movement of a first corner point of a projection picture according to the embodiment of fig. 1.
Fig. 4 is a schematic diagram of a movement of a first corner point of another projection screen provided in the embodiment of fig. 1.
Fig. 5 is a flowchart illustrating a method for processing a projection screen according to another exemplary embodiment.
Fig. 6 is a flowchart illustrating a method for processing a projection screen according to still another exemplary embodiment.
Fig. 7 is a schematic structural diagram of a projection device provided in the embodiment of fig. 6.
Fig. 8 is a schematic diagram of a variation of the display range provided by the embodiment of fig. 6.
Fig. 9 is a schematic diagram of mapping a projection screen into a display range according to the embodiment of fig. 6.
Fig. 10 is a flowchart illustrating a method for processing a projection screen according to still another exemplary embodiment.
Fig. 11 is a block diagram of a projection screen processing apparatus according to an exemplary embodiment.
FIG. 12 is a block diagram of a projection device provided in accordance with an exemplary embodiment.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
With the popularization of projection apparatuses, correction techniques for projection pictures of projection apparatuses have been perfected.
However, the projection picture correction technique in the related art has the following drawbacks:
on one hand, in the current projection picture correction, for the movement of the projection picture, the projection picture is subjected to screenshot under the condition of the maximum picture, then the screenshot is subjected to animation of image transformation, after the animation is completed, the whole screen is darkened, then the bottom layer of the picture is switched, and after the switching is completed, the picture is lightened. So that the user does not perceive the process of a picture jump. However, since the screenshot is changed, the original picture content being played is interrupted and cannot be played normally, and the projection screen becomes dark, so that the user can feel visually obtrusive and uncomfortable, and the user experience is reduced.
On the other hand, in the current projection picture correction, when the projection picture moves, the projection picture is often directly switched from the current state to the final state after correction, so that the change of the projection picture in the correction process can give unsmooth and stiff feeling to people visually, and the user experience is reduced.
In view of the above problems, embodiments of the present disclosure provide a method and an apparatus for processing a projection picture, a storage medium, and a projection device, which can make transition of a projection picture in a correction process smoother, and ensure that picture content can be normally played, thereby improving user experience.
Fig. 1 is a flowchart illustrating a projection screen processing method according to an exemplary embodiment, which is used in a projection apparatus, as shown in fig. 1, and includes the steps of:
110. and determining target coordinates of each corner point of the projection picture in response to a preset correction trigger event aiming at the projection picture.
The target coordinates of each corner point of the projection picture refer to coordinates on an optical machine modulation plane of the projection equipment. Wherein, the modulation plane refers to a plane where an image is generated by a light modulator (chip) of the projection apparatus. The chip corresponding to the modulation plane comprises a reflection type image modulation chip or a transmission type image modulation chip. The reflective image modulation chip includes a DMD chip (Digital Micromirror Device) or an LCOS chip (Liquid Crystal on Silicon ), and the transmissive image modulation chip includes an LCD chip (Liquid Crystal Display ), and the like.
In some embodiments, the preset correction triggering event may include, but is not limited to: a trapezoidal correction event, an automatic screen alignment event, an automatic obstacle avoidance event, and the like.
Illustratively, for example, for a trapezoidal correction event, the projection device may acquire an actual display image of the projection screen through the image detection device of the projection device, and perform image analysis on the actual display image of the projection screen. Alternatively, the image detection device may be a high-definition camera, an industrial camera, or the like. The actual display image of the projection screen may include content corresponding to the projection screen, a projection background, and the like, which is equivalent to a screen image viewed from the user viewing angle captured by the image detection device. And if the analysis result shows that the shape of the projection picture is not the standard shape (such as a rectangle), determining that a trapezoidal correction event is triggered, and determining the coordinates of each corner point of the projection image corrected to be the standard shape as target coordinates.
For another example, for an automatic screen alignment event, the projection device may acquire the position of the projection screen and the position of the standard projection area through an image detection device of the projection device. And if the position of the projection picture does not match the position of the standard projection area, for example, the projection picture is not in the standard projection area, determining that an automatic screen aligning event is triggered, and determining the coordinates of each corner point after the projection picture is moved to the position matched with the position of the standard projection area as target coordinates. Alternatively, the standard projection area may be the area where the projection screen is located.
For another example, for an automatic obstacle avoidance event, the projection device may acquire an image of the projection screen through an image detection device of the projection device, and perform image analysis on the image of the projection screen. And if the analysis result shows that the obstacle exists in the projection picture, determining that an automatic obstacle avoidance event is triggered, and determining that the coordinates of each corner point of the projection picture after the projection picture is moved to the projection picture without the obstacle are determined as target coordinates.
It can be understood that, while determining the target coordinates of each corner point of the projection picture, the projection device may also record the actual coordinates of each corner point of the projection picture on the modulation plane in real time through the modulation plane of the optical machine, that is, the coordinates of the corner point at the current time. The actual coordinates of each corner point also refer to coordinates on an optical machine modulation plane of the projection equipment.
120. And controlling a modulation plane of an optical machine of the projection equipment, and moving the actual coordinates of each angular point to the target coordinates corresponding to the angular point through multiple movements.
In each moving process of each corner point, the moving speed of the corner point is related to the distance between the actual coordinate of the corner point and the target coordinate, and in each moving process of each corner point, the content of the projection picture is generated in real time by the projection equipment according to the data to be projected. Alternatively, the moving speed of the corner point may be positively or negatively correlated with the distance between the actual coordinates and the target coordinates of the corner point.
The data to be projected refers to a plurality of frames of images to be projected, and the content of the projection picture can be changed according to the switching of the plurality of frames of images to be projected.
It is understood that the plurality of movements in this embodiment refer to a plurality of movements of the same corner of the projection screen.
In some embodiments, the projection device may control a modulation plane of its optical engine, move each corner point of the projection picture from an actual coordinate to a corresponding target coordinate through multiple movements within the same time period, specifically, divide a distance between the actual coordinate of the corner point and the corresponding target coordinate into multiple movement steps according to a preset number of movements, and then move the corner point to the target coordinate sequentially through the multiple movement steps.
Exemplarily, as shown in fig. 2, in the modulation plane, the projection picture includes a first corner point, a second corner point, a third corner point, and a fourth corner point. Wherein the actual coordinate of the first corner point is A0The target coordinate is A; the actual coordinate of the second corner point is B0The target coordinate is B, and the actual coordinate of the third corner point is C0Target seatMarked C0(ii) a The actual coordinate of the fourth corner point is D0And the target coordinate of (2) is D. Taking 3 times of movement as an example, the modulation plane can move each corner point from the actual coordinate to the corresponding target coordinate through 3 times of movement, for example, the first corner point can reach the coordinate a after the first movement1After the second movement, coordinate A is reached2Coordinate a is reached after the third movement. Similarly, B may be passed for the second corner point0→B1,B1→B2,B2Three movements of → B arrive at the target coordinates of the second corner point. Wherein, the moving distance and moving direction of the corner point in one movement can be equivalent to the moving step length of the corner point in the current movement, such as A0To A1A moving distance of0In the direction of A1The vector formed by the directions of (a) and (b) can be regarded as the step of movement of the first angular point at the first movement.
It can be understood that there may be no time interval between two adjacent movements, that is, the corner immediately executes the next movement after the step length of the current movement is completed, so that the corner does not pause in the whole moving process.
Optionally, the moving steps corresponding to each corner point are uniformly decreased, or uniformly increased or equal. Exemplarily, taking a uniform reduction between a plurality of movement steps of a corner point as an example, as shown in fig. 3, a first corner point is derived from an actual coordinate a0When moving to the target coordinate A, the L can be passed through in sequence1、L2、L3、L4、L5These 5 steps arrive, where L1、L2、L3、L4、L5Is equal between every two adjacent steps, e.g. L5And L4The difference between is equal to L4And L3The difference between them.
Alternatively, the corner points may be moved from the actual coordinates to the target coordinates by means of a uniform deceleration movement. Exemplarily, as shown in fig. 4, a first corner point is specified from the actual coordinates a0The total time taken to move to the target coordinate A is T0And the actual coordinate A0The distance from the target coordinate a is S, and if the first corner point is to be moved from the actual coordinate a0 to the target coordinate a by moving 5 times, the moving duration corresponding to each moving step is the same, for example, the moving duration T1=T2=T3=T4=T5=T0/5. Wherein, T1The length of the movement for the first movement, which is also the movement step length L1Corresponding movement duration, likewise, T2The movement duration of the second movement. The distance of each movement step is equal to the distance of the movement of the first corner in the corresponding movement duration, e.g. the first movement duration T1Corresponding step size of movement
Figure BDA0003453450560000081
Figure BDA0003453450560000082
Wherein, V0Is the initial velocity, V, of the first corner point0=a·T0. Similarly, T can be calculated2Moving step length L corresponding to time period2=[(V0-a·T1)-1/2·a·T2]·T2. Where a is the acceleration of the first corner point, and a is 2 · S/(T)0·T0). By analogy, the moving step length corresponding to each moving time length in the process that the first angle point moves from the actual coordinate to the target coordinate in a uniform deceleration moving mode can be calculated through the moving step length calculation formula.
In other embodiments, the modulation plane may adjust the moving speed of the corner point in real time according to the distance between the actual coordinate of the corner point and the target coordinate, for example, when the distance between the actual coordinate of the corner point and the target coordinate is smaller, the moving speed of the corner point is smaller, and when the moving speed of the corner point is 0, the corner point just moves to the target coordinate, so as to visually enable the user to feel that the projection picture is gradually moving, and the animation effect presented by the projection picture is smoother. Optionally, for the same corner point, in the process of moving the corner point from the actual coordinate to the target coordinate, the corner point may be moved with uniform acceleration, or moved with uniform deceleration, or moved with uniform velocity, which is not limited herein.
It should be noted that the coordinates and distances referred to in the above embodiments refer to coordinates and distances of corner points of a projection picture on the modulation plane of the optical machine.
It can be seen that, in the present embodiment, the target coordinates of each corner point of the projection picture are determined by responding to a preset correction trigger event for the projection picture; and then controlling a modulation plane of an optical machine of the projection equipment, and moving the actual coordinates of each angular point to the target coordinates corresponding to the angular points through multiple movements. In each moving process of each corner point, the moving speed of the corner point is related to the distance between the actual coordinate of the corner point and the target coordinate, and in each moving process of each corner point, the content of the projection picture is generated in real time by the projection equipment according to the data to be projected. Therefore, when the projection equipment performs picture correction on the projection picture, the picture seen by the user moves to the position to be finally corrected in a progressive mode, so that the change of the picture is smoother, and the picture does not give a hard feeling to the user visually. In addition, in the picture correcting process, as the content of the projection picture is generated by the projection equipment in real time according to the data to be projected, the picture content can be normally played, and a sudden and uncomfortable feeling can not be provided for a user due to the interruption of the picture content, so that the user experience is effectively improved.
Fig. 5 is a flowchart illustrating a projection screen processing method according to another exemplary embodiment, which is used in a projection apparatus, as shown in fig. 5, and includes the steps of:
210. and determining target coordinates of each corner point of the projection picture in response to a preset correction trigger event aiming at the projection picture.
The detailed implementation of step 210 can refer to step 110, and therefore is not described herein.
220. And determining the moving step length of each angular point for each movement according to the preset moving times and the distance between the actual coordinates of each angular point of the projection picture and the target coordinates corresponding to each angular point.
In some embodiments, specific embodiments of step 220 may include:
221. the initial actual coordinates of each corner point are obtained.
For example, the projection apparatus may record coordinates of each corner point of the projection screen before correction in the modulation plane through the modulation plane, and use the coordinates as initial actual coordinates of each corner point, which are fixed coordinates.
222. And determining the moving step length of each angular point for each movement according to the preset moving times and the distance between the initial actual coordinate of each angular point and the corresponding target coordinate.
Illustratively, for the first corner point of the projection picture, its initial actual coordinate is (x)1,y1) The target coordinate is (x)2,y2) The projection device may pass through the initial actual coordinate as (x)1,y1) And the target coordinate is (x)2,y2) And calculating the total moving distance of the first corner point as S.
In one example, if it is set that the first corner point is moved from the actual coordinates to the target coordinates by a uniform motion, a preset moving time period T may be passed0Calculating that the moving speed of the first angular point is S/T0
In one example, if the first corner point is set to move from the actual coordinates to the target coordinates through a uniform subtraction motion, the first corner point may be moved by a preset moving duration T0The acceleration a is calculated to be 2 · S/(T)0·T0) Initial velocity is V0=a·T0The velocity of the angular point at the current time t in the moving process is Vt=[(V0-a·t)。
In one example, if the first corner point is set to move from the actual coordinates to the target coordinates by a uniform motion, the first corner point may be moved by a preset moving duration T0The acceleration a is calculated to be 2 · S/(T)0·T0) The velocity of the angular point at the current time t in the moving process is Vt=a·t。
In another example, if the first corner point is set to move from the actual coordinate to the target coordinate according to the same moving step, the moving step of the first corner point is S/N each time, which can be calculated by a preset number of times of moving N.
In another example, if the first corner point is set to move from the actual coordinates to the target coordinates by a method of sequentially decreasing the moving step size, the first corner point can be calculated by a preset number of times of moving N, the variation d of each step size is 2 · S/(N · N), and then the initial moving step size L is calculated according to the variation of the step size0D.n, finally, calculating the nth moving step length L in the multiple movements according to the initial moving step lengthn=L0-d·n。
In another example, if the first corner point is set to move from the actual coordinates to the target coordinates by a method of increasing the moving step length in sequence, the step length can be calculated by a preset moving number N, the variation d of each step length is 2 · S/(N · N), and then the nth moving step length L of the plurality of movements is calculated according to the variation of the step lengthn=d·n。
Similarly, the moving step length or the moving speed of the other corner points except the first corner point in the plurality of corner points of the projection picture can also be calculated in the above manner.
It should be noted that each corner point of the projection image may need to move by different distances, which causes different accelerations required for the same number of movements, and further causes different corner points to have different movement steps for the same number of movements. For example, referring again to fig. 2, in fig. 2, the initial actual coordinates a of the first corner point0Initial actual coordinates B with a distance from the target coordinates A larger than the second corner point0The distance from the target coordinates B results in a step length (A) for the first corner point of the projection image when the corner points are moved for the first time0→A1) Also larger than the step size (B) of the movement of the second corner point0→B1)。
In the embodiment, the moving step length of each angular point in each movement is determined according to the preset moving times and the distance between the initial actual coordinate of each angular point and the corresponding target coordinate, so that the moving step length of each angular point of the projection picture in each movement is calculated at one time, the angular point only needs to move according to the previously calculated moving step length in the moving process, and the correction efficiency of the projection picture is improved.
In other embodiments, embodiments of step 220 may include:
according to the moving times, the following operations are executed circularly:
first, the actual coordinates of each corner point of the projection screen are acquired.
The actual coordinates of the corner points in this embodiment may be, during the movement of the corner points, the current coordinates of the corner points are real-time coordinates.
And then, determining the moving step length of each corner point in the current movement according to the obtained actual coordinates of each corner point and the obtained distance between the actual coordinates of each corner point and the target coordinates corresponding to each corner point.
Exemplarily, taking the first corner point of the projection screen as an example, the preset number of times of movement is N, the number of times of movement this time is N, and the distance between the actual coordinate of the first corner point and the target coordinate thereof obtained this time is S1Then the moving step length of the current movement of the first corner point may be S1/(N-N). After the movement is completed, the distance between the actual coordinate of the first corner point and the target coordinate of the first corner point can be acquired again as S2And calculating the moving step length of the next movement (i.e. the moving times are n +1) of the first corner point as S1/(N-N-1). By analogy, the projection device may repeatedly perform the above steps until the number of times that the corner has moved is equal to the preset number of times of movement, which indicates that the first corner has moved from the actual coordinate to the target coordinate through N movements, where N and N are positive integers.
Similarly, the moving step length of the other corner points except the first corner point in the plurality of corner points of the projection picture can also be calculated in the above manner.
Considering the situation that the corner points of the projection picture may shift in the process of moving for multiple times, for example, the corner points may shift in the moving direction in a certain movement or the moving step length does not reach the standard, in this embodiment, the actual coordinates of each corner point of the projection picture are obtained again after the corner points of the projection picture move each time, and the moving step length of each corner point move this time is determined according to the remaining moving times and the distance between the actual coordinates of each corner point obtained this time and the target coordinates corresponding to each corner point, so that the corner points can be ensured to accurately reach the target coordinates in the preset moving times, and the correction quality of the projection picture is improved.
230. And controlling the modulation plane to move the actual coordinates of each angular point to the target coordinates corresponding to the angular point according to the moving times and the moving step length of each angular point.
In some embodiments, specific embodiments of step 230 may include:
after the moving step length of each angular point in the current movement is determined each time, the modulation plane is controlled to move each angular point from the obtained actual coordinate to the corresponding target coordinate once according to the moving step length and the direction corresponding to the moving step length.
Fig. 6 is a flowchart illustrating a projection screen processing method according to still another exemplary embodiment, as shown in fig. 6, which is used in a projection apparatus including a system layer, an application layer, and a driving layer, as shown in fig. 7, including the steps of:
310. and the application layer responds to a preset correction trigger event aiming at the projection picture, determines the target coordinates of each corner point of the projection picture and sends the target coordinates to the system layer.
320. The system layer determines the moving step length of each angular point moving on the modulation plane of the optical machine of the projection equipment each time according to the target coordinates and the preset moving times, determines the display range of the projection picture moving on the modulation plane each time according to the moving step length of each angular point, maps the projection picture into the display range, and sends the projection picture in the display range to the driving layer.
Illustratively, as shown in fig. 8, in the maximum display range of the modulation plane, the initial display of the projection screenShown as the coordinate A in the figure0、B0、C0、D0The enclosed range. After each corner point of the projection picture completes the first movement, the display range obtained in the maximum display range of the modulation plane is the coordinate A in the picture1、B1、C0、D1And in the same way, after each corner point of the projection picture finishes the movement after the preset movement times, the display range obtained in the maximum display range of the modulation plane is the coordinate A, B, C in the picture0And D.
Then, the system layer may map the projection screen into the display range obtained after each movement and the like in real time, and exemplarily, as shown in fig. 9, the system layer may map the projection screen 10 into the display range 20, obtaining the projection screen 30 within the display range 20. The picture content corresponding to the projection picture 30 within the display range 20 is relatively independent from the display range 20 and does not change with the change of the display range 20, wherein the picture content may be the picture content played in real time by the projection device.
330. And the driving layer controls an optical machine of the projection equipment to project a projection picture in the display range of the modulation plane, so that the actual coordinates of each corner point move to the corresponding target coordinates.
In each moving process of each corner point, the moving step length of the corner point is related to the distance between the actual coordinate of the corner point and the target coordinate, and in each moving process of each corner point, the content of the projection picture is generated in real time by the projection equipment according to the data to be projected.
The more detailed implementation of steps 310 to 330 can refer to the method for processing the projection image provided in the embodiment of fig. 1 and 5, and therefore is not described herein again.
Fig. 10 is a flowchart illustrating a projection screen processing method according to still another exemplary embodiment, as shown in fig. 10, the projection screen processing method being used in a projection apparatus, the projection apparatus including a system layer, an application layer and a driver layer, as shown in fig. 7, the application layer including a plurality of graphics applications and a screen correction control module, the system layer including an image synthesis module, a corner point movement control module and an image mapping processing module, the method including the steps of:
410. the plurality of graphic applications generate different image elements according to the data to be projected and send the different image elements to the system layer.
Among them, image elements may include, but are not limited to: system interface, floating window, picture image, etc.
420. And the picture correction control module responds to a preset correction trigger event aiming at the projection picture, determines the target coordinates of each corner point of the projection picture and sends the target coordinates to the system layer.
430. The image synthesis module synthesizes different image elements into a projection picture.
440. The angular point movement control module determines the movement step length of each angular point on the modulation plane of the optical machine of the projection equipment in each movement according to the target coordinates and the preset movement times, and determines the display range of the projection picture on the modulation plane after each movement according to the movement step length of each angular point.
In some embodiments, specific embodiments of step 440 may include:
and the corner point movement control module acquires the initial actual coordinates of each corner point sent by the picture correction control module.
And the point movement control module determines the movement step length of each angular point for each movement according to the movement times and the distance between the initial actual coordinate of each angular point and the corresponding target coordinate.
450. The image mapping processing module maps the projection picture into a display range and sends the projection picture in the display range to the driving layer.
In some embodiments, specific embodiments of steps 440 through 450 may include:
according to the moving times, the following operations are executed circularly:
firstly, the application layer acquires the actual coordinates of each corner of the projection picture and sends the actual coordinates to the corner movement control module.
And secondly, the angular point movement control module determines the movement step length of the current movement of each angular point according to the residual movement times and the distance between the actual coordinates of each angular point obtained at this time and the target coordinates corresponding to each angular point.
And then, determining the display range of the projection picture synthesized by the image synthesis module at this time on the modulation plane according to the moving step length of local movement of each corner point.
And finally, the image mapping processing module maps the projection picture into the display range determined this time, and sends the projection picture in the display range to the driving layer so that the driving layer controls the optical machine of the projection equipment to project the projection picture in the display range of the modulation plane determined this time.
460. And the driving layer controls an optical machine of the projection equipment to project a projection picture in the display range of the modulation plane, so that the actual coordinates of each corner point move to the corresponding target coordinates.
In some embodiments, the specific implementation of steps 440 to 460 may include:
according to the preset moving times, the following operations are executed in a circulating mode:
firstly, the angular point movement control module determines the display range of the projection picture synthesized by the image synthesis module at this time on the modulation plane according to the movement step length of each angular point corresponding to the movement at this time.
Secondly, the image mapping processing module maps the projection picture into the display range determined at this time and sends the projection picture in the display range to the driving layer.
And finally, the driving layer controls an optical machine of the projection equipment to project the projection picture within the display range of the modulation plane determined at this time.
For example, the driving layer may include an image processor and an optical machine, the image processor may receive the projection picture in the display range, perform image rendering on the projection picture in the display range, obtain a rendered image, and send the rendered image to the optical machine, and the optical machine may project the projection picture in the display range according to the rendered image.
The system layer may be a native layer in the android system, the Driver layer may be a Driver HW layer in the android system, and the application layer may be a Java layer in the android system. The image mapping processing module may be a Surface flag module, and the image synthesizing module may be an OpenGL module.
In a more specific implementation of steps 410 to 460, reference may be made to the projection image processing method provided in the embodiments of fig. 1, 5 and 6, and thus, the details are not described herein.
Optionally, the moving steps corresponding to each corner point are sequentially decreased, sequentially increased, or equal.
Fig. 11 is a block diagram illustrating a projection screen processing apparatus according to an exemplary embodiment, and as shown in fig. 11, the projection screen processing apparatus 500 includes: an object coordinate determination module 510 and a corner point movement module 520. Wherein:
a target coordinate determination module 510, configured to determine target coordinates of each corner point of the projection picture in response to a preset correction trigger event for the projection picture;
the corner moving module 520 is configured to control a modulation plane of an optical engine of the projection apparatus, and move the actual coordinates of each corner to the target coordinates corresponding to the corner through multiple movements. In each moving process of each corner point, the moving speed of the corner point is related to the distance between the actual coordinate of the corner point and the target coordinate, and in each moving process of each corner point, the content of the projection picture is generated in real time by the projection equipment according to the data to be projected.
In some embodiments, the corner point moving module 520 includes:
and the moving step length determining submodule is used for determining the moving step length of each angular point for each movement according to the preset moving times and the distance between the actual coordinate of each angular point of the projection picture and the target coordinate corresponding to each angular point.
And the target coordinate moving submodule is used for controlling the modulation plane to move the actual coordinates of each angular point to the target coordinates corresponding to the angular points according to the moving times and the moving step length of each angular point moving.
In some embodiments, the apparatus further comprises:
and the initial actual coordinate acquisition module is used for acquiring the initial actual coordinates of each corner point.
Correspondingly, the target coordinate moving submodule is further configured to determine a moving step length of each corner point moving each time according to the moving times and the distance between the initial actual coordinate of each corner point and the corresponding target coordinate.
In some embodiments, the moving step size determining submodule is specifically configured to: according to the moving times, the following operations are executed circularly: acquiring actual coordinates of each corner point of a projection picture; and determining the moving step length of each corner point in the current movement according to the obtained actual coordinates of each corner point and the distance between the obtained actual coordinates of each corner point and the target coordinates corresponding to each corner point.
Correspondingly, the target coordinate moving submodule is specifically configured to: and after the moving step length of each angular point in the current movement is determined each time, controlling the modulation plane to move each angular point from the actual coordinate acquired this time to the corresponding target coordinate once.
In some embodiments, the plurality of moving steps corresponding to each corner point are sequentially decreased, sequentially increased, or equal.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
Fig. 12 is a block diagram illustrating a projection device according to an example embodiment. As shown in fig. 12, the projection apparatus 700 may include: a processor 701 and a memory 702. The projection device 700 may also include one or more of a multimedia component 703, an input/output (I/O) interface 704, and a communication component 705.
The processor 701 is configured to control the overall operation of the projection apparatus 700, so as to complete all or part of the steps in the projection picture processing method. Memory 702 is used to store various types of data to support operation at the projection device 700, such as instructions for any application or method operating on the projection device 700 and application-related data, such as contact data, messaging, pictures, audio, video, and the like. The Memory 702 may be implemented by any type of volatile or non-volatile Memory device or combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read-Only Memory (ROM), magnetic Memory, flash Memory, magnetic disk, or optical disk. The multimedia components 703 may include screen and audio components. Wherein the screen may be, for example, a touch screen and the audio component is used for outputting and/or inputting audio signals. For example, the audio component may include a microphone for receiving external audio signals. The received audio signal may further be stored in the memory 702 or transmitted through the communication component 705. The audio assembly also includes at least one speaker for outputting audio signals. The I/O interface 704 provides an interface between the processor 701 and other interface modules, such as a keyboard, mouse, buttons, etc. These buttons may be virtual buttons or physical buttons. The communication component 705 is used for wired or wireless communication between the projection device 700 and other devices. Wireless Communication, such as Wi-Fi, bluetooth, Near Field Communication (NFC), 2G, 3G, 4G, NB-IOT, eMTC, or other 5G, etc., or a combination of one or more of them, which is not limited herein. The corresponding communication component 705 may thus include: Wi-Fi module, Bluetooth module, NFC module, etc.
In an exemplary embodiment, the projection Device 700 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the above-described projection picture Processing method.
In another exemplary embodiment, there is also provided a computer-readable storage medium including program instructions which, when executed by a processor, implement the steps of the projection screen processing method described above. For example, the computer readable storage medium may be the memory 702 including the program instructions, which are executable by the processor 701 of the projection device 700 to perform the projection screen processing method described above.
In another exemplary embodiment, a computer program product is also provided, which comprises a computer program executable by a programmable apparatus, the computer program having code portions for performing the above-mentioned projection picture processing method when executed by the programmable apparatus.
The preferred embodiments of the present disclosure are described in detail with reference to the accompanying drawings, however, the present disclosure is not limited to the specific details of the above embodiments, and various simple modifications may be made to the technical solution of the present disclosure within the technical idea of the present disclosure, and these simple modifications all belong to the protection scope of the present disclosure.
It should be noted that, in the foregoing embodiments, various features described in the above embodiments may be combined in any suitable manner, and in order to avoid unnecessary repetition, various combinations that are possible in the present disclosure are not described again.
In addition, any combination of various embodiments of the present disclosure may be made, and the same should be considered as the disclosure of the present disclosure, as long as it does not depart from the spirit of the present disclosure.

Claims (15)

1. A method for processing a projection picture, comprising:
responding to a preset correction trigger event aiming at a projection picture, and determining target coordinates of each corner point of the projection picture;
controlling a modulation plane of an optical machine of the projection equipment, and moving the actual coordinates of each angular point to the target coordinates corresponding to the angular point through multiple movements;
in each moving process of each corner point, the moving speed of the corner point is related to the distance between the actual coordinate of the corner point and the target coordinate, and in each moving process of each corner point, the content of the projection picture is generated by the projection equipment in real time according to data to be projected.
2. The method of claim 1, wherein the controlling a modulation plane of an optical engine of the projection device to move the actual coordinates of each of the corner points to the target coordinates corresponding to the corner points through a plurality of movements comprises:
determining the moving step length of each angular point for each movement according to the preset moving times and the distance between the actual coordinate of each angular point of the projection picture and the target coordinate corresponding to each angular point;
and controlling the modulation plane to move the actual coordinates of each corner point to the target coordinates corresponding to the corner points according to the moving times and the moving step length of each time of each corner point.
3. The method of claim 2, wherein before the modulation plane controlling an optical engine of the projection apparatus moves the actual coordinates of each of the corner points to the target coordinates corresponding to the corner points through a plurality of movements, the method further comprises:
acquiring initial actual coordinates of each corner point;
determining a moving step length of each angular point moving each time according to a preset moving frequency and a distance between an actual coordinate of each angular point of the projection picture and the target coordinate corresponding to each angular point, including:
and determining the moving step length of each angular point moving each time according to the moving times and the distance between the initial actual coordinate of each angular point and the corresponding target coordinate.
4. The method according to claim 2, wherein the determining a moving step length of each movement of each corner point according to a preset number of movements and a distance between an actual coordinate of each corner point of the projection picture and the target coordinate corresponding to each corner point comprises:
circularly executing the following operations according to the moving times:
acquiring actual coordinates of each corner point of the projection picture;
determining the moving step length of each corner point moving according to the obtained actual coordinate of each corner point and the distance between the obtained actual coordinate of each corner point and the target coordinate corresponding to each corner point;
the controlling the modulation plane to move the actual coordinates of each corner point to the target coordinates corresponding to the corner point according to the moving times and the moving step length of each moving of each corner point comprises:
and after the moving step length of each angular point in the current movement is determined each time, controlling the modulation plane to move each angular point from the actual coordinate acquired this time to the corresponding target coordinate once.
5. The method according to any one of claims 2 to 4, wherein the moving steps for each corner point are sequentially decreased, sequentially increased or equal.
6. A projection picture processing method is applied to a projection device, wherein the projection device comprises a system layer, an application layer and a driving layer, and the method comprises the following steps:
the application layer responds to a preset correction trigger event aiming at a projection picture, determines target coordinates of each corner point of the projection picture and sends the target coordinates to the system layer;
the system layer determines the moving step length of each angular point moving on a modulation plane of an optical machine of the projection equipment each time according to the target coordinates and preset moving times, determines the display range of the projection picture moving on the modulation plane each time according to the moving step length of each angular point, maps the projection picture into the display range, and sends the projection picture in the display range to the driving layer;
the driving layer controls an optical machine of the projection equipment to project a projection picture in the display range of the modulation plane, so that the actual coordinates of each corner point move to the corresponding target coordinates;
in each moving process of each corner point, the moving step length of the corner point is related to the distance between the actual coordinate of the corner point and the target coordinate, and in each moving process of each corner point, the content of the projection picture is generated by the projection equipment in real time according to data to be projected.
7. The method of claim 6, wherein the application layer comprises a plurality of graphics applications and a picture correction control module, the method further comprising:
the plurality of graphic application programs generate different image elements according to the data to be projected and send the different image elements to the system layer;
the application layer responds to a preset correction trigger event aiming at a projection picture, determines target coordinates of each corner point of the projection picture, and sends the target coordinates to the system layer, and the method comprises the following steps:
the picture correction control module responds to a preset correction trigger event aiming at a projection picture, determines target coordinates of each corner point of the projection picture, and sends the target coordinates to the system layer.
8. The method of claim 7, wherein the system layers comprise an image synthesis module, a corner movement control module, and an image mapping processing module, the method further comprising:
the image synthesis module synthesizes the different image elements into the projection picture;
the system layer determines a moving step length of each movement of each angular point on a modulation plane of an optical machine of the projection equipment according to the target coordinate and preset moving times, determines a display range of the projection picture on the modulation plane according to the moving step length of each angular point, maps the projection picture into the display range, and sends the projection picture in the display range to the driving layer, and the method comprises the following steps:
the angular point movement control module determines a movement step length of each angular point moving on a modulation plane of an optical machine of the projection equipment each time according to the target coordinates and preset movement times, and determines a display range of the projection picture moving on the modulation plane each time according to the movement step length of each angular point;
the image mapping processing module maps the projection picture into the display range and sends the projection picture in the display range to the driving layer.
9. The method of claim 8, wherein before the system layer determines a moving step of each movement of the corner points on a modulation plane of an optical engine of the projection apparatus according to the target coordinates and a preset number of movements, the method further comprises:
the corner point movement control module acquires the initial actual coordinates of each corner point sent by the picture correction control module;
the angular point movement control module determines a movement step length of each angular point moving on a modulation plane of an optical machine of the projection equipment each time according to the target coordinates and preset movement times, and the movement step length includes:
and the corner point movement control module determines the movement step length of each corner point for each movement according to the movement times and the distance between the initial actual coordinate of each corner point and the corresponding target coordinate.
10. The method of claim 9, further comprising:
according to the preset moving times, the following operations are executed in a circulating mode:
the corner point movement control module determines the display range of the projection picture synthesized by the image synthesis module at this time on the modulation plane according to the movement step length of each corner point corresponding to the movement at this time;
the image mapping processing module maps the projection picture into the display range determined this time and sends the projection picture in the display range to the driving layer;
and the driving layer controls an optical machine of the projection equipment to project the projection picture in the display range of the modulation plane determined at this time.
11. The method according to claim 8, wherein the corner point movement control module determines a movement step length of each movement of each corner point on a modulation plane of an optical engine of the projection apparatus according to the target coordinates and a preset number of movements, determines a display range of the projection picture after each movement on the modulation plane according to the movement step length of each corner point, and the image mapping processing module maps the projection picture into the display range and sends the projection picture within the display range to the driving layer, including:
circularly executing the following operations according to the moving times:
the application layer acquires actual coordinates of each corner point of a projection picture and sends the actual coordinates to the corner point movement control module;
the corner point movement control module determines the movement step length of each corner point in the movement according to the residual movement times and the distance between the actual coordinates of each corner point obtained this time and the target coordinates corresponding to each corner point;
determining the display range of the projection picture synthesized by the image synthesis module at this time on the modulation plane according to the moving step length of the local movement of each corner point;
the image mapping processing module maps the projection picture into the display range determined this time, and sends the projection picture in the display range to the driving layer, so that the driving layer controls an optical machine of the projection equipment to project the projection picture in the display range of the modulation plane determined this time.
12. The method according to any one of claims 6 to 11, wherein the moving steps for each corner point are sequentially decreased, sequentially increased, or equal.
13. A projection screen processing apparatus, comprising:
the target coordinate determination module is used for responding to a preset correction trigger event aiming at a projection picture and determining the target coordinates of each corner point of the projection picture;
the corner point moving module is used for controlling a modulation plane of an optical machine of the projection equipment and moving the actual coordinates of each corner point to the target coordinates corresponding to the corner points through multiple times of movement; in each moving process of each corner point, the moving speed of the corner point is related to the distance between the actual coordinate of the corner point and the target coordinate, and in each moving process of each corner point, the content of the projection picture is generated by the projection equipment in real time according to data to be projected.
14. A non-transitory computer readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method according to any one of claims 1 to 5.
15. A projection device, comprising:
a memory having a computer program stored thereon;
a processor for executing the computer program in the memory to carry out the steps of the method of any one of claims 1 to 5.
CN202111672543.4A 2021-12-31 2021-12-31 Projection picture processing method and device, storage medium and projection equipment Active CN114286069B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111672543.4A CN114286069B (en) 2021-12-31 2021-12-31 Projection picture processing method and device, storage medium and projection equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111672543.4A CN114286069B (en) 2021-12-31 2021-12-31 Projection picture processing method and device, storage medium and projection equipment

Publications (2)

Publication Number Publication Date
CN114286069A true CN114286069A (en) 2022-04-05
CN114286069B CN114286069B (en) 2024-04-02

Family

ID=80879799

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111672543.4A Active CN114286069B (en) 2021-12-31 2021-12-31 Projection picture processing method and device, storage medium and projection equipment

Country Status (1)

Country Link
CN (1) CN114286069B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160353068A1 (en) * 2015-05-28 2016-12-01 Masaaki Ishikawa Projection system, image processing apparatus, and computer-readable storage medium
CN107547880A (en) * 2016-06-24 2018-01-05 上海顺久电子科技有限公司 A kind of auto-correction method of projection imaging, device and laser television
CN109917974A (en) * 2019-03-20 2019-06-21 安徽慧视金瞳科技有限公司 A kind of non-linear coordinate mapping method of interactive projection system
WO2019179168A1 (en) * 2018-03-22 2019-09-26 深圳光峰科技股份有限公司 Projection distortion correction method, device and system, and storage medium
CN113489961A (en) * 2021-09-08 2021-10-08 深圳市火乐科技发展有限公司 Projection correction method, projection correction device, storage medium and projection equipment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160353068A1 (en) * 2015-05-28 2016-12-01 Masaaki Ishikawa Projection system, image processing apparatus, and computer-readable storage medium
CN107547880A (en) * 2016-06-24 2018-01-05 上海顺久电子科技有限公司 A kind of auto-correction method of projection imaging, device and laser television
WO2019179168A1 (en) * 2018-03-22 2019-09-26 深圳光峰科技股份有限公司 Projection distortion correction method, device and system, and storage medium
CN109917974A (en) * 2019-03-20 2019-06-21 安徽慧视金瞳科技有限公司 A kind of non-linear coordinate mapping method of interactive projection system
CN113489961A (en) * 2021-09-08 2021-10-08 深圳市火乐科技发展有限公司 Projection correction method, projection correction device, storage medium and projection equipment

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
DRISS AZOUGAGH ET AL.: "Auto-fit multiple movable projections into one display screen", 《2019 INTERNATIONAL CONFERENCE ON WIRELESS TECHNOLOGIES, EMBEDDED AND INTELLIGENT SYSTEMS (WITS)》, pages 1 - 4 *
方承志等: "基于变步长的旋转投影变换法", 《计算机技术与发展》, no. 9, pages 107 - 109 *
邢硕: "条纹投射技术中的全参数标定及畸变校正", 《中国博士学位论文全文数据库 (基础科学辑)》, no. 2 *

Also Published As

Publication number Publication date
CN114286069B (en) 2024-04-02

Similar Documents

Publication Publication Date Title
CN108351691B (en) Remote rendering for virtual images
US9928655B1 (en) Predictive rendering of augmented reality content to overlay physical structures
KR102298378B1 (en) Information processing device, information processing method, and program
US20190221029A1 (en) Image processing apparatus, image processing method, and storage medium
US10754420B2 (en) Method and device for displaying image based on virtual reality (VR) apparatus
JP2017181666A (en) Information processing device, information processing method, and program
EP3261367A1 (en) Improving perception of sound objects in mediated reality
KR20120012858A (en) Apparatus and method for rendering object in 3d graphic terminal
CN112384954A (en) 3-D transition
EP3719613A1 (en) Rendering captions for media content
JP2024026151A (en) Methods, systems, and media for rendering immersive video content using foveated meshes
US11269250B2 (en) Information processing apparatus, information processing method, and program
US11443487B2 (en) Methods, apparatus, systems, computer programs for enabling consumption of virtual content for mediated reality
WO2017212999A1 (en) Video generation device, video generation method, and video generation program
CN114787874A (en) Information processing apparatus, information processing method, and recording medium
CN114286069A (en) Projection picture processing method and device, storage medium and projection equipment
JP7318669B2 (en) Display method and display system
CN110494915B (en) Electronic device, control method thereof, and computer-readable medium
US10869156B2 (en) Audio processing
CN112313714A (en) Method for displaying content and electronic device
US11948257B2 (en) Systems and methods for augmented reality video generation
US11423516B2 (en) Gaze enhanced natural motion blur
US20230405475A1 (en) Shooting method, apparatus, device and medium based on virtual reality space
US20230186538A1 (en) Perspective correct vector graphics with foveated rendering
US20230077410A1 (en) Multi-View Video Codec

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant