WO2020119633A1 - 一种投影画面自动校正方法、系统 - Google Patents

一种投影画面自动校正方法、系统 Download PDF

Info

Publication number
WO2020119633A1
WO2020119633A1 PCT/CN2019/124013 CN2019124013W WO2020119633A1 WO 2020119633 A1 WO2020119633 A1 WO 2020119633A1 CN 2019124013 W CN2019124013 W CN 2019124013W WO 2020119633 A1 WO2020119633 A1 WO 2020119633A1
Authority
WO
WIPO (PCT)
Prior art keywords
correction
angle
corrected
projection
scale parameter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2019/124013
Other languages
English (en)
French (fr)
Inventor
郭海光
程俊
高向阳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Institute of Advanced Technology of CAS
Original Assignee
Shenzhen Institute of Advanced Technology of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Institute of Advanced Technology of CAS filed Critical Shenzhen Institute of Advanced Technology of CAS
Publication of WO2020119633A1 publication Critical patent/WO2020119633A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179Video signal processing therefor
    • H04N9/3185Geometric adjustment, e.g. keystone or convergence
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3141Constructional details thereof
    • H04N9/3173Constructional details thereof wherein the projection device is specially adapted for enhanced portability

Definitions

  • the invention relates to the technical field of projection correction, in particular to a method and system for automatic correction of a projection picture.
  • the mobile projection needs to adjust the relative position of the projection machine and the projection surface each time it is used. Generally, it is necessary to ensure that the projection is centered and perpendicular to the screen to obtain the best projection effect. In some occasions, the conditions cannot be reached, so that the projected picture will be deformed, which will seriously affect the viewing effect.
  • the common adjustment methods currently on the market are mechanical and push-button.
  • the mechanical adjustment method needs to add a correction mechanical structure when designing the optical machine, which increases the design difficulty of the optical machine, and the adjustment range is generally small;
  • the user calls the control software through the buttons on the projection host or the remote control to adjust the deformation of the screen.
  • the adjustment is more difficult, requiring the user to manually adjust while observing the screen, and the operation is cumbersome.
  • the present invention provides a method and system for automatically correcting a projection picture, to solve the existing technical problem of tedious manual operation in the process of projection correction.
  • a method for automatically correcting projection images including:
  • the first angle of the current projection where the first angle includes a depression angle or an elevation angle
  • the first corrected scale parameter is the corrected upper and lower side scale parameters
  • the second corrected scale parameter is the corrected left and right side scale parameters
  • adjusting the projection image includes:
  • the projector is driven to adjust the projection screen adapted to the first correction scale parameter and/or the second correction scale parameter.
  • the lengths of the left and right sides of the shadow picture are corrected according to the short sides of the left and right sides, including:
  • step (3) If the difference between the length of the first side and the short side is less than the first error, the length of the first side is the corrected long side, otherwise, continue to perform step (1).
  • the first angle is obtained based on sensing by the gravity sensing module
  • the lower side of the projection screen is used as a reference to correct the upper side
  • the lower side is corrected based on the upper side of the projection screen.
  • ⁇ 2 is the projection elevation angle
  • u is the upper side to be corrected
  • u1 is the corrected upper side
  • y and v are the left and right sides of the projection screen, respectively.
  • adjusting the projection image according to the first correction scale parameter and/or the second correction scale parameter also includes:
  • the corrected image is adjusted in proportion to the corrected upper or lower side as a reference.
  • An automatic correction system for projection images including:
  • the gravity sensing module obtains the first angle of the current projection, the first angle includes a depression angle or an elevation angle;
  • a first correction module performing correction on the upper side or the lower side of the projection screen based on the first angle to obtain a first correction scale parameter
  • an image capture device to capture the projected picture
  • a second correction module to obtain the length of the left and right sides of the projected picture, and correct the longer side according to the shorter left and right sides to obtain the second correction scale parameter ;
  • the arithmetic control unit adjusts the projected picture according to the first corrected scale parameter and/or the second corrected scale parameter.
  • the first corrected scale parameter is the corrected upper and lower side scale parameters
  • the second corrected scale parameter is the corrected left and right side scale parameters
  • the arithmetic control unit includes:
  • the projector is driven to adjust the projection screen adapted to the first correction scale parameter and/or the second correction scale parameter.
  • the second correction module includes:
  • the second calculation unit obtains the coordinates of the four corner points of the projection screen, and obtains the lengths of the left and right sides of the shadow screen according to the coordinates of the four corner points;
  • a second sub-correction unit setting a first error, the length of the long side minus the first error to obtain the length of the corrected first side;
  • the second determination unit if the difference between the length of the first side and the short side is less than the first error, then the length of the first side is the corrected long side, otherwise, the second calculation unit continues to be executed 2.
  • the second sub-correction unit if the difference between the length of the first side and the short side is less than the first error, then the length of the first side is the corrected long side, otherwise, the second calculation unit continues to be executed 2.
  • the gravity sensing module includes: the first angle is obtained based on sensing by the gravity sensing module;
  • the first correction unit includes: when the first angle is an elevation angle, correct the upper side based on the lower side of the projection screen; when the first angle is a depression angle, use the upper side of the projection screen Use the side as the reference and correct the lower side.
  • ⁇ 2 is the projection elevation angle
  • u is the upper side to be corrected
  • u1 is the corrected upper side
  • y and v are the left and right sides of the projection screen, respectively.
  • the arithmetic control unit includes:
  • the proportional adjustment module adjusts the corrected picture proportionally based on the corrected upper side or lower side according to the projection resolution.
  • the deformation and the pitch deformation and the rotation deformation are generated based on the projected picture
  • two types of modules are specifically designed to respectively handle the picture deformation caused by the pitch and rotation.
  • the first correction module performs pitch correction according to the pitch deformation sensed by the gravity sensor module
  • the second correction module corrects the deformation caused by the rotation, so that the user does not need to manually operate and adaptively adjust the projection screen to make the projection within a certain range Arranged randomly in the system, the system can automatically adjust the picture to keep the effective content rectangular and achieve a better display effect; and use two independent modules to deal with the deformation caused by different reasons, the system reliability is better.
  • FIG. 1 is a structural diagram of an automatic projection correction system according to Embodiment 1 of the present invention.
  • FIG. 2 is three kinds of picture deformation of the projection picture in the first embodiment of the invention.
  • FIG. 3 is a calibration flowchart corresponding to the situation C deformation of the projected picture in the first and second embodiments of the present invention
  • 4-8 are schematic diagrams of the correction process of the C deformation of the projected picture in the first and second embodiments of the present invention.
  • FIG. 1 is a structural diagram of an automatic projection correction system according to Embodiment 1 of the present invention.
  • the projection device is a device that can be connected to a computer and other devices to pass video signals selected by the user
  • the built-in photoelectric conversion unit projects.
  • the projection surface can be any flat surface.
  • projection In use, projection generally encounters three kinds of screen deformation, as shown in Figure 2.
  • the projection is vertical and centered on the projection surface, but the height before and after the projection is different, which will cause the projected picture to become a trapezoid with different widths at the top and bottom;
  • Case B projecting on one side of the projection surface will cause the projected picture to have a trapezoid shape with different widths on the left and right sides;
  • the projection position is random, which may cause deformation on all four sides of the projection screen.
  • the automatic correction system can correct these projection deformations, and obtain a rectangular area with the largest area while keeping the aspect ratio unchanged, so that the projection content can be displayed in the area without deformation.
  • An embodiment of the present invention provides an automatic projection correction system.
  • the automatic projection correction system includes:
  • the gravity sensing module senses the first angle of the current projection, the first angle includes a depression angle or an elevation angle;
  • the module is a MEMS chip with a gyroscope principle.
  • the micromechanical structure inside is a vibrating part.
  • the Coriolis acceleration generated by its rotation is measured to obtain the angular velocity.
  • the direction of gravity is judged by measuring the direction of gravity acceleration. Know the attitude of the projection in space.
  • a first correction module (not shown in the figure), performing the correction of the upper side or the lower side of the projection screen based on the first angle, to obtain a first correction scale parameter;
  • the attitude is a deformation due to the change in pitch angle.
  • the gravity sensor module is installed in the projector. When the projection is tilted up and down, the upper and lower sides (a, b) will not be the same length.
  • the gravity sensor module can obtain the angle between the current projection and the direction of gravity (angle 1 in Figure 2) . First, judge whether the current included angle is depression angle or elevation angle according to the included angle direction, the elevation angle correction side a, and the depression angle correction side b, and then calculate the compensation amount of the correction side from the triangle formula according to the included angle size.
  • the image capture device captures the projected picture
  • the second correction module (not shown in the figure)) obtains the lengths of the left and right sides of the projected picture, based on the shorter left and right sides To calibrate the longer side to obtain the second calibration scale parameter;
  • the image capture device is mainly composed of a camera.
  • the camera must be able to collect high-definition resolution images, and the acquisition frame rate is greater than 24 frames per second, and the exposure can be dynamically adjusted.
  • the angle of view of the camera is larger than the projection angle of the projection device, so that the camera can capture the complete projection picture.
  • the posture is due to the deformation caused by the rotation of the host, and the closed-loop negative feedback method is used here to compensate for the correction.
  • the posture is the deformation caused by the combination of the host’s pitch and rotation, so it can be decomposed into two steps to compensate for the correction.
  • FIG. 4 is a projection picture before correction, and it can be seen that the four sides (x, y, u, v in FIG. 4) have obvious deformation, assuming that the projection resolution is 640x480 , Then the edges x and u are 640, and y and v are 480.
  • the gravity sensing module includes: the first angle is obtained based on sensing by the gravity sensing module;
  • the first correction unit includes: when the first angle is an elevation angle, correct the upper side based on the lower side of the projection screen; when the first angle is a depression angle, use the upper side of the projection screen Use the side as the reference and correct the lower side.
  • the current pitch angle is measured by the gravity sensor module ( ⁇ 2 in Figure 2), and it is determined whether the current is the pitch angle or the elevation angle according to the direction of ⁇ 2, as shown in Figure 2 ⁇ 2 is the elevation angle, when it is the elevation angle Then, based on the side x, the side u is corrected. Find the corrected edge u1 from the trigonometric function.
  • the first corrected proportional parameter is the corrected upper and lower side proportional parameters
  • the proportional parameter can be obtained from the original side length u, which is the first corrected proportional parameter, and substituted into the projection drive control module.
  • the second correction module includes:
  • the second calculation unit obtains the coordinates of the four corner points of the projection screen, and obtains the lengths of the left and right sides of the shadow screen according to the coordinates of the four corner points;
  • a second sub-correction unit setting a first error, the length of the long side minus the first error to obtain the length of the corrected first side;
  • the second determination unit if the difference between the length of the first side and the short side is less than the first error, then the length of the first side is the corrected long side, otherwise, the second calculation unit continues to be executed 2.
  • the second sub-correction unit if the difference between the length of the first side and the short side is less than the first error, then the length of the first side is the corrected long side, otherwise, the second calculation unit continues to be executed 2.
  • the second corrected proportional parameters are the corrected left and right side proportional parameters
  • the projection screen is captured by the image acquisition device. Since the projection screen is brighter than the projection surface, a control algorithm is used to extract the coordinates of the four corner points in the camera acquisition screen, and find the left and right two The length of the side (as shown in Figure 5y1, v1). Compare the two sides to determine which side is long. If the difference is less than the allowable error value ⁇ , then complete the correction. If it is larger, further correction is needed. Here, set ⁇ to 5 pixels. In Figure 5, v1 is longer than y1, and y1 is used as Baseline, correct side v1.
  • the operation control unit includes: driving the projector to adjust the projection screen adapted to the first correction scale parameter and/or the second correction scale parameter according to the first correction scale parameter and/or the second correction scale parameter.
  • the arithmetic control unit includes:
  • the proportional adjustment module adjusts the corrected picture proportionally based on the corrected upper side or lower side according to the projection resolution.
  • the final corrected screen shown in FIG. 8 is obtained, and the display ratio of the character pattern is consistent with the source screen.
  • the above correction parameters are saved, and the system acquires the new projection host and the state of the picture through the gravity sensing module and the image acquisition device every 5 seconds. If there is any change, re-enter the calibration operation from the beginning.
  • the projection angle of the projection light machine is different from the field angle of the camera.
  • the field angle is larger than the projection angle of the light machine, so that the complete projection screen can be captured.
  • FIG. 3 is the projection screen before correction, and the obvious deformation on the four sides (x, y, u, v in FIG. 4) can be seen.
  • the projection resolution is 640x480
  • the sides x and u are 640
  • y and v are 480.
  • This embodiment provides a method for automatically correcting a projection image, including:
  • the first angle includes a depression angle or an elevation angle
  • the first corrected scale parameter is the corrected upper and lower side scale parameters
  • the second corrected scale parameter is the corrected left and right side scale parameters
  • adjusting the projection image includes:
  • the projector is driven to adjust the projection screen adapted to the first correction scale parameter and/or the second correction scale parameter.
  • the lengths of the left and right sides of the shadow picture are corrected according to the short sides of the left and right sides, including:
  • step (3) If the difference between the length of the first side and the short side is less than the first error, the length of the first side is the corrected long side, otherwise, continue to perform step (1).
  • the first angle is obtained based on sensing by the gravity sensing module
  • the lower side of the projection screen is used as a reference to correct the upper side
  • the lower side is corrected based on the upper side of the projection screen.
  • ⁇ 2 is the projection elevation angle
  • u is the upper side to be corrected
  • u1 is the corrected upper side
  • y and v are the left and right sides of the projection screen, respectively.
  • adjusting the projection image according to the first correction scale parameter and/or the second correction scale parameter also includes:
  • the corrected image is adjusted in proportion to the corrected upper or lower side as a reference.
  • the current pitch angle (angle 2 in Figure 2) (first angle) is measured by the gravity sensing module, and the current angle of depression or elevation is determined according to the direction of angle 2, as shown in Figure 2 angle 2 is Elevation angle, when it is elevation angle, use side x as the reference, and correct side u. Find the corrected edge u1 from the trigonometric function.
  • the proportional parameter can be obtained from the original side length u, and then substituted into the projection drive control module. After the correction, the corrected figure 5 can be obtained.
  • Step two capture the projected image through the image acquisition device. Since the projected image is brighter than the projection surface, the control algorithm is used to extract the coordinates of the four corner points in the camera acquisition image and find the left and right two The length of the side (as shown in Figure 5y1, v1). Compare the two sides to determine which side is long. If the difference is less than the allowable error value ⁇ , then complete the correction. If it is larger, further correction is needed. Here, set ⁇ to 5 pixels. In Figure 5, v1 is longer than y1, and y1 is used as Baseline, correct side v1.
  • Step 3 After the length difference between the left and right sides is less than the error value, calculate the length of the four sides (x2, y1, u3, v3) in Figure 7 respectively, calculate the aspect ratio, and compare it with the original resolution (640x480) .
  • the reference side x in the above lower side is corrected to x2 as the new reference, and the other three sides are corrected:
  • Step 4 Save the above calibration parameters.
  • the system obtains the new projection host and screen status through the gravity sensor module and the image acquisition device every 5 seconds. If there is no change, no change will be made. If there is any change, re-enter the calibration operation from the first step.
  • the deformation and the pitch deformation and the rotation deformation are generated based on the projected picture
  • two types of modules are specifically designed to deal with the picture deformation caused by the pitch and rotation, respectively.
  • the first correction module performs pitch correction according to the pitch deformation sensed by the gravity sensor module
  • the second correction module corrects the deformation caused by the rotation, so that the user does not need to manually operate and adaptively adjust the projection screen to make the projection within a certain range Arranged randomly in the system, the system can automatically adjust the picture to keep the effective content rectangular and achieve a better display effect; and use two independent modules to deal with the deformation caused by different reasons, the system reliability is better.
  • each functional unit in each embodiment of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units may be integrated into one module.
  • the above integrated modules may be implemented in the form of hardware or software function modules. If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.
  • the embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer usable storage media (including but not limited to disk storage and optical storage, etc.) containing computer usable program code.
  • a computer usable storage media including but not limited to disk storage and optical storage, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Geometry (AREA)
  • Projection Apparatus (AREA)
  • Transforming Electric Information Into Light Information (AREA)

Abstract

本发明提供一种投影画面自动校正方法、系统,属于投影校正技术领域。通过获取当前投影的第一角度,所述第一角度包括俯角或仰角;基于所述第一角度执行投影画面的上侧边或下侧边校正,得到第一校正比例参数;和/或,捕捉投影画面,获取投影画面的左、右侧边长度,根据左、右的较短侧边来校正较长侧边,得到第二校正比例参数;根据第一校正比例参数和/或第二校正比例参数,调整投影画面。通过本方案,自适应调整投影画面,使投影在一定范围内随意摆放,系统都可以自动调整画面,使有效内容保持矩形,达到较好显示效果。

Description

一种投影画面自动校正方法、系统 技术领域
本发明涉及投影校正技术领域,尤其涉及一种投影画面自动校正方法、系统。
背景技术
随着移动便携式投影的发展,近几年来投影进入了人们的普通生活中。传统固定式投影,投影与投射面的相对位置固定,且一般垂直居中,投影画面在投影安装好后即会调整好,后期无需再作调整配置。而便携式投影也正因为携带上的方便,每次使用时,由于摆放位置的不同往往需要先调整设置来校正画面,才能达到最佳显示效果。
移动式的投影在每次使用时需要调整投影机器与投影面的相对位置,一般需要确保投影与画面居中垂直,才能获得最佳投影效果。在某些场合由于条件限制无法达到,这样投影画面即会产生形变,严重观影效果。
目前市面上常见的调整方法有机械式和按键式,其中,机械式调整方式,需要在设计光机时就加入校正机械结构,增加光机的设计难度,而且调整范围一般较小;而按键式调整方式,由用户通过投影主机或遥控器上的按键调用控制软件来调整画面的形变,而对于随意摆放的移动式投影,调整难度加大,需要用户一边观察画面一边手动调整,操作繁琐。
发明内容
有鉴于此,本发明提供了一种投影画面自动校正方法、系统,用以解决现有的针对投影校正过程中手动操作繁琐的技术问题。
本发明的技术方案如下:
一种投影画面自动校正方法,包括:
获取当前投影的第一角度,所述第一角度包括俯角或仰角;
基于所述第一角度执行投影画面的上侧边或下侧边校正,得到第一校正比例参数;
和/或,捕捉投影画面;获取投影画面的左、右侧边长度,根据左、右的较短侧边来校正较长侧边,得到第二校正比例参数;
根据第一校正比例参数和/或第二校正比例参数,调整投影画面。
相应的,所述第一校正比例参数为校正后的上、下侧边比例参数;所述第二校正比例参数为校正后的左、右侧边比例参数;
根据第一校正比例参数和/或第二校正比例参数,调整投影画面包括:
根据第一校正比例参数和/或第二校正比例参数,驱动投影仪调整适应于第一校正比例参数和/或第二校正比例参数的投影画面。
相应的,所述影画面的左、右侧边长度,根据左、右侧边中的短侧边来校正长侧边,包括:
(1)获取投影画面的四个角点坐标,根据所述四个角点坐标获取所述影画面的左、右侧边长度;
(2)设置第一误差,所述长侧边长度减去第一误差获得校正后的第一侧边的长度;
(3)若所述第一侧边的长度与短侧边的差值小于第一误差,则将所述第一侧边的长度为校正长侧边,否则,继续执行步骤(1)。
相应的,所述第一角度基于重力感应模块感测获取;
当所述第一角度为仰角时,以投影画面的下侧边为基准,校正上侧边;
当所述第一角度为俯角时,以投影画面的上侧边为基准,校正下侧边。
相应的,当所述第一角度为仰角时,以投影画面的下侧边为基准,校正上侧边,包括:基于公式u1=u-ysin∠2-vsin∠2校正上侧边;
其中,所述∠2为投影仰角,u为待修正的上侧边,u1为校正后的上侧边,y,v分别为投影画面的左、右侧边。
相应的,根据第一校正比例参数和/或第二校正比例参数,调整投影画面,还包括:
获得一投影分辨率;
根据所述投影分辨率,以校正后的上侧边或下侧边为基准,来等比例调整校正后的画面。
一种投影画面自动校正系统,包括:
重力感应模块,获取当前投影的第一角度,所述第一角度包括俯角或仰角;
第一校正模块,基于所述第一角度执行投影画面的上侧边或下侧边校正,得到第一校正比例参数;
和/或,图像捕捉装置,捕捉投影画面;第二校正模块,获取投影画面的左、右侧边长度,根据左、右的较短侧边来校正较长侧边,得到第二校正比例参数;
运算控制单元,根据第一校正比例参数和/或第二校正比例参数,调整投影 画面。
相应的,所述第一校正比例参数为校正后的上、下侧边比例参数;所述第二校正比例参数为校正后的左、右侧边比例参数;
所述运算控制单元包括:
根据第一校正比例参数和/或第二校正比例参数,驱动投影仪调整适应于第一校正比例参数和/或第二校正比例参数的投影画面。
相应的,所述第二校正模块包括:
第二计算单元,获取投影画面的四个角点坐标,根据所述四个角点坐标获取所述影画面的左、右侧边长度;
第二子校正单元,设置第一误差,所述长侧边长度减去第一误差获得校正后的第一侧边的长度;
第二判定单元,若所述第一侧边的长度与短侧边的差值小于第一误差,则将所述第一侧边的长度为校正长侧边,否则,继续执行第二计算单元、第二子校正单元。
相应的,所述重力感应模块,包括:所述第一角度基于重力感应模块感测获取;
所述第一校正单元,包括:当所述第一角度为仰角时,以投影画面的下侧边为基准,校正上侧边;当所述第一角度为俯角时,以投影画面的上侧边为基准,校正下侧边。
相应的,所述第一校正单元,当所述第一角度为仰角时,以投影画面的下侧边为基准,校正上侧边,包括:基于公式u1=u-ysin∠2-vsin∠2校正上侧边;
其中,所述∠2为投影仰角,u为待修正的上侧边,u1为校正后的上侧边,y,v分别为投影画面的左、右侧边。
相应的,所述运算控制单元,包括:
获取模块,获得一投影分辨率;
等比例调整模块,根据所述投影分辨率,以校正后的上侧边或下侧边为基准,来等比例调整校正后的画面。
在本发明实施例的方案中,由于基于投影画面产生形变的俯仰形变以及旋转形变,从而针对性设计了采用两种模块分别处理俯仰和旋转导致的画面形变。其中,第一校正模块,根据重力感应模块感测的俯仰形变进行俯仰校正,而第二校 正模块针对旋转导致的形变进行校正,从而无需用户手动操作,自适应调整投影画面,使投影在一定范围内随意摆放,系统都可以自动调整画面,使有效内容保持矩形,达到较好显示效果;且采用两个独立模块处理不同的原因产生的形变,系统可靠性更好。
附图说明
图1为本发明实施例一的投影自动校正系统结构图;
图2为本发明实施例一的投影画面三种画面形变情况;
图3为本发明实施例一、二的投影画面情形C形变所对应的校正流程图;
图4-8为本发明实施例一、二的投影画面情形C形变校正过程示意图。
具体实施方式
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。
实施例一
本发明实施例一种投影自动校正系统,图1为本发明实施例一的投影自动校正系统结构图,实际应用中,投影装置,是一种可以连接计算机等设备,把用户选择的视频信号通过内置的光电转换单元投射出来,本方法中投影面可以是任意的平整平面。
投影在使用中一般会碰到三种画面形变,如图2所示。
情形A,投影与投影面垂直且居中,但是投影前后高低不同,会导致投影画面成一个上下边不一样宽的梯形;
情形B,投影在投影面的一侧,会导致投影画面成左右侧边不一样宽的梯形;
情形C,投影位置随意,则可能导致投影画面四边都发生形变。自动校正系统可以修正这些投影形变,在保持长宽比不变的前提下求得一个面积最大的矩形区域,使投影内容在该区域内能无形变的显示。
从空间几何上来说,产生这些形变的主要原因就是投影机在空间上产生了旋转、平移、俯仰等,只要求取出这些参数即可通过公式得出校正方案。
本发明实施例一种投影自动校正系统,所述投影自动校正系统包括:
重力感应模块,感测当前投影的第一角度,所述第一角度包括俯角或仰角;
实际应用中,该模块是一种陀螺仪原理的MEMS芯片,里面的微机械结构为振动件,测量其旋转产生的科氏加速度来获得角速度,通过测量重力加速度方向来判断重力的方向,从而得知投影在空间中的姿态。
第一校正模块(图中未示出),基于所述第一角度执行投影画面的上侧边或下侧边校正,得到第一校正比例参数;
实际应用中,针对情形A,从姿态上来说是由于俯仰角度变化产生的形变。重力感应模块安装在投影机内,当投影成上下倾斜投影时,上下边(a、b)会不一样长,重力感应模块可以获得当前投影与重力方向的夹角(如图二中角1)。首先根据夹角方向判断当前夹角是俯角还是仰角,仰角修正边a,俯角修正边b,然后再根据夹角大小由三角公式计算出修正边的补偿量。
本实施例中,和/或,图像捕捉装置,捕捉投影画面;第二校正模块(图中未示出)),获取投影画面的左、右侧边长度,根据左、右的较短侧边来校正较长侧边,得到第二校正比例参数;
实际应用中,图像捕捉装置,主要由一个摄像头组成。其中摄像头要能采集高清分辨率图像,且采集帧率大于24帧每秒,曝光可以动态调节。摄像头的视场角要大于投影装置的投射角,以便摄像头能捕捉到完整的投影画面。
相应的,针对情形B,从姿态上来说是由于主机旋转后产生的形变,这里采用闭环负反馈方式来补偿修正。首先使用图像采集装置抓取投影画面,提取出投影的四个角点,然后计算出两条侧边(c、d)的长度差,如果这个差值大于设定的误差值,则以短边为基础修正较长的边;之后再重复该操作,再次抓取投影画面计算两边长度差进行修正,直到两边长度差在误差范围内后停止调节。
相应的,针对情形C,从姿态上来说是主机俯仰和旋转组合后产生的形变,因此可以分解为两步来补偿修正,先使用重力感应模块修正上下边的形变,然后再使用图像采集装置修正两侧边。
进一步,以投影画面情形C形变作为实例阐述本实施例,图4是校正前的投影画面,可以看到四边(图4中x、y、u、v)明显的形变,假设投影分辨率为640x480,则边x、u即为640,y、v为480。
本实施例,所述重力感应模块,包括:所述第一角度基于重力感应模块感测获取;
所述第一校正单元,包括:当所述第一角度为仰角时,以投影画面的下侧边为基准,校正上侧边;当所述第一角度为俯角时,以投影画面的上侧边为基准, 校正下侧边。
相应的,通过重力感应模块测量出当前的俯仰角(图2中的∠2),并根据∠2的方向判断出当前是俯角还是仰角,如图二中∠2即为仰角,当为仰角时则以边x为基准,修正边u。根据三角函数求出修正后的边u1。
u1=u-ysin∠2-vsin∠2
本实施例,所述第一校正比例参数为校正后的上、下侧边比例参数;
上式得出修正后的u1后即可与原边长u求取比例参数,即为第一校正比例参数,代入投影驱动控制模块。
本实施例,所述第二校正模块包括:
第二计算单元,获取投影画面的四个角点坐标,根据所述四个角点坐标获取所述影画面的左、右侧边长度;
第二子校正单元,设置第一误差,所述长侧边长度减去第一误差获得校正后的第一侧边的长度;
第二判定单元,若所述第一侧边的长度与短侧边的差值小于第一误差,则将所述第一侧边的长度为校正长侧边,否则,继续执行第二计算单元、第二子校正单元。
本实施例,所述第二校正比例参数为校正后的左、右侧边比例参数;
具体地,如图5所示,通过图像采集装置抓取投影画面,由于投影画面比投影面更亮,采用控制算法提取出四个角点在摄像头采集画面中的坐标,并求出左右两条侧边(如图5y1、v1)长度。比较两边判断出哪条边长,如果差值小于允许的误差值Δ则完成修正,如大于则还需要进一步修正,这里设Δ为5个像素,图5中v1比y1长,则以y1为基准,修正边v1。假设我们采用的修正最小单位为5个像素,则在v1基础上减去5个像素得到v2,然后求取与v1的比例参数,即为第二校正比例参数,代入投影驱动控制模块,得到新的修正画面,如图6所示。
然后,再通过采集装置抓取投影画面,使用上述方法调整边v2。直到左右长短边差值小于误差值Δ即得到图7。
本实施例,所述运算控制单元包括:根据第一校正比例参数和/或第二校正比例参数,驱动投影仪调整适应于第一校正比例参数和/或第二校正比例参数的投影画面。
本实施例,所述运算控制单元,包括:
获取模块,获得一投影分辨率;
等比例调整模块,根据所述投影分辨率,以校正后的上侧边或下侧边为基准,来等比例调整校正后的画面。
相应的,左右边长差值小于误差值后,分别再次计算图七中四边(x2、y1、u3、v3)长度,计算一下长宽比,与原图分辨率(640x480)所得长宽比比较。以上下边中的基准边x修正后的x2为新基准,修正另外三边:
u4=x2
y2=x2×480÷640
v4=y2
得到图8所示最终校正后的画面,使字符图案显示的比例与信号源画面一致。
相应的,保存上述校正参数,系统每隔5秒通过重力感应模块与图像采集装置获取新的投影主机与画面状态,如无变化则不做变化。如有变化则从重新开始重新进入校正操作。
关于进行投影画面图像捕捉的图像捕捉装置,需要满足一个条件。投影光机的投射角和摄像头的视场角大小不一样,选择摄像头时需要视场角大于光机的投射角,这样才可以捕捉到完整的投影画面。
实施例二
本实施例,如图3所示,以投影画面情形C形变作为实例阐述具体实施方案,图4是校正前的投影画面,可以看到四边(图四x、y、u、v)明显的形变,假设投影分辨率为640x480,则边x、u即为640,y、v为480。
本实施例提供一种投影画面自动校正方法,包括:
感测当前投影的第一角度,所述第一角度包括俯角或仰角;
基于所述第一角度执行投影画面的上侧边或下侧边校正,得到第一校正比例参数;
和/或,捕捉投影画面;获取投影画面的左、右侧边长度,根据左、右的较短侧边来校正较长侧边,得到第二校正比例参数;
根据第一校正比例参数和/或第二校正比例参数,调整投影画面。
相应的,所述第一校正比例参数为校正后的上、下侧边比例参数;所述第二校正比例参数为校正后的左、右侧边比例参数;
根据第一校正比例参数和/或第二校正比例参数,调整投影画面包括:
根据第一校正比例参数和/或第二校正比例参数,驱动投影仪调整适应于第 一校正比例参数和/或第二校正比例参数的投影画面。
相应的,所述影画面的左、右侧边长度,根据左、右侧边中的短侧边来校正长侧边,包括:
(1)获取投影画面的四个角点坐标,根据所述四个角点坐标获取所述影画面的左、右侧边长度;
(2)设置第一误差,所述长侧边长度减去第一误差获得校正后的第一侧边的长度;
(3)若所述第一侧边的长度与短侧边的差值小于第一误差,则将所述第一侧边的长度为校正长侧边,否则,继续执行步骤(1)。
相应的,所述第一角度基于重力感应模块感测获取;
当所述第一角度为仰角时,以投影画面的下侧边为基准,校正上侧边;
当所述第一角度为俯角时,以投影画面的上侧边为基准,校正下侧边。
相应的,当所述第一角度为仰角时,以投影画面的下侧边为基准,校正上侧边,包括:基于公式u1=u-ysin∠2-vsin∠2校正上侧边;
其中,所述∠2为投影仰角,u为待修正的上侧边,u1为校正后的上侧边,y,v分别为投影画面的左、右侧边。
相应的,根据第一校正比例参数和/或第二校正比例参数,调整投影画面,还包括:
获得一投影分辨率;
根据所述投影分辨率,以校正后的上侧边或下侧边为基准,来等比例调整校正后的画面。
具体的,步骤一,通过重力感应模块测量出当前的俯仰角(图二角2)(第一角度),并根据角2的方向判断出当前是俯角还是仰角,如图二中角2即为仰角,当为仰角时则以边x为基准,修正边u。根据三角函数求出修正后的边u1。
u1=u-ysin∠2-vsin∠2
上式得出修正后的u1后即可与原边长u求取比例参数后,代入投影驱动控制模块。修正后即可得到修正后的图5。
步骤二,如图5所示,通过图像采集装置抓取投影画面,由于投影画面比投影面更亮,采用控制算法提取出四个角点在摄像头采集画面中的坐标,并求出左右两条侧边(如图5y1、v1)长度。比较两边判断出哪条边长,如果差值小于允 许的误差值Δ则完成修正,如大于则还需要进一步修正,这里设Δ为5个像素,图5中v1比y1长,则以y1为基准,修正边v1。假设我们采用的修正最小单位为5个像素,则在v1基础上减去5个像素得到v2,然后求取与v1的比例参数,即为第二校正比例参数,代入投影驱动控制模块,得到新的修正画面,如图6所示。
然后,再通过采集装置抓取投影画面,使用上述方法调整边v2。直到左右长短边差值小于误差值Δ即得到图7。
步骤三,左右边长差值小于误差值后,分别再次计算图七中四边(x2、y1、u3、v3)长度,计算一下长宽比,与原图分辨率(640x480)所得长宽比比较。以上下边中的基准边x修正后的x2为新基准,修正另外三边:
u4=x2
y2=x2×480÷640
v4=y2
得到图8所示最终校正后的画面。
步骤四,保存上述校正参数,系统每隔5秒通过重力感应模块与图像采集装置获取新的投影主机与画面状态,如无变化则不做变化。如有变化则从步骤一开始重新进入校正操作。
在本发明上述实施例的方案中,由于基于投影画面产生形变的俯仰形变以及旋转形变,从而针对性设计了采用两种模块分别处理俯仰和旋转导致的画面形变。其中,第一校正模块,根据重力感应模块感测的俯仰形变进行俯仰校正,而第二校正模块针对旋转导致的形变进行校正,从而无需用户手动操作,自适应调整投影画面,使投影在一定范围内随意摆放,系统都可以自动调整画面,使有效内容保持矩形,达到较好显示效果;且采用两个独立模块处理不同的原因产生的形变,系统可靠性更好。
本领域普通技术人员可以理解实现上述实施例方法携带的全部或部分步骤是可以通过程序来指令相关的硬件完成,所述的程序可以存储于一种计算机可读存储介质中,该程序在执行时,包括方法实施例的步骤之一或其组合。
另外,在本发明各个实施例中的各功能单元可以集成在一个处理模块中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。所述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使 用时,也可以存储在一个计算机可读取存储介质中。
本领域内的技术人员应明白,本发明的实施例可提供为方法、系统、或计算机程序产品。因此,本发明可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器和光学存储器等)上实施的计算机程序产品的形式。
显然,本领域的技术人员可以对本发明进行各种改动和变型而不脱离本发明的精神和范围。这样,倘若本发明的这些修改和变型属于本发明权利要求及其等同技术的范围之内,则本发明也意图包含这些改动和变型在内。

Claims (12)

  1. 一种投影画面自动校正方法,其特征在于,包括:
    获取当前投影的第一角度,所述第一角度包括俯角或仰角;
    基于所述第一角度执行投影画面的上侧边或下侧边校正,得到第一校正比例参数;
    和/或,捕捉投影画面,获取投影画面的左、右侧边长度,根据左、右的较短侧边来校正较长侧边,得到第二校正比例参数;
    根据第一校正比例参数和/或第二校正比例参数,调整投影画面。
  2. 根据权利要求1所述的投影画面自动校正方法,其特征在于,所述第一校正比例参数为校正后的上、下侧边比例参数;所述第二校正比例参数为校正后的左、右侧边比例参数;
    根据第一校正比例参数和/或第二校正比例参数,调整投影画面包括:
    根据第一校正比例参数和/或第二校正比例参数,驱动投影仪调整适应于第一校正比例参数和/或第二校正比例参数的投影画面。
  3. 根据权利要求1所述的投影画面自动校正方法,其特征在于,所述影画面的左、右侧边长度,根据左、右侧边中的短侧边来校正长侧边,包括:
    (1)获取投影画面的四个角点坐标,根据所述四个角点坐标获取所述影画面的左、右侧边长度;
    (2)设置第一误差,所述长侧边长度减去第一误差获得校正后的第一侧边的长度;
    (3)若所述第一侧边的长度与短侧边的差值小于第一误差,则将所述第一侧边的长度为校正长侧边,否则,继续执行步骤(1)。
  4. 根据权利要求1所述的投影画面自动校正方法,其特征在于,
    所述第一角度基于重力感应模块感测获取;
    当所述第一角度为仰角时,以投影画面的下侧边为基准,校正上侧边;
    当所述第一角度为俯角时,以投影画面的上侧边为基准,校正下侧边。
  5. 根据权利要求4所述的投影画面自动校正方法,其特征在于,当所述第 一角度为仰角时,以投影画面的下侧边为基准,校正上侧边,包括:基于公式u1=u-y sin∠2-v sin∠2校正上侧边;
    其中,所述∠2为投影仰角,u为待修正的上侧边,u1为校正后的上侧边,y,v分别为投影画面的左、右侧边。
  6. 根据权利要求1所述的投影画面自动校正方法,其特征在于,根据第一校正比例参数和/或第二校正比例参数,调整投影画面,还包括:
    获得一投影分辨率;
    根据所述投影分辨率,以校正后的上侧边或下侧边为基准,来等比例调整校正后的画面。
  7. 一种投影画面自动校正系统,其特征在于,包括:
    重力感应模块,获取当前投影的第一角度,所述第一角度包括俯角或仰角;
    第一校正模块,基于所述第一角度执行投影画面的上侧边或下侧边校正,得到第一校正比例参数;
    和/或,图像捕捉装置,捕捉投影画面;
    第二校正模块,获取投影画面的左、右侧边长度,根据左、右的较短侧边来校正较长侧边,得到第二校正比例参数;
    运算控制单元,根据第一校正比例参数和/或第二校正比例参数,调整投影画面。
  8. 根据权利要求7所述的投影画面自动校正方法,其特征在于,
    所述第一校正比例参数为校正后的上、下侧边比例参数;所述第二校正比例参数为校正后的左、右侧边比例参数;
    所述运算控制单元包括:
    根据第一校正比例参数和/或第二校正比例参数,驱动投影仪调整适应于第一校正比例参数和/或第二校正比例参数的投影画面。
  9. 根据权利要求7所述的投影画面自动校正方法,其特征在于,所述第二校正模块包括:
    第二计算单元,获取投影画面的四个角点坐标,根据所述四个角点坐标获取所述影画面的左、右侧边长度;
    第二子校正单元,设置第一误差,所述长侧边长度减去第一误差获得校正后的第一侧边的长度;
    第二判定单元,若所述第一侧边的长度与短侧边的差值小于第一误差,则将所述第一侧边的长度为校正长侧边,否则,继续执行第二计算单元、第二子校正单元。
  10. 根据权利要求7所述的投影画面自动校正方法,其特征在于,
    所述重力感应模块,包括:所述第一角度基于重力感应模块感测获取;
    所述第一校正单元,包括:当所述第一角度为仰角时,以投影画面的下侧边为基准,校正上侧边;当所述第一角度为俯角时,以投影画面的上侧边为基准,校正下侧边。
  11. 根据权利要求10所述的投影画面自动校正方法,其特征在于,所述第一校正单元,当所述第一角度为仰角时,以投影画面的下侧边为基准,校正上侧边,包括:基于公式u1=u-y sin∠2-v sin∠2校正上侧边;
    其中,所述∠2为投影仰角,u为待修正的上侧边,u1为校正后的上侧边,y,v分别为投影画面的左、右侧边。
  12. 根据权利要求7所述的投影画面自动校正方法,其特征在于,所述运算控制单元,包括:
    获取模块,获得一投影分辨率;
    等比例调整模块,根据所述投影分辨率,以校正后的上侧边或下侧边为基准,来等比例调整校正后的画面。
PCT/CN2019/124013 2018-12-12 2019-12-09 一种投影画面自动校正方法、系统 Ceased WO2020119633A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811516823.4 2018-12-12
CN201811516823.4A CN109688390B (zh) 2018-12-12 2018-12-12 一种投影画面自动校正方法、系统

Publications (1)

Publication Number Publication Date
WO2020119633A1 true WO2020119633A1 (zh) 2020-06-18

Family

ID=66186552

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/124013 Ceased WO2020119633A1 (zh) 2018-12-12 2019-12-09 一种投影画面自动校正方法、系统

Country Status (2)

Country Link
CN (1) CN109688390B (zh)
WO (1) WO2020119633A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109688390B (zh) * 2018-12-12 2020-11-17 中国科学院深圳先进技术研究院 一种投影画面自动校正方法、系统
CN116033131B (zh) * 2022-12-29 2024-05-17 深圳创维数字技术有限公司 图像矫正方法、装置、电子设备及可读存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1584729A (zh) * 2003-08-22 2005-02-23 日本电气株式会社 图像投影方法和设备
JP2010050542A (ja) * 2008-08-19 2010-03-04 Seiko Epson Corp 投写型表示装置および表示方法
CN102271237A (zh) * 2011-02-25 2011-12-07 鸿富锦精密工业(深圳)有限公司 投影装置及其矫正梯形失真的方法
CN103529624A (zh) * 2012-07-04 2014-01-22 昆盈企业股份有限公司 自动修正梯形画面的投影机及其梯形画面自动修正方法
CN104460197A (zh) * 2014-11-25 2015-03-25 深圳先进技术研究院 一种可自动校正几何失真的投影机及其校正方法
CN109688390A (zh) * 2018-12-12 2019-04-26 中国科学院深圳先进技术研究院 一种投影画面自动校正方法、系统

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002158946A (ja) * 2000-11-20 2002-05-31 Seiko Epson Corp プロジェクタおよび画像歪補正方法
JP2005223393A (ja) * 2004-02-03 2005-08-18 Casio Comput Co Ltd 投影装置、投影方法、及び投影プログラム
CN102316295A (zh) * 2010-07-08 2012-01-11 鸿富锦精密工业(深圳)有限公司 投影仪及其校正装置、校正方法
CN204302650U (zh) * 2014-11-25 2015-04-29 深圳先进技术研究院 一种可自动校正几何失真的投影机
CN104935850A (zh) * 2015-06-25 2015-09-23 苏州市英富美欣科技有限公司 一种基于图像分析的自适应投影仪
CN104935852A (zh) * 2015-06-25 2015-09-23 苏州市英富美欣科技有限公司 一种基于图像分析的投影角度调节方法
CN106899837A (zh) * 2015-12-17 2017-06-27 西安中兴新软件有限责任公司 一种投影修正的方法及系统和终端
CN106550226A (zh) * 2016-11-07 2017-03-29 北京小米移动软件有限公司 投影画面校正方法及装置
CN108121232A (zh) * 2016-11-28 2018-06-05 英业达科技有限公司 投影装置及投影方法
CN107835399A (zh) * 2017-10-31 2018-03-23 潍坊歌尔电子有限公司 一种投影校正的方法、装置和投影设备
CN108289208B (zh) * 2018-01-24 2020-11-27 歌尔股份有限公司 一种投影画面自动校正方法和装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1584729A (zh) * 2003-08-22 2005-02-23 日本电气株式会社 图像投影方法和设备
JP2010050542A (ja) * 2008-08-19 2010-03-04 Seiko Epson Corp 投写型表示装置および表示方法
CN102271237A (zh) * 2011-02-25 2011-12-07 鸿富锦精密工业(深圳)有限公司 投影装置及其矫正梯形失真的方法
CN103529624A (zh) * 2012-07-04 2014-01-22 昆盈企业股份有限公司 自动修正梯形画面的投影机及其梯形画面自动修正方法
CN104460197A (zh) * 2014-11-25 2015-03-25 深圳先进技术研究院 一种可自动校正几何失真的投影机及其校正方法
CN109688390A (zh) * 2018-12-12 2019-04-26 中国科学院深圳先进技术研究院 一种投影画面自动校正方法、系统

Also Published As

Publication number Publication date
CN109688390B (zh) 2020-11-17
CN109688390A (zh) 2019-04-26

Similar Documents

Publication Publication Date Title
US8282219B2 (en) Projector and control method
CN217904536U (zh) 投影机系统
CN110099266B (zh) 投影机画面校正方法、装置及投影机
JP5327468B2 (ja) プロジェクター、プログラム、情報記憶媒体および台形歪み補正方法
KR101428064B1 (ko) 화면 왜곡 보정 장치 및 방법
CN103813119B (zh) 图像处理装置、投影装置及图像处理方法
JP5652596B2 (ja) プロジェクター、プログラム、情報記憶媒体および画像投写方法
JP2010130225A (ja) 投写型表示装置および投写用調整方法
CN101656858A (zh) 投影型显示装置及显示方法
CN115086631B (zh) 图像生成方法和信息处理装置
CN106454294A (zh) 投影机画面校正方法及投影机
JP6749402B2 (ja) 投射型映像表示装置および投射映像の調整方法
WO2020119633A1 (zh) 一种投影画面自动校正方法、系统
JP2005318652A5 (zh)
JP2003289485A (ja) 投写型画像表示装置及び平面被投写体
TWI503579B (zh) 立體影像裝置、其立體影像掃描底座及其運作方法
JP4702050B2 (ja) 画像投影装置、画像投影装置の投影画像補正方法及びプログラム
JP2012199772A (ja) プロジェクター及びプロジェクターの設置方法
CN112689133B (zh) 一种图像校正系统及方法
JP2008242087A (ja) 前面投影型プロジェクタの設置位置調整システム
TWI745992B (zh) 用於虛擬觸控之投影裝置及其方法
JP5664725B2 (ja) プロジェクター、画像投写システムおよび画像投写方法
WO2023071256A1 (zh) 激光投影设备及投影图像的校正方法
JP2015053734A (ja) プロジェクター、画像投写システムおよび画像投写方法
WO2014029562A1 (en) Method for correction of defects in image projection for a handheld projector

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19896988

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 03.11.2021)

122 Ep: pct application non-entry in european phase

Ref document number: 19896988

Country of ref document: EP

Kind code of ref document: A1