WO2017080444A1 - 飞机驾驶舱视界增强系统和方法 - Google Patents

飞机驾驶舱视界增强系统和方法 Download PDF

Info

Publication number
WO2017080444A1
WO2017080444A1 PCT/CN2016/105141 CN2016105141W WO2017080444A1 WO 2017080444 A1 WO2017080444 A1 WO 2017080444A1 CN 2016105141 W CN2016105141 W CN 2016105141W WO 2017080444 A1 WO2017080444 A1 WO 2017080444A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
aircraft
column
aircraft windshield
windshield
Prior art date
Application number
PCT/CN2016/105141
Other languages
English (en)
French (fr)
Inventor
金鼎
Original Assignee
中国商用飞机有限责任公司
中国商用飞机有限责任公司上海飞机设计研究院
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中国商用飞机有限责任公司, 中国商用飞机有限责任公司上海飞机设计研究院 filed Critical 中国商用飞机有限责任公司
Priority to EP16863620.7A priority Critical patent/EP3291170B1/en
Priority to US15/578,136 priority patent/US10654590B2/en
Publication of WO2017080444A1 publication Critical patent/WO2017080444A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/14—Transformations for image registration, e.g. adjusting or mapping for alignment of images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B64—AIRCRAFT; AVIATION; COSMONAUTICS
    • B64D—EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
    • B64D47/00—Equipment not otherwise provided for
    • B64D47/08—Arrangements of cameras
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/12—Edge-based segmentation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/13—Edge detection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F9/00—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements
    • G09F9/30—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements in which the desired character or characters are formed by combining individual elements
    • G09F9/301—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements in which the desired character or characters are formed by combining individual elements flexible foldable or roll-able electronic displays, e.g. thin LCD, OLED
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/20—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used
    • B60R2300/202—Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of display used displaying a blind spot scene on the vehicle part responsible for the blind spot
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30248—Vehicle exterior or interior
    • G06T2207/30252—Vehicle exterior; Vicinity of vehicle

Definitions

  • the invention relates to an aircraft cockpit vision enhancement system and method, and belongs to the general technical field of aircraft.
  • the airworthiness regulations provide a supplementary explanation, that is, the driver's head. It can be moved 32mm (1.26 inches) left and right, and the impact of the obstacle on the field of view is reduced as much as possible with the binocular field of view.
  • the present invention contemplates installing a cockpit view enhancement system inside the windshield column so that the pilot can see the scene blocked by the windshield column without moving the head, thereby reducing the burden on the pilot and improving safety.
  • the system can be installed at other desired locations in the cockpit to further enhance the pilot's field of view.
  • the technology close to the present invention is a "stealth” technology exhibited by the University of Tokyo in 2004.
  • the "invisibility cloak” is coated with a layer of retroreflective material and is equipped with a camera.
  • the scene behind the clothes is taken by the camera, and then the image is converted to the projector in front of the clothes, and then the image is projected onto a cloth made of a special material to make the wearer look transparent.
  • This technique is not suitable for use in the scope of the present invention since it is not suitable for the camera assembly outside the cockpit of the windshield, i.e., outside the cockpit.
  • an aircraft cockpit vision enhancement system comprising:
  • a positive-position imaging device a left-position imaging device, and a right-position imaging device
  • the positive-position imaging device is disposed between a driver's eye position and an aircraft windshield column
  • the shooting angle of the positive-position imaging device is opposite to An aircraft windshield column
  • the left position camera device and the right position camera device are respectively disposed on a left side and a right side of the aircraft windshield column
  • the shooting angles of the left position camera device and the right position camera device are respectively pointed Tilt to the right and left sides of the aircraft windshield column;
  • An image processing device connected to the positive-position imaging device, the left-bit imaging device, and the right-position imaging device for use in the positive-position imaging device, the left-point imaging device, and The right position image, the left position image and the right position image captured by the right position camera device perform image synthesis and image matching, and obtain an image of the aircraft windshield column occlusion area;
  • a display device is coupled to the image processing device for displaying the obtained image of the aircraft windshield occlusion region.
  • the aircraft cockpit view enhancement system of the present invention can achieve the following beneficial technical effects: it can accurately display the image of the occlusion area of the windshield column, and make up for the drawbacks of the windshield column occlusion of the cockpit view.
  • the image processing apparatus includes an image synthesis module, an edge detection module, and an image matching module, wherein the image synthesis module is configured to perform image synthesis on the left bit image and the right bit image, Obtaining a composite image with a larger viewing angle, the edge detecting module is configured to perform edge detection on the orthographic image to obtain a boundary of an occlusion region of the aircraft windshield column, and the image matching module is configured to obtain the synthesized image and the positive image
  • the bit image is image-aligned, and an image of the occlusion area of the aircraft windshield column is extracted according to the obtained boundary.
  • the aircraft cockpit visual field augmentation system of the present invention can provide the following beneficial technical effects: the image of the occlusion area of the aircraft windshield column can be accurately extracted, thereby further accurately displaying the image of the occlusion area of the windshield column.
  • the image processing apparatus further includes an image cropping module, the image cropping module
  • the block is adapted to adjustably crop the image of the aircraft windshield occlusion area according to the actual visual effect.
  • the aircraft cockpit vision enhancement system of the present invention can achieve the following beneficial technical effects: the aircraft windshield column occlusion area image can be adjusted and adjusted according to the actual visual effect, thereby further accurately displaying the image of the occlusion area of the windshield column. .
  • the image processing apparatus further includes an image deformation module, wherein the image deformation module is configured to perform image deformation processing on the image of the aircraft windshield occlusion area according to the shape of the aircraft windshield column, so as to deform the image.
  • the processed aircraft windshield column occlusion area image is adapted to the shape of the aircraft windshield column.
  • the aircraft cockpit vision enhancement system of the present invention can provide the following beneficial technical effects: the image of the aircraft windshield occlusion area can be adapted to the shape of the aircraft windshield column, thereby further accurately displaying the image of the occlusion area of the windshield column. .
  • the display device is a flexible film display device, and the flexible film display device is attached to the inner side of the aircraft windshield column.
  • the aircraft cockpit vision enhancement system of the present invention can have the following beneficial technical effects: the flexible film display device can make the image of the aircraft windshield occlusion area suitable for the shape of the aircraft windshield column, thereby further accurately displaying the windshield column. An image of the occlusion area.
  • an aircraft cockpit view enhancement method comprising:
  • the positive position image, the left position image, and the right position image are respectively taken by the right position camera, the left position image, and the right position image, wherein the ortho position camera is disposed between the driver's eye position and the aircraft windshield column
  • the shooting angle of the positive position camera is opposite to the aircraft windshield column, and the left position camera and the right position camera are respectively disposed on the left side and the right side of the aircraft windshield column, the left position
  • the photographing angles of the camera device and the right position camera are respectively directed to the right side and the left side of the aircraft windshield column;
  • the obtained image of the occlusion area of the aircraft windshield column is displayed by the display device.
  • the aircraft cockpit vision enhancement method of the present invention can provide the following benefits Technical effect: It can accurately display the image of the area blocked by the windshield column, and make up for the drawbacks of the windshield column to the cockpit view.
  • performing image synthesis and image matching on the orthographic image, the left bit image, and the right bit image by using an image processing device to obtain an image of the aircraft windshield column occlusion region includes: Performing image synthesis with the right-bit image to obtain a composite image with a larger viewing angle; performing edge detection on the ortho-image to obtain a boundary of the occlusion region of the aircraft windshield; and performing image on the obtained composite image and the ortho image Match the image of the occlusion area of the aircraft windshield column according to the obtained boundary.
  • the aircraft cockpit view enhancement method of the present invention can provide the following beneficial technical effects: the image of the aircraft windshield column occlusion area can be accurately extracted, thereby further accurately displaying the image of the occlusion area of the windshield column.
  • performing image synthesis and image matching on the orthographic image, the left bit image, and the right bit image by using an image processing device to obtain an image of the aircraft windshield occlusion region further includes: according to actual visual effects Adjusting and cutting the image of the occlusion area of the aircraft windshield column.
  • the aircraft cockpit vision enhancement method of the present invention can achieve the following beneficial technical effects: the aircraft windshield column occlusion area image can be adjusted and adjusted according to the actual visual effect, thereby further accurately displaying the image of the occlusion area of the windshield column. .
  • performing image synthesis and image matching on the orthographic image, the left bit image, and the right bit image by using an image processing device to obtain an image of the aircraft windshield occlusion region further includes: according to the aircraft windshield The shape of the column performs image deformation processing on the image of the aircraft windshield occlusion area so that the image of the aircraft windshield occlusion area subjected to image deformation processing is suitable for the shape of the aircraft windshield column.
  • the aircraft cockpit view enhancement method of the present invention can provide the following beneficial technical effects: the image of the aircraft windshield occlusion area can be adapted to the shape of the aircraft windshield column, thereby further accurately displaying the image of the occlusion area of the windshield column. .
  • the display device is a flexible film display device, and the flexible film display device is attached to the inner side of the aircraft windshield column.
  • the aircraft cockpit vision enhancement method of the present invention can have the following Technical effect:
  • the flexible film display device can make the image of the aircraft windshield block occlusion area suitable for the shape of the aircraft windshield column, thereby further accurately displaying the image of the occlusion area of the windshield column.
  • FIG. 1 is a schematic diagram showing the composition of an aircraft cockpit view enhancement system according to an embodiment of the present invention.
  • FIG. 2 is a schematic diagram of an aircraft cockpit view enhancement system in accordance with an embodiment of the present invention.
  • FIG. 3 is a flow chart of image processing of an aircraft cockpit view enhancement system in accordance with an embodiment of the present invention.
  • FIG. 4 is a schematic view of an aircraft cockpit in accordance with an embodiment of the present invention.
  • an aircraft cockpit view enhancement system includes:
  • a positive position camera device a left position camera device and a right position camera device
  • the ortho position camera device is disposed between the driver's eye position and the aircraft windshield column, and the shooting angle of the orthophoto camera device is opposite to the aircraft windshield column
  • left position The camera device and the right position camera device are respectively disposed on the left side and the right side of the aircraft windshield column, and the shooting angles of the left position camera device and the right position camera device respectively point to the right side and the left side of the aircraft windshield column;
  • the image processing device is connected to the orthophotographing device, the left bit camera device, and the right position camera device for use in orthographic images taken by the right position camera device, the left position camera device, and the right position camera device, left
  • the image of the bit and the image of the right image are image-combined and image-aligned to obtain an image of the occlusion area of the aircraft windshield column;
  • a display device is coupled to the image processing device for displaying the obtained image of the aircraft windshield occlusion region.
  • the image processing apparatus includes an image synthesis module, an edge detection module, and an image matching module, wherein the image synthesis module is configured to perform image synthesis on the left image and the right image to obtain a composite image having a larger viewing angle.
  • the algorithm used to implement the functionality of the module can be a least squares method based on gray values or other algorithms with the same function.
  • the edge detection module is used for edge detection of the ortho image to obtain the boundary of the occlusion area of the aircraft windshield column.
  • the algorithm used to implement the function of the module may be a canny multi-level edge detection algorithm or other algorithms with the same function.
  • the image matching module is configured to perform image matching on the obtained composite image and the ortho image, and extract an image of the occlusion area of the aircraft windshield column according to the obtained boundary, and the algorithm used to implement the function of the module may be based on the order of the gray value.
  • a similarity detection algorithm (SSDA algorithm) or other algorithm with the same function.
  • the image processing apparatus further includes an image cropping module, wherein the image cropping module is configured to adjust the image of the occlusion area of the aircraft windshield column according to the actual visual effect, and the algorithm used to implement the function of the module may be a Cyrus-Beck polygonal window line. Cropping algorithms or other algorithms with the same functionality.
  • the image processing apparatus further includes an image deformation module, wherein the image deformation module is configured to perform image deformation processing on the image of the occlusion area of the aircraft windshield according to the shape of the windshield of the aircraft, so as to block the image of the damper of the aircraft windshield by the image deformation process.
  • the algorithm used to implement the function of the module can be based on a linear minimum moving square image deformation algorithm or other algorithms with the same function.
  • the display device is a flexible film display device, and the flexible film display device is attached to the inside of the aircraft windshield column.
  • FIG. 2 is a schematic diagram of an aircraft cockpit view enhancement system in accordance with an embodiment of the present invention.
  • 3 is a flow chart of image processing of an aircraft cockpit view enhancement system in accordance with an embodiment of the present invention.
  • 4 is a schematic view of an aircraft cockpit in accordance with an embodiment of the present invention.
  • the image of the occlusion area of the windshield column extracted in the previous step is further cropped, and the size of the cut boundary can be adjusted by the pilot according to the actual visual effect through the adjustment knob;
  • the image of the occlusion area of the windshield column is subjected to image deformation processing according to the shape of the windshield column, and an image of the damper column occlusion area conforming to the real visual effect is obtained for final display on the display device.
  • an aircraft cockpit view enhancement method includes:
  • the positive position camera, the left position camera device and the right position camera device respectively capture a positive position image, a left position image and a right position image, wherein the ortho position camera device is disposed between the driver's eye position and the aircraft windshield column,
  • the shooting angle of the position camera is directly opposite to the aircraft windshield column.
  • the left camera and the right camera are respectively disposed on the left and right sides of the aircraft windshield column.
  • the shooting angles of the left camera and the right camera are respectively directed to the aircraft.
  • the obtained image of the occlusion area of the aircraft windshield column is displayed by the display device.
  • the image processing device performs image synthesis and image matching on the right image, the left image, and the right image to obtain an image of the aircraft windshield occlusion region, including: image synthesis of the left image and the right image, To obtain a composite image with a larger viewing angle; perform edge detection on the ortho image to obtain the boundary of the occlusion area of the aircraft windshield column; image the obtained composite image and the ortho image, and extract the aircraft windshield according to the obtained boundary
  • the column blocks the image of the area.
  • using the image processing device to perform image synthesis and image matching on the orthographic image, the left image, and the right image to obtain the image of the aircraft windshield occlusion region further includes: adjusting the aircraft windshield column adaptively according to the actual visual effect Occlusion area image.
  • using the image processing device to perform image synthesis and image matching on the orthographic image, the left image, and the right image to obtain an image of the aircraft windshield occlusion region further includes: occluding the aircraft windshield column according to the shape of the aircraft windshield column
  • the area image is subjected to image deformation processing so that the image of the aircraft windshield occlusion area subjected to image deformation processing is adapted to the shape of the aircraft windshield column.
  • the left position camera LC and the right position camera RC are arranged on both sides of the windshield column, and point the shooting angles thereof to the windshield column.
  • Side; the positive position camera CC is installed between the eye position E and the axis of the windshield column, the shooting angle is directly opposite the windshield column; the three camera devices are respectively fixed on the cockpit wall panel by the bracket; the flexible film display device is attached Covering the flat surface of the windshield column; mounting the image processing device inside the cockpit panel, the left position camera device LC, the right position camera device RC and the right position camera device CC, and the flexible film display device are connected to the image processing device through a cable; Select the appropriate position to arrange the power switch and adjustment knob to realize the system switching function and display range adjustment function (ie, adjustable image cropping function).

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Image Processing (AREA)

Abstract

一种飞机驾驶舱视界增强系统和方法。飞机驾驶舱视界增强系统包括：正位摄像装置（CC）、左位摄像装置（LC）和右位摄像装置（RC），正位摄像装置（CC）设置在驾驶员眼位点（E）和飞机风挡力柱之间，拍摄角度正对飞机风挡立柱，左位摄像装置（LC）和右位摄像装置（RC）分别设置在飞机风挡立柱的左侧和右侧，拍摄角度分别指向偏向飞机风挡立柱的右侧和左侧；图像处理装置，用于对正位摄像装置（CC）、左位摄像装置（LC）和右位摄像装置（RC）所拍摄的正位图像、左位图像和右位图像进行图像合成和图像匹准，获得飞机风挡立柱遮挡区域图像；显示装置，用于显示所获得的飞机风挡立柱遮挡区域图像。该飞机驾驶舱视界增强系统和方法能精确显示风挡立柱遮挡区域图像，弥补风挡立柱对驾驶舱视界遮挡的弊端。

Description

飞机驾驶舱视界增强系统和方法
本申请要求于2015年11月12日提交的、申请号为201510770666.X的中国专利申请的优先权，在此以参见的方式引入该申请的全部内容。
技术领域
本发明涉及飞机驾驶舱视界增强系统和方法，属于飞机总体技术领域。
背景技术
在设计民用飞机的驾驶舱时，需满足适航规章中的驾驶舱视界范围要求，由于飞机风挡立柱的存在势必对视界产生局部遮挡，因此适航规章提出了补充性说明，即驾驶员的头可左、右移动32mm(1.26英寸)，用双目视野尽可能地减少障碍对视野的影响。
基于上述情况，本发明考虑在风挡立柱内侧安装驾驶舱视界增强系统，使飞行员不需要移动头部就能看清被风挡立柱遮挡的景象，由此降低飞行员的负担，提高安全性。同时，也可以在驾驶舱其他需要的位置安装该系统，进一步增强飞行员的视界范围。
目前，与本发明接近的技术为2004年日本东京大学展示的一款“隐身衣”技术，该“隐身衣”上涂有一层回射性物质，还装配了照相机。使用时，将衣服后面的场景由照相机拍摄下来，然后将图像转换到衣服前面的放映机，再将图像投射到由特殊材料制成的衣料上，就能让穿着者看起来是透明人。由于在风挡立柱背面即驾驶舱外不适合摄像组件，因此该技术不适于在本发明所述范围使用。
发明内容
本发明的一个目的在于，提供一种飞机驾驶舱视界增强系统和方法， 其可以精确地显示被风挡立柱遮挡区域的图像，弥补风挡立柱对驾驶舱视界遮挡的弊端。
本发明的以上目的通过一种飞机驾驶舱视界增强系统来实现，该飞机驾驶舱视界增强系统包括：
正位摄像装置、左位摄像装置和右位摄像装置，其中，所述正位摄像装置设置在驾驶员眼位点和飞机风挡立柱之间，所述正位摄像装置的拍摄角度正对所述飞机风挡立柱，所述左位摄像装置和所述右位摄像装置分别设置在所述飞机风挡立柱的左侧和右侧，所述左位摄像装置和所述右位摄像装置的拍摄角度分别指向偏向所述飞机风挡立柱的右侧和左侧；
图像处理装置，所述图像处理装置连接至所述正位摄像装置、所述左位摄像装置和所述右位摄像装置，以用于对所述正位摄像装置、所述左位摄像装置和所述右位摄像装置所拍摄的正位图像、左位图像和右位图像进行图像合成和图像匹准，获得飞机风挡立柱遮挡区域图像；
显示装置，所述显示装置连接至所述图像处理装置，以用于显示所获得的飞机风挡立柱遮挡区域图像。
根据上述技术方案，本发明的飞机驾驶舱视界增强系统能起到以下有益技术效果：能精确地显示被风挡立柱遮挡区域的图像，弥补风挡立柱对驾驶舱视界遮挡的弊端。
较佳的是，所述图像处理装置包括图像合成模块、边缘检测模块、图像匹准模块，其中，所述图像合成模块用于对所述左位图像和所述右位图像进行图像合成，以得到视角较大的合成图像，所述边缘检测模块用于对所述正位图像进行边缘检测，以得到飞机风挡立柱遮挡区域的边界，所述图像匹准模块用于对所得到的合成图像和正位图像进行图像匹准，并根据所得到的边界提取飞机风挡立柱遮挡区域图像。
根据上述技术方案，本发明的飞机驾驶舱视界增强系统能起到以下有益技术效果：能精确地提取飞机风挡立柱遮挡区域图像，从而进一步精确地显示被风挡立柱遮挡区域的图像。
较佳的是，所述图像处理装置还包括图像裁剪模块，所述图像裁剪模 块用于根据实际视觉效果可调整地裁剪所述飞机风挡立柱遮挡区域图像。
根据上述技术方案，本发明的飞机驾驶舱视界增强系统能起到以下有益技术效果：能根据实际视觉效果可调整地裁剪飞机风挡立柱遮挡区域图像，从而进一步精确地显示被风挡立柱遮挡区域的图像。
较佳的是，所述图像处理装置还包括图像变形模块，所述图像变形模块用于根据所述飞机风挡立柱的形状对所述飞机风挡立柱遮挡区域图像进行图像变形处理，以使经图像变形处理的飞机风挡立柱遮挡区域图像适合于所述飞机风挡立柱的形状。
根据上述技术方案，本发明的飞机驾驶舱视界增强系统能起到以下有益技术效果：能使得飞机风挡立柱遮挡区域图像适合于飞机风挡立柱的形状，从而进一步精确地显示被风挡立柱遮挡区域的图像。
较佳的是，所述显示装置是柔性薄膜显示装置，所述柔性薄膜显示装置贴覆在所述飞机风挡立柱的内侧。
根据上述技术方案，本发明的飞机驾驶舱视界增强系统能起到以下有益技术效果：柔性薄膜显示装置能使得飞机风挡立柱遮挡区域图像适合于飞机风挡立柱的形状，从而进一步精确地显示被风挡立柱遮挡区域的图像。
本发明的以上目的还通过一种飞机驾驶舱视界增强方法来实现，该飞机驾驶舱视界增强方法包括：
利用正位摄像装置、左位摄像装置和右位摄像装置分别拍摄正位图像、左位图像和右位图像，其中，所述正位摄像装置设置在驾驶员眼位点和飞机风挡立柱之间，所述正位摄像装置的拍摄角度正对所述飞机风挡立柱，所述左位摄像装置和所述右位摄像装置分别设置在所述飞机风挡立柱的左侧和右侧，所述左位摄像装置和所述右位摄像装置的拍摄角度分别指向偏向所述飞机风挡立柱的右侧和左侧；
利用图像处理装置对所述正位图像、所述左位图像和所述右位图像进行图像合成和图像匹准以获得飞机风挡立柱遮挡区域图像；
利用显示装置显示所获得的飞机风挡立柱遮挡区域图像。
根据上述技术方案，本发明的飞机驾驶舱视界增强方法能起到以下有益 技术效果：能精确地显示被风挡立柱遮挡区域的图像，弥补风挡立柱对驾驶舱视界遮挡的弊端。
较佳的是，利用图像处理装置对所述正位图像、所述左位图像和所述右位图像进行图像合成和图像匹准以获得飞机风挡立柱遮挡区域图像包括：对所述左位图像和所述右位图像进行图像合成，以得到视角较大的合成图像；对所述正位图像进行边缘检测，以得到飞机风挡立柱遮挡区域的边界；对所得到的合成图像和正位图像进行图像匹准，并根据所得到的边界提取飞机风挡立柱遮挡区域图像。
根据上述技术方案，本发明的飞机驾驶舱视界增强方法能起到以下有益技术效果：能精确地提取飞机风挡立柱遮挡区域图像，从而进一步精确地显示被风挡立柱遮挡区域的图像。
较佳的是，利用图像处理装置对所述正位图像、所述左位图像和所述右位图像进行图像合成和图像匹准以获得飞机风挡立柱遮挡区域图像还包括：根据实际视觉效果可调整地裁剪所述飞机风挡立柱遮挡区域图像。
根据上述技术方案，本发明的飞机驾驶舱视界增强方法能起到以下有益技术效果：能根据实际视觉效果可调整地裁剪飞机风挡立柱遮挡区域图像，从而进一步精确地显示被风挡立柱遮挡区域的图像。
较佳的是，利用图像处理装置对所述正位图像、所述左位图像和所述右位图像进行图像合成和图像匹准以获得飞机风挡立柱遮挡区域图像还包括：根据所述飞机风挡立柱的形状对所述飞机风挡立柱遮挡区域图像进行图像变形处理，以使经图像变形处理的飞机风挡立柱遮挡区域图像适合于所述飞机风挡立柱的形状。
根据上述技术方案，本发明的飞机驾驶舱视界增强方法能起到以下有益技术效果：能使得飞机风挡立柱遮挡区域图像适合于飞机风挡立柱的形状，从而进一步精确地显示被风挡立柱遮挡区域的图像。
较佳的是，所述显示装置是柔性薄膜显示装置，所述柔性薄膜显示装置贴覆在所述飞机风挡立柱的内侧。
根据上述技术方案，本发明的飞机驾驶舱视界增强方法能起到以下有 益技术效果：柔性薄膜显示装置能使得飞机风挡立柱遮挡区域图像适合于飞机风挡立柱的形状，从而进一步精确地显示被风挡立柱遮挡区域的图像。
附图说明
图1是本发明一实施例的飞机驾驶舱视界增强系统的组成示意图。
图2是本发明一实施例的飞机驾驶舱视界增强系统的原理图。
图3是本发明一实施例的飞机驾驶舱视界增强系统的的图像处理流程图。
图4是本发明一实施例的飞机驾驶舱示意图。
具体实施方式
下面结合具体实施例和附图对本发明作进一步说明，在以下的描述中阐述了更多的细节以便于充分理解本发明，但是本发明显然能够以多种不同于此描述的其它方式来实施，本领域技术人员可以在不违背本发明内涵的情况下根据实际应用情况作类似推广、演绎，因此不应以此具体实施例的内容限制本发明的保护范围。
图1是本发明一实施例的飞机驾驶舱视界增强系统的组成示意图。如图1所示，根据本发明的一实施例，飞机驾驶舱视界增强系统包括：
正位摄像装置、左位摄像装置和右位摄像装置，其中，正位摄像装置设置在驾驶员眼位点和飞机风挡立柱之间，正位摄像装置的拍摄角度正对飞机风挡立柱，左位摄像装置和右位摄像装置分别设置在飞机风挡立柱的左侧和右侧，左位摄像装置和右位摄像装置的拍摄角度分别指向偏向飞机风挡立柱的右侧和左侧；
图像处理装置，图像处理装置连接至正位摄像装置、左位摄像装置和右位摄像装置，以用于对正位摄像装置、左位摄像装置和右位摄像装置所拍摄的正位图像、左位图像和右位图像进行图像合成和图像匹准，获得飞机风挡立柱遮挡区域图像；
显示装置，显示装置连接至图像处理装置，以用于显示所获得的飞机风挡立柱遮挡区域图像。
较佳的是，图像处理装置包括图像合成模块、边缘检测模块、图像匹准模块，其中，图像合成模块用于对左位图像和右位图像进行图像合成，以得到视角较大的合成图像，实现该模块功能所用到的算法可以是基于灰度值的最小二乘法或其他具有相同功能的算法。边缘检测模块用于对正位图像进行边缘检测，以得到飞机风挡立柱遮挡区域的边界，实现该模块功能所用到的算法可以是canny多级边缘检测算法或其他具有相同功能的算法。图像匹准模块用于对所得到的合成图像和正位图像进行图像匹准，并根据所得到的边界提取飞机风挡立柱遮挡区域图像，实现该模块功能所用到的算法可以是基于灰度值的序贯相似性检测算法(SSDA算法)或其他具有相同功能的算法。
较佳的是，图像处理装置还包括图像裁剪模块，图像裁剪模块用于根据实际视觉效果可调整地裁剪飞机风挡立柱遮挡区域图像，实现该模块功能所用到的算法可以是Cyrus-Beck多边形窗口直线裁剪算法或其他具有相同功能的算法。
较佳的是，图像处理装置还包括图像变形模块，图像变形模块用于根据飞机风挡立柱的形状对飞机风挡立柱遮挡区域图像进行图像变形处理，以使经图像变形处理的飞机风挡立柱遮挡区域图像适合于飞机风挡立柱的形状，实现该模块功能所用到的算法可以是基于线性最小移动二乘图像变形算法或其他具有相同功能的算法。
较佳的是，显示装置是柔性薄膜显示装置，柔性薄膜显示装置贴覆在飞机风挡立柱的内侧。
图2是本发明一实施例的飞机驾驶舱视界增强系统的原理图。图3是本发明一实施例的飞机驾驶舱视界增强系统的的图像处理流程图。图4是本发明一实施例的飞机驾驶舱示意图。
下面结合图2－4说明飞机驾驶舱视界增强系统的图像处理原理：
(1)对左位摄像装置LC所拍摄的左位图像和右位摄像装置RC所拍摄的右位图像进行图像合成，得到一个视角较大的合成图像；
(2)从图2可知，正位摄像装置CC所拍摄的正位图像与眼位点E处 看到的图像相比，正位图像中被遮挡区域较大，故对正位图像进行边缘检测，得到风挡立柱遮挡区域边界；
(3)对所得到的合成图像和正位图像进行图像匹准，并根据所得到的边界提取风挡立柱遮挡区域图像；
(4)较佳的是，对上一步中所提取的风挡立柱遮挡区域图像进行进一步裁剪，裁剪的边界大小可以由飞行员根据实际视觉效果通过调节旋钮进行调整；
(5)较佳的是，根据风挡立柱形状对风挡立柱遮挡区域图像进图像变形处理，得到符合真实视觉效果的风挡立柱遮挡区域图像，以供最终显示在显示装置上。
如图3所示，根据本发明的一实施例，飞机驾驶舱视界增强方法包括：
利用正位摄像装置、左位摄像装置和右位摄像装置分别拍摄正位图像、左位图像和右位图像，其中，正位摄像装置设置在驾驶员眼位点和飞机风挡立柱之间，正位摄像装置的拍摄角度正对飞机风挡立柱，左位摄像装置和右位摄像装置分别设置在飞机风挡立柱的左侧和右侧，左位摄像装置和右位摄像装置的拍摄角度分别指向偏向飞机风挡立柱的右侧和左侧；
利用图像处理装置对正位图像、左位图像和右位图像进行图像合成和图像匹准以获得飞机风挡立柱遮挡区域图像；
利用显示装置显示所获得的飞机风挡立柱遮挡区域图像。
较佳的是，利用图像处理装置对正位图像、左位图像和右位图像进行图像合成和图像匹准以获得飞机风挡立柱遮挡区域图像包括：对左位图像和右位图像进行图像合成，以得到视角较大的合成图像；对正位图像进行边缘检测，以得到飞机风挡立柱遮挡区域的边界；对所得到的合成图像和正位图像进行图像匹准，并根据所得到的边界提取飞机风挡立柱遮挡区域图像。
较佳的是，利用图像处理装置对正位图像、左位图像和右位图像进行图像合成和图像匹准以获得飞机风挡立柱遮挡区域图像还包括：根据实际视觉效果可调整地裁剪飞机风挡立柱遮挡区域图像。
较佳的是，利用图像处理装置对正位图像、左位图像和右位图像进行图像合成和图像匹准以获得飞机风挡立柱遮挡区域图像还包括：根据飞机风挡立柱的形状对飞机风挡立柱遮挡区域图像进行图像变形处理，以使经图像变形处理的飞机风挡立柱遮挡区域图像适合于飞机风挡立柱的形状。
如图4所示，在驾驶舱实际安装时，较佳的是，将左位摄像装置LC和右位摄像装置RC分别布置在风挡立柱两侧，并将它们的拍摄角度分别指向偏向风挡立柱一侧；将正位摄像装置CC安装在眼位点E和风挡立柱轴线的之间，拍摄角度正对风挡立柱；三个摄像装置分别通过支架固定在驾驶舱壁板上；将柔性薄膜显示装置贴覆在风挡立柱的平整面上；将图像处理装置安装在驾驶舱面板内部，左位摄像装置LC、右位摄像装置RC和正位摄像装置CC以及柔性薄膜显示装置通过线缆与图像处理装置相连；选取合适的位置布置电源开关和调整旋钮，分别实现系统开关功能和显示范围调整功能(即，可调的图像裁剪功能)。
以上对本发明的具体实施方式进行了描述，但本领域技术人员将会理解，上述具体实施方式并不构成对本发明的限制，本领域技术人员可以在以上公开内容的基础上进行多种修改，而不超出本发明的范围。

Claims (10)

  1. 一种飞机驾驶舱视界增强系统，包括：
    正位摄像装置、左位摄像装置和右位摄像装置，其中，所述正位摄像装置设置在驾驶员眼位点和飞机风挡立柱之间，所述正位摄像装置的拍摄角度正对所述飞机风挡立柱，所述左位摄像装置和所述右位摄像装置分别设置在所述飞机风挡立柱的左侧和右侧，所述左位摄像装置和所述右位摄像装置的拍摄角度分别指向偏向所述飞机风挡立柱的右侧和左侧；
    图像处理装置，所述图像处理装置连接至所述正位摄像装置、所述左位摄像装置和所述右位摄像装置，以用于对所述正位摄像装置、所述左位摄像装置和所述右位摄像装置所拍摄的正位图像、左位图像和右位图像进行图像合成和图像匹准，获得飞机风挡立柱遮挡区域图像；
    显示装置，所述显示装置连接至所述图像处理装置，以用于显示所获得的飞机风挡立柱遮挡区域图像。
  2. 如权利要求1所述的飞机驾驶舱视界增强系统，其特征在于，所述图像处理装置包括图像合成模块、边缘检测模块、图像匹准模块，其中，所述图像合成模块用于对所述左位图像和所述右位图像进行图像合成，以得到视角较大的合成图像，所述边缘检测模块用于对所述正位图像进行边缘检测，以得到飞机风挡立柱遮挡区域的边界，所述图像匹准模块用于对所得到的合成图像和正位图像进行图像匹准，并根据所得到的边界提取飞机风挡立柱遮挡区域图像。
  3. 如权利要求2所述的飞机驾驶舱视界增强系统，其特征在于，所述图像处理装置还包括图像裁剪模块，所述图像裁剪模块用于根据实际视觉效果可调整地裁剪所述飞机风挡立柱遮挡区域图像。
  4. 如权利要求2所述的飞机驾驶舱视界增强系统，其特征在于，所述图像处理装置还包括图像变形模块，所述图像变形模块用于根据所述飞机风挡立柱的形状对所述飞机风挡立柱遮挡区域图像进行图像变形处理，以使经图像变形处理的飞机风挡立柱遮挡区域图像适合于所述飞机风挡立柱 的形状。
  5. 如权利要求1所述的飞机驾驶舱视界增强系统，其特征在于，所述显示装置是柔性薄膜显示装置，所述柔性薄膜显示装置贴覆在所述飞机风挡立柱的内侧。
  6. 一种飞机驾驶舱视界增强方法，包括：
    利用正位摄像装置、左位摄像装置和右位摄像装置分别拍摄正位图像、左位图像和右位图像，其中，所述正位摄像装置设置在驾驶员眼位点和飞机风挡立柱之间，所述正位摄像装置的拍摄角度正对所述飞机风挡立柱，所述左位摄像装置和所述右位摄像装置分别设置在所述飞机风挡立柱的左侧和右侧，所述左位摄像装置和所述右位摄像装置的拍摄角度分别指向偏向所述飞机风挡立柱的右侧和左侧；
    利用图像处理装置对所述正位图像、所述左位图像和所述右位图像进行图像合成和图像匹准以获得飞机风挡立柱遮挡区域图像；
    利用显示装置显示所获得的飞机风挡立柱遮挡区域图像。
  7. 如权利要求6所述的飞机驾驶舱视界增强方法，其特征在于，利用图像处理装置对所述正位图像、所述左位图像和所述右位图像进行图像合成和图像匹准以获得飞机风挡立柱遮挡区域图像包括：对所述左位图像和所述右位图像进行图像合成，以得到视角较大的合成图像；对所述正位图像进行边缘检测，以得到飞机风挡立柱遮挡区域的边界；对所得到的合成图像和正位图像进行图像匹准，并根据所得到的边界提取飞机风挡立柱遮挡区域图像。
  8. 如权利要求7所述的飞机驾驶舱视界增强方法，其特征在于，利用图像处理装置对所述正位图像、所述左位图像和所述右位图像进行图像合成和图像匹准以获得飞机风挡立柱遮挡区域图像还包括：根据实际视觉效果可调整地裁剪所述飞机风挡立柱遮挡区域图像。
  9. 如权利要求7所述的飞机驾驶舱视界增强方法，其特征在于，利用图像处理装置对所述正位图像、所述左位图像和所述右位图像进行图像合成和图像匹准以获得飞机风挡立柱遮挡区域图像还包括：根据所述飞机风 挡立柱的形状对所述飞机风挡立柱遮挡区域图像进行图像变形处理，以使经图像变形处理的飞机风挡立柱遮挡区域图像适合于所述飞机风挡立柱的形状。
  10. 如权利要求6所述的飞机驾驶舱视界增强方法，其特征在于，所述显示装置是柔性薄膜显示装置，所述柔性薄膜显示装置贴覆在所述飞机风挡立柱的内侧。
PCT/CN2016/105141 2015-11-12 2016-11-09 飞机驾驶舱视界增强系统和方法 WO2017080444A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP16863620.7A EP3291170B1 (en) 2015-11-12 2016-11-09 Aircraft cockpit view enhancing system and method
US15/578,136 US10654590B2 (en) 2015-11-12 2016-11-09 Aircraft cockpit view enhancing system and method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510770666.X 2015-11-12
CN201510770666.XA CN105405093B (zh) 2015-11-12 2015-11-12 飞机驾驶舱视界增强系统和方法

Publications (1)

Publication Number Publication Date
WO2017080444A1 true WO2017080444A1 (zh) 2017-05-18

Family

ID=55470561

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/105141 WO2017080444A1 (zh) 2015-11-12 2016-11-09 飞机驾驶舱视界增强系统和方法

Country Status (4)

Country Link
US (1) US10654590B2 (zh)
EP (1) EP3291170B1 (zh)
CN (1) CN105405093B (zh)
WO (1) WO2017080444A1 (zh)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105405093B (zh) 2015-11-12 2019-03-15 中国商用飞机有限责任公司 飞机驾驶舱视界增强系统和方法
CN106023064B (zh) * 2016-05-12 2019-06-28 中国航空工业集团公司西安飞机设计研究所 一种飞机座舱视界评估方法
CN107704681B (zh) * 2017-09-30 2021-06-04 江西洪都航空工业集团有限责任公司 一种飞机地面视野范围的计算方法
KR102161918B1 (ko) * 2019-06-03 2020-10-05 김근형 항공기의 비행 중 외부 전경 콘텐츠 제공 장치

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070268118A1 (en) * 2006-05-17 2007-11-22 Hisayuki Watanabe Surrounding image generating apparatus and method of adjusting metering for image pickup device
CN101277432A (zh) * 2007-03-26 2008-10-01 爱信艾达株式会社 驾驶辅助方法以及驾驶辅助装置
CN103253196A (zh) * 2013-05-30 2013-08-21 吕军 汽车全视纪录镜
CN103581651A (zh) * 2013-10-28 2014-02-12 西安交通大学 一种用于车载多目摄像机环视系统的虚拟视点合成方法
CN103818320A (zh) * 2014-03-14 2014-05-28 盛凯 驾驶舱用智能控制系统及控制方法
CN103879544A (zh) * 2012-12-21 2014-06-25 空中客车公司 具有配备了用于领航的至少部分虚拟的可视表面的驾驶室的飞行器
CN104044745A (zh) * 2013-03-12 2014-09-17 霍尼韦尔国际公司 飞机驾驶舱显示器以及用于组合视景显示中的障碍物的增强显示的系统和方法
CN105405093A (zh) * 2015-11-12 2016-03-16 中国商用飞机有限责任公司 飞机驾驶舱视界增强系统和方法

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7180476B1 (en) * 1999-06-30 2007-02-20 The Boeing Company Exterior aircraft vision system using a helmet-mounted display
US7394916B2 (en) * 2003-02-10 2008-07-01 Activeye, Inc. Linking tracked objects that undergo temporary occlusion
JP4862774B2 (ja) * 2006-12-20 2012-01-25 アイシン・エィ・ダブリュ株式会社 運転支援方法及び運転支援装置
JP2009078719A (ja) 2007-09-26 2009-04-16 Denso Corp 視認支援装置
US20090187300A1 (en) * 2008-01-22 2009-07-23 David Wayne Everitt Integrated vehicle computer system
CN102591014B (zh) * 2011-01-07 2015-04-08 北京航天万方科技有限公司 一种全景视觉观察系统及其工作方法
TW201438940A (zh) * 2013-04-11 2014-10-16 Compal Electronics Inc 影像顯示方法及系統
WO2015002885A1 (en) * 2013-07-01 2015-01-08 Rwd Consulting, Inc. Vehicle visibility improvement system
JP6065296B2 (ja) * 2014-05-20 2017-01-25 パナソニックＩｐマネジメント株式会社 画像表示システム、および画像表示システムに用いられるディスプレイ
CN107111742B (zh) * 2014-08-18 2021-04-02 无比视视觉技术有限公司 在导航中对车道限制和施工区域的识别和预测

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070268118A1 (en) * 2006-05-17 2007-11-22 Hisayuki Watanabe Surrounding image generating apparatus and method of adjusting metering for image pickup device
CN101277432A (zh) * 2007-03-26 2008-10-01 爱信艾达株式会社 驾驶辅助方法以及驾驶辅助装置
CN103879544A (zh) * 2012-12-21 2014-06-25 空中客车公司 具有配备了用于领航的至少部分虚拟的可视表面的驾驶室的飞行器
CN104044745A (zh) * 2013-03-12 2014-09-17 霍尼韦尔国际公司 飞机驾驶舱显示器以及用于组合视景显示中的障碍物的增强显示的系统和方法
CN103253196A (zh) * 2013-05-30 2013-08-21 吕军 汽车全视纪录镜
CN103581651A (zh) * 2013-10-28 2014-02-12 西安交通大学 一种用于车载多目摄像机环视系统的虚拟视点合成方法
CN103818320A (zh) * 2014-03-14 2014-05-28 盛凯 驾驶舱用智能控制系统及控制方法
CN105405093A (zh) * 2015-11-12 2016-03-16 中国商用飞机有限责任公司 飞机驾驶舱视界增强系统和方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3291170A4 *

Also Published As

Publication number Publication date
EP3291170B1 (en) 2020-01-01
US20180237157A1 (en) 2018-08-23
CN105405093B (zh) 2019-03-15
US10654590B2 (en) 2020-05-19
EP3291170A1 (en) 2018-03-07
EP3291170A4 (en) 2018-12-19
CN105405093A (zh) 2016-03-16

Similar Documents

Publication Publication Date Title
WO2017080444A1 (zh) 飞机驾驶舱视界增强系统和方法
CA3019583C (en) Transition between binocular and monocular views
US9952657B2 (en) Display apparatus and display control method
JP6717377B2 (ja) 情報処理装置、情報処理方法、及びプログラム
CN109089074A (zh) 用于环视监控系统的摄像头角度估计方法
KR102263725B1 (ko) 주행 정보 제공 장치 및 주행 정보 제공 방법
CN112298039A (zh) 一种a柱成像方法
US20160264051A1 (en) Night Driving System and Method
CN208036106U (zh) 一种全景驾驶辅助系统和汽车
CN106143307A (zh) 一种驾驶辅助系统及车辆
KR20150115488A (ko) 차량 주변 이미지 생성 장치 및 방법
JP2018055644A5 (ja) 画像処理装置及び画像処理方法及び画像処理システム及びプログラム
CN109313025A (zh) 用于陆地车辆的光电子观察装置
WO2020228465A1 (zh) 立体显示装置以及立体显示方法
CN104890574A (zh) 一种基于机器视觉的轿车a柱盲区消除装置
US9902341B2 (en) Image processing apparatus and image processing method including area setting and perspective conversion
KR101504335B1 (ko) 어라운드뷰 제공 장치, 방법 및 차량
JP2017181588A (ja) 投影装置、遮蔽物、投影方法及び投影用プログラム
CN111016786B (zh) 基于3d视线估计的汽车a柱遮挡区域显示方法
KR20150054021A (ko) 헤드업 디스플레이를 이용한 물체 표시 장치 및 방법
CN108001176B (zh) 一种车用智能防强光护眼屏
CN207535662U (zh) 一种车用智能防强光护眼屏
KR102301030B1 (ko) 차량의 주변 감시 장치
KR101499349B1 (ko) 영상 표시 장치 및 그 구동 방법
TW201601118A (zh) 畫面重心追蹤系統及其方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16863620

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2016863620

Country of ref document: EP

Ref document number: 15578136

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE