CA2769796A1 - Airplane cockpit video system - Google Patents
Airplane cockpit video system Download PDFInfo
- Publication number
- CA2769796A1 CA2769796A1 CA2769796A CA2769796A CA2769796A1 CA 2769796 A1 CA2769796 A1 CA 2769796A1 CA 2769796 A CA2769796 A CA 2769796A CA 2769796 A CA2769796 A CA 2769796A CA 2769796 A1 CA2769796 A1 CA 2769796A1
- Authority
- CA
- Canada
- Prior art keywords
- airplane
- image
- video
- recited
- reference mark
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000012545 processing Methods 0.000 claims abstract description 24
- 238000000034 method Methods 0.000 claims description 25
- 238000012423 maintenance Methods 0.000 claims description 7
- 230000000712 assembly Effects 0.000 description 14
- 238000000429 assembly Methods 0.000 description 14
- 238000009434 installation Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 4
- 230000008901 benefit Effects 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 210000001015 abdomen Anatomy 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 238000011900 installation process Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 239000003381 stabilizer Substances 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64D—EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENTS OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
- B64D47/00—Equipment not otherwise provided for
- B64D47/08—Arrangements of cameras
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64D—EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENTS OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
- B64D45/00—Aircraft indicators or protectors not otherwise provided for
- B64D45/04—Landing aids; Safety measures to prevent collision with earth's surface
- B64D45/08—Landing aids; Safety measures to prevent collision with earth's surface optical
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B64—AIRCRAFT; AVIATION; COSMONAUTICS
- B64F—GROUND OR AIRCRAFT-CARRIER-DECK INSTALLATIONS SPECIALLY ADAPTED FOR USE IN CONNECTION WITH AIRCRAFT; DESIGNING, MANUFACTURING, ASSEMBLING, CLEANING, MAINTAINING OR REPAIRING AIRCRAFT, NOT OTHERWISE PROVIDED FOR; HANDLING, TRANSPORTING, TESTING OR INSPECTING AIRCRAFT COMPONENTS, NOT OTHERWISE PROVIDED FOR
- B64F1/00—Ground or aircraft-carrier-deck installations
- B64F1/002—Taxiing aids
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C5/00—Registering or indicating the working of vehicles
- G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
- G07C5/0841—Registering performance data
- G07C5/085—Registering performance data using electronic data carriers
- G07C5/0866—Registering performance data using electronic data carriers the electronic data carrier being a digital video recorder in combination with video camera
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course or altitude of land, water, air, or space vehicles, e.g. automatic pilot
- G05D1/04—Control of altitude or depth
- G05D1/06—Rate of change of altitude or depth
- G05D1/0607—Rate of change of altitude or depth specially adapted for aircraft
- G05D1/0653—Rate of change of altitude or depth specially adapted for aircraft during a phase of take-off or landing
- G05D1/0676—Rate of change of altitude or depth specially adapted for aircraft during a phase of take-off or landing specially adapted for landing
- G05D1/0684—Rate of change of altitude or depth specially adapted for aircraft during a phase of take-off or landing specially adapted for landing on a moving platform, e.g. aircraft carrier
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G5/00—Traffic control systems for aircraft, e.g. air-traffic control [ATC]
- G08G5/06—Traffic control systems for aircraft, e.g. air-traffic control [ATC] for control when on the ground
- G08G5/065—Navigation or guidance aids, e.g. for taxiing or rolling
Abstract
A cockpit video system for an airplane includes a camera assembly positioned on the airplane, a video monitor for receiving a signal from the camera assembly, and a video processing module for electronically aligning the signal so that a pilot of the airplane is presented with an aligned image on the video monitor. Preferably, the signal is an over-sized field of view and the alignment module performs the electronic aligning by cropping and re-aligning the over-sized field of view to fit the video monitor. The camera assembly is adapted and configured to attach to the exterior of the airplane.
Description
Atty Docket No. 87607 (50524) AIRPLANE COCKPIT VIDEO SYSTEM
BACKGROUND OF THE DISCLOSURE
1. Field of the Disclosure [0001] The subject disclosure relates to systems for assisting airplane pilots during runway taxi, and more particularly to an improved system for providing positional video to the pilot.
BACKGROUND OF THE DISCLOSURE
1. Field of the Disclosure [0001] The subject disclosure relates to systems for assisting airplane pilots during runway taxi, and more particularly to an improved system for providing positional video to the pilot.
2. Background of the Related Art [0002] Taxi-aid camera systems provide pilots with supplementary guidance for steering the airplane. Typically, the runway and even the airplane itself are provided with markings. By using views from one or more cameras of the airplane and markings, the pilots are able to determine airplane position to properly steer the airplane.
[0003] A camera is mounted in a location to provide a comprehensive view of the airplane.
The vertical tail fin of the airplane is a common location for such a camera.
When the camera is provided with a wide angle lens, the captured image can extend from wing tip to wing tip.
The vertical tail fin of the airplane is a common location for such a camera.
When the camera is provided with a wide angle lens, the captured image can extend from wing tip to wing tip.
[0004] The cameras are mechanically aligned to the airplane so that that on screen markings are also aligned to the airplane. In order for the image to be satisfactory, tight mechanical tolerances on the camera housing assembly and camera housing assembly to aircraft installation must be met.
Despite the tight tolerances, mechanical adjustment that is difficult and time consuming is also required.
Despite the tight tolerances, mechanical adjustment that is difficult and time consuming is also required.
[0005] Some examples are illustrated in: U.S. Patent No. 7,844,392 issued on November 30, 2010 to Dubourg; U.S. Patent Application Publication No.
published on April 19, 2007 to Beauregard; and U.S. Patent Application Publication No.
2003/0125141 published on November 20, 2003 to Zakrewski et al., each of which is incorporated herein by reference.
PRV 1122412.1 Atty Docket No. 87607 (50524) SUMMARY OF THE INVENTION
published on April 19, 2007 to Beauregard; and U.S. Patent Application Publication No.
2003/0125141 published on November 20, 2003 to Zakrewski et al., each of which is incorporated herein by reference.
PRV 1122412.1 Atty Docket No. 87607 (50524) SUMMARY OF THE INVENTION
[0006] In view of the above, there is a need for an improved cockpit video system and method for aligning same which permits easy installation and aids in assuring adequate alignment of the image displayed for pilots.
[0007] One embodiment of the subject technology is directed to a cockpit video system for an airplane including a camera assembly positioned on the airplane, a video monitor for receiving a signal from the camera assembly, and a video processing module for electronically aligning the signal so that a pilot of the airplane is presented with an aligned image on the video monitor. Preferably, the signal is an over-sized field of view and the alignment module performs the electronic aligning by cropping and re-aligning the over-sized field of view to fit the video monitor. The alignment module may correct for 4 degrees of misalignment of the signal or more in two axis to yield a final image alignment within 0.25 degrees or. similar specifications as desired. The camera assembly is adapted and configured to attach to the fuselage, wings, or tail planes of the airplane.
[0008] The cockpit video system may also include multiple cameras, each of which could undergo the same alignment procedure. A third camera assembly is adapted and configured to mount on an underside of the airplane to provide a view for an on board entertainment system.
The video monitor and the video processing module can be an integral unit or separate components.
The video monitor and the video processing module can be an integral unit or separate components.
[0009] Another embodiment of the subject technology is directed to a method for operating a cockpit video system of an airplane including the steps of mounting a camera assembly on the airplane to capture an image of the airplane, mounting a video monitor in a cockpit of the airplane for receiving a signal of the image from the camera assembly, prompting a maintenance operational mode to align the image on the video monitor, processing the image to PRV 1122412.1 Atty Docket No. 87607 (50524) create an aligned image by electronically adjusting the image to at least one reference mark, and presenting the aligned image on the video monitor. The electronic adjustment of the image may be automated by using image recognition software to identify the airplane in the image.
[0010] The method also can apply a reference mark to the airplane. The image recognition software can identify the reference mark in the image and adjust the image by moving the reference mark to a pedetermined location in the aligned image. The reference mark may be temporarily attached to the airplane during installation of the system, then removed. The method could also allow for manual alignment of the image to a horizontal and/or veritcal centerline on the video monitor. The reference mark could also be an outline of an airplane selectively displayed on the video monitor. The image recognition software can also be configured to identify the at least one reference mark in the image and adjust the image by moving the reference mark to a pedetermined pixel location.
[0011] Still another embodiment of the subject technology is directed to a method for aligning a cockpit video system of an airplane including the steps of capturing an image of the airplane from a taxi-aid camera, entering a maintenance mode to align the image on a video monitor in a cockpit of the airplane, analyzing the image to electronically align the airplane in the image to at least one reference mark, and presenting the aligned image on the video monitor. The image may be automatically electronically aligned by using image recognition software to identify the airplane in the image. The airplane may have an airplane reference mark so that the at least one reference mark and the airplane reference mark are configured to visually indicate a level of airplane alignment.
[0012] It should be appreciated that the present technology can be implemented and utilized in numerous ways, including without limitation as a process, an apparatus, a system, a device, a method for applications now known and later developed or a computer readable medium. These PRV 1122412.1 Atty Docket No. 87607 (50524) and other unique features of the system disclosed herein will become more readily apparent from the following description and the accompanying drawings.
BRIEF DESCRIPTION OF THE DRAWINGS
BRIEF DESCRIPTION OF THE DRAWINGS
[0013] So that those having ordinary skill in the art to which the disclosed system appertains will more readily understand how to make and use the same, reference may be had to the drawings wherein:
[0014] Figure 1 is a perspective view of an airplane having a cockpit video system in accordance with a preferred embodiment of the subject disclosure.
[0015] Figure 2 is a somewhat schematic view of the cockpit video system in accordance with a preferred embodiment of the subject disclosure.
[0016] Figure 3 is a flowchart illustrating an embodiment of a process for installation and set up of the cockpit video system of Figure 2.
[0017] Figure 4 is a raw image from a camera assembly of the cockpit video system of Figure 2.
[0018] Figure 5 is a processed image for display on a video monitor of the cockpit video system of Figure 2.
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
[0019] The present disclosure overcomes many of the prior art problems associated with airplane cockpit video systems that assist pilots during runway taxi and at other times. The advantages, and other features of the system disclosed herein, will become more readily apparent to those having ordinary skill in the art from the following detailed description of certain preferred embodiments taken in conjunction with the drawings which set forth representative embodiments of the present invention and wherein like reference numerals identify similar structural elements.
PRV 1122412.1 Atty Docket No. 87607 (50524) [0020] All relative descriptions herein such as left, right, up, and down are with reference to the Figures, and not meant in a limiting sense. The illustrated embodiments can be understood as providing exemplary features of varying detail of certain embodiments, and therefore, features, components, modules, elements, and/or aspects of the illustrations can be otherwise combined, interconnected, sequenced, separated, interchanged, positioned, and/or rearranged without materially departing from the disclosed systems or methods.
[0021 ] Referring now to Figure 1, a perspective view of an airplane 10 having a cockpit video system 100 in accordance with a preferred embodiment of the subject disclosure is shown. The airplane 10 has a fuselage 12 with wings 14 extending horizontally and a tail 16 extending vertically. The cockpit video system 100 mounts one or more camera assemblies 102a-c to capture images for display in the cockpit 18.
[0022] Referring now to Figure 2, a somewhat schematic view of the cockpit video system 100 in accordance with a preferred embodiment of the subject disclosure is shown. The cockpit video system 100 could utilize only a single camera or a plurality of camera assemblies 102a-c, three being shown. As shown in Figure 1, the cockpit video system 100 includes two taxi-aid camera assemblies 102a, 102b and a landscape camera assembly 102c. The first camera assembly 102a is positioned in the vertical tail 16. An area near a top of the airplane tail 16 should house the camera assembly 102 to provide a proper vantage point but other locations may be suitable depending upon the airplane configuration. The second camera assembly 102b is positioned on the underside or belly of the fuselage 12. The taxi-aid camera assemblies 102a, 102b provide views generally forward and surrounding the airplane 10. In alternative embodiments, varying numbers of camera assemblies are utilized, which may be placed anywhere such as on the horizontal stabilizers, airplane wings and the like.
[0023] Preferably, the first camera assembly 102a provides a view of the main gear, the PRV 1122412.1 Atty Docket No. 87607 (50524) surroundings of the leading edge of the vertial tail 16, and 'a horizontal span nearly from wing tip to wing tip. In one embodiment, the camera assemblies 102a, 102b have the same native field of view but the resulting images are processed and may display differently. In another embodiment, the first camera assembly 102a has an 80 degree horizontal field of view and a 45 degree vertical field of view. The second camera assembly 102b captures a view of the nose gear and surroundings. The second camera assembly 102b has a 90 degree horizontal field of view and a 57 degree vertical field of view. The landscape camera assembly 102c has a downward view for capturing scenery below the airplane.
[0024] Each camera assembly 102a-c can have a wide angle lens to provide an over-sized field of view. Each camera assembly 102a-c is retained in a housing (not explicitly shown) for flush mounting in the respective location. Alternatively, a slight bulge may be formed in the airplane 10 so that the camera assembly 102a-c may acquire a proper view through a window in the respective housing. The housing window is a durable scratch and impact resistant material as well as heated to provide clarity and protection under harsh conditions.
[0025] Still referring to Figure 2, the raw signals from the camera assemblies 102a-c are transmitted to a video processing module 104. The video processing module 104 acts as a multiplexer so that a single display can be utilized for all of the images or a single signal can be selected as desired. The video processing module 104 also electronically aligns the signals from the taxi-aid camera assemblies 102a, 102b as described in more detail below with respect to Figures 3-5. The raw signals may be transmitted through wires, fiber optics, wirelessly and the like as is well known to those of ordinary skill in the pertinent art.
[0026] Once the raw signals are processed into an aligned image signal by the video processing module 104, the aligned image signal or signals are displayed on a video monitor 106 for review by the pilot. Any of the signals may also be presented in the entertainment monitors PRV 1122412.1 Atty Docket No. 87607 (50524) for passenger entertainment or information. The landscape camera assembly 102c may also capture scenic images primarily for entertainment purposes. The video processing module 104 can also tile or mosaic multiple images on a single monitor or plurality of monitors. The video processing module 104 and monitor 106 may be combined into a single unit or exist as separate components that serve other purposes at other times. For example, the monitor 106 may present other images to the pilots from additional camera assemblies (not shown explicitly) or non-video related information.
[0027] Figure 3 is a flowchart illustrating an embodiment of a process 300 for installation and set up of the cockpit video system of Figure 2. Initially, at step S 1, the camera assemblies 102a-c, the video processing module 104, and monitor 106 are installed and inter connected. At step S2, the camera assemblies 102a-c are powered on to capture video images that are transmitted to the video processing module 104, which is set in maintenance mode that may only be available for grounded aircraft. Due to lens, sensor and housing tolerances, internal camera misalignment occurs. Further, the camera assemblies 102a-c are also misaligned to the airplane 10. It is possible to pin the cameras and housing to reduce this misalignment, however with the subject technology, pinning is not required.
[0028] In maintenance mode, the video processing module 104 presents a raw image that may be adjusted with real-time feedback by a technician. Referring additionally to Figure 4, an example of a possible raw image 400 is shown. The raw image 400 is oversized with respect the final image used during taxi. The raw image 400 may also be misaligned both vertically and horizontally. To illustrate the misalignment, a centerline 402 is shown on Figure 4. As can be seen, the airplane 10 and tail 16 are to the left of the centerline 402 indicating horizontal misalignment. Additionally, the area in front of the airplane 10 cannot be seen indicating vertical misalignment.
[0029] Still referring to Figure 3, to perform aligning adjustments, either or both of the PRV 1122412.1 Atty Docket No. 87607 (50524) video processing module 104 and the video monitor 106 includes a user interface. At step S3, the technician uses the user interface to adjust or realign the raw image 400 to produce the processed image 500 shown in Figure 5 and the process 300 ends. In order to align the image, the video processing module 104 crops and re-aligns the over-sized raw image 400 based upon inputs from the user interface.
[0030] In the processed image 500, the airplane 10 is aligned with the center line 502 and the area in front of the airplane 10 can be seen indicating horizontal and vertical alignment. The processed image 500 is adjusted to include the desired features of interest. The processed image 500 also includes optional alignment reference marks 504. The reference marks 504 may be utilized with various structure of the airplane 10 to assist a technician in proper alignment. Additionally, the airplane 10 may include temporary or permanent visual indicia as reference points to facilitate correction of the raw image 400. In one embodiment, the video processing module 104 includes a pointing mechanism such as a mouse with associated software so the technician can apply a virtual rectangle around the portion of the raw image 400 that becomes the processed image 500.
[0031] In one embodiment, the video processing module 104 corrects for 4 degrees of mechanical misalignment of the raw image 300 although more and less corrections such as 7 degrees, 5.5 degrees, or 3 degrees may be accomplished depending upon the requirements resulting from internal camera misalignment and camera assembly to airplane misalignment. The video processing module 104 may also include a separate display monitor (not shown) or output connection for temporary connection of temporary monitor and components to be used as a user interface.
[0032] As a benefit of having the video processing module 104 electronically correct the misalignment, the mechanical tolerances and alignment pinning on installation of the camera assemblies 102a-c can be loosened or removed. The cost savings of simpler, lower cost camera PRV 1122412.1 Atty Docket No. 87607 (50524) assemblies 102a-c and simplification of the installation process are significant.
[0033] In another embodiment, the cockpit video system 100 utilizes image recognition software to automatically align on-screen views of the airplane. The image recognition software could be achieved by using known airplane geometry, fiducial alignment marks applied to the airplane (permanently or temporarily), fiducial marks applied to the image (optically or electronically) and the like. The video monitor 106 could be precalibrated to have a set location for one or more alignment marks or structures on the airplane. Once the relevant reference marks or structures are identified, the video processing module 104 simply moves the marks or structures to the precalibrated position for same to accomplish the alignment. The cockpit video system 100 could also allow manual alignment to fiducial marks and the like.
[0034] For example, the fiducial marks could be the centerline 502 of Figure 5 embossed into the monitor assembly along with other marks on the monitor frame such as to mark a horizontal point of the forward tip of the airplane image or a top of the wing position.
Further fiducial marks other than the reference marks 504 could be included on the screen image. For example, the screen image could include a thin dashed outline of the respective airplane in maintenance mode so that the live image is simply slid there under (manually or electronically) to accomplish the alignment. It is also envisioned that an airplane reference mark is matched to a video reference mark so that the video reference mark and the airplane reference mark visually indicate a level of airplane alignment in degrees and the like. The image recognition software can also be configured to identify the reference mark in the image and adjust the image by moving the reference mark to a pedetermined pixel location.
[0035] As would be appreciated by those of ordinary skill in the pertinent art, the subject technology is applicable to use on helicopters, automobiles and the like. The functions of several elements may, in alternative embodiments, be carried out by fewer elements, or a single element.
PRV 1122412.1 Atty Docket No. 87607 (50524) Similarly, in some embodiments, any functional element may perform fewer, or different, operations than those described with respect to the illustrated embodiment.
Further, relative size and location are merely illustrative and it is understood that not only the same but many other embodiments could have varying depictions and configurations.
[0036] While the invention has been described with respect to preferred embodiments, those skilled in the art will readily appreciate that various changes and/or modifications can be made to the invention without departing from the spirit or scope of the invention as defined by the appended claims. For example, each claim may depend from any or all claims in a multiple dependent manner even though such has not been originally claimed.
PRV 1122412.1
PRV 1122412.1 Atty Docket No. 87607 (50524) [0020] All relative descriptions herein such as left, right, up, and down are with reference to the Figures, and not meant in a limiting sense. The illustrated embodiments can be understood as providing exemplary features of varying detail of certain embodiments, and therefore, features, components, modules, elements, and/or aspects of the illustrations can be otherwise combined, interconnected, sequenced, separated, interchanged, positioned, and/or rearranged without materially departing from the disclosed systems or methods.
[0021 ] Referring now to Figure 1, a perspective view of an airplane 10 having a cockpit video system 100 in accordance with a preferred embodiment of the subject disclosure is shown. The airplane 10 has a fuselage 12 with wings 14 extending horizontally and a tail 16 extending vertically. The cockpit video system 100 mounts one or more camera assemblies 102a-c to capture images for display in the cockpit 18.
[0022] Referring now to Figure 2, a somewhat schematic view of the cockpit video system 100 in accordance with a preferred embodiment of the subject disclosure is shown. The cockpit video system 100 could utilize only a single camera or a plurality of camera assemblies 102a-c, three being shown. As shown in Figure 1, the cockpit video system 100 includes two taxi-aid camera assemblies 102a, 102b and a landscape camera assembly 102c. The first camera assembly 102a is positioned in the vertical tail 16. An area near a top of the airplane tail 16 should house the camera assembly 102 to provide a proper vantage point but other locations may be suitable depending upon the airplane configuration. The second camera assembly 102b is positioned on the underside or belly of the fuselage 12. The taxi-aid camera assemblies 102a, 102b provide views generally forward and surrounding the airplane 10. In alternative embodiments, varying numbers of camera assemblies are utilized, which may be placed anywhere such as on the horizontal stabilizers, airplane wings and the like.
[0023] Preferably, the first camera assembly 102a provides a view of the main gear, the PRV 1122412.1 Atty Docket No. 87607 (50524) surroundings of the leading edge of the vertial tail 16, and 'a horizontal span nearly from wing tip to wing tip. In one embodiment, the camera assemblies 102a, 102b have the same native field of view but the resulting images are processed and may display differently. In another embodiment, the first camera assembly 102a has an 80 degree horizontal field of view and a 45 degree vertical field of view. The second camera assembly 102b captures a view of the nose gear and surroundings. The second camera assembly 102b has a 90 degree horizontal field of view and a 57 degree vertical field of view. The landscape camera assembly 102c has a downward view for capturing scenery below the airplane.
[0024] Each camera assembly 102a-c can have a wide angle lens to provide an over-sized field of view. Each camera assembly 102a-c is retained in a housing (not explicitly shown) for flush mounting in the respective location. Alternatively, a slight bulge may be formed in the airplane 10 so that the camera assembly 102a-c may acquire a proper view through a window in the respective housing. The housing window is a durable scratch and impact resistant material as well as heated to provide clarity and protection under harsh conditions.
[0025] Still referring to Figure 2, the raw signals from the camera assemblies 102a-c are transmitted to a video processing module 104. The video processing module 104 acts as a multiplexer so that a single display can be utilized for all of the images or a single signal can be selected as desired. The video processing module 104 also electronically aligns the signals from the taxi-aid camera assemblies 102a, 102b as described in more detail below with respect to Figures 3-5. The raw signals may be transmitted through wires, fiber optics, wirelessly and the like as is well known to those of ordinary skill in the pertinent art.
[0026] Once the raw signals are processed into an aligned image signal by the video processing module 104, the aligned image signal or signals are displayed on a video monitor 106 for review by the pilot. Any of the signals may also be presented in the entertainment monitors PRV 1122412.1 Atty Docket No. 87607 (50524) for passenger entertainment or information. The landscape camera assembly 102c may also capture scenic images primarily for entertainment purposes. The video processing module 104 can also tile or mosaic multiple images on a single monitor or plurality of monitors. The video processing module 104 and monitor 106 may be combined into a single unit or exist as separate components that serve other purposes at other times. For example, the monitor 106 may present other images to the pilots from additional camera assemblies (not shown explicitly) or non-video related information.
[0027] Figure 3 is a flowchart illustrating an embodiment of a process 300 for installation and set up of the cockpit video system of Figure 2. Initially, at step S 1, the camera assemblies 102a-c, the video processing module 104, and monitor 106 are installed and inter connected. At step S2, the camera assemblies 102a-c are powered on to capture video images that are transmitted to the video processing module 104, which is set in maintenance mode that may only be available for grounded aircraft. Due to lens, sensor and housing tolerances, internal camera misalignment occurs. Further, the camera assemblies 102a-c are also misaligned to the airplane 10. It is possible to pin the cameras and housing to reduce this misalignment, however with the subject technology, pinning is not required.
[0028] In maintenance mode, the video processing module 104 presents a raw image that may be adjusted with real-time feedback by a technician. Referring additionally to Figure 4, an example of a possible raw image 400 is shown. The raw image 400 is oversized with respect the final image used during taxi. The raw image 400 may also be misaligned both vertically and horizontally. To illustrate the misalignment, a centerline 402 is shown on Figure 4. As can be seen, the airplane 10 and tail 16 are to the left of the centerline 402 indicating horizontal misalignment. Additionally, the area in front of the airplane 10 cannot be seen indicating vertical misalignment.
[0029] Still referring to Figure 3, to perform aligning adjustments, either or both of the PRV 1122412.1 Atty Docket No. 87607 (50524) video processing module 104 and the video monitor 106 includes a user interface. At step S3, the technician uses the user interface to adjust or realign the raw image 400 to produce the processed image 500 shown in Figure 5 and the process 300 ends. In order to align the image, the video processing module 104 crops and re-aligns the over-sized raw image 400 based upon inputs from the user interface.
[0030] In the processed image 500, the airplane 10 is aligned with the center line 502 and the area in front of the airplane 10 can be seen indicating horizontal and vertical alignment. The processed image 500 is adjusted to include the desired features of interest. The processed image 500 also includes optional alignment reference marks 504. The reference marks 504 may be utilized with various structure of the airplane 10 to assist a technician in proper alignment. Additionally, the airplane 10 may include temporary or permanent visual indicia as reference points to facilitate correction of the raw image 400. In one embodiment, the video processing module 104 includes a pointing mechanism such as a mouse with associated software so the technician can apply a virtual rectangle around the portion of the raw image 400 that becomes the processed image 500.
[0031] In one embodiment, the video processing module 104 corrects for 4 degrees of mechanical misalignment of the raw image 300 although more and less corrections such as 7 degrees, 5.5 degrees, or 3 degrees may be accomplished depending upon the requirements resulting from internal camera misalignment and camera assembly to airplane misalignment. The video processing module 104 may also include a separate display monitor (not shown) or output connection for temporary connection of temporary monitor and components to be used as a user interface.
[0032] As a benefit of having the video processing module 104 electronically correct the misalignment, the mechanical tolerances and alignment pinning on installation of the camera assemblies 102a-c can be loosened or removed. The cost savings of simpler, lower cost camera PRV 1122412.1 Atty Docket No. 87607 (50524) assemblies 102a-c and simplification of the installation process are significant.
[0033] In another embodiment, the cockpit video system 100 utilizes image recognition software to automatically align on-screen views of the airplane. The image recognition software could be achieved by using known airplane geometry, fiducial alignment marks applied to the airplane (permanently or temporarily), fiducial marks applied to the image (optically or electronically) and the like. The video monitor 106 could be precalibrated to have a set location for one or more alignment marks or structures on the airplane. Once the relevant reference marks or structures are identified, the video processing module 104 simply moves the marks or structures to the precalibrated position for same to accomplish the alignment. The cockpit video system 100 could also allow manual alignment to fiducial marks and the like.
[0034] For example, the fiducial marks could be the centerline 502 of Figure 5 embossed into the monitor assembly along with other marks on the monitor frame such as to mark a horizontal point of the forward tip of the airplane image or a top of the wing position.
Further fiducial marks other than the reference marks 504 could be included on the screen image. For example, the screen image could include a thin dashed outline of the respective airplane in maintenance mode so that the live image is simply slid there under (manually or electronically) to accomplish the alignment. It is also envisioned that an airplane reference mark is matched to a video reference mark so that the video reference mark and the airplane reference mark visually indicate a level of airplane alignment in degrees and the like. The image recognition software can also be configured to identify the reference mark in the image and adjust the image by moving the reference mark to a pedetermined pixel location.
[0035] As would be appreciated by those of ordinary skill in the pertinent art, the subject technology is applicable to use on helicopters, automobiles and the like. The functions of several elements may, in alternative embodiments, be carried out by fewer elements, or a single element.
PRV 1122412.1 Atty Docket No. 87607 (50524) Similarly, in some embodiments, any functional element may perform fewer, or different, operations than those described with respect to the illustrated embodiment.
Further, relative size and location are merely illustrative and it is understood that not only the same but many other embodiments could have varying depictions and configurations.
[0036] While the invention has been described with respect to preferred embodiments, those skilled in the art will readily appreciate that various changes and/or modifications can be made to the invention without departing from the spirit or scope of the invention as defined by the appended claims. For example, each claim may depend from any or all claims in a multiple dependent manner even though such has not been originally claimed.
PRV 1122412.1
Claims (20)
1. A cockpit video system for an airplane comprising:
a camera assembly positioned on the airplane;
a video monitor for receiving a signal from the camera assembly; and a video processing module for electronically aligning the signal so that a pilot of the airplane is presented with an aligned image on the video monitor.
a camera assembly positioned on the airplane;
a video monitor for receiving a signal from the camera assembly; and a video processing module for electronically aligning the signal so that a pilot of the airplane is presented with an aligned image on the video monitor.
2. A cockpit video system as recited in Claim 1, wherein the signal is an over-sized field of view and the alignment module performs the electronic aligning by cropping and re-aligning the over-sized field of view to fit the video monitor.
3. A cockpit video system as recited in Claim 1, wherein the alignment module corrects for 4 degrees of misalignment of the signal in two axes to yield a final image alignment within 0.25 degrees.
4. A cockpit video system as recited in Claim 1, wherein the camera assembly is adapted and configured to attach within a tail of the airplane.
5. A cockpit video system as recited in Claim 1, further comprising a second camera assembly adapted and configured to view the nose landing gear of the airplane.
6. A cockpit video system as recited in Claim 1, wherein the video processing module and the camera assembly are an integral unit.
7. A cockpit video system as recited in Claim 1, wherein the video monitor and the video processing module are an integral unit.
8. A method for operating a cockpit video system of an airplane comprising the steps of:
mounting a camera assembly on the airplane to capture an image of the airplane;
mounting a video monitor in a cockpit of the airplane for receiving a signal of the video image from the camera assembly;
processing the video image to create an aligned image by electronically adjusting the image to at least one reference mark; and presenting the aligned image on the video monitor.
mounting a camera assembly on the airplane to capture an image of the airplane;
mounting a video monitor in a cockpit of the airplane for receiving a signal of the video image from the camera assembly;
processing the video image to create an aligned image by electronically adjusting the image to at least one reference mark; and presenting the aligned image on the video monitor.
9. A method as recited in Claim 8, further comprising the step of automatically electronically adjusting the video image.
10. A method as recited in Claim 9, further comprising the step of using image recognition software to identify the airplane in the video image.
11. A method as recited in Claim 8, further comprising the step of applying a reference mark to the airplane from which to align the video image.
12. A method as recited in Claim 11, further comprising the step of using image recognition software to identify the reference mark in the video image and adjust the video image by moving the reference mark to a pedetermined location in the aligned image.
PRV 1122412.1
PRV 1122412.1
13. A method as recited in Claim 11, further comprising the step of prompting a maintenance operational mode to align the video image on the video monitor, and wherein the reference mark is temporary.
14. A method as recited in Claim 11, wherein the at least one reference mark is a centerline on the video monitor.
15. A method as recited in Claim 11, wherein the at least one reference mark is an outline of an airplane selectively displayed on the video monitor.
16. A method for aligning a cockpit video system of an airplane comprising the steps of:
capturing an image of the airplane from a taxi-aid camera;
entering a maintenance mode to align the image on a video monitor in a cockpit of the airplane;
analyzing the image to electronically align the airplane in the image to at least one reference mark; and presenting the aligned image on the video monitor.
capturing an image of the airplane from a taxi-aid camera;
entering a maintenance mode to align the image on a video monitor in a cockpit of the airplane;
analyzing the image to electronically align the airplane in the image to at least one reference mark; and presenting the aligned image on the video monitor.
17. A method as recited in Claim 16, further comprising the step of automatically electronically aligning the image by using image recognition software to identify the airplane in the image.
18. A method as recited in Claim 16, further comprising the step of applying an airplane reference mark to the airplane so that the at least one reference mark and the airplane reference mark are configured to visually indicate a level of airplane alignment.
19. A method as recited in Claim 16, further comprising the step of using image recognition software to identify the at least one reference mark in the image and automatically adjust the image by moving the reference mark to a predetermined pixel location.
20. A method as recited in Claim 16, wherein the at least one reference mark is a centerline on the video monitor.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/038,931 | 2011-03-02 | ||
US13/038,931 US20120224058A1 (en) | 2011-03-02 | 2011-03-02 | Airplane cockpit video system |
Publications (1)
Publication Number | Publication Date |
---|---|
CA2769796A1 true CA2769796A1 (en) | 2012-09-02 |
Family
ID=45937129
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CA2769796A Abandoned CA2769796A1 (en) | 2011-03-02 | 2012-02-27 | Airplane cockpit video system |
Country Status (5)
Country | Link |
---|---|
US (1) | US20120224058A1 (en) |
EP (1) | EP2495168A1 (en) |
CN (1) | CN102655587A (en) |
BR (1) | BR102012004373A2 (en) |
CA (1) | CA2769796A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3312082A1 (en) | 2016-10-18 | 2018-04-25 | AIRBUS HELICOPTERS DEUTSCHLAND GmbH | An aircraft with a plurality of aircraft doors |
US11117674B2 (en) | 2016-12-07 | 2021-09-14 | Airbus Helicopters Deutschland GmbH | Aircraft with an airframe and at least one electrically powered thrust producing unit |
Families Citing this family (28)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11021136B1 (en) * | 2011-08-29 | 2021-06-01 | The Boeing Company | Methods and systems for providing a remote virtual view |
US8880328B2 (en) * | 2012-11-02 | 2014-11-04 | Ge Aviation Systems Llc | Method of optically locating an aircraft relative to an airport |
EP2922751B1 (en) | 2012-11-20 | 2020-07-22 | Learjet Inc. | Optical viewing apparatus for aircraft doorway |
EP2744217A1 (en) * | 2012-12-14 | 2014-06-18 | Airbus Operations GmbH | A method to provide a virtual cockpit experience to the flying passenger |
US9058742B2 (en) * | 2013-02-12 | 2015-06-16 | Ge Aviation Systems, Llc | Methods for illustrating aircraft situational information |
US9031311B2 (en) * | 2013-02-28 | 2015-05-12 | The Boeing Company | Identification of aircraft surface positions using camera images |
FR3004423B1 (en) * | 2013-04-12 | 2015-05-01 | Latecoere | METHOD AND SYSTEM FOR VISUALIZING THE EXTERNAL ENVIRONMENT OF AN AIRCRAFT, AND AIRCRAFT DOOR EQUIPPED WITH SUCH A SYSTEM |
US9047771B1 (en) * | 2014-03-07 | 2015-06-02 | The Boeing Company | Systems and methods for ground collision avoidance |
FR3023406B1 (en) * | 2014-07-07 | 2019-07-12 | Airbus | METHOD FOR AIDING THE FLIGHT OF AN AIRCRAFT AND SYSTEM FOR ITS IMPLEMENTATION |
EP2998817B1 (en) * | 2014-09-16 | 2017-06-07 | Aviovision | System for calculating aircraft performance and method for performing the same |
FR3030091B1 (en) * | 2014-12-12 | 2018-01-26 | Airbus Operations | METHOD AND SYSTEM FOR AUTOMATICALLY DETECTING A DISALLIATION IN OPERATION OF A MONITORING SENSOR OF AN AIRCRAFT. |
FR3031731B1 (en) * | 2015-01-20 | 2017-01-06 | Airbus Operations Sas | METHOD AND SYSTEM FOR AIDING THE FLOORING OF AN AIRCRAFT |
US10043404B2 (en) | 2016-04-18 | 2018-08-07 | Rosemount Aerospace Inc. | Method and system for aircraft taxi strike alerting |
US11319086B2 (en) * | 2016-05-23 | 2022-05-03 | Rosemount Aerospace Inc. | Method and system for aligning a taxi-assist camera |
US10511762B2 (en) * | 2016-10-24 | 2019-12-17 | Rosemount Aerospace Inc. | System and method for aircraft camera image alignment |
US10559213B2 (en) | 2017-03-06 | 2020-02-11 | Rosemount Aerospace Inc. | Method and system for aircraft taxi strike alerting |
US10096256B2 (en) | 2017-03-07 | 2018-10-09 | Rosemount Aerospace Inc. | Method and system for aircraft taxi strike alerting |
US10720069B2 (en) | 2017-04-17 | 2020-07-21 | Rosemount Aerospace Inc. | Method and system for aircraft taxi strike alerting |
US10217371B1 (en) | 2017-08-22 | 2019-02-26 | Rosemount Aerospace Inc. | Method and system for aircraft taxi strike alerting using adaptive field of view |
US10803760B2 (en) | 2017-10-13 | 2020-10-13 | Rosemount Aerospace Inc. | Method and system for rendering and displaying a perspective view of aircraft taxi operation |
US10553123B2 (en) | 2017-11-16 | 2020-02-04 | Simmonds Precision Products, Inc. | Determination of collision risks between a taxiing aircraft and objects external to the taxiing aircraft |
US10642053B2 (en) | 2018-03-26 | 2020-05-05 | Simmonds Precision Products, Inc. | Scanned linear illumination of distant objects |
US10818024B2 (en) | 2018-03-26 | 2020-10-27 | Simmonds Precision Products, Inc. | Ranging objects external to an aircraft using multi-camera triangulation |
US10725180B2 (en) | 2018-03-26 | 2020-07-28 | Rosemount Aerospace Inc. | Array of independently-controllable laser diode bars for scanning a linear illumination pattern |
US11094210B2 (en) | 2018-05-09 | 2021-08-17 | Simmonds Precision Products, Inc. | Airport surface navigation aid |
CN109250070B (en) * | 2018-09-25 | 2021-09-14 | 陕西飞机工业(集团)有限公司 | Method for marking flap lowering angle of upper single-wing aircraft |
CN111017241B (en) * | 2019-12-19 | 2023-05-23 | 中国航空工业集团公司西安飞机设计研究所 | Wing flow field measuring device and method of double-fuselage unmanned aerial vehicle |
US11227379B2 (en) * | 2020-03-25 | 2022-01-18 | The Boeing Company | Inspection and imaging system and method of use |
Family Cites Families (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
SE429690B (en) * | 1979-11-19 | 1983-09-19 | Hans Erik Ove Olofsson | AIRPLANE REFERRED WORLD REGISTRATION WITH THE HELP OF CAMERA, WHICH ALLOWS ELECTRONIC REGISTRATION, AND THEIR CONCERNING ENCOURAGEMENT PROCEDURE |
US5440337A (en) * | 1993-11-12 | 1995-08-08 | Puritan-Bennett Corporation | Multi-camera closed circuit television system for aircraft |
US6405975B1 (en) * | 1995-12-19 | 2002-06-18 | The Boeing Company | Airplane ground maneuvering camera system |
US6366311B1 (en) * | 1996-10-11 | 2002-04-02 | David A. Monroe | Record and playback system for aircraft |
US7280134B1 (en) * | 1998-01-26 | 2007-10-09 | Thales Avionics, Inc. | Landscape camera system with electronic field of view switching |
US6694064B1 (en) * | 1999-11-19 | 2004-02-17 | Positive Systems, Inc. | Digital aerial image mosaic method and apparatus |
US20030048357A1 (en) * | 2001-08-29 | 2003-03-13 | Geovantage, Inc. | Digital imaging system for airborne applications |
US6638189B2 (en) | 2001-12-28 | 2003-10-28 | Mei Huei Liu | Inflatable game ball and method of making same |
IL155034A0 (en) * | 2003-03-23 | 2004-06-20 | M A M D Digital Data Proc Syst | Automatic aerial digital photography and digital data processing systems |
FR2866960B1 (en) * | 2004-02-27 | 2006-09-15 | Thales Sa | SECURE OPTOELECTRONIC AIDING DEVICE FOR AIRCRAFT |
US20070085907A1 (en) | 2005-10-14 | 2007-04-19 | Smiths Aerospace Llc | Video storage uplink system |
EP1798587B1 (en) * | 2005-12-15 | 2012-06-13 | Saab Ab | Head-up display |
US7623044B2 (en) * | 2006-04-06 | 2009-11-24 | Honeywell International Inc. | Runway and taxiway turning guidance |
GB2447672B (en) * | 2007-03-21 | 2011-12-14 | Ford Global Tech Llc | Vehicle manoeuvring aids |
CA2691375C (en) * | 2007-07-18 | 2014-05-20 | Elbit Systems Ltd. | Aircraft landing assistance |
US8017898B2 (en) * | 2007-08-17 | 2011-09-13 | Magna Electronics Inc. | Vehicular imaging system in an automatic headlamp control system |
EP2232463B1 (en) * | 2007-11-30 | 2018-04-11 | Searidge Technologies INC. | Airport target tracking system |
FR2942343B1 (en) * | 2009-02-16 | 2012-10-12 | Airbus France | AIRCRAFT EQUIPMENT ASSEMBLY COMPRISING A VIDEO SENSOR AND AT LEAST TWO HIGH HEAD VISUALIZATION DEVICES |
-
2011
- 2011-03-02 US US13/038,931 patent/US20120224058A1/en not_active Abandoned
-
2012
- 2012-02-27 CA CA2769796A patent/CA2769796A1/en not_active Abandoned
- 2012-02-28 BR BR102012004373A patent/BR102012004373A2/en not_active Application Discontinuation
- 2012-02-28 EP EP12250043A patent/EP2495168A1/en not_active Withdrawn
- 2012-03-01 CN CN201210052144.2A patent/CN102655587A/en active Pending
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3312082A1 (en) | 2016-10-18 | 2018-04-25 | AIRBUS HELICOPTERS DEUTSCHLAND GmbH | An aircraft with a plurality of aircraft doors |
US10711487B2 (en) | 2016-10-18 | 2020-07-14 | Airbus Helicopters Deutschland GmbH | Aircraft with a plurality of aircraft doors |
US11117674B2 (en) | 2016-12-07 | 2021-09-14 | Airbus Helicopters Deutschland GmbH | Aircraft with an airframe and at least one electrically powered thrust producing unit |
Also Published As
Publication number | Publication date |
---|---|
US20120224058A1 (en) | 2012-09-06 |
EP2495168A1 (en) | 2012-09-05 |
CN102655587A (en) | 2012-09-05 |
BR102012004373A2 (en) | 2016-10-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20120224058A1 (en) | Airplane cockpit video system | |
US9541763B1 (en) | Active HUD alignment | |
US9323056B2 (en) | Method of aligning a helmet mounted display | |
US9401094B2 (en) | Method for assisting the piloting of an aircraft on the ground and system for its implementation | |
JP3618805B2 (en) | Dedicated television equipment for multifunctional cameras for aircraft | |
CN201385620Y (en) | Cab visual disturbance eliminating device | |
US10711696B2 (en) | Engine installation using machine vision for alignment | |
EP2336028A1 (en) | Improved method and system for enhanced vision in aerial refueling operations | |
EP2336027A1 (en) | Method and system for enhanced vision in aerial refuelling operations | |
WO2013061066A3 (en) | Identification and analysis of aircraft landing sites | |
CN205333968U (en) | HUD governing system | |
WO2009152091A3 (en) | System and method for displaying aerial refueling symbology | |
US10818091B2 (en) | Visualization system for an aircraft using LIDAR point cloud model | |
CN107392853A (en) | Double-camera video frequency merges distortion correction and viewpoint readjustment method and system | |
CN102929297A (en) | Take-off and landing tracking system and method for airplane | |
US8537214B2 (en) | Method of regulating a harmonization compensation between video sensor and head up display device, and corresponding devices | |
EP2341386A1 (en) | A method of aligning a helmet mounted display | |
US10511762B2 (en) | System and method for aircraft camera image alignment | |
CN105405093A (en) | Cockpit visual field reinforcing system and method | |
US20170289463A1 (en) | Imaging system, video processing system, and video processing method | |
CN207523549U (en) | For eliminating the display device of automobile A column ken blind area | |
CN104670093B (en) | Automobile starting blind area monitors image capture method and system | |
US20210383709A1 (en) | Enhanced flight vision system for an aircraft | |
EP3118122B1 (en) | Viewing system for in-flight refuelling | |
CN110493565B (en) | Monitoring system and monitoring method for aircraft air refueling |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
EEER | Examination request |
Effective date: 20170224 |
|
FZDE | Discontinued |
Effective date: 20190822 |