Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N7/00—Television systems
  • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N7/00—Television systems
  • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
  • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources

Definitions

• the invention relates to a system for visualizing an environment with the aid of TV cameras and at least one display unit.
• Systems of this type are well-known in the art and may for instance be used for surveillance purposes. To this end, a limited number of azimuth directions is monitored with the aid of several TV cameras. Images from these TV cameras are displayed simultaneously on several display screens; it may also occur that only one display screen is available and a selector switch for selecting a TV camera.
• the system according to the invention does not have this drawback and is characterized in that an array of TV cameras is provided for at least substantially simultaneously visualizing each azimuth direction of the environment .
• a compact embodiment of the invention is characterized in that the array of TV cameras is arranged in one plane to cover an at least substantially 360 degree field of view.
• a further advantageous embodiment which precludes the occurrence of blind angles is characterized in that each TV camera in the array of TV cameras has an aperture such that each azimuth direction can be monitored with at least one TV camera.
• each TV camera in the array of TV cameras has an aperture such that each azimuth direction can be monitored with at least one TV camera.
• each TV camera its own aperture, for instance on the basis of a desired resolution in a certain azimuth direction.
• all TV cameras have similar apertures, which simplifies the merging of sub-images from adjacent TV cameras.
• a further advantageous embodiment of the invention is therefore characterized in that the apertures of adjacent TV cameras slightly overlap at least in azimuth direction.
• a still further advantageous embodiment of the invention is characterized in that the system includes an image processor for merging the sub-images obtained with the aid of the array of TV cameras into one panoramic image.
• the system includes an image processor for merging the sub-images obtained with the aid of the array of TV cameras into one panoramic image.
• the sub-images are stored in the image processor in the form of matrices of N rows in elevation direction and M columns in azimuth direction. Merging then merely involves a once-only readjustment, in an alignment procedure, of the relative row numbers so that horizontal rows continue and the column numbers run consecutively.
• a possible problem during alignment is constituted by the overlap in azimuth direction.
• a still further advantageous embodiment of the invention is therefore characterized in that the image processor is also designed to define one new pixel from two corresponding pixels in overlapping sub- images. This may be realized through point-wise linear interpolation.
• a further advantageous embodiment of the invention is characterized in that the display unit is designed to present at least a part of the surrounding panorama, centred around a selected azimuth direction.
• the display unit may incorporate a selector device, for instance a rotary knob.
• a highly advantageous embodiment of the invention is characterized in that the display unit includes at least one helmet-mounted display and the selected azimuth direction corresponds with a direction that the user of the helmet-mounted display is facing.
• a display affords a view of the surrounding area from a completely darkened room. This is for instance of importance in a vessel constructed to minimize radar reflection, which rules out the conventional navigating bridge or other superstructure.
• an array of TV cameras is installed on the ship which can be realized without any appreciable increase of the radar cross-section; the navigation bridge is placed below the water line and the helmet-mounted displays enable crew members to observe the surrounding panorama without hindrance.
• the helmet-mounted display should be equipped with a sensor for determining the direction of view, however, sensors of this type are well-known in the art.
• a further, highly advantageous embodiment of the invention is characterized in that the array of TV cameras comprises an even sub-array and an odd sub-array whereby each sub- array is designed to at least substantially simultaneously visualize each azimuth direction of the environment and always one TV camera in the even sub-array and one TV camera in the odd sub-array are identically aligned in azimuth direction, which produces a stereoscopic effect.
• each of the two sub-arrays comprises an image processor for merging the sub-images obtained with the aid of a sub-array into one panoramic image and that a stereoscopic display screen is provided for stereo- scopically displaying at least a portion of the panoramic images, centred around a selected azimuth direction.
• a highly advantageous realization of the invention is characterized in that the display unit comprises a helmet- mounted display and that the selected azimuth direction corresponds with a direction that the user of the helmet- mounted display is facing.
• the aperture of the TV cameras shall be selected to be so wide that a selected elevation direction, for instance the horizon, remains within view, irrespective of the ship's roll and pitch.
• a still further embodiment of the invention where this constraint need not be considered, is characterized in that the system is provided with stabilization means for retaining the surface on which the array of TV cameras is disposed in a level position.
• a thus stabilized image which moreover allows a narrow aperture, is most suitable for automatic target detection, because the ship's movements no longer affect the apparent position of a target.
• a still further advantageous embodiment of the invention is therefore characterized in that the system is provided with a target extractor, connected to the image processor, for initiating and maintaining tracks of potential targets and for supplying azimuth and elevation values pertaining to these potential targets.
• a well-known drawback of optronic systems is the lack of range information pertaining to a target.
• a highly advantageous embodiment which obviates this drawback at least partially, is therefore characterized in that the system is provided with two arrays of TV cameras placed one above the other, each array incorporating an image processor for generating a panoramic image and that furthermore two target extractors, connected to the image processor, are provided for initiating and maintaining tracks of potential targets and for supplying azimuth and elevation values pertaining to these potential targets as well as range information on the basis of parallax shift determined for each potential target.
• Range information is of particular importance for eliminating bird echoes, in that sense that the possibility of a track being generated is ruled out.
• Fig. 1A is a schematic top view of an array of TV cameras according to the invention
• Fig. IB is a schematic side view of an array of TV cameras according to the invention
• Fig. 2 is a block diagram of an non-stabilized array
• Fig. 3 is a block diagram of a stabilized array.
• Fig. 1A shows a top view of an array of 18 TV cameras 1, positioned to cover a 360 degree field of view, each TV camera having an aperture of 24 degrees, consequently resulting in 18 images, always with a 4 degree overlap.
• each TV camera 1 is mounted on a foundation ring 3 and is additionally provided with a lever 4 ending in a second hinge 5 which acts in concert with a disk 6, capable of rise and fall motion, thus allowing the tilt of all TV cameras 1 to be adjusted simultaneously.
• Fig. IB shows a side view of the same array incorporating the same component parts.
• a protective hood 7 is shown to cover the array of TV cameras which, at the position of the TV cameras, is transparent to the wavelength in question.
• the protective hood may be covered with a material that absorbs electromagnetic radiation and may be shaped such that it is difficult to be detected by a radar apparatus.
• the TV cameras 1 used are sensitive to visible light or infrared radiation. In the latter case the cameras are of the type that makes chilling down to liquid nitrogen temperature unnecessary, for instance on the basis of prior-art pyroelectric detectors or bolometer arrays.
• Fig. 2 is a block diagram of a non-stabilized array in which 18 cameras 1.1,..., 1.18 are connected to an image processor 8 implemented as a high-speed computer provided with DSPs. Every 20 milliseconds, image processor 8 receives 18 sub-images in the form of image matrices consisting of rows and columns. Each sub-image has a horizontal aperture of 25 degrees; the main function of the image processor 8 is to generate, every 20 milliseconds, one image with a horizontal aperture of 360 degrees from these 18 sub-images.
• a secondary function of the image processor 8 is to periodically display the relative alignment of the 18 sub-images, for instance after overhaul and by means of a measuring grid placed around the array of TV cameras.
• Alignment errors comprise a possible translation in horizontal and vertical direction as well as a possible rotational error.
• Rotational errors can be corrected per sub-image in a manner known in the art by rotating the image matrix corresponding to the sub-image, such that horizontal lines in the measuring grid are also observed to be horizontal.
• Translations in vertical direction can be simply corrected by slightly adjusting, per sub-image, the row numbers of an image matrix. Even though this method will cause several image lines to be left out at the top or at the bottom of a sub-image, it is still considered acceptable.
• Translations in horizontal direction however, upset the continuity of the overall image and shall consequently be corrected. This is relatively easy to realize because in azimuth direction the sub-images afford a certain degree of overlap.
• a selector device 11 is connected to the image processor 8.
• display 10 is a helmet-mounted display and the selector device as a prior-art helmet-mounted angle sensor.
• Such a system creates the illusion of looking straight through a ship's hull or a tank's armour-plating, which makes it possible to for instance eliminate the navigating bridge with its considerable radar cross-section.
• other data e.g. radar data
• Fig. 3 shows a block diagram of a stabilized array with the 18 cameras 1.1,...1.18 mounted on a prior-art stabilized platform, so that ship movements, with the exception of the ship's heading, no longer affect the system.
• the 18 cameras 1.1,...1.18 are again connected to an image processor 8 which for instance generates, every 20 milliseconds, one image with a horizontal aperture of 360 degrees from the 18 sub-images, this in line with the array described with reference to Fig. 2.
• a target will every 20 milliseconds appear on practically the same spot on the display screen. Particular importance attaches to a point target looming up on the horizon, such as a missile or patrol vessel.
• image processor 8 is connected to a point target extractor 12 which compares the intensity of each pixel with the intensity of adjacent pixels and decides on the basis of thereof if a point target is actually observed.
• Point target extractor 12 assigns the detected point targets to a tracker 13 only after the presence of a point target has been ascertained in a (string of images) number of sequentially generated images.
• point target extractor 12 may comprise other prior art components to reduce the false alarm probability, for instance edge detectors which detect the edges of for instance man-made structures or clouds and preclude the detection of point targets in those areas.
• tracker 13 initiates a tentative track which, after a certain number of detections, changes into a confirmed track to be subsequently presented on a display unit 10.
• point target extractor 12 is also provided with data on the ship's heading 14 with which, on the basis of modified column numbers, an alteration of the ship's course can be simply corrected such that it seems as if the target does not move as a result of the alteration of course.
• a second array may advantageously be added to the existing array; the second array may be positioned above or underneath the existing array.
• the tracks supplied by both arrays are passed to one display unit 10 for multi-colour presentation.
• a bird flying in the proximity of the arrays will show a significant parallax difference, causing the tracks to run parallel without any overlap.
• the parallax difference may of course also be ascertained with a suitable computer program. This precludes tracks caused by birds from appearing on the display screen.

Landscapes

• Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Signal Processing (AREA)
• Closed-Circuit Television Systems (AREA)

Applications Claiming Priority (3)

Publications (1)

Family

ID=19765231

Family Applications (1)

Country Status (8)

Families Citing this family (7)

Family Cites Families (4)

• 1997
  • 1997-06-26 NL NL1006407A patent/NL1006407C2/nl not_active IP Right Cessation
• 1998
  • 1998-06-17 WO PCT/EP1998/004000 patent/WO1999000982A1/en not_active Application Discontinuation
  • 1998-06-17 CN CN98806551A patent/CN1261500A/zh active Pending
  • 1998-06-17 EP EP98937554A patent/EP1016283A1/de not_active Ceased
  • 1998-06-17 JP JP50921599A patent/JP2002511221A/ja active Pending
  • 1998-06-17 CA CA002295183A patent/CA2295183A1/en not_active Abandoned
  • 1998-06-17 KR KR19997012265A patent/KR20010014190A/ko not_active Application Discontinuation
  • 1998-06-17 AU AU86304/98A patent/AU745415B2/en not_active Ceased

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events