JP2008032650A - Method for supporting search of small target on sea surface - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a means for conveying search support information related to the detection of a small target floating on a sea surface to a crew even if the aircraft crew looks one's eyes off a monitor screen. <P>SOLUTION: In a method for supporting the search of a small target on a sea surface for searching a small target floating on the sea surface while scanning along a sea route, an infrared imaging apparatus, or the like mounted on an aircraft is used to output a sound signal to headphones 19 using the strength of sound and variations in a sound interval by a sound signal conversion section 18 according to the distance difference between the position of the small target and that of the aircraft calculated by a target extraction processing section 15, thus reporting the crew that the small target to be searched is near the aircraft even if the crew is not seeing the screen of the monitor 13 of the infrared imaging apparatus 10. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a small target search support method on the sea surface where an occupant of an aircraft or the like searches for a small target floating on the sea surface with an infrared imaging device mounted on an aircraft or the like from above.

  FIG. 10 is a diagram showing a monitor screen of a general infrared imaging device mounted on an aircraft. When searching for a small target floating on the sea surface at night or the like, an occupant looks at the monitor screen 100 shown in FIG. 10 as a whole and picks up an image captured by an infrared imaging device mounted on the aircraft. Judging the existence of existence, we are searching for small targets. As an example of additional information displayed on the monitor screen 100 in addition to the captured image, information relating to the date and time is displayed in the display area 101, information relating to the aircraft is displayed in the display area 102, and information relating to the infrared imaging device (hereinafter referred to as a camera) is displayed. It is displayed in the area 103. In the display area 104, the distance between the camera mounted on the aircraft and the center of the imaging screen is shown in units of nautical miles (NM).

  The camera fixed to the aircraft is directed to an initial value (for example, directly below the aircraft) in the initial state. At this time, a mark 105 indicating the left-right turning angle of the camera and a mark 106 indicating the up-down turning angle of the camera are scales 107, respectively. And 108 at the approximate center. When the camera is turned left and right, the mark 105 moves left and right on the scale 107. When the camera is turned up and down, the mark 106 moves up and down on the scale 108.

  Additional information regarding the small target is not displayed on the monitor screen 100. For this reason, the occupant visually checks the in-flight monitor screen 100 to determine the presence or absence of a small target, and after the determination, repeats the operation of actually looking directly at the sea surface outside the aircraft and searching for the small target again. . Therefore, the current situation is that it takes time to search.

  The invention described in Patent Document 1 relates to a search radar system having a function of identifying and highlighting a specific target from a radar echo of a search radar and a target display method of the search radar system, and specifying the radar echo on the display screen This target position is clearly presented to the radar operator together with the echo characteristics. Specifically, image processing is performed by adding color information to a target echo in accordance with preset color designation information in addition to luminance information, and the target echo with the color information added is synthesized with other echoes. Display on the color monitor.

JP 2001-272456 A (refer to paragraphs [0014] to [0028], FIG. 1, FIG. 2 and abstract)

  However, in the search radar system and the target display method of the search radar system described in Patent Document 1, or the search method for a small target floating on the sea surface according to the above-described conventional technique, a large number of small targets that are likely to be search targets are displayed on the monitor screen. When it fluctuates from moment to moment, the occupant looks at the monitor screen and self-determines the likelihood of being searched for all of them, and searches for what seems to be highly likely. Therefore, it is necessary to keep an eye on the monitor screen during the search, and not only can not concentrate on operations related to aircraft operation (checking instruments, operating switches, etc.), but on the contrary, the monitor screen can be viewed during operation. There is a problem that it is impossible to concentrate on search activities.

  In such a situation, there is a problem that even if the target detection information is displayed on the monitor screen when the aircraft occupant is looking away from the monitor screen, the target detection information may be overlooked.

  Accordingly, an object of the present invention is to solve the above-described problems and provide a means for transmitting information related to target detection to the occupant even when the aircraft occupant keeps an eye on the monitor screen.

  The sea surface small target search support method according to the first aspect of the present invention that achieves the above object uses a device mounted on an aircraft to search for a small target floating on the sea surface while scanning along a route. In the above small target search support method, the output device connected to the device changes the sound intensity and / or interval according to the distance difference between the small target position and the aircraft position and outputs the sound. It is characterized by doing.

  The sea surface small target search support method according to the second aspect of the present invention that achieves the above object is to search for a small target floating on the sea surface while scanning along a route using an apparatus mounted on an aircraft. In the above small target search support method, output is performed by changing either or both of vibration intensity and interval according to the distance difference between the position of the small target and the position of the aircraft by the output device connected to the device. It is characterized by doing.

  The subsurface search support method on the sea surface according to the third aspect of the present invention that achieves the above object uses the device mounted on the aircraft to search the subsurface floating on the sea surface while scanning along the route. In the above small target search support method, the output device connected to the device changes light intensity and / or blinking interval according to the distance difference between the position of the small target and the aircraft. It is characterized by outputting.

  According to the first aspect of the present invention, by applying the search occupant support method using sound, it is possible to know the presence or absence of a search target that has been missed when the occupant has not looked at the monitor screen by a steering operation or the like. .

  In the first embodiment of the present invention, since the noise in the aircraft is large, the notification to the occupant by sound may be erased by noise. As another means in such a case, according to the second embodiment of the present invention, by notifying the occupant with a vibration pad or the like, it is overlooked when the occupant is not looking at the monitor screen during a steering operation or the like or at the time of noise. You can know if there is a search target.

  According to the third aspect of the present invention, the occupant can control the operation by notifying the occupant by turning on or blinking the LED or the like in the field of view of the instrument or the like that the occupant is looking at the operation. You can know if there is a search target that you missed when you were not looking at the monitor screen.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
FIG. 1 is a schematic block diagram of an infrared imaging device according to the first embodiment of the present invention. In the infrared imaging apparatus 10 shown in FIG. 1 mounted on an aircraft such as a rotary wing aircraft or a fixed wing aircraft, the image signal obtained by the imaging unit 11 is corrected in the signal processing unit 12, and the superimposition processing unit 16 The corrected image signal is superposed on the machine information and the like, and the image adjustment unit 17 performs the imaging process and displays it on the screen of the monitor 13. After the correction processing unit 14 performs the correction processing, the target extraction processing unit 15 performs general target extraction processing such as binarization processing, edge extraction, feature extraction, and pattern matching.

The present invention outputs as follows according to the distance difference between the small target and the airframe (the imaging device mounting machine).
In the first embodiment, a sound (a sound that is louder as it gets closer, a sound with a shorter interval) is output.
In the second embodiment, vibrations (vibrations that are larger and vibrations with shorter intervals) are output.
In the third embodiment, light (light that is brighter as it gets closer, light that has a shorter interval) is output.

  Returning again to FIG. In the target extraction process of the target extraction processing unit 15 in the signal processing unit 12, the distance difference between the small target and the machine body (the imaging device-equipped machine) is calculated, and the sound signal conversion unit 18 determines the distance according to the calculated distance difference. The closer the difference is, the louder the sound or the shorter the interval is. However, the target extraction processing unit 15 determines the degree of the search target of the small target, and the sound signal conversion unit 18 corresponds to the level of the search target of the small target obtained by the target extraction process. A sound conversion process for changing the interval may be performed. As described above, since the sound is transmitted to the occupant through the headphones 19 or the like worn by the occupant, even if the occupant does not look at the monitor screen, there is no problem in searching for the small target.

  When varying the intensity or interval of the sound signal based on the distance difference or the degree of search targetness, the distance difference (or the level of search targetness) and the sound intensity (or interval) are set in advance. The table can be stored in a storage device accessible by the sound signal conversion unit 18, and the strength and interval of the sound signal to be output can be obtained by referring to the table. It should be noted that the user of the present apparatus can appropriately design how much distance difference (or degree of search target likelihood) is associated with how much sound intensity (or interval). Further, the change in sound may be changed based not only on the distance difference between the object and the aircraft, but also on the temperature difference between the object and the surroundings of the object (for example, the sea surface) detected by the infrared imaging device.

  Further, the sound conversion processing by the sound signal conversion unit 18 may be configured to be expressed by a program and loaded into the computer so that the computer executes the processing. Further, the other processing in the signal processing unit 12 may be configured to cause the computer to execute the program in the same manner.

FIG. 2 is a schematic block diagram of an infrared imaging device according to the second embodiment of the present invention.
In the target extraction process of the target extraction processing unit 25 in the signal processing unit 22, the distance difference between the small target and the machine body (imaging device mounting machine) is calculated, and the vibration signal conversion unit 28 determines the difference between As the distance difference is closer, larger vibrations and shorter intervals are output to a vibration pad or the like. However, the target extraction processing unit 25 determines the degree of likelihood of searching for a small target, and the vibration signal conversion unit 28 responds to the degree of likelihood of searching for a small target obtained by the target extraction process with the intensity and interval of vibration. You may perform the vibration conversion process which fluctuates. As described above, since vibration is transmitted to the occupant through the vibration pad 29 or the like attached to the occupant, even if the occupant is not looking at the monitor screen, there is no problem in searching for the small target.

  When changing the intensity or interval of vibration based on the distance difference or the degree of search object likelihood, a table in which the distance difference (or the degree of search object likelihood) and the intensity (or interval) of the vibration are set in advance is set. The strength and interval of the vibration signal to be output can be obtained by storing in a storage device accessible by the vibration signal conversion unit 28 and referring to the table. It should be noted that the user of the present apparatus can appropriately design how much distance difference (or degree of search target likelihood) is associated with how much vibration intensity (or interval). In addition, the change in the strength (or interval) of the vibration is not only based on the difference in distance between the object and the aircraft, but also on the basis of the temperature difference between the object and the surroundings of the object (for example, the sea surface) detected by the infrared imaging device. May be.

  The vibration conversion process by the vibration signal conversion unit 28 may be expressed by a program and loaded into the computer so that the computer executes the process. Similarly, other processing units in the signal processing unit 22 may be configured to cause a computer to execute a program.

FIG. 3 is a schematic block diagram of an infrared imaging device according to the third embodiment of the present invention.
In the target extraction process of the target extraction processing unit 35 in the signal processing unit 32, a distance difference between the small target and the machine body (image pickup apparatus-equipped machine) is calculated. The closer the difference is, the brighter the light or the shorter the light is output. However, the target extraction processing unit 35 determines the degree of the search target of the small target, and the optical signal conversion unit 38 corresponds to the degree of the search target of the small target obtained by the target extraction process. A light conversion process that fluctuates the light may be performed. As described above, since the optical signal is transmitted to the occupant through the LED 39 or the like installed in the instrument in the sight of the occupant, even if the occupant does not look at the monitor screen, there is no problem in searching for the small target.

  When changing the intensity or interval of light based on the distance difference or the degree of search target, a table in which the distance difference (or the level of search target) and the intensity (or interval) of light are set in advance is set. The intensity and interval of the optical signal to be output can be obtained by storing the data in a storage device accessible by the optical signal converter 38 and referring to the table. It should be noted that the user of this apparatus can appropriately design how much distance difference (or the degree of search target likelihood) corresponds to how much light intensity (or interval). In addition, the change in the intensity (or interval) of light is changed based not only on the distance difference between the object and the aircraft, but also on the temperature difference between the object and the object surroundings (for example, the sea surface) detected by the infrared imaging device. May be.

  The optical conversion processing by the optical signal conversion unit 38 may be expressed by a program and loaded into the computer so that the computer executes the processing. Similarly, other processing units in the signal processing unit 32 may be configured to cause a computer to execute a program.

  FIG. 4 is a block configuration diagram illustrating a first specific example of display processing of a color monitor screen by a signal processing unit in the infrared imaging device according to the first to third embodiments of the present invention. In the infrared imaging device 40 shown in FIG. 4 as a whole, the image signal obtained by the imaging unit 41 is corrected in the signal processing unit 42, and the output of the correction processing unit 44 and a symbol allocation processing unit to be described later are performed in the superimposition processing unit 46. The output of 45A is superimposed on the date and time, the information of the machine and the device, and the image adjustment unit 47 performs the imaging process of the output from the superimposition processing unit 46, and the image data output from the image adjustment unit 47 is displayed on the monitor 43. It is displayed on the screen. After the correction processing unit 44 performs the correction processing, the target extraction processing unit 45 performs general target extraction processing such as binarization processing, edge extraction, feature extraction, and pattern matching.

  For the small target obtained by performing the target extraction process in the target extraction processing unit 45, the symbol allocation processing unit 45A determines the degree of the search target obtained at that time (for example, how much it exceeds a certain threshold value). Symbol allocation processing for allocating symbols having different colors and / or shapes assigned in advance by the symbol allocation processing unit 45A according to the level of the degree of the error. In the superimposition processing by the superimposition processing unit 46, the output image signal of the correction processing unit 44, the date and time, the information of the machine body and the device, and the like, and the output from the symbol allocation processing unit 45A are superimposed, and each symbol is placed near the small target. Information is added and displayed on the screen of the color monitor 43.

Next, a method for superimposing and displaying information for reducing the load on the passenger on the monitor screen will be described.
FIG. 5 is a diagram showing an example of color display for reducing the load on the occupant who searches on the monitor screen shown in FIG. 4, and (A) shows the size of the circle as the degree of the search target of the small target increases. (B) is a diagram showing an example in which the length of the bar is displayed longer as the degree of search target of the small target is higher, and (C) is a diagram showing an example of displaying the small target. It is a figure which shows the example by which the degree of search object likelihood is displayed numerically. In FIGS. 5A to 5C, R means red, Y means yellow, and L means blue, and the shape (circle, bar (bar)) and numerical values are displayed on the screen in these colors.

In the display examples of FIG. 5A and FIG. 5B, red, yellow, and blue are represented in descending order of the degree of likelihood of searching for a small target, and the shape (circle, bar (bar)) also has a degree. The symbol size (/ length) is represented in the descending order from large (/ long) to medium to small (/ short).
In the display example of FIG. 5C, the search target is represented by red → yellow → blue and numerical values (81, 75, 53, 46, 37) in descending order of the degree of likelihood of searching for small targets.

  FIG. 6 is a diagram showing an example of black and white display for reducing the load on the occupant who searches on the monitor screen shown in FIG. 4, and (A) shows the size of the circle as the degree of the search target of the small target increases. (B) is a diagram showing an example in which the length of the bar is displayed longer as the degree of search target of the small target is higher, and (C) is a diagram showing an example of displaying the small target. It is a figure which shows the example by which the degree of search object likelihood is displayed numerically. FIG. 7 is a diagram showing an example of black and white display for reducing the load on the occupant who searches on the monitor screen shown in FIG. 4, and a diagram showing an example in which the degree of likelihood of searching for a small target is displayed in a different shape It is.

On the black-and-white monitor screen, display by color coding corresponding to the degree of the search target like the color monitor screen described with reference to FIG.
In the display examples shown in FIG. 6A and FIG. 6B, the symbol size is expressed as large (/ length) → small (/ short) in descending order of the degree of small target search target. Yes.
In the display example shown in FIG. 6C, the degree of likelihood of searching for a small target is represented by numerical values (88, 72, 63, 51, 33).
In the display example shown in FIG. 7, the degree of likelihood of searching for a small target is represented by various different shapes.

  According to the superimposed display of information to reduce the burden on the occupant on the monitor screen, the occupant can monitor the monitor screen by superimposing search target information that was not on the conventional monitor display screen by displaying the search occupant support display. Since it is only necessary to look outside the aircraft when there is a small target that looks like a search target, it is possible to improve the efficiency of search activities.

  FIG. 8 is a block diagram illustrating a second specific example of monitor screen display processing by the signal processing unit in the infrared imaging device according to the first to third embodiments of the present invention. In the infrared imaging device 80 shown in FIG. 8 as a whole, the image signal obtained by the imaging unit 81 is corrected in the signal processing unit 82, and the output of the correction processing unit 84 and a symbol allocation processing unit to be described later are performed in the superimposition processing unit 86. The output of 85A is superimposed on the date and time, the information of the machine and the device, and the image adjustment unit 87 performs image processing of the image data output from the superimposition processing unit 86, and the image data output from the image adjustment unit 87 is converted into the image data. It is displayed on the screen of the monitor 83. After the correction processing is performed by the correction processing unit 84, general target extraction processing such as binarization processing, edge extraction, feature extraction, and pattern matching is performed by the target extraction processing unit 85.

  In the target extraction processing of the target extraction processing unit 85 in the signal processing unit 82, the degree of likelihood of searching for a small target is determined, and the priority determination processing 85B searches based on information such as the order close to the aircraft or the order of high degree. Based on the search order, the symbol allocation processing unit 85A performs symbol allocation processing. The output image signal of the correction processing unit 84, the date and time, the information of the machine and device, and the like, and the output from the symbol allocation processing unit 85A Are superimposed on each other, and each symbol information is added in the vicinity of the small target and displayed on the screen of the color monitor 83.

  Next, when a large number of small targets that are likely to be searched are displayed on the monitor screen, the occupant determines whether or not to search for all of these small targets, determines the priority for searching, and accordingly Since it takes a considerable amount of time to start the search and fly, a method for reducing the search time by displaying the search priority information in addition to the search crew support display described above will be described below.

FIG. 9 is a diagram showing an example of a display for reducing the load on the occupant who searches on the monitor screen shown in FIG. 8, and (A) displays an instruction (arrow) for searching in descending order of priority. It is a figure which shows an example, (B) is a figure which shows the example which represents a priority with a numerical value.
In the display example shown in FIG. 9A, an instruction (arrow) for searching is displayed in descending order of priority. Here, different colors are used in descending order of priority.
In the display example shown in FIG. 9B, the priority order is represented by numerical values (1, 2, 3, 4, 5).

  According to the search priority information display above, the search time displayed in the search occupant support display by the search priority display so far, it took a long time to search for the search target displayed on the monitor screen by self-judgment. Can be shortened.

(Appendix 1)
In the small target search support method on the sea surface that searches for a small target floating on the sea surface while scanning along the route using the device mounted on the aircraft,
An output device connected to the device outputs the sound by changing either or both of sound intensity and interval according to the distance difference between the position of the small target and the position of the aircraft. Small target search support method.

(Appendix 2)
In the small target search support method on the sea surface that searches for a small target floating on the sea surface while scanning along the route using the device mounted on the aircraft,
An output device connected to the device outputs the vibration while changing either or both of vibration intensity and interval according to the distance difference between the position of the small target and the aircraft. Small target search support method.

(Appendix 3)
In the small target search support method on the sea surface that searches for a small target floating on the sea surface while scanning along the route using the device mounted on the aircraft,
On the sea surface, the output device connected to the device changes the intensity of light and / or the blinking interval according to the distance difference between the position of the small target and the aircraft. Small target search support method.

(Appendix 4)
The output by the output device is changed according to the temperature difference between the temperature of the small target and the temperature around the small target, instead of the distance difference between the position of the small target and the position of the aircraft.
The small target search support method according to any one of appendices 1 to 3.

(Appendix 5)
A program used to support searching for a small target on the surface of the sea, searching for a small target floating on the surface of the sea while scanning along the route using a device mounted on the aircraft,
On the computer,
An output device connected to the device is configured to execute output by changing either or both of sound intensity and interval according to a distance difference between the position of the small target and the position of the aircraft. program.

(Appendix 6)
A program used to support searching for a small target on the surface of the sea, searching for a small target floating on the surface of the sea while scanning along the route using a device mounted on the aircraft,
On the computer,
An output device connected to the device is configured to execute output by changing either or both of vibration intensity and interval according to a distance difference between a position of a small target and the position of the aircraft. program.

(Appendix 7)
A program used to support searching for a small target on the surface of the sea, searching for a small target floating on the surface of the sea while scanning along the route using a device mounted on the aircraft,
On the computer,
An output device connected to the device is configured to execute the output by changing either or both of the intensity of light and the blinking interval according to a distance difference between the position of the small target and the position of the aircraft. Program to do.

(Appendix 8)
In the small target search support device on the sea surface, which searches for a small target floating on the sea surface while scanning along the route using the equipment installed in the aircraft,
On the surface of the sea, comprising an output device connected to the device and outputting the sound by changing either or both of sound intensity and interval according to the distance difference between the position of the small target and the position of the aircraft Small target search support device.

(Appendix 9)
In the small target search support device on the sea surface, which searches for a small target floating on the sea surface while scanning along the route using the equipment installed in the aircraft,
On the sea surface, comprising an output device that is connected to the device and outputs an output by changing either or both of vibration intensity and interval according to the distance difference between the position of the small target and the aircraft. Small target search support device.

(Appendix 10)
In the small target search support device on the sea surface, which searches for a small target floating on the sea surface while scanning along the route using the equipment installed in the aircraft,
A sea surface, comprising: an output device connected to the device, wherein the output device changes and outputs either light intensity or flashing interval according to a distance difference between a position of a small target and the aircraft. Upper small target search support device.

1 is a schematic block configuration diagram of an infrared imaging device according to a first embodiment of the present invention. It is a schematic block block diagram of the infrared imaging device which concerns on 2nd Embodiment of this invention. It is a schematic block block diagram of the infrared imaging device which concerns on 3rd Embodiment of this invention. It is a block block diagram explaining the 1st specific example of the display process of the monitor screen by the signal processing part in the infrared imaging device which concerns on 1st-3rd embodiment of this invention. It is a figure which shows the example of the black-and-white display for reducing the passenger | crew's load which searches by the monitor screen shown in FIG. 4, (A) is a larger size of a circle, so that the degree of the search target of a small target is high. (B) is a diagram showing an example in which the length of the bar is displayed longer as the degree of the search target of the small target is higher, and (C) is the likelihood of the search target of the small target. It is a figure which shows the example by which the degree of is displayed numerically. It is a figure which shows the example of the black-and-white display for reducing the passenger | crew's load which searches by the monitor screen shown in FIG. 4, (A) is a larger size of a circle, so that the degree of the search target of a small target is high. (B) is a figure which shows the example in which the height of a stick | rod is displayed so that the degree of the search target of a small target is high, and (C) is a search target of a small target. It is a figure which shows the example by which the degree of is displayed numerically. It is a figure which shows the example of the black-and-white display for reducing the load of the passenger | crew who searches on the monitor screen shown in FIG. 4, and is a figure which shows the example displayed in the shape from which the degree of the search target of a small target differs. It is a block block diagram explaining the 2nd specific example of the display process of the monitor screen by the signal processing part in the infrared imaging device which concerns on 1st-3rd embodiment of this invention. It is a figure which shows the example of the display for reducing the load of the passenger | crew who searches on the monitor screen shown in FIG. 8, (A) shows the example in which the instruction | indication (arrow) to search is displayed in order of a high priority. It is a figure and (B) is a figure which shows the example which represents a priority with a numerical value. It is a figure which shows the monitor screen of the general infrared imaging device mounted in the aircraft.

Explanation of symbols

10, 20, 30, 40, infrared imaging device (infrared camera)
11, 21, 31, 41, 81 Imaging unit 12, 22, 32, 32, 82 Signal processing unit 13, 23, 33, 43, 83 Monitor 18 Sound signal conversion unit 28 Vibration signal conversion unit 38 Optical signal conversion unit

Claims (3)

In the small target search support method on the sea surface that searches for a small target floating on the sea surface while scanning along the route using the device mounted on the aircraft,
An output device connected to the device outputs the sound by changing either or both of sound intensity and interval according to the distance difference between the position of the small target and the position of the aircraft. Small target search support method. In the small target search support method on the sea surface that searches for a small target floating on the sea surface while scanning along the route using the device mounted on the aircraft,
An output device connected to the device outputs the vibration while changing either or both of vibration intensity and interval according to the distance difference between the position of the small target and the aircraft. Small target search support method. In the small target search support method on the sea surface that searches for a small target floating on the sea surface while scanning along the route using the device mounted on the aircraft,
On the sea surface, the output device connected to the device changes the intensity of light and / or the blinking interval according to the distance difference between the position of the small target and the aircraft. Small target search support method.

Images