JP5676975B2 - Display device, aerial survey system including the same, and display method of the display device - Google Patents

Description

  The present invention relates to a display device and display method that enables stereoscopic display and can be suitably used for surveys using aircraft, and an aerial survey system including the display device, and in particular, data located in the ocean or mountainous areas. The present invention relates to a display device and a display method for acquiring survey data and the like from a collection device and displaying them for analysis, and an aerial survey system including the same.

  The ocean not only has huge biological resources such as seafood, but also has energy resources such as oil and gas on the continental shelf, or mineral resources such as manganese nodules and submarine hydrothermal deposits. Due to recent advances in science and technology, the development and utilization of these marine resources has received much attention.

  Furthermore, in recent years, in addition to the development of resources, new ways of using the ocean itself have attracted attention. For example, ocean power generation such as wave power generation, ocean current power generation, and tidal power generation is expected as a power generation method with a small environmental load, or large floating structures (mega floats) are not suitable for conventional landfills. It is expected that coastal development can be carried out without annihilation.

  In addition, the ocean is greatly related to environmental problems. For example, a wide range of sea surface temperature abnormalities such as the El Niño phenomenon is one of the causes of abnormal weather. In addition, marine pollution caused by heavy oil, crude oil, etc. not only can cause damage to the fishery, but also has a significant impact on the ecosystem. Recently, the occurrence of the disappearance phenomenon of the underwater forest (seaweed beds with dense seaweeds) (referred to as "burnt fire" or "boiled out") has also been reported.

  In such ocean use, development, or environmental protection, it is extremely important to obtain various ocean-related data (marine data) accurately and analyze it appropriately according to the purpose of use, that is, ocean surveys. It becomes.

  In conducting ocean surveys, various methods are used depending on the type or purpose of ocean data to be acquired. In general, a method using a marine research ship or the like can be mentioned, but a method using an aircraft is also known. Taking a heavy oil spill accident as an example, in order to investigate a marine area polluted with heavy oil, etc., there is a method of acquiring marine data by flying an aircraft equipped with a multi-spectral scanner (MSS) over the polluted sea area. Are known. Since MSS collects and analyzes visible light and infrared light by frequency range, it is suitable for marine surveys that comprehensively survey a wide area.

  The above-mentioned method using MSS uses “remote sensing” technology that collects ocean data from the sky far from the ocean, but unlike this, various observational instruments are located directly in the ocean. There are also ways to get data. A typical example is a method in which a floating body including an observation device and a communication device is introduced into the ocean and ocean data is collected by an aircraft (or an artificial satellite) through communication with the floating body.

  Examples of the technology related to ocean research using a floating body and an aircraft include a floating material detection system and a floating material detection method disclosed in Patent Document 1. This technology is intended to detect floating materials such as heavy oil that has flowed out of the sea due to a marine accident, etc., and is supported by floating bodies that float temporarily or constantly in the water area. An underwater camera is provided, the water surface is photographed from underwater by the underwater camera, and the presence / absence of a floating substance floating on the water surface is detected by image processing of the photographed image. The part that performs image processing may be provided on a floating body or other than a floating body such as an aircraft, and in the case of being provided on an aircraft, the image processing device on the aircraft side converts the data of the image captured by the underwater camera. The image processing apparatus performs image processing.

JP 2008-281423 A

  By the way, in ocean research, it is necessary to acquire and analyze ocean data based on a comprehensive viewpoint, a local viewpoint, or both viewpoints depending on the purpose. For example, taking the heavy oil spill accident mentioned above as an example, grasping the entire contaminated sea area is based on a comprehensive point of view, and protecting a particular farm immediately after the accident occurs is a relative It is based on a local viewpoint. A more specific example of the local perspective is to use a specific observation point located between the spill site and the farm to predict when the spilled heavy oil will drift to the particular farm. One example is checking the arrival of heavy oil.

  In ocean surveys, it is usually rare to acquire and analyze ocean data from only one perspective, either comprehensive or local, and it is possible to comprehensively and comprehensively analyze data acquired from both perspectives. Many.

  For example, a method using an aircraft equipped with an MSS is suitable for the purpose of acquiring ocean data from a comprehensive viewpoint, but is not suitable for acquiring ocean data from a local viewpoint. On the other hand, since the technique disclosed in Patent Document 1 performs image processing on image data directly acquired from a floating body, it is suitable for the purpose of acquiring ocean data from a local viewpoint. Furthermore, if a large number of ocean data can be acquired using a large number of floating bodies, it is possible to acquire and analyze ocean data from a comprehensive viewpoint by appropriately analyzing a collection of these local ocean data. is there. However, Patent Document 1 does not specifically disclose the analysis from such a comprehensive viewpoint.

  The present invention has been made to solve such problems, and the object thereof can be suitably used for ocean surveys or mountain surveys using aircraft, and is obtained from both a comprehensive and local viewpoint. It is to provide a technique capable of giving the surveyed data to the person in charge of analysis.

  As a result of intensive studies in view of the above problems, the present inventors have combined a three-dimensional display in addition to a normal two-dimensional display in a display device that displays survey data, thereby providing both comprehensive and local viewpoints. It was found that the survey data acquired in (1) can be displayed to the person in charge of analysis so that it can be easily analyzed, and the present invention has been completed.

That is, the display device according to the present invention is a display device that can display survey data collected by a plurality of data collection devices located in a sea area or region that is a target of ocean survey or mountain survey and acquired by communication. A display unit capable of simultaneously displaying a two-dimensional image and a three-dimensional image, a storage unit for storing display data including at least three-dimensional terrain data for displaying terrain as the three-dimensional image, and the data A display data generation unit that generates display data for the survey data from the survey data acquired from the collection device; and a control unit, wherein the display data generation unit changes the survey data over time. when occur, before and after the change of the survey data, a three-dimensional image display in the depth direction of at least the screen is changed from time to time, and an indicator image As displayed, and it generates the display data, the data collection device display data also generated indicating a symbol image, the control unit, of the waters or regions on the basis of the three-dimensional topography data Terrain Is displayed on the display unit as a three-dimensional image, and a symbol image indicating the data collection device is displayed on the display unit. Further, when a change with time occurs in the survey data, the change is displayed on the display unit. The indicator image is displayed as needed on the display unit as a change in the depth direction of the indicator image based on the data.

  According to the above configuration, at least terrain data is displayed as a three-dimensional image, and when a change occurs in the survey data, it is displayed as a change in the image. Therefore, the sea area or the whole area, which is a comprehensive viewpoint, is three-dimensionalized to clearly distinguish it from other displays, and individual survey data, which is a local viewpoint, It is clearly distinguished from the display. Moreover, even if the analyst is concentrating and viewing the three-dimensional topographic image in the central field of view, if the image showing the survey data is in the peripheral field of view, the survey data will change. The person in charge of analysis can appropriately grasp the change in the image. In addition, changes in survey data are displayed as changes in images at any time. Therefore, survey data acquired from both comprehensive and local viewpoints can be presented to the analyst so that it can be used for immediate analysis.

Further, according to the above configuration, when survey data collected by an arbitrary data collection device changes, the data change is displayed as an indicator image indicating a three-dimensional change, not a two-dimensional change. Become. Therefore, the distinction between the comprehensive viewpoint display and the local viewpoint display can be made clearer. In addition, since changes in images can be clearly grasped at any time, contribution to immediate analysis of survey data can be improved.

  Moreover, even if the display area on the screen is too small to display a two-dimensional indicator image, for example, even if the display area is a three-dimensional indicator image, the change is a change in the depth direction of the screen. It can be displayed as (extension and contraction of the indicator image in the height direction). Therefore, a clear change in the survey data can be displayed in a narrow display area, and the display can be made compact.

  The display device according to the present invention can be used in any situation as long as it is intended for marine surveys or mountain surveys, but it is particularly preferable that the display device is mounted on an aircraft. Yes.

  In the display device, the display data generation unit further generates display data in a two-dimensional format including character information, and the control unit generates a two-dimensional image simultaneously with the three-dimensional image based on the display data. It is preferable that an image is displayed on the display unit.

  According to the said structure, since a three-dimensional image and a two-dimensional image can be displayed simultaneously, the landform or the seafloor topography can be displayed by a three-dimensional image, and character information can be displayed by a normal two-dimensional image. . Thus, the three-dimensional or two-dimensional display can be switched according to the type of image to be displayed so that the person in charge of analysis can easily recognize.

  In the display device, it is more preferable that the display unit is configured to display the three-dimensional landform data as a three-dimensional image based on contour lines or contour lines.

  According to the said structure, the landform of the land and the seabed is comprehensively displayed on the basis of height. Therefore, it is possible to improve the contribution to the analysis from the comprehensive viewpoint based on the topography for the sea area or region to be investigated.

  In the display device, it is more preferable that the display unit is configured to display a three-dimensional image by orthographic projection by autostereoscopic vision.

  According to the above configuration, since the three-dimensional image is displayed by an orthographic projection instead of a general perspective projection, the display size of the three-dimensional image is the distance from the viewpoint of the viewer (analyzer). It doesn't change regardless. Moreover, the three-dimensional image is displayed by autostereoscopic viewing. Therefore, the viewer can recognize the accurate display of the topography with the naked eye without using 3D display glasses or the like, and can further improve the contribution to the analysis from a comprehensive viewpoint. .

  In the display device, the control unit divides the entire screen of the display unit into a plurality of display areas, displays different images in the display areas, and displays the three-dimensional display among the display areas. In the display area where the height of the image is maximum, a reference plane in the height direction of the three-dimensional image is set, and in all the display areas, the image is displayed with reference to the reference plane. More preferred.

  According to the above configuration, the reference plane is set with reference to the three-dimensional image having the maximum height, and the three-dimensional image is displayed in all of the plurality of display areas based on the reference plane. The display of the three-dimensional image can be adjusted so that the back can be clearly seen.

  The display device may include an input unit that allows data other than the survey data to be input. The specific configuration of the input unit is not particularly limited, and various known input devices can be used.

  Here, in the display device, the operation finger unit includes not only the operator's five fingers but also a part of the palm other than the five fingers and an object other than the finger such as a pen held by the operator. In the display device, it is further preferable that the input unit is a touch panel integrated with the display unit.

In the display device, the input unit inputs three-dimensional position data that inputs an operation of the position of the operation finger unit of the operator in front of the display unit as three-dimensional position data based on the screen of the display unit. The data used for displaying an image in a three-dimensional format among the display data includes image position data corresponding to the input three-dimensional position data, and the control unit from the difference between the three-dimensional position data and the image position data for, in the configuration for performing control to execute the input of the operation command by the operator, and more preferred.

  According to the above-described configuration, data or the like can be input by an analysis person performing an operation of touching a 3D image displayed on the display unit with a finger. Therefore, since the display on the display unit and the input of data and the like can be directly associated with each other, the operability can be further improved. Further, if the input unit is a touch panel, data can be input by touching the screen of the display unit by the person in charge of analysis. Therefore, since the display on the display unit and the input of data and the like can be directly associated with each other, the operability can be further improved.

  In the display device, it is more preferable that the input unit is a line-of-sight tracking camera.

  According to the said structure, the motion of the eye of the analysis person who looks at the screen of a display part with a gaze tracking camera can be utilized for the input of data. Therefore, for example, a multi-step input operation can be realized only by eye movement, or a cursor symbol on the screen can be quickly moved only by eye movement.

  An aerial survey system according to the present invention includes a display device having any one of the above-described configurations, a data collection device including a data acquisition unit that acquires survey data, and a transmission unit that transmits the acquired survey data, and receives from the data collection device And a data receiving device for inputting the survey data to the display device.

  In the aerial survey system, the specific configuration of the data collection device is not particularly limited. For example, in ocean surveys, a floating body floating on the water surface can be preferably used as the data collection device.

Furthermore, the present invention includes a display device display method in addition to the display device and the aerial survey system. Specifically, the display method according to the present invention includes an image display step that enables simultaneous display of a two-dimensional image and a three-dimensional image based on display data, and an ocean survey or mountain survey target. A display data generation step for generating the display data corresponding to the survey data from the survey data collected by a plurality of data collection devices located in the sea area or region, and obtained by communication, The display data includes 3D terrain data stored in advance for displaying the terrain as an image in a 3D format. In the display data generation step, the survey data changes over time. when the before and after the change of the survey data, a three-dimensional image display in the depth direction of at least the screen is changed from time to time, the display as an indicator image As, generates the display data, the even display data for displaying the data collecting device as symbol image generated, in the image display step, the symbol indicating the three-dimensional image and the data collection device of the terrain and displays an image, the change over time can include structure for displaying at any time as a change in the depth direction of the indicator image based on the display data.

  In the display method, in the display data generation step, display data in a two-dimensional format including character information is further generated, and in the image display step, an image in a three-dimensional format is generated based on the display data. At the same time, it is preferable to have a configuration for displaying a two-dimensional image.

  In the display method, the image display step is preferably configured to display the 3D terrain data as a 3D image based on contour lines or contour lines.

  In the display method, it is more preferable that the image display step has a configuration in which the three-dimensional image is displayed in an autostereoscopic display by orthographic stereoscopic display.

  In the display method, in the image display step, the entire screen is divided into a plurality of display areas, different images are displayed in the display areas, and the height of a three-dimensional image displayed in the display areas is displayed. It is more preferable that the reference plane in the height direction of the three-dimensional image is set in the display area where the maximum is displayed, and the image is displayed with reference to the reference plane in all the display areas.

  The display method can be applied to a display device used in any situation for the purpose of ocean survey or mountain survey. In particular, in the present invention, the display device is a display device mounted on an aircraft. It is preferable.

  As described above, in the present invention, it can be suitably used for ocean surveys using aircraft, and marine data acquired from both comprehensive and local viewpoints can be used for immediate analysis. The effect is that it can be given to the person in charge of analysis.

It is a schematic diagram which shows an example of schematic structure of the airline survey system which concerns on Embodiment 1 of this invention. It is a typical front view which shows an example of the external appearance structure of the display apparatus with which the aerial survey system shown in FIG. It is a block diagram which shows an example of a structure of the control system in the display apparatus shown in FIG. FIG. 3 is a schematic diagram illustrating an example of a three-dimensional topographic map and a three-dimensional indicator displayed on a lower display panel in the display device illustrated in FIG. 2 in comparison with a two-dimensional display. (A) is a schematic diagram which shows an example of the screen structure displayed on the lower display panel in the display apparatus shown in FIG. 2, (b) is typical which shows the structural example of the three-dimensional indicator shown in (a). It is a perspective view. It is a flowchart which shows an example of control of the three-dimensional display in the display apparatus shown in FIG. (A)-(c) is a schematic diagram which shows the procedure which adjusts the reference plane of a some display area corresponding to the flowchart shown in FIG. 7 is a flowchart specifically illustrating an example of display control of a three-dimensional indicator in the image display step in the flowchart illustrated in FIG. 6. It is a typical front view which shows an example of the external appearance structure of the display apparatus which concerns on Embodiment 2 of this invention. It is a block diagram which shows an example of a structure of the control system in the display apparatus shown in FIG. 10 is a flowchart illustrating an example of control of a hand gesture input operation in the display device illustrated in FIG. 9. It is a typical front view which shows an example of the external appearance structure of the display apparatus which concerns on Embodiment 3 of this invention. It is a block diagram which shows an example of a structure of the control system in the display apparatus shown in FIG. It is a block diagram which shows an example of a structure of the control system of the display apparatus which concerns on Embodiment 4 of this invention. (A), (b) is a schematic diagram which shows an example of operation by the multi touch panel in the display apparatus shown in FIG.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. In the following description, the same or corresponding elements are denoted by the same reference symbols throughout the drawings, and redundant description thereof is omitted.

(Embodiment 1)
[Schematic configuration of aerial survey system]
First, an example of an aerial survey system to which the display device according to Embodiment 1 of the present invention is applied will be specifically described with reference to FIG. As shown in FIG. 1, the aerial survey system exemplified in the present embodiment typically includes an aircraft 10, a display device 11 </ b> A and a data receiving device 15 mounted on the aircraft 10, and a data collecting device 20. It is the composition which includes. The display device 11 </ b> A and the data receiving device 15 are illustrated in a balloon-like frame from the aircraft 10 to indicate that they are mounted on the aircraft 10.

  As the aircraft 10, the survey data can be obtained by flying in the ocean area or the mountain survey area, and the occupant (analyzer) for analyzing the survey data, the display device 11A, and the data can be obtained. As long as the receiving device 15 can be mounted, the configuration is not particularly limited. In the example shown in FIG. 1, the aircraft 10 is a fixed wing aircraft, but may be an unmanned aircraft or a rotary wing aircraft, or a balloon or an airship.

  The display device 11A displays survey data to the person in charge of analysis, and is configured not only to display but also to input various data, process data using a program stored in advance, and the like. There may be. The data receiving device 15 inputs the survey data received from the data collecting device 20 to the display device 11A. The display device 11A and the data receiving device 15 will be described in detail later.

  The data collection device 20 is present in a plurality of locations in the sea area or the area to be surveyed for the ocean survey, and if the survey data is collected for the ocean survey or the mountain survey, its configuration is particularly It is not limited. In the example shown in FIG. 1, there are a drifting buoy 20A or a mooring buoy 20B which is a floating body floating on the water surface, or various telemeters 20C provided on a mountainside or the like.

  As will be described later, the data collection device 20 includes a data acquisition unit that acquires survey data and a transmission unit that transmits the acquired survey data. The specific configuration of the data acquisition unit is not particularly limited, and an appropriate measurement device may be used according to the type of survey data to be acquired. For example, in the case of ocean surveys, survey data includes ocean topography, water temperature, salinity, current direction, current flow, etc. In mountain surveys, survey data includes mountain topography, temperature, humidity, wind direction, Since there are rainfalls, etc., measurement equipment such as a laser profiler (terrain), a water temperature or temperature measuring device, a salinity measuring device, a meteorological observation device, an ocean current anemometer, etc. are used for measuring these.

  A known method is suitably used for communication between the aircraft 10 and the data collection device 20 (indicated by a dotted arrow in the figure). Typically, survey data is communicated from the transmission unit of the data collection device 20 to the data reception device 15 of the aircraft 10 by communication using very high frequency (VHF). Of course, communication may be performed using electromagnetic waves in other wavelength ranges. Therefore, as the transmission unit of the data collection device 20 and the data reception device 15, a communication device using VHF or other electromagnetic waves can be used. In the example shown in FIG. 1, the communication is only in one direction from the data collection device 20 to the aircraft 10. However, the communication is bidirectional communication in which various data is transmitted from the aircraft 10 to the data collection device 20. May be. That is, the aircraft 10 may be provided with a data transmission device, and the data collection device 20 may include a receiving unit.

[Configuration of display device]
Next, an example of a specific configuration of the display device according to this embodiment will be specifically described with reference to FIGS. First, as shown in FIG. 2, the display device 11 </ b> A includes a display device body 111, a console unit 112, an upper display panel 121, a lower display panel 122, a left touch panel 123, a right touch panel 124, a keyboard 131, and a trackball 132. Joystick 133 and the like.

  The display device main body 111 includes a control unit and the like inside, an upper display panel 121 is provided at the upper part of the front surface, a lower display panel 122 is provided at the lower part thereof, and a left touch panel 123 is provided on both sides of the lower display panel 122. A right touch panel 124 (on the right side in FIG. 2) is provided (on the left side in FIG. 2). A desk part 112 protruding in the vertical direction of the front surface is provided at the front of the display device main body 111 and below the lower display panel 122, and a keyboard 131 is provided at the center of the upper surface of the desk part 112. On the right side, a trackball 132 and a joystick 133 are provided.

  In this embodiment, the upper display panel 121 is configured to display a radar screen two-dimensionally, and the lower display panel 122 can display at least a three-dimensional image, and particularly preferably a two-dimensional image and a three-dimensional image. Can be displayed simultaneously. Each of the upper display panel 121 and the lower display panel 122 constitutes a display unit of the display device 11A, and the specific configuration is not particularly limited, and a flat panel display such as a known liquid crystal panel or plasma display panel is preferable. Can be used.

  The display method of the lower display panel 122 is not particularly limited as long as it can display a three-dimensional image. However, as will be described later, the autostereoscopic display method is particularly preferable. Furthermore, it is very preferable that the displayed three-dimensional image is an orthographic projection rather than a general perspective projection. This will be described in detail later.

  The left touch panel 123 and the right touch panel 124 can display various keys, and an operation corresponding to the displayed key is input when the user (analyzer) touches an image corresponding to the key. . That is, the left touch panel 123 and the right touch panel 124 are not only a display unit of the display device 11A but also an input unit. Specific configurations of the left touch panel 123 and the right touch panel 124 are not particularly limited, and a known configuration such as a resistive film method can be suitably used.

  The keyboard 131, the trackball 132, and the joystick 133 constitute an input unit of the display device 11A. The specific configuration is not limited, and a configuration well known in the field of a personal computer or the like can be suitably used. Of these input units, the trackball 132 is used to move the cursor symbol 30 (cursor) displayed on the lower display panel 122 on the screen. The trackball 132 indicated by an arrow P1 in FIG. If the (analyzer) rotates, the cursor symbol 30 moves on the screen of the lower display panel 122 as indicated by an arrow P2 in accordance with the rotation direction. The cursor symbol 30 can be moved not only to the lower display panel 122 but also to the upper display panel 121.

  As shown in FIG. 3, the display device 11 </ b> A can communicate with the data collection device 20 via the data reception device 15. As described above, the data collection device 20 includes the data acquisition unit 21 and the transmission unit 22, and transmits the survey data acquired by the data acquisition unit 21 from the transmission unit 22 to the data reception device 15 (dotted line arrows in the figure). ). The data receiving device 15 inputs the received survey data to the display device 11A.

  11 A of display apparatuses are provided with the display control part 141, the display data generation part 142, and the memory | storage part 143 in addition to the display part and input part which were mentioned above. In FIG. 3, for convenience of explanation, only the lower display panel 122 is shown as a display unit, and the keyboard 131, the trackball 132, the joystick 133, the left touch panel 123, and the right touch panel 124 that are input units are shown by alternate long and short dashed lines. Are collectively shown as “input unit 13”. Further, the left touch panel 123 and the right touch panel 124 are schematically illustrated as one panel collectively in FIG. 3, and these also serve as a display unit. Therefore, the display control unit 141, the left touch panel 123, and the right touch panel 124 are combined. The arrow indicating control is bidirectional.

  The display control unit 141 controls display of an image by the display unit. In particular, in the present invention, as schematically shown by a broken line on the screen of the lower display panel 122 in FIG. Control for displaying a three-dimensional image such as the 3D indicator 35 in FIG. 34 is performed. The display data generation unit 142 generates display data for the survey data from the survey data acquired from the data collection device 20. The input unit 13 can input various data other than the survey data to the display control unit 141. Therefore, the display control unit 141 is configured to perform control to reflect the data input from the input unit 13 on the display of the display unit. As a result, various data other than the terrain data and the survey data can be displayed on the display unit, so that the immediate analysis of the survey data can be facilitated.

  The storage unit 143 stores various data or programs used for control by the display control unit 141. In particular, in the present embodiment, a marine landform or a mountainous landform is displayed on the lower display panel 122 as a three-dimensional image. 3D terrain data for display as. This three-dimensional terrain data is data based on contour lines and contour lines (or one of them).

  The display control unit 141 and the storage unit 143 are each configured by, for example, a microcomputer CPU and an internal memory. Note that the configurations of the display control unit 141 and the storage unit 143 are not limited to this. For example, the display control unit 141 may be a control device group including a plurality of control devices instead of a single control device, and the storage unit 143 does not have to be a single storage device. (For example, an internal memory and an external hard disk drive) may be provided.

  The display data generation unit 142 is a functional configuration of the display control unit 141 and can be realized by the CPU as the display control unit 141 operating according to a program stored in the storage unit 143. . Further, it may be configured as a data conversion circuit using a known switching element, subtractor, comparator, or the like.

  The display control unit 141, the display data generation unit 142, and the storage unit 143 may be configured as one circuit board. In this case, the circuit board converts the survey data transmitted from the data collection device 20 into an I / O circuit for inputting the data from the data receiving device 15, and further converts the survey data into a digital signal when the survey data is an analog signal. An A / D conversion circuit or the like may be incorporated. That is, in the configuration of the control system shown in FIG. 3, description of circuits or functional blocks known to those skilled in the art, such as I / O circuits and A / D conversion circuits, is omitted.

[Example of screen structure on the display]
In the display device 11A, the configuration of the screen when the lower display panel 122 displays a three-dimensional image will be specifically described with reference to FIGS. 4, 5A, and 5B. In FIG. 4, the upper diagram shows an example of three-dimensional display, and the lower diagram shows an example of two-dimensional display corresponding to the upper diagram. Further, in FIG. 4, for convenience of explanation, images such as topographic maps, symbols, indicators, etc. are schematically illustrated from the actual display. Furthermore, in the following description, 2D and 3D are abbreviated as “2D” and “3D”, respectively.

  For example, when the entire screen of the lower display panel 122 is divided into a 2D terrain display area 131 that displays 2D terrain and a 2D indicator display area 132 that displays a 2D indicator 135, as shown in the lower diagram of FIG. To do.

  Among these, in the 2D terrain display area 131, 2D overhead view (2D terrain map 134) is displayed, and an aircraft symbol 136a (indicating the aircraft 10 on which the display device 11A is mounted is superimposed on the 2D terrain map 134). A white circle in the drawing) and a buoy symbol 136b (shaded circle in the drawing) indicating a drifting buoy 20A which is an example of the data collection device 20 are displayed. Since four buoy symbols 136b are displayed, four drifting buoys 20A are used as the data collection device 20 in the marine survey corresponding to this display.

  In order to distinguish the four independent buoy symbols 136b from each other, in FIG. 4, auxiliary reference numerals S1 to S4 are attached to the side of the two-dot chain line connecting the upper diagram and the lower diagram. Therefore, in the following description, when a specific drifting buoy 20A or buoy symbol 136b is displayed, it is expressed as “drifting buoy 20A-S1” or “buoy symbol 136b-S1”. Further, although there is only one aircraft symbol 136a, an auxiliary reference code S0 is attached in accordance with the auxiliary reference codes S1 to S4 of the buoy symbol 136b.

  In the 2D indicator display area 132, when various changes occur in the survey data collected by the data collection device 20, the occurrence or degree of the change is displayed by the change in the 2D indicator 135. The 2D indicator 135 is a band extending along the horizontal direction of the screen, and four 2D indicators 135 are displayed corresponding to the drifting buoy 20A (buoy symbol 136b) of S1 to S4. When the shaded portion extends to the right side in the figure, the degree of change in the survey data is positive. When the shaded portion extends to the left side in the figure, the change in the survey data is greatly minus. If the portion is not displayed, it indicates that there is no change in the survey data.

  In the example of the ocean survey shown in the lower diagram of FIG. 4, the survey is performed in the ocean area where the land L0 located in the upper right of the 2D terrain display region 131 and the islands L1 and L2 located in the center in the horizontal direction exist. In the 2D terrain display area 131, the upper direction of the screen corresponds to the north. Therefore, the land L0, the island L1, and the island L2 are arranged from the west to the east. The aircraft symbol 136a, that is, the aircraft 10 is the most eastern island. Located southeast of L2. Of the four buoy symbols 136b, the buoy symbol 136b-S1 is located on the northern coast of the land L0, the buoy symbol 136b-S2 is located on the southern coast of the land L0, and the buoy symbol 136b-S3 is located on the island L1. Located on the southwest coast, the buoy symbol 136b-S4 is located in the strait between the island L1 and the island L2.

  If the survey data is, for example, a change in seawater temperature over time, the seawater temperature is changed over time at the position of the buoy symbol 136b-S1, as indicated by four 2D indicators 135 in the 2D indicator display area 132, respectively. However, the seawater temperature is slightly higher at the position of the buoy symbol 136b-S2, the seawater temperature is higher at the position of the buoy symbol 136b-S3, and the seawater temperature is higher at the position of the buoy symbol 136b-S4. It can be seen that a change of lowering is observed.

  For example, in the environment where warm current flows from the south into this sea area and cold current flows from the north, when a tidal current toward the northwest is generated, when analyzing changes over time in seawater temperature, Analysis is possible. That is, at the position of the buoy symbol 136b-S1, since the cold current is dominant, even if a tidal current in the northwest direction is generated, it hardly mixes with the warm current, and therefore no change is seen in the seawater temperature. On the other hand, at the position of the buoy symbol 136b-S2, the warm current flowing from the south by the tidal current is more dominant than the cold current flowing between the land L0 and the island L1, but the warm current is partially blocked by the two submarine hills B3 and B4. Therefore, the rise in seawater temperature is low.

  Furthermore, at the position of the buoy symbol 136b-S3, a cold current flows from the north along the periphery of the island L1. On the sea bottom of the southern coast of the island L1, there is a seabed topography that prevents the warm current caused by the tidal current. As a result, the warm current becomes dominant and the seawater temperature rises greatly. On the other hand, the position of the buoy symbol 136b-S4 is not only the strait along the north-south direction but also the submarine gorge B1 at the bottom of the sea. Therefore, the warm current that has flowed so as to face the cold current is shifted toward the land L0 due to the generation of the tidal current toward the northwest, and as a result, the cold current becomes dominant and the seawater temperature is lowered.

  Here, the seabed topography is relatively steep compared to the topography on the ground. Therefore, in the bird's-eye view display such as the 2D topographic map 134 shown in the lower part of FIG. 4, there is a steep change in depth in a small area, so that the display becomes unclear as the number of contour lines increases. Specifically, for example, in the case of an elongated terrain such as the submarine canyon B1, the adjacent contour lines are too dense, and the user (analyst) who can view the screen can appropriately confirm the submarine canyon B1. Disappear. Therefore, if the number of contour lines is reduced, as shown in the lower diagram of FIG. 4, for example, a relatively high submarine hill B4 can be confirmed, but a relatively low submarine hill B3 cannot be properly confirmed.

  Further, a seabed depression B2 exists in the southwestern part of the island L1. As shown in the lower diagram of FIG. 4, if the number of contour lines per unit depth is reduced, the seabed depression B2 cannot be clearly confirmed. For example, if the seawater temperature, which is survey data, is near the seabed, low-temperature seawater tends to stay in the concave portion of the seabed such as the seabed depression B2, so that grasping is important in the analysis. However, if the concave portion cannot be confirmed on the screen, proper analysis can be hindered.

  On the other hand, in this Embodiment, as shown in the upper figure of FIG. 4, the seabed topography is displayed by 3D. In particular, the 3D display is more preferably an orthographic projection rather than a general perspective projection, and there is also a naked-eye stereoscopic display system that is a 3D display system that does not use auxiliary tools such as so-called “3D glasses”. Very preferred when used.

  Specifically, as shown in the upper diagram of FIG. 4, the entire screen of the lower display panel 122 has a 3D terrain display area 31 for displaying the terrain in 3D and a 3D indicator display for displaying the 3D indicator 35 as in the lower diagram. The area 32 is divided. In the 3D terrain display area 31, the 3D terrain map 34 is displayed in an orthographic projection so as to protrude in front of the viewer (user, analyst), and is superimposed on the 3D terrain map 34. An aircraft symbol 36a (white sphere in the figure) indicating the aircraft 10 and a buoy symbol 36b (shaded sphere in the figure) indicating the drifting buoy 20A are displayed.

  The 3D terrain map 34 is a 3D image object generated from the 3D format terrain data stored in the storage unit 143, and is generated from the terrain data newly input from the input unit 13 as necessary. Also good. Further, the 3D topographic map 34 is displayed as a 3D image based on contour lines for the land portion and contour lines for the sea bottom portion.

  Also in the 3D indicator display area 32, a substantially cylindrical 3D indicator 35 is displayed in an orthographic projection with an autostereoscopic view, and this 3D indicator 35 is directed toward the near side of the eye in response to changes in the survey data. It is displayed so that it protrudes or retracts to the far side away from the viewer. The protrusion or retraction of the 3D indicator 35 is based on the reference surface R2 that matches the actual screen, and this reference surface R2 matches the reference surface R1 that is shown as a shaded surface in the adjacent 3D terrain display area 31. ing. Further, in order to distinguish the plurality of 3D indicators 35 in the 3D indicator display area 32, the partition grid lines and the characters S1 to S4 are displayed on the reference plane R2, so the 3D indicator display area 32 is Both 3D images and 2D images can be displayed.

  Explaining the protruding or retracting state of the four 3D indicators 35 shown in the upper part of FIG. 4, the 3D indicator 35-S1 corresponding to the buoy symbol 36b-S1 is in a state where there is no step and no protrusion or retracting from the reference plane R2. There is no change in the survey data (in the above example, the change in seawater temperature over time). Further, the 3D indicator 35-S2 corresponding to the buoy symbol 36b-S2 protrudes to some extent toward the viewer, indicating that a positive change has occurred in the survey data. The 3D indicator 35-S3 corresponding to the buoy symbol 36b-S3 protrudes greatly, indicating that a large positive change has occurred in the survey data, and the 3D indicator 35-S4 corresponding to the buoy symbol 36b-S4. Indicates that there is a negative change in the survey data because it has been pulled inward.

  In the upper diagram of FIG. 4, for convenience of explaining the relationship between the viewing direction V1 of the viewer and 3D display by orthographic projection, the 3D topographic map 34, the aircraft symbol 36a, the buoy symbol 36b, and the 3D indicator 35, which are 3D images, are shown. It is shown as a perspective view. In addition, in order to show the corresponding relationship with the lower figure, the aircraft symbol 36a and the four buoy symbols 36b in the upper figure are displayed by being connected to the aircraft symbols 136a and the four buoy symbols 136b in the lower figure by two-dot chain lines, respectively. .

  As shown in the upper diagram of FIG. 4, the positional relationship between the aircraft symbol 36a and each buoy symbol 36b with respect to the land L0 and the islands L1, L2 is the same as the lower diagram. However, since the 3D topographic map 34 is orthographically displayed, the submarine depression B2 and the submarine hill B3 that are unclear in the 2D topographic map 134 are clearly displayed. The 3D indicator 35 is a substantially cylindrical 3D image, and is orthogonally projected so as to expand and contract from the front of the screen to the back. Therefore, as compared with the 2D indicator 135, the degree of change in the survey data becomes clearer.

  In FIG. 4, the reference plane R1 for 3D display by orthographic projection is located in the middle of the inclined portion of the seabed in the 3D topographic map 34, but it is raised to the sea level or to a deeper position. By moving it down, the 3D topographic map 34 can be moved up and down in the overall height direction as viewed from the viewer. In accordance with this, the reference plane R2 of the 3D indicator display area 32 also moves up and down.

  Furthermore, since the display device 11A also includes an upper display panel 121 that displays a 2D image (see FIG. 2), the 2D display by the upper display panel 121 and the orthogonal 3D display by the lower display panel 122 are compared. Thus, the person in charge of analysis can perform more appropriate analysis. For example, if the upper display panel 121 displays a weather map by a weather radar instead of a topographic map, and the bottom display panel 122 displays a three-dimensional view of the seabed topography, the analyst can analyze the weather phenomenon such as rain. It can be easily compared with the seafloor topography. For example, depending on the type of survey, the 2D display shown in the lower diagram of FIG. 4 and the 3D display shown in the upper diagram of FIG. 4 may be switchable.

  As for the schematic screen of the lower display panel 122 described above, if a more specific configuration is illustrated, as shown in FIG. 5A, in addition to the 3D terrain display area 31 and the 3D indicator display area 32, 2D text A configuration including the display area 33 can be given. The 3D terrain display area 31 occupies most of the entire screen, and a 3D indicator display area 32 is positioned on the right side of the 3D terrain display area 31, and a 2D text display area 33 is positioned on the upper side. As described above, the 3D terrain display area 31 and the 3D indicator display area 32 are display areas for displaying 3D images by orthogonal projection, but the 2D text display area 33 is suitable for 2D display such as character information. This is a display area for displaying an image. In FIG. 5A, for convenience of explanation, the 3D topographic map 34 and the 3D indicator 35 are illustrated two-dimensionally.

  In the 3D terrain display area 31, one aircraft symbol 36a and a plurality of buoy symbols 36b are displayed superimposed on the 3D terrain map 34, as in the upper diagram of FIG. In this example, since nine buoy symbols 36b are displayed, nine 3D indicators 35 are also displayed in the 3D indicator display area 32.

  Here, as shown in FIG. 5B, the 3D indicator 35 may be displayed so that various changes occur in response to changes in the survey data. For example, the 3D indicator 35a shown at the left end in FIG. 5B has a simple cylindrical shape and is displayed so as to expand and contract along the viewing direction V1 when viewed from the viewer. 3D indicator 35b is displayed so that the brightness | luminance of the top | upper surface (front side) of the said 3D indicator 35b changes with expansion / contraction. In FIG. 5 (b), when the top surface is located at the farthest end, the brightness is low and dark as shown in the dark shading, but the brightness of the top surface increases as it extends toward the front (in FIG. Multiplying density decreases) and the display is bright.

  Alternatively, the 3D indicator 35c shown on the right side of the 3D indicator 35b is displayed so that the color of the top surface thereof changes as it expands and contracts. In FIG. 5B, if the top surface is located at the innermost position, for example, it is displayed in cold blue (indicated by vertical hatching in the figure), and if the top surface is located in the middle, green (in the figure, If the top surface is closest to the top, it is displayed in a warm red color (indicated by the hatched hatching in the figure).

  Alternatively, the 3D indicator 35d shown at the right end toward the right is displayed such that the scale of the top surface changes with expansion and contraction. In FIG. 5B, if the top surface is located at the innermost position, the area of the top surface is displayed small, but the top surface area is displayed so as to increase toward the front. Although not shown, the shape of the top surface may be changed (for example, it is rectangular at the innermost position and becomes closer to a circle as it extends forward).

  Furthermore, the above changes may be combined, or changes other than the above may be combined. In other words, the brightness and color of the top surface of the 3D indicator may be changed, or at least one of the brightness and color of the top surface may be changed according to the change in the size of the top surface. Good.

  As shown in FIG. 5A, the 2D text display area 33 displays a time “13:23:45” and a character “Z” indicating a 3D display state. In addition to the character information, images suitable for 2D display, such as various icons, can be displayed. Therefore, the display data generation unit 142 (see FIG. 3) is configured to be able to generate 2D format data including character information as display data, and the storage unit 143 displays a 2D format display including character information. It is sufficient that the business data is stored.

  As described above, if it is possible to display a 3D image and a 2D image at the same time, landform or submarine topography can be displayed as a 3D image, and character information can be displayed as a normal 2D image. Therefore, the 3D or 2D display can be switched according to the type of image displayed so that the viewer (analyzer) can easily recognize.

  The 3D image displayed on the lower display panel 122 preferably has a predetermined upper limit on the height viewed from the viewer depending on the type of the image. For example, the 3D topographic map 134 is an image that displays a steep terrain change such as a seabed topography in 3D, whereas the 3D indicator 35 is an image that displays the degree or change of survey data. The height in the 3D display can be set so that the 3D topographic map 134 is higher than the 3D indicator 35. The 3D indicator 35 is a 3D image that can be expanded and contracted. However, if the maximum extension dimension exceeds the height of the 3D topographic map 134, it may be an obstacle for the viewer to see the topography. Conversely, when it is desired to emphasize the expansion / contraction change of the 3D indicator 35, the 3D indicator 35 may be set higher than the 3D topographic map 134.

[3D image display control]
Next, 3D image display control by orthographic projection will be described in detail with reference to FIGS. 6 to 8 in addition to FIGS. 3 and 5A and 5B.

  As shown in FIG. 6, the display control unit 141 shown in FIG. 3 first reads the terrain data as display data stored in advance from the storage unit 143 (step S101: display data reading step). The terrain data read at this time is typically 3D terrain data for displaying the 3D terrain map 34. However, when the 2D terrain map 134 is displayed on the lower display panel 122, the 2D terrain data is displayed. Read out.

  Next, as shown in FIG. 3, the data receiving device 15 receives survey data (for example, a change in seawater temperature with time) from the data collecting device 20 (for example, the drifting buoy 20 </ b> A), and displays the display data generating unit 142. Therefore, the display control unit 141 causes the display data generation unit 142 to generate display data from the survey data (step S102: display data generation step).

  Depending on the type of image displayed on the lower display panel 122, the display data generation unit 142 may generate new display data from various data stored in the storage unit 143, as well as the input survey data. It may be generated. Therefore, in the display data generation step by the display data generation unit 142, display data may be generated not only from the acquired survey data but also from other data. Further, when only the 3D topographic map 34 (or the 2D topographic map 134) is displayed due to the screen configuration, the display data generation step can be skipped for control.

  Next, the display control unit 141 creates an image object for each of a plurality of preset display areas (step S103: image object creation step). In the example shown in FIG. 5A, since the plurality of display areas set on the lower display panel 122 are the 3D terrain display area 31, the 3D indicator display area 32, and the 2D text display area 33, An image object to be displayed in the display area is generated from the display data. In the 3D terrain display area 31, a 3D terrain map 34 that is a 3D image object is generated, in the 3D indicator display area 32, a 3D indicator 35 that is a 3D image object is generated, and in the 2D text display area 33, 2D A character string (text) that is an image object is generated.

  Next, the display control unit 141 selects, from among the generated 2D or 3D image objects, a display area in which a 3D image object having the maximum height Z is created as an “adjustment area” (step S104: adjustment area) Judgment step). For example, as shown in FIG. 7A, if each display area where an image object is generated is schematically shown as a solid corresponding to the XYZ coordinates, even if the 3D indicator 35 is in the maximum stretched state, As described above, normally, the height Z of the 3D topographic map 34 is set to be larger than the height Z of the 3D indicator 35. Since the 2D image object has a height Z = 0, the 3D landform display area 31 is selected as the adjustment area.

  Next, the display control unit 141 adjusts the position of the reference plane R1 for displaying the 3D image object for the adjustment region (step S105: offset adjustment step). In other words, the degree of protrusion of the 3D image object displayed in the adjustment area is adjusted by offsetting the relative position of the adjustment area in the XYZ coordinates in the direction of the height Z. For example, as shown in FIG. 7A, the 3D landform display area 31 (cuboid in the figure) is in a state where the rear end face is in contact with the XY plane, but as shown in FIG. The terrain display area 31 is translated in the −Z direction and adjusted so that the XY plane is positioned in the middle of the height Z. As a result, the reference plane R1 is positioned in the middle of the height Z of the 3D landform display area 31. Needless to say, the reference plane R1 is not limited to the middle of the height Z.

  Next, the display control unit 141 adjusts the depth of the 3D image object in the adjustment region (step S106: protrusion amount adjustment step). “Depth adjustment” refers to adjusting the interval (depth Dm) from the position in front of the 3D image object to the farthest position as viewed from the viewer, as indicated by reference numeral Dm in FIG. This corresponds to the protrusion amount of the 3D image object from the reference plane R1. By appropriately adjusting the depth Dm, the viewer can clearly see both the near side and the farthest side of the 3D image object. In this protrusion amount adjustment step, since the purpose is to adjust the height Z direction (depth Dm), the scale in the XY direction is not changed. In other words, in this step, the dimensions in the XY direction of the 3D landform display area 31 are fixed, and only the scale in the Z direction is adjusted.

  Next, it is determined whether or not there is a display area in which the reference plane is not adjusted in the plurality of display areas (step S107: unadjusted display area determination step). In the present embodiment, since the 3D indicator display area 32 and the 2D text display area 33 remain (YES in step S107), the process returns to step S104. In step S104, the 3D indicator display area 32 is selected as the adjustment area (since the 2D text display area 33 has a height Z = 0), and in step S105, the offset adjustment of the 3D indicator display area 32 is performed. As shown in (c), the reference plane R2 moves so as to coincide with the reference plane R1 (that is, the XY plane) of the 3D landform display area 31. Since the eyes of the viewer are focused on the reference plane R1, 2D images such as partition grid lines and characters displayed on the reference plane R2 can be clearly seen. Then, the protrusion amount adjustment step of the 3D indicator display area 32 is performed in step S106.

  Next, the process proceeds to step S107, and it is determined that there is a display area whose reference plane is not adjusted. Since the 2D text display area 33 remains (YES in step S107), the process returns to step S104. In step S105, the offset of the 2D text display area 33 is adjusted. As shown in FIG. 7C, the 2D text display area 33 that is a plane is the reference plane R1 (that is, the XY plane) of the 3D landform display area 31. ) To match. Since the viewer's eyes are focused on the reference plane R1, a 2D image such as text displayed in the 2D text display area 33 can be clearly seen. Thereafter, step S106 is substantially skipped (since no 3D image is displayed), and the process proceeds to step S107.

  Since the adjustment of the reference plane has been completed for all the display areas (NO in step S107), the image objects corresponding to the display areas of the display unit (lower display panel 122) are displayed (step S108: image display step). ). In this way, display control of an example of a 3D image ends.

  As described above, in the display device 11A, the 3D terrain data of the sea area (or area) is stored in the storage unit 143, and the display data generation unit 142 before and after the change when the survey data changes. Display data corresponding to the survey data is generated so that the images are displayed differently. The display control unit 141 displays the terrain of the sea area (or region) on the lower display panel 122 as a 3D image (3D terrain map 34) based on the 3D terrain data, and when the survey data changes, The change is displayed on the lower display panel 122 as an image change based on the display data. The change in the image may be a 2D image such as a 2D indicator 135 shown in the lower diagram of FIG. 4, but as shown in the display control described above, a 3D image such as the 3D indicator 35 shown in FIGS. 5A and 5B is used. Particularly preferred.

  Thereby, at least terrain data is displayed as a 3D image, and when a change occurs in the survey data, it is preferably displayed as a change in the 3D image. Therefore, the entire sea area (or region), which is a comprehensive viewpoint, can be clearly distinguished from other displays by being converted to 3D, and individual survey data, which is a local viewpoint, ) Can be clearly distinguished. Moreover, changes in the collected survey data are displayed as changes in the image from time to time, so that the survey data obtained from both comprehensive and local viewpoints can be used for immediate analysis. (Analyzer) can be given.

  Further, in the lower display panel 122, the display method of the 3D topographic map 34 and the 3D indicator 35 is an orthographic autostereoscopic display method. If the 3D image is displayed in an orthographic projection instead of a general perspective projection, the display size of the 3D image does not change regardless of the distance from the viewpoint of the viewer. In addition, since the 3D image is displayed with the naked eye stereoscopic view, the viewer recognizes the accurate display of the terrain with the naked eye without using 3D display glasses or the like regardless of the water depth (or altitude difference in the area). It becomes possible.

  In particular, in the case of ocean surveys, since the seabed topography is steep, display of 3D images by orthographic projection is much more advantageous than general perspective projection. That is, when the topography is displayed in 3D by perspective projection, the visual volume assumed from the viewer's viewpoint toward the viewing direction is a substantially quadrangular pyramid shape (or pyramid shape) in which the vertex is located on the viewpoint side and the bottom surface is located on the far side. It becomes. Therefore, for example, in a steep undersea terrain, the display size becomes smaller than the actual size as the water depth increases, so that the positional relationship of the data collection device 20 with respect to the specific terrain is displayed so that it can be accurately recognized. It becomes difficult. On the other hand, if the 3D display is performed by orthographic projection, the visual volume becomes a substantially rectangular parallelepiped shape. Therefore, since it is possible to display an accurate shape regardless of the water depth, for example, a display that can accurately recognize the positional relationship of the data collection device 20 with respect to a specific landform is possible.

  Further, the entire screen of the lower display panel 122 is divided into a plurality of display areas, and is configured to display different images in the respective display areas. In this case, the display control unit 141 is configured to display the plurality of display areas. Among them, a reference plane in the height direction (Z direction) is set in the display area where the height of the displayed three-dimensional image is maximum, and the image is displayed with reference to the reference plane also in the remaining display areas. It is configured. Thereby, the display of a 2D or 3D image can be adjusted so that the near side or the innermost part on the screen can be clearly seen.

  Here, in the image display step of step S108, display control is performed in accordance with each display area. As described above, the 3D indicator 35 is at least along the depth direction of the screen when the survey data changes. Display control is performed so that the display changes. This display control will be specifically described with reference to FIG.

  First, the display control unit 141 is based on the display data acquired from the display data generation unit 142, and among the plurality of 3D indicators 35, the 3D indicator 35 corresponding to the survey data in which the change has occurred is proportional to the amount of change. The length is expanded or contracted (step S201). And the brightness | luminance of the top | upper surface of the 3D indicator 35, a color, a reduced scale, a shape, etc. are changed with expansion / contraction (step S202, for example, refer FIG.5 (b)). Thereafter, it is determined whether there is any other survey data that has changed (step S203). If it exists (YES in step S203), the process returns to step S201, and if it does not exist (NO in step S203). The display control ends.

  Thus, when the survey data collected by the data collection device 20 changes, the data change is displayed as a 3D indicator 35 indicating a three-dimensional change, not a two-dimensional change. Therefore, the distinction between the comprehensive viewpoint display (3D terrain display area 31) and the local viewpoint display (3D indicator display area 32) can be made clearer. In addition, since the change in the image, that is, the expansion and contraction of the 3D indicator 35 is easily grasped as needed, the contribution of the survey data to the immediate analysis can be improved.

  Specifically, the central portion of the visual field (central visual field) is an area where the viewer's line of sight concentrates, and thus is an area where the visual acuity of the viewer can be maximized. Therefore, when identifying a visual target, sufficient spatial resolution (perception of shape) can be exhibited, and color perception is also substantially complete. Therefore, on the screen of the lower display panel 122, the 3D terrain display area 31 may be arranged at a position corresponding to the central visual field (see the upper diagram in FIG. 4 and FIG. 5A). On the other hand, the peripheral part of the visual field (peripheral visual field) is a region in which the viewer cannot fully perceive the shape or color of the visual object compared to the central visual field. This is an area where excellent reaction characteristics can be exhibited.

  Therefore, as shown in the upper diagram of FIG. 4, FIG. 5A, and FIGS. 7A to 7C, the 3D indicator 35 is placed beside the 3D terrain display area 31 (3D indicator display area 32), for example. By displaying, even if the viewer is observing the screen with his / her eyes concentrated on the 3D topographic map 34, the buoy symbol 36b, etc., the expansion / contraction of the 3D indicator 35, and the brightness and color of the top surface are also observed. It is possible to appropriately grasp that the survey data has changed due to changes in scale, shape, and the like.

  Furthermore, since the expansion / contraction display of the 3D indicator 35 can display changes in the survey data with time, it can be used for a viewer (analyzer) to immediately analyze the survey data.

  For example, in the analysis of ocean data, sufficient analysis time may be secured, but in many cases, immediacy is required for the analysis. For example, the above-described spill accident of heavy oil or the like requires immediate analysis of the monitoring and prediction of the diffusion of heavy oil or the like in order to prevent the damage from spreading. However, in conventional marine surveys using aircraft, there is no known technique that can obtain and analyze marine data from both comprehensive and local viewpoints and can cope with analysis with high immediacy.

  Here, the analysis of the acquired data includes not only analysis of the data by a mathematical method or information processing technology, but also confirmation and determination of a person in charge handling the data. For example, assuming that there are multiple farms to be protected and there are limited human and material resources for protection in the accident of spilling heavy oil, etc., the ocean topography, tidal currents, It is necessary to select only a specific farm with comprehensive consideration of the conditions such as the scale of the farm and the economic impact, and concentrate protection resources only on the farm. Therefore, the person in charge analyzes various acquired marine data in order to make an immediate decision to select a specific farm.

  In the present embodiment, the display device 11A can display not only the topographic data as a 3D image on the lower display panel 122 but also the change in the survey data as an indicator image over time. The indicator image may be a 2D image, but if it is a 3D image like the 3D indicator 35, the change in the survey data can be displayed as a change in the height direction (depth direction), which is highly recognized by the viewer. There is an advantage that it becomes easy to do. Therefore, the survey data acquired from both comprehensive and local viewpoints can be presented to the analyst so that it can be used for immediate analysis.

[Modification]
In the present invention, the aircraft survey system may include devices other than the aircraft 10, the display device 11 </ b> A, the data receiving device 15, and the data collecting device 20. For example, in the case of marine survey, various ships are included, and survey data and the like may be communicated with the ship. For mountain surveys, communication bases or the like provided at the foot of the mountain or at the top of the mountain may be included. Regardless of ocean survey or mountain survey, the aircraft 10 may include a survey device such as a multi-spectral scanner (MSS). A plurality of aircrafts 10 may be included, and each aircraft 10 may be equipped with a display device 11A (and data receiving device 15). Further, the survey target of the aerial survey system is not specified as either the ocean or the mountain, but may be the entire specific region including both.

  Further, the specific purpose of the ocean survey or mountain survey is not particularly limited. For example, in the case of oceanographic surveys, in addition to surveying the ocean floor topography for the purpose of architectural civil engineering, surveying the marine environment, surveying ocean currents, etc., for example, searching for victims due to accidents, surveying marine life behavior In addition, surveys on the movement of submersible ships, etc. are also included. In addition, in the case of mountain survey, in addition to mountain topography survey, mountain environment survey, and mountain meteorological survey, for example, search for victims due to accidents, behavior survey of animals in mountainous areas, etc. are also included.

  Further, the data collection device 20 may be a “moving type” (for example, a drifting type buoy 20A) that moves in an investigation target area even if it is a “fixed type” (for example, a mooring type buoy 20B) installed at a specific location. In addition, for the purpose of investigating the range of behavior of the animal, it may be an “attached type” that is directly attached to the animal. In this case, the survey data collected is the position of the animal in the survey target area. Similarly, in the fixed type or mobile type data collection device 20, the presence or behavior of an animal, a human being, or even a vehicle is collected as survey data by providing a detection device such as an infrared detector or sonar. Can do.

  The display device 11A includes the upper display panel 121 and the lower display panel 122. However, the display device 11A may include only the lower display panel 122 capable of 3D display, or may include a display unit other than these. There may be. The input unit 13 includes a keyboard 131, a trackball 132, a joystick 133, a left touch panel 123, and a right touch panel 124, but the input unit 13 may be any one of these, or other than these. The input unit 13 may be provided.

  In addition, the input unit 13, the display unit, the display control unit 141, and the like constituting the display device 11A are not integrated as shown in FIG. Alternatively, the display device 11A may be integrated with the data receiving device 15 or the like.

  In the 3D terrain display area 31, the 3D terrain map 34 may be displayed in monochrome (or displayed in a single color), but it is preferable to perform color display using a plurality of colors. In particular, when the seabed topography is very steep or wide, changing the display color of the 3D topographic map 34 according to the water depth makes it easier for the viewer (analyzer) to grasp the seabed topography. Therefore, it is preferable. For example, if the display is light blue in the vicinity of the continental shelf and deep blue in the vicinity of the trench, and the color becomes darker as the water depth increases, the viewer can intuitively determine rough promotion. Therefore, the understanding degree of the person in charge of analysis can be further enhanced by a synergistic effect with the 3D image.

  Further, in the present embodiment, the configuration in which the display device according to the present invention is mounted on an aircraft and used in an aerial survey system has been described as a particularly preferred embodiment, but the present invention is not necessarily limited to this configuration. However, for the purpose of ocean survey or mountain survey, it does not necessarily have to be mounted on an aircraft and can be used in any situation.

(Embodiment 2)
The display device according to Embodiment 2 of the present invention has a configuration in which a user (analyzer) directly performs an input operation on a 3D image displayed on the lower display panel 122. It has become. An example of the configuration will be specifically described with reference to FIGS.

  As shown in FIG. 9, the display device 11 </ b> B according to the present embodiment has the same external configuration as the display device 11 </ b> A according to the first embodiment. The difference is that 134 is provided. Since the upper display panel 121 is located above the hand movement recognition camera 134, the hand movement recognition camera 134 is located between the upper display panel 121 and the lower display panel 122 in the configuration shown in FIG. It will be. Further, an arrow P3 in FIG. 9 indicates that the 3D indicator 35 in the protruding state can be operated by an operation such as a user's hand gesture (or gesture).

  As shown in FIG. 10, the display device 11B has a control system similar to that of the display device 11A, except that an indicator input control unit 144 is provided in addition to the hand movement recognition camera 134. . In FIG. 10, the data collection device 20 and the input unit 13 are illustrated in a simplified manner, unlike FIG.

  The indicator input control unit 144 includes an operation corresponding image region extracting unit 144a, an indicator coordinate specifying unit 144b, and an indicator operation determining unit 144c. An image captured by the hand movement recognition camera 134 is an operation corresponding image region extracting unit 144a. Is input. In addition, center coordinates of the top surface of the 3D indicator 35 described later are input from the display control unit 141 to the indicator coordinate specifying unit 144b.

  The operation corresponding image region extraction unit 144a operates the 3D indicator 35 displayed on the lower display panel 122 from the upper body image of the user (viewer) captured by the hand movement recognition camera 134 (in the case of right-handed, the right hand). ) Is extracted as an “operation-compatible image region”. In this operation-corresponding image area, the position of the user's hand corresponds to 3D position data. The indicator coordinate specifying unit 144b converts the center coordinates of the 3D indicator 35 input from the display control unit 141 into coordinates in the world coordinate system, and specifies the coordinates of the 3D indicator 35. The world coordinate system here is a coordinate system set in an operation space (virtual world) in which the user performs a gesture corresponding to an operation in front of the screen of the lower display panel 122, and is converted into the world coordinate system. The previous center coordinate is position data (image position data) for the 3D image of the 3D indicator 35.

  The operation corresponding image region (3D position data) extracted by the operation corresponding image region extracting unit 144a and the world coordinates of the top surface of the 3D indicator 35 specified by the indicator coordinate specifying unit 144b are sent to the indicator operation determining unit 144c. Entered. The indicator operation determination unit 144c compares the operation-corresponding image area with the world coordinates of the top surface, selects a combination having the closest interval, and calculates the distance (closest distance) Ds. Furthermore, if an upper limit value (upper limit distance ds) of the closest distance Ds is set in advance and a state where the calculated closest distance Ds is smaller than the upper limit distance ds is maintained for a certain period of time, the specific 3D indicator 35 is displayed. It is determined that the user has performed an operation, and the result is output to the display control unit 141.

  In the present embodiment, the specific configurations of the hand movement recognition camera 134 and the indicator input control unit 144 are not particularly limited. As the hand movement recognition camera 134, a known digital imager used for input of motion and hand movement is used. The indicator input control unit 144 is a functional configuration of the display control unit 141 and includes a configuration realized by the CPU as the display control unit 141 operating according to a program stored in the storage unit 143. You may comprise as a determination circuit etc. by a well-known switching element, a subtractor, a comparator.

  The movement of the user's hand gesture (or gesture) or the like imaged by the hand movement recognition camera 134 is typically the movement of the user's five fingers. It may be a partial movement, or a movement of a pen gripped by the user or the like. In the present embodiment, a part of the palm or an object other than the finger is included in the five fingers of the user (operator) and referred to as an “operation finger unit”.

  Further, the movement of the operation finger unit may be recognized by a device other than the hand movement recognition camera 134. For example, a configuration in which a display used as the lower display panel 122 integrally incorporates an optical sensor can recognize the movement of the operation finger unit in front of the screen. Or the structure which recognizes a motion of an operating finger | toe part with an infrared camera instead of the camera which images an image in presence of visible light may be sufficient. Therefore, in the present embodiment, the position of the operation finger portion by the gesture of the operator (user, viewer, analyst) etc. in front of the display portion is used as 3D position data based on the screen of the display portion. What is necessary is just to provide the 3D position data input part which enables input.

  In the display device 11B having the above configuration, the operation control of the 3D indicator 35 by the indicator input control unit 144 will be specifically described with reference to FIG.

  First, the display control unit 141 inputs the center coordinates of the displayed top surface of the 3D indicator 35 to the indicator coordinate specifying unit 144b, whereby the indicator input control unit 144 acquires the center coordinates of the top surface ( Step S301). Next, the indicator coordinate specifying unit 144b converts the acquired center coordinates into the world coordinates (step S302).

  In addition, the user's hand gesture in front of the screen of the lower display panel 122 is picked up as an upper body image by the hand movement recognition camera 134 and input to the operation corresponding image area extracting unit 144a. Therefore, the indicator input control unit 144 is Get the upper body image. Then, the operation corresponding image region extraction unit 144a extracts, for example, an image region corresponding to the right hand from the upper body image as an operation corresponding image region (step S303).

  Then, the indicator operation determination unit 144c compares the extracted operation-corresponding image region (3D position data of the operation finger unit) with the world coordinate (image position data) of the top surface of the identified 3D indicator 35, As described above, the closest distance Ds is calculated (step S304). Thereafter, the indicator operation determination unit 144c determines whether or not the state where the closest distance Ds is smaller than the upper limit distance ds (Ds <ds) is maintained for a certain period of time (whether or not the condition that the certain time Ds <ds is satisfied) is satisfied. Is determined (step S305).

  If it is satisfied (YES in step S305), it is determined that the specific 3D indicator 35 has been operated by the user, and the determination result is output to the display control unit 141. The display control unit 141 performs control to generate an internal event corresponding to the operation (step S306). On the other hand, when not satisfying (NO in step S305), it is determined that the 3D indicator 35 is not operated, and the determination result is output to the display control unit 141. Since the 3D indicator 35 is not operated, the display control unit 141 ends the control of the indicator input control unit 144 without performing any particular processing.

  As described above, the display device 11B further includes the hand movement recognition camera 134 as an input unit, and further includes the indicator input control unit 144 as a control block. Therefore, if an operation (hand gesture) is performed such that the user touches the 3D indicator 35 displayed on the lower display panel 122, an operation command (or various data) can be input to the display device 11B. Therefore, since the display on the lower display panel 122 and the data input are directly associated with each other, the operability is further improved.

  Note that the 3D image that can be operated by the user is not limited to the 3D indicator 35, and is a 3D image displayed in the 3D terrain display area 31, such as the 3D terrain map 34, the aircraft symbol 36a, and the buoy symbol 36b. May be. The display data used for displaying these 3D images only needs to include image position data corresponding to the 3D position data set in the operation space. Thereby, step S304 can be executed.

(Embodiment 3)
The display device according to Embodiment 3 of the present invention is configured such that a viewer who views the upper display panel 121 or the lower display panel 122 can perform line-of-sight input. An example of the configuration will be specifically described with reference to FIGS.

  As shown in FIG. 12, the display device 11 </ b> C according to the present embodiment has the same external configuration as the display device 11 </ b> B according to the second embodiment. The difference is that a line-of-sight tracking camera 135 is provided on the front side of 112. Note that an arrow P4 in FIG. 12 indicates the movement of the viewer's eyes imaged by the line-of-sight tracking camera 135, and an arrow P5 indicates that the cursor symbol 30 is displayed on the upper display panel 121 and the lower display in accordance with the movement P4 of the line of sight. It shows that it can move between the panels 122.

  As shown in FIG. 13, the display device 11C has a control system similar to that of the display device 11B, except that it includes a line-of-sight tracking input control unit 145 in addition to the line-of-sight tracking camera 135. Yes. In FIG. 13, as in FIG. 10, the data collection device 20 and the input unit 13 are illustrated in a simplified manner, unlike FIG. The line-of-sight tracking camera 135 inputs the movement of the viewer's line of sight as imaging data to the line-of-sight tracking input control unit 145, and the line-of-sight tracking input control unit 145 generates an operation command from the imaging data and inputs it to the display control unit 141. To do. The display control unit 141 performs display control based on the input operation command.

  In the present embodiment, the specific configurations of the line-of-sight tracking camera 135 and the line-of-sight tracking input control unit 145 are not particularly limited. As the eye tracking camera 135, a digital imager known in the field of eye tracking is used. The line-of-sight tracking input control unit 145 has a functional configuration of the display control unit 141 and is realized by a CPU as the display control unit 141 operating according to a program stored in the storage unit 143. Examples of programs used include various programs known in the eye tracking field.

  As described above, the display device 11C includes the line-of-sight tracking camera 135 as an input unit, and includes the line-of-sight tracking input control unit 145 as a control block. Therefore, since the eye movement of the viewer viewing the screen of the display unit with the line-of-sight tracking camera 135 can be used for data input, for example, a multi-step input operation can be realized only by eye movement. As shown in FIG. 12, the movement of the cursor symbol 30 on the screen can be quickly performed by the movement of the eyes.

(Embodiment 4)
The display device according to Embodiment 3 of the present invention is configured such that a viewer who views the upper display panel 121 or the lower display panel 122 can perform line-of-sight input. An example of the configuration will be specifically described with reference to FIG. 14 and FIGS. 15 (a) and 15 (b).

  As shown in FIG. 14, the display device 11 </ b> D according to the present embodiment has the same control system as the display device 11 </ b> C according to the third embodiment, but a multi-touch panel 136 is provided on the front surface of the lower display panel 122. Are different in that they are attached together. The viewer can input an operation command or various data to the display control unit 141 by directly touching the screen of the lower display panel 122 with a fingertip or the like.

  The specific configuration of the touch panel attached to the front surface of the lower display panel 122 is not particularly limited, but the multi-touch panel 136 is particularly preferable. With the multi-touch panel 136, a specific region of the 3D topographic map 34 can be specified by simply placing the fingertips of both hands at two locations on the screen. Specifically, as shown in FIG. 15A, a 3D topographic map 34 of the Japanese archipelago excluding, for example, the Nansei Islands is illustrated in the 3D topographic display area 31. If the viewer puts the index finger of both hands on the screen so as to sandwich the diagonal line of the region corresponding to Hokkaido, the region designation frame 37 which is a one-dot chain line frame image in the figure is displayed, and the region surrounding Hokkaido is designated. The Thereafter, when the index fingers of both hands are released, the region is fixed, and as shown in FIG. 15B, for example, a 3D topographic map 34 only for Hokkaido is enlarged and displayed.

  As described above, if a touch panel is provided on the front surface of the lower display panel 122, an operator command or various data can be input by the viewer directly touching the screen. Furthermore, if the above-described multi-touch panel 136 is used, the number of operations can be reduced by touching a plurality of locations on the screen to specify a region with a simpler operation. For example, if the touch panel is a single touch, four steps are required to specify the region, but if the multi touch panel 136 is used, two steps can be used. Therefore, it is possible not only to directly correspond the display of the screen and the input of data etc., but also to simplify the input operation, so that the operability can be further improved.

  It should be noted that the present invention is not limited to the description of each of the above-described embodiments, and various modifications can be made within the scope of the claims, and different embodiments and a plurality of modified examples are respectively provided. Embodiments obtained by appropriately combining the disclosed technical means are also included in the technical scope of the present invention.

  The present invention can be particularly suitably used in the field of aerial surveys, particularly marine surveys and mountain surveys in which topographic changes are steep.

DESCRIPTION OF SYMBOLS 10 Aircraft 11A-11D Display apparatus 13 Input part 15 Data receiving apparatus 20 Data collection apparatus 20A Drifting type buoy (data collection apparatus, floating body)
20B Mooring buoy (data collection device, floating body)
20C telemeter (data collection device)
21 Data acquisition unit 22 Transmission unit 31 3D landform display area (multiple display areas)
32 3D indicator display area (multiple display areas)
33 2D text display area (multiple display areas)
34 3D topographic map (three-dimensional image)
35 3D indicator (3D image, indicator image)
121 Upper display panel (display unit)
122 Lower display panel (display unit)
123 Left touch panel (display unit, input unit)
124 Left touch panel (display unit, input unit)
131 Keyboard (input unit)
132 Trackball (input unit)
133 Joystick (input unit)
134 gesture recognition camera (input unit, 3D position data input unit)
135 Visual tracking camera (input unit)
136 Multi-touch panel (input unit, touch panel)
141 Display control unit (control unit)
142 Display data generation unit 143 Storage unit R1, R2 Reference plane

Claims (17)

A display device capable of displaying survey data collected by a plurality of data collection devices located in a sea area or region subject to ocean survey or mountain survey and acquired by communication,
A display unit capable of simultaneously displaying a two-dimensional image and a three-dimensional image;
A storage unit for storing display data including at least three-dimensional terrain data for displaying terrain as the three-dimensional image;
From the survey data acquired from the data collection device, a display data generation unit that generates display data for the survey data;
A control unit,
The display data generating unit, when the temporal change occurs in the survey data, before and after the change of the survey data, a three-dimensional image display in the depth direction of at least the screen is changed from time to time, as an indicator image Generating the display data to be displayed, and also generating display data indicating the data collection device as a symbol image ,
The control unit causes the display unit to display the sea area or the topography of the area as a three-dimensional image based on the three-dimensional landform data, and causes the display unit to display a symbol image indicating the data collection device,
Further, when a change with time occurs in the survey data, the change is configured to be displayed on the display unit as needed in the depth direction of the indicator image based on the display data. Display device. The display data generation unit further generates display data in a two-dimensional format including character information,
The display device according to claim 1, wherein the control unit is configured to display a two-dimensional image on the display unit simultaneously with the three-dimensional image based on the display data. The display device according to claim 1 , wherein the display unit is configured to display the three-dimensional terrain data as a three-dimensional image based on contour lines or contour lines. The display device according to claim 3 , wherein the display unit is configured to display a three-dimensional image by autostereoscopic projection with an autostereoscopic view. The control unit divides the entire screen in the display unit into a plurality of display areas, displays different images in the display areas, and
Among the display areas, in the display area where the height of the displayed three-dimensional image is maximum, a reference plane in the height direction of the three-dimensional image is set,
5. The display device according to claim 4 , wherein the display device is configured to display an image with respect to the reference plane in all the display areas. The display device according to claim 1 , further comprising an input unit that allows data other than the survey data to be input. The display device according to claim 6 , wherein the input unit is a touch panel integrated with the display unit. The input unit is a three-dimensional position data input unit that inputs the position of the operator's operation finger unit in front of the display unit as three-dimensional position data with reference to the screen of the display unit,
Among the display data, the data used for displaying the image in the three-dimensional format includes image position data corresponding to the input three-dimensional position data,
Wherein the control unit is configured from a difference between the three-dimensional position data and the image position data for, and performing control to execute the input of the operation command by the operator, the display device according to claim 6. The display device according to claim 6 , wherein the input unit is a line-of-sight tracking camera. A display device according to any one of claims 1 to 9 ,
A data collection device comprising a data acquisition unit for acquiring survey data and a transmission unit for transmitting the acquired survey data;
A data receiving device for inputting the survey data received from the data collecting device to the display device;
An aerial survey system characterized by comprising: The aerial survey system according to claim 10 , wherein the data collection device is a floating body floating on a water surface. An image display step for simultaneously displaying a two-dimensional image and a three-dimensional image based on the display data;
Display data for generating the display data corresponding to the survey data from the survey data collected by a plurality of data collection devices located in the sea area or region subject to ocean survey or mountain survey and acquired by communication Generating step,
The display data includes pre-stored three-dimensional terrain data for displaying the terrain as a three-dimensional image.
The display data generating step, when the temporal change occurs in the survey data, before and after the change of the survey data, a three-dimensional image display in the depth direction of at least the screen is changed from time to time, an indicator image Generating the display data so as to be displayed as, and also generating display data for displaying the data collection device as a symbol image ,
In the image display step, a three-dimensional image of the terrain and a symbol image indicating the data collection device are displayed , and the change over time is displayed as needed in the depth direction of the indicator image based on the display data. A display method for a display device. In the display data generation step, two-dimensional display data including character information is further generated,
13. The display method according to claim 12 , wherein in the image display step, a two-dimensional image is displayed simultaneously with a three-dimensional image based on the display data. The display method according to claim 12 , wherein in the image display step, the three-dimensional terrain data is displayed as a three-dimensional image based on contour lines or contour lines. 15. The display method according to claim 14 , wherein, in the image display step, the three-dimensional image is displayed in an autostereoscopic display by orthographic three-dimensional display. In the image display step, the entire screen is divided into a plurality of display areas, and different images are displayed in the display areas.
Among the display areas, in the display area where the height of the displayed three-dimensional image is maximum, a reference plane in the height direction of the three-dimensional image is set,
The display method according to claim 15 , wherein an image is displayed on the basis of the reference plane in all the display areas. The display method according to claim 12 , wherein the display device is an aircraft-mounted display device.

Images