JP7140478B2 - WEATHER DISPLAY DEVICE, WEATHER DISPLAY METHOD AND WEATHER DISPLAY PROGRAM - Google Patents

Description

The present invention relates to a weather distribution display device, a weather distribution display method, and a weather distribution display program for displaying weather distribution.

Currently, weather information is distributed by information distribution media such as television broadcasting or the Internet. In such distribution, the weather distribution is mainly displayed superimposed on a flat map. For example, in Non-Patent Document 1, the distribution of precipitation is displayed superimposed on a two-dimensional map showing the Japanese archipelago and its surrounding areas. Further, for example, in Non-Patent Document 2, the distribution of clouds observed by a geostationary meteorological satellite is superimposed and displayed on a two-dimensional map showing the Japanese archipelago and its surrounding areas. Furthermore, Non-Patent Document 3 introduces visualization software for three-dimensionally visualizing various data such as map information.

Japan Meteorological Agency, "Radar Nowcast (Precipitation, Thunder, Tornado): Nationwide", [online], [searched on August 15, 2017], Internet <URL: http://www.jma.go.jp/jp /radnowc/> Japan Meteorological Agency, "Meteorological Satellite", [online], [searched on August 15, 2017], Internet <URL: http://www.jma.go.jp/jp/gms/> Cybernet System Co., Ltd., "General-purpose visualization software AVS", [online], [searched on August 15, 2017], Internet <URL: http://www.cybernet.co.jp/avs/products/>

According to the visualization software introduced in Non-Patent Document 3, a three-dimensionally visualized image of an object can be displayed on the screen of a display device. In addition, with such visualization software, it is possible to display an image according to the position of the viewpoint by changing the position of the viewpoint from which the object is viewed using a mouse. However, it is difficult for the user to grasp the relative positional relationship between the object and the viewpoint from the image displayed on the screen.

An object of the present invention is to provide a weather distribution display device capable of displaying an image of weather distribution on a map three-dimensionally and allowing the user to easily grasp the relative positional relationship between the map and the viewpoint. It is to provide a weather distribution display method and a weather distribution display program.

(1) A weather distribution display device according to a first aspect of the invention is a weather distribution display device for displaying weather distribution on a display unit of a portable device, and is a reference setting that virtually sets a fixed reference position in real space. a map data acquisition unit that acquires map data showing a map; a weather data acquisition unit that acquires weather data showing weather distribution; and a relative positional relationship calculation unit that calculates the relative positional relationship between the reference position and the mobile device Then, based on the map data, two-dimensional map image data showing a map image with a three-dimensional effect is generated, and based on the weather data, a weather image with a three-dimensional effect corresponding to the weather distribution is superimposed on the map image. an image data generation unit for generating two-dimensional weather image data, the image data generation unit generating composite image data by combining the map image data and the weather image data, and based on the generated composite image data The synthesized image is displayed on the display unit, and the map image data and the weather image data are changed so that at least one of the position, size and direction of the map image and the weather image is changed according to the change in the relative positional relationship.

In this weather distribution display device, a fixed reference position is virtually set in the real space, and the relative positional relationship between the reference position and the portable device is calculated. Map data representing a map is acquired, and two-dimensional map image data representing a map image having a stereoscopic effect is generated based on the map data. Also, weather data indicating the weather distribution is acquired, and two-dimensional weather image data is generated based on the weather data to indicate a weather image superimposed on the map image and having a three-dimensional effect corresponding to the weather distribution. Composite image data is generated by combining the map image data and the weather image data, and a composite image based on the generated composite image data is displayed on the display unit.

According to this configuration, the weather image can be displayed on the display unit of the portable device so as to be superimposed on the map image having a stereoscopic effect. Also, when the relative positional relationship between the reference position and the portable device changes, at least one of the position, size and orientation of the map image and the weather image changes accordingly. Therefore, the user can operate the portable device to change the relative positional relationship of the portable device with respect to the reference position, thereby displaying desired portions of the map image and the weather image in the composite image at a desired angle on the display unit. can be done. Here, the user can intuitively recognize the position of the mobile device as the position of the viewpoint, and can easily grasp the position of the viewpoint with respect to the reference position. Therefore, it is possible to display the image of the weather distribution on the map three-dimensionally and to allow the user to easily grasp the relative positional relationship between the map image and the viewpoint.

(2) The image data generator converts the map image data representing the map image that is recognizable when the map image virtually arranged at the reference position is viewed from the position of the mobile device into the relative positional relationship and the map data. A weather image that is generated based on the above and that is virtually placed at the reference position so as to be superimposed on the virtual map image at the reference position and that is recognizable when the weather image is viewed from the position of the portable device. Data may be generated based on relative positional relationships and weather data. In this case, it is possible to easily generate map image data representing a map image having a stereoscopic effect and weather image data representing a weather image having a stereoscopic effect.

(3) The reference setting unit virtually sets a first reference plane fixed in the physical space as a reference position, the map image is virtually arranged on the first reference plane, and the relative positional relationship calculation unit , a relative positional relationship between a predetermined reference point on the first reference plane and the position of the mobile device may be calculated. In this case, the weather image is displayed at the same height as the map image in the synthesized image. This allows the user to easily recognize the relationship between each region on the map image and the weather image corresponding to that region.

(4) The meteorological data acquired by the meteorological data acquiring unit represent first and second meteorological distributions of different types, and the reference setting unit is fixed to the physical space and is positioned between the first reference plane and the predetermined position. A virtual second reference plane having a relationship is further set, and the image data generation unit generates the first weather distribution virtually placed on the first reference plane so as to be superimposed on the virtual map image. and a second weather image corresponding to a second weather distribution virtually placed on a second reference plane are viewed from the position of the portable device. Weather image data representing the image may be generated based on the relative positions and the weather data.

In this case, the first weather image and the second weather image can be displayed at different heights in the composite image according to the type of weather distribution. Also, since the first weather image is displayed at the same height as the map image, the user can easily recognize the relationship between each area of the map image and the first weather image corresponding to the area. can be done.

(5) The weather data acquisition unit acquires weather data at predetermined time intervals, and the image data generation unit updates weather image data generated each time weather data is acquired by the weather data acquisition unit. good too. In this case, it is possible to update the weather image in the composite image by following changes in weather data over time.

(6) The portable device includes a camera and a detector that detects the imaging direction of the camera, and the relative positional relationship calculation unit includes imaging data representing an image of the subject in focus obtained by the camera and detected by the detector. The direction from the camera to the reference position and the distance between the reference position and the camera may be calculated as the relative positional relationship based on the imaging direction. In this case, the relative positional relationship between the reference position and the mobile device can be easily calculated.

(7) The relative positional relationship calculator may calculate the relative positional relationship using the position of the camera as the position of the mobile device. In this case, the position of the mobile device can be calculated more easily based on the imaging data. In addition, the user can intuitively recognize the position of the camera as the position of the viewpoint, and can more easily grasp the position of the viewpoint with respect to the reference position.

(8) The detector includes an acceleration sensor that detects the direction of gravity and an electronic compass that detects the direction of geomagnetism. may be calculated. In this case, the direction of the camera can be easily detected in two directions perpendicular to each other. This makes it possible to easily calculate the direction from the camera toward the reference position.

(9) The reference setting unit may set, as the reference position, a virtual position having a predetermined positional relationship with respect to the mobile device at a predetermined point in time. In this case, the reference position can be easily set.

(10) Weather data may include geographic distributions of weather. In this case, the user can recognize the spatial distribution of the weather by visually recognizing the synthesized image.

(11) A weather distribution display method according to a second aspect of the invention is a weather distribution display method for displaying a weather distribution on a display unit of a portable device, the step of virtually setting a fixed reference position in a real space. a step of acquiring map data showing a map; a step of acquiring weather data showing weather distribution; a step of calculating a relative positional relationship between a reference position and a portable device; a step of generating two-dimensional map image data representing an image; and a step of generating two-dimensional weather image data representing a weather image superimposed on the map image based on the weather data and having a three-dimensional effect corresponding to the weather distribution. , generating composite image data by synthesizing map image data and weather image data; and displaying a composite image based on the generated composite image data on a display unit, wherein the composite image is displayed on the display unit. The step of causing includes changing the map image data and the weather image data such that at least one of the position, size and orientation of the map image and the weather image changes according to the change in the relative positional relationship.

According to this configuration, the user operates the portable device to change the relative positional relationship of the portable device with respect to the reference position, thereby displaying desired portions of the map image and the weather image in the composite image at a desired angle on the display unit. can be displayed. The user can intuitively recognize the position of the mobile device as the position of the viewpoint, and can easily grasp the position of the viewpoint with respect to the reference position. Therefore, it is possible to display the image of the weather distribution on the map three-dimensionally and to allow the user to easily grasp the relative positional relationship between the map image and the viewpoint.

(12) A weather distribution display program according to a third aspect of the invention is a weather distribution display program capable of displaying a weather distribution on a display unit of a portable device by a processing device, wherein a fixed reference position is set in the real space. Virtual setting processing, processing for acquiring map data showing a map, processing for acquiring weather data showing weather distribution, processing for calculating the relative positional relationship between the reference position and the portable device, and map data a process for generating two-dimensional map image data showing a map image with a three-dimensional effect based on the weather data; A process of generating image data, a process of generating composite image data by combining map image data and weather image data, and a process of displaying a composite image based on the generated composite image data on the display unit. The processing to be executed by the device and to display the synthesized image on the display unit is performed by combining the map image data and the weather image so that at least one of the position, size and orientation of the map image and the weather image changes according to the change in the relative positional relationship. Including changing the image data.

According to this configuration, the user operates the portable device to change the relative positional relationship of the portable device with respect to the reference position, thereby displaying desired portions of the map image and the weather image in the composite image at a desired angle on the display unit. can be displayed. The user can intuitively recognize the position of the mobile device as the position of the viewpoint, and can easily grasp the position of the viewpoint with respect to the reference position. Therefore, it is possible to display the image of the weather distribution on the map three-dimensionally and to allow the user to easily grasp the relative positional relationship between the map image and the viewpoint.

ADVANTAGE OF THE INVENTION According to this invention, the image of the weather distribution on a map can be displayed three-dimensionally, and a user can easily grasp the relative positional relationship between a map and a viewpoint.

1 is a block diagram showing the configuration of a portable device including a weather distribution display device according to an embodiment of the present invention; FIG. It is a figure which shows an example of the setting method of a reference plane. FIG. 10 is a diagram showing an example of display of a synthesized image; It is a figure which shows the change of a synthetic image when the position of a lens changes. It is a figure which shows the change of a synthetic image when the position of a lens changes. FIG. 10 is a diagram showing changes in a synthesized image when the direction of the lens changes; FIG. 10 is a diagram showing changes in a synthesized image when the direction of the lens changes; 4 is a flow chart showing an algorithm of weather distribution display processing performed by a weather distribution display program;

Hereinafter, a weather distribution display device, a weather distribution display method, and a weather distribution display program according to embodiments of the present invention will be described in detail with reference to the drawings.

(1) Configuration of Portable Device FIG. 1 is a block diagram showing the configuration of a portable device including a weather distribution display device according to an embodiment of the present invention. The mobile device 100 is, for example, a mobile smart device such as a mobile terminal, and is configured to be able to communicate with a weather server 200 that distributes weather data indicating weather distribution. Meteorological data is data in which weather such as rain, snow, clouds, thunder, wind, waves, temperature, or atmospheric pressure is associated with locations, and is obtained by observation or prediction. In the present embodiment, the meteorological data is the observed value of precipitation, the distribution of precipitation intensity observed by weather radar, and the distribution of clouds observed by meteorological satellites.

The meteorological data may be precipitation forecasts, forecasted precipitation intensity distributions, or forecasted cloud distributions. Alternatively, meteorological data includes snowfall, wind speed and direction, air temperature, surface temperature distribution, upper air temperature distribution, surface pressure distribution, upper air pressure distribution, surface wind distribution, upper wind distribution (including vertical component), lightning probability distribution, and tornado. Observed values or forecast values such as occurrence probability distribution, weather distribution of estimated weather, seismic intensity at seismic intensity observation points, or tsunami height at tsunami observation points may be used. It should be noted that data on earthquakes can also be associated with places. Therefore, in the present embodiment, weather data may include data on earthquakes.

Portable device 100 includes weather distribution display device 10 , acceleration sensor 20 , electronic compass 30 , camera 40 , position/direction calculation unit 50 , storage unit 60 , communication unit 70 and display unit 80 . Portable device 100 also includes a CPU (central processing unit), a RAM (random access memory), a ROM (read only memory), and a storage device (not shown). The ROM or storage device stores a system program, a position/direction calculation program, and a weather distribution display program.

The acceleration sensor 20 detects the direction of gravitational acceleration of the earth. The electronic compass 30 detects the direction of geomagnetism. The camera 40 has a lens 41 and captures an image of an arbitrary subject through the lens 41 to generate imaging data representing an image of the subject. Acceleration sensor 20 and electronic compass 30 are examples of detectors that detect the imaging direction of camera 40 .

The function of the position/direction calculator 50 is implemented by the CPU of the mobile device 100 executing a position/direction calculation program on the RAM. The position/direction calculator 50 sequentially calculates the relative position of the lens 41 with respect to the subject at predetermined time intervals based on the imaging data generated by the camera 40 . Further, the position/direction calculator 50 calculates the direction of the optical axis of the lens 41 (hereinafter simply referred to as the direction of the lens 41) based on the direction of gravitational acceleration detected by the acceleration sensor 20 and the direction of geomagnetism detected by the electronic compass 30. ) are sequentially calculated at predetermined time intervals.

Here, the direction of the lens 41 is represented by the elevation angle and horizontal angle of the lens 41 . The elevation angle of the lens 41 is defined as the angle formed by the optical axis of the lens 41 with respect to a plane (horizontal plane) orthogonal to the direction of gravitational acceleration detected by the acceleration sensor 20, for example. The horizontal angle of the lens 41 is defined, for example, as the angle formed by the optical axis of the lens 41 with respect to the geomagnetic direction (north-south direction) detected by the electronic compass 30 in the horizontal plane.

The storage unit 60 is configured by the RAM, ROM, and storage device described above. The storage unit 60 stores three-dimensional map data representing a map. The map data indicates, for example, the Japanese archipelago and its surrounding areas. Communication unit 70 is configured to be wirelessly communicable with weather server 200 . The display unit 80 includes, for example, a touch panel display, and displays various images.

The weather distribution display device 10 includes a reference setting unit 1, a relative positional relationship calculation unit 2, a map data acquisition unit 3, a map image data generation unit 4, a weather data acquisition unit 5, a weather image data generation unit 6, and an image data synthesis unit 7. including. The functions of the components (1 to 7) of the weather distribution display device 10 are realized by the CPU of the portable device 100 executing the weather distribution display program stored in the ROM or storage device. Some or all of the components (1 to 7) of the weather distribution display device 10 may be configured by hardware such as electronic circuits.

As an initial operation, the reference setting unit 1 virtually sets a fixed reference position in the physical space. In this embodiment, the reference setting unit 1 sets a virtual reference plane in the real space within the field of view of the camera 40 as the reference position. A reference point is set at a predetermined point (for example, center point) on the reference plane. Specifically, the reference plane is set based on the position and direction of the lens 41 when the camera 40 is activated and any subject within the field of view of the camera 40 is in focus. After the reference plane is set, the position of the reference plane does not change even if the position or orientation of the lens 41 changes. The details of how to set the reference plane will be described later.

The relative positional relationship calculator 2 calculates the relative positional relationship between the reference point of the reference plane set by the reference setting unit 1 and the lens 41 based on the position and direction of the lens 41 calculated by the position/direction calculator 50 . do. The relative positional relationship between the reference point and the lens 41 includes the direction from the lens 41 to the reference point and the distance between the reference point and the lens 41 .

The map data acquisition unit 3 acquires three-dimensional map data from the storage unit 60 . When weather server 200 distributes map data, map data acquisition unit 3 may acquire map data from weather server 200 via communication unit 70 .

Here, a three-dimensional map image is virtually arranged on the reference plane set by the reference setting unit 1 . Based on the three-dimensional map data acquired by the map data acquisition unit 3 and the relative positional relationship calculated by the relative positional relationship calculation unit 2, the map image data generation unit 4 moves the camera 40 from the current position of the lens 41. Two-dimensional map image data representing a two-dimensional map image obtained by capturing a virtual three-dimensional map image is sequentially generated at predetermined time intervals. Here, the two-dimensional map image is an image having a stereoscopic effect.

The weather data acquisition unit 5 acquires weather data from the weather server 200 via the communication unit 70 . Here, a virtual three-dimensional weather image that visually shows the weather distribution is defined based on the weather data, and the three-dimensional weather image is superimposed on the virtual three-dimensional map image on the reference plane. Placed virtually on a plane. Based on the weather data acquired by the weather data acquisition unit 5 and the relative positional relationship calculated by the relative positional relationship calculation unit 2, the weather image data generation unit 6 generates a virtual image of the camera 40 from the current position of the lens 41. Two-dimensional weather image data representing a two-dimensional weather image obtained by capturing a three-dimensional weather image is sequentially generated at predetermined time intervals. Here, the two-dimensional weather image is an image having a stereoscopic effect.

The image data synthesizing unit 7 combines two-dimensional map image data generated by the map image data generating unit 4, two-dimensional weather image data generated by the weather image data generating unit 6, and imaging data generated by the camera 40. By synthesizing, synthetic image data is generated. Further, the image data synthesizing section 7 causes the display section 80 to display a synthetic image based on the synthesized synthetic image data. The size, position and orientation of the map and weather image in the displayed composite image change depending on the position and orientation of the lens 41 . Thus, the map image data generator 4, the weather image data generator 6, and the image data synthesizer 7 are examples of the image data generator.

(2) Display of Composite Image FIG. 2 is a diagram showing an example of a method of setting a reference plane. After starting the camera 40, the reference setting unit 1 in FIG. 1 sets a virtual point 600 mm away from the lens 41 in the direction of the optical axis 42 as the reference point R1, as shown in FIG. The reference setting unit 1 also sets a virtual plane of 800 mm×800 mm that includes the reference point R1 and is parallel to the horizontal plane as the reference plane R2. Furthermore, the reference setting unit 1 sets a virtual plane of 800 mm×800 mm parallel to the horizontal plane at a predetermined height from the reference plane R2 as a sky plane R3. Reference plane R2 and sky plane R3 are examples of first and second reference planes, respectively.

FIG. 3 is a diagram showing an example of display of a synthesized image. As shown in FIG. 3, a three-dimensional map image is virtually arranged on the reference plane R2. The map image data generator 4 in FIG. 1 shows a two-dimensional map image obtained by capturing a virtual three-dimensional map image arranged on the reference plane R2 by the camera 40 from the current position of the lens 41. Generate two-dimensional map image data. In the example of FIG. 3, the lens 41 is located above and to the south of the map image. Further, since the distance between the lens 41 and the reference plane R2 is relatively large, the entire map image is included in the field of view of the camera 40. FIG. Therefore, two-dimensional map data representing a two-dimensional map image obtained by imaging the entire three-dimensional map image from the upper south direction is generated.

Further, in the example of FIG. 3, as three-dimensional weather images, an image showing the distribution of precipitation amount and precipitation intensity is virtually arranged on the reference plane R2, and an image showing the distribution of clouds is virtually arranged on the sky plane R3. are placed. The weather image data generator 6 in FIG. 1 generates a two-dimensional weather image obtained by capturing a virtual weather image arranged on the reference plane R2 and the sky plane R3 from the current position of the lens 41 by the camera 40. 2D weather image data shown in FIG.

The generated weather image data includes a precipitation amount image G1 indicating the amount of precipitation, a precipitation intensity distribution image G2 indicating the distribution of precipitation intensity, and a cloud distribution image G3 indicating the distribution of clouds. The precipitation image G1 is an image composed of one or more cylinders, and the height and color of the cylinders indicate the amount of precipitation. The precipitation intensity distribution image G2 is an image of an area (polygon) indicating an area having a predetermined precipitation intensity. The cloud distribution image G3 is an image of polygons indicating the positions of clouds. Note that if the weather data is wind speed and direction, the weather image may be an image of a wind turbine or an image of particles. In this case, the direction and speed of the wind can be represented by the manner of rotation of the windmill or the manner of scattering of particles.

The image data synthesizing unit 7 in FIG. 1 synthesizes the generated two-dimensional map image data, two-dimensional weather image data, and imaging data to generate synthetic image data. Further, the image data synthesizing unit 7 causes the display unit 80 to display a synthetic image based on the generated synthetic image data. When the relative positional relationship between the reference point R1 and the lens 41 changes, the size, position or direction of the synthesized image displayed on the display unit 80 changes corresponding to the change.

By visually recognizing the display unit 80, the user recognizes the three-dimensional map image virtually arranged on the reference plane R2, and also recognizes the reference plane R2 so as to be superimposed on each area of the map image on the reference plane R2. and a weather image of the area virtually placed on the sky plane R3. Also, the user can recognize the image of the subject captured by the camera 40 in the area outside the reference plane R2.

4 and 5 are diagrams showing changes in the synthesized image when the position of the lens 41 changes. In the example of FIG. 4, the position of the lens 41 is moved from the position in FIG. 3 to approach the reference point R1, as indicated by the thick dotted arrow. In this case, the user will recognize the map image virtually placed on the reference plane R2 from a position closer to the reference point R1. Therefore, the synthesized image data is updated based on the distance between the reference point R1 and the lens 41. FIG. The enlarged composite image is displayed on the display unit 80 based on the updated composite image data.

In the example of FIG. 4, the Kinki region and the Chubu region in the map image are enlarged and displayed, and the precipitation amount image G1 and the precipitation intensity distribution image G2 corresponding to these regions are also enlarged and displayed. Note that when the distance between the reference point R1 and the lens 41 is smaller than a predetermined value, the sky plane R3 is not included in the field of view of the camera 40, so the cloud distribution image is displayed on the display unit 80 as in the example of FIG. G3 is not displayed.

In the example of FIG. 5, the position of the lens 41 is moved eastward in the map image from the position in FIG. 4, as indicated by the thick dotted arrow. In this case, the user will recognize the map image virtually placed on the reference plane R2 from the east. Therefore, the synthesized image data is updated based on the direction from the lens 41 to the reference point R1 and the distance between the reference point R1 and the lens 41. FIG. Based on the updated composite image data, a composite image corresponding to the region viewed from the east (Chubu region and Kanto region in the example of FIG. 5) is displayed on the display unit 80 .

6 and 7 are diagrams showing changes in the synthesized image when the direction of the lens 41 changes. In the example of FIG. 6, the horizontal angle of the lens 41 is rotated eastward in the map image from the direction of FIG. 5, as indicated by the thick dotted arrow. In this case, the user will perceive the map image virtually placed on the reference plane R2 further eastward. Therefore, the composite image data is updated based on the direction from the lens 41 toward the reference point R1. Based on the updated composite image data, the display unit 80 displays a composite image corresponding to an area viewed further east (the Tohoku region and Hokkaido in the example of FIG. 6).

In the example of FIG. 7, the elevation angle of the lens 41 is rotated downward from the direction of FIG. 5, as indicated by the thick dotted arrow. In this case, the user will recognize the map image virtually placed on the reference plane R2 further downward. Therefore, the composite image data is updated based on the direction from the lens 41 toward the reference point R1. Based on the updated composite image data, the display unit 80 displays a composite image corresponding to an area (Hokkaido in the example of FIG. 7) viewed from below.

(3) Weather Distribution Display Processing FIG. 8 is a flow chart showing an algorithm for weather distribution display processing performed by the weather distribution display program. First, the reference setting unit 1 determines whether or not the focus of the lens 41 is on any subject within the field of view of the camera 40 (step S1). If the lens 41 is not focused on any subject, the reference setting unit 1 waits until the lens 41 is focused on any subject. When the lens 41 is focused on any subject within the field of view of the camera 40, the reference setting unit 1 determines the reference point, reference plane and A sky plane is set (step S2).

Next, the map data acquisition unit 3 acquires three-dimensional map data from the storage unit 60 (step S3). The weather data acquisition unit 5 acquires weather data from the weather server 200 via the communication unit 70 (step S4). Step S4 is interrupt processing for updating the weather data distributed from the weather server 200, and is executed at predetermined time intervals. The predetermined time interval may be, for example, 5 minute intervals or 1 hour intervals. Subsequently, the relative positional relationship calculator 2 calculates the relative positional relationship between the reference point set in step S2 and the lens 41 based on the position and direction of the lens 41 calculated by the position/direction calculator 50 ( step S5).

Thereafter, the map image data generator 4 generates two-dimensional map image data based on the three-dimensional map data obtained in step S3 and the relative positional relationship calculated in step S5 (step S6). Further, the weather image data generator 6 generates two-dimensional weather image data based on the weather data obtained in step S4 and the relative positional relationship calculated in step S5 (step S7). Either of steps S6 and S7 may be performed first, or may be performed simultaneously.

The image data synthesizing unit 7 acquires image data from the camera 40 (step S8). Step S8 may be executed at any time of steps S4 to S7. Further, the image data synthesizing unit 7 synthesizes the map image data generated in step S6, the weather image data generated in step S7, and the imaging data obtained in step S8 to generate synthesized image data (step S9). After that, the image data synthesizing unit 7 causes the display unit 80 to display a synthetic image based on the synthetic image data generated in step S9 (step S10), and returns to step S4.

Steps S4 to S10 are repeated until the user gives an instruction to end the weather distribution display process. As a result, the size, position, or direction of the displayed composite image is updated each time the relative positional relationship between the reference point and the lens 41 changes. Further, by updating the weather data distributed from the weather server 200, the weather image in the composite image is updated. If the execution timing of step S4 is not the weather data acquisition timing, steps S4 and S7 are skipped.

(4) Effect In the weather distribution display device 10 according to the present embodiment, the weather image can be displayed on the display unit 80 of the portable device 100 so as to be superimposed on the map image having a three-dimensional effect. Further, when the relative positional relationship between the reference plane and the lens 41 changes, at least one of the position, size and orientation of the map image and the weather image changes accordingly. Therefore, the user operates the portable device 100 to change the relative positional relationship of the lens 41 with respect to the reference plane, thereby displaying a desired portion of the map image and the weather image in the composite image at a desired angle on the display unit 80. can be made Here, the user intuitively recognizes the position of the lens 41 as the position of the viewpoint, and can easily grasp the position of the viewpoint with respect to the reference plane. Therefore, the user can easily grasp the relative positional relationship between the map image and the viewpoint.

The weather image can be arranged at an appropriate height in the composite image according to the type of weather distribution. For example, the precipitation amount image G1 and the precipitation intensity distribution image G2 are arranged at the same height as the map image, and the cloud distribution image G3 is arranged in the space above the map image. As a result, the user can easily recognize the relationship between each area of the map image and the distribution of precipitation and precipitation intensity corresponding to the area, and can also recognize the distribution of clouds above the map image from a bird's-eye view. can be done.

The type and combination of weather images displayed on the first reference plane and the second reference plane (sky plane) are not particularly limited. Preferably, a weather image corresponding to the weather data of surface wind distribution is displayed. On the other hand, on the second reference plane, it is preferable to display a weather image corresponding to weather data of cloud distribution, upper air temperature distribution, upper air pressure distribution, or upper wind distribution. These displays allow the user to visually recognize the actual weather distribution more easily.

(5) Other Embodiments (a) In the above embodiments, the weather distribution display device 10 is provided in a smart device, but the present invention is not limited to this. The weather distribution display device 10 may be provided in a mobile electronic device such as a personal computer or a game device. Also, the weather distribution display device 10 may not be provided integrally with the portable device 100, but may be provided separately.

(b) In the above embodiment, the reference point, reference plane and sky plane are set based on the position and direction of the lens 41 when the camera 40 is activated, but the present invention is not limited to this. The reference point, reference plane and sky plane may be set at any desired time. For example, the user may set the reference point, the reference plane, and the sky plane by operating specific switches on the mobile device 100 . Also, the reference point, the reference plane and the sky plane may be fixedly set in the physical space regardless of the position and direction of the lens 41 .

(c) In the above embodiment, the position and direction of lens 41 are treated as the position and direction of portable device 100 in order to calculate the relative positional relationship between the reference plane and the portable device, but the present invention is limited to this. not. The position and orientation of a desired portion of mobile device 100 may be treated as the position and orientation of mobile device 100 .

(d) In the above embodiment, the position and direction of portable device 100 based on the direction of gravitational acceleration detected by acceleration sensor 20, the direction of geomagnetism detected by electronic compass 30, and image data generated by camera 40. is calculated, but the present invention is not limited to this. If the mobile device 100 has a positioning system using satellites such as GPS (Global Positioning System), the position or direction of the mobile device 100 may be calculated based on the positioning information acquired by the positioning system. In this case, mobile device 100 may not be provided with acceleration sensor 20 , electronic compass 30 or camera 40 .

(e) In the above embodiment, the map data acquisition section 3 acquires three-dimensional map data, but the present invention is not limited to this. The map data acquisition unit 3 may acquire two-dimensional map data. In this case, a two-dimensional map image is virtually arranged on the reference plane. Also, a two-dimensional weather image instead of a three-dimensional weather image may be virtually arranged on the reference plane.

(f) In the above embodiment, the map image data is generated based on the map data such that at least one of the position, size and orientation of the map image changes according to the change in the relative positional relationship. Further, weather image data is generated based on the weather data such that at least one of the position, size and orientation of the weather image changes according to changes in the relative positional relationship. Synthetic image data is generated by synthesizing the map image data and the weather image data. However, the invention is not limited to the above examples.

For example, without depending on the relative positional relationship, map image data is generated based on the map data, weather image data is generated based on the weather data, and the map image data and the weather image data are synthesized to create a composite image. Data may be generated. In this case, the composite image data is changed such that at least one of the position, size and orientation of the map image and the weather image in the composite image changes according to the change in the relative positional relationship. In addition, as long as the combined image data is generated so that both the map image and the weather image are visually displayed near a specific reference position according to the change in the relative positional relationship, various embodiments are possible. Transformations are possible.

REFERENCE SIGNS LIST 1: reference setting unit 2: relative positional relationship calculation unit 3: map data acquisition unit 4: map image data generation unit 5: weather data acquisition unit 6: weather image data generation unit 7: image data synthesis unit , 10... Weather distribution display device, 20... Acceleration sensor, 30... Electronic compass, 40... Camera, 41... Lens, 42... Optical axis, 50... Position/direction calculation unit, 60... Storage unit, 70... Communication unit, 80... Display unit 100 Portable device 200 Weather server G1 Precipitation image G2 Precipitation intensity distribution image G3 Cloud distribution image R1 Reference point R2 Reference plane R3 Sky plane

Claims (1)

A weather distribution display device for displaying weather distribution on a display unit of a portable device,
a reference setting unit that virtually sets a fixed reference plane and a reference point in the real space;
a map data acquisition unit that acquires map data representing a map;
a weather data acquisition unit that acquires weather data indicating weather distribution;
a camera integrated with the portable device ;
a detector that detects the imaging direction of the camera;
a relative positional relationship calculator that calculates a relative positional relationship between the reference point and the portable device;
Two-dimensional map image data representing a map image having a three-dimensional effect is generated based on the map data, and a weather image having a three-dimensional effect corresponding to the weather distribution is superimposed on the map image based on the weather data. an image data generation unit that generates two-dimensional weather image data,
The reference setting unit virtually sets a first reference plane that is fixed in the physical space, sets the reference point on the first reference plane, and places the map image on the first reference plane. placed virtually,
The relative positional relationship calculation unit calculates the distance from the camera to the reference point based on sequentially acquired image data indicating a focused image of a subject obtained by the camera and the imaging direction detected by the detector. calculating the direction toward and the distance between the reference point and the camera as the relative positional relationship;
The image data generation unit generates composite image data by combining the map image data and the weather image data, causes the display unit to display a composite image based on the generated composite image data, and displays the relative image data. changing the map image data and the weather image data so that at least one of the position, size and orientation of the map image and the weather image changes according to a change in positional relationship ; generating the map image data representing a map image that is recognizable when the map image virtually arranged on the reference plane is viewed from the position of the portable device, based on the relative positional relationship and the map data; Also, the weather image that is virtually placed on the reference plane so as to be superimposed on the virtual map image on the reference plane shows a recognizable weather image when viewed from the position of the portable device. A weather distribution display device that generates image data based on the relative positional relationship and the weather data.

Images