JP2019045325A - Weather distribution display device, weather distribution display method and weather distribution display program - Google Patents

Abstract

To provide a weather distribution display device, a weather distribution display method and a weather distribution display program capable of displaying an image of weather distribution on a map in a three-dimensional manner, and allowing a user to easily grasp relative position relationship between a map and a view point.SOLUTION: A reference position which is fixed to a real space is virtually set, and relative position relationship between a reference position and a portable device 100 is calculated. Map data indicating a map is acquired, then two-dimensional map image data indicating a map image having a three-dimensional feeling is generated based on the map data. Weather data indicating weather distribution is acquired, then two-dimensional weather image data which indicates a weather image and has a three-dimensional feeling and which is superposed to the map image and corresponds to the weather distribution, is generated based on the weather data. Then a combined image based on combined image data formed by combining the map image data and the weather image data is displayed on a display part 80. According to change of the relative position relationship, at least ones of positions, sizes and directions of the map image and weather image are changed.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a meteorological distribution display device for displaying meteorological distribution, a meteorological distribution display method, and a meteorological distribution display program.

  Currently, distribution of weather information is performed by information distribution media such as television broadcasting or the Internet. In such a distribution, the meteorological distribution is mainly superimposed and displayed on a planar map. For example, in Non-Patent Document 1, the distribution of precipitation is displayed superimposed on a two-dimensional map showing the Japanese Archipelago and its surrounding area. Also, for example, in Non-Patent Document 2, the distribution of clouds observed by geostationary meteorological satellites is displayed superimposed on a two-dimensional map showing the Japanese Archipelago and its surrounding area. Further, Non-Patent Document 3 introduces visualization software for three-dimensionally visualizing various data such as map information.

Japan Meteorological Agency, "Radar · Nowcast (rainfall · thunder · tornado): Nationwide", [online], [August 15, 2017 search], Internet <URL: http://www.jma.go.jp/jp / radnowc /> Meteorological Agency, "weather satellite", [online], [August 15, 2017 search], Internet <URL: http://www.jma.go.jp/jp/gms/> Cybernet Systems Co., Ltd., "general-purpose visualization software AVS", [online], [August 15, 2017 search], Internet <URL: http://www.cybernet.co.jp/avs/products/>

  According to the visualization software introduced in Non-Patent Document 3, it is possible to display an image of a three-dimensionally visualized object on the screen of the display device. In addition, in such visualization software, it is possible to display an image according to the position of the viewpoint by changing the position of the viewpoint that looks at the object with the mouse. However, it is difficult for the user to grasp the relative positional relationship between the object and the viewpoint from the image displayed on the screen.

  An object of the present invention is a weather distribution display device capable of three-dimensionally displaying an image of weather distribution on a map and allowing a user to easily grasp the relative positional relationship between the map and the viewpoint. A weather distribution display method and a weather distribution display program are provided.

  (1) The weather distribution display device according to the first aspect of the present invention is a weather distribution display device for displaying the weather distribution on the display unit of the portable device, and a reference setting for virtually setting a fixed reference position in real space , A map data acquisition unit that acquires map data that indicates a map, a weather data acquisition unit that acquires weather data that indicates a weather distribution, and a relative positional relationship calculation unit that calculates a relative positional relationship between a reference position and a mobile device And generates a two-dimensional map image data indicating a map image having a three-dimensional effect based on the map data, and indicates a meteorological image superimposed on the map image based on the meteorological data and having a three-dimensional effect corresponding to the weather distribution. An image data generation unit that generates two-dimensional weather image data, and the image data generation unit generates synthetic image data by synthesizing the map image data and the weather image data; While displaying a composite image based on the generated composite image data on the display unit, map image data such that at least one of the position, size, and orientation of the map image and the weather image changes according to the change in relative positional relationship. And change the weather image data.

  In this weather distribution display device, a fixed reference position is virtually set in the real space, and the relative positional relationship between the reference position and the portable device is calculated. Map data representing a map is acquired, and two-dimensional map image data representing a map image having a three-dimensional effect is generated based on the map data. In addition, meteorological data indicating a meteorological distribution is acquired, and two-dimensional meteorological image data indicating a meteorological image superimposed on the map image and having a stereoscopic effect corresponding to the meteorological distribution is generated based on the meteorological data. By combining the map image data and the weather image data, composite image data is generated, and a composite image based on the generated composite image data is displayed on the display unit.

  According to this configuration, the weather image can be displayed on the display unit of the portable device so as to be superimposed on the map image having a three-dimensional effect. In addition, when the relative positional relationship between the reference position and the portable device changes, at least one of the position, the size, and the direction of the map image and the weather image changes in accordance with the change. Therefore, the user operates the portable device to change the relative positional relationship of the portable device with respect to the reference position, thereby causing the display unit to display the desired portion of the map image and the weather image in the composite image at a desired angle. Can. Here, the user can intuitively recognize the position of the portable device as the position of the viewpoint and can easily grasp the position of the viewpoint with respect to the reference position. Therefore, while displaying the image of the weather distribution on a map three-dimensionally, it becomes possible to make a user grasp | ascertain the relative positional relationship of a map image and a viewpoint easily.

  (2) The image data generation unit generates map image data representing a map image that can be recognized when the map image virtually arranged at the reference position is visually recognized from the position of the portable device as the relative positional relationship and the map data. A weather image that is generated based on the weather image that can be recognized when the weather image virtually arranged at the reference position so as to be superimposed on the virtual map image at the reference position is visually recognized from the position of the portable device Data may be generated based on relative position and weather data. In this case, it is possible to easily generate map image data indicating a map image having a three-dimensional effect and weather image data indicating a meteorological image having a three-dimensional effect.

  (3) The reference setting unit virtually sets a fixed first reference plane in the real space as a reference position, the map image is virtually arranged on the first reference plane, and the relative positional relationship calculation unit The relative positional relationship between the predetermined reference point on the first reference plane and the position of the portable device may be calculated. In this case, the weather image is displayed at the same height as the map image in the composite image. Thereby, the user can easily recognize the relationship between each area of the map image and the weather image corresponding to the area.

  (4) The weather data acquired by the weather data acquisition unit indicates the first and second weather distributions of different types, and the reference setting unit is fixed to the real space and has a predetermined position with the first reference plane. A virtual second reference plane having a relationship is further set, and the image data generation unit is configured to generate a first weather distribution virtually arranged on the first reference plane so as to be superimposed on the virtual map image. Weather that can be recognized when a second weather image corresponding to a first weather image corresponding to and a second weather image corresponding to a second weather distribution virtually arranged on a second reference plane are viewed from the position of the portable device Weather image data representing an image may be generated based on the relative positional relationship and the weather data.

  In this case, the first weather image and the second weather image can be displayed at different heights in the composite image according to the type of weather distribution. Also, since the first weather image is displayed at the same height as the map image, the user can easily recognize the relationship between each area of the map image and the first weather image corresponding to the area. Can.

  (5) The weather data acquisition unit acquires weather data acquisition at predetermined time intervals, and the image data generation unit updates the weather image data generated each time weather data is acquired by the weather data acquisition unit. It is also good. In this case, it is possible to update the weather image in the composite image following the change of the weather data with the passage of time.

  (6) The portable device includes a camera and a detector that detects an imaging direction of the camera, and the relative positional relationship calculation unit calculates the camera based on imaging data obtained by the camera and an imaging direction detected by the detector. The direction from the position to the reference position and the distance between the reference position and the camera may be calculated as a relative positional relationship. In this case, the relative positional relationship between the reference position and the portable device can be easily calculated.

  (7) The relative positional relationship calculation unit may calculate the relative positional relationship with the position of the camera as the position of the mobile device. In this case, the position of the mobile device can be calculated more easily based on the imaging data. Also, the user can intuitively recognize the position of the camera as the position of the viewpoint, and can more easily grasp the position of the viewpoint with respect to the reference position.

  (8) The detector includes an acceleration sensor that detects the direction of gravity, and an electronic compass that detects the direction of geomagnetism. The relative positional relationship calculation unit calculates the reference position from the camera based on the detection results of the acceleration sensor and the electronic compass. The direction towards may be calculated. In this case, the camera direction can be easily detected in two directions orthogonal to each other. Thereby, the direction from the camera to the reference position can be easily calculated.

  (9) The reference setting unit may set, as the reference position, a virtual position having a predetermined positional relationship with the portable device at a predetermined time. In this case, the reference position can be easily set.

  (10) The weather data may include a spatial distribution regarding the weather. In this case, the user can recognize the spatial distribution related to the weather by visually recognizing the composite image.

  (11) A weather distribution display method according to a second aspect of the present invention is a weather distribution display method for displaying a weather distribution on a display unit of a portable device, and virtually setting a fixed reference position in a real space; , Obtaining map data indicating a map, obtaining weather data indicating a weather distribution, calculating a relative positional relationship between a reference position and a portable device, and a map having a three-dimensional effect based on the map data Generating two-dimensional map image data representing an image; generating two-dimensional meteorological image data representing a meteorological image superimposed on the map image based on the meteorological data and having a stereoscopic effect corresponding to the meteorological distribution Generating synthetic image data by synthesizing map image data and meteorological image data, and displaying a synthetic image based on the generated synthetic image data Displaying the composite image on the display unit including changing the position of the map image and the weather image so that at least one of the position, the size, and the direction of the map image changes. Including changing image data and weather image data.

  According to this configuration, the user operates the portable device to change the relative positional relationship of the portable device to the reference position, thereby displaying the desired portion of the map image and the weather image in the composite image at the desired angle. Can be displayed. The user can intuitively recognize the position of the portable device as the position of the viewpoint and can easily grasp the position of the viewpoint with respect to the reference position. Therefore, while displaying the image of the weather distribution on a map three-dimensionally, it becomes possible to make a user grasp | ascertain the relative positional relationship of a map image and a viewpoint easily.

  (12) A weather distribution display program according to the third aspect of the present invention is a weather distribution display program capable of executing display of weather distribution on the display unit of the portable device by the processing device, wherein the reference position fixed in the real space is fixed. Processing for virtually setting processing, processing for acquiring map data indicating a map, processing for acquiring weather data indicating a meteorological distribution, processing for calculating a relative positional relationship between a reference position and a portable device, map data A process of generating two-dimensional map image data showing a map image having a three-dimensional effect, and a two-dimensional weather showing a meteorological image superimposed on the map image based on meteorological data and having a three-dimensional effect corresponding to the weather distribution A process of generating image data, a process of generating composite image data by combining map image data and weather image data, and a composite image based on the generated composite image data The processing for causing the processing unit to execute the processing for displaying on the display unit and the processing for displaying the composite image on the display unit includes at least the position, size, and orientation of the map image and the weather image according to the change in relative positional relationship. Changing the map image data and the weather image data to change one.

  According to this configuration, the user operates the portable device to change the relative positional relationship of the portable device to the reference position, thereby displaying the desired portion of the map image and the weather image in the composite image at the desired angle. Can be displayed. The user can intuitively recognize the position of the portable device as the position of the viewpoint and can easily grasp the position of the viewpoint with respect to the reference position. Therefore, while displaying the image of the weather distribution on a map three-dimensionally, it becomes possible to make a user grasp | ascertain the relative positional relationship of a map image and a viewpoint easily.

  According to the present invention, the image of the weather distribution on the map can be displayed three-dimensionally, and the user can easily grasp the relative positional relationship between the map and the viewpoint.

It is a block diagram showing composition of a portable device containing a weather distribution display concerning an embodiment of the invention. It is a figure which shows an example of the setting method of a reference plane. It is a figure which shows an example of a display of a synthesized image. It is a figure which shows the change of a synthesized image when the position of a lens changes. It is a figure which shows the change of a synthesized image when the position of a lens changes. It is a figure which shows the change of a synthesized image when the direction of a lens changes. It is a figure which shows the change of a synthesized image when the direction of a lens changes. It is a flowchart which shows the algorithm of the weather distribution display process performed by a weather distribution display program.

  Hereinafter, a weather distribution display device, a weather distribution display method, and a weather distribution display program according to an embodiment of the present invention will be described in detail with reference to the drawings.

(1) Configuration of Mobile Device FIG. 1 is a block diagram showing a configuration of a mobile device including a weather distribution display device according to an embodiment of the present invention. The portable device 100 is, for example, a movable smart device such as a portable terminal, and is configured to be communicable with a weather server 200 that distributes weather data indicating a weather distribution. The meteorological data is data in which weather such as rain, snow, clouds, thunder, wind, waves, air temperature or atmospheric pressure is associated with a place, and is obtained by observation or prediction. In the present embodiment, the meteorological data is an observation value of precipitation, a distribution of precipitation intensity observed by a meteorological radar, and a distribution of clouds observed by a meteorological satellite.

  The weather data may be a predicted value of precipitation, a predicted rainfall intensity distribution or a predicted cloud distribution. Alternatively, meteorological data may be snowfall amount, wind direction wind speed, air temperature, ground air temperature distribution, high air temperature distribution, ground air pressure distribution, high air pressure distribution, ground air distribution, high air wind distribution (including vertical component), lightning probability distribution, tornado It may be an observed value or a forecasted value such as occurrence probability distribution, weather distribution of estimated weather, seismic intensity of seismic observation point or tsunami height of tsunami observation point. In addition, it is possible to associate data about earthquakes with places. Therefore, in the present embodiment, the weather data may include data on earthquakes.

  The portable device 100 includes a weather distribution display device 10, an acceleration sensor 20, an electronic compass 30, a camera 40, a position / direction calculation unit 50, a storage unit 60, a communication unit 70, and a display unit 80. The portable device 100 also includes a CPU (central processing unit), a RAM (random access memory), a ROM (read only memory), and a storage device (not shown). A system program, a position and direction calculation program, and a weather distribution display program are stored in the ROM or the storage device.

  The acceleration sensor 20 detects the direction of the gravitational acceleration of the earth. The electronic compass 30 detects the direction of geomagnetism. The camera 40 has a lens 41, and picks up an arbitrary subject through the lens 41 to generate imaging data indicating an image of the subject. The acceleration sensor 20 and the electronic compass 30 are examples of a detector that detects the imaging direction of the camera 40.

  The function of the position / direction calculation unit 50 is realized by the CPU of the mobile device 100 executing a position / direction calculation program on the RAM. The position / direction calculation unit 50 sequentially calculates the relative position of the lens 41 with respect to the subject at predetermined time intervals based on the imaging data generated by the camera 40. Further, based on the direction of gravitational acceleration detected by the acceleration sensor 20 and the direction of geomagnetism detected by the electronic compass 30, the position / direction calculation unit 50 determines the direction of the optical axis of the lens 41 (hereinafter simply referred to as the direction of the lens 41 Is sequentially calculated at predetermined time intervals.

  Here, the direction of the lens 41 is represented by the elevation angle and the horizontal angle of the lens 41. The elevation angle of the lens 41 is defined as, for example, an angle formed by the optical axis of the lens 41 with respect to a plane (horizontal plane) orthogonal to the direction of the gravitational acceleration detected by the acceleration sensor 20. The horizontal angle of the lens 41 is defined, for example, as an angle formed by the optical axis of the lens 41 with respect to the direction of the geomagnetism (North-South direction) detected by the electronic compass 30 in a horizontal plane.

  The storage unit 60 is configured by the above-described RAM, ROM, and storage device. The storage unit 60 stores three-dimensional map data indicating a map. The map data indicates, for example, the Japanese archipelago and its surrounding area. The communication unit 70 is configured to be able to wirelessly communicate with the weather server 200. The display unit 80 includes, for example, a touch panel display, and displays various images.

  The weather distribution display device 10 includes a reference setting unit 1, a relative positional relationship calculation unit 2, a map data acquisition unit 3, a map image data generation unit 4, a weather data acquisition unit 5, a weather image data generation unit 6 and an image data synthesis unit 7. including. The CPU of the mobile device 100 executes the weather distribution display program stored in the ROM or the storage device to realize the functions of the components (1 to 7) of the weather distribution display device 10. Some or all of the components (1 to 7) of the weather distribution display device 10 may be configured by hardware such as an electronic circuit.

  The reference setting unit 1 virtually sets a fixed reference position in the real space as an initial operation. In the present embodiment, the reference setting unit 1 sets a virtual reference plane as a reference position in the real space in the field of view of the camera 40. A reference point is set at a predetermined point (for example, a center point) on the reference plane. Specifically, the reference plane is set based on the position and direction of the lens 41 when the camera 40 is activated and any subject within the field of view of the camera 40 is in focus. After the reference plane is set, the position of the reference plane does not change even if the position or the direction of the lens 41 changes. Details of the method of setting the reference plane will be described later.

  The relative positional relationship calculation unit 2 calculates the relative positional relationship between the reference point of the reference plane set by the reference setting unit 1 and the lens 41 based on the position and direction of the lens 41 calculated by the position / direction calculation unit 50. Do. The relative positional relationship between the reference point and the lens 41 includes the direction from the lens 41 to the reference point and the distance between the reference point and the lens 41.

  The map data acquisition unit 3 acquires three-dimensional map data from the storage unit 60. When the weather server 200 distributes map data, the map data acquisition unit 3 may acquire map data from the weather server 200 via the communication unit 70.

  Here, a three-dimensional map image is virtually arranged on the reference plane set by the reference setting unit 1. Based on the three-dimensional map data acquired by the map data acquisition unit 3 and the relative positional relationship calculated by the relative positional relationship calculation unit 2, the map image data generation unit 4 determines the camera 40 from the current position of the lens 41. Two-dimensional map image data representing a two-dimensional map image obtained by capturing a virtual three-dimensional map image is sequentially generated at predetermined time intervals. Here, the two-dimensional map image is an image having a three-dimensional effect.

  The weather data acquisition unit 5 acquires weather data from the weather server 200 via the communication unit 70. Here, a virtual three-dimensional meteorological image visually indicating the meteorological distribution is defined based on meteorological data, and a reference is made so that the three-dimensional meteorological image is superimposed on the virtual three-dimensional map image of the reference plane. Virtually arranged on a plane. The weather image data generation unit 6 virtually detects the camera 40 from the current position of the lens 41 based on the weather data acquired by the weather data acquisition unit 5 and the relative positional relationship calculated by the relative positional relationship calculation unit 2. Two-dimensional weather image data representing a two-dimensional weather image obtained by capturing a three-dimensional weather image is sequentially generated at predetermined time intervals. Here, the two-dimensional weather image is an image having a three-dimensional effect.

  The image data synthesis unit 7 generates two-dimensional map image data generated by the map image data generation unit 4, two-dimensional weather image data generated by the weather image data generation unit 6, and imaging data generated by the camera 40. Composite image data is generated by combining. Further, the image data combining unit 7 causes the display unit 80 to display a combined image based on the combined image data that has been combined. The size, position and orientation of the map and the weather image in the composite image to be displayed change depending on the position and orientation of the lens 41. Thus, the map image data generation unit 4, the weather image data generation unit 6, and the image data combining unit 7 are examples of the image data generation unit.

(2) Display of Composite Image FIG. 2 is a diagram showing an example of a method of setting a reference plane. After activation of the camera 40, as shown in FIG. 2, the reference setting unit 1 of FIG. 1 sets a virtual point separated from the lens 41 in the direction of the optical axis 42 by 600 mm as the reference point R1. Further, the reference setting unit 1 sets an 800 mm × 800 mm virtual plane parallel to the horizontal plane including the reference point R1 as a reference plane R2. Further, the reference setting unit 1 sets a virtual plane of 800 mm × 800 mm parallel to the horizontal plane as the sky plane R3 at a predetermined height from the reference plane R2. The reference plane R2 and the sky plane R3 are examples of the first and second reference planes, respectively.

  FIG. 3 is a view showing an example of display of a composite image. As shown in FIG. 3, a three-dimensional map image is virtually arranged on the reference plane R2. The map image data generation unit 4 of FIG. 1 shows a two-dimensional map image obtained by capturing a virtual three-dimensional map image in which the camera 40 is disposed on the reference plane R2 from the position of the lens 41 at the current time. Generate two-dimensional map image data. In the example of FIG. 3, the lens 41 is located at the south upper side of the map image. Further, since the distance between the lens 41 and the reference plane R2 is relatively large, the entire map image is included in the field of view of the camera 40. Therefore, two-dimensional map data indicating a two-dimensional map image obtained by imaging the entire three-dimensional map image from the south upper side is generated.

  Further, in the example of FIG. 3, as a three-dimensional meteorological image, an image showing the distribution of precipitation and precipitation intensity is virtually arranged on the reference plane R2, and an image showing the distribution of clouds is virtually on the upper plane R3. It is arranged. The weather image data generation unit 6 of FIG. 1 obtains a two-dimensional weather image obtained by imaging a virtual weather image arranged on the reference plane R2 and the sky plane R3 from the position of the lens 41 at the current time. Generate two-dimensional weather image data as shown.

  The generated meteorological image data includes a precipitation image G1 indicating the amount of precipitation, a precipitation intensity distribution image G2 indicating the distribution of precipitation intensity, and a cloud distribution image G3 indicating the distribution of clouds. The precipitation image G1 is an image constituted by one or more cylinders, and indicates the amount of precipitation by the height and color of the cylinders. The precipitation intensity distribution image G2 is an image of an area (polygon) indicating an area having a predetermined precipitation intensity. The cloud distribution image G3 is an image of a polygon indicating the position of the cloud. When the weather data is the wind direction and the wind speed, the weather image may be an image of a windmill or an image of particles. In this case, the wind direction can be expressed by the rotation aspect of the wind turbine or the scattering aspect of the particles.

  The image data combining unit 7 of FIG. 1 generates combined image data by combining the generated two-dimensional map image data, the two-dimensional weather image data, and the imaging data. Further, the image data combining unit 7 causes the display unit 80 to display a combined image based on the generated combined image data. When the relative positional relationship between the reference point R1 and the lens 41 changes, the size, position, or direction of the composite image displayed on the display unit 80 changes to correspond to the change.

  The user recognizes the three-dimensional map image virtually arranged on the reference plane R2 by visually recognizing the display unit 80, and the reference plane R2 is superimposed on each area of the map image of the reference plane R2. And the weather image of the said area virtually arrange | positioned in sky top R3 can be recognized. In addition, the user can recognize the image of the subject captured by the camera 40 in an area outside the reference plane R2.

  FIG. 4 and FIG. 5 are diagrams showing the change of the composite image when the position of the lens 41 is changed. In the example of FIG. 4, as shown by the thick dotted arrow, the position of the lens 41 is moved from the position in FIG. 3 so as to approach the reference point R1. In this case, the user recognizes the map image virtually arranged on the reference plane R2 from a position closer to the reference point R1. Therefore, the composite image data is updated based on the distance between the reference point R1 and the lens 41. The enlarged composite image is displayed on the display unit 80 based on the updated composite image data.

  In the example of FIG. 4, the Kinki region and the Chubu region in the map image are displayed enlarged, and the precipitation image G1 and the precipitation intensity distribution image G2 corresponding to these regions are displayed enlarged. When the distance between the reference point R1 and the lens 41 is smaller than a predetermined value, the sky plane R3 is not included in the field of view of the camera 40, and as shown in FIG. G3 is not displayed.

  In the example of FIG. 5, the position of the lens 41 is moved from the position in FIG. 4 to the east in the map image, as indicated by the thick dotted arrow. In this case, the user recognizes the map image virtually arranged on the reference plane R2 from the east. Therefore, the composite image data is updated based on the direction from the lens 41 toward the reference point R1 and the distance between the reference point R1 and the lens 41. Based on the updated composite image data, a composite image corresponding to the area viewed from the east (the Chubu region and the Kanto region in the example of FIG. 5) is displayed on the display unit 80.

  6 and 7 are diagrams showing changes in the composite image when the direction of the lens 41 changes. In the example of FIG. 6, as indicated by the thick dotted arrow, the horizontal angle of the lens 41 is rotated from the direction of FIG. 5 to the east in the map image. In this case, the user recognizes the map image virtually arranged on the reference plane R2 more to the east. Therefore, the composite image data is updated based on the direction from the lens 41 toward the reference point R1. Based on the updated composite image data, a composite image corresponding to a region seen to the east (in the example of FIG. 6, the Tohoku region and Hokkaido) is displayed on the display unit 80.

  In the example of FIG. 7, the elevation angle of the lens 41 is rotated downward from the direction of FIG. 5, as indicated by the thick dotted arrow. In this case, the user recognizes the map image virtually arranged on the reference plane R2 lower. Therefore, the composite image data is updated based on the direction from the lens 41 toward the reference point R1. Based on the updated composite image data, a composite image corresponding to the area (Hokkaido in the example of FIG. 7) viewed further downward is displayed on the display unit 80.

(3) Weather Distribution Display Process FIG. 8 is a flowchart showing an algorithm of the weather distribution display process performed by the weather distribution display program. First, the reference setting unit 1 determines whether the focal point of the lens 41 matches any subject within the field of view of the camera 40 (step S1). If the focus of the lens 41 does not match any subject, the reference setting unit 1 stands by until the focus of the lens 41 matches any subject. When the focal point of the lens 41 matches any subject within the field of view of the camera 40, the reference setting unit 1 determines the reference point, the reference plane, and the reference plane based on the position and direction of the lens 41 calculated by the position / direction calculation unit 50. An upper sky plane is set (step S2).

  Next, the map data acquisition unit 3 acquires three-dimensional map data from the storage unit 60 (step S3). The weather data acquisition unit 5 acquires weather data from the weather server 200 via the communication unit 70 (step S4). Step S4 is an interrupt process for updating the weather data distributed from the weather server 200, and is executed at predetermined time intervals. The predetermined time interval may be, for example, 5 minutes or 1 hour. Subsequently, the relative positional relationship calculation unit 2 calculates the relative positional relationship between the reference point set in step S2 and the lens 41 based on the position and direction of the lens 41 calculated by the position / direction calculation unit 50 ( Step S5).

  Thereafter, the map image data generation unit 4 generates two-dimensional map image data based on the three-dimensional map data acquired in step S3 and the relative positional relationship calculated in step S5 (step S6). Further, the weather image data generation unit 6 generates two-dimensional weather image data based on the weather data acquired in step S4 and the relative positional relationship calculated in step S5 (step S7). Either step S6 or S7 may be performed first or may be performed simultaneously.

  The image data combining unit 7 acquires imaging data from the camera 40 (step S8). Step S8 may be performed at any time of steps S4 to S7. In addition, the image data combining unit 7 generates combined image data by combining the map image data generated in step S6, the weather image data generated in step S7, and the imaging data acquired in step S8 (step S9). Thereafter, the image data combining unit 7 causes the display unit 80 to display a combined image based on the combined image data generated in step S9 (step S10), and returns to step S4.

  Steps S4 to S10 are repeated until the user instructs to end the weather distribution display process. Thus, the size, position or direction of the composite image displayed is updated each time the relative positional relationship between the reference point and the lens 41 changes. Further, by updating the weather data distributed from the weather server 200, the weather image in the composite image is updated. If the execution timing of step S4 is not the acquisition timing of the weather data, steps S4 and S7 are skipped.

(4) Effects In the weather distribution display device 10 according to the present embodiment, the weather image can be displayed on the display unit 80 of the portable device 100 so as to be superimposed on the map image having a three-dimensional effect. In addition, when the relative positional relationship between the reference plane and the lens 41 changes, at least one of the position, the size, and the direction of the map image and the weather image changes according to the change. Therefore, the user operates the portable device 100 to change the relative positional relationship of the lens 41 with respect to the reference plane, thereby displaying on the display 80 the desired portions of the map image and the weather image in the composite image. It can be done. Here, the user can intuitively recognize the position of the lens 41 as the position of the viewpoint and can easily grasp the position of the viewpoint with respect to the reference plane. Therefore, the user can easily grasp the relative positional relationship between the map image and the viewpoint.

  The weather image can be placed at an appropriate height in the composite image according to the type of weather distribution. For example, the precipitation image G1 and the precipitation intensity distribution image G2 are disposed at the same height as the map image, and the cloud distribution image G3 is disposed in the space above the map image. Thus, the user can easily recognize the relationship between each area of the map image and the distribution of precipitation and rainfall intensity corresponding to the area, and also comprehensively recognize the distribution of clouds above the map image. Can.

  There are no particular limitations on the type and combination of weather images displayed on the first reference plane and the second reference plane (upper sky plane), but on the first reference plane, precipitation intensity distribution, surface temperature distribution, surface pressure distribution or surface pressure distribution Preferably, a weather image corresponding to the weather data of the ground wind distribution is displayed. On the other hand, it is preferable that a weather image corresponding to the weather data of cloud distribution, upper air temperature distribution, upper air pressure distribution, or upper air distribution is displayed on the second reference plane. According to these displays, the user can more easily view the actual weather distribution.

(5) Other Embodiments (a) In the above embodiments, the weather distribution display device 10 is provided in a smart device, but the present invention is not limited to this. The weather distribution display device 10 may be provided in a movable electronic device such as a personal computer or a game device. Also, the weather distribution display device 10 may not be provided integrally with the portable device 100, but may be provided separately.

  (B) In the above embodiment, the reference point, the reference plane and the sky plane are set based on the position and the direction of the lens 41 when the camera 40 is activated, but the present invention is not limited to this. The reference points, reference planes and sky planes may be set at desired times. For example, the reference point, the reference plane and the sky plane may be set by the user operating a specific switch of the portable device 100. Also, the reference point, the reference plane and the sky plane may be fixedly set in the real space regardless of the position and the direction of the lens 41.

  (C) In the above embodiment, the position and the direction of the lens 41 are treated as the position and the direction of the portable device 100 in order to calculate the relative positional relationship between the reference plane and the portable device, but the present invention is limited thereto I will not. The position and orientation of the desired portion of the portable device 100 may be treated as the position and orientation of the portable device 100.

  (D) In the above embodiment, the position and the direction of the portable device 100 based on the direction of gravitational acceleration detected by the acceleration sensor 20, the direction of geomagnetism detected by the electronic compass 30, and imaging data generated by the camera 40. Is calculated, but the present invention is not limited thereto. When the mobile device 100 has a positioning system using satellites such as GPS (Global Positioning System), the position or direction of the mobile device 100 may be calculated based on the positioning information acquired by the positioning system. In this case, the acceleration sensor 20, the electronic compass 30, or the camera 40 may not be provided in the portable device 100.

  (E) In the above embodiment, the map data acquisition unit 3 acquires three-dimensional map data, but the present invention is not limited to this. The map data acquisition unit 3 may acquire two-dimensional map data. In this case, a two-dimensional map image is virtually arranged on the reference plane. In addition, two-dimensional weather images may be virtually arranged on the reference plane instead of three-dimensional.

  (F) In the above embodiment, the map image data is generated based on the map data so that at least one of the position, the size, and the direction of the map image changes according to the change of the relative positional relationship. Further, the weather image data is generated based on the weather data so that at least one of the position, the size, and the direction of the weather image changes according to the change of the relative positional relationship. Composite image data is generated by combining the map image data and the weather image data. However, the present invention is not limited to the above example.

  For example, map image data is generated based on map data without depending on relative positional relationship, weather image data is generated based on weather data, and a composite image is generated by combining the map image data and the weather image data. Data may be generated. In this case, the composite image data is changed such that at least one of the position, size, and orientation of the map image and the weather image in the composite image changes in accordance with the change in the relative positional relationship. Further, according to various embodiments, as long as composite image data is generated so that both the map image and the weather image are visually displayed and displayed near a specific reference position according to a change in relative positional relationship, It is possible to make a transformation.

  DESCRIPTION OF SYMBOLS 1 ... standard setting part, 2 ... relative position relation calculation part, 3 ... map data acquisition part, 4 ... map image data generation part, 5 ... weather data acquisition part, 6 ... weather image data generation part, 7 ... image data synthesis part , 10 ... Weather distribution display device, 20 ... Acceleration sensor, 30 ... Electronic compass, 40 ... Camera, 41 ... Lens, 42 ... Optical axis, 50 ... Position / direction calculation unit, 60 ... Storage unit, 70 ... Communication unit, 80 ... Display unit, 100: Portable device, 200: Weather server, G1: Precipitation image, G2: Precipitation intensity distribution image, G3: Cloud distribution image, R1: Reference point, R2: Reference plane, R3: Sky plane

Claims (12)

A weather distribution display device for displaying weather distribution on a display unit of a portable device,
A reference setting unit for virtually setting a fixed reference position in the real space;
A map data acquisition unit that acquires map data indicating a map;
A meteorological data acquisition unit that acquires meteorological data indicating a meteorological distribution;
A relative positional relationship calculation unit that calculates a relative positional relationship between the reference position and the portable device;
A two-dimensional map image data showing a map image having a three-dimensional effect is generated based on the map data, and a meteorological image superimposed on the map image based on the meteorological data and having a three-dimensional effect corresponding to the weather distribution is shown. An image data generation unit for generating two-dimensional weather image data;
The image data generation unit generates composite image data by combining the map image data and the weather image data, and causes the display unit to display a composite image based on the generated composite image data, and the relative A weather distribution display device, wherein the map image data and the weather image data are changed such that at least one of a position, a size and an orientation of the map image and the weather image changes according to a change in positional relationship. The image data generation unit may be configured to generate the map image data representing a map image that can be recognized when the map image virtually arranged at the reference position is visually recognized from the position of the portable device, the relative positional relationship and the map data. While generating based on map data, it can be recognized when a weather image virtually arranged at the reference position so as to be superimposed on the virtual map image of the reference position is visually recognized from the position of the portable device The weather distribution display device according to claim 1, wherein the weather image data indicating a weather image is generated based on the relative positional relationship and the weather data. The reference setting unit virtually sets a fixed first reference plane in the real space as the reference position,
The map image is virtually arranged on the first reference plane,
The weather distribution display device according to claim 2, wherein the relative positional relationship calculation unit calculates the relative positional relationship between a predetermined reference point on the first reference plane and the position of the portable device. The meteorological data acquired by the meteorological data acquisition unit indicates first and second meteorological distributions of different types.
The reference setting unit further sets a virtual second reference plane fixed to the real space and having a predetermined positional relationship with the first reference plane,
The image data generation unit is configured to generate a first weather image and a second reference corresponding to a first weather distribution virtually arranged on the first reference plane so as to be superimposed on a virtual map image. The relative position of the meteorological image data indicating a meteorological image that can be recognized when a second meteorological image corresponding to a second meteorological distribution virtually arranged on a plane is viewed from the position of the portable device The weather distribution display device according to claim 3, wherein the weather distribution display device is generated based on a relationship and the weather data. The meteorological data acquisition unit acquires the meteorological data acquisition at predetermined time intervals,
The weather distribution display device according to any one of claims 1 to 4, wherein the image data generation unit updates the weather image data generated each time the weather data acquisition unit acquires the weather data. . The portable device includes a camera and a detector for detecting an imaging direction of the camera,
The relative positional relationship calculation unit calculates a direction from the camera toward the reference position and a distance between the reference position and the camera based on imaging data obtained by the camera and an imaging direction detected by the detector. The weather distribution display device according to claim 1, wherein the relative positional relationship is calculated. The weather distribution display device according to claim 6, wherein the relative positional relationship calculation unit calculates the relative positional relationship by using the position of the camera as the position of the portable device. The detector includes an acceleration sensor that detects a gravity direction, and an electronic compass that detects a geomagnetic direction.
The weather distribution display device according to claim 5, wherein the relative positional relationship calculation unit calculates a direction from the camera toward the reference position based on detection results of the acceleration sensor and the electronic compass. The weather distribution display according to any one of claims 1 to 8, wherein the reference setting unit sets, as the reference position, a virtual position having a predetermined positional relationship with respect to the portable device at a predetermined time. apparatus. The weather distribution display device according to any one of claims 1 to 9, wherein the weather data includes a spatial distribution related to the weather. A weather distribution display method for displaying weather distribution on a display unit of a portable device, comprising:
Virtually setting a fixed reference position in the real space;
Obtaining map data indicating a map;
Acquiring meteorological data indicative of meteorological distribution;
Calculating a relative positional relationship between the reference position and the portable device;
Generating two-dimensional map image data indicating a map image having a three-dimensional effect based on the map data;
Generating two-dimensional weather image data indicating a weather image superimposed on the map image and having a three-dimensional effect corresponding to the weather distribution based on the weather data;
Generating composite image data by combining the map image data and the weather image data;
Displaying a composite image based on the generated composite image data on the display unit;
In the step of displaying the composite image on the display unit, the map image data and the weather such that at least one of the position, the size, and the direction of the map image and the weather image changes according to a change in the relative positional relationship. A weather distribution display method comprising changing image data. It is a weather distribution display program which can execute display of weather distribution on a display unit of a portable device by a processing device
A process of virtually setting a fixed reference position in the real space;
A process of acquiring map data indicating a map;
A process of acquiring meteorological data indicating a meteorological distribution;
A process of calculating a relative positional relationship between the reference position and the portable device;
A process of generating two-dimensional map image data indicating a map image having a three-dimensional effect based on the map data;
A process of generating two-dimensional weather image data indicating a weather image superimposed on the map image and having a three-dimensional effect corresponding to the weather distribution based on the weather data;
A process of generating composite image data by combining the map image data and the weather image data;
Displaying a composite image based on the generated composite image data on the display unit;
Run on the processing device,
In the process of displaying the composite image on the display unit, the map image data and the weather such that at least one of the position, the size, and the direction of the map image and the weather image changes according to a change in the relative positional relationship. A weather distribution display program, including changing image data.

Images