JP6155510B2 - Weather information providing apparatus and weather information providing program - Google Patents

Description

  The present invention operates a weather information providing device that provides weather information and disaster prevention information related to the weather, and a computer mounted on the information terminal device so that various information terminal devices function as the weather information providing device. Regarding the program.

  In portable information terminal devices such as mobile phone terminals such as so-called smartphones and tablet information terminals, weather information and disaster prevention information are widely provided to general users through communication networks such as the Internet ( Non-patent document 1). Thereby, the user can easily know the latest weather information, for example, the weather forecast of the place where he / she is and the probability of precipitation.

  In recent years, with the frequent occurrence of localized short-term torrential rains called so-called guerrilla heavy rains, it is becoming increasingly important to immediately obtain rainfall prediction information in a very small area. In response to such a request, in the system disclosed in Non-Patent Document 2, if it is predicted that heavy rain will approach the area where the user is based on the radar precipitation distribution provided by the Japan Meteorological Agency, This is notified to the portable information terminal or personal computer owned by the user by e-mail. The user who has received this notification can take appropriate measures such as checking the radar precipitation distribution with a portable information terminal or personal computer at hand and evacuating immediately.

  In the conventional services and systems for providing weather information as described above, precipitation distribution and rain cloud distribution are displayed on the display screen, but these distributions are displayed on a two-dimensional map. Because it is shown, it is not easy for a user who is not good at understanding a map to know the amount of precipitation around the place where the user is. In addition, a general radar precipitation distribution is a heat map in which precipitation values are associated with display colors. To understand the actual intensity of rain from the display, Some knowledge and experience is required. Therefore, even if the general users who lack such knowledge and experience know the numerical value of the amount of rainfall in the area close to the area where they are, how much it falls It is difficult to guess. As a result, appropriate measures against heavy rain and heavy rain may not be taken.

  For this reason, weather that can be understood more intuitively by ordinary users to appropriately deal with guerrilla rainstorms, tornadoes, or lightning strikes, and to reduce human damage, damage to houses, damage to agricultural products, etc. It is desirable to provide information in a timely manner.

Note that the information terminal device in this specification refers to a mobile phone terminal such as a smartphone as described above, a tablet information terminal including a tablet personal computer, a music player terminal, a digital camera, a portable type equipped with a wireless communication function. Various devices such as game machines and PDAs (Personal Digital Assistants) are included. In addition, it is not necessarily limited to those carried by the user himself / herself, but includes, for example, equipment that is installed in a vehicle such as an automobile, motorcycle, or bicycle on which the user is riding and is movable. .

“Weather Japan”, Shimadzu Business Systems, Inc. [Search June 3, 2013], Internet <URL: http://www.otenki.jp/sp/> “SBS Weather Information Amemil”, Shimadzu Business Systems, Inc. [Search June 3, 2013], Internet <URL: http://tenki.shimadzu.co.jp/amemil1/>

  The present invention has been made in view of the above-mentioned problems, and the purpose of the present invention is to distribute the precipitation around the area where the user is present, even to a normal user who lacks knowledge and experience regarding the weather. Another object of the present invention is to provide a meteorological information providing apparatus and a weather information providing program capable of providing various types of meteorological distributions including distribution of occurrences of lightning, tornadoes, etc. in an easy-to-understand manner.

A first weather information providing apparatus according to the present invention, which has been made to solve the above-described problems, includes a display unit having a display screen, a communication unit that receives information from the outside, and imaging that captures an image in a predetermined range. , A positioning unit for recognizing the current position, and a three-dimensional azimuth detecting unit for detecting the direction and the inclination of the device from the horizontal state, and processing the weather information obtained from the outside by the communication unit In the weather information providing device for displaying on the screen of the display unit,
a) an optical axis direction calculation unit that calculates the direction of the optical axis of imaging by the imaging unit, based on information obtained by the positioning unit and the three-dimensional orientation detection unit;
b) At least light calculated by the optical axis direction calculation unit based on regional distribution information of precipitation distribution data indicating precipitation for each unit area, which is target weather information obtained by the communication unit. A virtual image is created by projecting, in a three-dimensional space, a simulated image that simulates the cloud state and the rainfall state corresponding to the precipitation amount for each unit area corresponding to the imaging range obtained by the imaging unit obtained from the axial information. A virtual image creation unit to
c) Image composition in which the virtual image within the imaging range of the imaging unit created by the virtual image creation unit is synthesized with the real image obtained by the imaging unit and displayed on the screen of the display unit And
It is characterized by having.
A second weather information providing apparatus according to the present invention, which has been made to solve the above problems, captures a predetermined range of images, a display unit having a display screen, a communication unit for receiving information from the outside, and the like. An imaging unit, a positioning unit that recognizes the current position, and a three-dimensional azimuth detection unit that detects the direction and the inclination of the device from the horizontal state, and processes weather information obtained from the outside by the communication unit In the portable weather information providing device which is processed and displayed on the screen of the display unit and has a rectangular shape in plan view,
a) an optical axis direction calculation unit that calculates the direction of the optical axis of imaging by the imaging unit, based on information obtained by the positioning unit and the three-dimensional orientation detection unit;
b) The imaging obtained from at least information on the optical axis direction calculated by the optical axis direction calculation unit based on regional distribution information of a weather-related index value that is target weather information obtained by the communication unit A virtual image creation unit for creating a virtual image by projecting a simulated image reflecting a weather-related index value for each unit area corresponding to a photographing range by the unit into a three-dimensional space;
c) Image composition in which the virtual image within the imaging range of the imaging unit created by the virtual image creation unit is synthesized with the real image obtained by the imaging unit and displayed on the screen of the display unit And
When the device is held horizontally, the image combined with the real image and the virtual image is displayed on the screen of the display unit, and the device is held vertically. A two-dimensional superposition of a heat map showing a mesh-like weather distribution created on the basis of the regional distribution information of the weather-related index value which is the target weather information obtained by the communication unit on a planar map The display is switched so that the image is displayed on the screen of the display unit.
The third weather information providing apparatus according to the present invention, which has been made to solve the above problems, captures a predetermined range of images, a display unit having a display screen, a communication unit for receiving information from the outside, and the like. An imaging unit, a positioning unit that recognizes the current position, and a three-dimensional azimuth detection unit that detects the direction and the inclination of the device from the horizontal state, and processes weather information obtained from the outside by the communication unit In the weather information providing apparatus that processes and displays on the screen of the display unit,
a) an optical axis direction calculation unit that calculates the direction of the optical axis of imaging by the imaging unit, based on information obtained by the positioning unit and the three-dimensional orientation detection unit;
b) Weather-related index values for all unit areas around the current position recognized by the positioning unit based on regional distribution information of weather-related index values that are target weather information obtained by the communication unit A virtual image creation unit that creates a virtual image obtained by projecting a simulated image reflecting the image into a three-dimensional space;
c) Extracting a virtual image within the shooting range by the imaging unit from the virtual images for every unit area around the current position created by the virtual image creating unit, and obtaining the virtual image and the imaging unit. An image composition unit that is displayed on the screen of the display unit,
It is characterized by having.
Moreover, the 4th weather information provision apparatus based on this invention made in order to solve the said subject is,
A display unit having a display screen, a communication unit that receives information from the outside, an imaging unit that captures an image of a predetermined range, a positioning unit that recognizes the current position, a direction and an inclination from the horizontal state of the device In the meteorological information providing apparatus comprising a three-dimensional azimuth detecting unit for detecting, processing the weather information obtained from the outside by the communication unit and displaying it on the screen of the display unit,
a) an optical axis direction calculation unit that calculates the direction of the optical axis of imaging by the imaging unit, based on information obtained by the positioning unit and the three-dimensional orientation detection unit;
b) The imaging obtained from at least information on the optical axis direction calculated by the optical axis direction calculation unit based on regional distribution information of a weather-related index value that is target weather information obtained by the communication unit A virtual image creation unit for creating a virtual image by projecting a simulated image reflecting a weather-related index value for each unit area corresponding to a photographing range by the unit into a three-dimensional space;
c) Image composition in which the virtual image within the imaging range of the imaging unit created by the virtual image creation unit is synthesized with the real image obtained by the imaging unit and displayed on the screen of the display unit And
The virtual image creation unit includes a simulated image for a plurality of unit areas arranged in a horizontal direction when viewed from the imaging unit when projecting a simulated image reflecting a weather-related index value for each unit area to a three-dimensional space. The horizontal width of each simulated image is enlarged by a predetermined magnification, and each simulated image is rotated so that each simulated image is positioned in front when viewed from the current position, and then the simulated images are connected to each other. It is said.

In addition, a first weather information providing program according to the present invention, which has been made to solve the above-described problems, includes a display unit having a display screen, a communication unit for receiving information from the outside, and imaging for capturing an image in a predetermined range. An information terminal device comprising: a positioning unit for recognizing a current position, a direction and a three-dimensional azimuth detecting unit for detecting a tilt from a horizontal state of the device, and a computer responsible for control and data processing of each unit. A program for operating the computer to function as a weather information providing device,
a) an optical axis direction calculating step of calculating a direction of an optical axis of photographing by the imaging unit based on information obtained by the positioning unit and the three-dimensional azimuth detecting unit;
b) At least light calculated by the optical axis direction calculation unit based on regional distribution information of precipitation distribution data indicating precipitation for each unit area, which is target weather information obtained by the communication unit. A virtual image is created by projecting, in a three-dimensional space, a simulated image that simulates the cloud state and the rainfall state corresponding to the precipitation amount for each unit area corresponding to the imaging range obtained by the imaging unit obtained from the axial information. Creating a virtual image,
c) Image composition in which the virtual image within the imaging range of the imaging unit created in the virtual image creation step is synthesized with the real image obtained by the imaging unit and displayed on the screen of the display unit Steps,
It is characterized by including.
In addition, a second weather information providing program according to the present invention, which has been made to solve the above problems, includes a display unit having a display screen, a communication unit for receiving information from the outside, and imaging for capturing an image of a predetermined range. In a rectangular shape in plan view, comprising a head unit, a positioning unit for recognizing the current position, a direction and a three-dimensional azimuth detection unit for detecting the inclination from the horizontal state of the device, and a computer responsible for control of each unit and data processing A program for operating the computer to cause a portable information terminal device to function as a weather information providing device,
a) an optical axis direction calculating step of calculating a direction of an optical axis of photographing by the imaging unit based on information obtained by the positioning unit and the three-dimensional azimuth detecting unit;
b) The imaging obtained from at least information on the optical axis direction calculated by the optical axis direction calculation unit based on regional distribution information of a weather-related index value that is target weather information obtained by the communication unit A virtual image creation step of creating a virtual image by projecting a simulated image reflecting a weather-related index value for each unit area corresponding to the photographing range by the unit into a three-dimensional space;
c) Image composition in which the virtual image within the imaging range of the imaging unit created in the virtual image creation step is synthesized with the real image obtained by the imaging unit and displayed on the screen of the display unit Steps,
In the state where the information terminal device is held horizontally, the image combined with the real image and the virtual image in the image combining step is displayed on the screen of the display unit, and the information terminal device is held vertically. In such a state, a heat map showing a mesh-like weather distribution created on the basis of the regional distribution information of the weather-related index value which is the target weather information obtained by the communication unit is displayed on a planar map. The display is switched so that the superimposed two-dimensional image is displayed on the screen of the display unit.
In addition, a third weather information providing program according to the present invention, which has been made to solve the above problems, includes a display unit having a display screen, a communication unit for receiving information from the outside, and imaging for capturing an image of a predetermined range. An information terminal device comprising: a positioning unit for recognizing a current position, a direction and a three-dimensional azimuth detecting unit for detecting a tilt from a horizontal state of the device, and a computer responsible for control and data processing of each unit. A program for operating the computer to function as a weather information providing device,
a) an optical axis direction calculating step of calculating a direction of an optical axis of photographing by the imaging unit based on information obtained by the positioning unit and the three-dimensional azimuth detecting unit;
b) Weather-related index values for all unit areas around the current position recognized by the positioning unit based on regional distribution information of weather-related index values that are target weather information obtained by the communication unit A virtual image creation step of creating a virtual image obtained by projecting a simulated image reflecting the image into a three-dimensional space;
c) Extracting a virtual image within the shooting range by the imaging unit from the virtual images for every unit area around the current position created by the virtual image creating unit, and obtaining the virtual image and the imaging unit. An image compositing step for compositing with the live-action image being displayed on the screen of the display unit;
It is characterized by including.
A fourth weather information providing program according to the present invention, which has been made to solve the above problems, includes a display unit having a display screen, a communication unit for receiving information from the outside, and imaging for capturing an image of a predetermined range. An information terminal device comprising: a positioning unit for recognizing a current position, a direction and a three-dimensional azimuth detecting unit for detecting a tilt from a horizontal state of the device, and a computer responsible for control and data processing of each unit. A program for operating the computer to function as a weather information providing device,
a) an optical axis direction calculating step of calculating a direction of an optical axis of photographing by the imaging unit based on information obtained by the positioning unit and the three-dimensional azimuth detecting unit;
b) The imaging obtained from at least information on the optical axis direction calculated by the optical axis direction calculation unit based on regional distribution information of a weather-related index value that is target weather information obtained by the communication unit A virtual image creation step of creating a virtual image by projecting a simulated image reflecting a weather-related index value for each unit area corresponding to the photographing range by the unit into a three-dimensional space;
c) Image composition in which the virtual image within the imaging range of the imaging unit created in the virtual image creation step is synthesized with the real image obtained by the imaging unit and displayed on the screen of the display unit Steps,
In the virtual image creation step, when projecting a simulated image reflecting the weather-related index value for each unit area to a three-dimensional space, the simulated image for a plurality of unit areas arranged in the horizontal direction when viewed from the imaging unit The horizontal width of each simulated image is enlarged by a predetermined magnification, and each simulated image is rotated so that each simulated image is positioned in front when viewed from the current position, and then the simulated images are connected to each other. It is said.

In the weather information providing device according to the present invention and the information terminal device equipped with the weather information providing program according to the present invention, the positioning unit is configured to measure a current position using GPS (Global Positioning System) or a wireless LAN ( (Local Area Network) Position measurement using radio waves from an access point (generally referred to as “WiFi positioning” or the like) can be used. The three-dimensional azimuth detecting unit may be an acceleration sensor that measures the gravitational acceleration of the earth, a geomagnetic sensor that detects geomagnetism, or the like.

  The communication unit typically uses the Internet network and collects necessary information by accessing, for example, a weather server in which weather information is stored. The weather information may be received via another communication network such as a line network. In addition, bidirectional communication is not necessarily required, and information to be distributed may be simply received.

  In the meteorological information providing apparatus according to the present invention, or the meteorological information providing apparatus embodied by operating the computer constituting the information terminal apparatus by the meteorological information providing program according to the present invention, the optical axis direction calculating unit includes: Based on the current position information obtained by the positioning unit and the information on the direction of the device and the inclination from the horizontal state obtained by the three-dimensional azimuth detecting unit at that time, the optical axis of the imaging unit at that time The direction, that is, the direction of the center of the captured image is calculated. If the viewing angle captured by the imaging unit is determined in advance, the range (width) corresponding to the image being captured can be determined from the optical axis direction of the imaging unit.

The communication unit receives weather information, specifically, regional distribution information of weather-related index values from the outside via the communication network. In addition, the communication unit receives not only the location around the location where the weather information providing device is located but also the regional distribution information of weather related index values over a wide range, and within the device is limited to an appropriate distance from the current location. Regional distribution information may be extracted. Alternatively, only the regional distribution information limited within a predetermined radius from the current position may be received by the communication unit, that is, the regional distribution information may be limited when the weather information is received. According to the latter method, the amount of data received through the communication unit can be reduced.

The virtual image creation unit obtains simulated images reflecting the weather-related index values for each unit area arranged in a grid based on the regional distribution information of the weather-related index values received through the communication unit. At this time, the simulated image may be obtained only for the unit area included in the imaging range (only in a specific direction viewed from the current position) determined based on the information on the optical axis direction of the imaging unit . As in the weather information providing apparatus 3 , a simulated image may be obtained for each unit area with respect to the entire periphery viewed from the current position (that is, an angular range of 360 degrees around). The simulated image may be determined in advance according to the type of weather information, for example, precipitation amount, lightning occurrence frequency, etc., but the simulated image information may be acquired together with the weather information through the communication unit.

If a simulated image for each unit area is obtained, the virtual image creation unit further creates a virtual image by projecting the simulated image for each unit area into a three-dimensional space using information on the optical axis direction of the imaging unit. To do. If a simulated image is required only for the unit area included in the shooting range (only in a specific direction viewed from the current position), a virtual image may be created only for that range, and the surroundings viewed from the current position If a simulated image is required for the entire image, a virtual image may be created for the entire periphery. In the latter case, a virtual image of a portion that is not captured by the imaging unit at that time is also created.

  The image synthesizing unit synthesizes the virtual image within the shooting range by the imaging unit with the real image obtained by the imaging unit and displays the synthesized image on the screen of the display unit. When a virtual image is created only for the shooting range at that time in the virtual image creation unit, the virtual image and the actual image may be synthesized, and the virtual image creation unit creates a virtual image of the entire surroundings. If it is, the virtual image corresponding to the shooting range at that time may be cut out and combined with the real image.

  That is, in the meteorological information providing apparatus and the meteorological information providing program according to the present invention, a virtual image related to the weather that does not actually exist or is not visible in the actual image such as an actual landscape or scenery existing in front of the user. An augmented reality (AR = Augmented Reality) display image obtained by superimposing the images is provided to the user.

Similarly to the first weather information providing apparatus according to the present invention, in the second to fourth weather information providing apparatuses according to the present invention, the target weather information is precipitation indicating precipitation per unit area. And a virtual image creation unit configured to create a virtual image in which a simulated image representing at least one of a cloud state or a rain state corresponding to precipitation for each unit area is projected in a three-dimensional space. can do.

  In this configuration, in the image displayed on the screen of the display unit by the image composition unit, a cloud clearly appears on the live-action image above the area where heavy rain is falling around the current position of the user. Even if it is not, a thick cloud is displayed, and a situation where heavy rain is falling from the cloud is drawn. Therefore, the user can confirm the local rainfall situation around the current position as a realistic image through this display image.

In the weather information providing apparatus according to the present invention, preferably, the virtual image creation unit creates a moving image as the virtual image, and the image composition unit composes the virtual moving image with a real image and displays the display unit. It may be configured to display on the screen.
According to this configuration, by using a simulated moving image, it is possible to inform the user in an easy-to-understand manner and intuitively particularly in situations such as rainfall and lightning described later.

  Of course, the target weather information is not limited to precipitation distribution data, and can be applied to other various weather distribution data. Examples of such distribution data include wind direction and wind speed distribution data, lightning nowcast data, tornado nowcast data, iso-altitude surface pressure data, soil rainfall index data, and the like. Also, a plurality of distribution data can be reflected together in the virtual image. For example, if a local storm occurs, creating a virtual image that reflects both precipitation distribution data and wind direction and wind speed distribution data will provide more accurate weather information to the user. be able to.

  In general, virtual images are created using the latest weather information. For example, it is desired to know the weather conditions at a specific point in the past, or conversely, predicted weather conditions at a specific point in the future. If the weather data is used, a similar image can be displayed. That is, in the weather information providing apparatus and the weather information providing program according to the present invention, a virtual image reflecting the weather situation at an arbitrary time point can be synthesized and displayed on a real image.

  According to the weather information providing apparatus and the weather information providing program according to the present invention, the latest weather situation around the area where the user is currently present and the weather situation at an arbitrary time point are synthesized and displayed as a virtual image on a live-action image. Can do. As a result, for example, guerrilla rainstorms and tornadoes, the specific weather phenomenon that causes severe damage in some cases is approaching, even for those who do not have specialized knowledge and experience regarding weather. Can let you know.

  Further, in particular, according to the program for providing weather information according to the present invention, it is possible to use the above-described accurate weather information by using a portable information terminal such as a smartphone or a tablet-type information terminal. Can be informed. Therefore, the user can obtain such weather information very easily and is effective for disaster prevention against the approach of the specific weather phenomenon as described above.

BRIEF DESCRIPTION OF THE DRAWINGS The block diagram of the weather information provision apparatus which is one Example of this invention. The figure which shows the optical axis direction of the camera in the weather information provision apparatus of a present Example. The figure which shows an example of the radar precipitation distribution data obtained from an external weather server in the weather information provision apparatus of a present Example. The figure which shows an example of the simulation image corresponding to the precipitation used in the weather information provision apparatus of a present Example. Explanatory drawing of the virtual image creation process based on the radar precipitation distribution data in the weather information provision apparatus of a present Example. Explanatory drawing of the virtual image creation process based on the radar precipitation distribution data in the weather information provision apparatus of a present Example. Explanatory drawing of the virtual image creation process based on the radar precipitation distribution data in the weather information provision apparatus of a present Example. The figure which shows an example of the use condition of the weather information provision apparatus of a present Example.

  Hereinafter, a weather information providing apparatus according to an embodiment of the present invention will be described with reference to the accompanying drawings.

  FIG. 1 is a block diagram of the weather information providing apparatus of this embodiment. As shown in FIG. 1, a weather information providing apparatus 1 according to the present embodiment includes a GPS receiving unit 10, an acceleration sensor 11, an electronic compass 12, a camera 13, a packet communication unit 14, a control / processing unit 15, an input unit 16, And a display unit 17. The control / processing unit 15 includes a position / three-dimensional azimuth calculation unit 151, a target data extraction unit 152, a virtual image creation unit 153, a simulated image storage unit 154, and an image composition unit 155 as functional blocks. Although not included in the weather information providing apparatus 1, a weather server 30 is installed in the data center 3, for example, as an external element necessary for providing weather information in the apparatus 1.

  The hardware of the weather information providing apparatus 1 of the present embodiment is a portable information terminal such as a general smartphone or a tablet-type information terminal apparatus having a larger display screen. The entity of the control / processing unit 15 is general-purpose. The computer includes a central processing unit (CPU), a random access memory (RAM), a read only memory (ROM), and the like, and may include a dedicated digital signal processor (DSP) in some cases. A storage device such as a flash ROM or a hard disk drive that constitutes the computer stores an operating system and various application software that operates on the operating system, and one of the application software operates the computer. The functional blocks included in the control / processing unit 15 are embodied.

  When the user wants to use the weather information providing apparatus 1 according to the present embodiment, the user downloads, for example, dedicated application software for providing weather information to the portable information terminal at hand and installs it. Thereafter, when an operation for starting the application software is performed, a program constituting the software starts to operate on the computer. Then, the processing described below is executed mainly by the computer. This process will be specifically described.

The position / three-dimensional azimuth calculation unit 151 obtains the current position of the apparatus 1, that is, the longitude / latitude based on the signal obtained by the GPS reception unit 10. Since the grasping of the current position is repeatedly executed at predetermined time intervals, for example, when the user having the apparatus 1 is moving, the latest current position accompanying the movement is always grasped. Now, as shown in FIG. 2A, a three-dimensional space in which a user is present is represented by three axes x, y, and z that are orthogonal to each other. At this time, the current position of the user is the origin O of the three-dimensional space.

  Further, since the acceleration sensor 11 measures the gravitational acceleration of the earth, the position / three-dimensional azimuth calculation unit 151 determines the inclination of the apparatus 1 from the horizontal state based on the signal obtained by the acceleration sensor 11, more specifically. First, the direction in which the optical axis C of the camera 13 faces in the vertical plane, that is, the elevation angle θ is obtained. As shown in FIG. 2B, the vertical plane is a plane formed by the x-axis and the y-axis, and the elevation angle θ is an angle from the x-axis. Therefore, when the elevation angle θ is 0 °, the camera 13 is photographing in the horizontal direction, and when the elevation angle θ is between 0 ° and 90 °, the camera 13 is photographing obliquely upward. Will be.

  Further, since the gravitational acceleration of the earth is measured by the electronic compass 12, the position / three-dimensional azimuth calculation unit 151 is based on the signal obtained by the electronic compass 12 and is absolutely directed to the optical axis C of the camera 13. The azimuth, more specifically, the horizontal angle φ formed by the north direction and the direction of the optical axis C of the camera 13 in the horizontal plane is obtained. As shown in FIG. 2C, the horizontal plane is a plane formed by the x axis and the z axis, and the horizontal angle φ is an angle from the x axis.

  Further, the position / three-dimensional azimuth calculation unit 151 is based on the current position O, the elevation angle θ, and the horizontal angle φ calculated as described above, and the direction in which the optical axis C of the camera 13 faces is based on the current position O. The vector S is calculated. Here, only the direction of the vector S is important.

  The external weather server 30 always stores the latest various weather data, and the necessary weather data is provided to each weather information providing device 1 through the Internet network or a communication network such as a mobile phone network. It has become. Therefore, the packet communication unit 14 reads the latest current position information from the position / three-dimensional azimuth calculation unit 151 via the target data extraction unit 152, and uses the latest observation result in a radius range of 10 km around the current position. A request is sent to the weather server 30 to transmit certain weather data. In response to this, the weather server 30 sends out the weather data of the requested area, and the packet communication unit 14 receives this weather data via the Internet network or the like. In this example, the weather data is the latest radar precipitation distribution data. Of course, the range of the area of the meteorological data to be received is not limited to the range of the surrounding 10 km radius, and can be changed as appropriate.

  Thus, by limiting the weather data received from the weather server 30 to the range around the current position, the amount of data to be communicated can be suppressed. However, as described above, rather than receiving weather data limited to the vicinity of the current position, it receives a wider range of weather data, and the target data extraction unit 152 centers on the current position from the wide range of weather data. Weather data in a narrow range with a predetermined radius may be extracted.

  The radar precipitation distribution data is two-dimensional numerical data indicating precipitation for each range (hereinafter referred to as “unit area”) partitioned into, for example, L [m] × L [m]. FIG. 3 shows an example of radar precipitation distribution data. The numerical value described in each unit area in the figure is the precipitation in the area, and the unit area is displayed in different colors according to the precipitation value.

Based on the information received from the position / three-dimensional azimuth calculation unit 151, the target data extraction unit 152 selects the precipitation corresponding to the range currently captured by the camera 13 from the received precipitation distribution data around the current position. Extract quantity distribution data.
More specifically, first, based on the direction vector of the optical axis C of the camera 13 calculated by the position / three-dimensional azimuth calculation unit 151 and a predetermined viewing angle of the camera 13, the camera 13 captures at that time. Find the range you are doing. At this time, by not using the zoom function or the like provided in the camera 13 at this time, if the viewing angle is determined, the range that can be accommodated in the captured image can be uniquely determined. Good.

  If the range captured by the camera 13 is found, limited precipitation distribution data centered on the camera 13 is extracted from precipitation distribution data around the current position. For example, in the case of a camera installed in a general portable information terminal, when the camera 13 is directed so as to look up at an obliquely upward sky, a width range of about 10 km can be accommodated in a captured image. Therefore, in this case, the shooting range by the camera 13 includes a maximum of 10 unit sections in the horizontal direction.

  The simulated image storage unit 154 stores in advance simulated image data that simulates the cloud state and the rainfall state corresponding to the precipitation value. FIG. 4 is an example of this simulated image. In this example, the precipitation is divided into four stages of 1-4 mm, 5-9 mm, 10-19 mm, and 20 mm or more, and the thickness and number of lines indicating the color of the cloud and the rain at each level. Are associated with different simulated images. Of course, these simulated images are only examples, and can be changed as appropriate. In addition, the level classification according to precipitation may be made finer. The simulated image may be downloaded at the same time as the application software for providing weather information, but only the simulated image may be downloaded. The simulated image data may be included in the weather data distributed from the weather server 30.

  The virtual image creation unit 153 stores the direction vector of the optical axis C of the camera 13 calculated by the position / three-dimensional azimuth calculation unit 151, the precipitation distribution data extracted by the target data extraction unit 152, and the simulated image storage unit 154. Based on the stored simulated image data, a virtual image that virtually indicates the state of precipitation is created as follows.

  That is, in the precipitation distribution data extracted as described above, since each unit area is associated with a numerical value indicating precipitation, a simulated image corresponding to the numerical value is acquired from the simulated image storage unit 154. . Then, as shown in FIG. 5, each acquired simulated image is regarded as a rectangular surface having a bottom width L [m] and a height H [m], and has a lattice shape. Mapping on the precipitation distribution plane. Since each mapped surface can be regarded as a surface onto which a simulated image is projected when viewed from the user, this surface is called a screen. In this way, the screen is installed corresponding to all the unit areas included in the range photographed by the camera 13 at that time.

  Next, the virtual image creation unit 153 creates a virtual image by projectively transforming a number of simulated images on the screen into a three-dimensional space based on the direction vector of the optical axis C of the camera 13. At this time, for the screen positioned in the depth direction when viewed from the camera 13, the following projective transformation is performed.

  That is, as shown in FIG. 6A, when the screen is viewed from the current position O, the screen is erected in the depth direction along the optical axis C at substantially L intervals. As shown in the figure, since the shooting range (width) of the camera 13 increases as it goes farther, objects located at the same height, that is, the simulated images C3 to C5 of the clouds located on the screen, are separated from each other. The lower it is, the lower it will be visible. Therefore, the simulated image of the cloud on the screen located on the near side is placed on the top, and the simulated image of the cloud positioned on the screen in the depth direction is projected one by one in order. As a result, as shown in FIG. 6B, the simulated images C3 to C5 of the clouds on the screens S3 to S5 arranged in order in the depth direction are projected so as to be arranged in order from the top on the virtual image.

  On the other hand, the simulated images on the screen arranged in the horizontal direction when viewed from the camera 13 are basically simply connected. However, if the screens are simply arranged on the xz plane, the unnaturalness of the joints cannot be avoided. Therefore, in practice, the length of the bottom side of one screen is enlarged to 1.4 × L, which is 1.4 times that of L instead of L, and each screen is positioned at a right angle when viewed from the current position O. Thus, the screen is arranged so as to rotate around the center point of the bottom side of the screen. FIG. 7 is a diagram showing an example of the state at this time, and the paper surface is an xz plane. When the size and arrangement of the bottom sides of the screens are adjusted in this way, the end portions of the adjacent screens sufficiently overlap each other when viewed from the current position O. As a result, the simulated images on both screens can be satisfactorily connected, that is, naturally.

  In FIG. 5, a simulated cloud image is drawn on the screen corresponding to each unit area. However, as described above, there is a simulated cloud image in both unit areas adjacent in the horizontal direction and the depth direction. When connecting them, the images are corrected and connected so that they can be seen continuously. As a result, a natural cloud image can be reproduced as a whole.

When the virtual image reflecting the actual precipitation distribution is created as described above, the image composition unit 155 creates an image obtained by superimposing the virtual image and the actual image obtained by the camera 13, The composite image is displayed on the display screen of the display unit 17.
In addition, about the image which shows the state of the rain in a simulation image, realisticity can be improved further by making it into the moving image by an animation instead of a mere still image. Specifically, for example, by making a simulated image indicating a rainy state a moving image, it is possible to easily and intuitively convey the strength and intensity of rain.

  In the above description, the target data extraction unit 152 extracts precipitation distribution data corresponding to the shooting range by the camera 13, and the virtual image creation unit 153 corresponds to the shooting range based on the extracted precipitation distribution data. I was creating a virtual image. In this case, when the user points the camera 13 in another direction, the shooting range changes accordingly, and a virtual image is created again. On the other hand, the target data extraction unit 152 does not extract precipitation distribution data (that is, not limited to the shooting range), and the virtual image creation unit 153 does not include all unit areas (within a predetermined radius) around the current position. Based on precipitation data at, a virtual image over 360 ° of the entire circumference is created in advance, and a virtual image included in the range photographed by the camera 13 at that time is cut out and synthesized with a real image You may make it do. According to this, even if the user points the camera 13 in a different direction, there is no need to recreate the virtual image, and the actual image is synthesized from the already created virtual images over 360 degrees around the circumference. Therefore, the part to be cut out may be changed.

  FIG. 8 is a diagram illustrating an example of a usage state of the weather information providing apparatus 1 according to the present embodiment. As shown in the drawing, on the display screen of the display unit 17, an image in which a virtual image based on a simulated image of clouds and rainfall is combined with a cityscape that is a real image is displayed. The user can intuitively grasp the occurrence of rainfall around the current position from this display image.

  When the user designates the target direction and distance by performing a predetermined operation with the input unit 16, a substantially rectangular frame 101 indicating the designated target direction is superimposed on the screen as shown in FIG. In addition to being displayed, numerical information 102 of precipitation in the target direction and distance is displayed. As a result, the user can know the precipitation quantitatively.

  Although the display using augmented reality as described above is useful for intuitively grasping the rainfall situation, the user wants to know a wider range of precipitation distribution and precipitation in any place other than where he is Sometimes. Therefore, it may be possible to switch between a two-dimensional display in which a heat map showing a mesh-like precipitation distribution is superimposed on a planar map and the above-described augmented reality display. For example, as shown in FIG. 8, when the user holds the weather information providing device 1 in the landscape orientation, the augmented reality display is performed, and when the device 1 is held in the portrait orientation, the two-dimensional display is performed. You may make it switch a display automatically so that it may perform.

  Further, in the weather information providing apparatus of the above embodiment, the augmented reality display indicating the cloud and the rainfall situation is performed using the precipitation distribution data, but it is useful for the user by using various other weather data. An augmented reality display can be provided.

  Specifically, for example, augmented reality display indicating the strength and wind direction of the wind around the current position of the user can be performed using wind direction and wind speed distribution data. In this case, an arrow or the like may be used as a simulated image.

  Further, the augmented reality display indicating the lightning occurrence accuracy around the current position of the user can be performed using the lightning nowcast data. In this case, a symbol that represents lightning as a simulated image may be used.

  Moreover, the augmented reality display which shows the tornado generation | occurrence | production accuracy around a user's present position can be performed using a tornado nowcast data. In this case, a symbol that schematically represents a tornado may be used as a simulated image.

  Further, the augmented reality display showing the trough of the air pressure around the current position of the user can be performed using the iso-altitude surface pressure data. In this case, an image that simply shows a mountain or a valley may be used as a simulated image.

  Moreover, the augmented reality display which shows the risk of the landslide of the land around a user's present position can be performed using soil rainfall index data. In this case, an image or the like that simply shows the rise of the ground such as a mountain may be used as the simulated image.

  Moreover, although the said Example is an example which applied the weather information provision apparatus which concerns on this invention to a portable information terminal, this invention is not only a portable information terminal but various forms, such as a portable type, a portable type, a vehicle mounting type. It can be applied to the information terminal device.

  Further, the above-described embodiments and various modifications are merely examples of the present invention, and it is a matter of course that modifications, additions, and modifications as appropriate within the scope of the present invention are included in the scope of the claims of the present application. .

DESCRIPTION OF SYMBOLS 1 ... Weather information provision apparatus 10 ... GPS receiving part 11 ... Acceleration sensor 12 ... Electronic compass 13 ... Camera 14 ... Packet communication part 15 ... Control / processing part 151 ... Position and three-dimensional azimuth | direction calculation part 152 ... Target data extraction part 153 ... Virtual image creation unit 154 ... simulated image storage unit 155 ... image composition unit 16 ... input unit 17 ... display unit 3 ... data center 30 ... weather server

Claims (13)

A display unit having a display screen, a communication unit that receives information from the outside, an imaging unit that captures an image of a predetermined range, a positioning unit that recognizes the current position, a direction and an inclination from the horizontal state of the device In the meteorological information providing apparatus comprising a three-dimensional azimuth detecting unit for detecting, processing the weather information obtained from the outside by the communication unit and displaying it on the screen of the display unit,
a) an optical axis direction calculation unit that calculates the direction of the optical axis of imaging by the imaging unit, based on information obtained by the positioning unit and the three-dimensional orientation detection unit;
b) At least light calculated by the optical axis direction calculation unit based on regional distribution information of precipitation distribution data indicating precipitation for each unit area, which is target weather information obtained by the communication unit. A virtual image is created by projecting, in a three-dimensional space, a simulated image that simulates the cloud state and the rainfall state corresponding to the precipitation amount for each unit area corresponding to the imaging range obtained by the imaging unit obtained from the axial information. A virtual image creation unit to
c) Image composition in which the virtual image within the imaging range of the imaging unit created by the virtual image creation unit is synthesized with the real image obtained by the imaging unit and displayed on the screen of the display unit And
A weather information providing device comprising: The weather information providing device according to claim 1,
The virtual image creation unit creates a virtual image using simulated images having different cloud colors and rain line thicknesses and / or numbers that are simulated according to precipitation. A weather information providing device. A display unit having a display screen, a communication unit that receives information from the outside, an imaging unit that captures an image of a predetermined range, a positioning unit that recognizes the current position, a direction and an inclination from the horizontal state of the device Portable weather information having a rectangular shape in plan view , comprising a three-dimensional azimuth detecting unit for detecting, processing weather information obtained from the outside by the communication unit, and displaying the processed weather information on the screen of the display unit In the providing device,
a) an optical axis direction calculation unit that calculates the direction of the optical axis of imaging by the imaging unit, based on information obtained by the positioning unit and the three-dimensional orientation detection unit;
b) The imaging obtained from at least information on the optical axis direction calculated by the optical axis direction calculation unit based on regional distribution information of a weather-related index value that is target weather information obtained by the communication unit A virtual image creation unit for creating a virtual image by projecting a simulated image reflecting a weather-related index value for each unit area corresponding to a photographing range by the unit into a three-dimensional space;
c) Image composition in which the virtual image within the imaging range of the imaging unit created by the virtual image creation unit is synthesized with the real image obtained by the imaging unit and displayed on the screen of the display unit And
When the device is held horizontally, the image combined with the real image and the virtual image is displayed on the screen of the display unit, and the device is held vertically. A two-dimensional superposition of a heat map showing a mesh-like weather distribution created on the basis of the regional distribution information of the weather-related index value which is the target weather information obtained by the communication unit on a planar map A weather information providing apparatus that switches display so that an image is displayed on a screen of the display unit. A display unit having a display screen, a communication unit that receives information from the outside, an imaging unit that captures an image of a predetermined range, a positioning unit that recognizes the current position, a direction and an inclination from the horizontal state of the device In the meteorological information providing apparatus comprising a three-dimensional azimuth detecting unit for detecting, processing the weather information obtained from the outside by the communication unit and displaying it on the screen of the display unit,
a) an optical axis direction calculation unit that calculates the direction of the optical axis of imaging by the imaging unit, based on information obtained by the positioning unit and the three-dimensional orientation detection unit;
b) Weather-related index values for all unit areas around the current position recognized by the positioning unit based on regional distribution information of weather-related index values that are target weather information obtained by the communication unit A virtual image creation unit that creates a virtual image obtained by projecting a simulated image reflecting the image into a three-dimensional space;
c) the extracting virtual image within the imaging range by the imaging unit in the virtual image of each surrounding all the unit areas of the current position created by the virtual image generation unit, obtained by the image pickup unit with the virtual image An image composition unit that synthesizes the captured real image and displays it on the screen of the display unit;
A weather information providing device comprising: A display unit having a display screen, a communication unit that receives information from the outside, an imaging unit that captures an image of a predetermined range, a positioning unit that recognizes the current position, a direction and an inclination from the horizontal state of the device In the meteorological information providing apparatus comprising a three-dimensional azimuth detecting unit for detecting, processing the weather information obtained from the outside by the communication unit and displaying it on the screen of the display unit,
a) an optical axis direction calculation unit that calculates the direction of the optical axis of imaging by the imaging unit, based on information obtained by the positioning unit and the three-dimensional orientation detection unit;
b) The imaging obtained from at least information on the optical axis direction calculated by the optical axis direction calculation unit based on regional distribution information of a weather-related index value that is target weather information obtained by the communication unit A virtual image creation unit for creating a virtual image by projecting a simulated image reflecting a weather-related index value for each unit area corresponding to a photographing range by the unit into a three-dimensional space;
c) Image composition in which the virtual image within the imaging range of the imaging unit created by the virtual image creation unit is synthesized with the real image obtained by the imaging unit and displayed on the screen of the display unit And
The virtual image creation unit includes a simulated image for a plurality of unit areas arranged in a horizontal direction when viewed from the imaging unit when projecting a simulated image reflecting a weather-related index value for each unit area to a three-dimensional space. The horizontal width of each simulated image is enlarged by a predetermined magnification, and each simulated image is rotated so that each simulated image is positioned in front when viewed from the current position, and then the simulated images are connected to each other. A weather information providing device. The weather information providing device according to any one of claims 3 to 5 ,
The target weather information is precipitation distribution data indicating precipitation for each unit area,
The virtual image creation unit creates a virtual image in which a simulated image representing at least one of a cloud state or a rain state corresponding to precipitation in each unit area is projected into a three-dimensional space. apparatus. The weather information providing device according to any one of claims 1 to 6 ,
The virtual image creating unit creates a moving image as the virtual image, and the image synthesizing unit synthesizes the virtual moving image with a photographed image and displays it on the screen of the display unit. Information providing device. A display unit having a display screen, a communication unit that receives information from the outside, an imaging unit that captures an image of a predetermined range, a positioning unit that recognizes the current position, a direction, and a three-dimensional detection of the direction and the inclination of the device from the horizontal state A program for operating the computer in order to cause an information terminal device including an orientation detection unit and a computer responsible for control and data processing of each unit to function as a weather information providing device,
a) an optical axis direction calculating step of calculating a direction of an optical axis of photographing by the imaging unit based on information obtained by the positioning unit and the three-dimensional azimuth detecting unit;
b) At least light calculated by the optical axis direction calculation unit based on regional distribution information of precipitation distribution data indicating precipitation for each unit area, which is target weather information obtained by the communication unit. A virtual image is created by projecting, in a three-dimensional space, a simulated image that simulates the cloud state and the rainfall state corresponding to the precipitation amount for each unit area corresponding to the imaging range obtained by the imaging unit obtained from the axial information. Creating a virtual image,
c) Image composition in which the virtual image within the imaging range of the imaging unit created in the virtual image creation step is synthesized with the real image obtained by the imaging unit and displayed on the screen of the display unit Steps,
A program for providing weather information characterized by including: The program for providing weather information according to claim 8,
In the virtual image creating step, a virtual image is created using simulated images having different cloud colors and rain line thicknesses and / or numbers that are simulated according to precipitation. A program for providing weather information. A display unit having a display screen, a communication unit that receives information from the outside, an imaging unit that captures an image of a predetermined range, a positioning unit that recognizes the current position, a direction, and a three-dimensional detection of the direction and the inclination of the device from the horizontal state A program for operating a computer in order to cause a portable information terminal device having a rectangular shape in a plan view including an orientation detection unit and a computer responsible for control and data processing of each unit to function as a weather information providing device. There,
a) an optical axis direction calculating step of calculating a direction of an optical axis of photographing by the imaging unit based on information obtained by the positioning unit and the three-dimensional azimuth detecting unit;
b) The imaging obtained from at least information on the optical axis direction calculated by the optical axis direction calculation unit based on regional distribution information of a weather-related index value that is target weather information obtained by the communication unit A virtual image creation step of creating a virtual image by projecting a simulated image reflecting a weather-related index value for each unit area corresponding to the photographing range by the unit into a three-dimensional space;
c) Image composition in which the virtual image within the imaging range of the imaging unit created in the virtual image creation step is synthesized with the real image obtained by the imaging unit and displayed on the screen of the display unit Steps,
In the state where the information terminal device is held horizontally, the image combined with the real image and the virtual image in the image combining step is displayed on the screen of the display unit, and the information terminal device is held vertically. In such a state, a heat map showing a mesh-like weather distribution created on the basis of the regional distribution information of the weather-related index value which is the target weather information obtained by the communication unit is displayed on a planar map. A program for providing weather information , wherein the display is switched so as to display a superimposed two-dimensional image on the screen of the display unit . A display unit having a display screen, a communication unit that receives information from the outside, an imaging unit that captures an image of a predetermined range, a positioning unit that recognizes the current position, a direction, and a three-dimensional detection of the direction and the inclination of the device from the horizontal state A program for operating the computer in order to cause an information terminal device including an orientation detection unit and a computer responsible for control and data processing of each unit to function as a weather information providing device,
a) an optical axis direction calculating step of calculating a direction of an optical axis of photographing by the imaging unit based on information obtained by the positioning unit and the three-dimensional azimuth detecting unit;
b) Weather-related index values for all unit areas around the current position recognized by the positioning unit based on regional distribution information of weather-related index values that are target weather information obtained by the communication unit A virtual image creation step of creating a virtual image obtained by projecting a simulated image reflecting the image into a three-dimensional space;
c) the extracting virtual image within the imaging range by the imaging unit in the virtual image of each surrounding all the unit areas of the current position created by the virtual image generation unit, obtained by the image pickup unit with the virtual image An image compositing step for compositing with the captured real image and displaying it on the screen of the display unit;
A program for providing weather information characterized by including: A display unit having a display screen, a communication unit that receives information from the outside, an imaging unit that captures an image of a predetermined range, a positioning unit that recognizes the current position, a direction, and a three-dimensional detection of the direction and the inclination of the device from the horizontal state A program for operating the computer in order to cause an information terminal device including an orientation detection unit and a computer responsible for control and data processing of each unit to function as a weather information providing device,
a) an optical axis direction calculating step of calculating a direction of an optical axis of photographing by the imaging unit based on information obtained by the positioning unit and the three-dimensional azimuth detecting unit;
b) The imaging obtained from at least information on the optical axis direction calculated by the optical axis direction calculation unit based on regional distribution information of a weather-related index value that is target weather information obtained by the communication unit A virtual image creation step of creating a virtual image by projecting a simulated image reflecting a weather-related index value for each unit area corresponding to the photographing range by the unit into a three-dimensional space;
c) Image composition in which the virtual image within the imaging range of the imaging unit created in the virtual image creation step is synthesized with the real image obtained by the imaging unit and displayed on the screen of the display unit Steps,
In the virtual image creation step, when projecting a simulated image reflecting the weather-related index value for each unit area to a three-dimensional space, the simulated image for a plurality of unit areas arranged in the horizontal direction when viewed from the imaging unit The horizontal width of each simulated image is enlarged by a predetermined magnification, and each simulated image is rotated so that each simulated image is positioned in front when viewed from the current position, and then the simulated images are connected to each other. A program for providing weather information. The weather information providing program according to any one of claims 10 to 12 ,
The target weather information is precipitation distribution data indicating precipitation for each unit area,
In the virtual image creation step, weather information provision is characterized in that a virtual image is created by projecting a simulated image representing at least one of a cloud state or a rain state corresponding to precipitation for each unit area into a three-dimensional space. Program.