JP2010048616A - Mobile terminal - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable a positional relationship relative to an object to be intuitively comprehended. <P>SOLUTION: A mechanism for acquiring image data 201 is installed in a mobile body and image data taken in real time is output. A position coordinate data calculating section 211 calculates coordinates of a static target relative to a self position based on positional information of the mobile body obtained by a self position data acquiring section 208, azimuth direction information in a direction of eyesight center of the mechanism for acquiring image data 201 obtained by an azimuth direction data acquiring section 207, and positional information of the static target obtained by a static target position data acquiring section 210. A display data generating section 212, based on the coordinates calculated by the position coordinate data calculating section 211, generates an image overlaid with a symbol denoting the static target on the image acquired by an image data acquiring section 206 to output it in a display data outputting mechanism 213. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a mobile terminal device that provides location information.

  Conventionally, in a navigation device or the like, the top view display using map (terrain) information has been generally used for visualization of position information. However, in a mobile terminal device in which equipment and operations are restricted, the user can intuitively locate the position information. It was not possible to grasp the information.

Further, there are the following publicly known documents related to the present application (see, for example, Patent Document 1).
JP 2006-105640 A

  As described above, in the conventional position information display method, it is difficult for the user to intuitively grasp the position information in the mobile terminal device in which equipment and operation are restricted.

  The present invention has been made paying attention to the above circumstances, and an object thereof is to provide a mobile terminal device capable of intuitively grasping a positional relationship with respect to a target.

  In order to achieve the above object, the present invention is a mobile terminal device attached to a moving body on which an imaging device is mounted, and is captured by a position storage means for storing static target position information in advance and the imaging device. Acquired by image acquisition means for acquiring image data, position acquisition means for acquiring position information of the moving body, azimuth acquisition means for acquiring azimuth information in the center direction of the field of view of the imaging device, and the position acquisition means Calculation means for calculating the coordinates of the static target with respect to the moving body based on the positional information, the azimuth information acquired by the azimuth acquisition means, and the stored static target position information; Display means for superimposing and displaying a symbol representing the static target on the image acquired by the image acquisition means based on the coordinates calculated by the calculation means.

  According to another aspect of the present invention, there is provided a mobile terminal device that is attached to a moving body on which an imaging device is mounted. The mobile terminal device receives position information of a dynamic target via a wireless line, and an imaging device. Image acquisition means for acquiring captured image data, position acquisition means for acquiring position information of the moving body, azimuth acquisition means for acquiring azimuth information in the visual field center direction of the imaging device, and the position acquisition means The calculation means for calculating the coordinates of the dynamic target with respect to the moving object based on the position information acquired by the above, the direction information acquired by the direction acquisition means, and the received position information of the dynamic target And display means for superimposing and displaying a symbol representing the dynamic target on the image acquired by the image acquisition means based on the coordinates calculated by the calculation means.

  Therefore, according to this invention, the mobile terminal device which can grasp | ascertain the positional relationship with respect to a target intuitively can be provided.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
FIG. 1 shows a configuration example of an embodiment of a mobile terminal apparatus according to the present invention. FIG. 2 shows a state in which the mobile terminal device and each device are attached to the user.

  As shown in FIG. 1, this mobile terminal device is carried by each of users A to C. The mobile terminal device includes a GPS (Global Positioning System) receiver, and acquires position information of the mobile device from the GPS. The terminals are connected to each other by a wireless LAN or the like, and have a function of transmitting / receiving the acquired location information to / from each other. In addition, a unit including a camera, an HMD (head mounted display), and an orientation sensor is attached to the users A to C. As shown in FIG. 2, this unit is configured such that the viewing direction of the camera and the viewing direction of the user substantially coincide. The azimuth sensor detects the azimuth of the camera's visual field center direction. The mobile terminal device is connected to each of these devices and has a function of acquiring position information / direction information / video information through each device.

FIG. 3 is a block diagram showing the internal configuration of this mobile terminal apparatus.
The video data acquisition mechanism 201 is a device having a function of outputting video data captured in real time, and is configured by a web camera, for example. The orientation data acquisition mechanism 202 is a device having a function of acquiring orientation information, and an orientation sensor or the like is used. The self-position data acquisition mechanism 203 is a device having a function of acquiring current position information, and for example, a GPS receiver is used. The dynamic target position data receiving mechanism 204 is a communication device for acquiring position data of another mobile terminal device, and is configured by a communication interface such as a wireless LAN. The static target position data holding mechanism 205 is a storage device that stores in advance position data of static objects, and a non-volatile storage device or the like is used.

  The video data acquisition unit 206 acquires video information data from the video data acquisition mechanism 201 and passes the video information data to the display data generation unit 212. The azimuth data acquisition unit 207 acquires east, west, south, and north azimuth data corresponding to the visual field center direction of the video data acquisition mechanism 201 from the azimuth data acquisition mechanism 202 and passes the azimuth data to the position coordinate data calculation unit 211. The self position data acquisition unit 208 acquires the current position data from the self position data acquisition mechanism 203 and passes the position data to the position coordinate data calculation unit 211. The dynamic target position data receiving unit 209 acquires the position information data of the other terminal from the dynamic target position data receiving mechanism 204 and passes the acquired position information data of the other terminal to the position coordinate data calculation unit 211. The static target position data acquisition unit 210 passes the position data of the static object stored in the static target position data holding mechanism 205 to the position coordinate data calculation unit 211.

  The self-location data transmission unit 214 performs processing for transmitting the self-location data acquired by the self-location data acquisition unit 208 to other terminals using the self-location data transmission mechanism 215. The self-location data transmission mechanism 215 is a device for transmitting self-location data from the self-location data transmission unit 214 to another terminal, and for example, a communication interface such as a wireless LAN is used.

  The position coordinate data calculation unit 211 receives azimuth data, self position data, and dynamic / static object position data, and converts the self position and the object position into two-dimensional coordinates. The converted two-dimensional coordinate data is transferred to the display data generation unit 212.

  The display data generation unit 212 generates image data in which the video data passed from the video data acquisition unit 206 is superimposed with a symbol representing an object indicated by the two-dimensional coordinate data passed from the position coordinate data calculation unit 211. The generated display data is transferred to the display data output mechanism 213. The display data output mechanism 213 is a device for displaying the image data transferred from the display data generation unit 212, and for example, an HMD (head mounted display) is used. The user is made to visually recognize the image data generated by the display data generation unit 212 using this display data output mechanism.

Next, the operation of the mobile terminal apparatus configured as described above will be described.
This mobile terminal apparatus repeatedly takes in information, periodically performs coordinate conversion processing, and generates display data.

(Importing information)
As shown in FIG. 4, the video data acquisition unit 206, the orientation data acquisition unit 207, the self-position data acquisition unit 208, and the static target position data acquisition unit 210 each capture information. The video data acquisition unit 206 takes in the field-of-view video captured by the device of the video data acquisition mechanism 201 as data in real time, and passes it to the display data generation unit 212. The azimuth data acquisition unit 207 takes azimuth information in the center direction of the visual field of the video data acquisition mechanism 201 captured by the device of the azimuth data acquisition mechanism 202 as data in real time. The self-position data acquisition unit 208 takes in the self-position information (latitude and longitude) captured by the device of the self-position data acquisition mechanism 203 as data. The dynamic target position data receiving unit 209 receives the position information data of other terminals through the device of the dynamic target position data receiving mechanism 204. The static target position data acquisition unit 210 takes in the position information (latitude and longitude) of the static target (fixed target) stored in the device of the static target position data holding mechanism 205 as data.

  On the other hand, the self-position data transmission unit 214 performs broadcast transmission of the self-position data acquired by the self-position data acquisition unit 208 to other terminals through the device of the self-position data transmission mechanism 215, so that the dynamic target of the other terminal The position data receiving unit 209 receives the dynamic target position data.

(Coordinate conversion process)
The taken-in information is processed by the position coordinate data calculation unit 211 in order to convert it into two-dimensional coordinates. The position coordinate data calculation unit 211 maps the position information of the static target from the absolute coordinates of latitude and longitude to the relative coordinate plane centered on the self position. As shown in FIG. 5, when mapping, the coordinate position is relatively rotated based on the azimuth data so that the visual field direction is the front. At the same time, the distance to each dynamic / static target is calculated from the self-position and the position information (latitude / longitude) of each dynamic / static target. As shown in FIG. 6, when the dynamic target moves, its position and distance are recalculated.

(Display data generation)
The display data generation unit 212 re-develops a two-dimensional plane whose front direction is the visual field direction based on the data converted into two-dimensional coordinates by the position coordinate data calculation unit 211. At this time, since the field of view of the video data acquired by the camera is limited, only the target in a range that falls within about 120 degrees right and left in the front direction of the field in the original two-dimensional coordinate data is drawn. When drawing, only the horizontal direction is used without considering the depth and tilt (tilt in the vertical direction). When drawing a target, drawing is performed together with a relative distance from the target. Finally, the target image and the distance to the target position are represented in real time in the visual field image by superimposing the image in which the target is drawn and the captured visual field image data.

  By outputting the image data in this state to the device of the display data output mechanism 213, the user can visually recognize the target position (direction) and distance superimposed on the view field image. It is possible to provide a user with an image visualized in real time by repeating the above-described series of information acquisition, coordinate conversion processing, and display data generation at high speed.

  As described above, according to the above-described embodiment, the user can dynamically visualize the target direction and distance on the field of view image, and thus the distance and direction to the target in real time and intuitively. Can be determined.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Further, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, you may combine suitably the component covering different embodiment.

The figure which shows the structural example of one Embodiment of the mobile terminal device which concerns on this invention. The figure which shows the attachment state of the mobile terminal device of FIG. The functional block diagram which shows the structure of the mobile terminal device of FIG. The figure which shows operation | movement of the mobile terminal device of FIG. The figure which shows operation | movement of the mobile terminal device of FIG. The figure which shows operation | movement of the mobile terminal device of FIG.

Explanation of symbols

  201 ... Video data acquisition mechanism, 202 ... Direction data acquisition mechanism, 203 ... Self-position data acquisition mechanism, 204 ... Dynamic target position data reception mechanism, 205 ... Static target position data holding mechanism, 206 ... Video data acquisition unit, 207 ... Direction data acquisition unit, 208 ... Self-position data acquisition unit, 209 ... Dynamic target position data reception unit, 210 ... Static target position data acquisition unit, 211 ... Position coordinate calculation unit, 212 ... Display data generation unit, 213 ... Display data output mechanism, 214... Self-position data transmission unit, 215... Self-position data transmission mechanism.

Claims (3)

A mobile terminal device attached to a moving body on which an imaging device is mounted,
Position storage means for storing in advance the position information of the static target;
Image acquisition means for acquiring data of an image captured by the imaging device;
Position acquisition means for acquiring position information of the moving body;
Azimuth acquisition means for acquiring azimuth information of the visual field center direction of the imaging device;
Based on the position information acquired by the position acquisition unit, the direction information acquired by the direction acquisition unit, and the position information of the stored static target, the coordinates of the static target with respect to the moving object are obtained. A calculation means for calculating;
A mobile terminal apparatus comprising: a display unit configured to superimpose and display a symbol representing the static target on the image acquired by the image acquisition unit based on the coordinates calculated by the calculation unit. A mobile terminal device attached to a moving body on which an imaging device is mounted,
Position receiving means for receiving position information of a dynamic target via a wireless line;
Image acquisition means for acquiring data of an image captured by the imaging device;
Position acquisition means for acquiring position information of the moving body;
Azimuth acquisition means for acquiring azimuth information of the visual field center direction of the imaging device;
Based on the position information acquired by the position acquisition unit, the direction information acquired by the direction acquisition unit, and the received position information of the dynamic target, the coordinates of the dynamic target with respect to the moving object are obtained. A calculation means for calculating;
A mobile terminal device comprising: a display unit configured to superimpose and display a symbol representing the dynamic target on the image acquired by the image acquisition unit based on the coordinates calculated by the calculation unit.   3. The mobile terminal apparatus according to claim 2, further comprising position transmitting means for transmitting the position information acquired by the position acquiring means to another mobile terminal apparatus via a wireless line.

Images