JPH1157206A - Shooting game system using view label - Google Patents

Abstract

PROBLEM TO BE SOLVED: To present computer-derived topographical information and an image of the real view to users while associating the information with each part of the image and to make a real shooting game possible in a real city. SOLUTION: This system transmits position information (with time) about users and shooting information from a terminal to a center 20 at regular time intervals. A game information control part 25 controls the position information about each user and the shooting information and delivers position information about a user who is not defunct at the present to a map information control part 21. At the map information control part 21, a structure where a user participating in a game is present is detected on the basis of the position information about the participating user not defunct at the present, and a label information originating part 22 originates user position label information for notifying each user that the game participant is present in the structure. The user position label information is delivered to the label information output part 17 of the terminal and displayed on the HMD of the user.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention superimposes and displays, on an image display device, geographical information about each partial area in an image taken by a user using a landscape image input device such as a camera. The present invention relates to a device that teaches a user by voice guidance or the like.

[0002]

2. Description of the Related Art Conventionally, there have been various navigation systems as systems for instructing users on geographical information about the area where the users are located.

FIG. 12 is a block diagram of a navigation device disclosed in Japanese Patent Application Laid-Open No. 8-273000. This device receives a vehicle position data and a movement data, receives a road map data, updates a vehicle position with reference to a position updating unit 71, and displays display road data and display background data based on map data and the like. Display data generator 7 to be generated
2, a three-dimensional moving image data creating unit 73 for creating three-dimensional moving image data based on these display data, and a storage unit 74.
When a travel route including a waypoint is set in advance, the device has a function of setting a route while viewing a real moving image display screen along a road that actually exists instead of a map screen.

According to this device, when a user travels along a route that actually exists, the user can see a moving image display (for example, FIG. 13) along the route.

[0005]

However, in the case of using the same device, the human finally associates the real scene with the geographical information in the computer world with the naked eye, so that the person in the real scene can be used. You have to recognize what is. In other words, humans rely on the naked eye to work the human brain unconsciously, based on the symbols in the map displayed as a moving image, to determine what the actual buildings, roads, and mountains are in front of the user. It must be understood by performing the work of association. At street corners, etc., comparing the map on the computer with the actual scenery, grasping the direction and finding landmarks, gazing at the direction, understanding the characteristics of the building in that direction, and then looking at the map again Understand what the building is.

[0006] For this reason, there is a problem that the trouble of comparing the map on the computer with the actual scenery many times and associating with the human cannot be omitted. Especially in the dark or at night, it is difficult to see the actual scenery and to take measures.

Further, there is a disadvantage that the shooting game in a personal computer has little realism and is unsatisfactory.

SUMMARY OF THE INVENTION An object of the present invention is to teach a user by associating geographical information on a computer with each part in an image of a real scene (hereinafter, referred to as a landscape image), and to shoot in a real city. An object of the present invention is to provide a landscape label-based shooting game system capable of playing games.

[0009]

According to the present invention, map data on a computer is created in advance as three-dimensional data, and a position at which an image (hereinafter referred to as a landscape image to distinguish it from a CG image) is input. , Camera angle, focal length, and image size at the time of shooting, and computer graphics (hereinafter referred to as CG) when viewed from the position at the time of shooting the actual scenery, the camera angle, and the focal length in the three-dimensional map space on the computer. This is to achieve the association by acquiring geographical information in the image and superimposing and displaying the geographical information on a landscape image which is a real scene. The geographic information is the name of a structure or the like or its attribute information in an image, and the attribute information means information on all attributes (for example, contour, color, etc.) of the structure. In this specification, the term structure is used to mean all data having a certain geographical structure in the map DB, including natural topography such as mountains, rivers, and the sea, in addition to artificial structures. . When acquiring geographic information, a landscape image is obtained based on a camera position, a camera angle, a focal length, and an image size, and a structure of a plurality of images is obtained. The position of the landscape image where the structure should be shown (hereinafter, referred to as the assigned position)
Is obtained, and the name or attribute information of the structure is superimposed and displayed.

Further, in order to further increase the accuracy of associating a structure in a landscape image with a structure in a CG image,
The previously acquired structure is associated with each partial region of the landscape image by pattern matching. A CG image is created on the basis of the acquired structure, a partial region in the CG image is associated with the partial region of the landscape image by pattern matching, and the structure as a source of the associated partial region Ask for.

Here, an example of a method for creating a CG image will be described. By accessing the three-dimensional map DB based on the camera position, camera angle, focal length, and image size obtained earlier,
Obtain the visual field space in the three-dimensional map space. A structure in the visual field space is obtained, and three-dimensional data of each structure is three-dimensionally projected and converted onto the projection plane using the camera screen as a projection plane. Further, of the line data constituting the projected figure of each structure, line data hidden by other structures and invisible is erased using a normal vector method or the like. The CG image is divided into regions based on the line data remaining after the elimination of the hidden lines. 3D map DB
Is used, the name of the structure that is the basis of the area can be associated with each area.

Then, the structure name of the partial area of the CG image associated with each partial area of the landscape image is extracted by pattern matching. The position coordinates of the actual scenery image on which the extracted structure name is to be superimposed are obtained by three-dimensionally projecting the position coordinates of the structure in the three-dimensional map space onto the projection plane. Label information is created from the position coordinates of the actual scenery image on which the extracted structure name is to be superimposed. Based on the label information, the structure name is superimposed on a landscape image as a real scene and displayed on a visual device.

In the present invention, the following configuration is adopted to enable a shooting game in a real city.

First, the communication control means sends position information (with time) and shooting information relating to the user from the terminal to the center at regular intervals. Here, the shooting information is called
Information on the time and the position and angle of the gun when each user fires a ray gun at another user (this is notified to the center), or each user fires a ray gun from another user, This is the time when a sensor attached to the body of the user on the side of the emission detects a light beam. The communication control means on the center side passes position information and shooting information on the user to the game information management means via the center control means. In the game information management means, the position information and shooting information of each user is managed, and if the correspondence is detected by comparing the shooting information of the firing side and the shooting information of the firing side, one user shoots the other user The score is given to the user on the shooting side and the score is deprived of the user on the shooting side. If the score falls below a certain threshold, it is regarded as dead and deleted from the list of game participating users. The game information management means passes the position information of the user who has not died at present to the center control means. The center control means passes the position information of the user to the label information creation means. The map information management means obtains a structure in which the user who is participating in the game exists based on the positional information of the participating users who are not currently deceased. Create user position label information to teach each user that it exists,
It is passed to the center control means in addition to the normal label information. Here, the user position label information includes the name or attribute information of the structure in which the user who is alive and participating exists and the position information of the user. The user position label information is passed to the label information output means via the communication control unit, and the user's HMD
Etc. are displayed on visual equipment.

The shooting game system using a landscape label according to the present invention comprises a plurality of terminals and a center, wherein each of the terminals is an image obtaining means for obtaining an image, and a position information obtaining means for obtaining a camera position at the time of obtaining the image. A camera attribute information acquisition unit for acquiring a camera angle, a focal length, and an image size at the time of image acquisition; an image processing unit for dividing the acquired image into a plurality of partial regions; The time when the light gun was fired at it and the position of the gun
Acquisition information about the angle, and the terminal is fired by a ray gun from another terminal, and shooting information acquisition means for acquiring, via a center, shooting information including the time at which the light ray was detected, and information on area division of the image, The camera position, the camera angle, the focal length, and the image size are transmitted to a center via a communication network, and the time-attached position information and the shooting information of the terminal are transmitted to the center via the communication network at regular intervals. Communication control means for transmitting label information and user position label information from the center, and superimposing the name of the structure in the label information or its attribute information at a position corresponding to the assigned position in the image, Label information output means for displaying the displayed image on a visual device and displaying the user position label information on the visual device; and terminal control means for controlling each of the means. The center transmits the information related to area division of the image, the camera position, the camera angle, the focal length, the image size, the time-attached position information of each terminal, and the shooting information from each terminal via the communication network. A communication control means for receiving and transmitting the label information and the user position label information to the terminal; managing the map information; and storing the map information in the map information space based on the received camera position, camera angle, focal length, and image size. Obtain the visual field space, obtain the structures existing in the visual field space, and, based on the positional information of the user who is not dying and who is participating in the game, determine the structure in which the user who is participating in the game exists. It manages the map information management means to be sought and the position information and shooting information of the user of each terminal, and if the correspondence can be detected by comparing the shooting information of the firing side and the shooting side of the firing side, the user of one terminal can be used. If the user shoots the other terminal user as if he were shooting, the scoring user will be scored, the scoring user will be scored, and if the score falls below a certain threshold, it is considered dead. Game information management means for outputting the position information of the user who has not died at present, and the obtained structure is associated with the partial area of the image. The label information including the name or attribute information of the structure and the assigned position is created, and the user of each terminal is instructed that the user participating in the game exists in the structure where the user participating in the game exists. Label information creating means for creating user position label information comprising name or attribute information of a structure in which a user participating in the game exists and position information of the user. And a center control means for controlling each of the means.

According to an embodiment of the present invention, the label information creating means creates a CG image which is a computer graphics image based on the acquired structure, and performs pattern matching on the partial area of the image. The CG
The partial areas in the image are associated with each other, the structure of the associated partial area is obtained, and label information including the name or attribute information of the structure and the assigned position is created.

According to another embodiment of the present invention, the label information creating means performs a three-dimensional projection conversion of the acquired structure on a camera screen, erases a structure invisible from the viewpoint, and creates a CG image. CG by the outline of the partial area in the CG image
A structure that divides the image into partial regions, associates the partial regions of the image with the partial regions of the CG image by pattern matching, and associates the partial regions of the image with the partial regions of the CG image An object is obtained, and label information including the name or attribute information of the structure and the assigned position is created.

[0018]

Next, embodiments of the present invention will be described with reference to the drawings.

Referring to FIG. 1, a scenery label utilizing type shooting game system according to an embodiment of the present invention includes a terminal 10, a center 20, and a communication network 30. Here, the terminal 10
Although only one is shown for the sake of convenience, there are actually a plurality of them.

The terminal 10 includes an image acquisition unit 1 for acquiring an image.
1, a position information acquisition unit 12 for acquiring a camera position at the time of image acquisition, a camera attribute information acquisition unit 13 for acquiring a camera angle, a focal length, and an image size at the time of image acquisition, and the acquired image in a plurality of partial areas. The image processing unit 14 that divides the image and obtains information about the time when the user of the terminal 10 fires the ray gun toward the user of the other terminal and information on the position and angle of the gun. The shooting information including the time when the gun was fired and the light beam was detected is transmitted to the center 2
A shooting information acquisition unit 18 to acquire through 0, information on the area division of the image, a camera position, a camera angle, a focal length, and an image size are transmitted to the center 20 via a communication network;
A communication control unit 15 for transmitting the time-attached position information and the shooting information of the terminal 10 to the center 20 via the communication network 30 at regular time intervals, and receiving label information and user position label information from the center 20; A label information output unit that superimposes the name of the structure inside or its attribute information at a position corresponding to the application position in the image, displays the superimposed image on a visual device, and displays user position label information on the visual device. 17 and a terminal control unit 16 that controls the units 11 to 15, 17, and 18. The center 20 receives, from each of the terminals 10, information on image area division, a camera position, a camera angle, a focal length, an image size, time-attached position information of each terminal, and shooting information from each terminal 10 via the communication network 30. A communication control unit 23 for transmitting label information and user position label information, and managing map information, obtaining a visual field space in a map information space based on the received camera position, camera angle, focal length, and image size. A map information management unit 21 that acquires a structure existing in the visual field space, and obtains a structure in which the user who is participating in the game exists based on the positional information of the user who is currently participating in the game who has not died; When the position information and the shooting information of the user of each terminal 10 are managed and the shooting information of the firing side and the shooting side of the firing side are detected and the correspondence is detected, the user of one terminal can use the other terminal user to shoot the other terminal. If the score falls below a certain threshold, it is considered dead and removed from the list of participating users. Then, the game information management unit 25 that outputs the position information of the user who is not currently dead is associated with the acquired structure with respect to the partial region of the image, and the name or attribute information of the associated structure and the assignment are provided. There is a user who is participating in the game to create label information including the position and to teach the user of each terminal that the user who is participating in the game is present in the structure where the user who is participating in the game is present. A label information creating unit 22 for creating user position label information including the name or attribute information of the structure and the position information of the user, and a sensor for controlling the units 21 to 23 and 25. It is composed of over control unit 24.

Next, the operation of this embodiment will be described with reference to the flowchart of FIG.

First, the terminal control unit 16 sends a processing start command to the position information acquisition unit 12, the camera attribute information acquisition unit 13, and the image acquisition unit 11 in order to acquire information on a landscape image. The position information acquisition unit 12 is a terminal control unit 16
, The position information is collected every second by a GPS receiver or the like, and is passed to the terminal control unit 16 (step 21). Here, the time interval is not limited to the unit of seconds, but may be any value. The camera attribute information acquisition unit 13 acquires a camera angle of a landscape image recording device such as a camera at the time of image capturing as a set of a horizontal angle and an elevation angle in response to a command from the terminal control unit 16 (Step 22).
At the same time, if it is a landscape image device having a zoom function, the focal length is obtained (step 23). The image acquisition unit 11 receives a command from the terminal control unit 16, acquires a landscape image every second, and passes it to the control unit 16 (step 24). Since the image size is fixed for each landscape image device, the terminal control unit 16 holds the image size information. The terminal control unit 16 holds the collected information as a landscape image file.

FIG. 3 shows the file format of the data structure of the landscape image file. The landscape image file has header information and image data. The header information includes position information, camera angle information, focal length, time information, image size, type, and size of an image file. As location information,
East longitude, north latitude, and elevation data (for example, 137 degrees east 5 degrees
5 minutes 10 seconds, latitude 34 degrees 34 minutes 30 seconds north, altitude 101m3
3 cm). The camera angle includes horizontal angle data and elevation angle data (for example, horizontal angle 254 degrees clockwise, elevation angle 15 degrees, etc.). The focal length data is the focal length (for example, 28 mm) of the camera lens at the time of capturing an image. The time information includes the time at the time of shooting (for example, 15:06:17, January 31, 1997, Japan time). As the image size of the image file, the vertical and horizontal pixel sizes (for example, 64
0 × 480). File type (TIF
E format, 8-bit color, etc.). It also has the number of bytes of the file (307.2 KB, etc.). The image data itself has, for example, a binary format.

After storing the landscape image file, the terminal control unit 16 instructs the image processing unit 14 to extract the outline from the landscape image and divide the landscape image into a plurality of regions. The image processing unit 14 extracts the outline by performing a differentiation process based on the density difference in the landscape image, roughly speaking (step 25), and performs labeling with the outline as a boundary to divide the image into regions. (Step 26). Note that the technical term of labeling used here is a technical term used in image area division. As a procedure, first, the image is converted into a monochrome grayscale image. Since the contour is a portion where the brightness changes suddenly, the contour is extracted by performing a differentiation process to find a portion where the differential value is larger than a threshold value. At this time, the line width of the outline is one pixel, and the outlines are connected. For this purpose, a thinning process is performed to obtain a connected line having a line width of one pixel. Where the differentiation process,
It is sufficient to use a conventional method for the thinning processing.

The obtained contour is regarded as the contour of the area, and an operation of numbering the area constituted by the contour is performed.
The largest number among the numbers is the number of areas, and the number of pixels in the area indicates the area of the area. FIG. 8 shows an example in which a landscape image is divided into a plurality of partial regions. Note that a measure of similarity (closeness) between regions may be introduced, and a clustering process may be performed to combine a plurality of regions having similar properties into one region. Any existing clustering method may be used.

When the landscape image region division processing is completed, the communication control unit 15 receives information on the acquired camera position, camera angle, focal length, image size, and image region division (landscape image file) according to an instruction from the terminal control unit 16. Is transmitted to the center 20 (step 27). These pieces of information are transferred to the map information management unit 21 of the center 20 via the communication control unit 23 and the center control unit 24. An example of the map information management unit 21 is a map database program. The map information management unit 21 manages three-dimensional map data. Although two-dimensional map data may be used, in this case, since there is no height information, the accuracy of the position at which the labeling is applied to the actual scenery is inferior. When the two-dimensional map data is used as the basis, the processing is performed by supplementing the height information. For example, in the case of two-dimensional data of a house, if there is floor information indicating the number of floors of the house, the number of floors is multiplied by a certain number to estimate the height of the house, and the two-dimensional data is obtained. 3D data is created based on the height information. Even when there is no floor information, the height information can be estimated by assigning a certain number of heights according to the area of the house figure, and similarly, three-dimensional data is created based on the estimated height information. . In this way, three-dimensional data is created and the process proceeds.

FIG. 4 shows an example of three-dimensional map data. FIG.
(1) shows a map information space expressed in two dimensions, and FIG.
(2) shows a map information space expressed in three dimensions. This 3
With respect to the three-dimensional map information space, the map information management unit 21 receives the instruction of the center control unit 24 and calculates the visual field space based on the header information of the landscape image file (step 28).
FIG. 5 shows a calculation example of the visual field space. First, XY in the horizontal direction
The axis is stretched, and the Z axis is stretched in the vertical direction. The position of the viewpoint E is set in the three-dimensional map information space from the position information in the header information of the landscape image file. For example, East longitude 1
37 degrees 55 minutes 19 seconds, north latitude 34 degrees 34 minutes 30 seconds, altitude 1
If it is 01m33cm, the corresponding coordinates in the corresponding map mesh number are set. Similarly, the camera angle direction is set based on the horizontal angle and the elevation angle in the camera angle information in the header information. The focal point F is set at a point advanced from the viewpoint E by the focal length on a straight line representing the camera angle direction. The line-of-sight direction vector is a unit vector having a length of 1 from the viewpoint E on the straight line. In the image size of the landscape image file, the width x on the X-axis of the camera screen is set from the horizontal size, and the width y on the Y-axis is set from the vertical size. The horizontal x vertical y plane is perpendicular to the camera angle direction with respect to the line-of-sight direction vector, and the focal point F
Is set to include Straight lines connecting the four corner points of the camera screen are obtained from the coordinates of the viewpoint E, and a three-dimensional space formed by four half lines extending from the viewpoint E is defined as a visual field space. FIG.
FIG. 3 shows an example of a visual field space in a three-dimensional map space. The three-dimensional map space is viewed from the XZ plane. In FIG. 6, a portion surrounded by oblique lines is a cross-sectional view of the space belonging to the viewing space on the XZ plane. In the example of FIG. 6, buildings and mountains in the visual field space are included.

Further, the map information management section 21 determines a structure existing in the determined visual space. For each structure,
It is calculated whether or not each vertex constituting the solid representing the structure exists in the internal region of the viewing space. Usually, a two-dimensional map space is divided by a two-dimensional mesh of a fixed size. As a method of cutting a mesh in the three-dimensional map space, a mesh is cut at regular intervals in the height direction in addition to the two-dimensional mesh in the vertical and horizontal directions. The space is divided by a rectangular parallelepiped unit space. First, the presence or absence of an overlapping portion between the rectangular parallelepiped unit space and the visual field space is checked, and the number of the three-dimensional unit map space having the overlapping portion is obtained. The number of the three-dimensional unit map space here is the same as a so-called mesh number. A check is made as to whether or not there is an overlapping portion between the visual field space and the structure in the overlapping three-dimensional unit map space. A straight line connecting the coordinates of the vertices constituting the structure and the coordinates of the viewpoint is obtained. If the straight line has an intersection with the camera screen of FIG. 7, it is within the visual field space. Of the vertices that make up the structure,
If at least one vertex satisfies this condition, the structure has an overlapping part with the viewing space.

When the structure is included in the view space or a part of the structure, the process enters a process of three-dimensionally projecting each structure onto the projection surface using the camera screen as a projection surface (step 29). ). Here, as shown in FIG. 7, after the point P is re-expressed in the coordinate system based on the viewpoint E based on the following equation (1), the point P is projected on the camera screen to obtain the intersection Q. .

[0030]

(Equation 1) Here, point P = (x, y, z): coordinates of the vertices constituting the structure point E = (ex, ey, ez): coordinates of the viewpoint vector L = (lx, ly, lz): gaze direction vector (Unit vector) Point P ′ = (x ′, y ′, z ′): coordinates in a coordinate system based on the viewpoint E of the point P r = (lx ² + ly ² ) ^1/2 intersection Q = (X, Y): The projection point t of the point P on the camera screen is the focal length. In the three-dimensional projection conversion, first, for each structure, the surface on which the vertex extends is obtained. For example, in the case of a structure represented by a rectangular parallelepiped, six surfaces are obtained. When each plane is projected onto the camera screen, the distance between the viewpoint and the corresponding point on the plane is calculated for each pixel on the camera screen included in the projection area, and stored as a depth value (Z value) in the memory. Store. For each surface of each structure, the depth value (Z
Value) and store it in memory. Note that z ′ in (Equation 1) represents a depth value (Z value) from the viewpoint.

Among the structures three-dimensionally transformed on the camera screen, there are structures that can be seen from the viewpoint and structures that cannot be seen from the viewpoint. Among them, it is necessary to find only the structure that can be seen from the viewpoint, and to find the surface on the opposite side from the viewpoint or the surface that is blocked by other structures. Therefore, hidden surface processing is performed (step 3
0). There are various methods for processing the hidden surface, and for example, the Z buffer method is used. Other scan line methods and ray tracing methods may be used.

A pixel on the camera screen is arbitrarily determined, and a plane having the smallest depth value for the pixel is determined. As described above, when processing is sequentially performed on each surface of each structure, the surface closest to the viewpoint is left for each pixel on the camera screen. The plane closest to the viewpoint is determined for each pixel on the camera screen, and pixels on the camera screen that share the plane closest to the viewpoint generally form an area.
There can be a plurality of regions consisting of pixels with the common surface being the closest surface. The region obtained in this way is a region obtained by performing a three-dimensional projection conversion of the partial region of the structure seen from the viewpoint. Surfaces on the other side of the view and those obstructed by other structures have been erased.

The area thus formed forms a CG image area (step 31).

With respect to the vertex coordinates of the two-dimensional figure constituting the CG image area, three-dimensional coordinates before projection transformation are obtained, and the correspondence between the two is stored in the memory as link information. It is used to determine which structure the two-dimensional area is a projection of based on the link information.

Based on the line data remaining after erasing hidden lines, C
The G image is divided into regions. Since the three-dimensional map DB is used, the name of the structure serving as the basis of each area can be associated with each area. The divided areas of the CG image are numbered sequentially. FIG. 9 shows an example in which a CG image is divided into a plurality of partial areas.

When the CG image area division processing is completed, the center control unit 24 instructs the label information
A command is issued to associate the divided regions of the G image with the divided regions of the landscape image. The label information creating unit 22 associates the divided regions of the CG image with the divided regions of the landscape image by template matching (step 32, see FIG. 10).

Among the divided regions of the landscape image, the regions are associated with the divided regions of the CG image in ascending order (for example, the first region). For matching, any of the conventional matching methods may be used, but here, a simple template matching method is used. That is, two regions to be compared are superimposed, and when the ratio of overlapping portions is equal to or greater than a certain ratio determined as a threshold, the regions are associated as regions relating to the same structure. For example, the coordinate value of each pixel in the first divided region R1 of the landscape image is set to (A, B). The value of the pixel at coordinates (A, B) is 1 because it is inside the area. In the first divided area S1 of the CG image,
If the coordinates (A, B) are within the area S1, the pixel value is 1 and overlaps, but if the coordinates (A, B) are outside the area S1, the pixel value is 0 and does not overlap. In this way, the overlap coefficient K (A, B) at the coordinates (A, B) is determined to be 1 when they overlap and 0 when they do not overlap. The coordinates (A, B) are moved within the region R1, and the overlap coefficient K
(A, B) is obtained. Then, with respect to the number N1 of coordinates (A, B) moved in the region R1, the overlap coefficient K (A,
The number N2 of coordinates where B) was 1 is obtained, and when N1 / N2 is equal to or larger than the threshold value, it is determined that the divided region R1 of the landscape image and the divided region S1 of the CG image correspond to each other. This association is performed from the first to the last divided area of the landscape image. In addition, as the matching method, an evaluation function that has the same value even if there is a slight displacement in the XY directions may be used.

After associating the partial area of the CG image with the partial area of the landscape image, the label information creating section 22 extracts the structure of the associated partial area (step 3).
3) Further, a process of obtaining information (structure name or attribute information) to be superimposed for each partial region of the landscape image and creating label information together with a position to be superimposed (step 3)
Enter 4). First, a partial area of the CG image corresponding to the partial area of the landscape image is extracted. The partial region of the extracted CG image is originally obtained by three-dimensionally projecting and converting a certain surface of the three-dimensional structure in the three-dimensional map space onto the camera screen. Therefore, the surface of the three-dimensional structure on which the three-dimensional projection conversion is based is obtained using the depth value (Z value) of the partial region of the CG image as a key. The link information created at the time of the three-dimensional projection conversion may be used as a key. 3D map DB based on the surface of the original structure
To get the name or attribute information of the structure. Here, the attribute information means information associated with the structure, and may be any information as long as the information is related to the structure. Then, the position coordinates where the name or attribute information is to be superimposed are determined for the partial area of the landscape image. How to decide
You can decide how you like. For example, the center of gravity of the figure extending the partial area may be used. Label information is created from the name or attribute information of the structure and the assigned position coordinates. Table 1 shows an example of label information.

[0039]

[Table 1] When the label information creating unit 22 finishes creating the label information, it passes the label information to the center control unit 24. When the center control unit 24 receives the label information, the center control unit 24
Is instructed to transmit the label information to the terminal 10 (step 35).

The label information is passed to the label information output unit 17 of the terminal 10, and the label information output unit 17 superimposes the name or attribute information of the structure in the label information at a position in the landscape image (step 36). The obtained landscape image is displayed on a video display device such as a display (CRT) or a head-malant display (step 37). FIG. 11 shows an example of a landscape image on which label information is superimposed.

When the shooting game is started between the user of the terminal 10 and the user of the other terminal, the firing time of the light gun fired by the user of the terminal 10 toward the user of the other terminal and the position and angle of the gun The shooting information obtaining unit 18 obtains information (shooting information) related to the terminal 10, and the communication control unit 15 sends the information together with the time-attached position information of the terminal 10 to the center 20 at regular intervals (step 38). The time-added position information and the shooting information of the terminal 10 are passed to the game information management unit 25 of the center 20 via the center control unit 24, and the game information management unit 25 manages the position information and the shooting information of each user and fires. If the correspondence can be detected by comparing the shooting information of the side and the firing side, one user gives a score to the shooting side as if the other user has fired, and the score from the shot side user If the score falls below a certain threshold, it is regarded as dead and is deleted from the list of the game participating users, and the position information of the user who is not currently dead is passed to the center control unit 24 (step 39). ). The position information of the user is stored in the map information management unit 21 by the center control unit 24.
The map information management unit 21 obtains a structure in which the user who is participating in the game exists based on the position information of the participating user who has not died, and the label information creation unit 22 Creating user position label information (consisting of the name or attribute information of the structure in which the user participating in the game exists and the position information of the user) for teaching each user that the game participant exists in the object, It is passed to the center control unit 24 (step 40).

The center control unit 24 transmits the user position label information to the terminal 10 via the communication control unit 23 (Step 41). The label information output unit 17 of the terminal 10 displays the user position label information on the video display device (Step 4).
2).

[0043]

As described above, according to the present invention, the geographical information on the computer and each part in the scenery image of the actual scene can be presented to the user in association with each other.
It is not necessary for a human to compare the map on the computer with the actual scenery and associate it with the human, and a shooting game can be played in a real city.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of a shooting game system using a landscape label according to an embodiment of the present invention.

FIG. 2 is a flowchart of a process of a shooting game system using a landscape label of FIG. 1;

FIG. 3 is a diagram showing a data structure of a landscape image file.

FIG. 4 is a diagram showing an example of a two-dimensional map (FIG. 1 (1)) and its three-dimensional map (FIG. 2 (2)).

FIG. 5 is a diagram illustrating a calculation method of a visual field space.

FIG. 6 is a diagram illustrating an example of a visual field space in a three-dimensional map space.

FIG. 7 is a diagram showing an example of a projection view.

FIG. 8 is a diagram showing an example of area division of a landscape image.

FIG. 9 is a diagram illustrating an example of area division of a CG image.

FIG. 10 is an explanatory diagram of pattern matching between a partial region of a landscape image and a partial region of a CG image.

FIG. 11 is a diagram illustrating an example of superimposition of label information on a landscape image.

FIG. 12 is a configuration diagram of a navigation device disclosed in JP-A-8-273000.

FIG. 13 is a diagram illustrating a display example of a moving image.

[Explanation of symbols]

 Reference Signs List 10 terminal 11 image acquisition unit 12 position information acquisition unit 13 camera attribute information acquisition unit 14 image processing unit 15 communication control unit 16 terminal control unit 17 label information output unit 18 shooting information acquisition unit 20 center 21 map information management unit 22 label information creation Unit 23 communication control unit 24 center control unit 25 game information management unit 30 communication network

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Akira Suzuki 3-19-2 Nishi-Shinjuku, Shinjuku-ku, Tokyo Japan Telegraph and Telephone Corporation (72) Inventor Takeshi Ikeda 3- 192-1 Nishi-Shinjuku, Shinjuku-ku, Tokyo No. Japan Telegraph and Telephone Corporation

Claims (3)

[Claims] 1. A terminal comprising a plurality of terminals and a center, wherein each of the terminals comprises: an image acquisition unit for acquiring an image; a position information acquisition unit for acquiring a camera position at the time of image acquisition; a camera angle and a focus at the time of image acquisition. Camera attribute information acquiring means for acquiring distance and image size; image processing means for dividing the acquired image into a plurality of partial areas; and time when the user of the terminal fires a light gun toward the user of another terminal And shooting information obtaining means for obtaining information about the position and angle of the gun, and obtaining, via the center, shooting information including the time at which the terminal is fired from another terminal and the light ray is detected, and the image Information about the area division, the camera position, the camera angle, the focal length, and the image size are transmitted to the center via a communication network. Communication control means for transmitting shooting information to the center via the communication network at regular time intervals and receiving label information and user position label information from the center; and a name of a structure in the label information or attribute information thereof. Label information output means for superimposing on a position corresponding to the application position in the image, displaying the superimposed image on a visual device, and displaying the user position label information on the visual device, and a terminal for controlling each of the means Control means, wherein the center receives information on area division of the image from each terminal via the communication network, the camera position, the camera angle, the focal length, the image size, and the time-attached position of each terminal. Communication control means for receiving the information and the shooting information and transmitting the label information and the user position label information to the terminal; managing the map information; Obtain the visual space in the map information space based on the mera angle, the focal length, and the image size, obtain the structures existing in the visual space, and obtain the positional information of the user who is currently dying and participating in the game. Based on the map information management means for finding the structure where the user who is participating in the game exists, manages the position information and shooting information of the user of each terminal, and matches the shooting information of the firing side and the firing side If the correspondence can be detected, the user of one terminal gives a score to the user who fired assuming that the user of the other terminal has fired, the score is deprived of the user who was shot, and a threshold value with a score is given. In the case of the following, the game information management unit that deletes from the list of game participating users assuming that the user has died and outputs the position information of the user who is not currently dying, The acquired structures are associated with each other, the label information including the name or attribute information of the associated structures and the assigned position is created, and the user who is participating in the game is presently participating in the game. Label information creating means for creating user position label information comprising the name or attribute information of the structure in which the user participating in the game is present and the position information of the user for teaching the user of each terminal that the user is present; And a landscape label-based shooting game system having a center control means for controlling each of the means. 2. The label information creating means creates a CG image, which is a computer graphics image, based on the acquired structure, and a part in the CG image by pattern matching with respect to the partial area of the image. The system according to claim 1, wherein the regions are associated, a structure of the associated partial region is obtained, and label information including the name or attribute information of the structure and an assigned position is created. 3. The label information creating means performs a three-dimensional projection conversion of the acquired structure on a camera screen, creates a CG image by erasing a structure that cannot be seen from a viewpoint, and creates a contour of a partial area in the CG image. Dividing the CG image into partial areas by lines,
The partial area of the image and the partial area of the CG image are associated with each other by pattern matching, and the structure that is the basis of the partial area of the CG image is determined for the partial area of the image. The system according to claim 1, wherein label information including name or attribute information and an assigned position is created.