JP2011164701A - Object display control device and object display control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable an entire object to be displayed to a user to be output and displayed in output processing or display processing of the object in an AR (Augmented Reality) technique. <P>SOLUTION: In an object display control device 1, a visual line reference position information acquiring portion 10 acquires visual line reference position information in a real space or a virtual space. A visible object determining portion 15 determines, among objects existed in the real space or the virtual space, a visible object which is an object at least a part of which can be viewed from a visual line reference position. Thereby, if at least a part of the object can be viewed from the visual line reference position, the object is determined as a visible object, so that control for outputting or displaying other objects associated with the visible object and the entire visible object itself can be performed when outputting processing or display processing of the object is performed. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an object display control device and an object display control method.

  In recent years, services using AR (Augmented Reality) technology have been developed and provided. For example, a technique is known in which an object arranged around the location of a mobile terminal is acquired, and various information and an object including an image are superimposed and displayed on an image acquired by a camera provided in the mobile terminal. In this technique, the object displayed in a superimposed manner includes, for example, information related to the structure object in the virtual space or the real space, and thus it is possible to provide information related to the structure object in the image. . In addition, when a part of an object is shielded by another object, a technique for performing control so that the part is not displayed is known (for example, see Patent Document 1).

JP 2007-47972 A

  However, in the above related art relating to object display control, when a part of one object is located behind another object as viewed from the reference position of the line of sight, the entire one object is not displayed. On the other hand, in the AR technology field, there is a case where it is desired to display all of the one object even when a part of the one object is shielded by another object such as a structure. In particular, when one object is associated with another object and includes information about the other object, the one object is an object to be displayed to the user, and all of the one object is displayed. It is preferred that

  Accordingly, the present invention has been made in view of the above problems, and an object capable of outputting and displaying all objects to be displayed to the user in the object output process or display process in the AR technology. An object is to provide a display control device and an object display control method.

  In order to solve the above problems, an object display control device of the present invention is an object display control device that performs display control of an object arranged in a real space or a virtual space, and a reference position of a line of sight in the real space or the virtual space. A line-of-sight reference position information acquisition means for acquiring line-of-sight reference position information indicating the line-of-sight reference position, and a visible object that is an object that can be at least partially visible from the line-of-sight reference position among objects existing in the real space or virtual space Visible object discriminating means for discriminating between them is provided.

  In order to solve the above problems, an object display control method of the present invention is an object display control method in an object display control device that performs display control of an object arranged in a real space or a virtual space, and A line-of-sight reference position information acquisition step for acquiring line-of-sight reference position information indicating a line-of-sight reference position that is a line-of-sight reference position in virtual space, and at least a part of the line-of-sight reference position among objects existing in real space or virtual space And a visible object determining step of determining a visible object that is a visible object.

  According to the object display control device and the object display control method of the present invention, if at least a part of the object is visible from the line-of-sight reference position, the object is determined as a visible object. When performing the above, it is possible to control to output or display all other objects associated with the visible object and the visible object itself. Thereby, it is possible to output and display the object to be displayed to the user.

  The object in the present invention includes an object indicating a structure and an object indicating information associated with the structure. The structure includes all objects existing on the ground surface, and includes not only buildings but also objects formed by natural topography. Further, the structure includes not only a structure in the real space but also a structure virtually provided in the virtual space. An object representing information associated with a structure includes various text information and images related to the structure.

  Further, the object display control device according to the present invention is viewed from an object information acquisition unit that acquires object information including information that can define an area occupied by an object in the real space or the virtual space, and the gaze reference position based on the object information. Object tangent angle calculating means for calculating an object tangent angle that is an angle formed by an object tangent that is a line of sight passing through the end of the object and a predetermined reference direction, and an object distance that is a distance between the line of sight reference position and the object is calculated. An object distance calculating means, and the visible object determining means is a positional relationship between objects determined using the object tangent angle calculated by the object tangent angle calculating means and the object distance calculated by the object distance calculating means. Based on Characterized in that to determine the visual object.

  In this case, the positional relationship between the objects is determined using the object tangent angle and the object distance. Then, based on the positional relationship between the objects, when viewed from the line-of-sight reference position, all of the objects can be visually recognized, or at least a part of the objects that can be visually recognized even if they are hidden by other objects are appropriately determined as visible objects. Is done.

  In the object display control device of the present invention, the object information includes object vertex coordinates that are coordinates of the vertices of the area occupied by the object on the plane, and the object tangent angle calculation means passes the line-of-sight reference position and the vertex coordinates. A straight line is obtained as an object tangent, and an object tangent angle is calculated based on the object tangent.

  When the area occupied by an object in a planar shape can be defined by object vertex coordinates, a straight line passing through the coordinates indicating the line-of-sight reference position and the object vertex coordinates is obtained as the object tangent. Therefore, the object tangent angle can be easily calculated. It becomes possible.

  In the object display control device of the present invention, the object distance calculation means calculates the distance between the line-of-sight reference position and the representative position as the object distance when the object information includes representative coordinates indicating the location of the object, If the object information includes object vertex coordinates that are the coordinates of the vertex of the area occupied by the object on the plane, the distance between the line-of-sight reference position and the center of gravity calculated from the object vertex coordinates is calculated as the object distance. When the information includes position information indicating the geographical location of the object in the real space, the distance between the coordinates on the two-dimensional plane obtained based on the position information and the line-of-sight reference position is calculated as the object distance. It is characterized by doing.

  Information such as the representative coordinates indicating the location of the object, the barycentric position calculated from the object vertex coordinates, or the positional information indicating the geographical location of the object in the real space indicates the position of the object. The control device can appropriately calculate the object distance based on these pieces of information.

  The object display control device of the present invention further includes an object height direction tangent angle calculation unit, the object information includes height information indicating the height of the object, and the object height direction tangent angle calculation unit includes the height Based on the height information, the object height direction tangent angle, which is the angle formed by the object height direction tangent line that passes through the upper edge of the object viewed from the line of sight reference position and the horizontal direction in the virtual space or the real space, is calculated. The visible object discriminating means includes the object tangent angle calculated by the object tangent angle calculating means, the object distance calculated by the object distance calculating means, and the object height direction tangent calculated by the object height direction tangent angle calculating means. Position relation between objects determined using angle Characterized in that to determine the visible objects on the basis of.

  In this case, the positional relationship between the objects is determined using the object tangent angle, the object distance, and the object height direction tangent angle. And based on the positional relationship between the objects, when viewed from the line-of-sight reference position, even if the entire object is visible or partially hidden by another object, at least a part on both sides or above the other object Can be appropriately identified as a visible object.

  The object display control device according to the present invention further includes object information storage means for storing object information, and the object information acquisition means acquires object information stored in the object information storage means. . In this case, the object information acquisition unit can reliably acquire the object information.

  Further, the object display control device of the present invention provides object information related to an accompanying object that is an object including related object information indicating an association with another object as object information, and the other object indicated in the related object information of the accompanying object. It further comprises object information output means for outputting when is a visible object.

  In this case, since the associated object is output when the other object indicated in the associated object information of the associated object is a visible object, the associated object is output when the object output process or display process is performed. It is possible to control such that all of these are output or displayed. Thereby, it is possible to output and display the object to be displayed to the user.

  In the object display control device of the present invention, the object information output means further includes object information output means for outputting object information related to the visible object determined by the visible object determination means.

  In this case, since the object information of the object determined as the visible object is output, it is possible to control to output or display all of the object when the object output process or display process is performed. Thereby, the output / display of the object to be displayed to the user is suitably performed.

  The object display control device of the present invention further includes object information output means, and the visible object determination means attaches a visible attribute indicating that the object is a visible object to the object information of the visible object, and the object information The output means may output the object information of the object located within a predetermined distance set in advance from the line-of-sight reference position together with the visible attribute.

  In this case, the mobile terminal that has received the object information can determine and control whether or not to display the object when performing the object display process. Thereby, the display of the object which should be displayed with respect to a user is performed suitably.

  It is possible to output / display all objects to be displayed to the user in the object output process or display process in the AR technology.

It is a block diagram which shows the functional structure of an object display control apparatus. It is a hardware block diagram of an object display control device. It is a figure which shows the example of the structure of the object information storage part, and the data memorize | stored. It is a figure which shows the example of an object tangent angle and an object distance. It is a flowchart which shows the processing content of the object display control method implemented in an object display control apparatus. It is a block diagram which shows the functional structure of the object display control apparatus which concerns on 2nd Embodiment. It is a figure which shows the example of the structure of the object information storage part which concerns on 2nd Embodiment, and the data stored. It is a figure which shows the example of an object height direction tangent angle. It is a block diagram which shows the functional structure of the object display control apparatus which concerns on 3rd Embodiment.

  An embodiment of an object display control device according to the present invention will be described with reference to the drawings. If possible, the same parts are denoted by the same reference numerals, and redundant description is omitted.

(First embodiment)
FIG. 1 is a block diagram showing a functional configuration of an object display control apparatus 1 according to the first embodiment. FIG. 1 also shows a functional configuration of the mobile terminal 2 that can communicate with the object display control device 1. The object display control device 1 is a device that performs display control of an object arranged in a real space or a virtual space, and the object display control device 1 of the present embodiment is configured by a computer such as a server.

  The mobile terminal 2 is a device that receives object information from the object display control device 1 and displays an object based on the received object information. For example, an object can be superimposed and displayed on an image of a real environment acquired by an imaging device (not shown) included in the mobile terminal 2. The object in the display image is arranged at a position indicated by the coordinates of the object included in the object information in the real environment space in the display image. Accordingly, it is possible to display the object associated with the structure included in the real environment image.

  In the present embodiment, the object includes a structure object that is an object that roughly represents a structure, and an information object (an associated object) that is an object that represents information associated with the structure. The structure includes all objects existing on the ground surface, and includes not only buildings but also objects formed by natural topography. Further, the structure includes not only a structure in the real space but also a structure virtually provided in the virtual space. The information object representing the information associated with the structure includes various text information and images related to the structure, and is associated with the structure object indicating the structure.

  The present embodiment is also intended to perform display control of information objects against the background of AR technology. The user desires to obtain information about structures that are within the field of view. For this reason, when at least a part of a certain structural object is visible when viewed from the reference position of the user's line of sight, all the information objects associated with the structural object are displayed to the user. Control is required. In addition, when information such as the position, size, or area is defined in the information object itself and only at least a part of the information object is visible when viewed from the reference position of the user's line of sight, the information object It is necessary to control such that all of the above are displayed to the user.

  Functionally, the object display control device 1 has a line-of-sight reference position information acquisition unit 10 (line-of-sight reference position information acquisition unit), an object information storage unit 11 (object information storage unit), and an object information acquisition unit 12 (object information acquisition unit). ), An object tangent angle calculation unit 13 (object tangent angle calculation unit), an object distance calculation unit 14 (object distance calculation unit), a visible object determination unit 15 (visible object determination unit), and an object information output unit 16 (object information output unit). ).

  FIG. 2 is a hardware configuration diagram of the object display control device 1. As shown in FIG. 2, the object display control device 1 physically includes a CPU 101, a RAM 102 and a ROM 103 which are main storage devices, a communication module 104 which is a data transmission / reception device such as a network card, an auxiliary device such as a hard disk and a flash memory. The computer system includes a storage device 105, an input device 106 such as a keyboard and mouse as input devices, and an output device 107 such as a display. Each function shown in FIG. 1 has a communication module 104, an input device 106, and an output device 107 under the control of the CPU 101 by loading predetermined computer software on the hardware such as the CPU 101 and the RAM 102 shown in FIG. This is realized by reading and writing data in the RAM 102 and the auxiliary storage device 105. Again, with reference to FIG. 1, each function part of the object display control apparatus 1 is demonstrated in detail.

  The line-of-sight reference position information acquisition unit 10 is a part that acquires line-of-sight reference position information that is the reference position of the user's line of sight from the mobile terminal 2. The position information of the mobile terminal 2 in the present embodiment indicates the reference position of the line of sight in the virtual space or the real space when the object is displayed on the mobile terminal 2, and is, for example, coordinate information represented by latitude and longitude.

  The object information storage unit 11 is a storage unit for storing object information that is information about an object. FIG. 3 is a diagram illustrating an example of the configuration of the object information storage unit 11 and the stored object information.

  FIG. 3A is a diagram illustrating an example of object information of a structure object. As shown in FIG. 3A, the object information storage unit 11 associates a structure object with a structure object ID that uniquely identifies the structure object, and uses the structure name, address, representative coordinates, and vertex coordinates as structure information. I remember it.

  The representative coordinates shown in FIG. 3A are coordinates (latitude, longitude) indicating an arbitrary point in the area occupied by the structure. For example, the center of gravity of the area occupied by the structure or the structure It is the coordinate of one point among a plurality of vertices forming the outline. The vertex coordinates shown in FIG. 3A are the coordinates (latitude and longitude) of the vertex forming the outline of the structure, and information that can define the area occupied by the structure object on the two-dimensional plane. It is. The object information shown in FIG. 3A has four vertex coordinates, but more vertex coordinates may be included to indicate the shape of a complex structure. The address shown in FIG. 3A is information indicating the geographical location of the structure in the real space.

  FIG. 3B is a diagram illustrating an example of the object information of the information object. The object information storage unit 11 stores the object name, address, representative coordinates, and vertex coordinates as structure information in association with an information object ID that uniquely identifies the information object. The representative coordinates shown in FIG. 3B are coordinates (latitude, longitude) indicating an arbitrary point in the area occupied by the information object. For example, the center of gravity of the area occupied by the information object, the information object It is the coordinate of one point among a plurality of vertices forming the outline. The vertex coordinates shown in FIG. 3B are the coordinates (latitude and longitude) of the vertex forming the outline of the information object, and information that can define the area occupied by the information object on the two-dimensional plane. The address shown in FIG. 3B is information indicating the geographical location of the information object in the real space.

  FIG. 3C is a diagram illustrating an example of the object information of the information object. The object information of the information object shown in FIG. 3C is information related to the related structure object ID (related object information) instead of the object information shown in FIG. 3B including information related to the vertex coordinates. Is included. The related structure object ID is information indicating an association with another structure object. In other words, the information object related to the object information shown in FIG. 3C is an accompanying object accompanying the object shown in the related structure object ID.

  The related structure object ID is set and stored in advance in the object information storage unit 11, for example. Moreover, it is good also as setting by the function part (not shown) with which the object display control apparatus 1 is provided based on the positional relationship of an information object and a structure object.

  For example, when the structure object and the information object both have representative coordinates as object information, the distance between the locations of both objects specified by the representative coordinates is within a predetermined distance. In addition, the object ID of the structure object may be stored as the related structure object ID of the information object. Here, the fixed distance can be set to 20 meters, for example. When the object information does not include the representative coordinates and the vertex coordinates are included, the coordinates of the barycentric position calculated from the plurality of vertex coordinates can be used instead of the representative coordinates. .

  Further, when both the structure object and the information object have addresses as object information, when the addresses of both objects coincide with each other more than a certain level, the object ID of the structure object is related to the related structure of the information object. It may be stored as a physical object ID. For example, a so-called string analysis method can be used for the address match determination.

  In the present embodiment, the object information storage unit 11 is provided in the object display control device 1, but may be provided in another device that can communicate with the object display control device 1.

  The object information acquisition unit 12 is a part that acquires object information stored in the object information storage unit 11. Specifically, the object information acquisition unit 12 acquires line-of-sight reference position information from the line-of-sight reference position information acquisition unit 10. Subsequently, the object information acquisition unit 12 refers to the object information storage unit 11 and acquires object information of objects existing within a predetermined distance set in advance from the line-of-sight reference position. Here, the predetermined distance is set to a distance of 500 meters, for example.

  The object tangent angle calculation unit 13 is a part that calculates an object tangent angle that is an angle formed by an object tangent that is a line of sight passing through an end of the object viewed from the line-of-sight reference position and a predetermined reference direction based on the object information. . With reference to FIG. 4A, the object tangent angle calculation processing by the object tangent angle calculation unit 13 will be specifically described.

The object tangent angle calculation unit 13 first sets a two-dimensional coordinate system with the line-of-sight reference position as the origin. Here, as the reference direction for calculating the object tangent angle, for example, the X-axis direction can be set. Subsequently, the object tangent angle calculation unit 13 generates, as an object tangent, a line of sight that passes through the origin and that passes through the end of the object _SN viewed from the line-of-sight reference position. Then, the object tangent angle calculation unit 13 calculates, as the object tangent angle, the maximum angle θ _maxN that is the maximum angle and the minimum angle θ _minN that is the minimum angle among the angles formed by the generated object tangent and the X axis. To do. In FIG. 4A, the maximum angle θ _maxA and the minimum angle θ _minA generated for each of the object S _A and the object S _B , and the maximum angle θ _maxB and the minimum angle θ _minB are shown.

  As shown in the example of FIG. 4A, when the object vertex coordinates that are the coordinates of the vertex of the region occupied by the object on the two-dimensional plane are included in the object information, the object tangent angle calculation unit 13 A straight line passing through the line-of-sight reference position and the vertex coordinates is obtained as the object tangent, and the object tangent angle can be calculated based on the object tangent.

The object distance calculation unit 14 is a part that calculates an object distance that is a distance between the line-of-sight reference position and the object. An example of calculating the object distance will be specifically described. When the object information includes representative coordinates indicating the location of the object, the object distance calculation unit 14 uses the distance between the line-of-sight reference position and the representative position as the object distance. calculate. When the object information includes object vertex coordinates that are the coordinates of the vertices of the area occupied by the object on the two-dimensional plane, the object distance calculation unit 14 calculates the centroid position calculated from the line-of-sight reference position and the object vertex coordinates. Can be calculated as the object distance. In addition, when the object information includes position information indicating the geographical location of the object in the real space, such as an address, the object distance calculation unit 14 on the two-dimensional plane obtained based on the position information The distance between the coordinates and the line-of-sight reference position can be calculated as the object distance. FIG. 4B is a diagram illustrating the object distances R _A and R _B calculated for each of the object S _A and the object S _B.

  The visible object discriminating unit 15 is a part that discriminates a visible object that is an object in which at least a part of the object existing in the real space or the virtual space can be visually recognized from the visual line reference position. More specifically, the visible object determination unit 15 determines the position between objects determined using the object tangent angle calculated by the object tangent angle calculation unit 13 and the object distance calculated by the object distance calculation unit 14. Visible objects are determined based on the relationship. Next, with reference to FIG. 4, the visible object discrimination process by the visible object discrimination unit 15 will be specifically described.

The determination target object on which discrimination between visible objects and object S _B, the positional relationship determination target object is judged a subject by positional relationship whether to shield the determination target object taken from the view reference position when the the object S _a, when the following formula (1) and (2) are satisfied together, the object S _B is an object that can not visible from gaze reference position.
θ _minA ≦ θ _minB <θ _maxB ≦ θ _maxA (1)
R _A <R _B (2)
Accordingly, the visible object determination unit 15, if any of the formulas (1) and (2) is not satisfied, the object S _B, that is not completely shielded by the object S _A, at least some visible It is determined as an object.

  The visible object determination unit 15 extracts one object information as a determination target object from the object information acquired by the object information acquisition unit 12 as an object existing within a predetermined distance set in advance from the line-of-sight reference position. All other objects other than one object information are extracted as positional relationship determination target objects, and the positional relationship is determined as described above. When the one object is determined as an object that can be at least partially viewed with respect to all the positional relationship determination target objects, the visible object determination unit 15 determines the one object as a visible object. . Note that the object extracted as the discrimination target object and the positional relationship determination target object here is a structure object (see FIG. 3A) and information object (see FIG. 3B) including information that can define a position and a region. ).

  The visible object determination unit 15 can send object information of an object determined as a visible object to the object information output unit 16. The visible object determination unit 15 may add attribute information indicating that the object is a visible object to the object information of the object determined as a visible object and store the attribute information in the object information storage unit 11.

  The object information output unit 16 is a part that outputs to the mobile terminal 2 object information of objects that should be displayed entirely on the mobile terminal 2. More specifically, when the structure object indicated by the related structure object ID of the information object is a visible object (see FIG. 3C), the object information output unit 16 sets object information related to the information object. Is output to the mobile terminal 2. In the example illustrated in FIG. 3C, when an object having the object ID “aaa” is determined as a visible object, the object information output unit 16 relates to the information object identified by the information object ID “zzz”. The object information is output to the mobile terminal 2.

  In addition, when the information object has information capable of defining the position and area as shown in FIG. 3B, the object information output unit 16 displays the object information regarding the information object determined as the visible object. It can be output to the mobile terminal 2.

  When attribute information indicating that the object is a visible object is attached to the object information of the object determined as the visible object by the visible object determining unit 15, the object information output unit 16 acquires the object information from the object information acquiring unit 12. It is good also as outputting all the made object information to the mobile terminal 2. FIG. In this case, on the mobile terminal 2 side, it is determined whether or not to display the object based on the attribute information indicating that the object is a visible object.

  In this embodiment, the line-of-sight reference position information acquisition unit 10, the object information storage unit 11, the object information acquisition unit 12, the object tangent angle calculation unit 13, the object distance calculation unit 14, the visible object determination unit 15, and the object information output unit 16 is provided in the object display control device 1, but each of the functional units 10 to 16 may be distributed and provided in devices that can communicate with each other.

  Next, functions of the mobile terminal 2 will be described. The mobile terminal 2 functionally includes a GPS 20, a position information transmission unit 22, an object information reception unit 23, and an object display unit 24. The mobile terminal 2 is a computer having the same configuration as the hardware configuration of the object display control device 1 shown in FIG. 2, and is configured by a device such as a mobile phone or a mobile terminal.

  The GPS 20 is a device that measures the location of the mobile terminal 2, and sends location information indicating the location of the location to the location information transmission unit 22 and the object display unit 24. The mobile terminal 2 can specify the visual field range of the user of the mobile terminal 2 or the visual field range of an imaging device (not shown) included in the mobile terminal 2 based on the position information. The mobile terminal 2 may further include an orientation sensor (not shown), and the orientation information detected by the orientation sensor may be used for specifying the visual field range.

  The position information transmitting unit 22 is a part that transmits position information indicating the location of the mobile terminal 2 to the object display control device 1. In the present embodiment, the position information is acquired by the GPS 20, but for example, positioning may be performed by a method such as WiFi, RFID tag, marker recognition, image recognition, and the position information may be acquired. .

  The object information receiving unit 23 is a part that receives the object information output from the object information output unit 16 of the object display control device 1. The object information receiving unit 23 sends the received object information to the object display unit 24.

  The object display unit 24 is a part that displays an object included in the object information acquired from the object information receiving unit 23 in association with the arrangement position of the object indicated in the object information. Specifically, the object display unit 24 displays an object arranged within the visual field range of the imaging device of the mobile terminal 2.

  In the present embodiment, the object information related to the information object identified as the visible object and the information object identified as the visible object is received by the object information receiving unit 23, and the information related to the object information is received. The object is displayed by the object display unit 24. Therefore, display of the information object to be displayed to the user is realized.

  When the object information receiving unit 23 receives all the object information acquired by the object information acquiring unit 12 including the objects determined as visible objects, the object display unit 24 is based on the received object information. The information object associated with the structure object determined as the visible object and the information object determined as the visible object may be displayed.

  Next, the operation of the object display control device 1 in the object display control method of this embodiment will be described with reference to FIG. FIG. 5 is a flowchart showing the processing contents executed in the object display control apparatus 1.

  First, the line-of-sight reference position information acquisition unit 10 acquires position information of the user's line-of-sight reference position from the mobile terminal 2 (S1, position information acquisition step). Subsequently, the object information acquisition unit 12 acquires object information of objects existing within a predetermined distance set in advance from the line-of-sight reference position indicated in the position information acquired in step S1 (S2).

  Next, the visible object discriminating unit 15 discriminates a structure object and an information object that are at least partially visible from the line-of-sight reference position as a visible object (S3, visible object discrimination step). The visible object is determined based on the positional relationship between the objects determined using the object tangent angle calculated by the object tangent angle calculating unit 13 and the object distance calculated by the object distance calculating unit 14.

  Subsequently, the object information output unit 16 outputs the information object associated with the structure object determined as the visible object and the information object determined as the visible object to the mobile terminal 2 (S4). In step S4, the object information output unit 16 outputs all the object information acquired by the object information acquisition unit 12 including the object information to which the attribute information indicating that the object is a visible object is attached to the mobile terminal 2. It is good as well. In this way, the process of this embodiment is complete | finished.

  In the object display control device 1 and the object display control method of the first embodiment described above, if at least a part of the object is visible from the line-of-sight reference position, the object is determined as a visible object by the visible object determination unit 15. Therefore, when the object output process is performed, it is possible to control to output all of the information object associated with the visible object and the information object itself identified as the visible object. Thereby, it is possible to output an object to be displayed to the user.

(Second Embodiment)
FIG. 6 is a block diagram illustrating a functional configuration of the object display control device 1 according to the second embodiment. The object display control device 1 according to the second embodiment includes an object height direction tangent angle calculation unit 17 (object height) in addition to the function units 10 to 16 included in the object display control device 1 according to the first embodiment. Direction tangent angle calculation means).

  The object height direction tangent angle calculation unit 17 is a straight line passing through the line-of-sight reference position, and the object height direction tangent that is in close contact with the object in the height direction of the object is the horizontal direction in the virtual space or the real space. This is a part for calculating an object height direction tangent angle which is an angle formed.

  FIG. 7 is a diagram illustrating an example of the configuration of the object information storage unit 11 and the object information of the stored structure object in the second embodiment. As shown in FIG. 7, the object information stored in the object information storage unit 11 includes a plurality of vertex coordinates (latitude, longitude, and so on) that can three-dimensionally define an area occupied by the structure object in virtual space or real space. Height). Thus, the height of the structure object can be taken into consideration in the visible object discrimination process. In the example of the structure object shown in FIG. 7, for convenience of explanation, the structure is defined as a rectangular parallelepiped with eight vertex coordinates. However, a structure with a more complicated shape is formed with more vertex coordinates. It may be defined.

Next, the object height direction tangent angle calculation processing by the object height direction tangent angle calculation unit 17 will be described in detail with reference to FIG. The arrangement of the objects S _A and object S _B shown in Fig. 8 corresponds to FIG. Also, the determination target object on which discrimination between visible objects and object S _B, positional relation determining a determining a subject by positional relationship whether to shield the determination target object taken from the view reference position the target object with the object _{S a.}

First, the object height direction tangent angle calculation unit 17 sets a coordinate system that includes the horizontal direction (H axis) and the height direction (Z axis) and has the line-of-sight reference position as the origin. The direction of the H axis, for example, on a horizontal plane including the gaze reference position, the object height direction tangent angle of the object S _B is taken in a direction such that maximum.

Subsequently, the object height direction tangent angle calculation unit 17 generates an object height direction tangent that is a line of sight passing through the upper end of the object viewed from the line-of-sight reference position. Then, the object height direction tangent angle calculation unit 17 calculates an object height direction tangent angle that is an angle formed by the generated object height direction tangent and the H axis. In FIG. 8, object height direction tangents L _A and L _B are generated for the objects S _A and S _B , and object height direction tangent angles θ _A and θ _B are generated. Further, in the example shown in FIG. 8, the contact points of the object height direction tangents L _A and L _{B in} the objects S _A and S _B are the coordinates (D _A , Z _A ) and (D _B , Z _B ), respectively. The tangent angles θ _A and θ _B in the object height direction are calculated by equations (3) and (4), respectively.
θ _A = arctan (Z _A / D _A ) (3)
θ _B = arctan (Z _B / D _B ) (4)

  The visible object determination unit 15 in the second embodiment includes an object tangent angle calculated by the object tangent angle calculation unit 13, an object distance calculated by the object distance calculation unit 14, and an object height direction tangent angle calculation unit 17. Visible objects are discriminated based on the positional relationship between the objects determined using the calculated object height direction tangent angle. Next, with reference to FIG.4 and FIG.8, the visible object discrimination | determination process by the visible object discrimination | determination part 15 in 2nd Embodiment is demonstrated concretely.

The determination target object on which discrimination between visible objects and object S _B, the positional relationship determination target object is judged a subject by positional relationship whether to shield the determination target object taken from the view reference position when the the object S _a, when the following formula (5) and (6) are satisfied together, the object S _B, in the two-dimensional plane, is completely shielded in the object S _a taken from the view reference position It is in the state.
θ _minA ≦ θ _minB <θ _maxB ≦ θ _maxA (5)
R _A <R _B (6)

However, even if both formula (5) and formula (6) hold, as shown in FIG. 8 (a), if formula (7) holds,
θ _A <θ _B (7)
From gaze reference position is visible at least part of the object S _B above object S _A.

On the other hand, when both Expression (5) and Expression (6) are satisfied and Expression (8) is satisfied as shown in FIG.
θ _A > θ _B (8)
Object S _B, in 3-dimensional space in a state of being completely shielded to the object S _A taken from the view reference position.

Accordingly, the visible object determination unit 15, the formula (5), if any of the formula (6) and (8) is not satisfied, the object S _B, of being completely shielded by the object S _A It is determined that the object is at least partially visible.

  After that, as in the first embodiment, the visible object determination unit 15 uses the object information acquired by the object information acquisition unit 12 as an object existing within a predetermined distance set in advance from the line-of-sight reference position. Object information is extracted as a discrimination target object, all other objects other than the one object information are extracted as positional relationship determination target objects, and the above-described determination of the positional relationship is performed. When the one object is determined as an object that can be at least partially viewed with respect to all the positional relationship determination target objects, the visible object determination unit 15 determines the one object as a visible object. .

  In the object display control device 1 according to the second embodiment described above, the positional relationship between objects is determined using the object tangent angle, the object distance, and the object height direction tangent angle. And based on the positional relationship between the objects, when viewed from the line-of-sight reference position, even if the entire object is visible or partially hidden by another object, at least a part on both sides or above the other object Can be appropriately identified as a visible object.

(Third embodiment)
FIG. 9 is a block diagram showing a functional configuration of the object display control device 1A according to the third embodiment. The object display control device 1 according to the first embodiment has a configuration of determining a non-display object based on position information transmitted from the mobile terminal 2 and outputting the object to the mobile terminal 2, for example, a device such as a server. (See FIG. 1). On the other hand, the object display control device 1A of the third embodiment has a configuration in which a visible object is determined based on the line-of-sight reference position information acquired in the own device, and the object is displayed. The object display control device 1A of the third embodiment is configured by devices such as a mobile phone and a mobile terminal, for example.

  Functionally, the object display control device 1A has a line-of-sight reference position information acquisition unit 10A (line-of-sight reference position information acquisition unit), an object information storage unit 11A (object information storage unit), and an object information acquisition unit 12A (object information acquisition unit). ), Object tangent angle calculation unit 13A (object tangent angle calculation unit), object distance calculation unit 14A (object distance calculation unit), visible object determination unit 15A (visible object determination unit), object display unit 16A (object information output unit) , An object height direction tangent angle calculation unit 17 (object height direction tangent angle calculation means) and a GPS 20A.

  The line-of-sight reference position information acquisition unit 10A is a part that acquires position information indicating the location of the object display control device 1A. The position information is measured by the GPS 20A. The line-of-sight reference position information acquisition unit 10A sends the acquired position information to the object information acquisition unit 12A. In the present embodiment, the position information is acquired by the GPS 20A. However, for example, positioning may be performed by a method such as WiFi, RFID tag, marker recognition, and image recognition, and the position information may be acquired. .

  The object information acquisition unit 12A, the object tangent angle calculation unit 13A, the object distance calculation unit 14A, and the visible object determination unit 15A are respectively the object information acquisition unit 12, the object tangent angle calculation unit 13, the object distance calculation unit 14 and the visible object in FIG. It has the same function as the object determination unit 15. Further, the object height direction tangent angle calculation unit 17A has the same function as the object height direction tangent angle calculation unit 17 in FIG.

  The object display unit 16A displays the information object associated with the structure object determined as the visible object by the visible object determination unit 15A and the information object determined as the visible object by the visible object determination unit 15A. This is a portion displayed in correspondence with the location of the object indicated in the object information. The object display unit 16A can be acquired from the visible object determination unit 15A or the object information storage unit 11A.

  Thereby, the object display unit 16A can superimpose and display an object on an image of a real environment acquired by an imaging device (not shown) included in the object display control device 1A, for example. The object in the display image is arranged at a position indicated by the coordinates of the object included in the object information in the real environment space in the display image. Thereby, it is possible to display the information object associated with the structure object included in the image of the real environment. The object display process by the object display unit 16A is an aspect of the object information output process.

  The GPS 20A is a device that measures the location of the object display control device 1A, and sends position information indicating the measured location to the line-of-sight reference position information acquisition unit 10A and the object display unit 16A. Note that the object display control device 1A may further include an orientation sensor (not shown), and the orientation information detected by the orientation sensor may be used for specifying the visual field range of the imaging device.

  The present invention has been described in detail based on the embodiments. However, the present invention is not limited to the above embodiment. The present invention can be variously modified without departing from the gist thereof.

  DESCRIPTION OF SYMBOLS 1, 1A ... Object display control apparatus, 10, 10A ... Gaze reference position information acquisition part, 11, 11A ... Object information storage part, 12, 12A ... Object information acquisition part, 13, 13A ... Object tangent angle calculation part, 14, 14A ... Object distance calculation unit, 15, 15A ... Visible object discrimination unit, 16 ... Object information output unit, 16A ... Object display unit, 17, 17A ... Object height direction tangent angle calculation unit, 22 ... Position information transmission unit, 23 ... object information receiving section, 24 ... object display section.

Claims (10)

An object display control device that performs display control of an object arranged in a real space or a virtual space,
Gaze reference position information acquisition means for acquiring gaze reference position information indicating a gaze reference position that is a reference position of the gaze in the real space or the virtual space;
Visible object discriminating means for discriminating, among the objects existing in the real space or the virtual space, a visible object that is the object that is at least partially visible from the line-of-sight reference position;
An object display control device comprising: Object information acquisition means for acquiring object information including information capable of defining an area occupied by an object in the real space or the virtual space;
An object tangent angle calculating means for calculating an object tangent angle that is an angle formed by an object tangent that is a line of sight passing through an end of the object viewed from the line of sight reference position and a predetermined reference direction based on the object information;
An object distance calculation means for calculating an object distance that is a distance between the line-of-sight reference position and the object;
The visible object discrimination means includes
Determining the visible object based on a positional relationship between the objects determined using the object tangent angle calculated by the object tangent angle calculating means and the object distance calculated by the object distance calculating means. The object display control device according to claim 1, wherein: The object information includes object vertex coordinates that are coordinates of vertices of an area occupied by the object on a plane,
The object tangent angle calculation means obtains a straight line passing through the visual line reference position and the vertex coordinates as the object tangent, and calculates the object tangent angle based on the object tangent. Object display control device. The object distance calculation means includes
When the object information includes representative coordinates indicating the location of the object, the distance between the line-of-sight reference position and the representative position is calculated as the object distance,
When the object information includes object vertex coordinates that are coordinates of vertices of the area occupied by the object on a plane, the distance between the line-of-sight reference position and the center of gravity calculated from the object vertex coordinates is the object distance. As
When the object information includes position information indicating a geographical location of the object in the real space, a distance between the coordinates on the two-dimensional plane obtained based on the position information and the line-of-sight reference position is calculated. The object display control device according to claim 2, wherein the object display control unit calculates the object distance. Further comprising an object height direction tangent angle calculation means,
The object information includes height information indicating the height of the object,
The object height direction tangent angle calculation means includes:
Based on the height information, the object height is an angle formed by an object height direction tangent that is a line of sight passing through the upper end of the object viewed from the line-of-sight reference position and a horizontal direction in the virtual space or the real space. Calculate the direction tangent angle,
The visible object discrimination means includes
The object tangent angle calculated by the object tangent angle calculating unit, the object distance calculated by the object distance calculating unit, and the object height direction tangent angle calculated by the object height direction tangent angle calculating unit The object display control device according to any one of claims 2 to 4, wherein the visible object is determined based on a positional relationship between the objects determined using. An object information storage means for storing the object information;
The object display control device according to claim 2, wherein the object information acquisition unit acquires the object information stored in the object information storage unit. When the object information related to the associated object, which is an object including the related object information indicating the association with another object as the object information, and the other object indicated in the related object information of the associated object is the visible object, The object display control device according to any one of claims 1 to 6, further comprising object information output means for outputting. The object information output means includes
The object display control device according to claim 7, further comprising: an object information output unit that outputs the object information related to the visible object determined by the visible object determination unit. Further comprising object information output means,
The visible object determining means attaches a visible attribute indicating that the object is a visible object to the object information of the visible object,
The object information output means outputs the object information of an object located within a predetermined distance set in advance from the line-of-sight reference position together with the visibility attribute. The object display control device described in 1. An object display control method in an object display control device that performs display control of an object arranged in a real space or a virtual space,
A line-of-sight reference position information acquisition step of acquiring line-of-sight reference position information indicating a line-of-sight reference position that is a line-of-sight reference position in the real space or the virtual space;
A visible object determination step of determining a visible object that is an object that can be visually recognized at least partially from a reference position of the line of sight among the objects existing in the real space or the virtual space;
An object display control method comprising:

Images