JP4922436B2 - Object display device and object display method - Google Patents

Description

  The present invention relates to an object display device and an object display method.

  In recent years, research on virtual reality (virtual reality) that forms a virtual reality space by computer graphics and augmented reality (AR: augmented reality) that adds information by processing images in the real space with a computer has been advanced. Recently, augmented reality technology (AR technology) has attracted attention. There are various modes for realizing the AR technology, and one of them is one using a camera-equipped mobile phone. The AR technology in a mobile phone transmits the location information of the mobile phone measured by GPS or the like to the server, and among the information registered in advance in the server, sends information on stores and facilities around the mobile phone to the terminal from the server. The augmented reality is realized by adding and displaying the acquired information to the landscape video. As an example of a specific service using such AR technology, there is a service that displays green information and hazard information of a golf course in a superimposed manner on a landscape video.

  In addition, the camera acquires an image, measures the camera position and orientation, reads the data stored at a predetermined address of the storage device based on the measured camera position and orientation, and acquires the read data with the camera. An AR technique for displaying an image combined with the image is disclosed (see, for example, Patent Document 1).

Japanese Patent No. 3700021

  In the AR technology for displaying various information on real space video acquired by a camera, the information is superimposed and displayed on the real space video as a graphics object such as an information balloon or an icon. In such a case, the display screen becomes very complicated when the amount of information to be displayed increases. Further, if the graphics objects are displayed so as to overlap each other, it is difficult to visually recognize information and to select the graphic objects. Such a problem is particularly prominent in mobile terminals such as mobile phones and PDAs equipped with small display devices. Further, in a mobile terminal employing a touch panel, it is extremely difficult to operate one of graphics objects that are densely arranged on the screen.

  Furthermore, when this AR technology is applied to navigation of a golf course, it is very easy to visually recognize the exact direction and distance of the green and bunker positions when green information and hazard information such as bunker are superimposed on each other. It becomes difficult.

  Therefore, the present invention has been made in view of the above problems, and in AR technology, even when the amount of information to be superimposed and displayed on a real space image is large, it is possible to suppress complication of the screen. It is an object to provide a possible object display device and object display method.

  In order to solve the above-described problem, an object display device of the present invention is an object display device that superimposes and displays an object on a real-space video acquired by a photographing unit, and includes position information for acquiring a current position of the object display device. An acquisition means; object information storage means for storing object information including object reference position information, which is information relating to the object and is information relating to a reference position in the real space of the object; A horizontal plane two-dimensional coordinate system setting means for setting a horizontal plane two-dimensional coordinate system including a straight line connecting the position of a specific target in space as one of the reference axes and having the current position of the object display device as an origin; An object in the horizontal two-dimensional coordinate system set by the coordinate system setting means Object reference position arrangement means for plotting object reference position information of object information stored in the information storage means, and a projection plane for projecting the object on which the object reference position information is plotted on a horizontal two-dimensional coordinate system A projection plane two-dimensional coordinate system setting means for setting a projection plane two-dimensional coordinate system having the horizontal and vertical directions on the projection plane as coordinate axes, and a projection plane two-dimensional set by the projection plane two-dimensional coordinate system setting means. A projection plane two-dimensional coordinate system dividing means for dividing each quadrant in the coordinate system into projection plane subareas which are small areas having a predetermined size and a predetermined coordinate value in the projection plane two-dimensional coordinate system; The object reference position information plotted in the horizontal plane two-dimensional coordinate system by the position arranging means is converted into the horizontal plane two-dimensional coordinate system. An object display position determining means for determining the display position of the object by arranging in the projection plane small area corresponding to the arrangement position of the object reference position information, and a projection plane on which the object is arranged by the object display position determining means. And display control means for controlling the display position of the object on the display screen based on the information regarding the area.

  In order to solve the above-described problem, an object display method of the present invention is an object display method for realizing an object superimposed display on an object display device that overlays and displays an object on a real-space video acquired by a photographing unit. A position information acquisition step for acquiring the current position of the object display device, and a straight line connecting the current position acquired in the position information acquisition step and the position of the specific target in real space as one of the reference axes. A horizontal plane two-dimensional coordinate system setting step for setting a horizontal plane two-dimensional coordinate system with the current position of the object display device as the origin, and an object reference position that is information related to the object and is information related to the reference position of the object in real space Object that stores object information including information An object reference position placement step for obtaining object information from the information storage means and plotting the object reference position information of the object information on the horizontal plane two-dimensional coordinate system set by the horizontal plane two-dimensional coordinate system setting step; Projection plane two-dimensional coordinate system setting step for setting a projection plane for projecting an object on which object reference position information is plotted, and setting a projection plane two-dimensional coordinate system with the horizontal and vertical directions on the projection plane as coordinate axes And each quadrant in the projection plane two-dimensional coordinate system set by the projection plane two-dimensional coordinate system setting step is a projection that is a small area having a predetermined size and a predetermined coordinate value in the projection plane two-dimensional coordinate system. Projection plane two-dimensional coordinate system dividing step to divide into small areas, and object reference position arrangement The object reference position information plotted in the horizontal plane two-dimensional coordinate system in the step is arranged in the small area of the projection plane corresponding to the arrangement position of the object reference position information in the horizontal plane two-dimensional coordinate system, thereby determining the display position of the object. An object display position determining step, and a display control step for controlling a display position on the display screen of the object based on information on a small projection plane area where the object is arranged in the object display position determining step. To do.

  According to the object display device and the object display method of the present invention, the reference position information of the object is arranged / plotted in the horizontal plane two-dimensional coordinate system based on the object information, and further, the object reference position information in the horizontal plane two-dimensional coordinate system is placed at the arrangement position. Based on this, the object is arranged in the corresponding projection plane small area. Then, the display position of the object is determined based on the projection surface small area where the object is arranged. As a result, the reference position of the object on the horizontal plane is reflected in the display position of the object on the display screen, so that the object is displayed neatly even when there is a large amount of information to be superimposed on the real space video. Therefore, it is possible to suppress complication of the screen.

  Further, in the object display device of the present invention, the object display position determining means, when the projection plane small area in which the object reference position information is arranged corresponds to a display prohibited area that is an area for prohibiting object display, The object is rearranged in a small area of the projection plane that does not correspond to the display prohibited area.

  According to this configuration, for example, by setting the projection surface small area in which other objects are arranged as the display prohibition area, it is possible to avoid the objects from being overlapped and displayed. Therefore, even when the amount of objects to be superimposed and displayed on the real space video is large, the complexity of the screen is suppressed.

  The object display device of the present invention further includes an orientation acquisition unit that acquires the imaging direction of the imaging unit, and the projection plane two-dimensional coordinate system setting unit is a plane orthogonal to the imaging direction acquired by the orientation acquisition unit, or A plane orthogonal to the horizontal component of the photographing direction is set as a projection plane, and a projection plane two-dimensional coordinate system is set with the horizontal and vertical directions on the projection plane as coordinate axes. Thereby, a projection plane two-dimensional coordinate system suitable for controlling the display of the object is set.

  In the object display device of the present invention, the projection plane two-dimensional coordinate system setting means is drawn along a horizontal component of the photographing direction of the photographing means starting from a position at a predetermined height at the current position of the object display device. The coordinate axis in the projection plane two-dimensional coordinate system is set with the intersection of the straight line and the projection plane as the origin.

  In the object display device of the present invention, the projection plane two-dimensional coordinate system setting means perspectively projects the specific target on the projection plane when the position at a predetermined height at the current position of the object display device is the viewpoint. The coordinate axis in the projection plane two-dimensional coordinate system is set with the position as the origin.

  According to these configurations, for example, it is possible to set the coordinate axes in the projection plane two-dimensional coordinate system according to the purpose in the display control such as how to set the display prohibited area in the projection plane two-dimensional coordinate system. It becomes.

  In the object display device of the present invention, the object display position determining means is an object arranged in the horizontal plane two-dimensional coordinate system by the object reference position arranging means with the position of a predetermined height at the current position of the object display device as a viewpoint. The object is arranged in a small area of the projection plane corresponding to a position where the reference position information is projected on the projection plane.

  According to this configuration, the object is arranged in the small area of the projection plane to which the actual location in the real space image acquired by the photographing unit belongs. As a result, it is possible to provide information by displaying the object closely associated with the position in the real space.

  In the object display device of the present invention, the object display position determining means sets the projection area small area where the object is arranged as a display prohibited area.

  According to this configuration, it is avoided that the objects are displayed in a superimposed manner. Therefore, even when the amount of objects to be superimposed on the real space video is large, the complexity of the screen is suppressed and the visibility of the objects is improved.

  Further, in the object display device of the present invention, the object display position determining means sets the projection plane small area located within a predetermined distance from the vertical coordinate axis in the projection plane two-dimensional coordinate system as the display prohibited area. It is characterized by setting.

  According to this configuration, since no object is arranged in the vicinity of the vertical coordinate axis in the projection plane two-dimensional coordinate system, visibility of an area corresponding to the vicinity of the vertical coordinate axis in the superimposed real space image is improved. For example, by setting the projection plane two-dimensional coordinate system so that the vertical coordinate axis overlaps the position of the specific target in real space, the specific target and the upper and lower sides of the specific target on the display screen It is possible to display the area located at without being obstructed by the object.

  Further, in the object display device of the present invention, the object display position determining means uses a projection plane small area positioned within a predetermined distance from the horizontal coordinate axis in the projection plane two-dimensional coordinate system as a display prohibited area. It is characterized by setting.

  According to this configuration, the object is not arranged in the vicinity of the horizontal coordinate axis in the two-dimensional coordinate system of the projection plane, so that the visibility of the area corresponding to the vicinity of the horizontal coordinate axis in the superimposed real space image is improved. For example, by setting the projection plane two-dimensional coordinate system so that the horizontal coordinate axis overlaps the position of the specific target in the real space, the same level as the specific target on the specific target and the display screen A region located at a height can be displayed without being blocked by the object.

  Further, in the object display device of the present invention, the object display position determining means displays a projection plane small area located within a predetermined distance set in advance from the position of the specific target that is perspective-projected on the projection plane. It is characterized by setting to.

  According to this configuration, the object is not arranged in the vicinity of the position of the specific target in the projection plane and the projection plane two-dimensional coordinate system, so the visibility of the area corresponding to the vicinity of the specific target in the superimposed real space image is improved. To do.

  In the object display device of the present invention, the object display position determining means sets the projection area small area corresponding to the area for displaying the specific graphic object on the display screen of the object display device as the display prohibited area. Features.

  According to this configuration, since the object is not arranged in the small area of the projection plane corresponding to the area for displaying the specific graphic object on the display screen, the specific graphic object can be displayed without being obstructed by the object. Become.

  In the object display device of the present invention, the object display position determining means rearranges the object in the adjacent projection plane small area when the projection plane small area in which the object is arranged corresponds to the display prohibited area. It is characterized by doing.

  According to this configuration, when an object is arranged in the projection surface small area corresponding to the display prohibited area, the object is rearranged in the projection surface small area adjacent to the projection surface small area. The object can be displayed in an area near the location.

  Further, in the object display device of the present invention, the object display position determining means, when the projection plane small area where the object is arranged corresponds to the display prohibited area, the projection plane small area in the projection plane two-dimensional coordinate system. The object is rearranged in a small area of the projection plane indicated by a coordinate value obtained by increasing or decreasing the absolute value of the vertical coordinate value by a predetermined value.

  According to this configuration, for example, when a plurality of objects are arranged in one small projection plane area corresponding to the display prohibited area, the plurality of objects are sequentially arranged and rearranged in the vertical direction. It becomes. Accordingly, it is possible to display a plurality of mutually related objects associated with the same place while highlighting the association on the display screen. The predetermined value for increasing or decreasing the coordinate value can be set to 1, for example. The predetermined value may be a value other than 1.

  Further, in the object display device of the present invention, the object display position determining means, when the projection plane small area where the object is arranged corresponds to the display prohibited area, the projection plane small area in the projection plane two-dimensional coordinate system. The object is rearranged in a small area of the projection plane indicated by a coordinate value obtained by increasing or decreasing the absolute value of the horizontal coordinate value by a predetermined value.

  According to this configuration, for example, when a plurality of objects are arranged in one small projection plane area corresponding to the display prohibited area, the plurality of objects are sequentially arranged and rearranged in the horizontal direction. It becomes. Accordingly, it is possible to display a plurality of mutually related objects associated with the same place while highlighting the association on the display screen. The predetermined value for increasing or decreasing the coordinate value can be set to 1, for example. The predetermined value may be a value other than 1. In addition, according to the combination of the above configurations, the absolute value of the vertical coordinate value in the projection plane two-dimensional coordinate system is increased or decreased by a predetermined value, and the horizontal coordinate value of the object placed in the display prohibited area is increased. It is also possible to rearrange the object in the small area of the projection plane indicated by the coordinate value obtained by increasing or decreasing the absolute value of.

  Further, in the object display device of the present invention, the object display position determining means, when a plurality of objects are arranged in one small projection plane area, based on a preset priority of the objects, One object is arranged in one small projection plane area, and another object is rearranged in a small projection plane area adjacent to one projection plane small area.

  According to this configuration, when a plurality of objects are arranged in one small projection plane area, an object having a higher priority is arranged in the one projection plane small area. This makes it possible to set the one projection plane small area as a display-prohibited area, so that another object is a projection plane small area other than one projection plane small area, and one projection plane small area Can be rearranged in a small area of the projection plane adjacent to the.

  Further, in the object display device of the present invention, the object display position determining means converts the projection plane two-dimensional coordinate system into a plurality of projection planes based on a projection plane division rule for dividing a preset projection plane two-dimensional coordinate system. The projection plane is divided into medium areas including small areas, a predetermined arrangement order is set for a plurality of projection plane small areas included in each projection plane area, and an object having a higher priority set in advance has an arrangement order. The object arranged in the projection plane area is rearranged so as to be arranged in a higher projection plane small area.

  In this configuration, an object set with a high priority indicates more important information, and a small projection plane area set with a high arrangement order corresponds to an area that is more easily visible on the display screen. is there. Therefore, according to this configuration, it is possible to display an object indicating important information at a position that is easier to visually recognize on the display screen.

  Further, in the object display device of the present invention, the object display position determining means is a plurality of objects related to one object in real space, and one end on the side where the viewpoint position of the object display device in the one object exists When determining the display position of the object indicating the information related to the one end and the information indicating the information related to the other end on the opposite side of the one object, the object indicating the information related to the one end and the information related to the other end are determined. The objects shown are each arranged in a small area on the projection plane located in the lower and upper quadrants of the horizontal coordinate axis in the projection plane two-dimensional coordinate system.

  According to this configuration, it is possible to display two objects indicating information related to one end and the other end of a predetermined object while allowing the user to recognize the relationship between each other and the positional relationship of the one object. Become.

  In the object display device of the present invention, each quadrant in the horizontal plane two-dimensional coordinate system set by the horizontal plane two-dimensional coordinate system setting means has a predetermined size and a predetermined coordinate value in the horizontal plane two-dimensional coordinate system. A horizontal plane two-dimensional coordinate system dividing unit that divides the horizontal plane into a small area that is a small area, and the object reference position arranging unit is configured to obtain the object reference position information based on the object information stored in the object information storage unit. The object display position determining means plots in the horizontal plane small area corresponding to the reference position indicated in the object reference position information, and the object display position determining means is based on the correspondence between the preset horizontal plane small area and the projection plane small area. The object reference position information plotted in the small horizontal plane area by Characterized in that, characterized in that disposed in the projection plane small area associated with the horizontal plane small area.

  According to this configuration, based on the object information, the object reference position information is arranged in the horizontal plane small area in the horizontal plane two-dimensional coordinate system, and is further arranged in the projection plane small area corresponding to the horizontal plane small area. Then, the display position of the object is determined based on the projection surface small area where the object reference position information is arranged. As a result, the object is displayed in a small area of the projection plane in which the positional relationship on the horizontal plane is reflected. Therefore, it is easy to intuitively recognize the position where the object is associated on the display screen. In addition, since the spatial spread in the horizontal plane is reflected on the projection plane and the display screen, there is a high probability that the objects will be arranged with a moderate spread on the display screen without being crowded. Therefore, even when the amount of objects to be superimposed and displayed on the real space video is large, it is possible to suppress complication of the screen.

  In the object display device of the present invention, the object reference position arrangement unit prohibits the placement of the object in the horizontal plane small area associated with the projection plane small area corresponding to the display prohibited area in the projection plane two-dimensional coordinate system. If the horizontal small area where the object reference position information is placed corresponds to the placement prohibited area, the object reference position information is rearranged in a horizontal small area that does not correspond to the placement prohibited area. It is characterized by doing.

  According to this configuration, the object is prevented from being placed in the display prohibited area in the projection plane two-dimensional coordinate system. Therefore, since the object is not displayed in an area where it is not preferable to superimpose the object on the display surface, the visibility of the display screen is improved.

  In the object display device of the present invention, the object reference position arrangement means sets a horizontal plane small area positioned within a predetermined distance from a reference axis in the horizontal plane two-dimensional coordinate system as an arrangement prohibition area, When the horizontal plane small area in which the position information is arranged corresponds to the arrangement prohibition area, the object reference position information is rearranged in the horizontal plane small area not corresponding to the arrangement prohibition area.

  According to this configuration, for example, when the horizontal plane small area and the projection plane small area are associated with each other so that the reference axis in the horizontal plane two-dimensional coordinate system and the vertical coordinate axis in the projection plane two-dimensional coordinate system coincide with each other. In addition, the object is not arranged in the vicinity of the vertical coordinate axis in the projection plane two-dimensional coordinate system. Therefore, the visibility of the region corresponding to the vicinity of the coordinate axis in the vertical direction in the superimposed real space image is improved. For example, by setting the projection plane two-dimensional coordinate system so that the vertical coordinate axis overlaps the position of the specific target in real space, the specific target and the upper and lower sides of the specific target on the display screen It is possible to display the area located at without being obstructed by the object.

  Further, in the object display device of the present invention, the object reference position arranging unit is configured to select a plurality of objects based on a priority set in advance for the object when a plurality of object reference position information is arranged in one horizontal plane small area. One object reference position information among the reference position information is arranged in one horizontal plane small area, and another object reference position information is rearranged in a horizontal plane small area adjacent to one horizontal plane small area. .

  According to this configuration, when a plurality of object reference position information is arranged in one horizontal plane small area, the object reference position information of an object having a higher priority is arranged in the one horizontal plane small area. It is possible to arrange one piece of object reference position information for each small horizontal plane area based on the priorities. Since the display position of the object in the projection plane two-dimensional coordinate system is determined based on the arrangement of the object reference position information, the overlapping display of the objects is prevented, and the visibility of the display surface is improved.

  Further, in the object display device of the present invention, the object reference position arranging means is configured such that when a plurality of object reference position information is arranged in one horizontal plane small area, the object reference position is determined from any dimension axis in the horizontal plane two-dimensional coordinate system. Based on the distance to the position indicated in the position information, one object reference position information among a plurality of object reference position information is arranged in one horizontal plane small area, and the other object reference position information is set in one horizontal plane small area. It rearranges in the horizontal surface small area adjacent to.

  According to this configuration, when a plurality of object reference position information is arranged in one horizontal plane small area, the object reference position information closer to the coordinate axis in the horizontal two-dimensional coordinate system is displayed in the one horizontal plane small area. Since it is arranged, one object reference position information can be arranged for each small horizontal plane area based on the distance from the coordinate axis. Since the display position of the object in the projection plane two-dimensional coordinate system is determined based on the arrangement of the object reference position information, the overlapping display of the objects is prevented, and the visibility of the display surface is improved.

  Further, in the object display device of the present invention, the object reference position arranging means includes a horizontal plane two-dimensional coordinate by a straight line that passes through the current position of the object display device and is orthogonal to a straight line that connects the current position and the position of the specific target in real space. Of the regions obtained by dividing the system, the object position processing is performed for an object located in a region where the specific target exists.

  According to this configuration, only an object with a high probability of being a display target is set as a processing target, and placement processing regarding other objects is not performed, so the processing load is reduced.

  In the object display device of the present invention, the projection plane two-dimensional coordinate system setting means has a predetermined radius centered on the current position of the object display device, and the axial direction is directed to a predetermined direction set in advance. A virtual cylinder is set, and a projection plane cylindrical coordinate system having two directions on the inner side surface of the set cylinder as coordinate axes is set as a projection plane two-dimensional coordinate system. As a result, it is possible to display and display the object in which the positional relationship between the object in the real space and the object associated with the object is more appropriately reflected.

  Further, in the object display device of the present invention, the object display position determining means sets a straight line passing through the arrangement position of one object with the center position as a starting point in the projection plane cylindrical coordinate system. Relocating an object in the projection surface small area that is closest to the projection surface small area in which no other object is arranged and the one object is arranged in the projection surface small area through which the straight line passes. Features.

  In the object display device of the present invention, the object reference position arrangement means sets a straight line passing through the arrangement position of one object reference position with the center position as a starting point in the horizontal plane two-dimensional coordinate system. Of the horizontal plane small areas through which the straight line passes, the object reference position is set in the horizontal plane small area closest to the horizontal plane small area where no other object reference position is arranged and the one object reference position is arranged. It is characterized by rearranging.

  Further, in the object display device of the present invention, the object display position determining means sets a straight line that passes through the position where one object is placed with the specific target as the center in the projection plane two-dimensional coordinate system. In the projection plane small area through which the straight line passes, no object is arranged, and the object is rearranged in the projection plane small area closest to the projection plane small area in which the one object is arranged. It is characterized by.

  According to these configurations, since the object is arranged at a position close to the target in the real space to which the object is associated on the display screen, natural and orderly expression is possible while showing the relationship between the object and the target. It becomes.

  In the AR technology, even when the amount of information to be superimposed and displayed on the real space video is large, it is possible to suppress the complication of the screen.

It is a block diagram which shows the functional structure of the object display apparatus which concerns on 1st Embodiment. It is a hardware block diagram of an object display apparatus. It is a figure which shows the example of the structure of the object information storage part, and the data memorize | stored. FIG. 2 is a diagram schematically illustrating a golf course and an example of a horizontal plane two-dimensional coordinate system set by a horizontal plane two-dimensional coordinate system setting unit. It is the figure which represented the position of the object in a golf course typically, and the figure which shows the object arrange | positioned in a horizontal surface two-dimensional coordinate system. It is a figure for demonstrating the setting process of the projection surface two-dimensional coordinate system by the projection surface two-dimensional coordinate system setting part. It is a figure which shows the example of the setting of the coordinate axis in a projection surface two-dimensional coordinate system. It is a figure which shows the example of the display prohibition area | region set to the projection plane two-dimensional coordinate system, and the figure which shows the example of the object arrange | positioned at a projection plane two-dimensional coordinate system. It is a figure which shows the example of the display prohibition area | region set in the projection surface two-dimensional coordinate system, and the figure which shows the example of the rearrangement of an object. It is a figure which shows the example of the display prohibition area | region set in the projection surface two-dimensional coordinate system, and the figure which shows the example of the rearrangement of an object. It is a figure which shows the example of a setting of a display prohibition area | region. It is a figure which shows the example of the rearrangement of an object. It is a figure which shows the example of the arrangement | positioning order of the projection surface small area in the rearrangement of an object. It is a figure which shows the example of the display prohibition area | region set in the projection surface two-dimensional coordinate system. It is a figure for demonstrating the setting of the middle area which is a unit area | region for the rearrangement of an object. It is a figure for demonstrating rearrangement of the object for every set middle area. It is a figure which shows the example of the object arrange | positioned and rearranged in the projection surface two-dimensional coordinate system by the object display position determination part. FIG. 18 is an example of a display screen on the display unit when an object is arranged in the projection plane two-dimensional coordinate system as illustrated in FIG. It is a figure which shows the other example of the object arrange | positioned and rearranged in the projection surface two-dimensional coordinate system by the object display position determination part. 4 is a flowchart showing processing contents executed in the object display device 1. It is a block diagram which shows the functional structure of the object display apparatus 1 which concerns on 2nd Embodiment. It is the figure which represented the position of the object in a golf course and a golf course typically, and the figure which shows the horizontal surface two-dimensional coordinate system and the horizontal surface small area produced | generated by dividing | segmenting a horizontal surface two-dimensional coordinate system. It is a figure which shows the example of the structure of the object information storage part, and the data memorize | stored. It is a figure which shows the example of the arrangement | positioning prohibition area | region set in the horizontal plane two-dimensional coordinate system, the example which shows the example of rearrangement of an object, and the figure which shows the example of the object arrange | positioned in the projection plane small area in a projection plane two-dimensional coordinate system. . It is a figure which shows the other example of the setting of a layout prohibition area | region, and the rearrangement of an object. It is a flowchart which shows the processing content implemented in the object display apparatus of 2nd Embodiment. It is a figure for demonstrating the setting process of the projection surface two-dimensional coordinate system in 3rd Embodiment. It is a figure for demonstrating the processing content from the setting of a projection surface two-dimensional coordinate system to the superimposition display of an object in 3rd Embodiment. It is a figure for demonstrating rearrangement of the object in a projection surface two-dimensional coordinate system in 3rd Embodiment. It is a flowchart which shows the processing content implemented in the object display apparatus 1 in 3rd Embodiment.

  Embodiments of an object display device and an object display method according to the present invention will be described with reference to the drawings. If possible, the same parts are denoted by the same reference numerals, and redundant description is omitted.

(First embodiment)
FIG. 1 is a block diagram showing a functional configuration of an object display device 1 according to the first embodiment. The object display device 1 according to the present embodiment provides a service that gives the user augmented reality by displaying various objects in a superimposed manner on a video image acquired by the user with a photographing device such as a camera directed to a real space. For example, a device such as a portable terminal is exemplified. In the present embodiment, when the object display device 1 is a device that provides a service for superimposing and displaying on the video of the course, with information on green and hazards (including ponds, bunker, etc.) as objects in the golf course. However, the object display device 1 is not limited to a device that provides a service on a golf course.

  As shown in FIG. 1, the object display device 1 functionally includes an object information storage unit 10 (object information storage unit), a position information acquisition unit 11 (position information acquisition unit), and an orientation acquisition unit 12 (azimuth acquisition unit). ), Imaging unit 13 (imaging unit), horizontal plane two-dimensional coordinate system setting unit 14 (horizontal plane two-dimensional coordinate system setting unit), object reference position arrangement unit 15 (object reference position arrangement unit), projection plane two-dimensional coordinate system setting unit 16 (projection plane two-dimensional coordinate system setting means), projection plane two-dimensional coordinate system division section 17 (projection plane two-dimensional coordinate system division means), object display position determination section 18 (object display position determination means), display control section 19 (Display control means) and a display unit 20 are provided.

  FIG. 2 is a hardware configuration diagram of the object display device 1. As shown in FIG. 2, the object display device 1 physically includes a CPU 101, a RAM 102 and a ROM 103 which are main storage devices, a communication module 104 which is a data transmission / reception device, an auxiliary storage device 105 such as a hard disk and a flash memory, an input The computer system includes an input device 106 such as a keyboard, which is a device, and an output device 107 such as a display. The functions shown in FIG. 1 are executed by reading predetermined computer software on hardware such as the CPU 101 and the RAM 102 shown in FIG. 2 and executing them, thereby controlling the communication module 104, the input device 106, This is realized by operating the output device 107 and reading and writing data in the RAM 102 and the auxiliary storage device 105. Again, with reference to FIG. 1, each function part of the object display apparatus 1 is demonstrated in detail.

  The object information storage unit 10 is a part that stores object information including object reference position information that is information related to an object and is information related to a reference position in the real space of the object. FIG. 3 is a diagram illustrating an example of the configuration of the object information storage unit 10 and stored data. As shown in FIG. 3, the object information storage unit 10 stores genre, position information (object reference position information), and information data as object information for each course information ID for identifying object information.

  The genre is attribute information indicating a target object associated with the object information. Also, the genre is “front” that is one end of the object such as “bunker” or “pond” on the side where the viewpoint position of the object display device 1 exists on the object, and the opposite side to the one end. Information such as “back” may be included.

  The position information is information indicating a reference position with which the object is associated in the real space, and includes information on latitude and longitude, for example. The information data is data that is displayed on the display unit 20 so as to be superimposed on the real space video, and may include predetermined image data such as text data, icons, and photographs, for example. In the present embodiment, the information data stores information indicating the distance to the object indicated by the genre.

  The object information storage unit 10 may further include a field for storing an arrangement position in the horizontal plane two-dimensional coordinate system, a display position in the projection plane two-dimensional coordinate system, and a display necessity attribute.

  In addition, although the object information of this embodiment shall be previously memorize | stored in the object information storage part 10, it is not restricted to this. For example, object information is accumulated in a server (not shown) that can communicate with the object display device 1, and the server stores object information arranged around the object display device 1 based on the position information of the object display device 1. The extracted object information may be transmitted from the server to the object display device 1.

  The position information acquisition unit 11 is a part that acquires the current position of the object display device 1. The position information acquisition unit 11 is, for example, a GPS module that receives radio waves from a plurality of GPS (Global Positioning System) satellites and acquires position information related to the current position of the object display device 1 from their intensities. When the object display device 1 is a mobile terminal for communication via the mobile communication network, the position information acquisition unit 11 is located near the object display device 1 by communicating with the communication network via the communication module 105. It can be a module corresponding to an AGPS (Assisted Global Positioning System) system that obtains information on satellites as assist data and performs positioning. In this case, position information can be acquired more quickly and accurately. However, the position information acquisition unit 11 is not limited to those using GPS or AGPS, and may be configured to acquire position information without depending on GPS. For example, the position information acquisition unit 11 may use a method in which a plurality of wireless communication base stations such as WiFi and Bluetooth (registered trademark) are arranged in a space, and terminal position information is acquired based on the radio field intensity therefrom. It is also possible to use a method in which such a method is used in combination with GPS or AGPS.

  The bearing acquisition unit 12 is a part that acquires the shooting direction of the shooting unit 13. The azimuth acquisition unit 12 can be configured by a module that detects a posture / angle in a direction in which the object display device 1 is facing and outputs a signal corresponding thereto. As a module for configuring the azimuth acquisition unit 12, it is possible to adopt a combination of a plurality of geomagnetic sensors, and even a motion sensor that combines a plurality of acceleration sensors in addition to a geomagnetic sensor. Good. More specifically, as a module for configuring the azimuth acquisition unit 12, a 6-axis sensor in which a triaxial geomagnetic sensor and a triaxial acceleration sensor are combined, a triaxial geomagnetic sensor, and a biaxial acceleration sensor Can be employed, and a gyro can be employed instead of the acceleration sensor. Such a motion sensor can detect not only information on the posture and angle of the object display device 1 but also the direction and speed of the operation when the user moves or tilts the object display device 1.

  The imaging unit 13 is a part that acquires an image of a real space. The photographing unit 13 can include a predetermined optical system and an image receiving element, and can be configured by a module that provides a function of acquiring a digital image.

  The horizontal plane two-dimensional coordinate system setting unit 14 includes a straight line connecting the current position of the object display device 1 and the position of the specific target in real space as one of the reference axes, and the current position of the object display device 1 is set as the origin. This is a part for setting a horizontal two-dimensional coordinate system. With reference to FIG. 4, the setting process of a horizontal two-dimensional coordinate system is demonstrated. FIG. 4A is a diagram schematically showing a golf course. FIG. 4A shows the current position CP and the specific target T of the object display device 1. In the service for guiding the golf course of the present embodiment, for example, green is set as the specific target T. Information relating to the specific target is stored in the object information storage unit 10 as one type of object information (see the object information of the genre “green” in FIG. 3), for example, stored in the object information storage unit 10. Any object among the objects can be set as the specific target T by the user's selection. The horizontal plane two-dimensional coordinate system setting unit 14 acquires information regarding the specific target T from the object information storage unit 10. Further, the horizontal plane two-dimensional coordinate system setting unit 14 can set a specific direction such as “true north” as the specific target T, for example.

  FIG. 4B is a diagram showing an example of a horizontal plane two-dimensional coordinate system set by the horizontal plane two-dimensional coordinate system setting unit 14 in the golf course shown in FIG. In the example shown in FIG. 4B, an orthogonal coordinate system composed of an X axis and a Y axis is set as a horizontal two-dimensional coordinate system. That is, the horizontal plane two-dimensional coordinate system setting unit 14 sets a horizontal line connecting the current position CP and the specific target T as the Y axis which is one of the reference axes, and is orthogonal to the Y axis and passes through the current position CP. A line is set as the X axis, and a horizontal two-dimensional coordinate system including the Y axis and the X axis is set. In the present embodiment, a straight line extending in the horizontal direction connecting the current position CP and the specific target T is used for setting the Y axis, but the straight line used here is limited to that in the horizontal direction. Absent. In the present embodiment, an orthogonal coordinate system is illustrated as an example of the horizontal two-dimensional coordinate system, but the present invention is not limited to this, and for example, a two-dimensional polar coordinate (circular coordinate) system may be used.

Based on the object reference position information of the object information stored in the object information storage unit 10, the object reference position arrangement unit 15 sets the reference position of the object in the horizontal plane two-dimensional coordinate system set by the horizontal plane two-dimensional coordinate system setting unit 14. This is the part where information is plotted. In the present embodiment, the object reference position arrangement unit 15 plots and arranges the object reference position information in the horizontal plane two-dimensional coordinate system based on the position information (object reference position information) represented by latitude and longitude. FIG. 5A is a diagram schematically illustrating a reference position of an object on the golf course. FIG. 5B is a diagram showing objects arranged in a horizontal two-dimensional coordinate system. As shown in FIG. 5B, the object reference position information O _{2 to} O ₅ of the objects associated with the attributes such as the front of the bunker, the back of the bunker, the front of the pond and the back of the pond (see FIG. 3) are two-dimensional coordinates in the horizontal plane. Plotted in a horizontal two-dimensional coordinate system set by the system setting unit 14.

  The projection plane two-dimensional coordinate system setting unit 16 sets a plane orthogonal to the imaging direction of the imaging unit 13 acquired by the orientation acquisition unit 12 or a plane orthogonal to the horizontal component of the imaging direction as a projection plane. This is a part for setting a projection plane two-dimensional coordinate system with the horizontal and vertical directions as coordinate axes. FIG. 6 is a diagram for explaining the projection plane two-dimensional coordinate system setting process performed by the projection plane two-dimensional coordinate system setting unit 16. As shown in FIG. 6, the projection plane two-dimensional coordinate system setting unit 16 uses the viewpoint position FP set at a predetermined height position on the current position CP as a reference position, and the shooting direction of the shooting unit 13 indicated by the arrow R. Alternatively, a horizontal direction component in the photographing direction is set, and a projection plane PP orthogonal to that direction is set. The projection plane two-dimensional coordinate system setting unit 16 sets a projection plane two-dimensional coordinate system having the horizontal and vertical directions on the projection plane PP as coordinate axes. The projection plane two-dimensional coordinate system setting unit 16 sets, for example, the horizontal coordinate axis in the projection plane two-dimensional coordinate system as the W axis and the vertical coordinate axis as the Z axis. Further, the projection plane PP is not limited to a plane orthogonal to a plane including a horizontal two-dimensional coordinate system.

  Here, as shown in FIG. 7A, the projection plane two-dimensional coordinate system setting unit 16 starts a shooting direction or a shooting direction of the shooting unit 13 with a position at a predetermined height at the current position of the object display device 1 as a starting point. The coordinate axis in the two-dimensional coordinate system of the projection plane can be set with the intersection point between the straight line drawn along the horizontal component of the projection plane PP and the projection plane PP as the origin. That is, since the position of the predetermined height at the current position of the object display device 1 is represented by the viewpoint position FP in FIG. 6, the straight line drawn along the direction of the arrow R from the viewpoint position FP and the projection plane The intersection with PP is set as the origin. The predetermined height at the current position is preferably set to, for example, about 150 cm, which is a general user viewpoint position.

  Further, as shown in FIG. 7B, the projection plane two-dimensional coordinate system setting unit 16 sets the projection plane PP on the projection plane PP when the position of the predetermined height at the current position CP of the object display device 1 is set as the viewpoint position FP. The coordinate axis in the projection plane two-dimensional coordinate system can be set with the position where the specific target T is perspectively projected as the origin.

  The projection plane two-dimensional coordinate system dividing unit 17 has each quadrant in the projection plane two-dimensional coordinate system set by the projection plane two-dimensional coordinate system setting unit 16 having a predetermined size and a predetermined value in the projection plane two-dimensional coordinate system. This is a portion that is divided into small areas of the projection plane, which are small areas having the coordinate values. Specifically, the projection plane two-dimensional coordinate system dividing unit 17 divides each quadrant in the projection plane two-dimensional coordinate system into projection plane small areas VA, as shown in FIGS. 7A and 7B. . In the example shown in FIGS. 7A and 7B, each quadrant in the projection plane two-dimensional coordinate system is divided into square projection plane small areas VA. The projection surface small area VA has coordinate values of the W axis and the Z axis.

  The object display position determination unit 18 converts the object reference position information arranged in the horizontal plane two-dimensional coordinate system by the object reference position arrangement unit 15 into a small projection plane corresponding to the arrangement position of the object reference position information in the horizontal plane two-dimensional coordinate system. It is a part that determines the display position of the object by arranging it in the area VA. In addition, when the small projection plane area VA in which the object is arranged corresponds to a display prohibition area that prohibits the display of the object, the object display position determination unit 18 projects the object that does not correspond to the display prohibition area. This is a portion to be rearranged in the small area VA. Furthermore, the object display position determination unit 18 also sets a display prohibition area that is an area in which object display is prohibited. Hereinafter, with reference to FIGS. 8 to 17, an example of an object display position determination unit 18 that performs an object placement process, a rearrangement process, and a prohibited area setting process with respect to the projection surface small area VA will be described.

FIG. 8A is a diagram illustrating an example of the display prohibition area set in the projection plane two-dimensional coordinate system. In other words, the object display position determination unit 18 is a projection plane small area VA located within a predetermined distance set in advance from the position of the specific target T projected in the projection plane two-dimensional coordinate system (projection plane PP). Is set to the display prohibited area. In the example shown in FIG. 8 (a), the object display position determination section 18 is a specific target T green is set to display prohibition region a projection surface small areas VA ₁ including the projected position. Further, the object display position determination unit 18 sets a projection plane small area VA corresponding to an area for displaying a specific graphic object G on the display screen of the object display device 1 as a display prohibited area. In the example shown in FIG. 8 (a), the object display position determination unit 18, a projection plane small corresponding to an area for displaying a graphic object G ₂ showing a schematic diagram of a graphical object G ₁ and golf course indicates the number of holes Areas VA ₂ and VA ₃ are set as display prohibited areas.

FIG. 8B is a diagram illustrating an example of an object arranged in the projection plane two-dimensional coordinate system. That is, the object display position determination unit 18 uses the object reference position arranged in the horizontal plane two-dimensional coordinate system by the object reference position arrangement unit 15 with the position of the predetermined height at the current position CP of the object display device 1 as the viewpoint position FP. The object is arranged in the projection plane small area VA corresponding to the position where the information is perspectively projected on the projection plane PP (see FIG. 6). In the example shown in FIG. 8B, the object display position determination unit 18 arranges the objects O ₁₁ , O ₁₂ , and O ₁₃ in the projection plane small area VA ₄ and the object O ₁₄ in the projection plane small area VA ₅ . The object O ₁₅ is arranged in the projection plane small area VA ₅ . In the present embodiment, the object is a balloon-type graphic object, and information data indicating the distance to an object such as a bunker or a pond is displayed in the balloon. This information data is stored in the object information storage unit 10.

FIG. 9A is a diagram illustrating an example of the display prohibited area set in the projection plane two-dimensional coordinate system. Since the projection plane small areas VA ₄ , VA ₅ , and VA ₆ are areas in which information provided by the object is displayed on the display screen, objects in the real space are displayed. The object will be hidden. Therefore, the object display position determination unit 18 sets these projection plane small areas VA ₄ , VA ₅ , VA ₆ as display prohibited areas.

FIG. 9B is a diagram illustrating an example of object rearrangement. As shown in FIG. 9A, since the objects O ₁₁ , O ₁₂ , and O ₁₃ are arranged in the display prohibition area, the object display position determination unit 18 displays the objects O ₁₁ , O ₁₂ , and O ₁₃ . , Rearranged in the adjacent projection plane small area VA. In the example shown in FIG. 9B, the object display position determination unit 18 places an object in the projection plane small area VA indicated by the coordinate value obtained by increasing the absolute value of the vertical coordinate value of the projection plane small area VA by one. Rearrange. Here, assuming that a rule such that an object close to the current position of the object display device 1 is preferentially rearranged is set in advance, the object display position determination unit 18 moves the object O ₁₁ to a small area on the projection plane. The absolute value of the coordinate value in the vertical direction of VA ₄ is rearranged in the projection surface small area VA ₁₁ that is the projection surface small area indicated by the coordinate value increased by one. In the present embodiment, the object is rearranged in the projection plane small area VA indicated by the coordinate value obtained by increasing the absolute value of the coordinate value by 1, but the present invention is not limited to this. It may be rearranged in the projection surface small area VA indicated by the coordinate value obtained by reducing the absolute value of the coordinate value, and the increase or decrease width in the absolute value of the coordinate value may be a value other than 1. Good.

Next, the object display position determination unit 18, the object O _12, rearranging the absolute values of vertical coordinates on the projection plane small area VA represented by the coordinate values is increased by one. However, the projection plane small area _{VA 11,} since the object _{O 11} to override the object _{O 12} has already been relocated, object _{O 12} is relocated to the projection plane small area _{VA 12.} Further, the object display position determination unit 18 rearranges the object O ₁₃ in the projection plane small area VA indicated by the coordinate value obtained by increasing the absolute value of the vertical coordinate value by one. However, each of the projection plane small area _VA 11, _{VA 12,} since the object _{O 11, O 12} to override the object _{O 13} has already been relocated, object _{O 13} is the projection plane small area _{VA 13} again Be placed. Similarly, the object display position determination unit 18 rearranges the objects O ₁₄ and O ₁₅ in the projection plane small areas VA ₁₄ and VA ₁₅ , respectively.

FIG. 10A is a diagram showing an example of the display prohibition area set in the projection plane two-dimensional coordinate system. In the example shown in FIG. 10A, since it is not preferable that the visibility of the specific target T is reduced on the display screen, the object display position determination unit 18 determines the vertical direction of the projection plane small area VA ₁ to which the specific target belongs. setting the projection plane small area VA ₇ located above and below a display prohibition region.

FIG. 10B is a diagram illustrating an example of object rearrangement. As shown in FIG. 10A, since the objects O ₁₁ , O ₁₂ , and O ₁₃ are arranged in the display prohibition area, the object display position determination unit 18 displays the objects O ₁₁ , O ₁₂ , and O ₁₃ . , Rearrange in the small area of the adjacent projection plane. Relocation is performed by giving priority to an object close to the current position of the object display device 1, and in the projection plane two-dimensional coordinate system, the projection plane indicated by the coordinate value obtained by incrementing the absolute value of the coordinate value in the vertical direction by 1 A rule is set in advance such that the movement / relocation to the small area VA is given priority over the movement / relocation to the projection surface small area VA indicated by the coordinate value obtained by increasing the absolute value of the horizontal coordinate value by one. Then, in the example shown in FIG. 10B, the projection plane small area VA ₁ indicated by the coordinate value obtained by incrementing the absolute value of the vertical coordinate value of the projection plane small area in which the object O ₁₁ is arranged by _one. because it is set to display prohibition region, the object display position determination unit 18, for example, the projection plane small area VA ₂ represented by the absolute value of the horizontal coordinate value coordinate value is increased by one Repositioning the object _{O 11} to. Similarly, the object display position determination unit 18 rearranges the objects O ₁₂ and O ₁₃ in the projection plane small areas VA ₂₂ and VA ₂₃ , respectively. Also, the object display position determination unit 18, if it can previously recognize that all of the projection plane small area located in the vertical projection plane small area object O ₁₁ is disposed corresponds to the display prohibition region, vertical The object O ₁₁ is directly rearranged in the projection surface small area VA ₂₁ indicated by the coordinate value obtained by increasing the absolute value of the coordinate value in the horizontal direction by 1 without attempting to rearrange the direction in the small projection surface area. be able to.

FIG. 11A is a diagram illustrating an example of setting a display prohibited area. The object display position determination unit 18 can set a projection plane small area located within a predetermined distance from a vertical coordinate axis in the projection plane two-dimensional coordinate system as a display prohibited area. In the example shown in FIG. 11 (a), the object display position determination unit 18, a projection plane small area VA belonging from the Z-axis is a coordinate axis in the vertical direction in the area PA _Z within a predetermined distance in the projection plane 2-dimensional coordinate system Set to display prohibited area.

FIG. 11B is a diagram illustrating an example of setting a display prohibited area. The object display position determination unit 18 can set a projection plane small area located within a predetermined distance set in advance from a horizontal coordinate axis in the projection plane two-dimensional coordinate system as a display prohibited area. In the example shown in FIG. 11 (b), the object display position determination unit 18, a projection surface small areas VA belonging to a predetermined region PA _W within a distance from the W-axis in the horizontal direction of the coordinate axes in the projection plane 2-dimensional coordinate system and setting the projection plane small area VA belonging from the Z axis in the area PA _Z within a predetermined distance in the display prohibition region.

FIG. 12 is a diagram illustrating an example of object rearrangement. The object display position determination unit 18 projects one object out of the plurality of objects into one projection based on the preset priority of the objects when a plurality of objects are arranged in one projection plane small area VA. While arranging in the small surface area VA, another object is rearranged in the small projection surface area VA adjacent to one small projection surface area. In the example shown in FIG. 12 (a), one of the projection surface small areas VA object _O A, is _{O B} is disposed. If the priority of the object O _A is higher than the priority of Object O _B, the object display position determining unit 18, as shown in FIG. 12 (b), placing the object O _A on the projection plane small area VA _A together, repositioning the projection plane small area VA _B adjacent the object _{O B} on the projection plane small area VA _a.

  FIG. 13 is a diagram showing an example of the arrangement order of the projection surface small areas VA in the rearrangement of objects. As described with reference to FIGS. 9 and 10, the object display position determination unit 18 is a coordinate in which the absolute value of the vertical or horizontal coordinate value of the projection plane small area VA on which the object is arranged is increased by one. The objects are rearranged in the projection plane small area VA indicated by the value. When a plurality of objects are rearranged, the objects are rearranged according to a preset arrangement order as illustrated in FIG. It is good also as implementing.

Next, another example of the object rearrangement process will be described with reference to FIGS. FIGS. 14A and 14B are diagrams showing examples of display prohibited areas set in the projection plane two-dimensional coordinate system. In the example shown in FIG. 14A, the object display position determination unit 18 includes the projection plane small area VA ₈ positioned in the vertical direction of the projection plane small area to which the specific target T belongs, and the projection plane positioned in the horizontal direction. The small area VA ₉ is set as a display prohibited area. By setting the display prohibition area in this manner, it is possible to maintain a good view of the real space video on the display screen.

Further, as shown in FIG. 14B, the objects O ₁₁ , O ₁₂ , and O ₁₃ are arranged in the projection plane small area VA ₄ , the object O ₁₄ is arranged in the projection plane small area VA ₅ , and the object O ₁₅ is Since it is arranged in the projection plane small area VA ₆ , the object display position determination unit 18 sets the projection plane small areas VA ₄ , VA ₅ , VA ₆ as display prohibited areas.

FIG. 15 is a diagram for explaining setting of a middle area which is a unit area for rearrangement of objects. FIG. 16 is a diagram for explaining the rearrangement of objects for each set middle area. When the real space video as shown in FIG. 15A is acquired, the object display position determination unit 18 passes through a predetermined point in the real space video as shown in FIG. The corresponding projection plane two-dimensional coordinate system is divided into _four middle areas MA _{1 to} MA 4 by straight lines drawn in the horizontal direction. For example, the predetermined point for dividing into the middle area MA may be set at a green position that is the specific target T, or may be set at a midpoint between the position of the specific target T and the current position. Also good.

  As shown in FIG. 16A, each middle area MA includes a plurality of small projection plane areas VA. Then, the object display position determination unit 18 sets the object arrangement order for the projection area small area VA for each middle area MA. The arrangement order set here may be set in advance, for example, or the order is set in order from the projection surface small area VA having a short distance from a predetermined point for division into the middle area MA. It is good as well.

Subsequently, as shown in FIG. 16B, the object display position determination unit 18 converts the objects O ₁₁ , O ₁₂ , O ₁₃ and the objects O ₁₄ , O ₁₅ into the projection plane small area VA for each middle area MA. Rearrange. For example, the object _{O 11,} O _{12, O 13,} object _{O 11,} when an object _{O 12,} higher priority order of object _{O 13} is set, the object display position determination unit 18, FIG. The objects O ₁₁ , O ₁₂ , and O ₁₃ are rearranged in the projection plane small areas VA ₃₃ , VA ₃₂ , and VA ₃₁ in accordance with the arrangement order of the projection plane small areas in the middle area MA ₃ shown in 16 (a). Similarly, for example, the object _{O 14, O 15,} object _{O 14,} when the higher priority order of object _{O 15} is set, the object display position determination unit 18, FIG. 16 (a) The objects O ₁₄ and O ₁₅ are rearranged in the projection plane small areas VA ₃₅ and VA ₃₄ in accordance with the arrangement order of the projection plane small areas in the middle area MA ₄ shown in FIG.

  FIG. 17 is a diagram illustrating an example of objects arranged and rearranged in the projection plane two-dimensional coordinate system by the object display position determination unit 18. FIG. 17 also shows a display range frame F set by the display control unit 19. The display control unit 19 is a part that controls the display position of the object on the display screen based on the information regarding the small projection plane area where the object is arranged by the object display position determination unit 18. Specifically, the display control unit 19 is based on the information regarding the shooting direction of the shooting unit 13 acquired by the azimuth acquiring unit 12, the zoom information acquired from the shooting unit 13, and the angle of view in the projection plane two-dimensional coordinate system. The display range is calculated and the display range frame F is set.

As shown in FIG. 17, the objects O ₄₁ , O ₄₂ , O ₄₃ , and O ₄₄ are arranged in the projection surface small areas VA ₄₁ , VA ₄₂ , VA ₄₃ , and VA ₄₄ , respectively. Each object is represented as a balloon-type graphic object, and information data (see FIG. 3) representing the distance to the object is displayed in the balloon portion. Further, in the present embodiment, the balloon-type object balloon source portion is obtained by perspectively projecting the position of the object in the real space onto the projection plane PP (see FIG. 6) to which the projection plane two-dimensional coordinate system belongs. Corresponding to the projection position. Both of the balloons of the objects O ₄₁ and O ₄₂ are associated with positions belonging to the projection plane small area VA ₄₅ . Further, both the balloons of the objects O ₄₃ and O ₄₄ are associated with positions belonging to the projection plane small area VA ₄₆ .

FIG. 18 is an example of a display screen on the display unit 20 when an object is arranged in the projection plane two-dimensional coordinate system as illustrated in FIG. As shown in FIG. 18, the objects O ₄₁ and O ₄₂ are displayed while being associated with the front of the pond and the back of the pond, respectively. Further, the objects O ₄₃ and O ₄₄ are displayed while being associated with the front of the bunker and the back of the bunker, respectively. And each object is arrange | positioned so that the visual field of the green direction seen from the present position may not be blocked | interrupted.

  FIG. 19 is a diagram illustrating another example of an object placed and rearranged in the projection plane two-dimensional coordinate system by the object display position determination unit 18. The object display position determination unit 18 is a plurality of objects related to one target object in the real space, the object indicating information about one end part on the side where the viewpoint position of the object display device 1 in the one target object exists, When determining the display position of an object indicating information related to the other end opposite to the one end of the target object, an object indicating information related to the one end and an object indicating information related to the other end are respectively projected onto the projection plane 2. It is arranged in a small projection area VA located in the lower and upper quadrants of the horizontal coordinate axis in the dimensional coordinate system. This will be specifically described below.

In FIG. 19, the W axis, which is the horizontal coordinate axis in the projection plane two-dimensional coordinate system, is set to pass through the specific target T. The objects O ₅₁ and O ₅₂ are objects representing the front of the pond and the back of the pond, respectively, and the objects O ₅₃ and O ₅₄ are objects representing the front of the bunker and the back of the bunker, respectively. That is, the object O ₅₁ is an object indicating information on one end of the object display device 1 on the side where the viewpoint position is present in the pond that is the object in the real space, and the object O ₅₂ is the object in front of the pond in the pond. It is an object indicating information related to the other end on the opposite side. Similarly, the object O ₅₃ is an object indicating information on one end portion on the side where the viewpoint position of the object display device 1 is present in a bunker that is an object in real space, and the object O ₅₄ is in front of the bunker in the bunker. It is an object which shows the information regarding the other end part of the other side.

In such a case, the object display position determination section 18 arranges the projection plane small area VA ₅₁ belonging objects O ₅₁ in quadrant below the W-axis, projection plane small belonging objects O ₅₂ above quadrant of W axis Arranged in area VA ₅₂ . Similarly, object display position determination section 18, object O ₅₃ is disposed on the projection surface the small area VA ₅₃ belonging to quadrants below the W-axis, projection endoplasmic area VA belonging objects O ₅₄ above quadrant of W axis ₅₄ . Thereby, it is possible to display two objects indicating information related to one end and the other end of a predetermined object while allowing the user to recognize the relevance of each other and the positional relationship of the object. The projection plane two-dimensional coordinate system may be configured so that the W axis passes through the midpoint of the specific target T and the current position CP.

  The display unit 20 is a part that superimposes and displays an object on the real-space video acquired by the imaging unit 13 based on the control of the display control unit 19, and includes a device such as a display.

  Next, the operation of the object display device 1 in the object display method of the present embodiment will be described with reference to FIG. FIG. 20 is a flowchart showing the processing contents executed in the object display device 1.

  First, the position information acquisition unit 11 acquires the current position of the object display device 1. Further, the direction acquisition unit 12 acquires the shooting direction of the shooting unit 13. Furthermore, the imaging unit 13 acquires zoom information and field angle information (S1, position information acquisition step, orientation information acquisition step). Next, the horizontal plane two-dimensional coordinate system setting unit 14 includes a straight line connecting the current position of the object display device 1 and the position of the specific target T in real space as one of the reference axes, and the current position of the object display device 1 A horizontal plane two-dimensional coordinate system is set with S as the origin (S2, horizontal plane two-dimensional coordinate system setting step). The object reference position placement unit 15 plots the object reference position information on the horizontal plane two-dimensional coordinate system set by the horizontal plane two-dimensional coordinate system setting unit 14 based on the object information stored in the object information storage unit 10. Arrange (S3, object reference position arrangement step).

  Subsequently, the projection plane two-dimensional coordinate system setting unit 16 sets the projection plane PP, and sets a projection plane two-dimensional coordinate system having the horizontal and vertical directions on the projection plane PP as coordinate axes (S4, projection plane 2). Dimensional coordinate system setting step). Next, the projection plane two-dimensional coordinate system dividing unit 17 has each projection quadrant in the projection plane two-dimensional coordinate system set by the projection plane two-dimensional coordinate system setting unit 16 having a predetermined size and projection plane two-dimensional coordinates. The projection plane is divided into small areas VA, which are small areas having predetermined coordinate values in the system (S5, projection plane two-dimensional coordinate system division step). Then, the object display position determination unit 18 projects the object reference position information arranged in the horizontal plane two-dimensional coordinate system by the object reference position arrangement unit 15 corresponding to the arrangement position of the object reference position information in the horizontal plane two-dimensional coordinate system. It arrange | positions to the small area VA (S6, object display position determination step). Here, the object display position determination unit 18 may store the coordinate value of the projection surface small area VA where the object is arranged in the “display position” field of the object information storage unit 10.

  Further, the object display position determination unit 18 displays the object when the projection surface small area VA in which the object is arranged in step S6 corresponds to a display prohibition area that is an area in which the object display is prohibited. Rearrangement is made in the projection surface small area VA that does not correspond to the prohibited area (S7, object display position determination step). Here, the object display position determination unit 18 may store the coordinate value of the projection plane small area VA on which the object is rearranged in the “display position” field of the object information storage unit 10.

  Next, the display control unit 19 displays the display range in the two-dimensional coordinate system on the projection plane based on the information regarding the shooting direction of the shooting unit 13 acquired by the azimuth acquiring unit 12, the zoom information acquired from the shooting unit 13, and the angle of view. And a display range frame F is set (S8, display control step). Subsequently, the display control unit 19 determines whether or not the object is included in the set display range (S9, display control step). Here, when one object is included in the display range, the display control unit 19 sets “1” in the “display necessity attribute” field in the record of the object in the object information storage unit 10. Further, when one object is not included in the display range, the display control unit 19 sets “0” in the “display necessity attribute” field in the record of the object in the object information storage unit 10.

  If it is determined in step S9 that the display range includes an object, the display control unit 19 superimposes the object included in the display range on the real space video and causes the display unit 20 to display the superimposed image (S10, display). Control step). On the other hand, if it is not determined in step S9 that the display range includes the object, the display control unit 19 does not display the object (S11, display control step). In this way, the process of this embodiment is complete | finished.

  In the object display device 1 and the object display method of the first embodiment described above, the reference position information of the object is arranged in the horizontal plane two-dimensional coordinate system based on the object information, and the arrangement position of the reference position information in the horizontal plane two-dimensional coordinate system. Based on the above, the object is arranged in the corresponding small projection plane area. Then, the display position of the object is determined based on the projection surface small area where the object is arranged. Here, when the projection plane small area in which the object is arranged is a display prohibited area, the object is rearranged in the projection plane small area that does not correspond to the display prohibited area. For example, another object is arranged. By setting the small projection plane small area as the display prohibition area, it is possible to prevent the objects from being displayed overlapping each other. Therefore, even when the amount of objects to be superimposed and displayed on the real space video is large, the complexity of the screen is suppressed. Further, the object is arranged in a small area of the projection plane to which the actual location position in the real space image acquired by the photographing means belongs. As a result, it is possible to provide information by displaying the object closely associated with the position in the real space.

(Second Embodiment)
Next, the object display device 1 according to the second embodiment will be described. FIG. 21 is a block diagram illustrating a functional configuration of the object display device 1 according to the second embodiment. As shown in FIG. 21, the object display device 1 in the second embodiment is different from the object display device 1 in the first embodiment in that it includes a horizontal plane two-dimensional coordinate system dividing unit 21 (horizontal plane two-dimensional coordinate system dividing means). Is different. Further, the object reference position arrangement unit 15 and the object display position determination unit 18 in the second embodiment have functions different from the functions of those function units in the first embodiment. Hereinafter, the difference from the first embodiment will be mainly described.

  The horizontal plane two-dimensional coordinate system dividing unit 21 has each quadrant in the horizontal plane two-dimensional coordinate system set by the horizontal plane two-dimensional coordinate system setting unit 14 having a predetermined size and a predetermined coordinate value in the horizontal plane two-dimensional coordinate system. It is a part which divides | segments into the horizontal surface small area HA which is a small area which has. With reference to FIGS. 22 and 23, the horizontal plane two-dimensional coordinate system dividing process by the horizontal plane two-dimensional coordinate system dividing unit 21 will be described.

FIG. 22A is a diagram schematically showing the golf course and the position of the object on the golf course. FIG. 22B is a diagram illustrating a horizontal plane small area HA generated by dividing the horizontal plane two-dimensional coordinate system and the horizontal plane two-dimensional coordinate system. FIG. 23A is a diagram showing an example of the configuration of the object information storage unit 10 and stored data, and the contents are the same as those shown in FIG. The object reference position information O _{2 to} O ₅ of the object shown in FIG. 22A corresponds to the course information ID “ID ₂ ” to “ID ₅ ” in FIG.

  As shown in FIG. 22B, the horizontal plane two-dimensional coordinate system dividing unit 21 sets each quadrant in the horizontal plane two-dimensional coordinate system after the horizontal plane two-dimensional coordinate system as shown in FIG. Divide into horizontal areas HA. In the example shown in FIG. 22B, each quadrant in the horizontal plane two-dimensional coordinate system is divided into square horizontal plane small areas HA. Further, the horizontal small area HA has coordinate values of the X axis and the Y axis.

Based on the object information stored in the object information storage unit 10, the object reference position arrangement unit 15 arranges the object reference position information in the horizontal plane small area HA corresponding to the position indicated by the object reference position information. Specifically, as illustrated in FIG. 22B, the object reference position placement unit 15 stores the object reference position information O _{2 to} O ₅ as the position information of each object stored in the object information storage unit 10. based on (FIG. 23 (a) see), arranged in a horizontal plane small area _HA 2 _{~HA 5} position belongs indicated in the position information. Here, the object reference position placement unit 15 stores the coordinate value of the horizontal plane small area HA on which the object is placed in the “placement position” field of the object information storage unit 10 as shown in FIG. It is good as well.

Further, the object reference position placement unit 15 can set a placement prohibited area in a horizontal two-dimensional coordinate system. FIG. 24A is a diagram illustrating an example of an arrangement prohibition region set in the horizontal plane two-dimensional coordinate system and an example of rearrangement of object reference position information. As shown in FIG. 24A, the object reference position arrangement unit 15 is, for example, a horizontal plane small area positioned within a predetermined distance set in advance from the Y axis that is one of the reference axes in the horizontal plane two-dimensional coordinate system. HA _Y can be set as a placement prohibited area. Further, the object reference position placement unit 15 may set a horizontal horizontal small area located within a predetermined distance set in advance from the X axis as the placement prohibited area.

  Further, the object reference position placement unit 15 may set a horizontal plane small area associated with a projection plane small area corresponding to a display prohibited area in the projection plane two-dimensional coordinate system as a placement prohibited area. Information related to the correspondence between the horizontal plane small area and the projection plane small area is stored in advance in the object display position determination unit 18 as described later, and can be referred to. Further, the setting of the display prohibited area in the projection plane two-dimensional coordinate system is performed by the object display position determination unit 18 as described in the first embodiment.

When the horizontal plane small area HA in which the object reference position information is arranged corresponds to the arrangement prohibited area, the object reference position arrangement unit 15 rearranges the object reference position information in the horizontal plane small area HA that does not correspond to the arrangement prohibited area. To do. Specifically, as shown in FIG. 24A, since the object reference position information O _{2 to} O ₅ is arranged in the horizontal plane small area HA _Y corresponding to the arrangement prohibited area, the object reference position arrangement unit 15 The object reference position information O _{2 to} O ₅ is rearranged in the horizontal plane small areas HA ₁₂ , HA ₁₃ , HA ₁₄ , HA ₁₅ , respectively.

  The object reference position placement unit 15 rearranges the object reference position information in the horizontal plane small area HA indicated by the coordinate value obtained by incrementing the absolute value of the X-axis coordinate value of the horizontal plane small area HA that is the original placement position by one. Alternatively, the object reference position information can be rearranged in the horizontal plane small area HA indicated by the coordinate value obtained by incrementing the absolute value of the Y-axis coordinate value of the horizontal plane small area HA that is the original layout position. In the present embodiment, the object is rearranged in the horizontal small area HA indicated by the coordinate value obtained by increasing the absolute value of each coordinate value by 1. However, the present invention is not limited to this. The absolute value of the coordinate value may be rearranged in the small horizontal area HA indicated by the coordinate value, and the increase or decrease in the absolute value of the coordinate value may be a value other than 1. .

  In addition, the object reference position placement unit 15 includes, when a plurality of object reference position information is placed in one horizontal plane small area HA, based on the priority set in advance for the object, One object reference position information is arranged in the one horizontal plane small area HA, and other object reference position information other than the one object reference position information is rearranged in a horizontal plane small area HA adjacent to the one horizontal plane small area HA. can do. Thus, one object reference position information is arranged for each small horizontal plane area based on the priority of the object, and the display position of the object in the projection plane two-dimensional coordinate system is based on the arrangement of the object reference position information. Therefore, the overlapping display of the objects is prevented, and the visibility of the display surface can be improved.

  Further, the object reference position arranging unit 15 determines the object reference position from either the X axis or the Y axis in the horizontal plane two-dimensional coordinate system when a plurality of object reference position information is arranged in one horizontal plane small area HA. The priority of the object is set based on the distance to the position of the information, and one object reference position information among the plurality of object reference position information is arranged in one horizontal plane small area HA based on the set priority. The other object reference position information can be rearranged in another horizontal plane small area HA adjacent to one horizontal plane small area HA. Even in this case, one object reference position information is arranged for each small horizontal plane area, and the display position of the object in the projection plane two-dimensional coordinate system is determined based on the arrangement of the object reference position information. Further, the superimposed display of the objects is prevented, and the visibility of the display surface can be improved.

  Here, the object reference position arrangement unit 15 divides the horizontal two-dimensional coordinate system by a straight line that passes through the current position of the object display device 1 and is orthogonal to a straight line that connects the current position and the position of the specific target T in the real space. Among the regions obtained in this way, the arrangement processing of the reference position of the object may be performed only for the object located in the region where the specific target exists. In this case, only an object that has a high probability of being a display target is set as a processing target, and placement processing for other objects is not performed, so that the processing load can be reduced.

  The object display position determination unit 18 sets the object reference position information arranged in the horizontal plane small area HA by the object reference position arrangement unit 15 based on the correspondence between the preset horizontal plane small area HA and the projection plane small area VA. It arrange | positions to the projection surface small area VA matched with the said horizontal surface small area, and the display position of the said object is determined based on this arrangement | positioning. FIG. 24B is a diagram illustrating an example of an object arranged in a small area of the projection plane in the projection plane two-dimensional coordinate system.

The object display position determination unit 18 has information in advance regarding the association between the horizontal plane small area HA and the projection plane small area VA. For example, as in this embodiment, the coordinate value (X, Y) in the horizontal two-dimensional coordinate system can be directly associated with the coordinate value (W, Z) in the projection plane two-dimensional coordinate system. It is not limited to attaching. FIG. 24 (a), the (b), the object display position determination section 18 arranges the object reference position information _{O 2} which are arranged in a horizontal plane small area _{HA 12} to the projection surface small areas _{VA H12,} horizontal small The object reference position information O ₃ arranged in the area HA ₁₃ is arranged in the projection plane small area VA _H13 , the object reference position information O ₄ arranged in the horizontal plane small area HA ₁₄ is arranged in the projection plane small area VA _H14 , placing the object reference position information _{O 5} which are arranged in a horizontal plane small area _{HA 15} on the projection surface the small area _{VA H15.} Through these arrangement processes, the display positions of the objects Ob ₂ , Ob ₃ , Ob ₄ , and Ob ₅ are determined.

In FIG. 24B, each of the objects Ob _{2 to} Ob ₅ is represented as a balloon-type graphic object, and information data representing the distance to the object is displayed in the balloon portion (see FIG. 23A). ) Is displayed. In addition, the balloon source part of the balloon-type object is associated with the projection position when the position of the object in the real space is perspective-projected on the projection plane PP (see FIG. 6) to which the projection plane two-dimensional coordinate system belongs. It has been.

FIG. 25 is a diagram illustrating another example of the setting of the placement prohibited area and the rearrangement of objects. Object reference position location unit 15, as shown in FIG. 25, for example, sets the horizontal plane small area HA _Y as an arrangement inhibition region which is located within a predetermined distance set in advance from the Y-axis, the specific target T it is possible to set the horizontal plane small area HA _X located in the left-right horizontal direction belonging horizontal small area HA as an arrangement inhibition region.

In this case, re-arranged in the object in a horizontal plane small area HA indicated by the absolute value of the coordinate value is increased by one coordinate value in the X-axis of the horizontal small areas HA is the original position of the object reference position information O ₃ Even so, since the rearrangement horizontal plane small area HA belongs to the layout prohibition area, the object reference position layout unit 15 further increases the absolute value of the coordinate value of the Y axis of the horizontal plane small area HA by 1. repositioning the object reference position information O ₃ in the horizontal plane small area HA indicated by the coordinate values. That is, the object reference position information O ₃ is rearranged in the horizontal plane small area HA ₂₃ .

  Next, processing contents in the object display device 1 according to the second embodiment will be described with reference to FIG. FIG. 26 is a flowchart showing the processing contents executed in the object display device 1.

  First, the position information acquisition unit 11 acquires the current position of the object display device 1. Further, the direction acquisition unit 12 acquires the shooting direction of the shooting unit 13. Further, the photographing unit 13 acquires zoom information and angle of view information (S21). Next, the horizontal plane two-dimensional coordinate system setting unit 14 includes a straight line connecting the current position of the object display device 1 and the position of the specific target T in real space as one of the reference axes, and the current position of the object display device 1 A horizontal plane two-dimensional coordinate system is set with S as the origin (S22).

  Subsequently, the horizontal plane two-dimensional coordinate system dividing unit 21 divides each quadrant in the horizontal plane two-dimensional coordinate system set by the horizontal plane two-dimensional coordinate system setting unit 14 into horizontal plane small areas HA (S23).

  Subsequently, the object reference position placement unit 15 places the object reference position information in the horizontal plane small area HA to which the position indicated by the object reference position information belongs based on the object information stored in the object information storage unit 10 ( S24). Here, as shown in FIG. 23B, the object reference position placement unit 15 stores the coordinate value of the horizontal plane small area HA in which the object reference position information is placed in the “placement position” field of the object information storage unit 10. It may be memorized. In addition, when the horizontal plane small area HA in which the object reference position information is arranged corresponds to the arrangement prohibited area, the object reference position arrangement unit 15 sets the object reference position information to the horizontal plane small area HA that does not correspond to the arrangement prohibited area. Rearrange (S24).

  Subsequently, the projection plane two-dimensional coordinate system setting unit 16 sets a plane orthogonal to the horizontal component of the imaging direction of the imaging unit 13 acquired by the orientation acquisition unit 12 as the projection plane PP, and the horizontal on the projection plane PP. A projection plane two-dimensional coordinate system having the direction and the vertical direction as coordinate axes is set (S25). Next, the projection plane two-dimensional coordinate system dividing unit 17 divides each quadrant in the projection plane two-dimensional coordinate system set by the projection plane two-dimensional coordinate system setting unit 16 into projection plane small areas VA (S26). The object display position determination unit 18 then sets the object reference position information placed in the horizontal plane small area HA by the object reference position placement unit 15 based on the preset correspondence between the horizontal plane small area HA and the projection plane small area VA. Are arranged in the projection surface small area VA associated with the horizontal plane small area (S27). Here, as shown in FIG. 23C, the object display position determination unit 18 uses the coordinate value of the projection plane small area VA in which the object reference position information is arranged in the “display position” field of the object information storage unit 10. It is good also as making it memorize.

  Next, the display control unit 19 displays on the projection plane two-dimensional coordinate system based on the information regarding the imaging direction of the imaging unit 13 acquired by the orientation acquisition unit 12, the zoom information and the angle of view information acquired from the imaging unit 13. The range is calculated and the display range frame F is set (S28). Subsequently, the display control unit 19 determines whether or not the object is included in the set display range (S29). Here, as shown in FIG. 23 (d), when one object is included in the display range, the display control unit 19 displays “display necessity attribute” in the record of the object in the object information storage unit 10. "1" is set in the field of. Further, when one object is not included in the display range, the display control unit 19 sets “0” in the “display necessity attribute” field in the record of the object in the object information storage unit 10.

  When it is determined in step S29 that an object is included in the display range, the display control unit 19 causes the display unit 20 to display the object included in the display range on the real space video (S30). On the other hand, if it is not determined in step S29 that the object is included in the display range, the display control unit 19 does not display the object (S31). In this way, the process of this embodiment is complete | finished.

  In the object display device 1 and the object display method of the second embodiment described above, the object is arranged in the horizontal plane small area in the horizontal plane two-dimensional coordinate system based on the position information, and further in the projection plane small area corresponding to the horizontal plane small area. Be placed. Then, the display position of the object is determined based on the projection surface small area where the object is arranged. As a result, the object is arranged in a small area of the projection plane in which the positional relationship on the horizontal plane is reflected. Therefore, it is easy to intuitively recognize the position where the object is associated on the display screen. In addition, since the spatial spread on the horizontal plane is reflected on the projection plane and the display plane, there is a high probability that the objects are not densely arranged on the display plane and are arranged with a moderate spread. Therefore, even when the amount of objects to be superimposed and displayed on the real space video is large, it is possible to suppress complication of the screen.

(Third embodiment)
Next, the object display device 1 according to the third embodiment will be described. In the third embodiment, the method of setting the projection plane two-dimensional coordinate system by the projection plane two-dimensional coordinate system setting unit 16 and the method of determining the object display position by the object display position determination unit 18 are different from those of the first embodiment. To do. Hereinafter, the difference from the first embodiment will be mainly described.

  FIG. 27 is a diagram for explaining the setting process of the projection plane two-dimensional coordinate system in the third embodiment. As shown in FIG. 27A, the projection plane two-dimensional coordinate system setting unit 16 sets a virtual grid VG, sets the projection plane cylindrical coordinate system on the set virtual grid VG, and sets the projection plane two-dimensional coordinate system of the present invention. Set as coordinate system. That is, the virtual grid VG is virtually provided on the inner surface of a cylinder having a predetermined radius with the current position CP of the object display device 1 as the center in the real space. The axial direction of the virtual cylinder can be, for example, along the vertical direction, but is not limited to this, and can be an arbitrary direction depending on the setting. Then, the projection plane two-dimensional coordinate system setting unit 16 sets the projection plane cylindrical coordinate system with the two directions (for example, the horizontal direction and the vertical direction) on the inner surface of the virtual cylinder as coordinate axes. In addition, the intersection of the virtual grid VG and the Y axis is superimposed on the projection point of the specific target T as the center of the virtual grid VG. In the present embodiment, the intersection of the virtual grid VG and the Y axis is superimposed on the projection point of the specific target T, but any direction and position can be superimposed by setting.

Further, as shown in FIGS. 27A and 27B, the projection plane two-dimensional coordinate system dividing unit 17 divides the projection plane cylindrical coordinate system set on the virtual grid VG into projection plane small areas. In addition, the object display position determination unit 18 arranges the objects Ob _{11 to} Ob ₁₆ at positions where the object reference position arranged in the horizontal two-dimensional coordinate system is perspective-projected in the projection plane cylindrical coordinate system. Further, the display control unit 19 sets the display range frame F based on the shooting direction, zoom information, and angle-of-view information of the shooting unit 13, and displays the superimposed display of the object on the real space video based on the set display range frame F. Part 20 is performed.

  Next, with reference to FIG. 28, processing contents from setting of the projection plane cylindrical coordinate system to superimposed display of the object will be described. FIG. 28A is a diagram showing a state where the projection plane cylindrical coordinate system set on the virtual grid VG is developed. The cylindrical coordinates in the projection plane cylindrical coordinate system are expressed by parameters of X, Y, Z, r, and θ. Here, r is the radius of the cylinder when the virtual grid VG is set. Also, θ is set based on information regarding the shooting direction acquired by the azimuth acquiring unit. In the process in the object display device 1, the virtual grid VG set over 360 degrees around the current position CP of the object display device 1 is handled as an XZ plane. In this embodiment, the XZ plane is exemplified as being orthogonal to the ground (horizontal plane), but is not limited thereto. Moreover, although the horizontal plane two-dimensional coordinate system set prior to the setting of the virtual grid VG and the projection plane two-dimensional coordinate system is shown as being parallel to the horizontal plane in the present embodiment, the present invention is not limited to this.

As shown in FIG. 28A, the object display position determining unit 18 sets the objects Ob _{11 to} Ob _{16 at} positions where the object reference position arranged in the horizontal plane two-dimensional coordinate system is perspectively projected in the projection plane cylindrical coordinate system. Place. 27 to 29, the objects Ob _{11 to} Ob ₁₆ arranged in the projection plane two-dimensional coordinate system are represented by black circles for convenience.

FIG. 28B is a diagram showing objects rearranged in the projection plane cylindrical coordinate system according to a predetermined rule. That is, the object display position determination unit 18 rearranges the objects Ob _{11 to} Ob ₁₆ as indicated by the objects Ob ₂₁ to Ob ₂₆ according to a predetermined rule. In FIGS. 28B to 28D, the rearranged objects Ob _{21 to} Ob ₂₆ are represented as, for example, balloon-type graphic objects.

FIG. 28C is a diagram showing an example of setting the display range frame. That is, the display control unit 19, the photographing direction of the imaging unit 13 sets the display range frame F ₁ based on the zoom information and the angle information. Then, the display unit 20, based on the display range frame F ₁ that is set is displayed by superimposing the object image in the real space. In the case illustrated in FIG. 28C, the display unit 20 displays the objects Ob _{21 to} Ob _{26 so} as to be superimposed on the real space video.

FIG. 28D is a diagram showing another example of setting the display range frame. That is, the display control unit 19, the photographing direction of the imaging unit 13 sets the display range frame F ₂ based on the zoom information and the angle information. Then, the display unit 20, based on the display range frame F ₂ that has been set is displayed by superimposing the object image in the real space. In the case illustrated in FIG. 28D, the display unit 20 displays the objects Ob _{21 to} Ob _{23 so} as to be superimposed on the real space video.

FIG. 29 is a diagram for explaining the rearrangement of objects in the projection plane cylindrical coordinate system. As shown in FIG. 29A, first, the objects Ob _{11 to} Ob ₁₆ are arranged at positions where an object reference position arranged in the horizontal plane two-dimensional coordinate system is perspectively projected in the projection plane two-dimensional coordinate system. Then, as shown in FIG. 29B, the objects Ob _{11 to} Ob ₁₆ are rearranged as shown in the objects Ob ₂₁ to Ob ₂₆ in accordance with a predetermined rule. That is, the object display position determination unit 18 sets a straight line that passes through the arrangement positions of the objects Ob _{11 to} Ob _{16 with} the specific target T as a center, and other objects in the projection surface small area through which the straight line passes are set. Each object is rearranged in a small area of the projection plane that is not arranged and is closest to the original arrangement position of the object. In addition, in this embodiment, although the green in a golf course is set to the specific target T, it is not limited to this. For example, an arbitrary point can be set as the specific target T. Further, the rearrangement of objects is performed in accordance with preset object priorities. FIG. 29 shows an example in which higher priorities are set in the order of the objects Ob ₁₁ , O ₁₂ , O ₁₃ , O ₁₄ , O ₁₅ , O ₁₆ .

According to a predetermined rearrangement rule, but so that the projection surface small areas of the object Ob ₁₄ and object Ob ₁₅ is repositioned to compete, the object Ob _14, is set a higher priority than the object Ob ₁₅ Therefore, the object Ob ₁₄ is preferentially rearranged as shown in the object Ob ₂₄ , and the object Ob ₁₅ is located above the small area of the projection plane where the object Ob ₂₄ is rearranged as shown in the object Ob _25. Is rearranged in a small area of the projection plane adjacent to the. When the object rearrangement positions compete, the various rules described in the first embodiment can be adopted as rules for further rearranging the objects.

  Further, the object rearrangement rule in the projection plane cylindrical coordinate system described with reference to FIG. 29 is applicable to the rearrangement of the object reference position arranged in the horizontal two-dimensional coordinate system in the second embodiment. That is, the object reference position placement unit 15 sets a straight line that passes through the placement position of the object reference position around the specific target T in the horizontal plane two-dimensional coordinate system, and among other horizontal plane small areas through which the straight line passes, The object reference position can be rearranged in a small horizontal plane area that is not arranged and that is closest to the original arrangement position of the object reference position.

  Furthermore, the object rearrangement rules in the projection plane cylindrical coordinate system described with reference to FIG. 29 can be applied to the rearrangement of objects arranged in the projection plane two-dimensional coordinate system in the first to second embodiments. is there. In other words, the object display position determination unit 18 sets a straight line that passes through the arrangement position of the object from the center position with the specific target T as the center in the two-dimensional coordinate system of the projection plane. Among them, the object can be rearranged in the small projection plane area that is closest to the original projection plane small area in which no other object is arranged and the object is arranged.

  Subsequently, the operation of the object display device 1 in the third embodiment will be described with reference to FIG. FIG. 30 is a flowchart showing the processing contents executed in the object display device 1.

  First, the position information acquisition unit 11 acquires the current position of the object display device 1. Further, the direction acquisition unit 12 acquires the shooting direction of the shooting unit 13. Further, the photographing unit 13 acquires zoom information and field angle information (S41). Next, the horizontal plane two-dimensional coordinate system setting unit 14 includes a straight line connecting the current position of the object display device 1 and the position of the specific target T in real space as one of the reference axes, and the current position of the object display device 1 A two-dimensional coordinate system in the horizontal plane with the origin at is set (S42). The object reference position placement unit 15 plots the object reference position information on the horizontal plane two-dimensional coordinate system set by the horizontal plane two-dimensional coordinate system setting unit 14 based on the object information stored in the object information storage unit 10. Arrange (S43).

  Subsequently, the projection plane two-dimensional coordinate system setting unit 16 sets a virtual grid VG and sets a projection plane two-dimensional coordinate system on the virtual grid VG (S44). Next, the projection plane two-dimensional coordinate system dividing unit 17 divides each quadrant in the projection plane two-dimensional coordinate system set by the projection plane two-dimensional coordinate system setting unit 16 into small projection plane areas (S45). Then, the object display position determination unit 18 projects the object reference position information arranged in the horizontal plane two-dimensional coordinate system by the object reference position arrangement unit 15 corresponding to the arrangement position of the object reference position information in the horizontal plane two-dimensional coordinate system. The objects are arranged in the small area, and the objects are rearranged according to the predetermined rearrangement rule in the third embodiment described above (S46).

  Next, the display control unit 19 calculates the display range in the projection plane two-dimensional coordinate system based on the information on the shooting direction of the shooting unit 13 acquired by the azimuth acquiring unit 12, the information on the zoom information, and the angle of view. A range frame F is set (S47). Subsequently, the display control unit 19 determines whether or not the object is included in the set display range (S48).

  If it is determined in step S48 that an object is included in the display range, the display control unit 19 causes the display unit 20 to display the object included in the display range on the real space video (S49). On the other hand, if it is not determined in step S48 that the display range includes an object, the display control unit 19 does not display the object (S50). In this way, the process of this embodiment is complete | finished.

  The present invention has been described in detail based on the embodiments. However, the present invention is not limited to the above embodiment. The present invention can be variously modified without departing from the gist thereof.

  For example, in the present embodiment, each of the function units 10 to 21 is configured integrally with the object display device 1, but each of these function units 10 to 21 is configured to be distributed among a plurality of devices that can communicate with each other. It is also good to do.

  Moreover, in this embodiment, although the apparatus for providing a user with the various information in a golf course is shown as an example of the object display apparatus 1, it is not limited to this. For example, the object display device of the present invention can be applied to a car navigation device.

  DESCRIPTION OF SYMBOLS 1 ... Object display apparatus, 10 ... Object information storage part, 11 ... Position information acquisition part, 12 ... Direction acquisition part, 13 ... Imaging | photography part, 14 ... Horizontal plane two-dimensional coordinate system setting part, 15 ... Object reference position arrangement | positioning part, 16 ... Projection plane two-dimensional coordinate system setting unit, 17 ... Projection plane two-dimensional coordinate system division unit, 18 ... Object display position determination unit, 19 ... Display control unit, 20 ... Display unit, 21 ... Horizontal plane two-dimensional coordinate system division unit, CP: current position, F: display range frame, FP: viewpoint position, HA ... horizontal plane small area, MA ... middle area, O ... object, PP ... projection plane, T ... specific target, VA ... projection plane small area.

Claims (29)

An object display device that superimposes and displays an object on a real space video acquired by a photographing means,
Position information acquisition means for acquiring a current position of the object display device;
Object information storage means for storing object information including object reference position information that is information related to the object and is information related to a reference position in the real space of the object;
A horizontal plane 2 that includes a straight line connecting the current position of the object display device and the position of the specific target in real space as one of the reference axes, and sets a horizontal two-dimensional coordinate system with the current position of the object display device as the origin. Dimensional coordinate system setting means;
Object reference position arrangement means for plotting the object reference position information of the object information stored in the object information storage means in the horizontal plane two-dimensional coordinate system set by the horizontal plane two-dimensional coordinate system setting means;
A projection plane for projecting the object on which the object reference position information is plotted is set in the horizontal plane two-dimensional coordinate system, and a projection plane two-dimensional coordinate system having a horizontal axis and a vertical direction on the projection plane as coordinate axes is set. A projection plane two-dimensional coordinate system setting means,
Each quadrant in the projection plane two-dimensional coordinate system set by the projection plane two-dimensional coordinate system setting means is a small area having a predetermined size and a predetermined coordinate value in the projection plane two-dimensional coordinate system. A projection plane two-dimensional coordinate system dividing means for dividing the projection plane into small areas;
The object reference position information plotted in the horizontal plane two-dimensional coordinate system by the object reference position arrangement unit is arranged in the projection plane small area corresponding to the arrangement position of the object reference position information in the horizontal plane two-dimensional coordinate system. Object display position determining means for determining the display position of the object,
An object display device comprising: display control means for controlling a display position of the object on a display screen based on information on the small area of the projection plane on which the object is arranged by the object display position determining means. . Further comprising an azimuth obtaining means for obtaining a photographing direction of the photographing means;
The projection plane two-dimensional coordinate system setting means includes:
Projection using a plane orthogonal to the imaging direction acquired by the azimuth acquisition unit or a plane orthogonal to the horizontal component of the imaging direction as a projection plane, and the horizontal and vertical directions on the projection plane as coordinate axes The object display device according to claim 1 , wherein a plane two-dimensional coordinate system is set. The projection plane two-dimensional coordinate system setting means includes:
The projection plane 2 starts from the intersection of the projection plane and the straight line drawn along the horizontal component of the imaging direction of the imaging means starting from a position at a predetermined height at the current position of the object display device. The object display device according to claim 2 , wherein coordinate axes in a dimensional coordinate system are set. The projection plane two-dimensional coordinate system setting means includes:
A coordinate axis in the two-dimensional coordinate system of the projection plane is set with the position at which the specific target is perspectively projected on the projection plane as the origin when the position at a predetermined height at the current position of the object display device is the viewpoint. The object display device according to claim 2 . The object display position determining means includes
The object reference position information arranged in the two-dimensional coordinate system on the horizontal plane is perspectively projected on the projection plane by the object reference position arrangement means with the position of a predetermined height at the current position of the object display device as a viewpoint. The object display device according to claim 1 , wherein the object is arranged in the small area of the projection plane corresponding to the position. The object display position determining means includes
When the projection plane small area in which the object reference position information is arranged corresponds to a display prohibition area that is an area prohibiting display of the object, the projection plane small area that does not correspond to the display prohibition area The object display device according to claim 5 , wherein the object display device is rearranged. The object display device according to claim 6, wherein the object display position determination unit sets the projection surface small area in which the object is arranged as the display prohibition area. The object display position determining means includes
The small area on the projection plane located within a predetermined distance set in advance from a vertical coordinate axis in the projection plane two-dimensional coordinate system is set as the display prohibition area. Object display device. The object display position determining means includes
The projection area small area positioned within a predetermined distance set in advance from a horizontal coordinate axis in the projection plane two-dimensional coordinate system is set as the display prohibition area. The object display device according to claim 1. The object display position determining means includes
The projection area small area located within a predetermined distance set in advance from the position of the specific target that is perspectively projected on the projection plane is set as the display prohibition area. The object display device according to any one of the above. The object display position determining means includes
11. The display prohibition area is set as the projection area small area corresponding to an area for displaying a specific graphic object on the display screen of the object display device. The object display device described. The object display position determining means includes
The said object is rearranged in the said adjacent projection surface small area, when the said projection surface small area where the said object is arrange | positioned corresponds to the said display prohibition area | region. The object display device according to item 1. The object display position determining means includes
When the projection plane small area where the object is placed corresponds to the display prohibited area, the absolute value of the vertical coordinate value of the projection plane small area in the projection plane two-dimensional coordinate system is increased by a predetermined value. The object display device according to any one of claims 6 to 12, wherein the object is rearranged in a small area of the projection plane indicated by the reduced coordinate value. The object display position determining means includes
When the projection plane small area where the object is arranged corresponds to the display prohibited area, the absolute value of the horizontal coordinate value of the projection plane small area in the projection plane two-dimensional coordinate system is increased by a predetermined value. The object display device according to any one of claims 6 to 13, wherein the object is rearranged in a small area of the projection plane indicated by the reduced coordinate value. The object display position determining means includes
When a plurality of objects are arranged in one projection plane small area, one object of the plurality of objects is arranged in the one projection plane small area based on a preset priority of the object The other object is rearranged in the small projection plane area adjacent to the one projection plane small area. The object display device according to any one of claims 5 to 14 . The object display position determining means includes
Based on a preset projection plane division rule for dividing the projection plane two-dimensional coordinate system, the projection plane two-dimensional coordinate system is divided into projection plane intermediate areas including a plurality of projection plane small areas, A predetermined arrangement order is set for the plurality of small projection plane areas included in the in-plane area, and an object with a higher priority set in advance is arranged in the projection plane small area with a higher arrangement order. The object display device according to any one of claims 5 to 15 , wherein the object arranged in the area in the projection plane is rearranged. The object display position determining means includes
A plurality of objects related to one object in real space, the object indicating information on one end of the one object on which the viewpoint position of the object display device exists, and the one end of the one object When determining the display position of an object indicating information related to the other end on the side opposite to the part, the object indicating information related to the one end and the object indicating information related to the other end are respectively represented on the projection plane two-dimensional coordinate system. The object display device according to claim 5 , wherein the object display device is arranged in the small area of the projection plane located in a quadrant below and above the horizontal coordinate axis. Each quadrant in the horizontal plane two-dimensional coordinate system set by the horizontal plane two-dimensional coordinate system setting means has a predetermined size and a small horizontal plane that is a small area having a predetermined coordinate value in the horizontal plane two-dimensional coordinate system. It further comprises a horizontal plane two-dimensional coordinate system dividing means for dividing into areas,
The object reference position arranging means is
Based on the object information stored in the object information storage means, the object reference position information is plotted in the horizontal plane small area corresponding to the reference position indicated by the object reference position information,
The object display position determining means includes
Based on the correspondence between the preset horizontal plane small area and the projection plane small area, the object reference position information plotted in the horizontal plane small area by the object reference position placement unit is associated with the horizontal plane small area. The object display device according to claim 1 , wherein the object display device is arranged in the small area of the projected plane. The object reference position arranging means is
Arrangement in which the horizontal plane small area corresponding to the projection-plane small area corresponding to the display-prohibited area that is a display-prohibited area in the projection plane two-dimensional coordinate system is an area that prohibits object arrangement When the horizontal small area that is set as the prohibited area and the object reference position information is arranged corresponds to the arrangement prohibited area, the object reference position information is re-applied to the horizontal small area that does not correspond to the arrangement prohibited area. The object display device according to claim 18, wherein the object display device is arranged. The object reference position arranging means is
The horizontal plane small area located within a predetermined distance set in advance from a reference axis in the horizontal plane two-dimensional coordinate system is set as an arrangement prohibition area which is an area for prohibiting object arrangement, and the object reference position information is arranged. The object reference position information is rearranged in the horizontal plane small area that does not correspond to the placement prohibition area when the horizontal plane small area corresponds to the placement prohibition area. Object display device. The object reference position arranging means is
When a plurality of object reference position information is arranged in one horizontal plane small area, one object reference position information among the plurality of object reference position information is set based on the priority set in advance for the object. It arrange | positions to one horizontal surface small area, and other object reference position information is rearranged to the said horizontal surface small area adjacent to said one horizontal surface small area. The object display device described. The object reference position arranging means is
When a plurality of object reference position information is arranged in one horizontal plane small area, based on the distance from any dimension axis in the horizontal plane two-dimensional coordinate system to the position indicated in the object reference position information, One object reference position information of the object reference position information is arranged in the one horizontal plane small area, and another object reference position information is rearranged in the horizontal plane small area adjacent to the one horizontal plane small area. The object display device according to any one of claims 18 to 21, wherein: The object reference position arranging means is
Of each region obtained by dividing the horizontal plane two-dimensional coordinate system by a straight line that passes through the current position of the object display device and is orthogonal to a straight line that connects the current position and the position of the specific target in real space, The object display device according to any one of claims 18 to 22, wherein an object reference position placement process is performed on an object located in the region where the specific target is present. The projection plane two-dimensional coordinate system setting means includes:
A virtual cylinder having a predetermined radius centered on the current position of the object display device and having an axial center direction set in a predetermined direction is set, and 2 on the inner surface of the set cylinder is set. The object display device according to claim 1 , wherein a projection plane cylindrical coordinate system having a direction as a coordinate axis is set as a projection plane two-dimensional coordinate system. In the projection plane cylindrical coordinate system, the object display position determination means sets a straight line that passes through the arrangement position of one object with the center position as a starting point, and a projection plane small area through which the straight line passes. 25. The object is rearranged in a small projection plane area that is closest to the projection plane small area in which no other object is arranged and the one object is arranged. Object display device. In the horizontal plane two-dimensional coordinate system, the object reference position arrangement means sets a straight line that passes through the arrangement position of one object reference position starting from the center position with the specific target as a center, and a horizontal plane that passes through the straight line. Among the areas, the object reference position is rearranged in a horizontal small area closest to the horizontal small area where the other object reference position is not arranged and the one object reference position is arranged. The object display device according to any one of claims 18 to 23. The object display position determination means sets a straight line passing through the arrangement position of one object from the center position as a starting point in the projection plane two-dimensional coordinate system, with the center position as a starting point. of area, other objects is not disposed, and claim 5, characterized in that the one object to reposition the object to the closest projection surface small areas on the projection surface the small area are arranged 24. The object display device according to any one of 23 . The object display position determining means includes
  When the projection plane small area in which the object reference position information is arranged corresponds to a display prohibition area that is an area prohibiting display of the object, the projection plane small area that does not correspond to the display prohibition area Rearrange to
  The object display device according to claim 1, wherein the object display device is an object display device. An object display method for realizing an object superimposed display on an object display device that overlays and displays an object on a real space video acquired by a photographing means,
A position information acquisition step of acquiring a current position of the object display device;
A horizontal plane two-dimensional coordinate system including, as one of reference axes, a straight line connecting the current position acquired in the position information acquisition step and the position of the specific target in real space, and having the current position of the object display device as an origin. A horizontal plane two-dimensional coordinate system setting step to be set;
Object information is acquired from object information storage means storing object information including object reference position information that is information related to the object and is information related to a reference position in the real space of the object, and the horizontal plane two-dimensional coordinate system An object reference position arrangement step of plotting the object reference position information of the object information on the horizontal plane two-dimensional coordinate system set by the setting step;
A projection plane for projecting the object on which the object reference position information is plotted is set in the horizontal plane two-dimensional coordinate system, and a projection plane two-dimensional coordinate system having a horizontal axis and a vertical direction on the projection plane as coordinate axes is set. A projection plane two-dimensional coordinate system setting step;
Each quadrant in the projection plane two-dimensional coordinate system set by the projection plane two-dimensional coordinate system setting step is a small area having a predetermined size and a predetermined coordinate value in the projection plane two-dimensional coordinate system. A projection plane two-dimensional coordinate system dividing step for dividing the projection plane into small areas;
The object reference position information plotted in the horizontal plane two-dimensional coordinate system in the object reference position arrangement step is arranged in the projection plane small area corresponding to the arrangement position of the object reference position information in the horizontal plane two-dimensional coordinate system. An object display position determination step for determining the display position of the object,
An object display method comprising: a display control step of controlling a display position of the object on a display screen based on information on the small area of the projection plane in which the object is arranged in the object display position determining step. .

Images