JP2021185361A - Guiding device and guiding program - Google Patents

Abstract

To inexpensively and comprehensively guide a guided person to a target position.SOLUTION: A guiding device includes: imaging means; display means; and operation means for accepting an operation. The guiding device includes: position detection means for performing position detection processing to detect a position of the guiding device; route determination means for determining a guiding route to guide a guided person from a present position of the guiding device to a target position; and guiding screen processing means for causing the display means to display a guiding screen where at least an AR display area to display AR content using a captured image captured by the imaging means is arranged, and also rendering at least a guiding direction object indicating a guiding direction along the guiding route from the present position of the guiding device in the AR display area.SELECTED DRAWING: Figure 1

Description

The present invention relates to a guidance device and a guidance program, and can be applied to, for example, directions for a user (guided person) traveling indoors.

Conventionally, the techniques described in Patent Documents 1 and 2 exist as a guidance system (navigation system; navigation system) that guides a guided person on foot (for example, route guidance).

In the technique described in Patent Document 1, a map (bird's-eye view map) in which the current position is viewed from diagonally above and a map viewed from above are combined and displayed on the smartphone possessed by the guided person to the guided person. It makes it easier to recognize the route from the current position to the target point.

In the technique described in Patent Document 2, a glasses-type head-mounted display worn by the guided person on the head functions as a display from the viewpoint of the guided person, and the arrow or sign for guiding the guide to the target point is expanded on the display. By rendering as an object of reality (Augmented Reality; hereinafter also referred to as “AR”), it is easy for the guided person to recognize the route from the current position to the target position.

Japanese Unexamined Patent Publication No. 2019-36953 Japanese Unexamined Patent Publication No. 2017-15485

Although it is possible to provide directions by displaying a bird's-eye view map (bird's-eye map) on a smartphone as in Patent Document 1, it is better for the guided person to display AR on the head-mounted display as in Patent Document 2. The route to the target position may be easy to recognize.

For example, if the space from the current position to the target position is narrow indoors, or if there is no landmark in the space from the current position to the target position, it is better to display AR on the head-up display. It is easy for the guide to recognize the route to the target position.

However, it can be said that the technology described in Patent Document 2 is inferior to the technology completed only with a smart phone as in Patent Document 1 in terms of cost and convenience such as the need to separately prepare a glasses-type display.

In view of the above problems, a guidance device and a guidance program capable of providing guidance (navigation) to a target position to a guided person at a lower cost and in an easy-to-understand manner are desired.

According to the first aspect of the present invention, in a guidance device including an image pickup means, a display means, and an operation means for receiving an operation, (1) a position detection means for performing a position detection process for detecting the position of the guidance device, and (2). ) Position detecting means for detecting the position of the guidance device, (3) route determining means for determining a guidance route for guiding the guided person from the current position of the guidance device to the target position, and (4). ) At least, the display means is to display a guide screen in which an AR display area for displaying AR contents using the captured image captured by the image pickup means is arranged, and at least the guide device is displayed in the AR display area. It is characterized by having a guide screen processing means for rendering a guide direction object indicating a guide direction along the guide route from the current position.

The second guidance program of the present invention performs a position detection process of (2) detecting the position of the guidance device by using a computer mounted on a guidance device including an image pickup means, a display means, and an operation means for receiving an operation. The position detecting means to be performed, (3) the route determining means for determining the guidance route for guiding the guided person from the current position of the guiding device to the target position, and (4) at least the captured image captured by the imaging means are used. The guide screen in which the AR display area for displaying the AR content is arranged is displayed on the display means, and the AR display area indicates at least the guide direction along the guide route from the current position of the guide device. It is characterized in that it functions as a guidance screen processing means for rendering a guidance direction object.

A third aspect of the present invention is a guidance method performed by a guidance device including an image pickup means, a display means, and an operation means for receiving an operation. (1) The guidance device includes a position detecting means, a route determining means, and a guidance screen. A processing means is provided, (2) the position detecting means performs a position detecting process for detecting the position of the guiding device, and (3) the route determining means targets a guided person from the current position of the guiding device. (4) The guidance screen processing means displays a guidance screen in which an AR display area for displaying AR contents using the captured image captured by the imaging means is arranged. The AR display area is characterized by rendering a guide direction object indicating a guide direction along the guide route from at least the current position of the guide device.

INDUSTRIAL APPLICABILITY According to the present invention, it is possible to provide a guide device and a guide program capable of providing a guide to a target position at a lower cost and in an easy-to-understand manner.

It is a block diagram which shows the whole structure of the guide device which concerns on embodiment. It is a figure which showed the example of the appearance of the guide device which concerns on embodiment. It is a flowchart which showed the flow of the guidance processing which concerns on embodiment. It is a figure which showed the map (the map seen from above) based on the map information processed by the guidance device which concerns on embodiment. It is a figure which showed the configuration example of the view coordinate system in the guide apparatus which concerns on embodiment. It is a figure which showed the guidance route which the guidance device which concerns on embodiment guides. It is a figure which showed the configuration example of the guidance screen displayed by the guidance device which concerns on embodiment. It is a figure which showed the arrangement example of the guide direction object which concerns on embodiment. It is a figure which showed the configuration example (the 1) of the guide screen which concerns on the modification of the embodiment. It is a figure which showed the configuration example (the 2) of the guide screen which concerns on the modification of the embodiment. It is a figure which showed the configuration example (the 3) of the guide screen which concerns on the modification of embodiment.

(A) Main Embodiment Hereinafter, one embodiment of the guidance device and the guidance program according to the present invention will be described in detail with reference to the drawings.

(A-1) Configuration of the Embodiment FIG. 1 is a block diagram showing an overall configuration of the guide device 10 of the embodiment.

The guidance device 10 guides a user who possesses the guidance device 10 (hereinafter, also referred to as a "guided person" or a "navigated person") a route or the like to a destination position (navigation; route guidance). It is a device that performs processing.

As shown in FIG. 2, the guidance device 10 includes a touch panel display 11, a camera 12, a control unit 13, a sensor unit 14, and a communication unit 15.

The control unit 13 has a function of controlling the entire guidance device 10, and is a process of guiding (navigating) a route or the like to a destination by using a user interface device such as a touch panel display 11 to the guided person. I do.

The control unit 13 may be configured in software by installing a program (including a guidance program according to an embodiment) in a computer (not shown), or may be configured in hardware (for example, a dedicated semiconductor chip or the like). It may be configured by using. In this embodiment, the control unit 13 will be described as being configured in software using a computer.

The camera 12 is an imaging means capable of imaging a real space.

The touch panel display 11 has a display means (display function) capable of displaying (presenting) an image (for example, an image such as an operation screen) to the user, and an operation means (touch panel) capable of receiving an operation from the user. Function).

The sensor unit 14 is a group of sensors for detecting the movement of the guidance device 10. For example, a sensor group including an acceleration sensor and a gyro sensor can be applied to the sensor unit 14.

The communication unit 15 is a communication means capable of wirelessly communicating with the outside by one or a plurality of communication methods. The type and number of communication methods supported by the communication unit 15 are not limited. As an example, the communication unit 15 of this embodiment may be used for Wi-Fi communication (registered trademark; wireless LAN communication), Bluetooth (registered trademark), LTE (Long Term Evolution), so-called 5G (fifth generation mobile communication system), or the like. It will be described as corresponding to one or more of the communication means.

As described above, in terms of hardware, the guidance device 10 can be configured by using, for example, an information processing device including a touch panel such as a smart phone or a tablet PC, a camera, and various sensors. In this embodiment, the guidance device 10 will be described as being configured by using a smart phone as hardware. That is, the guidance processing unit 131 will be described as being an application program that can be installed on the smartphone.

FIG. 2 is a diagram showing an example of the appearance of the guide device 10 of this embodiment.

In the example of this embodiment, the guidance device 10 will be described as being configured by using a smart phone having an appearance as shown in FIG.

FIG. 2A is a view of the guidance device 10 as viewed from the side of the touch panel display 11 (the side opposite to the camera 12). Further, FIG. 2B is a view of the guidance device 10 as viewed from the side opposite to the touch panel display 11 (the side of the camera 12).

Next, the outline of the guidance processing unit 131 will be described.

The guidance processing unit 131 is a virtual object in which the coordinates of the real space are associated with the image of the real space (hereinafter referred to as “captured image”) captured by the camera 12 by AR (Augmented Reality) technology. A process of generating a rendered (drawn) image of (a so-called AR object) and displaying it on the touch panel display 11 is performed. That is, the guidance processing unit 131 provides guidance information (for example, a route to reach the target position, a current position, a guidance direction, etc.) for guiding the guided person to reach the target position from the current position. It is displayed on the touch panel display 11 using AR technology.

The guidance processing unit 131 includes an AR processing unit 131a as a component for performing image processing, information processing, and the like related to AR. In the example of this embodiment, various AR systems (middleware / platform) can be applied to the AR processing unit 131a. Specifically, in the example of this embodiment, it is assumed that ARkit (registered trademark) is applied as an AR system to the AR processing unit 131a. The AR system applied to the AR processing unit 131a is not limited to the AR kit, and various environments can be applied. For example, if the OS of the guide device 10 is Android (registered trademark), it is natural that ARCore (registered trademark) may be used. That is, in the guidance processing unit 131 (AR processing unit 131a), various AR systems can be applied to the basic functions of AR. Therefore, in the present specification, basic processing related to AR (for example, ARkit or ARCORE) can be applied. The detailed description of the image processing that can be realized by using the above) itself will be omitted.

Further, the guidance processing unit 131 may be constructed by using an integrated development environment for various software (software integrated development environment capable of software development using an AR system). In this embodiment, as an example, the guidance processing unit 131 will be described as being developed using Unity or the like. Therefore, in the processing explanation of the guidance processing unit 131, a class or function defined in a library or the like on Unity may be used for explanation, but a similar class or function may be constructed using another integrated development environment. Of course, it's also good.

The AR processing unit 131a executes various AR-related processes using information and images obtained from the sensor unit 14, the touch panel display 11, and the camera 12. The sensor unit 14 is provided with at least a sensor group required for an AR system such as Arkit or ARCore (for example, a sensor group including an acceleration sensor, a gyro sensor, a magnetic compass (direction detection sensor, etc.)). The detailed explanation will be omitted.

Further, the guidance processing unit 131 includes a position recognition processing unit 131b for recognizing the position of the own device during the guidance processing. The method in which the position recognition processing unit 131b recognizes the position of the own device is not limited, and various methods can be applied. For example, the position recognition processing unit 131b may receive a GPS (Global Positioning System) signal (radio wave) from the outside via the communication unit 15 to perform the position recognition processing of its own device, or the communication unit 15 may perform the position recognition processing. Radio reception strength (position of each radio base station) when communicating with a plurality of surrounding radio base stations (for example, Wi-Fi access points) and beacons (for example, beacons corresponding to Wi-Fi and Bluetooth) via And, the position recognition processing of the own device may be performed according to the distance from each wireless base station to the own device), or the base station of the communication carrier (for example, the base station of LTE) via the communication unit 15. The location information of the own device recognized by the communication network of the communication carrier may be acquired (acquired from the server of the communication carrier).

It is natural that the AR processing unit 131a and the position recognition processing unit 131b may be configured as separate applications from the guidance processing unit 131 and may be operated in cooperation with each other.

As described above, the guidance processing unit 131 performs guidance processing to the target position based on the position information of the own device acquired by the position recognition processing unit 131b.

(A-2) Operation of the Embodiment Next, the operation of the guidance device 10 of the embodiment having the above configuration (each procedure of the guidance method according to the embodiment) will be described.

FIG. 2 is a flowchart showing the operation of the guidance device 10 (guidance processing unit 131) from the start to the guidance processing.

Here, first, it is assumed that the guidance device 10 (control unit 13) activates the application corresponding to the guidance processing unit 131 in response to the user's operation (S101). As for the operation of starting the application, since the basic operations of various smart phones and tablet PCs can be applied, detailed description thereof will be omitted.

When the guidance processing unit 131 is started, the guidance processing unit 131 executes a processing sequence (hereinafter, referred to as a “startup sequence”) necessary for starting the guidance processing (S102).

In the startup sequence, the guidance processing unit 131 performs, for example, a position recognition process of the own device using the position recognition processing unit 131b and a process of holding map information of a map including the recognized position of the own device. The format of the map information held by the guidance processing unit 131 is not limited, and information in the same format as various map information systems (for example, map information similar to those used in various map information applications and navigation systems). (Data) can be applied. The means by which the guidance processing unit 131 acquires the map information around the own device is not limited, and any means (predetermined means) can be applied. For example, the guidance processing unit 131 may hold (record) map data around the own device in advance, or a server (for example,) that does not show map information according to the position (position information) of the own device. You may download it from a map database on the Internet) and keep it.

When the activation sequence is completed, the guidance processing unit 131 sets a target position for guiding the guided person (S103).

For example, the guidance processing unit 131 may set the position corresponding to the operation of the guided person (for example, the operation input for the GUI displayed on the touch panel display 11) as the target position, or set the preset position as the target position. You may do it. Since various GUIs can be applied when the guidance processing unit 131 receives the setting of the target position from the guided person, detailed description thereof will be omitted.

Next, the guidance processing unit 131 searches for a route that can be reached from the current position of the own device to the target position based on the acquired map information and the like, and guides the guided person from the route searched according to a predetermined criterion. Determine the route to be applied to (hereinafter referred to as "guidance route"). For example, the guidance processing unit 131 may determine a route that can be efficiently traveled as a guidance route by using criteria such as a travel distance and a travel time. Further, the guidance processing unit 131 may determine the guidance route based on the evaluation value obtained by adding (weighting addition) a plurality of reference values. Since various processes (for example, the same processes as those of various navigation systems) can be applied to the specific algorithm of the process in which the guidance processing unit 131 searches for the guidance route, detailed description thereof will be omitted.

Next, the guidance processing unit 131 performs a process of displaying a guidance screen for displaying information and an image for guiding the movement to the target position on the touch panel display 11 (S105). The details of the guidance processing screen will be described later.

Next, the guidance processing unit 131 guides the non-guide to move to the target position by continuing the update processing (guidance processing) of the information and images to be displayed on the guidance screen (S106).

After that, when the guidance processing unit 131 detects that the own device has reached the target position, the guidance processing unit 131 ends the guidance processing (update of the guidance screen) (S107).

Next, the details of the guidance processing (guidance processing screen) by the guidance processing unit 131 will be described.

Here, the map information acquired by the guidance processing unit 131 will be described as having the contents as shown in FIG.

FIG. 4 assumes that the map information is visualized as a map viewed from above.

The map shown in FIG. 4 shows a map for one floor of a certain building (indoor). In the example of this embodiment, the initial position of the guide device 10 will be described as being any position on the map (floor) shown in FIG.

In the map (map information) of FIG. 4, the blank portion is shown to be movable, and the shapes of walls, desks, etc. that cannot be moved (passed through) are shown by solid lines. Further, in the map of FIG. 4, a portion where a movable (passable) door or the like is installed on a part of the wall is shown by a dotted line (chain line).

Further, in the guidance processing unit 131 (AR processing unit 131a) of this embodiment, it is assumed that the coordinates (coordinates of the world coordinate system) corresponding to each position of the map shown in FIG. 4 are managed by the AR system. Since the same processing as that of various AR systems can be applied to the association of the world coordinate system corresponding to each position indicated by the map information, detailed description thereof will be omitted.

Here, it is assumed that the guidance processing unit 131 (AR processing unit 131a) manages the two-dimensional coordinates (coordinates of the world coordinate system) at each position of the floor surface (floor) of the map shown in FIG. .. Originally, the coordinates managed by the AR system are 3D, but here, for the sake of simplicity in explanation and illustration, it is assumed that there is no change in height in the space for guiding the guided person. Here, in the space corresponding to the map shown in FIG. 4, the axes of the coordinates in the left-right direction will be described as the X-axis and the axes of the coordinates in the up-down direction will be described as the Y-axis when viewed from the direction of FIG. In the world coordinate system, the adaptation of the X-axis, the Y-axis, and the Z-axis is not limited to the above combinations, and may be changed to various combinations. Further, as described above, since all the maps shown in FIG. 4 have the same height, the illustration is omitted, but the direction of the height orthogonal to the X-axis and the Y-axis (direction orthogonal to the floor surface). Axis is the Z axis. And here, when viewed from the direction of FIG. 4, the right direction is the + X direction (the direction in which the X coordinate value increases), the left direction is the -X direction (the direction in which the X coordinate value decreases), and the upward direction is + Y. The direction (the direction in which the Y coordinate value increases), the downward direction is the -Y direction (the direction in which the Y coordinate value decreases), and the front direction (the direction from the floor to the upper side) is the + Z direction (the Z coordinate value increases). The direction to go) and the direction to the back (the direction from the floor to the bottom) are called the −Z direction (the direction in which the value of the Z coordinate decreases), respectively.

Further, here, the view coordinate system on the guide device 10 side will be described as being shown as shown in FIG.

FIG. 5A is a view of the guidance device 10 from the touch panel display 11 side, and FIG. 5B is a view of the guidance device 10 from the side surface side (side side of the touch panel display 11). There is. In FIG. 5, the coordinate axes of the rectangular touch panel display 11 in the lateral direction (left-right direction when viewed from FIG. 5A) are the X-axis, and the coordinate axes in the longitudinal direction (FIGS. 5A and 5B). The coordinate axis in the vertical direction when viewed is the Y-axis, the direction orthogonal to the screen of the touch panel display 11 (the front or back direction when viewed from FIG. 5 (a), the left-right direction when viewed from FIG. 5 (b)). The coordinate axes of are shown in the Z axis. In the view coordinate system, the adaptation of the X-axis, the Y-axis, and the Z-axis is not limited to the above combinations, and may be changed to various combinations. And here, when viewed from the direction of FIG. 5A, the right direction is the −X direction (the direction in which the X coordinate value decreases), the left direction is the + X direction (the direction in which the X coordinate value increases), and the upper direction. The direction is the + Y direction (the direction in which the Y coordinate value increases), the downward direction is the -Y direction (the direction in which the Y coordinate value decreases), and the front direction is the + Z direction (the direction in which the Z coordinate value increases). The direction on the back side is called the −Z direction (the direction in which the value of the Z coordinate decreases).

Further, here, the AR system of the guidance processing unit 131 (AR processing unit 131a) recognizes the direction of at least one of the views coordinate systems (either the X axis, the Y axis, or the Z axis) in the world coordinate system. It shall be possible. For example, if the sensor unit 14 is equipped with an electronic compass, a gyro sensor, or the like, the guidance processing unit 131 (AR processing unit 131a) is relative to the direction of the world coordinate system based on the sensor data of the sensor unit 14. It is possible to recognize the direction. For example, in Unity, how many times the guidance device 10 (smartphone) rotates counterclockwise from true north according to the class "compass. TrueHeading" (the Y-axis direction of the view coordinate system of the guidance device 10 is the world coordinates). How many times it is tilted counterclockwise from true north of the system) can be recognized. compass. In the trueHeading class, on the horizontal plane (XY plane) of the world coordinate system (real space), the angle of difference (rotation angle) from the direction of the Y axis of the view coordinate system counterclockwise with true north as 0 degree. 0 to 359 "degrees" are returned. Here, assuming that the + Y direction is north (true north) as shown in FIG. 6 (display portion of the cross-shaped coordinate system), the + Y direction of the world coordinate system is returned. When the + Y direction of the view coordinate system matches, the value returned from the compass.treeHeading class is 0 (degrees). At this time, when the + Y direction of the view coordinate system matches the + Y direction of the world coordinate system, compass. The value returned from the trueHeading class is 0 (degrees). Similarly, when the + Y direction of the view coordinate system is the -X, -Y, + X direction of the world coordinate system, it is returned from the compass.treeHeading class for each direction. The values are 90, 180, and 270.

As a matter of course, as shown in FIG. 5, in the view coordinate system, the relative relationship of each axis is known (relationship orthogonal to each other), so that the guidance processing unit 131 (AR processing unit 131a) has one. If the direction of the axis in the world coordinate system is known, the axial direction (direction in the world coordinate system) of another view coordinate system can be easily obtained by calculation (conversion). For example, as described above, compass. If the direction in which the Y-axis direction of the view coordinate system is converted into the world coordinate system is known by the trueHeading class, the Z-axis direction and the X-axis direction of the view coordinate system can also be converted into the direction of the world coordinate system by calculation.

As described above, the guidance processing unit 131 (AR processing unit 131a) acquires the axial direction of the view coordinate system (corresponding relationship of the world coordinate system) by the AR system, so that the orientation of the touch panel display 11 in the world coordinate system / The posture, the direction of the optical axis of the camera 12, and the like may be recognized. Then, here, normally, the touch panel display 11 is such that the guided person points the camera 12 (optical axis of the camera 12) of the guidance device 10 in the direction of his / her own line of sight or faces (orthogonally) his / her own line of sight. Suppose you turn the screen. Normally, the guided person is considered to move in a direction corresponding to the direction of the line of sight. Therefore, in the guidance processing unit 131 (AR processing unit 131a), the axial direction of the Y-axis or Z-axis of the view coordinate system is set to the direction of the world coordinate system. By converting to, it is possible to grasp the traveling direction of the guided person (the direction in which the guided person intends to proceed).

Here, the guidance processing unit 131 (AR processing unit 131a) is used for the above-mentioned Unity. Using the trueHeading class, it is assumed that the output value (0 to 359 degrees; the direction of the Y axis of the view coordinate system) can be acquired as it is as the traveling direction "DP" of the guided person. That is, here, the traveling direction DP acquired by the guidance processing unit 131 (AR processing unit 131a) is compass. Similar to the trueHeading class, it may be a value represented by 0 to 359.

As described above, in the guidance processing unit 131 (AR processing unit 131a), the orientation / orientation of the touch panel display 11 and the optical axis direction of the camera 12 are based on the axial direction of the view coordinate system (axial direction in the world coordinate system). It can be said that the line-of-sight direction / movement direction / traveling direction of the guided person can be recognized. If it is not necessary to acquire the traveling direction DP in the guidance processing unit 131, the above processing may be omitted.

FIG. 6 is a diagram showing an example of an initial position (current position in the initial stage (S103)), a target position, and a guide route acquired by the guidance processing unit 131.

In FIG. 6, the initial position is shown as P101 and the target position is shown as P102. Then, in FIG. 6, the guide route R1 for reaching the target position P102 from the initial position P101 is shown by a dotted line and an arrow. As shown in FIG. 6, the guide route R1 is a route that reaches the target position P102 from the initial position P101 via the relay position P103.

FIG. 7 is a diagram showing a configuration example of the guidance screen.

As shown in FIG. 7, the guidance screen has at least an AR display area for displaying an AR image in which an image of a 3D object (virtual object) in the AR space is rendered (drawn) on the image captured by the camera 12. FA is arranged.

Further, the AR display area FA is configured in the shape of an arrow indicating a direction (hereinafter referred to as "guidance direction") in which the guided person should be guided from the current position (current position of the guided person) in the AR space. The guide direction object image G_OBG, which is an image of the guide direction object OBG, is rendered.

FIG. 7 shows an example of a guidance screen when the guided person is in the initial position (P101).

The guidance processing unit 131 (AR processing unit 131a) acquires the current position (current position of its own device) and the guidance route at predetermined intervals (regular or irregular intervals), and based on the acquired current position and guidance route. , Performs a process of updating the image of each sign on the guidance screen (at least, the image including the "guidance direction object image G_OBG of the AR display area FA"). The process of acquiring the current position and the current guide route of the guide device 10 in the guide processing unit 131 (AR processing unit 131a) is as described above.

FIG. 8 is a diagram showing an arrangement example of the guide direction object OBG.

FIG. 8 is a view when the current position PC of the guide device 10 is viewed from above in the AR space.

In FIG. 8, the guide direction DG from the current position PC is illustrated by a alternate long and short dash line and an arrow. Further, in FIG. 8, a reference position RP as a reference for arranging the guide direction object OBG at a position separated by a distance L1 from the current position PC in the direction of the guide direction DG is shown. Here, it is assumed that the height of the reference position RP is set to the same height as the floor surface, but it may be a position higher than the floor surface (for example, a position about 3 cm above the floor surface). The guide direction object OBG does not have to have a thickness (dimension in the Z-axis direction (height direction)), but may have a thickness (three-dimensional shape) for easy recognition. ..

For example, when the guide route is formed by one or a plurality of straight lines (continuous straight lines), the guide direction DG is in the same direction (parallel direction) as the straight line directly extending (extending) from the current position among the guide routes. It may be the direction of. Further, for example, when the guide route is formed by a curve, the guide is guided in the same direction as the tangent line to the guide route at the current position (the same direction as the tangent line extending from the current position to the side where the guide route exists (parallel direction)). Direction DG may be the direction. As described above, the guide direction DG may be any direction along the guide route from the current position.

For example, when the guide route is the guide route R1 shown in FIG. 6, and the current position of the guided person is the initial position P101, the portion of the guide route R1 extending from the position P101 is directed from the position P101 to P103. In this case, the direction parallel to the straight line (direction from position P101 to position P103) is the guide direction DG. Then, the guidance direction object OBG (guidance direction object image G_OBG) reflecting the guidance direction DG in this case is in the state as shown in FIG. 7.

In FIG. 8, the guide direction object OBG is arranged at a position corresponding to the reference position RP. Specifically, the guide direction object OBG is centered on the reference position RP, and is a triangular marker indicating the guide direction (the apex is directed in the guide direction) on the floor surface (XY plane of the height of the floor surface). It has the shape of a triangle).

If the shape of the guide direction object OBG functions as a sign indicating the guide direction DG, various other shapes (for example, the shape of an arrow or a finger) can be applied without being limited to the shape of a triangle.

Further, in this embodiment, the relative positional relationship between the reference position RP and the guide direction object OBG is not limited to the example of FIG. 8 (an example in which the center position of the guide direction object OBG is the reference position RP). ..

Further, the value of the distance L1 is not limited, but may be set between, for example, about 1 to 3 m.

The timing for updating the guidance direction object OBG, the own device position mark image G_M, and the guidance direction image G_G is not limited in the guidance processing unit 131, and an arbitrary timing (for example, periodic or irregular timing) is applied. You may do it. For example, the guidance processing unit 131 may update each image of the guidance screen every time the guidance direction DG or the current position PC is acquired, or the guidance screen may be updated at predetermined fixed intervals (for example, about 3 seconds). You may update each image of. Further, the guidance processing unit 131 may reflect the acquired values of the guidance direction DG and the current position PC as they are on the guidance screen, or accumulate the latest plurality of samples and accumulate the average value or the weighted average value (past). A weighted average that lowers the weight as the value is) may be acquired and reflected in each image on the guidance screen to stabilize the display.

(A-3) Effect of Embodiment According to this embodiment, the following effects can be achieved.

In the guidance device 10 of this embodiment, as shown in FIG. 7, an image of the guidance direction object OBG (guidance direction object image G_OBG) corresponding to the guidance direction DG is rendered in the AR display area FA to inform the guided person. On the other hand, it is possible to recognize an accurate guidance direction.

Further, since the guidance device 10 of this embodiment can be realized only by installing an application corresponding to the guidance processing unit 131 on the smart phone possessed by the guided person, it is not necessary to prepare a dedicated device or the like, and the cost is low. Can be introduced.

(B) Other Embodiments The present invention is not limited to each of the above embodiments, and modified embodiments as illustrated below can also be mentioned.

(B-1) In the above embodiment, the position of the image of the guide direction object OBG is set based on the relative positional relationship with the guide device 10, but it operates along the guide direction DG (animation). You may let it. For example, the position of the guidance direction object OBG is moved from the initial position (a position away from the position PC by a distance L1) to a movement along the guidance direction DG (movement in a direction away from the guided person), and then the initial position. You may repeat the operation (animation) to return to.

(B-2) In the above embodiment, an image of a guide route object (guide route object image G_OBR) composed of lines and arrows along the guide route is additionally displayed (rendered) in the AR display area FA of the guide screen. You may try to do it.

FIG. 9 illustrates a state in which an image of a guide route object (guide route object image G_OBR) composed of dotted lines along the guide route R1 is rendered in the AR display area FA of the guide screen shown in FIG. 7. This makes it easier for the guided person to recognize the guided route.

(B-3) In the above embodiment, the map display area FM for displaying the map centered on the current position of the guided person (guidance device 10) may be additionally displayed on the guidance screen.

10 and 11 are examples of guidance screens in which the map display area FM is additionally displayed.

Hereinafter, the difference between the guidance screen of FIG. 10 and the guidance screen of FIG. 7 will be described.

In the guidance screen shown in FIG. 10, in the map display area FM, the own device position mark image G_M indicating the current position of the guided person (guidance device 10) and the guidance direction DG from the current position of the guided person are indicated by arrows. The guide direction image G_G is rendered. Then, on the guidance screen shown in FIG. 10, the guidance direction object OBG (guidance direction object image G_OBG) and the direction indicated by the guidance direction image G_G are synchronized (both are set as the guidance direction DG) to the guided person. It is possible to make it easier to recognize the guidance direction.

Hereinafter, the difference between the guidance screen of FIG. 11 and the guidance screen of FIG. 10 will be described.

In the guidance screen shown in FIG. 11, an image of a guidance route object (guide route object image G_OBR) composed of dotted lines along the guide route R1 is rendered in the AR display area FA. Further, in the guidance screen shown in FIG. 11, the guide route image G_R composed of dotted lines along the guide route R1 is rendered in the map display area FM. As a result, on the guidance screen shown in FIG. 11, it is possible to make it easier for the guided person to recognize the guidance route.

The map format (map viewpoint, display format, etc.) displayed in the map display area FM on the guidance screens of FIGS. 10 and 11 is not limited. For example, a bird's-eye view map (bird's-eye view map) may be displayed in the map display area FM.

10 ... Guidance device, 11 ... Touch panel display, 12 ... Camera, 13 ... Control unit, 131 ... Guidance processing unit, 131a ... AR processing unit, 131b ... Position recognition processing unit, 14 ... Sensor unit, 15 ... Communication unit.

Claims (3)

In a guidance device including an image pickup means, a display means, and an operation means for accepting an operation.
A position detecting means for performing a position detecting process for detecting the position of the guidance device, and a position detecting means.
A route determining means for determining a guidance route for guiding the guided person from the current position of the guidance device to the target position, and
At least, the display means is to display a guide screen in which an AR display area for displaying AR contents using the captured image captured by the image pickup means is arranged, and at least the present state of the guide device is displayed in the AR display area. A guide device comprising a guide screen processing means for rendering a guide direction object indicating a guide direction along the guide route from a position. The guidance screen processing means additionally displays a map display area for displaying a map of an area including the current position of the guidance device on the guidance screen, and at least the position and guidance direction of the guided person are displayed in the map display area. The guidance device according to claim 1, wherein an object indicating the above is rendered. In a guidance device including an image pickup means, a display means, and an operation means for accepting an operation.
A position detecting means for performing a position detecting process for detecting the position of the guidance device, and a position detecting means.
A route determining means for determining a guidance route for guiding the guided person from the current position of the guidance device to the target position, and
Guidance direction detecting means that performs guidance direction detection processing for detecting the guidance direction of the guided person possessing the guidance device based on the posture of the guidance device, and
At least, the display means is to display a guide screen in which an AR display area for displaying AR contents using the captured image captured by the image pickup means is arranged, and at least the present state of the guide device is displayed in the AR display area. A guidance program characterized by functioning as a guidance screen processing means for rendering a guidance direction object indicating a guidance direction along the guidance route from a position.

Images