JP2020042025A - Content providing method and device for route guidance - Google Patents

Abstract

To provide a content providing method and apparatus for route guidance.SOLUTION: A server acquires video information including location information related to the shooting location, posture information related to a device used for shooting, and travel direction information, and receives the route guidance request related to location information from a user terminal, thereby a method is provided, which provides the content including video information to a user terminal as the content for route guidance.SELECTED DRAWING: Figure 1

Description

  Embodiments relate to a method of providing content for route guidance to a user terminal, and more specifically, an image corresponding to the position of the user terminal along with the movement of the user terminal from the departure point to the destination is displayed on the user terminal. The present invention relates to a method for providing moving image content to be displayed as content for route guidance.

  A route guidance request for a predetermined destination is received from a user, an optimum route from a departure point to a destination included in the route request is searched, and the searched optimum route is provided to a user terminal and displayed. The service is widely used. Such services are provided by map applications that provide data regarding geographical location and location. On the other hand, a street view application that provides an image in which the position and the place are photographed in relation to the geographical position and the place is also widely known.

  However, when the user goes to an unknown destination, the user is not familiar with the route to the destination or the surrounding features, so the route guidance service provided by the map application alone can quickly and accurately determine the destination. It's hard to get to. In addition, since the Street View service (or Road View service) provided by the Street View application only provides an image of a specific location or place, it can only be used as a reference material for searching for a destination. There are difficulties to utilize to reach the ground quickly and accurately.

  Therefore, even when the user is heading to an unknown destination, route guidance is provided so that the user can intuitively confirm whether the user is correctly traveling along the optimal route guided to the destination. There is a demand for a content providing method for the purpose.

  Patent Document 1 (registered March 27, 2014) relates to a travel route guidance method and apparatus that enables a user to transmit information about a desired type of travel route to a mobile device, and matters necessary for setting a travel route. Discloses a technology that enables a user to set and provide a travel route that meets a user's purpose by searching for a travel route based on information input to an input window for inputting a user and providing the travel route to a user. .

  The information set forth above is for ease of understanding and may include content that does not form part of the prior art or may not include content that the prior art can present to those skilled in the art.

Korean Registered Patent No. 10-138380

  In one embodiment, position information related to the photographing position, posture information of the device used for photographing, and video information including the traveling direction information are obtained, and appropriate information is obtained according to a route guidance request from the user terminal. An object of the present invention is to provide a method of providing content for route guidance including video information to a user terminal.

  In one embodiment, a content for moving image-type route guidance is provided to a user terminal in accordance with a route guidance request including a departure place and a destination. It is an object of the present invention to provide a method for displaying an appropriate image corresponding to the position and orientation of a user terminal on a user terminal as the user moves.

  One embodiment provides content for route guidance generated by analyzing and processing video information captured by a plurality of photographers to a user terminal that has requested route guidance, and stores the user terminal at a position in the route. It is an object of the present invention to provide a method of displaying, on a user terminal, a frame optimized for a corresponding position when is located.

  In one aspect, a method for providing content for route guidance performed by a server, the method comprising providing position information related to a shooting position, posture information related to a device used for shooting, and image information including traveling direction information. And a content providing step of providing content for route guidance including the video information according to a route guidance request related to the location information. Is done.

  The video information may include a plurality of frames.

  The position information, the posture information, and the traveling direction information may be information related to a timing at which each of the plurality of frames is photographed.

  The position information may include GPS information of a shooting position.

  The traveling direction information may include a traveling direction of a device used for the photographing.

  The posture information may include at least one of a roll angle, a pitch angle, and a yaw angle of the apparatus used for the shooting.

  The content providing step may include receiving the route guidance request from a user terminal, and transmitting the moving image content to the user terminal.

  The content may be provided to the user terminal such that an image corresponding to the position of the user terminal is displayed on the user terminal as the user terminal moves from a departure place to a destination.

  Determining the optimal route from the departure point to the destination; and determining the optimal route based on position information, attitude information, and traveling direction information associated with each of the plurality of frames included in the video information. Determining at least one candidate frame for a position in the path, generating the moving image-form content including the optimal frame determined for the position based on the candidate frame; The method may include providing content to the user terminal.

  The plurality of candidate frames may be plural, and the optimum frame may be a reconstructed frame generated by combining a plurality of candidate frames.

  The reconstructed frame may include a 3D image associated with the position.

  There may be a plurality of positions on the optimal route, and the candidate frame and the optimal frame may be determined for each of the plurality of positions on the optimal route.

  When the user terminal moves along the optimal route, the optimal frame associated with the first position is determined when the user terminal is located at the first position among the plurality of positions. It may be provided to the user terminal so as to be displayed on the user terminal.

  The content in the moving image form includes, together with the frame of the content in the moving image form, first guide information at the center of the frame or the center of the screen of the user terminal, among the traveling direction information and the posture information related to the frame. At least one and a position determined based on at least one of the posture information and the traveling direction information of the user terminal, the second guide information is provided to the user terminal so as to be displayed on the user terminal. Good.

  The first guide information may be information indicating a position or a posture of the user terminal.

  The second guide information may be information for guiding an operation of the user terminal to a desired position or posture.

  The candidate frame or the optimal frame may include a frame associated with position information corresponding to the position, and associated with traveling direction information and attitude information obtained by photographing a road or a road from the position to the destination from the front. .

  The step of obtaining the video information may include obtaining video information captured by a plurality of photographers.

  The candidate frame is determined for a position in the optimal route based on position information, attitude information, and traveling direction information associated with each of the plurality of frames included in the video information captured by the plurality of photographers. May be.

  In another aspect, there is provided a method for providing content for route guidance executed by a user terminal, the method comprising: transmitting a route guidance request to a server; and transmitting at least a route guidance request from the server to a destination. Receiving a content including video information related to one position, wherein the video information includes position information related to a shooting position, posture information related to a device used for shooting, and a traveling direction. Receiving information including information, and displaying the image corresponding to the position of the user terminal as the user terminal moves from the departure point to the destination using the content. Content providing method is provided.

  The displaying step is a determining step of determining a frame corresponding to the position of the user terminal from a plurality of frames included in the content, wherein the frame includes position information related to the frame and position information of the user terminal. And a frame display step of displaying the determined frame when the user terminal is located at the position.

  The determined frame may be a reconstructed frame generated by combining a plurality of candidate frames.

  The displaying the frame may include displaying the first guide information at a center of the determined frame to be displayed or a center of a screen of the user terminal together with the determined frame.

  The first guide information may be information indicating a position or a posture of the user terminal.

  The frame display step includes, together with the determined frame and the first guide information, at least one of traveling direction information and posture information related to the determined frame and posture information and traveling direction information of the user terminal. The method may include displaying a second guide information at a position determined based on at least one of the second guide information.

  The second guide information may be information for guiding an operation of the user terminal to a desired position or posture.

  The operation of the user terminal to an intended position or posture may be an operation of the user terminal that matches a display position of the first guide information with a display position of the second guide information.

  The displaying of the second guide information includes calculating a direction difference angle by comparing a heading angle associated with the determined frame with a heading angle of the user terminal; and determining the determined frame. Calculating the posture difference angle by comparing the posture information related to the posture information of the user terminal, and determining the display position of the second guide information based on the direction difference angle and the posture difference angle, The method may include displaying the second guide information at the determined display position.

  The attitude difference angle may include at least one of a roll angle and a pitch angle associated with the determined frame and a roll angle and a pitch angle associated with the user terminal. It may be generated based on a comparison with at least one of them.

  The displaying the frame may include displaying a notification message when at least one of the direction difference angle and the posture difference angle is equal to or greater than a predetermined value.

  The video information may include video information in which at least one position existing in the route is photographed by a plurality of photographers.

  The video information may include video information related to at least one position existing in the route obtained from a server that provides a street view or road view service.

  By providing the user terminal with the position information related to the shooting position, the posture information of the device used for shooting, and the video information including the traveling direction information as content for route guidance, the user can use the user terminal. Can be intuitively confirmed whether the user is correctly moving along the optimal route guided to the destination while confirming the image displayed in. That is, the user can easily compare the image displayed on the user terminal with the actual feature at the corresponding position. When the displayed image deviates from the position to be guided, a notification message (for example, an alarm Etc.).

  By using video information captured by multiple photographers to generate content for route guidance, it is optimal for the position within the route for which route guidance was requested (to identify the route to the destination) The video of the converted frame can be displayed on the user terminal.

FIG. 5 is a diagram illustrating a method for providing a content for route guidance based on video information acquired by shooting to a user terminal that has requested route guidance in one embodiment. FIG. 2 is a structural diagram illustrating a configuration of a device that executes photographing, a server that generates content for route guidance, and a user terminal that receives provision of content for route guidance in one embodiment. 5 is a flowchart illustrating a method of acquiring (generating) video information and transmitting the acquired video information to a server according to an embodiment. 4 is a flowchart illustrating a method in which a server acquires video information and provides a content for route guidance to a user terminal that has requested route guidance, according to an embodiment. 6 is a flowchart illustrating a method in which a user terminal transmits a route guidance request to a server and receives a content for route guidance from the server according to an embodiment. 5 is a flowchart illustrating a method of displaying a video for route guidance corresponding to a position of the user terminal as the user terminal moves to a destination according to an embodiment. 5 is a flowchart illustrating a method for displaying guide information together with a user terminal displaying an image for route guidance in one embodiment. FIG. 4 is a diagram illustrating a method of acquiring video information by a device that executes photographing according to an embodiment. FIG. 7 is a diagram illustrating a method in which a server matches a candidate frame suitable for a position in a route for which route guidance has been requested, according to an embodiment. FIG. 5 is a diagram illustrating a method of generating an optimal image for route guidance by analyzing and processing image information captured by a plurality of photographers, according to an exemplary embodiment. FIG. 4 is a diagram illustrating a method of a user terminal matching a playback frame appropriate to a position of the user terminal according to an embodiment. FIG. 6 is a diagram illustrating a method of displaying guide information on a user terminal together with an image for route guidance in one embodiment.

  Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. The same reference numerals provided in each drawing indicate the same members.

  In the following detailed description, the functions and / or operations performed by the components included in the user terminal, the server, and the other devices are not the corresponding components, but are higher-level components including the corresponding components, for convenience of explanation. It may be described as being executed by a user terminal, a server, and other devices.

  Further, in the following detailed description, the video displayed on the user terminal that has been provided with the content for route guidance may indicate a frame of the video. That is, the terms “video” and “frame” may be used interchangeably with each other, and the term “video” may be used to refer to one frame in addition to a video including a plurality of frames. May be.

  FIG. 1 is a diagram illustrating a method for providing content for route guidance based on video information acquired by shooting to a user terminal that has requested route guidance in one embodiment.

  In FIG. 1, video information generated by the device 110 used for capturing an image of a place or position 160 is transmitted to a server (street view server) 120, and content for route guidance including the video information is provided. Is provided to the user terminal 130 that has requested the route guidance.

  The device 110 is a device for photographing a feature (for example, a road, a road, a building, or the like) existing at a place or a position 160, and may include a camera. As shown, device 110 may be a smartphone. The device 110 may generate video information by photographing a feature present at a location or location 160. The image information may include position information, attitude information, and traveling direction information related to the device 110 at the time of shooting (timing), in addition to the shot image.

  The specific configuration, function, and operation of the device 110 will be described in more detail with reference to FIG.

  The device 110 may transmit the generated video information to the server 120 via a network (for example, the Internet). The server 120 may record the video information acquired from the device 110 in the database 125. The database 125 may exist separately from the server 120 as shown in the figure, or may exist inside the server 120 differently from the one shown in the figure.

  The server 120 may determine an optimal route to the destination in accordance with a route guidance request from the user terminal 130 to a predetermined destination, and may provide the user terminal 130 with information on the determined optimal route. That is, the server 120 may be a device that provides a route guidance service to the user terminal 130. Further, the server 120 may be a device that provides a street view service or a road view service to the user terminal 130 according to a request from the user terminal 130.

  The specific configuration, function, and operation of the server 120 will be described in more detail with reference to FIG.

  The server 120 may generate content for route guidance using the video information acquired from the device 110. The content for route guidance may include the video information. When the server 120 receives the route guidance request from the user terminal 130, the server 120 may generate content for route guidance (or provide the content generated in advance) to the user terminal 130.

  The content for route guidance may be content for guiding the user terminal 130 on the optimal route determined by the server 120.

  The user terminal 130 may guide the user of the user terminal 130 to the destination using the provided content for route guidance. The user terminal 130 may display the video 150 corresponding to the position of the user terminal 130 as the user terminal 130 moves to the destination while using the content. The video 150 displayed on the user terminal 130 includes guide information for guiding the destination (for example, information including an arrow and / or text as information indicating the direction to the destination, and visual information of a road / road to the destination). Information for distinguishing and indicating each other).

  In the point that the video displayed on the user terminal 130 changes as the user terminal 130 moves to the destination, the content for the route guidance including the video information is a content in the form of a moving image. Good.

  The user terminal 130 is provided with the content for route guidance including the video information from the server 120, and guides the user to the destination by using the content. This makes it possible to compare the current location with the feature, thereby enabling the user to intuitively confirm whether the user is correctly moving along the optimal route guided to the destination.

  The specific functions and operations of the device 110, the server 120, and the user terminal 130, the provision of content for route guidance by the server 120, and the reproduction (display) of content for route guidance at the user terminal 130 are described below. This will be described in more detail with reference to FIGS.

  FIG. 2 is a structural diagram showing a configuration of a device that executes shooting, a server that generates content for route guidance, and a user terminal that receives provision of content for route guidance in one embodiment.

  The configurations of the device 110, the server 120, and the user terminal 130 illustrated in FIG. 1 will be described in more detail with reference to FIG.

  The device 110 may be any device configured to capture a feature present at a location or location 160. For example, the device 110 may be a smartphone including a camera 116, a personal computer (PC), a laptop (laptop computer), a laptop computer (laptop computer), a tablet (tablet), an IoT (Internet of Things) device, or a wearable computer. The terminal may be a terminal used by the user, such as (wearable computer).

  The device 110 may include a communication unit 112, a control unit 114, a camera 116, and a sensor unit 118.

  The communication unit 112 may be a device for the device 110 to communicate with the server 120 and other devices. That is, the communication unit 112 is a hardware module, such as a network interface card, a network interface chip, and a networking interface port of the device 110, that can transmit / receive data and / or information to / from the server 120 or the like. Or a software module such as a network device driver or a networking program.

  The control unit 114 may manage the components of the device 110, and may execute a program or an application used by the device 110. For example, the control unit 114 may control the camera 116 in accordance with the received photographing instruction so as to photograph a feature existing at the place or the position 160, or may generate video information by photographing. The control unit 114 may execute a program or application required to generate the video information, and may perform an operation necessary for executing the program or application and processing data. The control unit 114 may be at least one processor of the device 110 or at least one core in the processor.

  The camera 116 is configured to execute photographing, and may include an image sensor.

  The sensor unit 118 may be a device for acquiring position information, posture information, and traveling direction information related to the device 110 at the time of shooting. The traveling direction information may include a traveling direction of the device 110 (that is, including information indicating the traveling direction). In addition, the sensor unit 118 may acquire speed information related to the device 110 at the time of shooting.

  The position information may include latitude information, longitude information, and altitude information as GPS information of the shooting position. For example, the sensor unit 118 may include a GPS module and an altitude sensor for acquiring position information related to the device 110 at the time of shooting. The attitude information may include at least one of a roll angle, a pitch angle, and a yaw angle of the device 110. Attitude information may include all roll, pitch, and yaw angles of device 110. The attitude information may include attitude heading reference system (AHRS) information. The attitude information may also include Euler angles and / or quaternion information associated with the device 110.

  The posture information may include angle information of the device 110. The angle information may include a heading angle (heading angle) of the device. The heading angle may correspond to the yaw angle of device 110. The yaw angle may be a yaw angle with respect to the traveling direction of the device 110 indicated by the traveling direction information. That is, the yaw angle may further consider the angle of the direction in which the photographer (user) looks at the traveling direction of the device 110 (that is, the direction in which the device 100 (the camera of the device 100) faces).

  The sensor unit 118 may include a geomagnetic sensor, an acceleration sensor, and a gyro sensor, and the attitude information and / or the traveling direction information may be calculated from a value obtained by at least one of such sensors. The speed information may also be calculated from a value obtained by at least one of the components of the sensor unit 118.

  The video information generation unit 115 of the control unit 114 may generate video information by associating the information obtained by the sensor unit 118 with the video captured by the camera 116. The generated video information may be transmitted to the server 120 via the communication unit 112. The video information generation unit 115 may be realized by a software module and / or a hardware module.

  Although not shown, the device 110 may include a storage unit as a device for recording data or information. The storage unit may record the generated video information. That is, the video information transmitted to the server 120 may be video information recorded in the storage unit in advance.

  The server 120 may be a device that acquires video information from the device 110 and provides a content for route guidance including the video information to the user terminal 130 that has requested the route guidance. For example, the server 120 may be a device that provides a route guidance service to the user terminal 130. The server 120 may be a device that provides a street view service or a road view service to the user terminal 130 according to a request from the user terminal 130.

  The server 120 may include a control unit 220 and a communication unit 210. In the detailed description described below, the description of the control unit 220 and the communication unit 210 that are the same as those of the control unit 114 and the communication unit 112 of the device 110 will be omitted.

  The communication unit 210 is a device for the server 120 to communicate with the device 110 or the user terminal 130, and is a device that enables transmission and reception of data and / or information between the device 110 and the user terminal 130. May be.

  The control unit 220 may manage the components of the server 120, calculate an optimal route according to a route guidance request from the user terminal 130, generate content for route guidance based on the acquired video information, and The configuration may be provided to the terminal 130. The control unit 220 may be at least one processor of the server 120 or at least one core in the processor.

  The control unit 220 may include a video information acquisition unit 222 and a content providing unit 224. Each of the configurations 222 and 224 of the control unit 220 may be realized by one or more software modules and / or hardware modules.

  The video information acquisition unit 222 may acquire video information including position information related to a shooting position of the device 110, posture information of the device 110, and traveling direction information related to the device 110. Further, the video information acquisition unit 222 may acquire video information from a database (for example, the database 125) that records a street view (or road view) video instead of the device 110. The video information obtained from the database may be used to compose the content for route guidance in the same manner as the video information from the device 110, and auxiliary information for the video information from the device 110 (ie, (Data for supplementing video information from the device 110). The video information acquired from the database may also include position information, posture information, and traveling direction information at the time of shooting.

  That is, the video information used to generate the content for route guidance is obtained from a server (for example, database 125) that provides a street view or road view service in addition to the video information acquired from the device 110. It may include video information that is acquired (associated with a position in the route being guided).

  The content providing unit 224 may provide the user terminal 130 with content for route guidance including video information, for example, in accordance with a route guidance request related to position information from the user terminal 130. As the user moves to the destination, the user can quickly and accurately go to the destination while referring to the video included in the content for route guidance displayed on the user terminal 130.

  The user terminal 130 may be any electronic device that requests route guidance from the server 120 and receives content for route guidance from the server 120. For example, similarly to the device 110, the user terminal 130 includes a smartphone, a personal computer (PC), a laptop (laptop computer), a laptop computer (laptop computer), a tablet (tablet), and an IoT (Internet Of Things) device. Or a terminal used by the user, such as a wearable computer.

  The user terminal 130 may include a communication unit 230, a control unit 240, a display unit 250, and a sensor unit 260. The user terminal 130 may be a device similar to the device 110, and the communication unit 230, the control unit 240, and the sensor unit 260 overlap with the communication unit 112, the control unit 114, and the sensor unit 118 of the device 110. The description of the content is omitted.

  The communication unit 230 is a device for allowing the user terminal 130 to communicate with the server 120 and other user terminals, and is a device for transmitting / receiving data and / or information to / from the server 120 or the like. Good.

  The control unit 240 may manage the components of the user terminal 130, generate a route guidance request, transmit the route guidance request to the server 120 via the communication unit 230, and transmit the content for route guidance from the server 120. The display may be displayed on the display unit 250. The control unit 240 may be at least one processor of the user terminal 130 or at least one core in the processor.

  The control unit 240 may execute an application or a program (for example, a map application, a navigation application, a street view or a road view application, etc.) for providing route guidance to the user.

  The control unit 240 may include a route guidance request unit 242 and a content providing unit 244. Each of the configurations 242 and 244 of the control unit 240 may be realized by one or more software modules and / or hardware modules.

  The route guidance request unit 242 generates a route guidance request including the destination input or selected by the user (the destination input or selected by the user similarly to the destination, or the current location of the user terminal 130) and the departure location. It may be generated, and the generated route guidance request may be transmitted to the server.

The content providing unit 244 may receive the content for route guidance from the server 120 via the communication unit 230, and may display the video included in the content on the display unit 250. The content for route guidance may include video information related to at least one position existing in the route from the starting point to the destination.

  The content providing unit 244 may display, on the display unit 250, a frame corresponding to the current location of the user terminal 130 among videos (video frames) included in the received content for route guidance. That is, the content providing unit 244 may display an image corresponding to the position of the user terminal 130 on the display unit 250 as the user terminal 130 moves from the departure place to the destination while using the received content. .

  The display unit 250 is a device that outputs data input by the user of the user terminal 130, and may be a device that displays video included in content for route guidance. For example, the display unit 250 may include a touch screen. In this case, the display unit may be configured to have a function of an input unit for receiving input of settings and requests from a user.

  The sensor unit 260 may be configured to be similar to the sensor unit 118 described above. That is, the sensor unit 260 may acquire position information, posture information, and traveling direction information related to the user terminal 130.

  When displaying the image corresponding to the position of the user terminal 130 on the display unit 250, the control unit 240 considers the information acquired by the sensor unit 260 to provide the user with a more intuitive route guidance for the destination. Can be provided.

  The generation of video information by the device 110, the provision of content for route guidance by the server 120, and the method of displaying video by the user terminal 130 will be described in more detail with reference to FIGS.

  Since the technical features described above with reference to FIG. 1 can be applied to FIG. 2 as they are, duplicate description will be omitted.

  FIG. 3 is a flowchart illustrating a method of acquiring (generating) video information and transmitting the video information to a server, according to an embodiment.

  In step 310, the device 110 may use the camera 116 to photograph a feature at a predetermined position or location. A feature may include a road, road, or building within or near a location or location.

  In operation 320, the device 110 may obtain position information related to the shooting position in step 310 and the shooting position, attitude information of the device 110, and traveling direction information related to the device 110. The information obtained in step 320 may be obtained by the sensor unit 118. The position information, the posture information, and the traveling direction information may be information related to the time when the image was captured (timing) (that is, information acquired at the time when the image was captured).

  In operation 330, the apparatus 110 may generate image information by associating the image captured using the camera 116 with the position information, the attitude information, and the traveling direction information obtained in operation 320. For example, the position information, the posture information, and the traveling direction information may be associated with each frame included in the captured video.

  In addition, the position information, the posture information, and the traveling direction information may be acquired at predetermined time intervals (for example, 1 second or 5 seconds) and may be associated with a captured image. It may be related only to a predetermined key frame.

  Therefore, the generated video information includes the position information, the posture information, and the traveling direction information. The generated video information may include a plurality of frames, and the position information, the posture information, and the traveling direction information may be information at the time when each of the plurality of frames is photographed. Further, the video information may include speed information of the device 110 acquired by the sensor unit 118. Speed information may also be associated with frames of video information in a similar manner.

  In operation 340, the apparatus 110 may transmit the generated video information to the server 120 via the communication unit 112. For example, the device 110 may upload the video information to the server 120.

  As an example, the device 110 may be associated with an SNS account, and the server 120 may be a server that provides an SNS service. At this time, the device 110 may upload the video information to a timeline corresponding to its own SNS account.

  The video included in the video information may be an image of a feature present at a plurality of places or positions. For example, the video included in the video information may be a location that exists in a path or a location that exists in a route that the user of the device 110 moves toward a specific destination (for example, a location that a blogger user wants to introduce). It may be an image of an object. Such an image may include a moving image captured by the user while moving. Thus, the user may upload the moving image taken by the user to the SNS service as content for route guidance.

  The method by which the server 120 generates and provides the content for route guidance while using the video information transmitted to the server 120 will be described in more detail with reference to FIGS.

  The description of the technical features described above with reference to FIGS. 1 and 2 can be applied to FIG. 3 as it is, and a duplicate description will be omitted.

  FIG. 4 is a flowchart illustrating a method in which a server acquires video information and provides content for route guidance to a user terminal that has requested route guidance in one embodiment.

  In step 410, the image information obtaining unit 222 of the server 120 transmits the position information related to the shooting position via the communication unit 210, the posture information of the device used for shooting, and the information related to the device used for shooting. Video information including the traveling direction information may be acquired. As described above, the video information may be information captured and generated by the device 110 and received.

  The server 120 may acquire video information captured by a plurality of photographers. The video information acquired by the server 120 may be recorded in the database 125 and managed.

  In operation 420, the content providing unit 224 of the server 120 may provide the content including the video information acquired in operation 410 as content for route guidance. For example, by receiving a route guidance request related to location information from the user terminal 130, the content providing unit 224 converts the content including the video information including the corresponding location information into the user terminal 130 as content for route guidance. May be provided.

  That is, in accordance with the route request from the user terminal 130, the content for route guidance including the video of the position related to the route request may be provided to the user terminal 130.

  Step 420 will be described in more detail with reference to steps 422 to 429.

  In operation 422, the content providing unit 224 may receive a route guidance request including a departure place and a destination from the user terminal 130 via the communication unit 210. The route guidance request from the user terminal 130 may not include a destination (and a departure place), but at this time, the route guidance request may be a request for content in the form of a moving image to the server 120.

  In step 424, the content providing unit 224 may determine an optimal route from the departure point to the destination included in the route guidance request. The optimal route may be plural, and may be finally determined by selection by the user terminal 130.

  In operation 426, the content providing unit 224 may determine the optimal route within the optimal route determined in operation 424 based on the position information, the attitude information, and the traveling direction information associated with each of the plurality of frames included in the video information acquired in operation 410. At least one candidate frame may be determined for at least one position. The candidate frame may be determined (allocated) to each of a plurality of positions in the optimal route. There may be a plurality of candidate frames for each position.

  The candidate frame (or the optimal frame described later) is associated with the position information corresponding to the position where the candidate frame is determined, and the front or the road including the road or the road from the position to the destination is included. May include a frame related to the traveling direction information and the posture information captured from the camera. That is, the candidate frame determined for a specific position in the optimal route is a video taken at the specific position, and a road or a road from the specific position to the destination is viewed from the front (or the user). May be included in a form that makes it possible to identify a road or a road most easily. Also, the candidate frames may include a predetermined number of frames that best meet such criteria among a plurality of frames.

  On the other hand, as described above, the video information for generating the content for the route guidance may include video information in which at least one position existing in the optimal route is photographed by a plurality of photographers. When the candidate frame is determined based on video information captured by a plurality of photographers, the candidate frame includes position information, posture information, and position information associated with each of the plurality of frames included in the video information captured by the plurality of photographers. It may be determined for each position in the optimal route based on the traveling direction information.

  A method of assigning (matching) a candidate frame to a position in the optimal route will be described in more detail with reference to FIG.

  In operation 428, the content providing unit 224 may determine the optimal frame based on the candidate frame determined for the position in the optimal route, and may generate moving image-type content including the optimal frame. When there are a plurality of candidate frames for a certain position in the optimum route, the optimum frame may be a frame selected by the content providing unit 224 as a suitable frame from the plurality of candidate frames. Further, the optimal frame may be a reconstructed frame generated by combining a plurality of candidate frames. The reconstructed frame may include a 3D image (or an augmented reality or VR image) associated with the position. The method of generating the reconstructed frame will be described in more detail with reference to FIG.

  In operation 429, the content providing unit 224 may transmit the generated moving image content to the user terminal 130 via the communication unit 210. The content provided to the user terminal 130 is provided in such a manner that an image corresponding to the position of the user terminal 130 is displayed on the user terminal 130 as the user terminal 130 moves from the departure point to the destination. , May be regarded as corresponding to the content in the moving image form.

  For each of the plurality of positions in the optimal path determined in step 424, a candidate frame and a corresponding optimal frame may be determined. At this time, when the user terminal 130 moves along the optimum route, the content in the moving image format is moved to the first position (first position) when the user terminal 130 is located at the first position among a plurality of positions on the optimum route. The optimal frame related to the position information corresponding to the position) may be provided to the user terminal 130 so as to be displayed on the user terminal 130. This allows the user to intuitively confirm whether the user is correctly moving along the optimal route guided to the destination by comparing the image displayed on the user terminal 130 with the feature at the current location. It is possible to do.

  On the other hand, the content in the moving image form includes the frame corresponding to the image displayed on the user terminal 130 and the first guide information at the center of the displayed frame (that is, the center of the screen of the user terminal 130). The user is requested to display the second guide information at a position determined based on at least one of the related traveling direction information and the posture information and at least one of the posture information and the traveling direction information of the user terminal 130. It may be provided to the terminal 130.

  The first guide information may be information indicating a position or a posture of the user terminal 130, and the second guide information may be information for guiding an operation of the user terminal 130 to a desired position or posture. Specific examples of the first guide information and the second guide information will be described in more detail with reference to FIG.

  The description of the technical features described above with reference to FIGS. 1 to 3 can be applied to FIG. 4 as it is, and a duplicate description will be omitted.

  FIG. 5 is a flowchart illustrating a method in which the user terminal transmits a route guidance request to the server and receives the provision of content for route guidance from the server according to the embodiment.

  With reference to FIGS. 5 to 7, provision of content for route guidance from the viewpoint of the user terminal 130 will be described.

  In operation 510, the route guidance request unit 242 of the user terminal 130 may transmit a route guidance request to the server 120 via the communication unit 230. The route guidance request may include the departure place and the destination set by the user terminal 130.

  Such a route guidance request may not include a special destination (and departure place). At this time, the route guidance request may be a request for content in a moving image format to the server 120. The content in the moving image format may be, for example, content (moving image) for route guidance uploaded to the SNS service, as described above. The route guidance request may be made, for example, by the user selecting a video uploaded to the SNS service for downloading to the user terminal 130.

  In step 520, the content providing unit 244 of the user terminal 130 receives, from the server 120, the content including the video information related to at least one position existing in the route from the departure place to the destination by the communication unit 230. May be. The route may correspond to the optimal route described with reference to FIG. The content including the video information may correspond to the content for route guidance described above. The video information included in the content received from the server 120 is generated by shooting by the above-described device 110, and includes position information related to the shooting position and posture information related to the device 110 used for shooting. , And traveling direction information. The starting point and / or the destination may be set by the user terminal 130.

  If the route guidance request does not include a special destination and is a request for the moving image content to the server 120, the destination may be a destination included in the moving image content. Here, the departure location may be the current location of the user terminal 130. That is, the user terminal 130 may receive (download) a moving image uploaded by another user to the SNS service as moving image-type content for route guidance. While using the received moving image, the user terminal 130 may display an image corresponding to the position of the user terminal 130 as the user terminal 130 moves from the departure point to the destination included in the moving image. Therefore, the user can move to the destination while comparing the moving image uploaded to the SNS service by another user with the route actually moving.

  In operation 530, the content providing unit 244 may display an image corresponding to the position of the user terminal 130 on the display unit 250 as the user terminal 130 moves from the departure place to the destination using the received content. .

  As an example, when the user of the user terminal 130 sets the destination at the restaurant A and transmits a route guidance request from the current location (departure place) to the restaurant A to the server 120, the user terminal 130 captures the route to the restaurant A. The content including the video information is received from the server 120 as the content for the guidance of the optimal route, and the route guidance is provided to the user by the video captured in the process of moving to the restaurant A by using such content. May do it. At this time, the video information may be information captured by a user who has visited Restaurant A before and uploaded to the server 120.

  Step 530 will be described in more detail with reference to FIG.

  FIG. 6 is a flowchart illustrating a method of displaying an image for route guidance corresponding to the position of the user terminal as the user terminal moves to the destination in one embodiment.

  In operation 610, the content providing unit 244 may determine a frame corresponding to the position of the user terminal 130 from a plurality of frames included in the content received in operation 520. The determined frame may be a “playback frame” displayed on the user terminal 130 when the user terminal 130 is located at the position. The content providing unit 244 may determine a frame corresponding to the position of the user terminal 130 by comparing position information related to a plurality of frames with position information of the user terminal. That is, of the plurality of frames, the frame whose shooting position corresponds to the (current) position of the user terminal or the frame closest to the position may be determined as the reproduction frame of the position. A method of matching a reproduction frame suitable for the position of the user terminal 130 will be described in more detail with reference to FIG.

  In operation 620, the content providing unit 244 may display the playback frame (the frame determined in operation 610) on the display unit 250 when the user terminal 130 is located at the corresponding position. Therefore, when the user terminal 130 receives guidance on the route from the server 120 to the destination, the user terminal 130 is located at a position in the route, so that an image of the feature at the corresponding position is displayed on the user terminal 130. May be.

  On the other hand, the reproduced frame (the frame determined in step 610) displayed on the display unit 250 is the optimal frame described above with reference to FIG. 4 or a reconstructed frame generated by combining a plurality of candidate frames. May be.

  In operation 622, the content providing unit 244 may display the first guide information on the display unit 250 at the center of the playback frame together with the playback frame. The first guide information may be information indicating a position or a posture of the user terminal 130. The first guide information may be information indicating a reference position of the user terminal 130.

  In operation 624, the content providing unit 244 displays, on the display unit 250, at least one of the traveling direction information and the posture information related to the reproduction frame, the posture information and the traveling direction of the user terminal 130, together with the reproduction frame and the first guide information. The second guide information may be displayed at a position determined based on at least one of the information.

  The second guide information may be information that guides an operation to a desired position or posture of the user terminal 130, and an operation to the desired position or posture of the user terminal 130 guided by the second guide information is The operation may be an operation of the user terminal 130 that matches the display position of the first guide information with the display position of the second guide information.

  The first guide information and the second guide information may be displayed so as to overlap the playback frame.

  Specific examples of the first guide information and the second guide information will be described more specifically with reference to FIG.

  A method for displaying the second guide information will be described in more detail with reference to FIG. FIG. 7 is a flowchart illustrating a method of displaying the second guide information together when the user terminal displays an image for route guidance in one embodiment.

  In operation 710, the content providing unit 244 may calculate the direction difference angle by comparing the heading angle of the user terminal 130 with the heading angle associated with the playback frame. That is, the direction difference angle may indicate a difference between the traveling direction angle at the time of capturing the reproduction frame and the traveling direction angle of the user terminal 130. For example, the direction difference angle includes a yaw angle with respect to a traveling direction related to a reproduction frame at the time of shooting of the reproduction frame (that is, a yaw angle according to posture information with respect to a traveling direction according to traveling direction information) and a yaw angle of the user terminal 130 (user terminal 130). (The yaw angle of the user terminal 130 with respect to the traveling direction of the user terminal 130).

  In operation 710, the content providing unit 244 may calculate the posture difference angle by comparing the posture information related to the playback frame with the posture information of the user terminal 130. The attitude information related to the playback frame and the attitude information of the user terminal 130 may include at least one of a roll angle, a pitch angle, and a yaw angle. For example, the posture difference angle may indicate a difference between a roll angle and / or a pitch angle at the time of capturing a playback frame and a roll angle and / or a pitch angle of the user terminal 130. The attitude difference angle may include a pitch angle difference and a roll angle difference, respectively.

  In operation 730, the content providing unit 244 may determine a display position of the second guide information based on the calculated direction difference angle and posture difference angle. The display position of the second guide information may be determined based on the display position of the first guide information displayed at the center of the playback frame. For example, the display position of the second guide information may be determined to be a position shifted from the display position of the first guide information by a value corresponding to the direction difference angle and the posture difference angle. That is, it moves horizontally (x-axis) by a value corresponding to the direction difference angle from the display position of the first guide information, and moves vertically (y-axis) by a value corresponding to the posture difference angle (pitch angle difference and / or roll angle difference). The position moved to ()) may be determined as the display position of the second guide information. In one embodiment, the attitude difference angle may be a pitch angle difference.

  In operation 740, the content providing unit 244 may display the second guide information at the determined display position. The first guide information and the second guide information may be displayed so as to overlap the playback frame.

  The user operates the user terminal 130 while referring to the displayed first guide information and second guide information (that is, as movement) so that the second guide information is displayed at the center of the playback frame. In this case, the display positions of the first guide information and the second guide information may be matched. Thereby, the traveling direction information and the posture information of the user terminal are matched with the traveling direction information and the posture information at the time of shooting of the reproduction frame, and the user can display the displayed reproduction frame and the actual feature at the corresponding position. Can be easily compared.

  In operation 750, the content providing unit 244 may display a notification message on the display unit 250 when at least one of the calculated direction difference angle and posture difference angle is equal to or greater than a predetermined value. That is, although not shown in the figure, the content providing unit 244 determines whether at least one of the calculated direction difference angle and posture difference angle is equal to or greater than a predetermined value, and displays a notification message. May be determined.

  The notification message may include a text message and / or a symbol, such as, for example, an arrow. The notification message may indicate a direction in which the user terminal 130 must be operated. The notification message may be displayed so as to overlap the playback frame displayed on the user terminal 130.

  The notification message may be output as a sound such as a sound effect or a voice, in addition to being output in a visual form.

  The notification message may be displayed when the user terminal 130 deviates from the position (latitude and longitude) on the route to be guided by a predetermined value or more. The notification message may include a symbol and / or text, such as an arrow, indicating in which direction and / or how far the user terminal 130 is off the route.

  On the other hand, the content providing unit 244 includes position information and / or speed information of the user terminal 130 acquired by the sensor unit 260 of the user terminal 130 and position information and / or speed information of video information included in the content for route guidance. The playback speed of the video (playback frame) displayed on the user terminal 130 may be adjusted by comparing. For example, when the user terminal 130 moving along the route stops moving, the reproduction of the displayed video may be stopped (that is, a still image is displayed on the user terminal 130).

  The description of the technical features described above with reference to FIGS. 1 to 4 can be applied to FIGS. 5 to 7 as they are, and thus redundant description will be omitted.

  FIG. 8 is a diagram illustrating a method of acquiring video information by a device that performs photographing according to an embodiment.

  FIG. 8 illustrates a method in which the device 110 uses the camera 116 to photograph a feature at a place or position.

  θ may be the yaw angle of the device 110 with respect to the direction indicated by the traveling direction information related to the device 110, as the traveling direction angle of the device 110. Attitude information associated with device 110 may include angles determined by yaw rotation, roll rotation, and pitch rotation of device 110, as shown.

  The device 110 may generate the above-described video information by associating the traveling direction information and the posture information at the time of capturing (timing) with the video in which the positional information is captured. On the other hand, when the device 110 captures a feature while moving (ie, when performing moving image capturing), the speed information of the device 110 may be associated with the video, and the generated video information includes the speed information. May be.

  The description of the technical features described above with reference to FIGS. 1 to 7 can be applied to FIG. 8 as it is, and a duplicate description will be omitted.

  FIG. 9 is a diagram illustrating a method of matching candidate frames suitable for a position in a route for which route guidance has been requested in a server according to an embodiment.

  Referring to FIG. 9, a method for matching a plurality of frames included in video information (for example, video information captured by a plurality of photographers) acquired and managed by server 120 with a position in a predetermined path explain. The route shown in the figure may be the optimal route for the destination requested by the user terminal 130. The server 120 may match the appropriate frame to each position in the path using a predetermined matching algorithm.

  The server 120 uses the position information (latitude, longitude, altitude), traveling direction information (traveling direction), and attitude information (roll angle, pitch angle, yaw angle) associated with each frame as an index (index), and By comparing with the position, a frame suitable for each position may be matched. For example, the server 120 may match positions and frames with matching (or similar) latitude and longitude to each other.

  As a method of calculating the distance between two points using the latitude and longitude values, a method of calculating the distance between two points located on a sphere (the earth) may be applied. That is, after obtaining the included angle from the center of the earth using the inner product of the two points, the distance between the two points may be calculated by calculating the length of the arc. Alternatively, the distance between two points may be calculated by applying the Vincenty method (see http://www.ngs.noaa.gov/PUBS_LIB/inverse.pdf).

  That is, the server 120 selects, from among the frames in the DB, a frame that most closely matches the position in the route requested by the user terminal 130 and that maximally matches the direction and orientation of the user terminal 130 when providing route guidance. By making the selection, it is possible to reproduce a natural image on the user terminal 130.

  The description of the technical features described above with reference to FIGS. 1 to 8 can be applied to FIG. 9 as it is, and a duplicate description will be omitted.

  FIG. 10 is a diagram illustrating a method of generating an optimal image for route guidance by analyzing and processing image information captured by a plurality of photographers, according to an embodiment.

  With reference to FIG. 10, a method for generating an optimal frame (optimal video) based on the above-described plurality of candidate frames (candidate video) will be described in further detail. The optimal video shown in the figure may correspond to a playback frame displayed on the user terminal 130.

  As shown in the figure, the plurality of candidate frames may have been shot by a plurality of photographers' devices 110-1 to 110-N. For example, a feature at a place or a position 160 may be photographed from a plurality of angles by the devices 110-1 to 110-N.

  Based on the video information generated based on the video captured by the devices 110-1 to 110-N, the candidate video 1 to N for the position 160 in the route may be determined.

  The server 120 may generate a reconstructed video corresponding to the optimal video by decomposing, synthesizing, and reconstructing the candidate videos 1 to N. The optimal image may be an image that allows the user terminal 130 to most easily compare the optimal image with the feature at the position 160 when the user of the user terminal 130 is located at the position 160. The optimal image may be an image in which distortion or defect included in the candidate image has been corrected.

  The decomposition, synthesis, and reconstruction of the candidate videos 1 to N may be performed by the server 120 or an external server using, for example, a video processing method based on machine learning, deep learning, or learning based on an artificial neural network. .

  Therefore, even when the video information acquired by the server 120 is somewhat incomplete and does not include the optimal video, the server 120 decomposes, combines, and reconstructs the video included in such incomplete video information. This makes it possible to generate content for route guidance including the optimal video.

  The description of the technical features described above with reference to FIGS. 1 to 9 can be applied to FIG. 10 as it is, and a duplicate description will be omitted.

  FIG. 11 is a diagram illustrating a method in which a user terminal matches a reproduction frame appropriate to a position of the user terminal according to an embodiment.

  With reference to FIG. 11, a method of determining an appropriate playback frame corresponding to the position of the user terminal 130 as the user terminal 130 moves along the route will be described in further detail.

  The route shown in the figure may be the optimal route for the destination requested by the user terminal 130.

  The user terminal 130 may determine a playback frame suitable for the position of the user terminal 130 by comparing the position information (latitude and longitude) of the frame included in the content for route guidance with the position information of the user terminal 130.

  As a method of calculating the distance between two points using the latitude and longitude values, for example, the above-mentioned Vincenty method (see http://www.ngs.noaa.gov/PUBS_LIB/inverse.pdf) is applied. Good.

  That is, the user terminal 130 can display the playback frame that best matches the position of the user terminal 130, and the user can easily compare the feature at the corresponding position with reference to the displayed playback frame. Becomes

  The description of the technical features described above with reference to FIGS. 1 to 10 can be applied to FIG. 11 as it is, and a duplicate description will be omitted.

  FIG. 12 is a diagram illustrating a method of displaying guide information on a user terminal together with an image for route guidance in one embodiment.

  FIG. 12 shows a state in which a reproduction frame included in the content for route guidance is displayed on the user terminal 130. As shown in the figure, the first guide information 1210 and the second guide information 1220 may be displayed on the user terminal 130 so as to overlap the playback frame. The first guide information 1210 is located at the center of the playback frame (that is, the center of the screen of the user terminal 130), and its display position may be maintained even if the user terminal 130 is moved.

  As described with reference to FIG. 7, the second guide information 1220 may be displayed at a position separated from the first guide information 1210 by the values of the direction difference angle and the posture difference angle.

  The user may move the user terminal 130 to match the display positions of the first guide information 1210 and the second guide information 1220. Thus, the user can more easily compare the displayed playback frame with the actual feature at the corresponding position.

  Although not shown in the figure, the entire route to the destination may be displayed on the user terminal 130 together with the playback frame. The entire route may be displayed in a form like a route provided by a map application, for example. This allows the user to compare the reproduced frame with the actual feature and at the same time check the overall route to the destination.

  The description of the technical features described above with reference to FIGS. 1 to 11 can be applied to FIG. 12 as it is, and a duplicate description will be omitted.

  In the embodiments described above, the operations performed by the server 120 and its configuration may be realized as being performed by the user terminal 130. For example, the server 120 only records and manages the video information, and the general operation for generating the content for route guidance may be realized as being executed by the user terminal and its configuration. Good.

  In other words, at least some of the operations performed by the server 120 can be performed by the user terminal 130 corresponding to the client.

  On the contrary, at least some operations performed by the user terminal 130 can be performed by the server 120 corresponding to the client.

  The apparatus described above may be realized by hardware components, software components, and / or a combination of hardware components and software components. For example, the devices and components described in the embodiments include, for example, a processor, a controller, an ALU (arithmetic logic unit), a digital signal processor, a microcomputer, a FPGA (field programmable gate array), a PLU (programmable logic unit), and a microcontroller. It may be implemented utilizing one or more general purpose or special purpose computers, such as a processor, or various devices capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the OS. The processing device may also respond to the execution of the software, access the data, and record, manipulate, process, and generate the data. Although one processing device may be described as being used for convenience of understanding, those skilled in the art will appreciate that a processing device may include multiple processing elements and / or multiple types of processing elements. You can understand. For example, the processing device may include a plurality of processors or one processor and one controller. Other processing configurations, such as a parallel processor, are also possible.

  The software may include a computer program, code, instructions, or a combination of one or more of these, configuring the processing unit to operate as desired, or instructing the processing unit independently or collectively. Or you can. The software and / or data may be interpreted on the basis of a processing device or provide any instructions or data to the processing device to provide any type of machine, component, physical device, virtual device, computer storage medium or device, or It may be permanently or temporarily embodied in the transmitted signal wave. The software may be distributed on computer systems connected by a network and recorded or executed in a distributed manner. Software and data may be recorded on one or more computer-readable recording media.

  The method according to the embodiments may be implemented in the form of program instructions executable by various computer means and recorded on a computer-readable medium. A computer-readable medium may include program instructions, data files, data structures, etc., alone or in combination. The program instructions recorded on the medium may be those specially designed and configured for the embodiments, or may be those known and usable by those skilled in computer software. Examples of computer readable media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and floppy disks. Included are magneto-optical media and hardware devices specially configured to record and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code, such as that generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

  As described above, the embodiments have been described based on the limited embodiments and the drawings. However, those skilled in the art can make various modifications and variations from the above description. For example, the described techniques may be performed in a different order than the described methods, and / or components, such as the described systems, structures, devices, circuits, etc., in different forms than the described methods. Appropriate results may be achieved even when combined or combined, and replaced or replaced by other components or equivalents.

110: device 120: server 125: database 130: user terminal

Claims (20)

A content providing method for route guidance executed by a server,
Position information related to the shooting position, attitude information related to the device used for shooting, and video information obtaining step of obtaining video information including travel direction information, and according to a route guidance request related to the position information, A content providing method for route guidance, comprising: providing a content for providing route guidance including the video information. The video information includes a plurality of frames,
The position information, the posture information, and the traveling direction information are information related to a timing (timing) at which each of the plurality of frames is captured.
The content providing method for route guidance according to claim 1. The position information includes GPS information of a shooting position,
The traveling direction information includes a traveling direction of the device used for the photographing,
The posture information includes at least one of a roll angle, a pitch angle, and a yaw angle with respect to the traveling direction of the apparatus used for the photographing.
The content providing method for route guidance according to claim 1. The content providing step includes:
Receiving the route guidance request from a user terminal, and transmitting the moving image-form content to the user terminal,
The content is provided to the user terminal so as to display an image corresponding to the position of the user terminal on the user terminal along with the movement of the user terminal from the departure place to the destination,
The content providing method for route guidance according to claim 1. The content providing step includes:
Determining an optimal route from the departure point to the destination,
Determining at least one candidate frame for a position in the optimal path based on position information, attitude information, and traveling direction information associated with each of the plurality of frames included in the video information;
5. The method according to claim 4, further comprising: generating the moving image content including an optimal frame determined for the position based on the candidate frame; and providing the moving image content to the user terminal. 6. Content providing method for route guidance in Japan. The candidate frames are plural,
The optimal frame is a reconstructed frame generated by combining a plurality of candidate frames,
A content providing method for route guidance according to claim 5. The reconstructed frame includes a three-dimensional image associated with the position;
A content providing method for route guidance according to claim 6. A plurality of positions in the optimal route;
The candidate frame and the optimal frame are determined for each of a plurality of positions in the optimal path,
When the user terminal moves along the optimal route, the optimal frame associated with the first position is determined when the user terminal is located at the first position among the plurality of positions. Provided to the user terminal to be displayed on the user terminal;
A content providing method for route guidance according to claim 5. The content in the moving image form includes:
Along with the frame of the moving image content, first guide information is provided at the center of the frame or the center of the screen of the user terminal, at least one of traveling direction information and attitude information related to the frame and the user terminal. At the position determined based on at least one of the posture information and the traveling direction information, the second guide information is provided to the user terminal so as to be displayed on the user terminal,
The first guide information is information indicating a position or a posture of the user terminal,
The second guide information is information for guiding an operation to an intended position or posture of the user terminal.
The content providing method for route guidance according to claim 4. The candidate frame or the optimal frame is associated with position information corresponding to the position, and includes a frame associated with traveling direction information and posture information obtained by photographing a road or a road from the position to the destination from the front,
A content providing method for route guidance according to claim 5. The image information obtaining step obtains image information captured by a plurality of photographers,
The candidate frame is determined for a position in the optimal route based on position information, attitude information, and traveling direction information associated with each of the plurality of frames included in the video information captured by the plurality of photographers. ,
A content providing method for route guidance according to claim 5. A content providing method for route guidance executed by a user terminal,
Transmitting a route guidance request to the server,
A receiving step of receiving, from the server, a content including video information related to at least one position existing in a route from a departure place to a destination, wherein the video information is position information related to a shooting position; A receiving step including attitude information and traveling direction information related to the device used for shooting, and using the content, the user using the content as the user terminal moves from the departure place to the destination. A method for providing content for route guidance, comprising a display step of displaying an image corresponding to a terminal position. The displaying step includes:
Determining a frame corresponding to the position of the user terminal from a plurality of frames included in the content, wherein the frame is obtained by comparing the position information related to the frame with the position information of the user terminal. The content providing method for route guidance according to claim 12, further comprising: a determining step of determining based on the frame, and a frame displaying step of displaying the determined frame when the user terminal is located at the position. The determined frame is a reconstructed frame generated by combining a plurality of candidate frames,
The content providing method for route guidance according to claim 13. The frame display step includes:
Displaying the first guide information at the center of the displayed determined frame or the center of the screen of the user terminal together with the determined frame,
The first guide information is information indicating a position or a posture of the user terminal,
The content providing method for route guidance according to claim 13. The frame display step includes:
Along with the determined frame and the first guide information, based on at least one of the traveling direction information and the attitude information related to the determined frame and at least one of the attitude information and the traveling direction information of the user terminal. Displaying the second guide information at the position determined by the second guide information display step,
The second guide information is information for guiding an operation of the user terminal to an intended position or posture,
The operation of the user terminal to an intended position or posture is an operation of the user terminal that matches the display position of the first guide information with the display position of the second guide information.
The content providing method for route guidance according to claim 15. The second guide information displaying step includes:
Calculating a direction difference angle by comparing a heading angle associated with the determined frame with a heading angle of the user terminal;
Calculating a posture difference angle by comparing posture information related to the determined frame with posture information of the user terminal; and displaying the second guide information based on the direction difference angle and the posture difference angle. Determining a position, and displaying the second guide information at the determined display position.
The attitude difference angle is at least one of a roll angle and a pitch angle related to the determined frame and a roll angle and a pitch angle related to the user terminal. Generated based on a comparison with at least one of
A content providing method for route guidance according to claim 16. The frame display step includes:
When at least one of the direction difference angle and the posture difference angle is equal to or more than a predetermined value, a step of displaying a notification message,
A content providing method for route guidance according to claim 17. The video information includes video information in which at least one position existing in the route is photographed by a plurality of photographers,
The content providing method for route guidance according to claim 12. The video information includes video information related to at least one position existing in the route obtained from a server that provides a street view or road view service,
The content providing method for route guidance according to claim 12.

Images