WO2017101294A1 - Method and apparatus for generating a route-planning-based street view video - Google Patents

Abstract

A method (200) and apparatus (400, 500) for generating a route-planning-based street view video. Said method (200) comprises: acquiring a collection of street view thumbnails on the basis of a generated planned route (210), wherein the collection of street-view thumbnails comprises a plurality of street view thumbnails which match the geographic locations of the route; on the basis of a user's selections, generating a first subset of the collection of street view thumbnails (220), wherein the first subset comprises one or a plurality of street view thumbnails from among the collection of street view thumbnails; acquiring street view images corresponding to the street view thumbnails of the first subset (230); and generating a geographic street view video on the basis of the street-view images (240). By means of said method (200), a street view video is generated while consuming a relatively small volume of network resources.

Description

Street view video generation method and device based on path planning

Cross-reference to related applications

The present application claims priority to Chinese Patent Application No. 201510944361.6, filed on Dec.

Technical field

The present application relates to the field of computer technologies, and in particular, to the field of Internet technologies, and in particular, to a method and apparatus for generating a street view video based on path planning.

Background technique

In the existing network map, the user can generate a path from the start position to the end position by inputting the start position and the end position desired to arrive. After completing the planning, you can generate a preview of the path in the map.

However, when previewing, only the generated path can be segmented and browsed at the corresponding position of the map, and the user is prone to errors when encountering a complicated path.

Summary of the invention

The purpose of the present application is to propose an improved path-based street view video generation to solve the technical problems mentioned in the background art above.

In a first aspect, the present application provides a road view video generation method based on path planning, including: acquiring a street view thumbnail set based on a path generated by a plan, wherein the set of street view thumbnails includes a plurality of street view thumbnails matching the geographic location of the path. Sketching; generating a first subset of the street view thumbnail set based on the user's selection, the first subset including one or more street view thumbnails in the street view thumbnail set; obtaining the first corresponding to each street view thumbnail in the first subset a street view image; and generate a street view video based on the first street view image.

In some embodiments, acquiring the first street view image corresponding to each street view thumbnail in the first subset includes: acquiring each street view thumbnail in the first subset according to a predetermined order Corresponding first street view image.

In some embodiments, the predetermined order is the order in which the distance between the geographic location of each first street view picture and the end of the path is from large to small.

In some embodiments, acquiring the first street view image corresponding to each street view thumbnail in the first subset according to the predetermined sequence includes: acquiring each of the first street view images, and acquiring the first street view image within a predetermined range The part of the first street view image.

In some embodiments, portions within a predetermined range have a first resolution and other portions have a second resolution, the first resolution being greater than the second resolution.

In some embodiments, each first street view picture is a street view picture based on a ball model;

The predetermined range is a portion of the first street view picture in which the vertical angle of view is in the range of -45° to 45° and the horizontal angle of view is in the range of -45° to 45°.

In a second aspect, the present application further provides a method for generating a street view video based on a path plan, including: generating a planning path in response to a path planning request of the terminal, and transmitting the planned path to the terminal; and acquiring the street view thumbnail in response to the terminal Sending, to the terminal, a street view thumbnail set, where the street view thumbnail set includes a street view thumbnail corresponding to the planned path; and based on the terminal selection, transmitting the first street view picture to the terminal according to the predetermined order, and each first street view picture is respectively One of the generated Street View videos corresponds to; wherein the first Street View image is a Street View image corresponding to each Street View thumbnail in the first subset of the Street View thumbnail set; the first subset includes one of the Street View thumbnail sets Or multiple street view thumbnails.

In some embodiments, the predetermined order is the order in which the distance between the geographic location of each first street view picture and the end of the path is from large to small.

In some embodiments, transmitting the first street view picture to the terminal according to the predetermined sequence includes: sending, when each of the first street view pictures is sent to the terminal, transmitting, in the first street view picture, a portion within a predetermined range, and then transmitting the first The rest of the street view image.

In some embodiments, portions within a predetermined range have a first resolution and other portions have a second resolution, the first resolution being greater than the second resolution.

In some embodiments, each of the first street view pictures is a street view picture based on a ball model; the predetermined range is in the first street view picture, the vertical viewing angle is in the range of -45° to 45°, and the horizontal viewing angle is in the range of −45° to 45°. section.

In a third aspect, the present application further provides a path planning-based street view video generating apparatus, including: a first acquiring module, configured to acquire a street view thumbnail set based on a path generated by the planning, where the street view thumbnail set includes a path a plurality of street view thumbnails that are geographically matched; a thumbnail generation module configured to generate a first subset of the set of street view thumbnails, the first subset including one or more of the set of street view thumbnails a second image capture module configured to acquire a first street view image corresponding to each street view thumbnail in the first subset; and a video generation module configured to generate a street view video according to the first street view image.

In some embodiments, the second obtaining module is further configured to: acquire the first street view picture corresponding to each street view thumbnail of the first subset in a predetermined order.

In some embodiments, the predetermined order is the order in which the distance between the geographic location of each first street view picture and the end of the path is from large to small.

In some embodiments, when acquiring the first street view image corresponding to each street view thumbnail in the first subset, the second obtaining module is further configured to: first acquire each first street view image when acquiring the first street view image The portion of the first street view image that is within the predetermined range, and then the other portion of the first street view image.

In some embodiments, the portion within the predetermined range has a first resolution and the other portions have a second resolution, the first resolution being greater than the second resolution.

In some embodiments, each first street view picture is a street view picture based on a ball model;

The predetermined range is a portion of the first street view picture in which the vertical angle of view is in the range of -45° to 45° and the horizontal angle of view is in the range of -45° to 45°.

In a fourth aspect, the present application further provides a road view video generating device based on a path planning, comprising: a planning path generating module, configured to generate a planning path in response to a path planning request of the terminal, and send the planned path to the terminal; a thumbnail sending module configured to send a street view thumbnail set to the terminal in response to the street view thumbnail obtaining request of the terminal, wherein the street view thumbnail set includes a street view thumbnail corresponding to the planned path; and a street view picture sending module, configured In the terminal-based selection, the first street view picture is sent to the terminal according to a predetermined order, and each first street view picture corresponds to one of the generated street view videos respectively; wherein the first street view picture is the first with the street view thumbnail set a street view image corresponding to each Street View thumbnail in the subset; the first subset includes one of the Street View thumbnail sets or Multiple street view thumbnails.

In some embodiments, the predetermined order is the order in which the distance between the geographic location of each first street view picture and the end of the path is from large to small.

In some embodiments, the street view picture sending module is further configured to: when sending each first street view picture to the terminal, first send a part of the first street view picture that is within a predetermined range, and then send the first street view picture. Other parts.

In some embodiments, the portion within the predetermined range has a first resolution and the other portions have a second resolution; the first resolution is greater than the second resolution.

In some embodiments, each first street view picture is a street view picture based on a ball model;

The predetermined range is a portion of the first street view picture in which the vertical angle of view is in the range of -45° to 45° and the horizontal angle of view is in the range of -45° to 45°.

The method and device for generating a street view video based on the path planning provided by the present application generates a street view thumbnail in the planned path after the path planning is completed, and generates a street view video based on the user's selection of one of the street view thumbnails, thereby The user provides a visual image of the planning generation path.

In some embodiments of the present application, by saving the street view image in the cache, when the user requests to browse the generated street view video again, the corresponding street view picture can be directly retrieved from the cache of the terminal to form a continuous Play Street View video without having to request access to the server again, reducing network traffic.

DRAWINGS

Other features, objects, and advantages of the present application will become more apparent from the detailed description of the accompanying drawings.

1 is an exemplary system architecture diagram to which the present application can be applied;

2 is a flow chart of one embodiment of a path plan based street view video generation method in accordance with the present application;

3 is a flow chart of another embodiment of a path planning based street view video generating method according to the present application;

4 is a schematic structural diagram of an embodiment of a path plan based street view video generating apparatus according to the present application;

5 is a schematic structural diagram of another embodiment of a path plan based street view video generating apparatus according to the present application;

FIG. 6 is a schematic structural diagram of a computer system suitable for implementing a terminal device or a server of an embodiment of the present application.

detailed description

The present application will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention, rather than the invention. It is also to be noted that, for the convenience of description, only the parts related to the related invention are shown in the drawings.

It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict. The present application will be described in detail below with reference to the accompanying drawings.

FIG. 1 illustrates an exemplary system architecture 100 of an embodiment of a path planning based street view video generation method or apparatus to which the present application may be applied.

As shown in FIG. 1, system architecture 100 can include terminal devices 101, 102, 103, network 104, and server 105. The network 104 is used to provide a medium for communication links between the terminal devices 101, 102, 103 and the server 105. Network 104 may include various types of connections, such as wired, wireless communication links, fiber optic cables, and the like.

The user can interact with the server 105 over the network 104 using the terminal devices 101, 102, 103 to receive or transmit messages and the like. Various communication client applications, such as a network map application, a shopping application, a search application, an instant communication tool, a mailbox client, a social platform software, and the like, may be installed on the terminal devices 101, 102, and 103.

The terminal devices 101, 102, and 103 may be various electronic devices having a display screen, including but not limited to a smart phone, a tablet computer, an e-book reader, and an MP3 player (Moving Picture Experts Group Audio Layer III). Audio level 3), MP4 (Moving Picture Experts Group Audio Layer IV) player, laptop portable computer and desktop computer, etc.

The server 105 may be a server that provides various services, such as a map server that provides support for path acquisition requests initiated by the terminal devices 101, 102, 103. Map server The processing such as the received path acquisition request and the like is analyzed, and the processing result (for example, the path generated by the planning) is fed back to the terminal device.

It should be noted that the path planning based street view video generating method provided by the embodiment of the present application may be executed by the terminal device 101, 102, 103 or by the server 105. Accordingly, the path planning based street view video generating device may be configured. The terminal devices 101, 102, and 103 may be provided in the server 105.

It should be understood that the number of terminal devices, networks, and servers in Figure 1 is merely illustrative. Depending on the implementation needs, there can be any number of terminal devices, networks, and servers.

With continued reference to FIG. 2, a flow 200 of one embodiment of a path plan based street view video generation method in accordance with the present application is illustrated. The method for generating a street view video based on path planning includes the following steps:

Step 210: Acquire a street view thumbnail set based on the planned generated path, wherein the street view thumbnail set includes a plurality of street view thumbnails that match the geographic location of the path.

In this embodiment, the electronic device (for example, the terminal device shown in FIG. 1) on which the street view video generating method based on the path planning can be sent may send a path planning request to the server that provides the path planning by using a wired connection or a wireless connection. . It should be noted that the above wireless connection manner may include but is not limited to 3G/4G connection, WiFi connection, Bluetooth connection, WiMAX connection, Zigbee connection, UWB (ultra wideband) connection, and other wireless connection methods that are now known or developed in the future. .

In general, the user can access the web page of the server providing the map service through the browser through the browser or input the expected path start point and path end point through the map type application, and submit the information including the path start point and the path end point to the server. .

The server can perform path planning according to the path start point and the path end point input by the user, and send the planned path to the terminal.

In some optional implementations, the server may send the planned path along with a plurality of corresponding Street View thumbnails to the terminal. Alternatively, in other optional implementation manners, the server may first send the planned path to the terminal, and then, according to the request of the user, send a street view thumbnail corresponding to the planned path to the terminal for the terminal. The display shows.

The street view thumbnail can be, for example, a street with a lower resolution and representing the corresponding A picture of the main features of the landscape picture. Due to the low resolution of Street View thumbnails, the required network traffic is small when the terminal captures these Street View thumbnails.

In some optional implementations, the Street View thumbnail stored on the server may include geographic location information corresponding thereto, where the geographic location information may include, but is not limited to, latitude and longitude, street name and house number, zip code, etc. One or more. Since the planned path includes the geographical location information of the starting point, the ending point of the path and the position point between the starting point and the ending point on the plurality of paths, after the path is planned, the server can store the street view stored thereon according to the geographical location information. A thumbnail of the street view corresponding to the path is searched for in the thumbnail, and the set of street view thumbnails composed of the plurality of street view thumbnails corresponding to the path is sent to the terminal.

Step 220: Acquire a first subset of the street view thumbnail set based on the user's selection, the first subset including one or more street view thumbnails in the street view thumbnail set. After the terminal acquires the street view thumbnail set corresponding to the path, each street view thumbnail in the street view thumbnail set may be presented on the display screen of the terminal. In some alternative implementations, these Street View thumbnails may be presented in a far and near order in accordance with the distance from the end of the path.

In some application scenarios, the video that the user desires to generate may only correspond to a part of the planning generation path. In these application scenarios, the user can select the starting position of the desired Street View video by operating on each of the Street View thumbnails presented on the display screen.

Step 230: Acquire a first street view picture corresponding to each street view thumbnail in the first subset.

In some optional implementations, the terminal may send geographic location information corresponding to the first street view thumbnail selected by the user to the server, so that the server knows the starting location of the video that is desired to be generated. The server may match the starting location and the planned generated path to obtain a plurality of first street view images from the starting location to the end of the planned generated path. It can be determined that these first street view pictures have a one-to-one correspondence with each street view thumbnail in the first subset of the street view thumbnail set.

Step 240: Generate a street view video according to the first street view image.

In some optional implementations, the obtained plurality of first street view pictures may be used as respective frames of the street view video, and the existing techniques are used to splicing the respective frames to form a street view video.

In some optional implementations, the generated video may also include a user and a user. An interactive interface on which the user can operate to perform corresponding playback control of the video. Here, the playback control may include, for example, but is not limited to, playing a video, pausing a video, stopping a video, exiting a video, and the like.

In some optional implementations, the acquiring, by the step 230, the first street view image corresponding to each street view thumbnail in the first subset includes:

Step 231: Acquire a first street view picture corresponding to each street view thumbnail in the first subset according to a predetermined order.

By acquiring the first street view pictures in order, it is possible to avoid problems such as excessive network traffic and possible network congestion and/or excessive interruption of the terminal processor.

In some optional implementations, the predetermined order may be, for example, an order in which the distance between the geographic location of each first street view picture and the end of the path is from large to small. That is to say, each first street view picture can be obtained from the start point to the end point in the order of the end point of the planned generated path starting from the geographic location corresponding to the first street view thumbnail selected by the user.

In some optional implementation manners, the acquiring, by the step 231, the first street view image corresponding to each street view thumbnail in the first subset in a predetermined order may be implemented by:

When acquiring each first street view image, first obtaining a portion of the first street view image that is within a predetermined range, and then acquiring other portions of the first street view image.

Further, a portion of the first street view picture within a predetermined range may have a first resolution, and other portions of the first street view picture may have a second resolution. Here, the first resolution is greater than the second resolution.

In general, the first Street View image typically has a larger file size. As described above, different portions of the same first street view picture can be acquired in time to reduce instantaneous network traffic. In addition, a portion of the first street view picture may have a smaller resolution and another portion may have a larger resolution to reduce network traffic for acquiring the first street view picture.

In some optional implementation manners, the first part of the first street view picture and/or the part with a larger resolution may be a part of the first street view picture that is highly concerned by the user, so that the network is balanced. At the same time, the obtained first street view picture has higher picture quality.

In some optional implementations, each first street view image may be a street view based on a ball model. In these alternative implementations, the predetermined range may be, for example, a portion of the first street view picture having a vertical viewing angle in the range of -45° to 45° and a horizontal viewing angle in the range of -45° to 45°. This range is the most interesting part of the user in the first street view picture, and the acquisition speed and/or image quality of this part of the image will have a greater impact on the user experience.

In some optional implementations, after the acquiring the first street view image corresponding to each frame in the street view video in step 230, the method in this embodiment may further include the step 250, saving each first street view image in the cache. in. The first street view image is saved in the cache of the terminal, and after the user finishes playing the video of the path generated by the plan, the user may directly obtain at least a part of the video in the video (ie, the first street view). Picture), which improves the response speed of playing video while reducing the consumption of network traffic.

In some optional implementation manners, when the user inputs a new path start point and/or a path end point, each first street view picture in the cache may be cleared to release the storage capacity of the terminal and speed up the processing speed of the terminal.

The foregoing embodiment of the present application provides a method for generating a plan generation path by providing a street view thumbnail in a planned path to a user after completing the path planning, and generating a street view video based on the user's selection of one of the street view thumbnails. Visual imagery.

Referring to FIG. 3, a flowchart 300 of another embodiment of a path plan based street view video generation method in accordance with the present application. The path planning based street view video generation method of the present embodiment can be performed, for example, by the server in FIG. 1.

The path planning based street view video generating method of this embodiment includes the following steps:

Step 310: Generate a planning path in response to the path planning request of the terminal, and send the planning path to the terminal.

In some optional implementations, the path planning request may include, for example, a path start point and a path end point of the user input of the terminal. In some application scenarios of the optional implementation manner, the path planning request may further include some special features of the user. Constraints, for example, avoiding congestion, with the least red light or the shortest path.

The server may generate the planned path based on the path planning request in any manner, including but not limited to the existing path planning mode, or the path planning mode developed in the future.

Step 320: Send a street view thumbnail set to the terminal in response to the street view thumbnail acquisition request of the terminal, wherein the street view thumbnail set includes a street view thumbnail corresponding to the planned path.

The user can send a Street View thumbnail acquisition request to the server through an operation of the terminal (eg, by manipulating a web page or a control provided in the map application).

After receiving the request, the server may filter out a part of the street view thumbnail corresponding to the planned path from the storage area in which the street view thumbnail is stored, and send the part of the street view thumbnail as a street view thumbnail set to the terminal.

Step 330: Send, according to the selection of the terminal, the first street view picture to the terminal according to a predetermined order, where each first street view picture corresponds to one of the generated street view videos.

The first street view picture is a street view picture corresponding to each street view thumbnail in the first subset of the street view thumbnail set. The first subset includes one or more Street View thumbnails of the terminal in the Street View thumbnail set.

In some optional implementations, the predetermined order may be an order in which the distance between the geographic location of each first street view picture and the end point of the path is from large to small.

In some optional implementation manners, sending the first street view image to the terminal according to the predetermined order may include: when sending each first street view picture to the terminal, first sending the part of the first street view picture that is within a predetermined range, and then Send the rest of the first Street View image.

Further, a portion of the first street view picture within a predetermined range may have a first resolution, and other portions of the first street view picture have a second resolution. The first resolution is greater than the second resolution.

In some optional implementations, each first street view image may be a street model based on a ball model. In these alternative implementations, the predetermined range may be, for example, a portion of the first street view picture having a vertical viewing angle in the range of -45° to 45° and a horizontal viewing angle in the range of -45° to 45°.

With further reference to FIG. 4, as an implementation of the method shown in the above figures, the present application provides an embodiment 400 of a street view video generating device based on path planning, which is compared with the method embodiment shown in FIG. Correspondingly, the device can be specifically applied to various electronic devices.

As shown in FIG. 4, the path planning based street view video generating apparatus of this embodiment includes The first obtaining module 410, the thumbnail generating module 420, the second obtaining module 430, and the video generating module 440.

The first obtaining module 410 is configured to acquire a street view thumbnail set based on the planned generated path, wherein the street view thumbnail set includes a plurality of street view thumbnails that match the geographic location of the path.

The thumbnail generation module 420 can be configured to generate a first subset of the set of street view thumbnails based on the user's selection, the first subset including one or more street view thumbnails in the set of street view thumbnails.

The second obtaining module 430 is configured to acquire a first street view picture corresponding to each street view thumbnail in the first subset.

The video generation module 440 is configured to generate a street view video according to the first street view image.

In some optional implementations, the second obtaining module 430 can be further configured to:

The first street view picture corresponding to each street view thumbnail of the first subset is acquired in a predetermined order.

In some optional implementations, the predetermined order may be an order in which the distance between the geographic location of each first street view picture and the end of the path is from large to small.

In some optional implementation manners, the second obtaining module 430 is further configured to: when acquiring the first street view image corresponding to each street view thumbnail in the first subset in a predetermined order:

When acquiring each first street view image, first obtaining a portion of the first street view image that is within a predetermined range, and then acquiring other portions of the first street view image.

Furthermore, a portion of the first street view picture within a predetermined range may have a first resolution, and other portions of the first street view picture have a second resolution, the first resolution being greater than the second resolution.

In some optional implementations, each first street view image may be a street model based on a ball model. The predetermined range may be a portion of the first street view picture having a vertical viewing angle in the range of -45° to 45° and a horizontal viewing angle in the range of -45° to 45°.

In some optional implementations, the apparatus in this embodiment may further include a cache module 450 configured to: after the second acquisition module 430 acquires the first street view image corresponding to each street view thumbnail in the first subset, Each first street view image is saved in the cache.

With further reference to FIG. 5, as an implementation of the method shown in the above figures, the present application provides an embodiment 500 of a street view video generating device based on path planning, which is compared with the method embodiment shown in FIG. Correspondingly, the device can be specifically applied to various electronic devices.

As shown in FIG. 5, the path plan based street view video generating apparatus of this embodiment includes a planned path generating module 510, a thumbnail sending module 520, and a street view picture transmitting module 530.

among them:

The planning path generation module 510 is configured to generate a planning path and send the planning path to the terminal in response to the path planning request of the terminal.

The thumbnail sending module 520 is configurable to send a street view thumbnail set to the terminal in response to the street view thumbnail acquisition request of the terminal, wherein the set of street view thumbnails includes a street view thumbnail corresponding to the planned path.

The street view picture sending module 530 may be configured to send, according to the selection of the terminal, the first street view picture to the terminal in a predetermined order, and each of the first street view pictures respectively corresponds to one of the generated street view videos.

The first street view picture is a street view picture corresponding to each street view thumbnail in the first subset of the street view thumbnail set. The first subset includes one or more Street View thumbnails in the set of Street View thumbnails.

In some optional implementations, the predetermined order may be an order in which the distance between the geographic location of each first street view picture and the end of the path is from large to small.

In some optional implementation manners, the street view image sending module 530 may be further configured to: when sending each first street view image to the terminal, first send a portion of the first street view image that is within a predetermined range, and then send the The other part of the first street view image.

In addition, a portion of the first street view picture within a predetermined range may have a first resolution, and other portions of the first street view picture may have a second resolution, the first resolution being greater than the second resolution.

In some optional implementations, each first street view image may be a street model based on a ball model. In these optional implementations, the predetermined range may be in the first street view picture, the vertical viewing angle is in the range of -45° to 45°, and the horizontal viewing angle is in the range of -45° to 45°. section.

Referring now to Figure 6, a block diagram of a computer system 600 suitable for use in implementing a terminal device or server of an embodiment of the present application is shown.

As shown in FIG. 6, computer system 600 includes a central processing unit (CPU) 601 that can be loaded into a program in random access memory (RAM) 603 according to a program stored in read only memory (ROM) 602 or from storage portion 608. And perform various appropriate actions and processes. In the RAM 603, various programs and data required for the operation of the system 600 are also stored. The CPU 601, the ROM 602, and the RAM 603 are connected to each other through a bus 604. An input/output (I/O) interface 605 is also coupled to bus 604.

The following components are connected to the I/O interface 605: an input portion 606 including a keyboard, a mouse, etc.; an output portion 607 including, for example, a cathode ray tube (CRT), a liquid crystal display (LCD), and the like, and a storage portion 608 including a hard disk or the like. And a communication portion 609 including a network interface card such as a LAN card, a modem, or the like. The communication section 609 performs communication processing via a network such as the Internet. Driver 610 is also coupled to I/O interface 605 as needed. A removable medium 611, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory or the like, is mounted on the drive 610 as needed so that a computer program read therefrom is installed into the storage portion 608 as needed.

In particular, the processes described above with reference to the flowcharts may be implemented as a computer software program in accordance with an embodiment of the present disclosure. For example, an embodiment of the present disclosure includes a computer program product comprising a computer program tangibly embodied on a machine readable medium, the computer program comprising program code for executing the method illustrated in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network via communication portion 609, and/or installed from removable media 611.

The flowchart and block diagrams in the Figures illustrate the architecture, functionality and operation of possible implementations of systems, methods and computer program products in accordance with various embodiments of the present application. In this regard, each block of the flowchart or block diagrams can represent a module, a program segment, or a portion of code that includes one or more logic for implementing the specified. Functional executable instructions. It should also be noted that in some alternative implementations, the functions noted in the blocks may also occur in a different order than that illustrated in the drawings. For example, two successively represented blocks may actually be executed substantially in parallel, they Sometimes it can be performed in the reverse order, depending on the function involved. It is also noted that each block of the block diagrams and/or flowcharts, and combinations of blocks in the block diagrams and/or flowcharts, can be implemented in a dedicated hardware-based system that performs the specified function or operation. Or it can be implemented by a combination of dedicated hardware and computer instructions.

The units involved in the embodiments of the present application may be implemented by software or by hardware. The described unit may also be disposed in the processor, for example, as a processor including a first acquisition module, a thumbnail generation module, a second acquisition module, and a video generation module. The names of these modules do not constitute a limitation on the module itself in some cases. For example, the first acquisition module may also be described as a module for acquiring a street view thumbnail set based on a planned generated path.

In another aspect, the present application further provides a non-volatile computer storage medium, which may be a non-volatile computer storage medium included in the apparatus described in the foregoing embodiments; It may be a non-volatile computer storage medium that exists alone and is not assembled into the terminal. The non-volatile computer storage medium stores one or more programs, when the one or more programs are executed by one device, causing the device to: acquire a street view thumbnail set based on the path generated by the plan, wherein the set of street view thumbnails includes a plurality of Street View thumbnails matching the geographic location of the path; generating a first subset of the Street View thumbnail set based on the user's selection, the first subset including the first Street View thumbnail selected by the user and the Street View thumbnail set, the geographic location a street view thumbnail that is no longer than the distance between the end point of the first street view thumbnail and the first street view image corresponding to each street view thumbnail in the first subset; and generates a street view video, Each frame of the Street View video has a one-to-one correspondence with each of the first Street View pictures.

Alternatively, the above non-volatile computer storage medium stores one or more programs, and when one or more programs are executed by one device, the device may also: generate a planning path in response to the path planning request of the terminal, and plan Sending a path to the terminal; transmitting a street view thumbnail set to the terminal in response to the street view thumbnail acquisition request of the terminal, wherein the street view thumbnail set includes a street view thumbnail corresponding to the planned path; and based on the selection of the terminal, the terminal is in a predetermined order Sending a first street view image, each first street view picture is respectively corresponding to each frame of the generated street view video; wherein, the first street view picture is a street view picture corresponding to each street view thumbnail in the first subset of the street view thumbnail set First subset package In the first street view thumbnail selected by the street view thumbnail collection and the street view thumbnail set, the street view thumbnail of the distance between the geographic location and the end point of the planned path does not exceed the distance between the geographic location and the end point of the first street view thumbnail. .

The above description is only a preferred embodiment of the present application and a description of the principles of the applied technology. It should be understood by those skilled in the art that the scope of the invention referred to in the present application is not limited to the specific combination of the above technical features, and should also be covered by the above technical features without departing from the inventive concept. Other technical solutions formed by any combination of their equivalent features. For example, the above features are combined with the technical features disclosed in the present application, but are not limited to the technical features having similar functions.

Claims (26)

1. A method for generating a street view video based on path planning, comprising:

   Obtaining a street view thumbnail set based on the planned generated path, wherein the street view thumbnail set includes a plurality of street view thumbnails that match a geographic location of the path;

   Generating a first subset of the set of street view thumbnails based on a user's selection, the first subset including one or more street view thumbnails in the set of street view thumbnails;

   Obtaining a first street view image corresponding to each street view thumbnail of the first subset; and

   Generating a street view video according to the first street view image.
2. The method according to claim 1, wherein the acquiring the first street view image corresponding to each street view thumbnail in the first subset comprises:

   The first street view picture corresponding to each street view thumbnail of the first subset is acquired in a predetermined order.
3. The method of claim 2 wherein:

   The predetermined order is an order in which the distance between the geographic location of each of the first street view pictures and the end point of the path is from large to small.
4. The method according to claim 2, wherein the acquiring the first street view image corresponding to each street view thumbnail in the first subset comprises:

   When acquiring each first street view image, first obtaining a portion of the first street view image that is within a predetermined range, and then acquiring other portions of the first street view image.
5. The method of claim 4 wherein:

   The portion within the predetermined range has a first resolution;

   The other portion has a second resolution;

   The first resolution is greater than the second resolution.
6. A method according to claim 4 or 5, wherein:

   Each first street view image is a street view image based on a ball model;

   The predetermined range is a portion of the first street view picture in which the vertical viewing angle is in the range of -45° to 45° and the horizontal viewing angle is in the range of -45° to 45°.
7. A method for generating a street view video based on path planning, comprising:

   Generating a planning path in response to the path planning request of the terminal, and transmitting the planning path to the terminal;

   Sending a street view thumbnail set to the terminal in response to the street view thumbnail acquisition request of the terminal, wherein the street view thumbnail set includes a street view thumbnail corresponding to the planned path;

   Transmitting, according to a selection of the terminal, a first street view picture to the terminal according to a predetermined order, where each of the first street view pictures corresponds to one of the generated street view videos;

   The first street view picture is a street view picture corresponding to each street view thumbnail in the first subset of the street view thumbnail set;

   The first subset includes one or more Street View thumbnails of the Street View thumbnail set.
8. The method of claim 7 wherein:

   The predetermined order is an order in which the distance between the geographic location of each of the first street view pictures and the end point of the path is from large to small.
9. The method according to claim 7, wherein the transmitting the first street view picture to the terminal in a predetermined order comprises:

   When each first street view picture is sent to the terminal, the part of the first street view picture that is within the predetermined range is sent first, and then the other part of the first street view picture is sent.
10. The method of claim 9 wherein:

    The portion within the predetermined range has a first resolution;

    The other portion has a second resolution;

    The first resolution is greater than the second resolution.
11. A method according to claim 9 or 10, characterized in that:

    Each of the first street view pictures is a street view picture based on a ball model;

    The predetermined range is a portion of the first street view picture in which the vertical viewing angle is in the range of -45° to 45° and the horizontal viewing angle is in the range of -45° to 45°.
12. A street view video generating device based on path planning, comprising:

    a first obtaining module, configured to acquire a street view thumbnail set based on the path generated by the planning, where the set of street view thumbnails includes a plurality of street view thumbnails that match a geographic location of the path;

    a thumbnail generation module configured to generate a first subset of the set of street view thumbnails, the first subset including one or more street view thumbnails in the set of street view thumbnails;

    a second acquiring module, configured to acquire a first street view image corresponding to each street view thumbnail in the first subset;

    as well as

    a video generation module configured to generate a street view video according to the first street view image.
13. The apparatus according to claim 12, wherein the second obtaining module is further configured to:

    The first street view picture corresponding to each of the street view thumbnails in the first subset is acquired in a predetermined order.
14. The device of claim 13 wherein:

    The predetermined order is an order in which the distance between the geographic location of each of the first street view pictures and the end point of the path is from large to small.
15. The apparatus according to claim 13, wherein the second acquisition module is further configured to: when acquiring the first street view image corresponding to each of the street view thumbnails in the first subset in a predetermined order, :

    Acquiring the first street view image when acquiring each of the first street view pictures The portion of the first street view image is acquired in the portion within the predetermined range.
16. The device of claim 15 wherein:

    The portion within the predetermined range has a first resolution;

    The other portion has a second resolution;

    The first resolution is greater than the second resolution.
17. Apparatus according to claim 15 or claim 16 wherein:

    Each of the first street view pictures is a street view picture based on a ball model;

    The predetermined range is a portion of the first street view picture in which the vertical viewing angle is in the range of -45° to 45° and the horizontal viewing angle is in the range of -45° to 45°.
18. A street view video generating device based on path planning, comprising:

    a planning path generating module, configured to generate a planning path in response to the path planning request of the terminal, and send the planning path to the terminal;

    a thumbnail sending module configured to send a street view thumbnail set to the terminal in response to the street view thumbnail acquisition request of the terminal, wherein the street view thumbnail set includes a street view thumbnail corresponding to the planned path;

    a street view picture sending module, configured to send, according to a selection of the terminal, a first street view picture to the terminal according to a predetermined order, where each of the first street view pictures respectively corresponds to one of the generated street view videos;

    The first street view picture is a street view picture corresponding to each street view thumbnail in the first subset of the street view thumbnail set;

    The first subset includes one or more street view thumbnails in the set of street view thumbnails.
19. The device of claim 18 wherein:

    The predetermined order is an order in which the distance between the geographic location of each of the first street view pictures and the end point of the path is from large to small.
20. The device according to claim 18, wherein the street view picture sending module is further configured to:

    When each of the first street view pictures is sent to the terminal, the part of the first street view picture that is within a predetermined range is sent first, and then the other part of the first street view picture is sent.
21. The device of claim 20 wherein:

    The portion within the predetermined range has a first resolution, the other portion has a second resolution, and the first resolution is greater than the second resolution.
22. The device according to claim 20 or 21, characterized in that:

    Each of the first street view pictures is a street view picture based on a ball model;

    The predetermined range is a portion of the first street view picture in which the vertical viewing angle is in the range of -45° to 45° and the horizontal viewing angle is in the range of -45° to 45°.
23. A device that includes:

    Processor; and

    Memory,

    The memory stores computer readable instructions executable by the processor, the processor executing a path planning based street view video generation method, the method comprising:

    Obtaining a street view thumbnail set based on the planned generated path, wherein the street view thumbnail set includes a plurality of street view thumbnails that match a geographic location of the path;

    Generating a first subset of the set of street view thumbnails based on a user's selection, the first subset including one or more street view thumbnails in the set of street view thumbnails;

    Obtaining a first street view image corresponding to each street view thumbnail of the first subset; and

    Generating a street view video according to the first street view image.
24. A non-volatile computer storage medium storing the computer storage medium Computer readable instructions executable by a processor, when the computer readable instructions are executed by a processor, the processor performs a path planning based street view video generation method, the method comprising:

    Obtaining a street view thumbnail set based on the planned generated path, wherein the street view thumbnail set includes a plurality of street view thumbnails that match a geographic location of the path;

    Generating a first subset of the set of street view thumbnails based on a user's selection, the first subset including one or more street view thumbnails in the set of street view thumbnails;

    Obtaining a first street view image corresponding to each street view thumbnail of the first subset; and

    Generating a street view video according to the first street view image.
25. A device that includes:

    Processor; and

    Memory,

    The memory stores computer readable instructions executable by the processor, the processor executing a path planning based street view video generation method, the method comprising:

    Generating a planning path in response to the path planning request of the terminal, and transmitting the planning path to the terminal;

    Sending a street view thumbnail set to the terminal in response to the street view thumbnail acquisition request of the terminal, wherein the street view thumbnail set includes a street view thumbnail corresponding to the planned path;

    Transmitting, according to a selection of the terminal, a first street view picture to the terminal according to a predetermined order, where each of the first street view pictures corresponds to one of the generated street view videos;

    The first street view picture is a street view picture corresponding to each street view thumbnail in the first subset of the street view thumbnail set;

    The first subset includes one or more Street View thumbnails of the Street View thumbnail set.
26. A non-volatile computer storage medium storing computer readable instructions executable by a processor, when the computer readable instructions are processed When the processor is executed, the processor executes a path planning based street view video generation method, and the method includes:

    Generating a planning path in response to the path planning request of the terminal, and transmitting the planning path to the terminal;

    Sending a street view thumbnail set to the terminal in response to the street view thumbnail acquisition request of the terminal, wherein the street view thumbnail set includes a street view thumbnail corresponding to the planned path;

    Transmitting, according to a selection of the terminal, a first street view picture to the terminal according to a predetermined order, where each of the first street view pictures corresponds to one of the generated street view videos;

    The first street view picture is a street view picture corresponding to each street view thumbnail in the first subset of the street view thumbnail set;

    The first subset includes one or more Street View thumbnails of the Street View thumbnail set.

Images