CN112487244A

CN112487244A - Street view display method, device and storage medium

Info

Publication number: CN112487244A
Application number: CN202011474348.6A
Authority: CN
Inventors: 唐先炜; 王永亮
Original assignee: Beijing Wutong Chelian Technology Co Ltd
Current assignee: Beijing Wutong Chelian Technology Co Ltd
Priority date: 2020-12-14
Filing date: 2020-12-14
Publication date: 2021-03-12

Abstract

The application discloses a street view display method, a street view display device and a storage medium, and relates to the technical field of computers. According to the street view display method, the street view video is displayed on the display screen and is not a plurality of images shot at different positions on the street, so that the street view displayed on the display screen is coherent, and the display effect of the display screen is good. In addition, in the street view display method provided by the application, the controller can replace the street view video displayed on the display screen based on the direction adjusting instruction, and can adjust the playing speed of the street view video displayed on the display screen based on the speed adjusting instruction, so that the flexibility of displaying the street view video by the display screen is better.

Description

Street view display method, device and storage medium

Technical Field

The present disclosure relates to the field of computer technologies, and in particular, to a street view display method, device, and storage medium.

Background

Street view maps can provide panoramic images of cities, streets or other environments for users, and users can obtain map browsing experiences as they are on the spot through the street view maps.

In the related art, a simulated cockpit is widely used as a device for simulating driving, and is used for simulating the driving process of a driver driving a vehicle. The simulated cockpit includes a display screen on which a simulated image of the simulated driving process can be displayed. Wherein the simulation image may be an image stored in advance in a street view map in the simulation cockpit.

However, the street view map is actually a photo album formed by a plurality of images photographed at different positions on the street, and thus the street view displayed on the display screen is discontinuous, and the display effect of the display screen is poor.

Disclosure of Invention

The application provides a street view display method, a street view display device and a storage medium, which can solve the problem of poor display effect of a display screen in the related art. The technical scheme is as follows:

in one aspect, a street view display method is provided, which is applied to a controller of a simulated cockpit, where the simulated cockpit further includes: a display screen; the method comprises the following steps:

obtaining a plurality of street view videos, wherein the street view videos are all live view videos of a target simulation area, the target simulation area comprises a plurality of roads, each road has two end points, the plurality of roads have at least one road intersection point, and at least two positioning points corresponding to the at least one road intersection point, each positioning point is located between one end point and one road intersection point, and the street view videos comprise: the video obtained by shooting the road section between the end point and the positioning point and the video obtained by shooting the road section between two adjacent positioning points are obtained;

displaying a first streetscape video of the streetscape videos on the display screen in response to a simulation starting instruction for the target simulation area;

responding to a direction adjusting instruction, and replacing the street view video displayed on the display screen;

and responding to a speed adjusting instruction, and adjusting the playing speed of the street view video displayed on the display screen.

Optionally, the direction adjustment instruction includes: a left turn instruction, a right turn instruction, and a go-straight instruction; the responding to the direction adjusting instruction, and replacing the street view video displayed on the display screen comprises:

displaying a second streetscape video of the streetscape videos on the display screen in response to the left turn instruction, wherein the second streetscape video is a left turn video of the streetscape videos associated with the first streetscape video;

displaying a third street view video of the plurality of street view videos on the display screen in response to the right turn instruction, wherein the third street view video is a right turn video of the plurality of street view videos associated with the first street view video;

displaying a fourth street view video of the plurality of street view videos on the display screen in response to the inline command, wherein the fourth street view video is an inline video of the plurality of street view videos associated with the first street view video;

wherein a starting end point of a road segment in the video associated with the first street view video is the same as an ending end point of the road segment in the first street view video.

Optionally, the display screen includes: the display screen comprises a first sub display screen, a second sub display screen and a third sub display screen positioned between the first sub display screen and the second sub display screen; prior to the responding to the direction adjustment instruction, the method further comprises:

when the playing time length of the first street view video is larger than a time length threshold value, displaying at least part of the second street view video on the first sub-display screen, displaying at least part of the third street view video on the second sub-display screen, and displaying at least part of the fourth street view video on the third sub-display screen.

Optionally, the speed adjustment instruction includes: an acceleration instruction and a deceleration instruction; responding to a speed adjusting instruction, and adjusting the playing speed of the street view video displayed on the display screen, wherein the speed adjusting instruction comprises the following steps:

in response to the acceleration instruction, accelerating to display the street view video displayed on the display screen;

and responding to the deceleration instruction, and displaying the street view video displayed on the display screen in a deceleration mode.

Optionally, the displaying, on the display screen, a first street view video of the street view videos in response to the simulation starting instruction for the target simulation area includes:

receiving a selection operation for a first street view video of the plurality of street view videos;

and responding to the selection operation, and displaying the first street view video on the display screen.

Optionally, the acquiring multiple street view videos includes:

and acquiring the street view videos from a server, wherein the street view videos are obtained by processing the real view video of the target simulation area by the server.

In another aspect, there is provided a controller for simulating a cockpit, the controller comprising: an obtaining module, configured to obtain a plurality of street view videos, where the street view videos are all live view videos of a target simulation area, the target simulation area includes a plurality of roads, each road has two endpoints, the plurality of roads have at least one road intersection and at least two positioning points corresponding to the at least one road intersection, and the street view videos include: the video obtained by shooting the road section between the end point and the positioning point and the video obtained by shooting the road section between two adjacent positioning points are obtained;

the first display module is used for responding to a simulation starting instruction aiming at the target simulation area and displaying a first street view video in the street view videos on the display screen;

the second display module is used for responding to a direction adjusting instruction and replacing the street view video displayed on the display screen;

and the third display module is used for responding to the speed adjustment instruction and adjusting the playing speed of the street view video displayed on the display screen.

Optionally, the direction adjustment instruction includes: a left turn instruction, a right turn instruction, and a go-straight instruction; the second display module is configured to:

wherein a start end point of a section of the video associated with the first street view video is the same as an end point of the section of the first street view video.

In yet another aspect, there is provided a simulated cockpit comprising: a display screen, and a controller as described in the above aspect.

In yet another aspect, a computer-readable storage medium having instructions stored therein is provided, the instructions being loaded and executed by a processor to implement the streetscape display method as described in the above aspect.

In still another aspect, there is provided a street view display apparatus including: a processor, a memory and a computer program stored on the memory and executable on the processor, the processor when executing the computer program implementing the street view display method as described in the above aspect.

The beneficial effect that technical scheme that this application provided brought includes at least:

the application provides a street view display method, a street view display device and a storage medium, wherein a street view video is displayed on a display screen in the street view display method and is not a plurality of images shot at different positions on a street, so that the street view displayed on the display screen is coherent, and the display effect of the display screen is good. In addition, in the street view display method provided by the application, the controller can replace the street view video displayed on the display screen based on the direction adjusting instruction, and can adjust the playing speed of the street view video displayed on the display screen based on the speed adjusting instruction, so that the flexibility of displaying the street view video by the display screen is better.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.

Fig. 1 is a schematic structural diagram of a simulation cockpit according to an embodiment of the present application;

fig. 2 is a flowchart of a street view display method according to an embodiment of the present disclosure;

FIG. 3 is a schematic diagram of a target simulation area provided by an embodiment of the present application;

fig. 4 is a flowchart of another street view display method provided in the embodiment of the present application;

FIG. 5 is a schematic illustration of a vehicle provided in an embodiment of the present application;

FIG. 6 is a schematic diagram of another target simulation area provided by embodiments of the present application;

FIG. 7 is a schematic diagram of yet another target simulation area provided by an embodiment of the present application;

fig. 8 is a schematic diagram illustrating a real-scene video being divided into a plurality of street-scene videos according to an embodiment of the present disclosure;

FIG. 9 is a schematic view of a display screen provided in an embodiment of the present application;

fig. 10 is a schematic diagram of a display screen displaying a street view video according to an embodiment of the present application;

fig. 11 is a schematic diagram of another display screen displaying street view video provided by an embodiment of the present application;

fig. 12 is a schematic diagram of another display screen displaying street view video provided by an embodiment of the present application;

fig. 13 is a schematic diagram of a street view video displayed on a display screen according to another embodiment of the present application;

FIG. 14 is a schematic diagram of another display screen displaying street view video according to an embodiment of the present disclosure;

fig. 15 is a schematic diagram of a street view video displayed on a display screen according to another embodiment of the present application;

FIG. 16 is a schematic diagram of another display screen displaying street view video according to an embodiment of the present disclosure;

FIG. 17 is a schematic diagram of a controller provided in an embodiment of the present application;

fig. 18 is a schematic structural diagram of a street view display device according to an embodiment of the present application.

Detailed Description

To make the objects, technical solutions and advantages of the present application more clear, embodiments of the present application will be described in further detail below with reference to the accompanying drawings.

Fig. 1 is a schematic structural diagram of a simulation cockpit according to an embodiment of the present application. As can be seen with reference to fig. 1, the simulated cockpit 10 may comprise: a controller 101, and a display screen 102. The controller 101 may be used to control the street view video displayed on the display screen 102.

The controller 101 may be a device having a data processing function, such as a Central Processing Unit (CPU) or a Micro Control Unit (MCU), and the controller 101 may be disposed below an operation console (instrument panel) in the simulated cockpit 10.

Optionally, referring to fig. 1, the simulated cockpit 10 may further comprise: steering wheel 103, throttle 104, and brake 105. The controller 101 may also update the streetscape video displayed on the display screen 102 based on a control operation for the steering wheel 103, the throttle 104, or the brake 105. In addition, the simulated cockpit 10 may further include: a seat 106. A user may sit on the seat 106 while using the simulated cockpit 10 for simulated driving to facilitate operation of other devices in the simulated cockpit 10.

Fig. 2 is a flowchart of a street view display method according to an embodiment of the present application. The method may be applied in the controller 101 simulating a cockpit as shown in figure 1. Referring to fig. 2, the method may include:

step 201, obtaining a plurality of street view videos.

In the embodiment of the present application, the controller 101 simulating the cockpit 10 may acquire a plurality of street view videos, which are all real view videos of the target simulation area.

Fig. 3 is a schematic diagram of a target simulation area according to an embodiment of the present application. As can be seen with reference to FIG. 3, the target simulation area 30 may include a plurality of roads (3 roads are shown in FIG. 3). Each link may have two endpoints. Also, the plurality of roads may have at least one road intersection, and at least two anchor points corresponding to the at least one road intersection. Wherein one anchor point may be located between one end point and one road intersection, or one anchor point may be located between one road intersection and another anchor point. The anchor point is close to the road intersection point with respect to the end point. A road intersection is a point where two or more roads intersect. Each of the plurality of branch roads at the road intersection may have an anchor point thereon.

For example, in fig. 3, the plurality of roads may have three road intersections, a, B, and C, respectively. Also, the road intersection a having four branch roads (four junctions) corresponds to four anchor points, a1, a2, A3, and a4, respectively. The road intersection B having three branch roads (trifurcations) corresponds to three anchor points, B1, B2, and B3. The road intersection C having three branch roads (trifurcations) corresponds to three anchor points, C1, C2, and C3. That is, the road intersection a is a cross intersection, and the road intersection B and the road intersection C are both Y-intersections.

Of course, the road intersection may have a greater number of branch roads, for example, five branch roads or six branch roads, which is not limited in the embodiment of the present application.

Optionally, two roads in the plurality of roads may have the same link, or at least one end point of the two roads may be the same. For example, 3 roads are shown in fig. 3, two end points of the first road 301 are WG and EG, respectively, two end points of the second road 302 are NG and SG, respectively, and two end points of the third road 303 are WG and SG, respectively. The end WG of the first road 301 is the same as the end WG of the third road, and the end SG of the second road 302 is the same as the end SG of the third road 303. Also, the first road 301 and the third road 303 each have a link between the end point WG and the road intersection B, and the second road 302 and the third road 303 each have a link between the end point SG and the road intersection C.

In an embodiment of the present application, the street view videos may include: the video is obtained by shooting the road section between the end point and the positioning point, and the video is obtained by shooting the road section between two adjacent positioning points. For example, the plurality of street view videos may include: a video photographed on a link between the end point WG and the anchor point B1, and a video photographed on a link between the anchor point B1 and the anchor point B2.

Step 202, responding to a simulation starting instruction aiming at the target simulation area, and displaying a first street view video in the street view videos on a display screen.

In the embodiment of the present application, before the simulated driving of the target simulation area 30, a plurality of icons of the street view videos may be displayed on the display screen 102. When a user triggers a click operation on an icon of a first street view video of the street view videos, the controller 101 may display the first street view video on the display screen 102 in response to the click operation.

And step 203, responding to the direction adjusting instruction, and replacing the street view video displayed on the display screen.

In the embodiment of the present application, after the user triggers the direction adjustment command, the controller 101 of the simulated cockpit can receive and respond to the direction adjustment command to change the street view video displayed on the display screen 102.

For example, assuming that the simulated driver simulates driving into the target simulation area 30 from the endpoint WG, the first street view video may be a video photographed on a link between the endpoint WG and the location point B1. Since B is a road intersection, after the first street view video is displayed, the display screen 102 may display a video obtained by photographing a link from the location point B1 to the location point B2, or a video obtained by photographing a link from the location point B1 to the location point B3. In this case, the controller 101 may determine that the next street view video to be displayed after the first street view video is displayed on the display screen 102 according to the direction adjustment instruction triggered by the user.

And step 204, responding to the speed adjusting instruction, and adjusting the playing speed of the street view video displayed on the display screen.

In the embodiment of the present application, after the user triggers the speed adjustment command, the controller 101 of the simulated cockpit 10 can receive and respond to the speed adjustment command to adjust the playing speed of the street view video displayed on the display screen 102.

For example, the controller 101 may accelerate display of the street view video displayed on the display screen 102 or decelerate display of the street view video displayed on the display screen 102 in response to the speed adjustment instruction.

In summary, the embodiment of the present application provides a street view display method, in the method, a street view video is displayed on a display screen, and a plurality of images shot at different positions on a street are not displayed, so that the street view displayed on the display screen is coherent, and the display effect of the display screen is good. In addition, in the street view display method provided by the embodiment of the application, the controller can replace the street view video displayed on the display screen based on the direction adjusting instruction, and can adjust the playing speed of the street view video displayed on the display screen based on the speed adjusting instruction, so that the flexibility of displaying the street view video by the display screen is better.

In addition, the street view displayed on the display screen is coherent, and the controller can update the street view video displayed on the display screen based on the direction adjusting instruction or the speed adjusting instruction, so that the user can simulate the process of driving the vehicle in an immersive mode, and the user experience is good.

Fig. 4 is a flowchart of another street view display method according to an embodiment of the present disclosure. The method may be applied in the controller 101 simulating a cockpit as shown in figure 1. Referring to fig. 4, the method may include:

step 401, obtaining a plurality of street view videos from a server.

In the embodiment of the present application, the controller 101 and the server may establish a communication connection through a wired or wireless network. When the controller 101 acquires a plurality of street view videos from the server, the controller 101 may send an acquisition instruction for the plurality of street view videos to the server, and the server receives and transmits the plurality of street view videos to the controller 101 in response to the acquisition instruction. Alternatively, the server may automatically send a plurality of streetscape videos to the controller 101 during the process in which the server establishes a communication connection with the controller 101.

Optionally, the street view videos are obtained by processing the real view video of the target simulation area by the server. The live-action video of the target simulation area may be captured by a drive recorder of the work guidance vehicle. Or the images may be obtained by shooting with a car-data recorder of a private car of the visitor, which is not limited in the embodiment of the present application. The street view videos are obtained by processing the live view video of the target simulation area by the server, so the street view videos can be all the live view videos of the target simulation area.

Referring to fig. 5, the vehicle (job guide car or private car) may have three event recorders (a1, a2, and a3), which may be disposed at the left front, right front, and right front of the vehicle, respectively. The left front tachograph a1 may be used to capture left front live-action video, the right front tachograph a2 may be used to capture right front live-action video, and the right front tachograph a3 may be used to capture right front live-action video. Moreover, the shot real-scene videos can be guaranteed to be complete by arranging the three automobile data recorders, and the reliability of the obtained street-scene videos is further guaranteed.

Alternatively, the vehicle may have only one tachograph disposed directly in front. Normally, if the vehicle is a private car, there is usually only one tachograph. Wherein, this vehicle event data recorder can be the vehicle event data recorder of wide angle, can guarantee that the outdoor scene video of shooing is comparatively complete.

In the embodiment of the application, the vehicle event data recorder of the vehicle can establish communication connection with the server, and after the vehicle event data recorder shoots the live-action video of the target simulation area, the live-action video can be sent to the server. The server can further process the live-action video to obtain a plurality of street-action videos.

Alternatively, referring to FIG. 6, the vehicle may travel along the first road 301 from the end point WG to the end point EG (end point, road intersection, and anchor point during travel: WG, B1, B, B3, A2, A, A4, and EG in that order), and the vehicle's tachograph may record the live-action video of WG-B1-B-B3-A2-A4-EG along the way. Alternatively, the vehicle may travel along the third road 303 from the end point WG to the end point SG (the end point, the road intersection and the anchor point during the travel are WG, B1, B, B2, C2, C, C1 and SG in that order), and the vehicle recorder of the vehicle may record the live-action video of WG-B1-B-2-C2-C-C1-SG along the way.

Alternatively, referring to fig. 7, the vehicle may be arbitrarily driven (may be a private car in general) along the road of the target simulation area. For example, the vehicle may travel along route b1, route b2, or route b 3. When the vehicle runs along the route B1, the vehicle driving recorder can record live-action videos of SG-C1-C-C2-B2-B-B3-A2-A-A1-NG along the route. When the vehicle runs along the route B2, the vehicle driving recorder can record the live-action video of WG-B1-B-B3-A2-A3-C3-C-C1-SG along the way. When the vehicle travels along the route B3, the vehicle's tachograph may record live-action video of WG-B1-B-B3-A2-A4-EG along the way.

By analogy, the vehicle may traverse all of the links within the target simulation area 30 and traverse both directions for each link (e.g., both directions for the first link 301 include the direction from the endpoint WG to the endpoint EG and the direction from the endpoint EG to the endpoint WG), as well as the possible travel directions for each link intersection. That is, the vehicle may travel through the same road at least twice to obtain live-action videos in different directions, or may travel through the same road intersection multiple times to obtain live-action videos in different travel directions at the same road intersection.

In the embodiment of the application, the live-action video sent by the automobile data recorder to the server can have a plurality of time identifications associated with the end points and the positioning points. After receiving the live-action video sent by the automobile data recorder, the server may segment the live-action video based on the multiple time identifiers of the live-action video to obtain multiple street-action videos. The multiple street view videos obtained by the server after processing the live view video may include: the video is obtained by shooting the road section between the end point and the positioning point, and the video is obtained by shooting the road section between two adjacent positioning points.

For example, suppose that the server acquires the live-action video of the first road 301 from the end point WG to the end point EG, i.e. the live-action video of WG-B1-B3-a 2-a 4-EG, from the vehicle's drive recorder. Since the end points and the anchor points of the first road 301 include WG, B1, B3, a2, a4, and EG, the server may divide the live-view video into 5 street-view videos. Referring to fig. 8, the 5 streetscape videos include: the method comprises the steps of obtaining a video d1 by shooting a road section from an endpoint WG to a locating point B1, obtaining a video d2 by shooting a road section from a locating point B1 to a locating point B3, obtaining a video d3 by shooting a road section from a locating point B3 to a locating point A2, obtaining a video d4 by shooting a road section from a locating point A2 to a locating point A4, and obtaining a video d5 by shooting a road section from a locating point A4 to an endpoint EG.

In this embodiment, the vehicle needs to travel on other roads and capture a live-action video, and the server cannot process the obtained live-action video to obtain a set of complete street-action video until each direction of each road in the target simulation area 30 is traveled and each possible travel direction of each road intersection is traveled.

Optionally, a complete set of streetscape videos may include: end road segments, intermediate road segments, and junction road segments. And one endpoint of the starting endpoint and the ending endpoint of the endpoint road section is an endpoint of the road. There is no road intersection in the intermediate link and there is a road intersection in the intersection link.

In the embodiment of the present application, the number of complete street view videos of the target simulation area is positively correlated with the number of end points, the number of road intersections, and the number of anchor points of the target simulation area.

For a certain road intersection, the more the number of the positioning points corresponding to the road intersection is, the more the branched roads of the road intersection are, the more the street view video for the road intersection is acquired. Assuming that the road intersection has m branch roads, the number of acquired street view videos for the road intersection is m × (m-1).

For example, from anchor point A1, a vehicle heading for road junction A may have three possible scenarios, right turn A1- > A2, straight travel A1- > A3, and left turn A1- > A4. Similarly, vehicles driving from points a2, A3 and a4 to the road intersection a have the possibility of driving in three directions. That is, if the road intersection a has four branch roads, there are 4 × 3 — 12 street view videos for the road intersection a, 8 turn street view videos, and 4 straight street view videos.

Assuming that the number of end points of the target simulation area 30 is k, and the number of road intersections is h, the number of complete street view videos of the target simulation area is:

where m (i) is the number of branch roads that the ith road intersection has.

Taking the target simulation area 30 shown in fig. 3 as an example, the target simulation area 30 has 4 end points, 3 road intersections, a road intersection a having four branch roads, a road intersection B having three branch roads, and a road intersection C having three branch roads, i.e., k is 4 and h is 3. The number of complete street view videos of the target simulation area 30 is thus: 2 × 4+2 × 3+4 × (4-1) +3 × (3-1) +3 × (3-1) ═ 38.

The complete set of street view videos for the target simulation area 30 shown in fig. 3 includes a plurality of street view videos as shown in table 1.

TABLE 1

In Table 1 above, WG- > B1 is used to indicate: and (4) shooting a video of a road section between the endpoint WG and the positioning point B1. Correspondingly, B1- > WG is used to represent: and (3) shooting a video of the road section between the positioning point B1 and the end point WG.

Referring to fig. 5, since the vehicle has 3 car recorders, a complete set of street view videos may actually include 114 street view videos, which is 38 × 3. The 38 street view videos are videos of the left fronts of the 38 road sections in the table 1, which are shot by a driving recorder in the left front of the vehicle. The 38 street view videos are videos of 38 road sections in table 1, which are captured by a drive recorder right in front of the vehicle. The 38 street view videos are videos of the 38 road sections in the right front of the road in the table 1, which are shot by a driving recorder at the right front of the vehicle.

In the embodiment of the application, the server can acquire the live-action videos shot by each automobile data recorder of the vehicle, and the server can process each live-action video to obtain the street-action video. The controller 101 simulating the cabin 10 may retrieve each street view video from the server. For example, the controller 101 may retrieve 114 street view videos from a server.

Step 302, receiving a selection operation for a first street view video of a plurality of street view videos.

In the embodiment of the present application, referring to fig. 9, before the simulated driving of the target simulation area, a plurality of icons e1 of the street view videos may be displayed on the display screen 102. When a user triggers a click operation on an icon of a first street view video of the street view videos, the controller 101 may receive a selection operation on the first street view video of the street view videos.

And 403, responding to the selection operation, and displaying the first street view video on the display screen.

In the embodiment of the present application, when receiving a selection operation for a first street view video of a plurality of street view videos, the controller 101 may display the first street view video on the display screen 102 in response to the selection operation.

Wherein the first street view video is selected by a user among a plurality of street view videos. For example, the user may select a video of a road segment between a certain endpoint and a certain location point as a first street view video, or may select a video of a road segment between two adjacent location points as a first street view video.

And 404, when the playing time length of the first street view video is greater than the time length threshold, displaying at least part of a second street view video on the first sub-display screen, displaying at least part of a third street view video on the second sub-display screen, and displaying at least part of a fourth street view video on the third sub-display screen.

In the embodiment of the present application, the display screen 102 of the simulated cockpit may include: a first sub-display 1021, a second sub-display 1022, and a third sub-display 1023 positioned between the first sub-display 1021 and the second sub-display 1022. The first sub-display 1021, the second sub-display 1022, and the third sub-display 1023 can be used to display the street view video.

And when the playing time length of the first street view video is greater than the time length threshold value, the first street view video is about to be played completely. After the first street view video is played, the display screen 102 may continue to play the video associated with the first street view video. Before the next street view video of the first street view video is played on the display screen 102, different street view videos associated with the first street view video may be displayed on the first sub-display 1021, the second sub-display 1022, and the third sub-display 1023, respectively, so that the user can select the street view video that the display screen 102 needs to display after the first street view video is played.

For example, the video associated with the first street view video includes: a second street view video, a third street view video, and a fourth street view video. The first sub-screen 1021 may display at least a portion of the second street view video, the second sub-screen 1022 may display at least a portion of a third street view video, and the third sub-screen 1023 may display at least a portion of a fourth street view video. The second street view video is a left turn video associated with the first street view video in the plurality of street view videos. The third street view video is a right turn video associated with the first street view video in the plurality of street view videos. The fourth street view video is a direct line video associated with the first street view video in the plurality of street view videos.

At least part of the second street view video may be a video of a partial region in the second street view video, at least part of the third street view video may be a video of a partial region in the third street view video, and at least part of the fourth street view video may be a video of a partial region in the fourth street view video.

In the embodiment of the present application, the starting end point of the segment of the video associated with the first street view video is the same as the ending end point of the segment of the first street view video. The end point of the first street view video may be a locating point, and the segment of the video associated with the first street view video has a road intersection.

Assuming that the first street view video is a video photographed on a link between the endpoint WG and the anchor point B1, the video associated with the first street view video may include: a video obtained by photographing a link from the location point B1 to the location point B2, and a video obtained by photographing a link from the location point B1 to the location point B3.

In this case, the first sub-display 1021 and the third sub-display 1023 may display videos photographed on a link between the location point B1 and the location point B2, and the second sub-display 1022 may display videos photographed on a link between the location point B1 and the location point B3.

Alternatively, the third sub-display 1023 may continue to display the first street view video, or the third sub-display 1023 may display a video photographed on a link between the location point B1 and the location point B3.

Optionally, if the street view videos acquired by the controller 101 are processed by the server from the actual videos captured by the 3 event recorders of the vehicle, the videos associated with the first street view video may include: the video photographed right in front, left in front of the link between anchor point B1 and anchor point B2, and the video photographed right in front, left in front of the link between anchor point B1 and anchor point B3.

In this case, referring to fig. 10, in a case where the steering wheel 103 remains still and the first street view video is played to the anchor point B1, the first sub-display 1021 may display a video photographed in front of the left of the section between the anchor point B1 and the anchor point B2. The second sub-display screen 1023 may display a video photographed right in front of the section between the location point B1 and the location point B3. Third sub-display 1023 the third sub-display 1023 may display a video photographed right in front of the link between the location point B1 and the location point B2

Of course, the first sub-display 1021 may also display a video photographed just in front of or right in front of the section between the location point B1 and the location point B2. The second sub-display 1022 may also display a video photographed in front of the left or right of the section between the location point B1 and the location point B3. The third sub-display 1023 may also display a video photographed right in front of the section between the location point B1 and the location point B3. The embodiment of the present application does not limit this.

Assuming that the first street view video is a video photographed on a link between a position B3 and a position a2, the video associated with the first street view video may include: the video obtained by photographing the link between the location point a2 and the location point a1, the video obtained by photographing the link between the location point a2 and the location point A3, and the video obtained by photographing the link between the location point a2 and the location point a 4.

In this case, the first sub-display 1021 may display a video photographed for a link between the location point a2 and the location point a1, and the second sub-display 1022 may display a video photographed for a link between the location point a2 and the location point A3. The third sub-display 1023 may display a video photographed on the link between the location point a2 and the location point a 4.

Optionally, if the street view videos acquired by the controller 101 are processed by the server from the actual videos captured by the 3 event recorders of the vehicle, the videos associated with the first street view video may include: the video obtained by photographing the right front, the right front and the left front of the section between the anchor point a2 and the anchor point a1, the video obtained by photographing the right front, the right front and the front of the section between the anchor point a2 and the anchor point A3, and the video obtained by photographing the right front, the right front and the left front of the section between the anchor point a2 and the anchor point a 4.

In this case, referring to fig. 11, in a case where the steering wheel 103 remains still and the first street view video is played to the anchor point a2, the first sub-display 1021 may display a video photographed in front of the left of the section between the anchor point a2 to the anchor point a 1. The second sub-display 1022 may display a video photographed right in front of the section between the location point a2 and the location point A3. The third sub-display 1023 may display a video photographed right in front of the section between the location point a2 and the location point a 4.

Of course, the first sub-display 1021 may also display a video photographed just in front of or right in front of the section between the location point a2 and the location point a 1. The second sub-display 1022 may also display a video photographed just in front of or right in front of the section of road from the location point a2 to the location point A3. The third sub-display 1023 may also display a video photographed in the front left or right of the section between the location point a2 and the location point a 4. The embodiment of the present application does not limit this.

And 405, responding to the left-turn instruction, and displaying a second street view video in the street view videos on the display screen.

In an embodiment of the present application, referring to fig. 1, the simulated cockpit may include a steering wheel 103. When a user triggers a left turn operation for the steering wheel 103, the controller 101 may receive and respond to the left turn instruction to display a second street view video of the street view videos on the display screen 102.

Assuming that the first street view video is a video obtained by shooting a road segment from the endpoint WG to the location point B1, the second street view video may be: the video obtained by shooting the link between the location point B1 and the location point B3. Thus, the display screen 102 of the simulated cockpit can display the video obtained by shooting the link between the position point B1 and the position point B3 after the first street view video is played.

If the street view videos acquired by the controller 101 are processed by the server from the actual videos captured by the 3 event recorders of the vehicle, the second street view video may include: the video obtained by photographing the left front of the link between the anchor point B1 and the anchor point B3, the video obtained by photographing the right front of the link between the anchor point B1 and the anchor point B3, and the video obtained by photographing the right front of the link between the anchor point B1 and the anchor point B3.

Thus, referring to fig. 12, when the user triggers the left turn operation for the steering wheel 103, and the display screen 102 of the simulated cockpit 10 plays the first street view video, the first sub-display 1021 of the display screen 102 may display the video shot of the left front of the road between the location point B1 and the location point B3. The second sub-display 1022 may display a video photographed right in front of the section between the location point B1 and the location point B3. The third sub-display 1023 may display a video photographed right in front of the section between the location point B1 and the location point B3.

Assuming that the first street view video is a video obtained by shooting a road segment between a location point B3 and a location point a2, the second street view video may be: the video obtained by shooting the link between the location point a2 and the location point a 1. Thus, the display screen 102 of the simulated cockpit 10 can display the video obtained by shooting the link between the position point a2 and the position point a1 after the first street view video is played.

If the street view videos acquired by the controller 101 are processed by the server from the actual videos captured by the 3 event recorders of the vehicle, the second street view video may include: the video captured in front of the left side of the link between anchor point a2 and anchor point a1, the video captured in front of the link between anchor point a2 and anchor point a1, and the video captured in front of the right side of the link between anchor point a2 and anchor point a 1.

Thus, referring to fig. 13, when the user triggers the left turn operation for the steering wheel 103, and the display screen 102 of the simulated cockpit 10 plays the first street view video, the first sub-display 1021 of the display screen 102 can display the video shot of the left front of the road between location a2 and location a 1. The second sub-display 1022 may display a video photographed right in front of the section between the location point a2 and the location point a 1. The third sub-display 1023 may display a video photographed right in front of the section between the location point a2 and the location point a 1.

And 406, responding to the right-turn instruction, and displaying a third street view video in the plurality of street view videos on the display screen.

In this embodiment, when the user triggers a right turn operation for the steering wheel 103, the controller 101 may receive and respond to the right turn instruction to display a third street view video of the street view videos on the display screen 102.

Assuming that the first street view video is a video obtained by shooting a road segment from the endpoint WG to the location point B1, the third street view video may be: the video obtained by shooting the link between the location point B1 and the location point B2. Thus, the display screen 102 of the simulated cockpit can display the video obtained by shooting the link between the position point B1 and the position point B2 after the first street view video is played.

If the street view videos acquired by the controller 101 are processed by the server from the actual videos captured by the 3 event recorders of the vehicle, the third street view video may include: the video obtained by photographing the left front of the link between the anchor point B1 and the anchor point B2, the video obtained by photographing the right front of the link between the anchor point B1 and the anchor point B2, and the video obtained by photographing the right front of the link between the anchor point B1 and the anchor point B2.

Thus, referring to fig. 14, when the user triggers the right turn operation for the steering wheel 103, and the display screen 102 of the simulated cockpit 10 plays the first street view video, the first sub-display 1021 of the display screen 102 may display the video shot of the left front of the road between the location point B1 and the location point B2. The second sub-display 1022 may display a video photographed right in front of the section between the location point B1 and the location point B2. The third sub-display 1023 may display a video photographed right in front of the section between the location point B1 and the location point B2.

Assuming that the first street view video is a video obtained by shooting a road segment between a location point B3 and a location point a2, the third street view video may be: the video obtained by shooting the link between the location point a2 and the location point A3. Thus, the display screen 102 of the simulated cockpit 10 can display the video obtained by shooting the link between the position point a2 and the position point A3 after the first street view video is played.

If the street view videos acquired by the controller 101 are processed by the server from the actual videos captured by the 3 event recorders of the vehicle, the second street view video may include: the video captured in front of the left side of the link between anchor point a2 and anchor point A3, the video captured in front of the link between anchor point a2 and anchor point A3, and the video captured in front of the right side of the link between anchor point a2 and anchor point A3.

Thus, referring to fig. 15, when the user triggers the right turn operation with respect to the steering wheel 103, after the display screen 102 of the simulated cockpit 10 has played the first street view video, the first sub-display 1021 of the display screen 102 may display a video obtained by photographing the left front of the road segment between the anchor point a2 and the anchor point A3, the second sub-display 1022 may display a video obtained by photographing the right front of the road segment between the anchor point a2 and the anchor point A3, and the third sub-display 1023 may display a video obtained by photographing the right front of the road segment between the anchor point a2 and the anchor point A3.

And 407, responding to the straight-line instruction, and displaying a fourth street view video in the plurality of street view videos on the display screen.

In the embodiment of the present application, when the user triggers the still operation on the steering wheel 103, the controller 101 may receive and respond to the direct line command to display a fourth street view video of the street view videos on the display screen 102.

Assume that the first street view video is a video obtained by shooting a road segment from the endpoint WG to the anchor point B1, and there is no inline video associated with the first street view video in the plurality of street view videos. In this case, the user does not trigger the stationary operation for the steering wheel 103, nor does the controller 101 respond to the straight-ahead instruction.

Assuming that the first street view video is a video obtained by shooting a road segment between the location point B3 and the location point a2, the fourth street view video may be: the video obtained by shooting the link between the location point a2 and the location point a 4. Thus, the display screen 102 of the simulated cockpit 10 can display the video obtained by shooting the link between the position point a2 and the position point a4 after the first street view video is played.

If the street view videos acquired by the controller 101 are processed by the server from the actual videos captured by the 3 event recorders of the vehicle, the fourth street view video may include: the video captured in front of the left side of the link between anchor point a2 and anchor point a4, the video captured in front of the link between anchor point a2 and anchor point a4, and the video captured in front of the right side of the link between anchor point a2 and anchor point a 4.

Thus, referring to fig. 16, when the user triggers the stationary operation with respect to the steering wheel 103, after the display screen 102 of the simulated cockpit plays the first street view video, the first sub-display 1021 of the display screen 102 may display a video obtained by photographing the left front of the section between the anchor point a2 and the anchor point a4, the second sub-display 1022 may display a video obtained by photographing the right front of the section between the anchor point a2 and the anchor point a4, and the third sub-display 1023 may display a video obtained by photographing the right front of the section between the anchor point a2 and the anchor point a 4.

And step 408, responding to the acceleration instruction, and accelerating to display the street view video displayed on the display screen.

In an embodiment of the present application, referring to fig. 1, the simulated cockpit 10 may include a throttle 104. When the user triggers the stepping operation on the accelerator 104, the controller 101 may receive and respond to the acceleration command to accelerate the display of the street view video displayed on the display screen 102, so that the user can feel a faster driving speed.

And step 409, responding to the deceleration instruction, and displaying the street view video displayed on the display screen in a deceleration mode.

In an embodiment of the application, referring to fig. 1, the simulated cockpit 10 may include a brake 105. When the user triggers the stepping operation on the brake 105, the controller 101 may receive and respond to the deceleration command to decelerate and display the street view video displayed on the display screen 102.

It should be noted that, the order of the steps of the street view display method provided in the embodiment of the present application may be appropriately adjusted, and the steps may also be correspondingly increased or decreased according to the situation. For example, the execution sequence of steps 406 to 410 may be adjusted according to the situation, step 404 may be deleted according to the situation, and any step from step 406 to step 410 may also be deleted according to the situation, and any method that can be easily conceived by those skilled in the art within the technical scope disclosed in the present application shall be covered by the protection scope of the present application, and therefore, the description thereof is omitted.

In summary, the embodiment of the present application provides a street view display method, in the method, a street view video is displayed on a display screen, and a plurality of images shot at different positions on a street are not displayed, so that the street view displayed on the display screen is coherent, and the display effect of the display screen can be better. In addition, in the street view display method provided by the embodiment of the application, the controller can replace the street view video displayed on the display screen based on the direction adjusting instruction, and can adjust the playing speed of the street view video displayed on the display screen based on the speed adjusting instruction, so that the flexibility of displaying the street view video by the display screen is better.

Fig. 17 is a schematic structural diagram of a controller simulating a cockpit according to an embodiment of the present application. As can be seen with reference to fig. 17, the controller 101 may include:

the obtaining module 1011 is configured to obtain multiple street view videos.

The street view videos are all real view videos of a target simulation area, the target simulation area comprises a plurality of roads, and each road is provided with two end points. The plurality of roads has at least one road intersection, and at least two anchor points corresponding to the at least one road intersection. The plurality of street view videos include: the method comprises the steps that a video obtained by shooting a road section between an end point and a positioning point and a video obtained by shooting a road section between two adjacent positioning points are obtained;

a first display module 1012, configured to display a first street view video of the street view videos on the display screen in response to a simulation start instruction for the target simulation area.

And a second display module 1013 configured to respond to the direction adjustment instruction and replace the street view video displayed on the display screen.

And the third display module 1014 is configured to adjust the playing speed of the street view video displayed on the display screen in response to the speed adjustment instruction.

Optionally, the direction adjustment instruction may include: a left turn instruction, a right turn instruction, and a go-through instruction. The second display module 1013 may be configured to: responding to a left turn instruction, and displaying a second street view video in the plurality of street view videos on the display screen; displaying a third street view video of the plurality of street view videos on the display screen in response to the right turn instruction; displaying a fourth street view video of the plurality of street view videos on the display screen in response to the line-through instruction;

the second street view video is a left-turn video associated with the first street view video in the street view videos, the third street view video is a right-turn video associated with the first street view video in the street view videos, the fourth street view video is a straight-line video associated with the first street view video in the street view videos, and the starting end point of the road section of the video associated with the first street view video is the same as the ending end point of the road section of the first street view video.

Alternatively, referring to fig. 1, the display screen 102 may include: a first sub-display 1021, a second sub-display 1022, and a third sub-display located between the first sub-display 1021 and the second sub-display 1022. Referring to fig. 17, the controller 101 may further include:

the fourth display module 1015 is configured to display at least part of the second street view video on the first sub-display screen, display at least part of the third street view video on the second sub-display screen, and display at least part of the fourth street view video on the third sub-display screen when the playing duration of the first street view video is greater than the duration threshold.

Optionally, the speed adjustment instruction may include: an acceleration command and a deceleration command. The third display module 1014 may be configured to: responding to an acceleration instruction, and accelerating to display the street view video displayed on the display screen; and responding to the deceleration instruction, and displaying the street view video displayed on the display screen in a deceleration mode.

Optionally, the first display module 1012 may be configured to: receiving a selection operation for a first street view video of a plurality of street view videos; and responding to a selection operation, and displaying the first street view video on a display screen.

Optionally, the obtaining module 1011 may be configured to: a plurality of street view videos is obtained from a server. The street view videos are obtained by processing the real view video of the target simulation area through the server.

To sum up, this application embodiment provides a controller, and this controller can control and show street view video on the display screen to a plurality of images that different positions were shot on the display screen, therefore the street view that shows on the display screen is more coherent, and the display effect of display screen can be better. In addition, the controller provided by the embodiment of the application can replace the street view video displayed on the display screen based on the direction adjusting instruction, and can adjust the playing speed of the street view video displayed on the display screen based on the speed adjusting instruction, so that the flexibility of the street view video displayed on the display screen is better.

Fig. 18 is a schematic structural diagram of a street view display device according to an embodiment of the present disclosure, and referring to fig. 18, the device 50 may include: a processor 501, a memory 502 and a computer program stored in the memory 502 and operable on the processor, wherein the processor 501, when executing the computer program, can implement the street view display method provided by the above method embodiments, such as the method shown in fig. 2 or fig. 4.

The embodiment of the present application provides a computer-readable storage medium, in which instructions are stored, and the instructions are loaded and executed by a processor to implement the street view display method provided by the above method embodiment, for example, implement the method shown in fig. 2 or fig. 4.

In the embodiments of the present application, the terms "first", "second", "third", "fourth", "fifth", and "sixth" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. The term "at least one" in the embodiments of the present application means one or more, and the term "a plurality" in the embodiments of the present application means two or more.

The above description is only exemplary of the present application and should not be taken as limiting, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims

1. A streetscape display method, applied to a controller of a simulated cockpit, the simulated cockpit further comprising: a display screen; the method comprises the following steps:

2. The method of claim 1, wherein the direction adjustment instruction comprises: a left turn instruction, a right turn instruction, and a go-straight instruction; the responding to the direction adjusting instruction, and replacing the street view video displayed on the display screen comprises:

3. The method of claim 2, wherein the display screen comprises: the display screen comprises a first sub display screen, a second sub display screen and a third sub display screen positioned between the first sub display screen and the second sub display screen; prior to the responding to the direction adjustment instruction, the method further comprises:

4. The method of claim 1, wherein the speed adjustment instruction comprises: an acceleration instruction and a deceleration instruction; responding to a speed adjusting instruction, and adjusting the playing speed of the street view video displayed on the display screen, wherein the speed adjusting instruction comprises the following steps:

5. The method of any one of claims 1 to 4, wherein the displaying a first streetscape video of the streetscape videos on the display screen in response to a simulation start instruction for the target simulation area comprises:

6. The method according to any one of claims 1 to 4, wherein the obtaining a plurality of streetscape videos comprises:

7. A controller for simulating a cockpit, the controller comprising:

an obtaining module, configured to obtain a plurality of street view videos, where the street view videos are all live view videos of a target simulation area, the target simulation area includes a plurality of roads, each road has two endpoints, the plurality of roads have at least one road intersection and at least two positioning points corresponding to the at least one road intersection, and the street view videos include: the video obtained by shooting the road section between the end point and the positioning point and the video obtained by shooting the road section between two adjacent positioning points are obtained;

8. The controller of claim 7, wherein the direction adjustment instructions comprise: a left turn instruction, a right turn instruction, and a go-straight instruction; the second display module is configured to:

9. A simulated cockpit, characterized in that said simulated cockpit comprises: a display screen, and a controller as claimed in claim 7 or 8.

10. A computer-readable storage medium having instructions stored thereon, the instructions being loaded and executed by a processor to implement the streetscape display method according to any one of claims 1 to 6.