CN116124156A - Navigation method, storage medium, equipment and system based on multi-screen interaction - Google Patents

Abstract

The invention provides a navigation method, a storage medium, equipment and a system based on multi-screen interaction, wherein the navigation method based on multi-screen interaction comprises the following steps: acquiring a focus place in a navigation path; determining the arrival time of the concerned place by combining the current running information; predicting a user demand corresponding to the arrival time; and updating the position of the navigation passing point or the terminal according to the user demand. According to the invention, in the navigation process, information interaction between the main driving screen and the auxiliary driving screen as well as between the main driving screen and the rear seat screen can be realized, so that the main driving, the auxiliary driving and the rear seat passengers can be flexibly communicated and interacted.

Description

Navigation method, storage medium, equipment and system based on multi-screen interaction

Technical Field

The invention belongs to the technical field of navigation application, relates to a navigation method, and in particular relates to a navigation method, a storage medium, equipment and a system based on multi-screen interaction.

Background

Currently, with the development of scientific technology, automobiles become more and more intelligent. In order to meet the demands of different clients, the types and the number of the vehicle-mounted display screens are increasing. In addition to the traditional central control display screen and digital instrument panel, virtual rearview mirrors, head-up displays, rear-row vehicle entertainment display screens, air conditioner control screens and the like with various functions also appear. Thus, it has become a common design to provide a display screen for each seating position in addition to the driver's seat.

However, the existing vehicle-mounted multi-screen displays are respectively and independently outputting contents, particularly map displays, and only focus on the same map in the multi-screen display or different maps in the single-screen display. For navigation application, navigation can only be performed according to the destination position input by the main driver, and good interaction between the auxiliary driving screen or the rear seat screen is absent.

Therefore, how to provide a navigation method, a storage medium, a device and a system based on multi-screen interaction, so as to solve the defect that the prior art cannot enable multiple people in a vehicle to perform information interaction and communication through screens at respective positions, and the like, is a technical problem to be solved by those skilled in the art.

Disclosure of Invention

In view of the above-mentioned drawbacks of the prior art, the present invention is directed to a navigation method, a storage medium, a device and a system based on multi-screen interaction, which are advantageous in that a plurality of people in a vehicle can interact and communicate information through respective screens.

The invention further aims to provide a navigation method, a storage medium, equipment and a system based on multi-screen interaction, which have the advantages that information interaction between a main driving screen and a secondary driving screen and between the main driving screen and a rear seat screen can be realized in the navigation process, so that the main driving, the secondary driving and rear seat passengers can be flexibly communicated and interacted.

The invention aims to provide a navigation method, a storage medium, equipment and a system based on multi-screen interaction, which have the advantages that aiming at navigation application, a single and boring navigation process which can only be carried out according to a destination position input by a main driver is avoided.

The invention aims to provide a navigation method, a storage medium, equipment and a system based on multi-screen interaction, which have the advantages that the navigation method, the storage medium, the equipment and the system can push the location information of accommodation, dining, play and the like focused by a secondary screen or a rear seat screen passenger to a driving screen in time so as to update a navigation route according to the received location information.

The invention aims to provide a navigation method, a storage medium, equipment and a system based on multi-screen interaction, which have the advantages that the navigation method, the storage medium, the equipment and the system can automatically trigger and push the terminal point and the surrounding POI information of the terminal point when a vehicle approaches to the passing point or the terminal point position in a navigation path.

The invention aims to provide a navigation method, a storage medium, equipment and a system based on multi-screen interaction, which have the advantages that the information of interest points of passengers in a vehicle can be predicted according to the user information, so that the information of the preferences of the passengers can be displayed on a display screen at a corresponding position.

The invention aims to provide a navigation method, a storage medium, equipment and a system based on multi-screen interaction, which have the advantages that by matching the arrival time with a preset life work and rest plan, information pushing and updating of a navigation route can be performed according to waypoints related to a navigation path in the life work and rest plan.

To achieve the above and other related objects, an aspect of the present invention provides a navigation method based on multi-screen interaction, including: acquiring a focus place in a navigation path; determining the arrival time of the concerned place by combining the current running information; predicting a user demand corresponding to the arrival time; and updating the position of the navigation passing point or the terminal according to the user demand.

To achieve the above and other related objects, the present invention provides, in another aspect, a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the multi-screen interaction-based navigation method.

To achieve the above and other related objects, a further aspect of the present invention provides an electronic device, including: a processor and a memory; the memory is used for storing a computer program, and the processor is used for executing the computer program stored in the memory so as to enable the electronic equipment to execute the navigation method based on the multi-screen interaction.

To achieve the above and other related objects, a final aspect of the present invention provides a multi-screen interaction-based navigation system, comprising: the electronic equipment comprises a first display screen, a second display screen and the electronic equipment; the electronic equipment is respectively in communication connection with the first display screen and the second display screen; the first display screen displays a navigation path; the second display screen acquires a focus place in the navigation path; transmitting the place of interest to the electronic device; the electronic equipment combines the current running information to determine the arrival time of the concerned place; predicting a user demand corresponding to the arrival time; determining position information corresponding to the user demand according to the user demand, and sending the position information to a first display screen; and the first display screen updates the position of the navigation passing point or the end point in the navigation path according to the position information.

Drawings

FIG. 1 is a schematic flow chart of a navigation method based on multi-screen interaction according to an embodiment of the invention.

FIG. 2 is a flow chart illustrating a location acquisition method based on multi-screen interaction according to an embodiment of the present invention.

FIG. 3 is a flow chart showing an information presentation of a navigation method based on multi-screen interaction according to an embodiment of the invention.

FIG. 4 is a flow chart illustrating a method for demand prediction in an embodiment of the navigation method based on multi-screen interaction according to the present invention.

FIG. 5 is a flow chart illustrating a navigation method based on multi-screen interaction according to an embodiment of the invention.

FIG. 6 is a diagram illustrating a multi-screen interaction according to an embodiment of the navigation method.

Fig. 7 is a schematic structural connection diagram of an electronic device according to an embodiment of the invention.

FIG. 8 is a schematic diagram of a navigation system based on multi-screen interaction according to an embodiment of the present invention.

Description of element reference numerals

1. Electronic equipment

11. Processor and method for controlling the same

12. Memory device

2. First display screen

3. Second display screen

S11 to S14 steps

S111 to S113 steps

Steps S112A to S112D

S131 to S132 steps

S141 to S142 steps

Detailed Description

Other advantages and effects of the present invention will become apparent to those skilled in the art from the following disclosure, which describes the embodiments of the present invention with reference to specific examples. The invention may be practiced or carried out in other embodiments that depart from the specific details, and the details of the present description may be modified or varied from the spirit and scope of the present invention. It should be noted that the following embodiments and features in the embodiments may be combined with each other without conflict.

It should be noted that the illustrations provided in the following embodiments merely illustrate the basic concept of the present invention by way of illustration, and only the components related to the present invention are shown in the illustrations, not according to the number, shape and size of the components in actual implementation, and the form, number and proportion of each component in actual implementation may be arbitrarily changed, and the layout of the components may be more complex.

The navigation method, the storage medium, the equipment and the system based on the multi-screen interaction can realize the information interaction between the main driving screen and the auxiliary driving screen as well as between the main driving screen and the auxiliary driving screen.

The following describes in detail the principles and implementation of a navigation method, a storage medium, a device and a system based on multi-screen interaction according to the present embodiment with reference to fig. 1 to 8, so that those skilled in the art can understand the navigation method, the storage medium, the device and the system based on multi-screen interaction according to the present embodiment without creative effort.

Referring to fig. 1, a schematic flow chart of a navigation method based on multi-screen interaction according to an embodiment of the invention is shown. As shown in fig. 1, the navigation method based on multi-screen interaction specifically includes the following steps:

s11, acquiring a focus point in a navigation path.

Specifically, the focus point can be determined according to the information browsed by the display screens of passengers on different seats in the vehicle at the positions of the passengers.

Referring to fig. 2, a flow chart of a location acquisition method based on multi-screen interaction according to an embodiment of the invention is shown.

As shown in fig. 2, S11 specifically includes the following steps:

s111, setting a preset distance range.

In particular, the preset distance range may be 50 meters, 100 meters, or other reasonably set distance values.

In practical applications, the value set in the preset distance range may be a straight line distance from the waypoint to the interest point, or may be a driving distance from the waypoint to the interest point.

And S112, presenting the information of the interest points, the distance between the interest points and the waypoints in the navigation path of which is in a preset distance range.

Specifically, when the vehicle runs to different waypoints along the navigation path in real time, POIs (Point of interesting, points of interest) around the waypoints can be dynamically framed by a preset distance range.

Referring to fig. 3, a flowchart of a navigation method based on multi-screen interaction according to an embodiment of the invention is shown.

As shown in fig. 3, S112 specifically includes the following steps:

S112A, acquiring user information of the passengers in the vehicle.

Specifically, the portraits of the driver and the passenger are matched with the user information in the cloud database based on DMS (design+management+service), face recognition, voiceprint recognition, or registered accounts. The user portrait is determined in advance by any data which can identify the individual or can identify the individual in combination with each other, such as identity, character, browsing record, purchasing record and the like stored by the passengers in the vehicle.

S112B, predicting the interest point information of the passengers in the vehicle according to the user information.

Specifically, after the identity of a certain passenger is matched with the user information, the passenger preference is determined to be tourist, so that the interested point information of the passenger in the vehicle in the riding process is predicted to be tourist attractions.

And S112C, screening the interest point information of interest of the passengers in the vehicle within the preset distance range.

Specifically, if the preset distance range is 100 meters, large tourist attractions and small tourist attractions within 100 meters from the waypoints are screened.

Further, the display screen at the corresponding position of the passenger is provided with an information automatic recommendation function, and for different users, if the point A is recommended at intervals, the point B is recommended after the point A is closed for 1 minute, and the user can also close the recommendation function. Thus, the preference of each passenger can be accumulated and analyzed according to the opening and closing operation data of different passenger users.

On the other hand, for the information automatic recommendation function, the destination is a sight spot, and the predicted time when the destination is reached is noon or evening, whereby appropriate dining information is automatically recommended.

And S112D, presenting the screened interest point information of interest of the passengers in the vehicle.

In one embodiment, S112D includes the following steps:

(1) And determining the riding position of the passenger in the vehicle.

Specifically, the identity of each passenger in the vehicle can be identified from the captured image in combination with the captured image of the vehicle camera.

(2) And presenting the interest point information at the corresponding riding position.

Specifically, after the in-car image recognition, determining that the rear left passengers in the car like traveling, automatically recommending tourist attraction information to the rear left passengers; and if the fact that the passengers on the right side of the rear row in the vehicle like food is determined, the food and beverage information is automatically recommended to the passengers on the right side of the rear row.

In practical applications, the presentation mode of the interest point information may be a mode such as voice broadcasting or screen display.

S113, responding to the interest point information selected by the user, and determining the attention point.

Specifically, a browsing interaction interface is provided for a user through a display screen, the user can browse according to the information automatically recommended, and also can browse according to the information searched or selected by the user, so that the attention place is selected.

S12, combining the current running information, and determining the arrival time of the concerned place.

In one embodiment, the current driving information includes: at least one of a current vehicle speed, a current road condition, a current weather, or a current driver status.

Specifically, the arrival time may be determined from the current vehicle speed and the distance to the place of interest; if congestion or traffic accidents exist in the current road condition, predicting the arrival time according to the congestion condition; the arrival time can be flexibly predicted according to whether the current weather is thunderstorm typhoon or whether a driver is tired to drive for a long time or not, for example, if the current weather is thunderstorm, the speed of all vehicles on the route is predicted to be lower, and then the speed is predicted and the arrival time is predicted according to the thunderstorm weather; if the driver is in fatigue driving, the arrival time is predicted by combining the conditions of the vehicle such as the service area where the vehicle needs to stop and the like.

S13, predicting the user demand corresponding to the arrival time.

Referring to fig. 4, a flow chart of demand prediction in an embodiment of the navigation method based on multi-screen interaction according to the present invention is shown.

As shown in fig. 4, S13 specifically includes the following steps:

s131, matching the arrival time with a preset life work and rest plan; the life work and rest planning refers to the corresponding relation between different life work and rest activities and the time period which should occur.

Specifically, a life work plan of a co-driver passenger (which may be, for example, a spouse of a driver's owner) is obtained, and the time to lunch after the co-driver passenger arrives at the destination is determined from the life work plan, and the co-driver passenger plans to go to a praise restaurant for dining near the destination. In practical applications, the life work and rest program may be stored locally in the vehicle or pre-stored in a server, and issued to the vehicle by the server.

And S132, taking the life information successfully matched as the user requirement corresponding to the arrival time.

Specifically, the user's demand is determined by the lunch time to be enjoying lunch.

And S14, updating the position of the navigation passing point or the terminal point according to the user demand.

Specifically, the end position is updated to the praise restaurant for lunch enjoyment according to the user demand, and the navigation path is updated accordingly.

Referring to fig. 5, a flow chart of a location update in an embodiment of a navigation method based on multi-screen interaction according to the present invention is shown.

As shown in fig. 5, S14 specifically includes the following steps:

and S141, transmitting the position information corresponding to the user requirement.

Specifically, the co-driver passenger selects the praise restaurant through the co-driving display screen, and selects "transmission position" from the popped-up operation information.

And S142, synchronizing the position information into a navigation application, and updating the navigation path as a route point or an end point after updating the navigation path.

Specifically, for example, the destination of the driver is a hotel near a tourist attraction, and the destination is updated to the public praise restaurant according to the received position information of the public praise restaurant of the secondary driving display screen.

Referring to fig. 6, a multi-screen interaction diagram of a navigation method based on multi-screen interaction according to an embodiment of the invention is shown. As shown in fig. 6, the vehicle is in the navigation path, and the driving screen is just started to use and display the navigation path a. When the navigation route A approaches to the route point or the end point position, the peripheral information of the end point and the route point is acquired according to the requirement and time of the destination/route point, and the peripheral information is sequentially sent to the secondary drivers and passengers for selection and viewing according to the priority order. If the destination is the mosque and the arrival time is 12 am, the problem to be solved by the user at the time point is predicted to be dining, and then the periphery of the restaurant of the destination is preferentially recommended to the secondary screen for selection. Meanwhile, the reservation information of the restaurant can be sent to the assistant driver/rear seat for reservation. For example, the co-driver display screen displays information such as an address of a P-order hall, a telephone call, a preferential activity and the like, and after the co-driver selects the restaurant, P-point address information corresponding to the restaurant is acquired at the same time, the P-point address information is sent to the driving screen, and a final destination of navigation is modified to be P-point, so that the P-point is updated to be a navigation path B.

In addition, the assistant driver or the back seat passenger can find out suitable POIs along various lines or suitable POIs such as restaurants, hotels and scenic spots, re-plan the journey, order the found POIs in sequence, set the stay time at the location in the journey according to the reference stay time on the POIs, send the stay time to the driver seat, and enable the driver to navigate in sequence according to the journey. And resetting the navigation path and displaying the navigation path on a driving screen. For example, when a rear-row left passenger selects a restaurant, a exhibition hall, and a hotel in order at 12 pm, the restaurant information is transmitted to the driver at 12 pm, the estimated dining time is 2 hours, the exhibition hall information is transmitted to the driver at 2 pm, the exhibition hall tour time is estimated to be 1 half hour, and the hotel position is transmitted to the driver at 3 pm for 30 minutes.

The protection scope of the navigation method based on multi-screen interaction is not limited to the execution sequence of the steps listed in the embodiment, and all the schemes realized by the steps of increasing and decreasing and step replacement in the prior art according to the principles of the invention are included in the protection scope of the invention.

The present embodiment provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the multi-screen interaction based navigation method.

Those of ordinary skill in the art will appreciate that: all or part of the steps for implementing the method embodiments described above may be performed by computer program related hardware. The aforementioned computer program may be stored in a computer readable storage medium. The program, when executed, performs steps including the method embodiments described above; and the aforementioned computer-readable storage medium includes: various computer storage media such as ROM, RAM, magnetic or optical disks may store program code.

Referring to fig. 7, a schematic structural connection diagram of an electronic device according to an embodiment of the invention is shown. As shown in fig. 7, the present embodiment provides an electronic device 1, specifically including: a processor 11 and a memory 12; the memory 12 is configured to store a computer program, and the processor 11 is configured to execute the computer program stored in the memory 12, so that the electronic device 1 performs the steps of the navigation method based on multi-screen interaction.

The processor 11 may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU for short), a network processor (Network Processor, NP for short), and the like; but also digital signal processors (Digital Signal Processing, DSP for short), application specific integrated circuits (Alication Specific Integrated Circuit, ASIC for short), field programmable gate arrays (Field Programmable GateArray, FPGA for short) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

The memory 12 may include a random access memory (Random Access Memory, simply referred to as RAM) and may also include a non-volatile memory (non-volatile memory), such as at least one magnetic disk memory.

In practical applications, the electronic device may be a computer including a memory, a memory controller, one or more processing units (CPUs), a peripheral interface, an RF circuit, an audio circuit, a speaker, a microphone, an input/output (I/O) subsystem, a display screen, other output or control devices, and external ports; for example, the electronic device is a vehicle-mounted terminal, and the vehicle-mounted terminal is used for acquiring a place of interest in a navigation path; determining the arrival time of the concerned place by combining the current running information; predicting a user demand corresponding to the arrival time; and updating the position of the navigation passing point or the terminal according to the user demand.

Referring to fig. 8, a schematic structural diagram of a navigation system based on multi-screen interaction according to an embodiment of the invention is shown. As shown in fig. 8, the navigation system based on multi-screen interaction includes: an electronic device 1, a first display 2 and a second display 3; the electronic device 1 is respectively in communication connection with the first display screen 2 and the second display screen 3.

The first display screen 2 displays a navigation path.

The second display screen 3 acquires a focus point in a navigation path; the place of interest is sent to the electronic device 1.

The electronic equipment 1 combines the current running information to determine the arrival time of the concerned place; predicting a user demand corresponding to the arrival time; and determining position information corresponding to the user demand according to the user demand, and sending the position information to the first display screen 2.

And the first display screen 2 updates the position of the navigation passing point or the end point in the navigation path according to the position information.

The principle of the navigation system based on multi-screen interaction in the invention corresponds to the navigation method based on multi-screen interaction one by one, the navigation system based on multi-screen interaction in the invention can realize the navigation method based on multi-screen interaction in the invention, but the realization device of the navigation method based on multi-screen interaction in the invention comprises but is not limited to the structure of the navigation system based on multi-screen interaction listed in the embodiment, and all the structural deformation and replacement of the prior art according to the principle of the invention are included in the protection scope of the invention.

In summary, the navigation method, the storage medium, the device and the system based on multi-screen interaction enable multiple persons in a vehicle to perform information interaction and communication through screens at respective positions. In the navigation process, information interaction between the main driving screen and the auxiliary driving screen as well as between the main driving screen and the auxiliary driving screen. For navigation applications, a single and boring navigation process, which can only be performed according to the destination location of the main drive input, is avoided. The method can push the location information of accommodation, dining, playing and the like focused by the passenger on the secondary driving screen or the rear seat screen to the driving screen in time, so that the driver can update the navigation route according to the received location information. The terminal and the surrounding POI information of the terminal point can be automatically triggered and pushed when the vehicle approaches to the passing point or the terminal point position in the navigation path. The interest point information of the passengers in the vehicle can be predicted according to the user information, so that the information of the passenger preference is displayed on the display screen of the corresponding position. By matching the arrival time with a preset life work and rest plan, information pushing and updating of a navigation route can be performed according to the waypoints related to the navigation route in the life work and rest plan. The invention effectively overcomes various defects in the prior art and has high industrial utilization value.

The above embodiments are merely illustrative of the principles of the present invention and its effectiveness, and are not intended to limit the invention. Modifications and variations may be made to the above-described embodiments by those skilled in the art without departing from the spirit and scope of the invention. Accordingly, it is intended that all equivalent modifications and variations of the invention be covered by the claims, which are within the ordinary skill of the art, be within the spirit and scope of the present disclosure.

Claims (10)

1. The navigation method based on the multi-screen interaction is characterized by comprising the following steps of:

acquiring a focus place in a navigation path;

determining the arrival time of the concerned place by combining the current running information;

predicting a user demand corresponding to the arrival time;

and updating the position of the navigation passing point or the terminal according to the user demand.

2. The navigation method based on multi-screen interaction according to claim 1, wherein the acquiring the focus point in the navigation path comprises the following steps:

setting a preset distance range;

presenting interest point information of which the distance with the waypoints in the navigation path is in a preset distance range;

and determining the focus point in response to the interest point information selected by the user.

3. The navigation method based on multi-screen interaction according to claim 2, wherein the presenting the interest point information with the distance from the waypoint in the navigation path in the preset distance range comprises the following steps:

acquiring user information of passengers in the vehicle;

predicting interest point information of interest of passengers in the vehicle according to the user information;

screening interest point information of interest of passengers in the vehicle within the preset distance range;

and presenting the screened interest point information of interest of the passengers in the vehicle.

4. The navigation method based on multi-screen interaction according to claim 3, wherein the presenting the interest point information with the distance from the passing point in the navigation path being in the preset distance range includes the following steps:

determining a seating position of a passenger in the vehicle;

and presenting the interest point information at the corresponding riding position.

5. The multi-screen interaction-based navigation method according to claim 1, wherein the current driving information includes: at least one of a current vehicle speed, a current road condition, a current weather, or a current driver status.

6. The multi-screen interaction based navigation method according to claim 1, wherein the predicting the user demand corresponding to the arrival time comprises the steps of:

matching the arrival time with a preset life work and rest plan; the life work and rest planning refers to the corresponding relation between different life work and rest activities and time periods which should occur;

and taking the successfully matched life work and rest as the user requirement corresponding to the arrival time.

7. The navigation method based on multi-screen interaction according to claim 1, wherein the updating the navigation route point or the destination point according to the user requirement comprises the following steps:

transmitting position information corresponding to the user demand;

and synchronizing the position information into a navigation application, and carrying out navigation path updating as a route point or an end point after the navigation path updating.

8. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, implements the multi-screen interaction based navigation method of any one of claims 1 to 7.

9. An electronic device, comprising: a processor and a memory;

the memory is used for storing a computer program, and the processor is used for executing the computer program stored by the memory, so that the electronic device executes the navigation method based on multi-screen interaction as claimed in any one of claims 1 to 7.

10. A multi-screen interaction based navigation system, comprising: a first display screen, a second display screen and the electronic device of claim 9; the electronic equipment is respectively in communication connection with the first display screen and the second display screen;

the first display screen displays a navigation path;

the second display screen acquires a focus place in the navigation path; transmitting the place of interest to the electronic device;

the electronic equipment combines the current running information to determine the arrival time of the concerned place; predicting a user demand corresponding to the arrival time; determining position information corresponding to the user demand according to the user demand, and sending the position information to a first display screen;

and the first display screen updates the position of the navigation passing point or the end point in the navigation path according to the position information.

Images