WO2022160612A1

WO2022160612A1 - Interaction method with vehicle-mounted system of vehicle, storage medium, and mobile terminal

Info

Publication number: WO2022160612A1
Application number: PCT/CN2021/106072
Authority: WO
Inventors: 应臻恺; 时红仁
Original assignee: 博泰车联网科技(上海)股份有限公司
Priority date: 2021-01-29
Filing date: 2021-07-13
Publication date: 2022-08-04
Also published as: CN114827704A

Abstract

Embodiments of the present invention provide an interaction method with a vehicle-mounted system of a vehicle, comprising: according to a playback control situation of one or more screens of a vehicle-mounted system, a mobile terminal shares resources to the one or more screens of the vehicle-mounted system for play back. The method facilitates the effective utilization of playback resources of mobile terminals and vehicle-mounted systems of vehicles.

Description

Interaction method, storage medium and mobile terminal with on-board system of vehicle

technical field

The present invention relates to the technical field of vehicles, and in particular, to a method for interacting with an in-vehicle system of a vehicle, a storage medium and a mobile terminal.

Background technique

With the development of screen projection technology, users can project the content of the playback application on the mobile terminal such as a smartphone to the screen of the vehicle for playback, and can also project the playback content of the vehicle terminal to the mobile terminal such as a smartphone for playback.

Currently, there are mainly two ways to project the playback content of the mobile terminal to the vehicle screen for playback, the push method or the mirroring method. For the push method, some vehicle screen playback control systems may not support the push method or some of the playback applications do not support the push method. For the mirroring method, the data stream to be transmitted is relatively large, which is likely to cause freezes. Therefore, The application playback interaction between a mobile terminal such as a smart phone and a vehicle on-board terminal using the existing method is not conducive to the effective use of vehicle playback resources.

SUMMARY OF THE INVENTION

In order to overcome the shortcomings and deficiencies in the prior art, the purpose of the present application is to provide a method for interacting with an on-board system of a vehicle, a storage medium and a mobile terminal, aiming to solve the application between the mobile terminal and the on-board terminal of the vehicle in the prior art Play interaction is not conducive to the effective use of playback resources of mobile terminals and vehicle on-board systems.

One aspect of the specific embodiment of the present invention relates to a method of interacting with an in-vehicle system of a vehicle, the vehicle comprising one or more screens, wherein the following steps are included:

Send resource sharing requests;

According to the playback control of one or more screens, resource sharing is performed. If playback can be performed through resource address sharing, the shared resource address is sent; if playback cannot be performed through resource address sharing, the shared resource data is sent.

Optionally, the method further includes the step of: acquiring the stored playback control conditions of the one or more screens from storage.

Optionally, the method further includes the step of: acquiring the playback control situation of the one or more screens from the feedback of the in-vehicle system.

Optionally, the method further includes the step of: in response to the screen sharing instruction, sending specified screen information.

Optionally, it also includes the step of: responding to the resource sharing instruction, providing an operation interface for screen sharing, and the operation interface provides the position of the corresponding simulation screen according to the position layout of one or more screens in the vehicle, and the simulation screen can be passed through the simulation screen. Send screen-specific information.

Optionally, the method further includes the step of: acquiring in advance the position and layout of the one or more screens in the vehicle.

Optionally, the method further includes the step of: receiving feedback from the in-vehicle system to obtain the positional layout of one or more screens in the vehicle.

Optionally, it also includes the step of: if it can be played through resource address sharing, sending the application program information required for sharing the content to the vehicle.

Optionally, the resource is video or audio.

Another aspect of specific embodiments of the present invention relates to a computer-readable storage medium having computer instructions stored thereon, wherein the computer instructions are used to cause the computer to perform the interaction method as described in any preceding item.

Another aspect of the specific embodiments of the present invention relates to a mobile terminal, the mobile terminal comprising a memory and a processor for executing a computer program stored in the memory to implement the interaction method as described in any preceding item .

Optionally, the mobile terminal includes any one or more of a smart phone, a tablet computer, a notebook device, a vehicle terminal device, a mobile entertainment device, and a wearable device.

Another aspect of specific embodiments of the present invention relates to a method of interacting with an in-vehicle system of a vehicle, the vehicle including one or more screens, including the steps of:

Receive resource sharing requests;

Play according to the received shared resource, if the received shared resource is a resource address, obtain the resource according to the resource address and play; if the received shared resource is resource data, then convert the resource data into a corresponding resource for playback .

Optionally, the method further includes the step of: sending the playback control conditions of the one or more screens.

Optionally, the method further includes the step of: sending the position and layout of the one or more screens in the vehicle.

Optionally, the method further includes the step of: receiving screen designation information, and determining, according to the screen designation information, to be played by the designated screen.

Optionally, the method further includes the step of: receiving application program information of the shared resource, and matching the application program to play according to the application program information.

Optionally, the matched application is a quick application.

Optionally, the resource is video or audio.

Another aspect of the specific embodiment of the present invention relates to an in-vehicle terminal, the in-vehicle terminal includes a memory and a processor, the processor is configured to execute a computer program stored in the memory to implement the interaction method as described in any preceding item .

Description of drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained based on these drawings without any creative effort.

1 is a schematic flowchart of a method for interacting with an on-board system of a vehicle according to an aspect of the specific embodiment of the present invention;

FIG. 2 is a schematic flowchart of a method for interacting with an in-vehicle system of a vehicle according to another aspect of the specific embodiment of the present invention.

Detailed ways

In the specific embodiment of the present invention, the one or more screens may be screens provided in the vehicle, or may be screens provided outside the vehicle.

In a specific embodiment of the present invention, in the interaction method, the mobile terminal shares resources to the in-vehicle system for playback, and the mobile terminal includes smart phones, tablet computers, notebook devices, in-vehicle terminal devices, mobile entertainment devices and wearable devices. any one or more of them.

In the specific embodiment of the present invention, the transmission mode of data information such as shared resource addresses or shared resource data can be wired or wireless data transmission modes, such as data transmission modes such as wifi, Bluetooth, USB or NFC.

In the specific embodiment of the present invention, the resources are video resources or audio resources, specifically including video or audio playback resources of various applications, for example, video playback resources of a video website application, map navigation broadcast of a navigation application, etc. , the resource also includes its playback status information, such as the playback duration information of the shared resource.

Send resource sharing requests;

In the method for interacting with the on-board system of the vehicle in the specific embodiment of the present invention, the mobile terminal shares resources to the on-board system for playback, and performs resource sharing according to the playback control situation of one or more screens. If the playback control of the screen can pass the resource address If you want to share and play, send the shared resource address, so that you can play through the shared resource address, without occupying the playback resources of the mobile terminal, and without the mobile terminal for resource data transmission, so as to avoid excessive data streams, such as video data streams. If the playback control of the screen cannot be played through the resource address sharing, for example, some screens only have the display function and cannot be played through the resource address, or some resources cannot be shared through the resource address. For example, the related video or audio code is sent to the in-vehicle system through a data stream, and the in-vehicle system re-decodes and plays it, so that the shared resource can be played by means of data stream transmission. Make up for the inability to play through resource address sharing, so as to achieve the most effective use of playback resources when the mobile terminal shares resources to the in-vehicle system for playback.

FIG. 1 is a schematic flowchart of a method for interacting with an on-board system of a vehicle according to an aspect of the specific embodiment of the present invention. The method for interacting with an on-board system of a vehicle of the present invention is further described below with reference to FIG. 1 .

As shown in FIG. 1 , a method for interacting with an in-vehicle system of a vehicle according to a specific embodiment of the present invention, the vehicle includes one or more screens, including the following steps: S11, sending a resource sharing request; S12, according to one or more screens In the case of playback control, resource sharing is performed; S13, if the resource address sharing can be used for playback, the shared resource address is sent; S14, if the resource address sharing cannot be used for playback, the shared resource data is sent.

In the method for interacting with the on-board system of the vehicle according to the specific embodiments of the present invention, in some specific embodiments, in step S11, after sending the resource sharing request, after confirming that the on-board system accepts the resource sharing request, the subsequent step S12 is performed according to one or Play control of multiple screens and resource sharing. In some specific implementations, the in-vehicle system is set to accept the resource sharing request by default. In some specific implementations, the in-vehicle system requires the user to confirm to accept the resource sharing request. For example, the in-vehicle system receives the resource sharing request. After that, an interface of whether to agree to the operation is displayed on the display screen, and the user confirms whether to accept the resource sharing request.

In the method for interacting with the on-board system of the vehicle according to the specific embodiments of the present invention, in some specific embodiments, the interaction method further includes the step of: acquiring the stored playback control conditions of the one or more screens from storage, so that: Without waiting for further feedback from the on-board system, in step S11, after the resource sharing request is confirmed, an appropriate method for sending and sharing resources can be quickly selected for resource sharing. The stored playback control status of the one or more screens can be obtained by using the following examples, for example, by interacting with the vehicle system in advance, or by information interaction, such as sharing in a social communication application.

The method for interacting with the on-board system of the vehicle according to the specific embodiments of the present invention, in some specific embodiments, the interaction method further includes the step of: acquiring the playback control situation of the one or more screens from the on-board system feedback. After receiving the resource sharing request in step S11, the in-vehicle system feeds back the playback control conditions of one or more screens to the mobile terminal, so that the mobile terminal obtains the playback control conditions of the one or more screens from the feedback of the in-vehicle system.

The method for interacting with an on-board system of a vehicle according to a specific embodiment of the present invention further includes the step of: sending specified screen information in response to a screen sharing instruction. The screen sharing instruction is used to instruct to share the sharing resource to one or more designated screens in the vehicle, and the screen sharing instruction includes relevant input instructions that can be recognized by the mobile terminal, such as a voice instruction. The resource is shared to a specified screen, or it can be a touch operation instruction, such as a touch operation instruction to drag the shared resource to the specified screen.

The method for interacting with an on-board system of a vehicle according to a specific embodiment of the present invention further includes the step of: responding to a resource sharing instruction, providing an operation interface for screen sharing, and the operation interface provides a corresponding simulation according to the positional layout of one or more screens in the vehicle The position of the screen, and screen-specific information can be sent through the simulated screen. The resource sharing instructions include relevant input instructions that can be recognized by the mobile terminal, such as voice instructions or touch operation instructions, such as long-pressing the screen of the mobile phone for more than 3 seconds, or zooming out with two fingers. In some specific implementations, the position of the corresponding simulated screen uses text icons to represent the positional layout of one or more screens in the vehicle, for example, the operation interface displays icons such as "large front screen" or "rear seat screen" They correspond to the screens representing the front large screen and the rear seat screen, etc. in the vehicle, respectively. In some specific implementation manners, the position of the corresponding simulated screen is corresponding to the area of the command direction, for example, the area to the left represents the front large screen, the area to the right represents the rear seat screen, and so on.

The method for interacting with an on-board system of a vehicle according to specific embodiments of the present invention, in some specific embodiments, further includes the step of: pre-acquiring the positional layout of the one or more screens in the vehicle. In this way, without waiting for further feedback from the in-vehicle system, in step S11, after the resource sharing request is confirmed, the screen sharing operation interface can be quickly provided, so that the resource sharing method can be quickly sent to the designated screen. The location and layout of the one or more screens in the vehicle can be obtained in advance by using the following example, by interacting with the vehicle system in advance, or by means of information interaction, such as sharing in a social communication application.

The method for interacting with an on-board system of a vehicle according to specific embodiments of the present invention, in some specific embodiments, further includes the step of: receiving feedback from the on-board system, and acquiring the positional layout of one or more screens in the vehicle. After the in-vehicle system receives the resource sharing request sent in step S11, it feeds back the positional layout of one or more screens in the vehicle to the mobile terminal, so that the mobile terminal obtains from the feedback of the in-vehicle system the one or more screens in the vehicle. location layout.

The method for interacting with the on-board system of the vehicle according to the specific embodiment of the present invention further includes the steps of: S13. If the playback can be performed through resource address sharing, send the application program information required for sharing the content to the on-board system, where the application program information includes but does not It is limited to the application icon, application name, application installation package information, application category or application version, etc., so that the in-vehicle system can match the corresponding application to play according to the application information.

Another aspect of specific embodiments of the present invention relates to a computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause the computer to perform the interaction method as described in any preceding item. The computer storage medium may include ROM, RAM, magnetic or optical disks, and the like. The computer storage medium may also include non-volatile or non-transitory memory, and the like.

Another aspect of the specific embodiment of the present invention relates to a mobile terminal, the mobile terminal includes a memory and a processor, and the processor is configured to execute a computer program stored in the above-mentioned memory to implement the interaction method as described in any preceding item. The mobile terminal includes any one or more of a smart phone, a tablet computer, a notebook device, a vehicle terminal device, a mobile entertainment device, and a wearable device.

Receive resource sharing requests;

The method for interacting with the vehicle's on-board system according to the specific embodiment of the present invention receives the resource sharing of the mobile terminal for playback, and performs resource playback according to the playback control conditions of one or more screens. If the received shared resource is the resource address, then according to the The resource address is obtained from the in-vehicle system or the platform of the Internet of Vehicles for playback, which can make full use of the resources of the in-vehicle or platform itself for playback, without occupying the playback resources of the mobile terminal, and without the need for resource data transmission on the mobile terminal, so as to avoid excessive data. Streams, such as video data streams, usually have a relatively large amount of data, which is likely to cause jamming during the transmission process; if the received shared resource is resource data, the resource data is converted to the corresponding resource for playback, such as audio or video data. Decoding and playback, in this way, the shared resources can be played by means of data stream transmission to make up for the lack of playback through resource address sharing, so as to achieve the most effective use of playback resources when the mobile terminal shares resources to the vehicle system for playback.

FIG. 2 is a schematic flowchart of a method for interacting with an on-board system of a vehicle according to another aspect of the specific embodiment of the present invention. The method for interacting with an on-board system of a vehicle of the present invention is further described below with reference to FIG. 2 .

As shown in FIG. 2 , the method for interacting with the on-board system of a vehicle according to a specific embodiment of the present invention, the vehicle includes one or more screens, and includes the following steps: S21, receiving a resource sharing request, S22, playing according to the received shared resource situation, S23, if the received shared resource is a resource address, obtain the resource according to the resource address and play it; S24, if the received shared resource is resource data, convert the resource data into a corresponding resource for playback.

The method for interacting with the on-board system of the vehicle according to the specific embodiment of the present invention, in some specific embodiments, further includes the steps of: S21. After receiving the resource sharing request, send the playback control status of the one or more screens, and send the one or more screens. The playback control of each screen is fed back to the mobile terminal.

In the method for interacting with the on-board system of the vehicle according to the specific embodiment of the present invention, S21. After receiving the resource sharing request, in some specific implementations, the resource sharing request is accepted by default, and in some specific implementations, the user is required to agree to the operation and then accept it. For the resource sharing request, for example, an interface displaying whether to agree to the operation is displayed on the display screen, and the user confirms whether to accept the resource sharing request.

The method for interacting with the on-board system of the vehicle according to the specific embodiments of the present invention, in some specific embodiments, further includes the step of: sending the position and layout of the one or more screens in the vehicle. S21. After receiving the resource sharing request, send the position layout of the one or more screens in the vehicle, and feed back the position layout of the one or more screens in the vehicle to the mobile terminal.

The method for interacting with an on-board system of a vehicle according to specific embodiments of the present invention, in some specific embodiments, further includes the steps of: receiving screen specification information, and determining that the screen is to be played by the specified screen according to the screen specification information. For example, if the specified information is received from the mobile terminal for sharing resources to the front large screen of the vehicle, then the front large screen is selected for playback. play.

The method for interacting with the on-board system of the vehicle according to the specific embodiments of the present invention, in some specific embodiments, for the way of playing the resource obtained through the resource address, the method further includes the step of: receiving application program information for sharing the resource, according to the application program. The information matches the application program to play. Specifically, in some specific implementation manners, according to the application program information, the corresponding fast application program is matched, downloaded and started to play, so that a lightweight application program can be played without too much. In particular, in some specific implementation manners, if it is detected that the quick application is closed, the user is prompted to delete the quick application or automatically starts to safely delete the quick application, so that after the playback is completed, the user is prompted to delete the quick application. After that, the on-board storage resources will not be occupied; in some specific implementations, according to the application program information, before matching the corresponding fast application program, it is matched with the application program that comes with the on-board system, and if it can be played, it will be directly The application program is called to play, which can effectively use the application program resources built in the vehicle to play; in some specific implementation manners, according to the application program information, it is also possible to search and download a matching application program for playback.

Another aspect of the specific embodiment of the present invention relates to a computer-readable storage medium, which stores computer instructions, wherein the computer instructions are used to cause the computer to receive and play a shared resource from a mobile terminal according to the previous item. interactive method. The computer storage medium may include ROM, RAM, magnetic or optical disks, and the like. The computer storage medium may also include non-volatile or non-transitory memory, and the like.

Another aspect of the specific embodiments of the present invention relates to an in-vehicle terminal, the in-vehicle terminal includes a memory and a processor, and the processor is configured to execute a computer program stored in the memory to achieve the above-mentioned method of receiving a message from a mobile terminal. Interactive method for sharing resources for playback.

Although the present invention is disclosed above, the present invention is not limited thereto. Any person skilled in the art can make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the protection scope of the present invention should be based on the scope defined by the claims.

Claims

A method for interacting with an in-vehicle system of a vehicle, the vehicle comprising one or more screens, characterized in that it includes the following steps:

Send resource sharing requests;

According to the playback control situation of the one or more screens, perform resource sharing, and if the playback can be performed through resource address sharing, send the shared resource address;

If the resource address cannot be shared for playback, the shared resource data is sent.
The interaction method according to claim 1, further comprising the step of: acquiring the stored playback control conditions of the one or more screens from storage.
The interaction method according to claim 1, further comprising the step of: acquiring the playback control situation of the one or more screens from feedback from the vehicle-mounted system.
The interaction method according to claim 1, further comprising the step of: sending specified screen information in response to the screen sharing instruction.
The interaction method according to claim 4, further comprising the step of: responding to the resource sharing instruction, providing an operation interface for screen sharing, the operation interface providing the position of the corresponding simulated screen according to the positional layout of one or more screens in the vehicle, The screen specifying information may be transmitted through the simulated screen.
The interaction method according to claim 5, further comprising the step of: acquiring the positional layout of the one or more screens in the vehicle in advance.
The interaction method according to claim 5, further comprising the step of: receiving feedback from the in-vehicle system to obtain the positional layout of the one or more screens in the vehicle.
The interaction method according to claim 1, further comprising the step of: if it can be played through resource address sharing, sending application program information required for sharing content to the in-vehicle system.
The interaction method according to claim 1, wherein the resource is video or audio.
A computer-readable storage medium, characterized in that it stores computer instructions, wherein the computer instructions are used to cause the computer to execute the interaction method according to any one of claims 1-9.
A mobile terminal, characterized in that the mobile terminal includes a memory and a processor, and the processor is configured to execute a computer program stored in the memory to implement the interaction method according to any one of claims 1-9 .
The mobile terminal according to claim 11, comprising any one or more of a smart phone, a tablet computer, a notebook device, a vehicle-mounted terminal device, a mobile entertainment device, and a wearable device.
A method for interacting with an in-vehicle system of a vehicle, the vehicle comprising one or more screens, characterized in that it includes the following steps:

Receive resource sharing requests;

Play according to the received shared resource, if the received shared resource is a resource address, obtain the resource according to the resource address and play; if the received shared resource is resource data, then convert the resource data into a corresponding resource for playback .
The interaction method according to claim 13, further comprising the step of: sending the playback control conditions of the one or more screens.
The interaction method according to claim 13, further comprising the step of: sending the position and layout of the one or more screens in the vehicle.
The interaction method according to claim 13, further comprising the step of: receiving screen designation information, and determining that the screen is to be played by the designated screen according to the screen designation information.
The interaction method according to claim 13, further comprising the step of: receiving application information of shared resources, and matching application playing according to the application information.
According to the interaction method of claim 17, the matched application program is a quick application program.
The interaction method according to claim 13, wherein the resource is video or audio.
A computer-readable storage medium, characterized in that it stores computer instructions, wherein the computer instructions are used to cause the computer to execute the interaction method according to any one of claims 13-19.
An in-vehicle terminal, characterized in that the in-vehicle terminal includes a memory and a processor, and the processor is configured to execute a computer program stored in the memory to implement the interaction method according to any one of claims 13-19 .