CN115208864B

CN115208864B - Data transmission method, device, equipment, vehicle and storage medium

Info

Publication number: CN115208864B
Application number: CN202210967256.4A
Authority: CN
Inventors: 黄启立
Original assignee: Apollo Zhilian Beijing Technology Co Ltd; Apollo Zhixing Technology Guangzhou Co Ltd
Current assignee: Apollo Zhilian Beijing Technology Co Ltd; Apollo Zhixing Technology Guangzhou Co Ltd
Priority date: 2022-08-12
Filing date: 2022-08-12
Publication date: 2024-02-06
Anticipated expiration: 2042-08-12
Also published as: CN115208864A

Abstract

The disclosure provides a data transmission method, a data transmission device, data transmission equipment, a vehicle and a storage medium, relates to the technical field of communication, and particularly relates to the technical field of data transmission, cross-terminal interconnection and screen projection. The specific implementation scheme is as follows: acquiring media stream data to be transmitted, wherein the media stream data to be transmitted comprises video stream data and/or audio stream data; generating real-time transmission protocol RTP data packets according to media stream data to be transmitted; and sending RTP data packets to the vehicle based on the RTP session to instruct the vehicle to obtain corresponding first media stream data by analyzing the RTP data packets, and playing the first media stream data by utilizing the vehicle-mounted component, wherein the RTP session is realized based on a user datagram protocol mode. The method and the device can reduce the performance cost of the mobile terminal and the vehicle, avoid data blocking, further improve the data transmission efficiency, ensure the real-time performance of data transmission and ensure the fluency of the vehicle when playing the media data.

Description

Data transmission method, device, equipment, vehicle and storage medium

Technical Field

The disclosure relates to the technical field of communication, in particular to the technical field of data transmission, cross-terminal interconnection and screen projection.

Background

Along with the development of vehicle-mounted scenes, the requirements of people for interconnection of vehicle machines and mobile terminals are more and more obvious.

At present, the mobile terminal directly transmits the coded video data and audio data to the vehicle machine end based on a transmission control protocol (Transmission Control Protocol, TCP), wherein the TCP is a connection-oriented reliable connection protocol, and the correctness and the sequence of data transmission can be ensured.

Disclosure of Invention

The present disclosure provides a data transmission method, apparatus, device, and storage medium.

According to an aspect of the present disclosure, there is provided a data transmission method including:

acquiring media stream data to be transmitted, wherein the media stream data to be transmitted comprises video stream data and/or audio stream data;

generating real-time transmission protocol RTP data packets according to the media stream data to be transmitted;

and sending the RTP data packet to the vehicle based on the RTP session to instruct the vehicle to obtain corresponding first media stream data by analyzing the RTP data packet, and playing the first media stream data by utilizing a vehicle-mounted component, wherein the RTP session is realized based on a user datagram protocol mode.

According to another aspect of the present disclosure, there is provided a data transmission method, including:

based on a real-time transmission protocol RTP session, receiving an RTP data packet sent by a mobile terminal, wherein the mobile terminal generates the RTP data packet according to acquired media stream data to be transmitted, the media stream data to be transmitted comprises video stream data and/or audio stream data, and the RTP session is realized based on a user datagram protocol mode;

obtaining corresponding first media stream data by analyzing the RTP data packet;

and playing the first media stream data by utilizing the vehicle-mounted component.

According to another aspect of the present disclosure, there is provided a data transmission apparatus including:

the device comprises a data acquisition module to be transmitted, a data transmission module and a data transmission module, wherein the data acquisition module to be transmitted is used for acquiring media stream data to be transmitted, and the media stream data to be transmitted comprises video stream data and/or audio stream data;

the first data packet generating module is used for generating real-time transmission protocol RTP data packets according to the media stream data to be transmitted;

the first data packet sending module is used for sending the RTP data packet to the vehicle based on the RTP session, so as to instruct the vehicle to obtain corresponding first media stream data by analyzing the RTP data packet, and playing the first media stream data by utilizing the vehicle-mounted component, wherein the RTP session is realized based on a user datagram protocol mode.

the mobile terminal generates the RTP data packet according to the acquired media stream data to be transmitted, wherein the media stream data to be transmitted comprises video stream data and/or audio stream data, and the RTP session is realized based on a user datagram protocol mode;

the first data packet analyzing module is used for obtaining corresponding first media stream data by analyzing the RTP data packet;

and the first playing module is used for playing the first media stream data by utilizing the vehicle-mounted component.

According to another aspect of the present disclosure, there is provided a mobile terminal including:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the methods described by the embodiments of the present disclosure.

According to another aspect of the present disclosure, there is provided a vehicle including:

At least one processor; and

a memory communicatively coupled to the at least one processor; wherein,

According to another aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing the computer to perform the method of the embodiments of the present disclosure.

According to another aspect of the present disclosure, there is provided a computer program product comprising a computer program which, when executed by a processor, implements the method of any embodiment of the present disclosure.

It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the disclosure, nor is it intended to be used to limit the scope of the disclosure. Other features of the present disclosure will become apparent from the following specification.

Drawings

The drawings are for a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:

Fig. 1a is a flow chart of a data transmission method provided according to an embodiment of the present disclosure;

fig. 1b is a schematic diagram of a packet structure according to an embodiment of the disclosure;

FIG. 2 is a flow chart of another data transmission method provided in accordance with an embodiment of the present disclosure;

FIG. 3 is a flow chart of yet another data transmission method provided in accordance with an embodiment of the present disclosure;

fig. 4 is a flowchart of yet another data transmission method provided in accordance with an embodiment of the present disclosure;

fig. 5 is an interaction schematic diagram of a data transmission method according to an embodiment of the disclosure;

fig. 6 is a schematic structural diagram of a data transmission device according to an embodiment of the present disclosure;

fig. 7 is a schematic structural view of another data transmission apparatus according to an embodiment of the present disclosure;

fig. 8 is a block diagram of a mobile terminal for implementing a data transmission method of an embodiment of the present disclosure;

fig. 9 is a block diagram of a vehicle for implementing a data transmission method of an embodiment of the present disclosure.

Detailed Description

Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and should be considered as merely exemplary. Accordingly, one of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

Fig. 1a is a flowchart of a data transmission method according to an embodiment of the present disclosure, which is applicable to a case of data transmission between a mobile terminal and a vehicle. The method can be executed by a data transmission device, the device can be realized by adopting a hardware and/or software mode, and the device can be configured in a mobile terminal, wherein the mobile terminal can be a mobile phone, a smart watch, a tablet computer or other equipment. Referring to fig. 1a, the method specifically comprises the following steps:

s101, acquiring media stream data to be transmitted, wherein the media stream data to be transmitted comprises video stream data and/or audio stream data;

s102, generating a real-time transmission protocol RTP data packet according to the media stream data to be transmitted;

and S103, sending the RTP data packet to the vehicle based on the RTP session to instruct the vehicle to obtain corresponding first media stream data by analyzing the RTP data packet, and playing the first media stream data by utilizing a vehicle-mounted component, wherein the RTP session is realized based on a user datagram protocol mode.

The media stream data to be transmitted may be understood as media stream data to be transmitted to a vehicle in the mobile terminal, and may specifically be transmitted to a vehicle machine in the vehicle. The media stream data to be transmitted may include video stream data, audio stream data, and both video stream data and audio stream data. In the embodiment of the disclosure, the video stream data may include a plurality of video frames, and the sources of the video frames are not limited, for example, the video frames may be from a video player application program, and may also be from a navigation image in a navigation application program. The audio stream data may include a plurality of audio frames, the source of which is not limited, and may be, for example, audio from a video player-like application or navigation speech from a navigation application. In the case that the media stream data to be transmitted contains video stream data being displayed by the mobile terminal screen, the technical scheme of the embodiment of the disclosure can realize the effect of screen throwing of the mobile terminal to the vehicle.

In the embodiment of the disclosure, the mobile terminal and the vehicle can be in communication connection in a wired or wireless mode. By way of example, a Real-time transport protocol (Real-time Transport Protocol, RTP) session implemented based on user datagram protocol (User Datagram Protocol, UDP) means may be established between the mobile terminal and the vehicle, the establishment of the session being not limited. Optionally, a main data channel is first established between the mobile terminal and the vehicle, where the main data channel may be used as a channel for basic event delivery between the mobile terminal and the vehicle, and specifically for transmitting basic data, where the basic data may include, for example, an internet protocol (Internet Protocol, IP) address and port number of the mobile terminal and/or the vehicle, and an RTP session may be established based on the IP address and port number. Alternatively, the main data channel may be established based on a transmission control protocol (Transmission Control Protocol, TCP), and specifically may be a Socket connection, and the main data channel may be referred to as a MainData Socket.

For example, after acquiring the media stream data to be transmitted, the mobile terminal may generate an RTP packet according to all or part of the data in the media stream data. For example, the media stream data to be transmitted is encoded into data with a preset format, and the encoded data is encapsulated into RTP data packets. The preset format is not limited, for example, the preset format corresponding to the video stream data may be h.264, etc., and the preset format corresponding to the audio stream data may be MP3, etc. In the case of RTP packet encapsulation, the video stream data and the audio stream data may be encapsulated separately or together, which is not particularly limited.

Fig. 1b is a schematic diagram of a packet structure according to an embodiment of the present disclosure, where, as shown in fig. 1b, an RTP packet includes a header (RTP header) and a body, media stream data is taken as the body of the RTP packet (i.e. RTP data stream), and the RTP packet is taken as the body of the UDP packet, and is encapsulated into the UDP packet according to the RTP packet and the UDP header.

For example, after the RTP packet is generated, the RTP packet is transmitted to the vehicle through the RTP session, so that the vehicle may obtain the media stream data therein by parsing the RTP packet after receiving the RTP packet (the media stream data obtained after parsing may be the same as or different from the media stream data to be transmitted, and is herein denoted as first media stream data for convenience of distinction), and play the first media stream data by using the vehicle-mounted component, which may include, for example, a vehicle-mounted display screen or a vehicle-mounted audio.

According to the technical scheme provided by the embodiment of the disclosure, the mobile terminal can generate the RTP data packet according to the media stream data to be transmitted, and the RTP data is sent to the vehicle based on the RTP session, so that the vehicle can obtain the corresponding media stream data by analyzing the RTP data packet and play the corresponding media stream data by utilizing the vehicle-mounted component.

When the mobile terminal and the vehicle perform media stream transmission, the mobile terminal and the vehicle can be divided into different transmission scenes according to different data types in the media stream or different association relations between different data, and the emphasis of transmission requirements may be different in the different transmission scenes. Some scenes may be more focused on the fluency of the data stream playback; while some scenarios may be more focused on the reliability of data streaming, it is desirable to ensure the correctness and sequence of each frame of data. In the embodiment of the disclosure, the transmission condition required to be transmitted by using the RTP session may be preset and recorded as a preset transmission condition, and further, the RTP session may be used for transmission when the preset transmission condition is satisfied.

In an alternative embodiment, the generating RTP packets according to the media stream data to be transmitted includes: and generating RTP data packets according to the video stream data in the media stream data to be transmitted under the condition that the media stream data to be transmitted meets the preset transmission condition. Wherein the preset transmission condition includes at least one of: the media stream data to be transmitted only comprises video stream data; the association degree between the video stream data and the audio stream data contained in the media stream data to be transmitted is lower than a preset association degree. The advantage of this arrangement is that the RTP session is used for transmission in a proper transmission scenario, so that timeliness of data transmission is ensured.

For example, if the media stream data to be transmitted only includes video stream data and does not include audio stream data, the video stream data is not related to other data and is independently played, for example, a navigation video stream in a navigation application can allow packet loss, and timeliness is preferentially ensured; if the video stream data and the audio stream data are simultaneously transmitted in the media stream data to be transmitted, but the association degree between the video stream data and the audio stream data is lower than the preset association degree, namely the tightness degree is lower, for example, the navigation video stream and the navigation voice stream in navigation application can allow packet loss, and the timeliness is preferentially ensured; if the association degree of the video stream data and the audio stream data included in the media stream data to be transmitted is higher than or equal to the preset association degree, that is, the tightness degree is higher, for example, a movie picture and a character dialogue in a movie, if a packet loss occurs, the viewing experience is poor, and the reliability needs to be ensured, so that the preset transmission condition is considered not to be met, that is, the RTP data packet is not generated.

Optionally, the association degree between the video stream data and the audio stream data included in the media stream data to be transmitted is lower than a preset association degree, including: the video stream data and the audio stream data contained in the media stream data to be transmitted come from non-video player application programs. The advantage of this arrangement is that it is possible to quickly determine whether the preset transmission condition is met. The content played in the video player application program is usually high in tightness of pictures and sounds, such as movies, live video, short-view video works, and the like, so that if video stream data and audio stream data in media stream data to be transmitted are from the same video player application program, the preset transmission condition can be considered not to be met, and if the content is from a non-video player application program, such as a navigation application program, the preset transmission condition can be considered to be met.

Fig. 2 is a flowchart of another data transmission method according to an embodiment of the present disclosure, where an alternative scheme is provided on the basis of the foregoing alternative embodiments, and in the case where it is determined that media stream data to be transmitted does not meet a preset transmission condition, transmission is performed by adopting a TCP mode. Referring to fig. 2, the method includes:

s201, obtaining media stream data to be transmitted.

For example, the main data channel may be created after the mobile terminal and the vehicle successfully establish a wireless connection, and the connection of the main data channel may be maintained.

S202, determining whether media stream data to be transmitted meets preset transmission conditions, if so, executing S203; otherwise, S205 is performed.

S203, generating RTP data packets according to video stream data in the media stream data to be transmitted.

For example, after determining that the media stream data to be transmitted satisfies the preset transmission condition, the RTP session may be established according to the IP address and the port number transmitted by the main data channel. If the RTP session exists at this time, the operation of generating RTP data packets can be directly performed.

S204, sending RTP data packets to the vehicle based on the RTP session to instruct the vehicle to obtain corresponding first media stream data by analyzing the RTP data packets, and playing the first media stream data by utilizing the vehicle-mounted component.

Optionally, generating a second TCP packet according to the audio stream data in the media stream data to be transmitted under the condition that the association degree between the video stream data and the audio stream data included in the media stream data to be transmitted is determined to be lower than the preset association degree; and sending a second TCP data packet to the vehicle based on the main data channel so as to instruct the vehicle to obtain corresponding audio stream data by analyzing the second TCP data packet, and playing the obtained audio stream data by utilizing the vehicle-mounted component. The advantage of setting up like this is that the data volume of audio stream data is less, can adopt different channels to transmit video stream data and audio stream data separately, guarantees audio transmission's reliability.

S205, generating a first TCP data packet according to the media stream data to be transmitted.

Optionally, the RTP session is destroyed if it is determined that the media stream data to be transmitted does not satisfy the preset transmission condition. The advantage of this arrangement is that when it is determined that the RTP session is not required to be used for data transmission, the RTP session is destroyed in time, corresponding resources are released, and the resource utilization rate is improved.

S206, sending the first TCP data packet to the vehicle based on the main data channel so as to instruct the vehicle to obtain corresponding second media stream data by analyzing the first TCP data packet, and playing the second media stream data by utilizing the vehicle-mounted component.

For example, if the media stream data to be transmitted does not meet the preset transmission condition, the transmission can be performed in a TCP mode, so that the accuracy and the sequence of data transmission are ensured.

According to the technical scheme provided by the embodiment of the disclosure, whether the transmission of the media stream data to be transmitted adopts an RTP mode or a TCP mode is determined according to whether the video stream data is contained in the media stream data to be transmitted or not and the association degree between the contained video stream data and the contained audio stream data, so that different transmission requirements under different transmission scenes are met, and the experience of a user for watching or listening to the media stream is improved.

In the embodiment of the disclosure, when the RTP session is adopted for media streaming, there may be a packet loss situation, and the Real-time transmission control protocol (Real-time Transport Control Protocol, RTCP) session may be utilized to send the RTCP control packet, so that the vehicle side may timely acquire packet loss information or network quality information. In an alternative embodiment, the method further comprises: generating an RTCP control packet, wherein the RTCP control packet comprises the sending condition information of the RTP data packet; and sending the RTCP control packet to the vehicle based on an RTCP session so as to instruct the vehicle to obtain the sending condition information by analyzing the RTCP control packet, and determining packet loss information and/or network quality information according to the sending condition information.

The sending condition information may include a sequence number of the RTP data packet, a sent number of the RTP data packet, and the like; the packet loss information may include a sequence number of an RTP packet which is not successfully received, a packet loss rate, and the like; the network quality information may be used to represent network quality of the RTP channel, and may be determined according to a packet loss rate of the RTP packet, for example, when the packet loss rate is high, it may be determined that the network quality is poor.

In an alternative embodiment, the RTCP session is established based on a main data path, which is established based on TCP; the method further comprises the steps of: receiving a data packet retransmission instruction sent by the vehicle based on the main data channel and/or the RTCP session; and carrying out retransmission operation on the target RTP data packet indicated by the data packet retransmission instruction. The advantage of this arrangement is that the target RTP data to be retransmitted can be selected according to the indication of the vehicle and retransmitted, so that the integrity of the data transmission is improved to a certain extent.

The target RTP packet may include all the RTP packets that are not successfully received, or may include some RTP packets that are not successfully received. In the case of the inclusion, the selection may be made according to the importance of the lost RTP packet, so that some unnecessary retransmission operations may be avoided.

In an alternative embodiment, the packet retransmission instruction is generated by the vehicle according to packet loss information. The packet loss information may include a video frame type corresponding to the lost data packet. For example, in encoding video data, in order to reduce the amount of data, it is possible to encode into different types of video frames, such as a key frame (I frame), a forward predictive encoded frame (P frame), and a bi-predictive encoded frame (B frame), the three types of importance being sequentially reduced. Retransmission can be performed for the packet loss with higher importance, namely, the packet loss is determined to be a target RTP data packet, such as an I frame, and a P frame can be included; packet loss with lower importance can be ignored, retransmission is not performed, such as B frames, and P frames can be included.

In an alternative embodiment, the data packet retransmission instruction is determined by the vehicle according to packet loss information and current value and/or network quality information of a preset vehicle performance index, wherein the preset vehicle performance index is related to data processing capability of the vehicle. The advantage of this arrangement is that the RTP data packets that need to be retransmitted can be flexibly and accurately determined according to the actual situation by combining the network quality information and/or the preset vehicle performance index.

The preset vehicle performance index may include, for example, an index such as an idle rate or an idle rate of a processor, such as a central processing unit (Central Processing Unit, CPU), and may be calculated according to an occupancy rate or a load rate.

Optionally, when the vehicle determines that the current value of the preset vehicle performance index is lower than the first preset performance threshold, and/or determines that the current network quality is lower than the first preset quality threshold according to the network quality information, determining an unsuccessfully received RTP data packet to which the video frame data of the target video frame type belongs as the target RTP data packet according to the packet loss information, so as to generate a data packet retransmission instruction, wherein the target video frame type comprises a key frame. Therefore, the mobile terminal can retransmit the key frames in a targeted manner under the instruction of the vehicle, the reliability of key frame transmission is guaranteed preferentially, and the pressure of the vehicle end can be relieved.

Specifically, in the first case, when the vehicle determines that the current network quality is lower than the first preset quality threshold according to the network quality information, determining, as a target RTP data packet, an RTP data packet which is not successfully received and belongs to the video frame data of the target video frame type according to the packet loss information, so as to generate a data packet retransmission instruction, for example, the packet loss rate is greater than the preset packet loss rate threshold, which indicates that the network quality is poor, and can preferentially ensure reliable transmission of the key frame; or in the second case, under the condition that the current value of the preset vehicle performance index is determined to be lower than the first preset performance threshold, determining the RTP data packet which is not successfully received and belongs to the video frame data of the target video frame type as the target RTP data packet according to the packet loss information, so as to generate a data packet retransmission instruction, for example, the CPU idle rate is lower than the preset idle rate threshold, or the CPU load rate is higher than the preset load rate threshold, and the like, which indicates that the vehicle has fewer resources currently used for processing media stream transmission, and can preferentially ensure the reliable transmission of the key frames; or in the third case, under the condition that the current network quality is determined to be lower than a first preset quality threshold according to the network quality information and the current value of the preset vehicle performance index is determined to be lower than the first preset performance threshold, determining an unsuccessfully received RTP data packet to which the video frame data of the target video frame type belongs as a target RTP data packet according to the packet loss information so as to generate a data packet retransmission instruction.

Wherein the target video frame type includes a key frame and may further include a forward predictive encoded frame. Alternatively, the target video frame type may be different for the three different cases described above. For example, in the first case and the second case, the target video frame type includes I frames and P frames, i.e., does not include B frames; in the third case, the target video frame type includes I frames, i.e., does not include P frames and B frames.

Optionally, when determining that the current value of the preset vehicle performance index is higher than the first preset performance threshold, or determining that the current network quality is higher than the first preset quality threshold according to the network quality information, or meeting the two conditions simultaneously, determining whether video frame data corresponding to the unsuccessfully received RTP data packet is of a target video frame type according to the packet loss information, if so, determining the video frame data as the target RTP data packet to generate a data packet retransmission instruction, and if not, not generating the data packet retransmission instruction.

Fig. 3 is a flowchart of another data transmission method according to an embodiment of the present disclosure, where an alternative scheme is provided based on the foregoing alternative embodiments, and a mobile terminal may perform RTP transmission on video frame data of a target video frame type in a targeted manner according to a packet transmission instruction sent by a vehicle. Referring to fig. 3, the method includes:

S301, obtaining media stream data to be transmitted.

S302, under the condition that the media stream data to be transmitted meets the preset transmission condition, generating RTP data packets according to the video stream data in the media stream data to be transmitted.

And S303, sending RTP data packets to the vehicle based on the RTP session to instruct the vehicle to obtain corresponding first media stream data by analyzing the RTP data packets, and playing the first media stream data by utilizing the vehicle-mounted component.

S304, generating a real-time transmission control protocol RTCP control packet, wherein the RTCP control packet comprises the sending condition information of the RTP data packet.

S305, sending an RTCP control packet to the vehicle based on the RTCP session to instruct the vehicle to obtain sending condition information by analyzing the RTCP control packet, and determining packet loss information and/or network quality information according to the sending condition information.

S306, receiving a data packet retransmission instruction sent by the vehicle based on the main data channel and/or the RTCP session.

The data packet retransmission instruction is generated by the vehicle according to the packet loss information and the current value and/or network quality information of the preset vehicle performance index.

S307, the retransmission operation is carried out on the target RTP data packet indicated by the data packet retransmission instruction.

S308, receiving a data packet transmission instruction sent by the vehicle based on the main data channel and/or the RTCP session.

The data packet transmission instruction is generated by the vehicle according to the current value and/or network quality information of a preset vehicle performance index, the data packet transmission instruction is used for indicating a target video frame type, and the preset vehicle performance index is related to the data processing capacity of the vehicle.

For example, in the process of transmitting media stream data based on the RTP session, the network quality or the preset vehicle performance index may change dynamically, and the vehicle may indicate the type of video frame transmitted by the mobile terminal according to the current actual situation.

Optionally, the vehicle generates a data packet transmission instruction when determining that the current value of the preset vehicle performance index is lower than a second preset performance threshold value, and/or determining that the current network quality is lower than the second preset quality threshold value according to the network quality information, wherein the target video frame type indicated by the data packet transmission instruction comprises a key frame. Therefore, the mobile terminal can transmit the key frames under the indication of the vehicle, so that the occupation of the transmission channel of the non-key frames is reduced, the probability of successful transmission of the key frames is improved, and the pressure of the vehicle end is relieved.

For example, the target video frame type does not include a non-key frame, so that the occupation of a transmission channel by the non-key frame is reduced, and the probability of successful key frame transmission is improved. Optionally, the target video frame type may also include a P-frame in the case where the network quality is not below a preset minimum quality threshold and/or the current value of the preset vehicle performance index is not below a preset minimum performance threshold.

S309, generating a new RTP data packet according to the video frame data which accords with the target video frame type in the newly acquired media stream data to be transmitted.

It should be noted that, the newly acquired media stream data to be transmitted is used for distinguishing from the media stream data to be transmitted acquired in S301, and the acquisition time sequence of the two is not limited; the new RTP packet is used to distinguish from the RTP packet in S302, and the generation timing of both is not limited. If the data packet transmission instruction is generated by the vehicle according to the current value of the preset vehicle performance index, that is, if the generation of the data packet transmission instruction does not depend on the network quality information, the data packet transmission instruction sent by the vehicle may also be received before S302, and the RTP data packet may be generated according to the video frame data conforming to the target video frame type in the media stream data to be transmitted acquired in S301.

And S310, transmitting a new RTP data packet to the vehicle based on the RTP session to instruct the vehicle to obtain corresponding third media stream data by analyzing the new RTP data packet, and playing the third media stream data by utilizing the vehicle-mounted component.

The third media stream data obtained by parsing may include only the I frame or the I frame and the P frame after the vehicle receives the new RTP packet, which may improve the success rate of key frame transmission by discarding all or part of the transmission modes of the non-key frames, and may also alleviate the load and the like at the vehicle end.

According to the technical scheme provided by the embodiment of the disclosure, in the process of transmitting media stream data to the vehicle by adopting an RTP mode, the mobile terminal transmits an RTCP control packet through an RTCP session, so that the vehicle can timely and accurately acquire packet loss information and/or network quality information according to the transmission condition information of the RTP data packet obtained by analysis, further generate a data packet retransmission instruction according to the packet loss information and the current value of the preset vehicle performance index and/or the network quality information, and after receiving the data packet retransmission instruction, the mobile terminal can pertinently retransmit the packet loss, in addition, the mobile terminal can also receive the current value of the preset vehicle performance index and/or the network quality information to generate the data packet transmission instruction, selectively generate the RTP data packet according to the instruction to transmit the video frame in the video stream data, so that the occupation of a transmission channel of a non-key frame is reduced, the probability of successful transmission of the key frame is improved, and the pressure of the vehicle end is relieved.

Fig. 4 is a flowchart of still another data transmission method according to an embodiment of the present disclosure, which is applicable to a case of data transmission between a mobile terminal and a vehicle. The method can be executed by a data transmission device, the device can be realized in a hardware and/or software mode, and the device can be configured in a vehicle, and particularly can be configured in a vehicle machine. Referring to fig. 4, the method specifically includes the following:

S401, receiving an RTP data packet sent by a mobile terminal based on a real-time transmission protocol RTP session, wherein the mobile terminal generates the RTP data packet according to acquired media stream data to be transmitted, the media stream data to be transmitted comprises video stream data and/or audio stream data, and the RTP session is realized based on a user datagram protocol mode;

s402, obtaining corresponding first media stream data by analyzing the RTP data packet;

s403, playing the first media stream data by utilizing the vehicle-mounted component.

According to the technical scheme provided by the embodiment of the disclosure, the vehicle can receive the RTP data packet generated according to the media stream data to be transmitted and sent by the mobile terminal based on the RTP session, the corresponding media stream data is obtained by analyzing the RTP data packet and played by utilizing the vehicle-mounted component, and because the RTP session is realized based on the UDP mode, the data packet can be transmitted at any time, the correctness and the sequence of the data packet are not required to be ensured, the relevance between the data packets is not required to be processed, the performance cost of the mobile terminal and the vehicle can be reduced, in addition, the flow control or congestion control is not required to be provided, the occurrence of data blocking is avoided, the data transmission efficiency is further improved, the real-time performance of the data transmission is ensured, and the fluency of the vehicle can be ensured when the media data is played.

In an optional implementation manner, the mobile terminal generates the RTP data packet according to the video stream data in the media stream data to be transmitted under the condition that the media stream data to be transmitted meets the preset transmission condition. Wherein the preset transmission condition includes at least one of: the media stream data to be transmitted only comprises video stream data; the association degree between the video stream data and the audio stream data contained in the media stream data to be transmitted is lower than a preset association degree. The advantage of this arrangement is that the RTP session is used for transmission in a proper transmission scenario, so that timeliness of data transmission is ensured.

In an optional implementation manner, the association degree between the video stream data and the audio stream data included in the media stream data to be transmitted is lower than a preset association degree, which includes: the video stream data and the audio stream data contained in the media stream data to be transmitted come from non-video player application programs. The advantage of this arrangement is that it is possible to quickly determine whether the preset transmission condition is met.

In an alternative embodiment, the RTP session is established based on a main data channel established based on the transmission control protocol TCP. Wherein the method further comprises: receiving a first TCP data packet sent by the mobile terminal based on the main data channel, wherein the first TCP data packet is generated by the mobile terminal according to the media stream data to be transmitted under the condition that the media stream data to be transmitted does not meet the preset transmission condition; obtaining corresponding second media stream data by analyzing the first TCP data packet; and playing the second media stream data by using the vehicle-mounted component. The transmission method has the advantages that when the transmission condition of the RTP mode is not met, the TCP mode is adopted for transmission, timely and reliable transmission of media stream data is guaranteed, different transmission requirements under different transmission scenes are met, and the experience of watching or listening to the media stream by a user is improved.

In an alternative embodiment, the method further comprises: and destroying the RTP session under the condition that the media stream data to be transmitted does not meet the preset transmission condition. The advantage of this arrangement is that when it is determined that the RTP session is not required to be used for data transmission, the RTP session is destroyed in time, corresponding resources are released, and the resource utilization rate is improved.

In an alternative embodiment, the RTP session is established based on a primary data channel established based on TCP; the method further comprises the steps of: receiving a second TCP data packet sent by the mobile terminal based on the main data channel, wherein the second TCP data packet is generated by the mobile terminal according to the audio stream data in the media stream data to be transmitted under the condition that the association degree between the video stream data and the audio stream data contained in the media stream data to be transmitted is lower than the preset association degree; obtaining corresponding audio stream data by analyzing the second TCP data packet; and playing the obtained audio stream data by utilizing the vehicle-mounted component. The advantage of setting up like this is that the data volume of audio stream data is less, can adopt different channels to transmit video stream data and audio stream data separately, guarantees audio transmission's reliability.

In an alternative embodiment, the method further comprises: receiving an RTCP control packet of a real-time transmission control protocol sent by the mobile terminal based on an RTCP session, wherein the RTCP control packet comprises sending condition information of the RTP data packet; obtaining the sending condition information by analyzing the RTCP control packet; and determining packet loss information and/or network quality information according to the sending condition information. The advantage of this arrangement is that when the RTP session is used for media streaming, there may be a packet loss situation, and the RTCP session may be used to send the RTCP control packet, so that the vehicle side may timely learn about the packet loss information or the network quality information.

In an alternative embodiment, the RTCP session is established based on a main data path, which is established based on TCP; the method further comprises the steps of: and based on the main data channel and/or the data packet retransmission instruction sent by the RTCP session to the mobile terminal, indicating the mobile terminal to carry out retransmission operation on the target RTP data packet indicated by the data packet retransmission instruction. The advantage of this arrangement is that the target RTP data to be retransmitted can be selected according to the indication of the vehicle and retransmitted, so that the integrity of the data transmission is improved to a certain extent.

In an alternative embodiment, the method further comprises: and generating the data packet retransmission instruction according to at least one of packet loss information and the current value and/or network quality information of a preset vehicle performance index, wherein the preset vehicle performance index is related to the data processing capacity of the vehicle. The advantage of this arrangement is that the RTP data packets that need to be retransmitted can be flexibly and accurately determined according to the actual situation by combining the network quality information and/or the preset vehicle performance index.

In an optional implementation manner, the generating the packet retransmission instruction according to the packet loss information and the current value of the preset vehicle performance index and/or the network quality information includes: and determining an unsuccessfully received RTP data packet to which the video frame data of the target video frame type belongs as a target RTP data packet according to the packet loss information under the condition that the current value of the preset vehicle performance index is determined to be lower than a first preset performance threshold value and/or the current network quality is determined to be lower than the first preset quality threshold value according to the network quality information, so as to generate a data packet retransmission instruction, wherein the target video frame type comprises a key frame. The advantage of this arrangement is that the type of video frame in the RTP data packet indicating that the mobile terminal needs to retransmit is determined reasonably, the reliability of key frame transmission is guaranteed preferentially, and the pressure of the vehicle end can be relieved.

In an alternative embodiment, the RTCP session is established based on a main data path, which is established based on TCP. The method further comprises the steps of: generating a data packet transmission instruction according to the current value and/or network quality information of a preset vehicle performance index, wherein the data packet transmission instruction is used for indicating a target video frame type, and the preset vehicle performance index is related to the data processing capacity of the vehicle; based on the main data channel and/or the RTCP session, sending the data packet transmission instruction to the mobile terminal so as to instruct the mobile terminal to generate a new RTP data packet according to video frame data conforming to the target video frame type in newly acquired media stream data to be transmitted, and returning the new RTP data packet based on the RTP session; obtaining corresponding third media stream data by analyzing the new RTP data packet; and playing the third media stream data by utilizing the vehicle-mounted component. The advantage of this arrangement is that the vehicle indicates the type of video frame that the mobile terminal needs to transmit by adopting the RTP mode according to the network condition or the own performance condition, which is beneficial to reducing the occupation of the transmission channel for transmitting video frame data outside the target video frame type, improving the probability of successful transmission of the video frame of the target video frame type and relieving the pressure of the vehicle end.

In an optional implementation manner, the generating a data packet transmission instruction according to the current value of the preset vehicle performance index and/or the network quality information includes: and generating a data packet transmission instruction under the condition that the current value of the preset vehicle performance index is determined to be lower than a second preset performance threshold value, and/or determining that the current network quality is lower than the second preset quality threshold value according to the network quality information, wherein the target video frame type indicated by the data packet transmission instruction comprises a key frame. The method has the advantages that the type of the video frame which indicates the mobile terminal to transmit in the RTP mode is reasonably determined, occupation of a transmission channel by a non-key frame is reduced, probability of successful key frame transmission is improved, and pressure of a vehicle end is relieved.

Fig. 5 is an interaction schematic diagram of a data transmission method according to an embodiment of the disclosure. As shown in fig. 5, the vehicle and the mobile terminal first establish a main data channel, transmit an IP address and a port number on the main data channel to establish an RTP session and an RTCP session, and after obtaining media stream data to be transmitted, the mobile terminal determines whether the media stream data to be transmitted meets a preset transmission condition, if yes, adopts an RTP mode for transmission, and if not, adopts the main data channel for transmission. When the RTP mode is adopted for transmission, the media stream data are encapsulated into RTP data packets, RTCP control packets are generated, the RTP data packets are transmitted through the RTP channels, and the RTCP control packets are transmitted through the RTCP channels. After the vehicle receives the RTP data packet, the vehicle analyzes the RTP data packet to obtain corresponding media stream data, and renders and displays the corresponding media stream data on a vehicle-mounted display screen. When the vehicle determines that the packet loss exists according to the RTCP control packet, when the current need of retransmitting the key frame is determined according to the packet loss information, the CPU occupancy rate, the packet loss rate and the like, whether the RTP data packet which is not successfully received corresponds to the key frame is judged, if so, a data packet retransmission instruction is generated, and the mobile terminal is instructed to retransmit the key frame which is lost. When the vehicle determines that the transmission of the non-key frame needs to be abandoned according to the CPU occupancy rate, the packet loss rate and the like, a data packet transmission instruction can be sent to the mobile terminal to instruct the mobile terminal to transmit the RTP data packet which does not contain the non-key frame.

In the technical scheme of the disclosure, the related media stream data, user personal information and the like are collected, stored, used, processed, transmitted, provided, disclosed and the like, all conform to the regulations of related laws and regulations, and do not violate the popular regulations.

Fig. 6 is a schematic structural diagram of a data transmission device according to an embodiment of the present disclosure, which is applicable to a case of data transmission between a mobile terminal and a vehicle. The device can be realized in a hardware and/or software mode, can be configured in a mobile terminal, and can realize the data transmission method according to the corresponding embodiment of the disclosure. As shown in fig. 6, the data transmission apparatus 600 includes:

a data to be transmitted acquisition module 601, configured to acquire media stream data to be transmitted, where the media stream data to be transmitted includes video stream data and/or audio stream data;

a first data packet generating module 602, configured to generate a real-time transport protocol RTP data packet according to the media stream data to be transmitted;

the first data packet sending module 603 is configured to send the RTP data packet to a vehicle based on an RTP session, so as to instruct the vehicle to obtain corresponding first media stream data by parsing the RTP data packet, and play the first media stream data by using a vehicle-mounted component, where the RTP session is implemented based on a user datagram protocol mode.

In an alternative embodiment, the first data packet generating module is specifically configured to:

generating an RTP data packet according to video stream data in the media stream data to be transmitted under the condition that the media stream data to be transmitted meets the preset transmission condition;

wherein the preset transmission condition includes at least one of:

The media stream data to be transmitted only comprises video stream data;

the association degree between the video stream data and the audio stream data contained in the media stream data to be transmitted is lower than a preset association degree.

In an optional implementation manner, the association degree between the video stream data and the audio stream data included in the media stream data to be transmitted is lower than a preset association degree, which includes:

the video stream data and the audio stream data contained in the media stream data to be transmitted come from non-video player application programs.

In an alternative embodiment, the RTP session is established based on a primary data channel established based on a transmission control protocol TCP;

wherein the apparatus further comprises:

the second data packet generating module is used for generating a first TCP data packet according to the media stream data to be transmitted under the condition that the media stream data to be transmitted does not meet the preset transmission condition;

and the second data packet sending module is used for sending the first TCP data packet to the vehicle based on the main data channel so as to instruct the vehicle to obtain corresponding second media stream data by analyzing the first TCP data packet, and playing the second media stream data by utilizing a vehicle-mounted component.

In an alternative embodiment, the method further comprises:

and the first session destroying module is used for destroying the RTP session under the condition that the media stream data to be transmitted does not meet the preset transmission condition.

In an alternative embodiment, the RTP session is established based on a primary data channel established based on TCP;

the apparatus further comprises:

a third data packet generating module, configured to generate a second TCP data packet according to the audio stream data in the media stream data to be transmitted, when it is determined that the association degree between the video stream data and the audio stream data included in the media stream data to be transmitted is lower than a preset association degree;

and the third data packet sending module is used for sending the second TCP data packet to the vehicle based on the main data channel so as to instruct the vehicle to obtain corresponding audio stream data by analyzing the second TCP data packet, and playing the obtained audio stream data by utilizing the vehicle-mounted component.

In an alternative embodiment, the method further comprises:

a control packet generation module, configured to generate a real-time transport control protocol RTCP control packet, where the RTCP control packet includes transmission condition information of the RTP data packet;

And the control packet sending module is used for sending the RTCP control packet to the vehicle based on an RTCP session so as to instruct the vehicle to obtain the sending condition information by analyzing the RTCP control packet, and determining packet loss information and/or network quality information according to the sending condition information.

In an alternative embodiment, the RTCP session is established based on a main data path, which is established based on TCP;

the apparatus further comprises:

the retransmission instruction receiving module is used for receiving a data packet retransmission instruction sent by the vehicle based on the main data channel and/or the RTCP session;

and the retransmission module is used for carrying out retransmission operation on the target RTP data packet indicated by the data packet retransmission instruction.

In an alternative embodiment, the data packet retransmission command is generated by the vehicle according to packet loss information and current value and/or network quality information of a preset vehicle performance index, wherein the preset vehicle performance index is related to the data processing capability of the vehicle.

the apparatus further comprises:

A transmission instruction receiving module, configured to receive a data packet transmission instruction sent by the vehicle based on the main data channel and/or the RTCP session, where the data packet transmission instruction is generated by the vehicle according to a current value and/or network quality information of a preset vehicle performance index, and the data packet transmission instruction is used to indicate a target video frame type, and the preset vehicle performance index is related to a data processing capability of the vehicle;

a fourth data packet generating module, configured to generate a new RTP data packet according to video frame data that accords with the target video frame type in the newly acquired media stream data to be transmitted;

and the fourth data packet sending module is used for sending the new RTP data packet to the vehicle based on the RTP session so as to instruct the vehicle to obtain corresponding third media stream data by analyzing the new RTP data packet, and playing the third media stream data by utilizing a vehicle-mounted component.

Fig. 7 is a schematic structural diagram of another data transmission device according to an embodiment of the present disclosure, which is applicable to a case of data transmission between a mobile terminal and a vehicle. The device can be realized in a hardware and/or software mode, can be configured in a vehicle, and can realize the data transmission method according to the corresponding embodiment of the disclosure. As shown in fig. 7, the data transmission apparatus 700 includes:

A first data packet receiving module 701, configured to receive an RTP data packet sent by a mobile terminal based on a real-time transport protocol RTP session, where the mobile terminal generates the RTP data packet according to acquired media stream data to be transmitted, where the media stream data to be transmitted includes video stream data and/or audio stream data, and the RTP session is implemented based on a user datagram protocol mode;

a first packet parsing module 702, configured to parse the RTP packet to obtain corresponding first media stream data;

a first playing module 703, configured to play the first media stream data by using an on-board component.

In an optional implementation manner, the mobile terminal generates the RTP data packet according to video stream data in the media stream data to be transmitted under the condition that the media stream data to be transmitted meets a preset transmission condition;

wherein the preset transmission condition includes at least one of:

the media stream data to be transmitted only comprises video stream data;

wherein the apparatus further comprises:

the second data packet receiving module is used for receiving a first TCP data packet sent by the mobile terminal based on the main data channel, wherein the first TCP data packet is generated according to the media stream data to be transmitted under the condition that the media stream data to be transmitted does not meet the preset transmission condition;

The second data packet analyzing module is used for obtaining corresponding second media stream data by analyzing the first TCP data packet;

and the second playing module is used for playing the second media stream data by utilizing the vehicle-mounted component.

In an alternative embodiment, the method further comprises:

and the second session destroying module is used for destroying the RTP session under the condition that the media stream data to be transmitted does not meet the preset transmission condition.

the apparatus further comprises:

a third data packet receiving module, configured to receive, based on the main data channel, a second TCP data packet sent by the mobile terminal, where the second TCP data packet is generated by the mobile terminal according to the audio stream data in the media stream data to be transmitted when determining that the association degree between the video stream data and the audio stream data included in the media stream data to be transmitted is lower than a preset association degree;

the third data packet analysis module is used for obtaining corresponding audio stream data by analyzing the second TCP data packet;

and the third playing module is used for playing the obtained audio stream data by utilizing the vehicle-mounted component.

In an alternative embodiment, the method further comprises:

a control packet receiving module, configured to receive an RTCP control packet of a real-time transport control protocol sent by the mobile terminal based on an RTCP session, where the RTCP control packet includes sending condition information of the RTP data packet;

the control packet analysis module is used for obtaining the sending condition information by analyzing the RTCP control packet;

and the information determining module is used for determining packet loss information and/or network quality information according to the sending condition information.

the apparatus further comprises:

and the retransmission instruction sending module is used for sending a data packet retransmission instruction to the mobile terminal based on the main data channel and/or the RTCP session so as to instruct the mobile terminal to carry out retransmission operation on the target RTP data packet indicated by the data packet retransmission instruction.

In an alternative embodiment, the method further comprises:

and the retransmission instruction generation module is used for generating the data packet retransmission instruction according to at least one of packet loss information and the current value and/or network quality information of a preset vehicle performance index, wherein the preset vehicle performance index is related to the data processing capacity of the vehicle.

In an alternative embodiment, the retransmission instruction generation module is specifically configured to:

determining an unsuccessfully received RTP data packet to which video frame data of a target video frame type belongs as a target RTP data packet according to packet loss information under the condition that the current value of a preset vehicle performance index is determined to be lower than a first preset performance threshold value and/or the current network quality is determined to be lower than the first preset quality threshold value according to network quality information, so as to generate a data packet retransmission instruction; wherein the target video frame type comprises a key frame.

the apparatus further comprises:

the transmission instruction generation module is used for generating a data packet transmission instruction according to the current value of a preset vehicle performance index and/or network quality information, wherein the data packet transmission instruction is used for indicating a target video frame type, and the preset vehicle performance index is related to the data processing capacity of the vehicle;

a transmission instruction sending module, configured to send the packet transmission instruction to the mobile terminal based on the main data channel and/or the RTCP session, so as to instruct the mobile terminal to generate a new RTP packet according to video frame data that accords with the target video frame type in the newly acquired media stream data to be transmitted, and return the new RTP packet based on the RTP session;

A fourth data packet receiving module, configured to obtain corresponding third media stream data by parsing the new RTP data packet;

and the fourth playing module is used for playing the third media stream data by utilizing the vehicle-mounted component.

In an alternative embodiment, the transmission instruction generation module is specifically configured to:

and generating a data packet transmission instruction under the condition that the current value of the preset vehicle performance index is determined to be lower than a second preset performance threshold value, and/or determining that the current network quality is lower than the second preset quality threshold value according to the network quality information, wherein the target video frame type indicated by the data packet transmission instruction comprises a key frame.

According to embodiments of the present disclosure, the present disclosure also provides a mobile terminal, a vehicle, a readable storage medium and a computer program product.

Fig. 8 illustrates a schematic block diagram of an example mobile terminal 800 that may be used to implement embodiments of the present disclosure. Mobile terminals are intended to represent various forms of mobile devices, such as personal digital assistants, cellular telephones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 8, the mobile terminal 800 includes a computing unit 801 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM) 802 or a computer program loaded from a storage unit 808 into a Random Access Memory (RAM) 803. In the RAM 803, various programs and data required for the operation of the mobile terminal 800 can also be stored. The computing unit 801, the ROM 802, and the RAM 803 are connected to each other by a bus 804. An input/output (I/O) interface 805 is also connected to the bus 804.

Various components in the mobile terminal 800 are connected to the I/O interface 805, including: an input unit 806 such as a keyboard, mouse, etc.; an output unit 807 such as various types of displays, speakers, and the like; a storage unit 808, such as a magnetic disk, optical disk, etc.; and a communication unit 809, such as a network card, modem, wireless communication transceiver, or the like. The communication unit 809 allows the mobile terminal 800 to exchange information/data with other devices through a computer network such as the internet and/or various telecommunication networks.

The computing unit 801 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of computing unit 801 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 801 performs the respective methods and processes described above, such as a data transmission method. For example, in some embodiments, the data transmission method may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as the storage unit 808. In some embodiments, part or all of the computer program may be loaded and/or installed onto the mobile terminal 800 via the ROM 802 and/or the communication unit 809. When a computer program is loaded into RAM 803 and executed by computing unit 801, one or more steps of the data transfer method described above may be performed. Alternatively, in other embodiments, the computing unit 801 may be configured to perform the data transfer method by any other suitable means (e.g., by means of firmware).

Various implementations of the systems and techniques described here above can be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), complex Programmable Logic Devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.

Fig. 9 is a block diagram of a vehicle for implementing a data transmission method of an embodiment of the present disclosure, the vehicle 900, comprising: a processor 901, and a memory 902 communicatively connected to the processor 901, wherein the memory 902 stores a computer program executable by the processor 901, the computer program being executed by the processor 901 to enable the processor 901 to perform the data transmission method in the embodiments of the present disclosure. The number of processors may be one or more, and one processor is exemplified in fig. 9.

Program code for carrying out methods of the present disclosure may be written in any combination of one or more programming languages. These program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus such that the program code, when executed by the processor or controller, causes the functions/operations specified in the flowchart and/or block diagram to be implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.

It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps recited in the present disclosure may be performed in parallel, sequentially, or in a different order, provided that the desired results of the technical solutions provided by the present disclosure are achieved, and are not limited herein.

The above detailed description should not be taken as limiting the scope of the present disclosure. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present disclosure are intended to be included within the scope of the present disclosure.

Claims

1. A data transmission method, comprising:

acquiring media stream data to be transmitted, wherein the media stream data to be transmitted comprises video stream data and audio stream data;

sending the RTP data packet to a vehicle based on an RTP session to instruct the vehicle to obtain corresponding first media stream data by analyzing the RTP data packet, and playing the first media stream data by utilizing a vehicle-mounted component, wherein the RTP session is realized based on a user datagram protocol mode;

wherein, the generating an RTP data packet according to the media stream data to be transmitted includes:

wherein, the preset transmission conditions include: the association degree between the video stream data and the audio stream data contained in the media stream data to be transmitted is lower than a preset association degree.

2. The method of claim 1, wherein the association degree between the video stream data and the audio stream data included in the media stream data to be transmitted is lower than a preset association degree, comprising:

3. The method of claim 1, wherein the RTP session is established based on a primary data channel established based on a transmission control protocol, TCP;

wherein the method further comprises:

generating a first TCP data packet according to the media stream data to be transmitted under the condition that the media stream data to be transmitted does not meet the preset transmission condition;

and sending the first TCP data packet to the vehicle based on the main data channel so as to instruct the vehicle to obtain corresponding second media stream data by analyzing the first TCP data packet, and playing the second media stream data by utilizing a vehicle-mounted component.

4. A method according to claim 3, further comprising:

and destroying the RTP session under the condition that the media stream data to be transmitted does not meet the preset transmission condition.

5. The method of claim 1, wherein the RTP session is established based on a primary data channel established based on TCP;

the method further comprises the steps of:

generating a second TCP data packet according to the audio stream data in the media stream data to be transmitted under the condition that the association degree between the video stream data and the audio stream data contained in the media stream data to be transmitted is lower than the preset association degree;

And sending the second TCP data packet to the vehicle based on the main data channel so as to instruct the vehicle to obtain corresponding audio stream data by analyzing the second TCP data packet, and playing the obtained audio stream data by utilizing a vehicle-mounted component.

6. The method of claim 1, further comprising:

generating a real-time transmission control protocol (RTCP) control packet, wherein the RTCP control packet comprises sending condition information of the RTP data packet;

and sending the RTCP control packet to the vehicle based on an RTCP session so as to instruct the vehicle to obtain the sending condition information by analyzing the RTCP control packet, and determining packet loss information and/or network quality information according to the sending condition information.

7. The method of claim 6, wherein the RTCP session is established based on a main data channel, the main data channel being established based on TCP;

the method further comprises the steps of:

receiving a data packet retransmission instruction sent by the vehicle based on the main data channel and/or the RTCP session;

and carrying out retransmission operation on the target RTP data packet indicated by the data packet retransmission instruction.

8. The method of claim 7, wherein the packet retransmission instructions are generated by the vehicle from packet loss information and current values of preset vehicle performance indicators related to data processing capabilities of the vehicle and/or network quality information.

9. The method of claim 6, wherein the RTCP session is established based on a main data channel, the main data channel being established based on TCP;

the method further comprises the steps of:

receiving a data packet transmission instruction sent by the vehicle based on the main data channel and/or the RTCP session, wherein the data packet transmission instruction is generated by the vehicle according to the current value and/or network quality information of a preset vehicle performance index, the data packet transmission instruction is used for indicating a target video frame type, and the preset vehicle performance index is related to the data processing capacity of the vehicle;

generating a new RTP data packet according to video frame data which accords with the target video frame type in the newly acquired media stream data to be transmitted;

and sending the new RTP data packet to the vehicle based on the RTP session so as to instruct the vehicle to obtain corresponding third media stream data by analyzing the new RTP data packet, and playing the third media stream data by utilizing a vehicle-mounted component.

10. A data transmission method, comprising:

based on a real-time transmission protocol RTP session, receiving an RTP data packet sent by a mobile terminal, wherein the mobile terminal generates the RTP data packet according to acquired media stream data to be transmitted, the media stream data to be transmitted comprises video stream data and audio stream data, and the RTP session is realized based on a user datagram protocol mode;

playing the first media stream data by using a vehicle-mounted component;

the mobile terminal generates the RTP data packet according to video stream data in the media stream data to be transmitted under the condition that the media stream data to be transmitted meets the preset transmission condition;

11. The method of claim 10, wherein the association degree between the video stream data and the audio stream data included in the media stream data to be transmitted is lower than a preset association degree, comprising:

12. The method of claim 10, wherein the RTP session is established based on a primary data channel established based on a transmission control protocol, TCP;

wherein the method further comprises:

receiving a first TCP data packet sent by the mobile terminal based on the main data channel, wherein the first TCP data packet is generated by the mobile terminal according to the media stream data to be transmitted under the condition that the media stream data to be transmitted does not meet the preset transmission condition;

Obtaining corresponding second media stream data by analyzing the first TCP data packet;

and playing the second media stream data by using the vehicle-mounted component.

13. The method of claim 12, further comprising:

14. The method of claim 10, wherein the RTP session is established based on a primary data channel established based on TCP;

the method further comprises the steps of:

receiving a second TCP data packet sent by the mobile terminal based on the main data channel, wherein the second TCP data packet is generated by the mobile terminal according to the audio stream data in the media stream data to be transmitted under the condition that the association degree between the video stream data and the audio stream data contained in the media stream data to be transmitted is lower than the preset association degree;

obtaining corresponding audio stream data by analyzing the second TCP data packet;

and playing the obtained audio stream data by utilizing the vehicle-mounted component.

15. The method of claim 10, further comprising:

receiving an RTCP control packet of a real-time transmission control protocol sent by the mobile terminal based on an RTCP session, wherein the RTCP control packet comprises sending condition information of the RTP data packet;

Obtaining the sending condition information by analyzing the RTCP control packet;

and determining packet loss information and/or network quality information according to the sending condition information.

16. The method of claim 15, wherein the RTCP session is established based on a main data channel, the main data channel being established based on TCP;

the method further comprises the steps of:

and based on the main data channel and/or the data packet retransmission instruction sent by the RTCP session to the mobile terminal, indicating the mobile terminal to carry out retransmission operation on the target RTP data packet indicated by the data packet retransmission instruction.

17. The method of claim 16, the method further comprising:

and generating the data packet retransmission instruction according to at least one of packet loss information and the current value and/or network quality information of a preset vehicle performance index, wherein the preset vehicle performance index is related to the data processing capacity of the vehicle.

18. The method of claim 17, wherein the generating the packet retransmission command according to the packet loss information and the current value of the preset vehicle performance index and/or the network quality information comprises:

19. The method of claim 15, wherein the RTCP session is established based on a main data channel, the main data channel being established based on TCP;

the method further comprises the steps of:

generating a data packet transmission instruction according to the current value and/or network quality information of a preset vehicle performance index, wherein the data packet transmission instruction is used for indicating a target video frame type, and the preset vehicle performance index is related to the data processing capacity of the vehicle;

based on the main data channel and/or the RTCP session, sending the data packet transmission instruction to the mobile terminal so as to instruct the mobile terminal to generate a new RTP data packet according to video frame data conforming to the target video frame type in newly acquired media stream data to be transmitted, and returning the new RTP data packet based on the RTP session;

obtaining corresponding third media stream data by analyzing the new RTP data packet;

and playing the third media stream data by utilizing the vehicle-mounted component.

20. The method of claim 19, wherein the generating the packet transmission command according to the current value of the preset vehicle performance indicator and/or the network quality information comprises:

21. A data transmission apparatus comprising:

the device comprises a data acquisition module to be transmitted, a data transmission module and a data transmission module, wherein the data acquisition module to be transmitted is used for acquiring media stream data to be transmitted, and the media stream data to be transmitted comprises video stream data and audio stream data;

the first data packet sending module is used for sending the RTP data packet to the vehicle based on an RTP session to instruct the vehicle to obtain corresponding first media stream data by analyzing the RTP data packet, and playing the first media stream data by utilizing a vehicle-mounted component, wherein the RTP session is realized based on a user datagram protocol mode;

the first data packet generating module is specifically configured to: generating an RTP data packet according to video stream data in the media stream data to be transmitted under the condition that the media stream data to be transmitted meets the preset transmission condition;

22. A data transmission apparatus comprising:

The mobile terminal generates an RTP data packet according to the acquired media stream data to be transmitted, wherein the media stream data to be transmitted comprises video stream data and audio stream data, and the RTP session is realized based on a user datagram protocol mode;

the first playing module is used for playing the first media stream data by utilizing the vehicle-mounted component;

23. A mobile terminal, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-9.

24. A vehicle, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 10-20.

25. A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of any one of claims 1-20.