CN114567802A - Data display method and device - Google Patents
Data display method and device Download PDFInfo
- Publication number
- CN114567802A CN114567802A CN202111649852.XA CN202111649852A CN114567802A CN 114567802 A CN114567802 A CN 114567802A CN 202111649852 A CN202111649852 A CN 202111649852A CN 114567802 A CN114567802 A CN 114567802A
- Authority
- CN
- China
- Prior art keywords
- key frame
- target
- video data
- display
- frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 238000004590 computer program Methods 0.000 claims description 11
- 238000004891 communication Methods 0.000 claims description 9
- 230000004044 response Effects 0.000 claims description 9
- 230000002441 reversible effect Effects 0.000 claims description 6
- 238000004458 analytical method Methods 0.000 claims description 5
- 238000003860 storage Methods 0.000 claims description 5
- 230000008569 process Effects 0.000 abstract description 13
- 238000010422 painting Methods 0.000 abstract description 10
- 230000005540 biological transmission Effects 0.000 abstract description 9
- 238000010586 diagram Methods 0.000 description 10
- 238000009826 distribution Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 6
- 230000006835 compression Effects 0.000 description 4
- 238000007906 compression Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 3
- 238000013500 data storage Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 238000005266 casting Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
- H04N21/41422—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance located in transportation means, e.g. personal vehicle
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The invention discloses a data display method and device, and relates to the technical field of vehicle central control systems. The method comprises the steps of obtaining target video data from a system cache after obtaining a display instruction, wherein the target video data comprise decoding information and target key frames, and analyzing the target key frames according to the decoding information and displaying the target key frames on a screen of the vehicle. And then acquiring the video data from the terminal, and analyzing the video data according to the decoding information so as to continuously display the corresponding video stream after the target key frame. Therefore, the problem that black painting appears on a display page of a vehicle screen due to unfixed timing of terminal transmission video stream when the terminal switches the painting back and forth to the vehicle screen in the mirror image screen projection process of the vehicle screen can be solved, user experience is improved, and system performance of the vehicle central control system is optimized.
Description
Technical Field
The invention relates to the technical field of vehicle central control systems, in particular to a data display method and device.
Background
When the screen of the vehicle is switched back and forth between the front and the back, the screen is displayed again by depending on the image transmission of the mobile phone terminal, but the mobile phone image display of the vehicle screen is delayed due to the fact that the mobile phone performance is different and the time for transmitting the image to the vehicle screen is not fixed, and therefore the black screen of the vehicle screen can display a period of time, and user experience is affected.
Disclosure of Invention
In view of the above, the present invention has been made to provide a data display method and apparatus that overcomes or at least partially solves the above problems.
According to a first aspect of the present invention, there is provided a data display method applied to a vehicle-mounted central control system, the method including:
acquiring a display instruction, and switching the screen projection state from a closed state to a display state according to the display instruction;
obtaining target video data from a system cache, wherein the target video data comprises: decoding information and a target key frame, wherein the target key frame is a last frame key frame acquired before state switching;
analyzing and displaying the target key frame according to the decoding information;
acquiring video data from the terminal;
and analyzing the video data according to the decoding information, and displaying a corresponding video stream after the target key frame.
According to a second aspect of the present invention, there is provided a data display device for use in an in-vehicle center control system, the device comprising:
the instruction acquisition module is used for acquiring a display instruction and switching the screen projection state from a closed state to a display state according to the display instruction;
a first data obtaining module, configured to obtain target video data from a system cache, where the target video data includes: decoding information and a target key frame, wherein the target key frame is a last frame key frame acquired before state switching;
the key frame analysis module is used for analyzing and displaying the target key frame according to the decoding information;
the second data acquisition module is used for acquiring video data from the terminal;
and the video stream analyzing module is used for analyzing the video data according to the decoding information and displaying the corresponding video stream behind the target key frame.
According to the scheme of the invention, after the display instruction is obtained, the target video data is obtained from the system cache, wherein the target video data comprises decoding information and a target key frame, and the target key frame is firstly analyzed according to the decoding information and displayed on the screen of the vehicle. And then acquiring the video data from the terminal, and analyzing the video data according to the decoding information so as to continuously display the corresponding video stream after the target key frame. Therefore, the problem that black painting appears on a display page of a vehicle screen due to unfixed timing of terminal transmission video stream when the terminal switches the painting back and forth to the vehicle screen in the mirror image screen projection process of the vehicle screen can be solved, user experience is improved, and system performance of the vehicle central control system is optimized.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings.
In the drawings:
FIG. 1 is a flow chart illustrating steps of a data display method according to an embodiment of the present invention;
fig. 2 is an architecture diagram of interconnection between a terminal and a vehicle machine according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating steps of a video data transmission according to an embodiment of the present invention;
FIG. 4 is a flow chart illustrating steps of another method for displaying data according to an embodiment of the present invention;
fig. 5 is a block diagram of a data display device according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the invention are shown in the drawings, it should be understood that the invention can be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.
Referring to fig. 1, a flowchart of steps of a data display method provided by an embodiment of the present invention is shown, and the method is applied to a vehicle central control system, which is installed in a vehicle and has a mobile phone interconnection screen-projection function. For example, the internet of mobile phones screen-projection function may include CarPlay, carpife, Android Auto, and the like. The method may include:
In the embodiment of the present invention, the screen-projecting state is used to represent whether the terminal interface is displayed on the screen of the car machine, and may be one of the following states: an off state and a display state. And when the screen projection state is a display state, displaying a terminal interface on a screen of the vehicle machine. The interface corresponding to the target application displayed on the terminal interface can be opened based on the selection operation of the screen of the vehicle machine, so that the terminal can be edited on the screen of the vehicle machine. And when the screen projection state is the closing state, terminating the video data transmission of the terminal. The initial state of the screen projection is an off state, wherein switching the state of the screen projection from the display state to the off state may be referred to as switching to the background. Switching the state of the viewing screen from the off state to the display state may be referred to as switching to the foreground.
In one example, the display instruction is generated when responding to the clicking operation of the user on the vehicle machine screen of the vehicle, or responding to the pressing operation of the user on a display button on a center console of the vehicle, or detecting that the communication connection with the terminal is established. And the system switches the screen projection state from the closing state to the display state according to the display instruction. When in the display state, the types of the target applications that can be displayed on the car machine screen may include: navigation class, music class, call class, and the like. In another example, the close command may be generated in response to a clicking operation of a close control by the user, or in response to a clicking operation of a close button by the user, or in response to a reverse gear shift operation of the vehicle by the user. And the system switches the screen projection state from a display state to a closing state according to the closing instruction.
In one example, a closing control and a display control are arranged on a vehicle screen of a vehicle, and a user can complete the state switching of screen projection based on clicking of the two controls. In another example, a display button and a close button may be provided near the screen of the car machine, and the switching of the screen-projecting state may be realized by clicking the two buttons by the user.
In another example, in order to improve driving safety, a user needs to display a reverse image through a vehicle-mounted screen when the vehicle backs, so that the reverse condition of the vehicle can be observed in real time, and when the vehicle starts to back, the screen-projecting state needs to be switched to a closed state. Therefore, when the system detects that the user operates the vehicle gear, for example, detects that the user puts on the reverse gear, determines that the user is backing up, and immediately generates a closing instruction to switch the screen projection state from the display state to the closing state.
And 103, analyzing and displaying the target key frame according to the decoding information.
In the embodiment of the present invention, after the display instruction is obtained, the system preferentially calls the target video data from the cache, for example, the target video data may include decoding information and a target key frame. According to the decoding information, the target key frame can be analyzed, so that the target key frame can be rendered and displayed on a screen of the car machine. A key frame may also be referred to as an I-frame, and a single I-frame may be considered a static picture. The target key frame is the last key frame acquired before the state switching, namely the last frame I frame corresponding to the video data acquired by the system from the terminal before the switching operation of switching the screen projection state from the display state to the closed state is executed.
The system establishes communication connection with the terminal through a USB connecting line or WIFI, generates a corresponding display instruction after establishing the communication connection, acquires corresponding video data from the terminal when acquiring the display instruction for the first time, and displays a video stream corresponding to the video data on a screen of a vehicle. The terminal can compress the video stream in a target video compression format to form video data in a data packet form, and transmit the video data to the system. In the video data transmission process, the acquired first packet data may be decoding information corresponding to a target video compression format. The acquired second packet data and the acquired first packet data may be image sets corresponding to the terminal video stream. For example, the target video compression format may be an h.264 encoding format, and the corresponding image set may include: key frames and reference frames. And decoding the image set in sequence according to the decoding information so as to read the key frame and the reference frame in the image set, and then rendering and displaying to form a video stream.
The vehicle central control system can comprise a serial port driver, a wireless network card driver, a distribution layer, a mobile phone interconnection logic layer and a decoding layer. The serial port driver and the wireless network card driver run in a Kernel (also called Kernel) of the vehicle machine and are used for transmitting bottom layer data. In an example, when the terminal and the car machine establish a communication connection through a serial port driver, as shown in fig. 2, the serial port driver, for example, a USB driver, may be used for transmitting bottom layer data; the distribution layer, such as a Java layer, is used for data distribution, and transmits the video data and the audio data to the mobile phone interconnection logic layer by using different channels, respectively. Illustratively, at least the following channels may be included between the Java layer and the handset interconnection logic layer: a control command data channel, a video data channel, a music data channel, a voice recognition audio data channel, a voice recognition recording data channel, and a touch screen event data channel. The mobile phone interconnection logic layer is used for data processing and is responsible for data splitting and data integration; the decoding layer, e.g., the C + + layer, is used to interface with the underlying decoder and initialize the video player. And in the process of analyzing the video stream, the C + + layer preferentially sends the decoding information into the mobile phone interconnection logic layer for caching. And under the condition of acquiring the key frame, taking the acquired key frame as a target key frame, and sending the target key frame into a mobile phone interconnection logic layer by the C + + layer for caching. The method comprises the steps that a data storage module can be preset in a mobile phone interconnection logic layer, decoding information and a target key frame are used as target video data, and caching is carried out in a pile space of the data storage module. In order to save the buffer space, only one frame of target key frame may be buffered, for example, after each frame of key frame is acquired from the terminal, the key frame is taken as a new target key frame, and the previously acquired key frame is replaced. Therefore, when the screen-casting state is switched subsequently, the target key frame is the last frame key frame acquired before the state is switched.
Referring to fig. 3, the system obtains corresponding video data from the terminal and performs image display of the video stream, and the corresponding steps may be as follows:
and S301, the mobile phone terminal transmits the video data to the vehicle-mounted machine kernel.
And S302, the in-vehicle machine kernel transmits the video data to a distribution layer.
And step S303, the distribution layer transmits the video data to the mobile phone interconnection logic layer.
Step S304, caching decoding information and a target key frame corresponding to the video data by the mobile phone interconnection logic layer, and transmitting the video data to a decoding layer.
Step S305, the decoding layer decodes the video data based on the decoding information, and sends each frame of decoded picture to the video player.
And S306, the video player sends the acquired pictures to the screen of the vehicle machine for display one frame by one frame in sequence, so that the image display of the terminal is realized, and the video stream is generated.
In addition, when the system acquires a close instruction, the corresponding application program is switched, the image display corresponding to the video stream is closed, that is, the mobile phone interconnection is returned to the background, and then the corresponding close instruction needs to be sent to the terminal, and the corresponding steps can be as follows:
and S307, the video player stops transmitting the picture to the screen of the car machine, and the mobile phone is connected with the internet and returns to the background.
In step S308, the video player transmits a close command to the decoding layer, where the close command indicates that the terminal image is closed, i.e., stops transmitting the video data.
Step S309, the decoding layer transmits a closing instruction to the mobile phone interconnection logic layer.
And step S310, the mobile phone interconnection logic layer transmits a closing instruction to the distribution layer.
And step S311, the distribution layer transmits a closing instruction to the car machine kernel.
And S312, the in-vehicle machine core transmits a closing instruction to the mobile phone terminal, and at the moment, the mobile phone terminal stops transmitting the video data.
Therefore, after the system acquires the display instruction again, the corresponding application program is switched, and the mobile phone interconnection is switched to the foreground, so that the corresponding display instruction needs to be sent to the terminal, and the corresponding steps can be as follows:
and step S313, switching the interconnection of the mobile phones to the background.
In step S314, the video player transmits a display instruction to the decoding layer, where the display instruction instructs the terminal to display an image, that is, to start transmitting video data.
And step S315, the decoding layer transmits a display instruction to the mobile phone interconnection logic layer.
And step S316, the mobile phone interconnection logic layer transmits a display instruction to the distribution layer.
And step S317, the distribution layer transmits a display instruction to the car machine kernel.
And S318, the vehicle-mounted machine kernel transmits a display instruction to the mobile phone terminal, and at the moment, the mobile phone terminal starts to transmit video data.
When the mobile phone interconnection logic layer receives the display instruction, the target video data is directly called from the cache data in the mobile phone interconnection logic layer. Because the key frame can be independently decoded and other images do not need to be referred to, the target key frame can be displayed on the screen of the vehicle-mounted device immediately after being analyzed. The steps executed by the mobile phone interconnection logic layer after receiving the display instruction may be as follows:
step S319, the mobile phone interconnection logic layer transmits the target video data to a decoding layer;
step S320, the decoding layer decodes the target key frame based on the decoding information, and sends a frame of decoded picture to the video player.
And S321, the video player sends the acquired single-frame picture to a vehicle screen for display, so that the image display of the target key frame is realized.
If there is no target video data cached, after the display instruction is transmitted to the mobile phone terminal, the mobile phone terminal sequentially performs step S301 (corresponding to step S322), step S302 (corresponding to step S323), step S303 (corresponding to step S324), step S304 (corresponding to step S325), step S305 (corresponding to step S326), and step S306 (corresponding to step S327) to realize the image display of the car-machine screen. Therefore, the invention can directly improve the response speed of the screen display of the on-board unit after the display instruction is obtained, avoid the occurrence of black picture and improve the user experience.
And 104, acquiring video data from the terminal.
And 105, analyzing the video data according to the decoding information, and displaying a corresponding video stream behind the target key frame.
In the embodiment of the present invention, after switching to the foreground, the video data acquired from the terminal may include only the key frame and/or the reference frame. Thus, the video data is parsed according to the cached decoding information, and the corresponding video stream is continuously displayed after the target key frame.
To sum up, the data display method provided by the embodiment of the present invention includes acquiring target video data from a system cache after acquiring a display instruction, where the target video data includes decoding information and a target key frame, and analyzing the target key frame according to the decoding information and displaying the target key frame on a screen of a vehicle. And then acquiring the video data from the terminal, and analyzing the video data according to the decoding information so as to continuously display the corresponding video stream after the target key frame. Therefore, the problem that black painting appears on a display page of a vehicle screen due to unfixed timing of terminal transmission video stream when the terminal switches the painting back and forth to the vehicle screen in the mirror image screen projection process of the vehicle screen can be solved, user experience is improved, and system performance of the vehicle central control system is optimized.
Referring to fig. 4, a flowchart illustrating steps of another data display method provided in an embodiment of the present invention is shown, where the method may include:
In the embodiment of the present invention, the content of step 401 refers to the content of step 101 described above.
In the embodiment of the present invention, after the display instruction is obtained, the system preferentially calls the target video data from the cache, for example, the target video data may include decoding information and a target key frame. A key frame may also be referred to as an I-frame, and a single I-frame may be considered a static picture. The target key frame is the last frame key frame acquired before the state switching, namely the last frame I frame acquired by the system from the terminal before the switching operation of switching the screen projection state from the display state to the closed state is executed. In one example, when the terminal transmits a video stream in h.264 coding format, its corresponding decoding information may include a Sequence Parameter Set (SPS) and a Picture Parameter Set (PPS).
Analyzing and displaying the target key frame according to the decoding information, wherein the analyzing and displaying comprises the following steps: step 403-step 404.
And 403, determining target decoding parameters corresponding to the target key frames from the sequence parameter set and the image parameter set.
And step 404, analyzing and displaying the target key frame according to the target decoding parameter.
In the embodiment of the invention, the sequence parameter set and the image parameter set contain information parameters required by initializing an H.264 decoder, and the information parameters comprise parameters such as configuration, code stream level, size of a single-frame image, a filter and the like used for video stream compression coding. In this way, the decoding parameter for analyzing the target key frame can be acquired from the information parameter, and this decoding parameter can be used as the target decoding parameter. According to the target decoding parameters, the target key frame can be analyzed, so that the target key frame can be rendered and displayed on a vehicle-mounted machine screen.
Analyzing the video data according to the decoding information, and displaying a corresponding video stream after the target key frame, wherein the analyzing comprises: step 406-step 407.
And 406, determining decoding parameters corresponding to the reference frame and the key frame from the sequence parameter set and the image parameter set respectively.
And 407, analyzing the reference frame and the key frame in sequence according to the decoding parameters, and displaying and analyzing the target key frame to generate a video stream.
In the embodiment of the invention, the video data comprises a reference frame and a key frame. The reference frame may be a forward reference frame, also known as a P-frame. I-frames and P-frames are sequences of encoded image data corresponding to a frame-by-frame video stream. The corresponding decoding parameters are all stored in the decoding information. Thus, decoding parameters corresponding to the I frame or the P frame can be determined from the SPS and the PPS. When an I frame is received from a terminal, the frame can be directly analyzed based on the single frame I frame because the I frame contains all data corresponding to the page frame. When a P frame is received from a terminal, it is used as a differential frame, and only contains the elements that the current picture changes from the P frame or I frame corresponding to the previous frame. Therefore, in the process of analyzing the P frame, difference analysis can be carried out based on the image data of the previous frame, and the picture corresponding to the P frame can be displayed. And in the same way, generating a video stream and displaying the video stream after the target key frame.
Due to the fact that driving safety of a user is considered, the number of editable applications included in a video stream projected from a terminal mirror image is small, for example, for target applications of music and conversation, the picture difference between a key frame and a key frame, and between the key frame and a reference frame, which are acquired from the terminal, is small. Therefore, after the screen projection state is switched from the closed state to the display state, the video stream is displayed after the target key frame is preferentially displayed, and the phenomena of screen blockage or screen splash and the like cannot occur in the middle. Therefore, the condition of black picture pages is avoided when the foreground is switched. The playing fluency of the video stream is improved, and the user experience is improved.
In another example, for a target application of a navigation class, the difference between the key frames acquired from the terminal and the picture between the key frames and the reference frame is large. Therefore, the I frames can be updated according to the logic of the terminal, for example, the image data analysis failure caused by excessive frame number of the P frames can be avoided by reducing the image frame number between the two I frames, so that the playing fluency of the video stream is improved.
To sum up, another data display method provided in the embodiments of the present invention includes acquiring target video data from a system cache after acquiring a display instruction, where the target video data includes decoding information and a target key frame, and analyzing the target key frame according to the decoding information and displaying the target key frame on a screen of a vehicle. And then acquiring the video data from the terminal, and analyzing the video data according to the decoding information so as to continuously display the corresponding video stream after the target key frame. Therefore, the problem that black painting appears on a display page of a vehicle screen due to unfixed timing of terminal transmission video stream when the terminal switches the painting back and forth to the vehicle screen in the mirror image screen projection process of the vehicle screen can be solved, user experience is improved, and system performance of the vehicle central control system is optimized.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the embodiments are not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the embodiments. Further, those skilled in the art will also appreciate that the embodiments described in the specification are presently preferred and that no particular act is required of the embodiments of the application.
Referring to fig. 5, a data display apparatus according to an embodiment of the present invention is shown, and the apparatus may include:
the instruction obtaining module 501 is configured to obtain a display instruction, and switch the screen projection state from the off state to the display state according to the display instruction.
A first data obtaining module 502, configured to obtain target video data from a system cache according to the display instruction, where the target video data includes: decoding information and a target key frame, wherein the target key frame is a last frame key frame acquired before state switching.
And a key frame parsing module 503, configured to parse and display the target key frame according to the decoding information.
A second data obtaining module 504, configured to obtain video data from the terminal.
And a video stream parsing module 505, configured to parse the video data according to the decoding information, and display a corresponding video stream after the target key frame.
In an alternative embodiment of the present invention, the instruction obtaining module is further configured to:
and acquiring a closing instruction, switching the screen projection state from a display state to a closing state according to the closing instruction, and acquiring a last frame key frame corresponding to the video data acquired before state switching.
Replacing the target key frame in the system cache with the last frame key frame.
In an alternative embodiment of the present invention, the decoding information includes: a sequence parameter set and an image parameter set;
the key frame parsing module comprises:
and the target parameter acquisition sub-module is used for determining a target decoding parameter corresponding to the target key frame from the sequence parameter set and the image parameter set.
And the key frame analysis submodule is used for analyzing and displaying the target key frame according to the target decoding parameters.
In an alternative embodiment of the invention, the video data includes reference frames and key frames;
the video stream parsing module comprises:
and the decoding parameter acquisition sub-module is used for respectively determining the decoding parameters corresponding to the reference frame and the key frame from the sequence parameter set and the image parameter set.
And the video stream analysis sub-module is used for analyzing the reference frame and the key frame in sequence according to the decoding parameters and displaying and analyzing the target key frame to generate a video stream.
In an alternative embodiment of the present invention, the instruction obtaining module may be further configured to:
and generating a closing instruction in response to the clicking operation of the user on the closing control.
Or, the obtaining of the closing instruction includes:
and generating a closing instruction in response to the click operation of the user on the closing button.
Still alternatively, the obtaining the close instruction includes:
and generating a closing instruction in response to the reverse gear engaging operation of the vehicle gear by the user.
An optional invention embodiment, the apparatus further comprising:
the communication module is used for establishing communication connection with the terminal;
and the data caching module is used for caching the target video data acquired from the terminal when the display instruction is acquired for the first time after the communication connection is established.
To sum up, the data display apparatus provided in the embodiment of the present invention includes obtaining target video data from a system cache after obtaining a display instruction, where the target video data includes decoding information and a target key frame, and analyzing the target key frame according to the decoding information and displaying the target key frame on a screen of a vehicle. And then acquiring the video data from the terminal, and analyzing the video data according to the decoding information so as to continuously display the corresponding video stream after the target key frame. Therefore, the problem that black painting appears on a display page of a vehicle screen due to unfixed timing of terminal transmission video stream when the terminal switches the painting back and forth to the vehicle screen in the mirror image screen projection process of the vehicle screen can be solved, user experience is improved, and system performance of the vehicle central control system is optimized.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As is readily imaginable to the person skilled in the art: any combination of the above embodiments is possible, and thus any combination between the above embodiments is an embodiment of the present invention, but the present disclosure is not necessarily detailed herein for reasons of space.
In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the invention and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be construed to reflect the intent: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.
Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components in the embodiments may be combined into one module or unit or component, and furthermore, may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
An electronic device, comprising:
one or more processors;
a memory;
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the methods of the embodiments described above.
A computer-readable storage medium storing a computer program for use in conjunction with an electronic device, the computer program being executable by a processor to perform the method of the above embodiments.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The data display method and the data display device provided by the invention are described in detail, and the principle and the implementation mode of the invention are explained by applying specific examples, and the description of the examples is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. A data display method is characterized by being applied to a vehicle-mounted central control system, and comprises the following steps:
acquiring a display instruction, and switching the screen projection state from a closed state to a display state according to the display instruction;
obtaining target video data from a system cache, wherein the target video data comprises: decoding information and a target key frame, wherein the target key frame is a last frame key frame acquired before state switching;
analyzing and displaying the target key frame according to the decoding information;
acquiring video data from the terminal;
and analyzing the video data according to the decoding information, and displaying a corresponding video stream behind the target key frame.
2. The data display method of claim 1, further comprising:
acquiring a closing instruction, switching the screen projection state from a display state to a closing state according to the closing instruction, and acquiring a last frame key frame corresponding to the video data acquired before state switching;
replacing the target key frame in the system cache with the last frame key frame.
3. The data display method of claim 1, wherein the decoding information comprises: a sequence parameter set and a picture parameter set;
the analyzing and displaying the target key frame according to the decoding information comprises:
determining target decoding parameters corresponding to the target key frames from the sequence parameter set and the image parameter set;
and analyzing and displaying the target key frame according to the target decoding parameter.
4. A data display method according to claim 3, wherein the video data comprises a reference frame and a key frame;
the parsing the video data according to the decoding information and displaying the corresponding video stream after the target key frame includes:
respectively determining decoding parameters corresponding to the reference frame and the key frame from the sequence parameter set and the image parameter set;
and analyzing the reference frame and the key frame in sequence according to the decoding parameters, and displaying and analyzing the target key frame to generate a video stream.
5. The data display method of claim 2, wherein the obtaining the close command comprises:
responding to the click operation of the user on the closing control, and generating a closing instruction;
or, the obtaining of the closing instruction includes:
generating a closing instruction in response to the click operation of the user on a closing button;
still alternatively, the obtaining the close instruction includes:
and generating a closing instruction in response to the reverse gear engaging operation of the vehicle gear by the user.
6. The data display method of claim 1, further comprising:
establishing communication connection with the terminal;
and caching the target video data acquired from the terminal when the display instruction is acquired for the first time after the communication connection is established.
7. A data display device is characterized by being applied to a vehicle-mounted central control system, and the device comprises:
the instruction acquisition module is used for acquiring a display instruction and switching the screen projection state from a closed state to a display state according to the display instruction;
a first data obtaining module, configured to obtain target video data from a system cache, where the target video data includes: decoding information and a target key frame, wherein the target key frame is a last frame key frame acquired before state switching;
the key frame analysis module is used for analyzing and displaying the target key frame according to the decoding information;
the second data acquisition module is used for acquiring video data from the terminal;
and the video stream analyzing module is used for analyzing the video data according to the decoding information and displaying a corresponding video stream behind the target key frame.
8. The data display device of claim 7, wherein the instruction acquisition module is further configured to:
acquiring a closing instruction, switching the screen projection state from a display state to a closing state according to the closing instruction, and acquiring a last frame key frame corresponding to the video data acquired before state switching;
and replacing the target key frame in the system cache with the last frame key frame.
9. An electronic device, comprising:
one or more processors;
a memory;
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the methods of any of claims 1-6.
10. A computer-readable storage medium storing a computer program for use in conjunction with an electronic device, the computer program being executable by a processor to perform the method of any of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111649852.XA CN114567802B (en) | 2021-12-29 | 2021-12-29 | Data display method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111649852.XA CN114567802B (en) | 2021-12-29 | 2021-12-29 | Data display method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114567802A true CN114567802A (en) | 2022-05-31 |
| CN114567802B CN114567802B (en) | 2024-02-09 |
Family
ID=81711433
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111649852.XA Active CN114567802B (en) | 2021-12-29 | 2021-12-29 | Data display method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114567802B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116389352A (en) * | 2023-03-17 | 2023-07-04 | 深圳市同行者科技有限公司 | Method, system and related equipment for transmitting vehicle-mounted interactive screen-throwing data |
Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102238232A (en) * | 2010-05-04 | 2011-11-09 | 微软公司 | Using double buffering for screen sharing |
| CN102510541A (en) * | 2011-12-30 | 2012-06-20 | Tcl数码科技（深圳）有限责任公司 | Multi-screen interaction video and audio content switching method and media player |
| US20130346499A1 (en) * | 2012-06-25 | 2013-12-26 | Salesforce.Com, Inc. | Systems, methods, and apparatuses for implementing frame aggregation with screen sharing |
| JP2015149662A (en) * | 2014-02-07 | 2015-08-20 | 株式会社リコー | Data transmission system, terminal device, method, and program |
| US20160260238A1 (en) * | 2015-03-06 | 2016-09-08 | Mekra Lang Gmbh & Co. Kg | Display System for a Vehicle, In Particular Commercial Vehicle |
| US20180167631A1 (en) * | 2016-12-14 | 2018-06-14 | Getgo, Inc. | Synchronizing video signals using cached key frames |
| CN108268226A (en) * | 2016-12-30 | 2018-07-10 | 乐视汽车（北京）有限公司 | The picture of synchronous terminal screen to vehicle device method, terminal and system |
| CN109218731A (en) * | 2017-06-30 | 2019-01-15 | 腾讯科技（深圳）有限公司 | The throwing screen method, apparatus and system of mobile device |
| US20190149783A1 (en) * | 2017-11-16 | 2019-05-16 | Canon Kabushiki Kaisha | Projection apparatus for multi-projection, communication apparatus, control methods thereof, storage medium, and projection system |
| CN111273883A (en) * | 2020-01-20 | 2020-06-12 | 北京远特科技股份有限公司 | Same-screen display method and device for multiple operating systems and terminal equipment |
| CN111314648A (en) * | 2020-02-28 | 2020-06-19 | 联想(北京)有限公司 | Information processing method, processing device, first electronic equipment and server |
| CN111694625A (en) * | 2019-03-14 | 2020-09-22 | 阿里巴巴集团控股有限公司 | Method and equipment for projecting screen to vehicle machine by vehicle box |
| CN112214186A (en) * | 2019-07-11 | 2021-01-12 | 上海博泰悦臻网络技术服务有限公司 | Information sharing method and vehicle-mounted terminal |
| CN112416278A (en) * | 2020-11-10 | 2021-02-26 | 北京五八信息技术有限公司 | Screen sharing method and device, electronic equipment and storage medium |
| WO2021092827A1 (en) * | 2019-11-14 | 2021-05-20 | 深圳爱特天翔科技有限公司 | Video signal black-screen-free switching processing method and device |
| CN113138737A (en) * | 2021-04-16 | 2021-07-20 | 阿波罗智联(北京)科技有限公司 | Display control method, device, equipment, medium and program product for screen projection scene |
| CN113395606A (en) * | 2020-03-13 | 2021-09-14 | 华为技术有限公司 | URL screen projection method and device |
| JP2021175063A (en) * | 2020-04-23 | 2021-11-01 | セイコーエプソン株式会社 | Method for controlling image display device, and image display device |
-
2021
- 2021-12-29 CN CN202111649852.XA patent/CN114567802B/en active Active
Patent Citations (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102238232A (en) * | 2010-05-04 | 2011-11-09 | 微软公司 | Using double buffering for screen sharing |
| CN102510541A (en) * | 2011-12-30 | 2012-06-20 | Tcl数码科技（深圳）有限责任公司 | Multi-screen interaction video and audio content switching method and media player |
| US20130346499A1 (en) * | 2012-06-25 | 2013-12-26 | Salesforce.Com, Inc. | Systems, methods, and apparatuses for implementing frame aggregation with screen sharing |
| JP2015149662A (en) * | 2014-02-07 | 2015-08-20 | 株式会社リコー | Data transmission system, terminal device, method, and program |
| US20160260238A1 (en) * | 2015-03-06 | 2016-09-08 | Mekra Lang Gmbh & Co. Kg | Display System for a Vehicle, In Particular Commercial Vehicle |
| US20180167631A1 (en) * | 2016-12-14 | 2018-06-14 | Getgo, Inc. | Synchronizing video signals using cached key frames |
| CN108268226A (en) * | 2016-12-30 | 2018-07-10 | 乐视汽车（北京）有限公司 | The picture of synchronous terminal screen to vehicle device method, terminal and system |
| CN109218731A (en) * | 2017-06-30 | 2019-01-15 | 腾讯科技（深圳）有限公司 | The throwing screen method, apparatus and system of mobile device |
| US20190149783A1 (en) * | 2017-11-16 | 2019-05-16 | Canon Kabushiki Kaisha | Projection apparatus for multi-projection, communication apparatus, control methods thereof, storage medium, and projection system |
| CN111694625A (en) * | 2019-03-14 | 2020-09-22 | 阿里巴巴集团控股有限公司 | Method and equipment for projecting screen to vehicle machine by vehicle box |
| CN112214186A (en) * | 2019-07-11 | 2021-01-12 | 上海博泰悦臻网络技术服务有限公司 | Information sharing method and vehicle-mounted terminal |
| WO2021092827A1 (en) * | 2019-11-14 | 2021-05-20 | 深圳爱特天翔科技有限公司 | Video signal black-screen-free switching processing method and device |
| CN111273883A (en) * | 2020-01-20 | 2020-06-12 | 北京远特科技股份有限公司 | Same-screen display method and device for multiple operating systems and terminal equipment |
| CN111314648A (en) * | 2020-02-28 | 2020-06-19 | 联想(北京)有限公司 | Information processing method, processing device, first electronic equipment and server |
| CN113395606A (en) * | 2020-03-13 | 2021-09-14 | 华为技术有限公司 | URL screen projection method and device |
| JP2021175063A (en) * | 2020-04-23 | 2021-11-01 | セイコーエプソン株式会社 | Method for controlling image display device, and image display device |
| CN112416278A (en) * | 2020-11-10 | 2021-02-26 | 北京五八信息技术有限公司 | Screen sharing method and device, electronic equipment and storage medium |
| CN113138737A (en) * | 2021-04-16 | 2021-07-20 | 阿波罗智联(北京)科技有限公司 | Display control method, device, equipment, medium and program product for screen projection scene |
Non-Patent Citations (2)
| Title |
|---|
| 何衍: "基于Android的DLNA多屏互动系统的设计与开发", 《中国优秀硕士学位论文全文数据库电子期刊》 * |
| 朱芙蓉 等: "车载信息娱乐系统软件优化与改进", 《汽车实用技术》, vol. 46, no. 23 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116389352A (en) * | 2023-03-17 | 2023-07-04 | 深圳市同行者科技有限公司 | Method, system and related equipment for transmitting vehicle-mounted interactive screen-throwing data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114567802B (en) | 2024-02-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7352589B2 (en) | Method and apparatus, electronic device, computer readable storage medium and computer program for mirroring | |
| CN101740084B (en) | Clipping method and mobile terminal of multi-media segment | |
| CN110636370B (en) | Video processing method and device, electronic equipment and readable medium | |
| JP6499324B2 (en) | Method, client and computer storage medium for playing video | |
| US11785195B2 (en) | Method and apparatus for processing three-dimensional video, readable storage medium and electronic device | |
| CN112218151A (en) | Screen projection method, device, computer storage medium and system | |
| CN109688465A (en) | Video source modeling control method, device and electronic equipment | |
| CN112866782A (en) | Video playing method, video playing device and electronic equipment | |
| CN110740261A (en) | Video recording method, device, terminal and storage medium | |
| CN114567802B (en) | Data display method and device | |
| CN112099750A (en) | Screen sharing method, terminal, computer storage medium and system | |
| KR20110099414A (en) | Apparatus and method for providing animation effect in portable terminal | |
| CN109561337A (en) | The playing method and device of preview video | |
| KR101042352B1 (en) | Apparatus and method for receiving broadcasting signal in DMB system | |
| EP3522525B1 (en) | Method and apparatus for processing video playing | |
| KR102139331B1 (en) | Apparatus, server, and method for playing moving picture contents | |
| CN116101172A (en) | Vehicle entertainment information domain controller and driving record generation method | |
| CN111367598B (en) | Method and device for processing action instruction, electronic equipment and computer readable storage medium | |
| CN101009894B (en) | Method for displaying information regarding the condition of a portable terminal | |
| CN112954483B (en) | Data transmission method, system and non-volatile storage medium | |
| CN109348141A (en) | Video generation, video broadcasting method, device, electronic equipment and storage medium | |
| CN114168878B (en) | Dynamic effect playing method, device, equipment, storage medium and program product | |
| KR100498362B1 (en) | Method for post-processing decoded image of mobile phone | |
| JP2007300614A (en) | Transmission device of content, output device, transmission method, and content transmission data structure | |
| CN115767159A (en) | Screen projection method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |