CN114567802B - Data display method and device - Google Patents
Data display method and device Download PDFInfo
- Publication number
- CN114567802B CN114567802B CN202111649852.XA CN202111649852A CN114567802B CN 114567802 B CN114567802 B CN 114567802B CN 202111649852 A CN202111649852 A CN 202111649852A CN 114567802 B CN114567802 B CN 114567802B
- Authority
- CN
- China
- Prior art keywords
- key frame
- target
- frame
- video data
- state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 55
- 238000004590 computer program Methods 0.000 claims description 11
- 238000004891 communication Methods 0.000 claims description 9
- 238000004458 analytical method Methods 0.000 claims description 6
- 230000002441 reversible effect Effects 0.000 claims description 5
- 238000003860 storage Methods 0.000 claims description 5
- 230000008569 process Effects 0.000 abstract description 13
- 238000010422 painting Methods 0.000 abstract description 12
- 238000010586 diagram Methods 0.000 description 8
- 238000009826 distribution Methods 0.000 description 8
- 230000004044 response Effects 0.000 description 7
- 230000006870 function Effects 0.000 description 6
- 230000005540 biological transmission Effects 0.000 description 5
- 230000006835 compression Effects 0.000 description 4
- 238000007906 compression Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 3
- 238000013500 data storage Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
- H04N21/41422—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance located in transportation means, e.g. personal vehicle
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The invention discloses a data display method and device, and relates to the technical field of vehicle central control systems. The method comprises the steps of obtaining target video data from a system cache after obtaining a display instruction, wherein the target video data comprise decoding information and target key frames, and analyzing the target key frames according to the decoding information and displaying the target key frames on a vehicle-mounted screen. And then obtaining video data from the terminal, and analyzing the video data according to the decoding information so as to continuously display the corresponding video stream after the target key frame. Therefore, the problem that black painting appears on a display page of a vehicle screen due to unfixed time of transmitting video streams by the terminal when the painting is switched back and forth in the foreground in the mirror image screen throwing process of the terminal to the vehicle screen can be solved, user experience is improved, and system performance of the vehicle central control system is optimized.
Description
Technical Field
The invention relates to the technical field of vehicle central control systems, in particular to a data display method and device.
Background
When the pictures are switched back and forth in the foreground and the background, the pictures are redisplayed by depending on the images transmitted by the mobile phone terminal, but because the performances of the mobile phones are different, the time for transmitting the images to the mobile phone screen is not fixed, so that the mobile phone images are delayed to be displayed on the mobile phone screen, black pictures are displayed on the pages for a period of time, and the user experience is affected.
Disclosure of Invention
The present invention has been made in view of the above problems, and has as its object to provide a data display method and apparatus which overcome or at least partially solve the above problems.
According to a first aspect of the present invention, there is provided a data display method applied to a vehicle-mounted central control system, the method comprising:
acquiring a display instruction, and switching the screen throwing state from a closed state to a display state according to the display instruction;
obtaining target video data from a system cache, the target video data comprising: decoding information and a target key frame, wherein the target key frame is the last frame key frame acquired before state switching;
analyzing and displaying the target key frame according to the decoding information;
acquiring video data from the terminal;
and analyzing the video data according to the decoding information, and displaying the corresponding video stream after the target key frame.
According to a second aspect of the present invention, there is provided a data display device for use in an in-vehicle central control system, the device comprising:
the instruction acquisition module is used for acquiring a display instruction and switching the screen throwing state from the closing state to the display state according to the display instruction;
the first data acquisition module is used for acquiring target video data from the system cache, wherein the target video data comprises: decoding information and a target key frame, wherein the target key frame is the last frame key frame acquired before state switching;
the key frame analysis module is used for analyzing and displaying the target key frame according to the decoding information;
the second data acquisition module is used for acquiring video data from the terminal;
and the video stream analyzing module is used for analyzing the video data according to the decoding information and displaying the corresponding video stream after the target key frame.
In the scheme of the invention, after a display instruction is acquired, target video data is acquired from a system cache, wherein the target video data comprises decoding information and target key frames, and the target key frames are analyzed according to the decoding information and displayed on a vehicle-mounted screen. And then obtaining video data from the terminal, and analyzing the video data according to the decoding information so as to continuously display the corresponding video stream after the target key frame. Therefore, the problem that black painting appears on a display page of a vehicle screen due to unfixed time of transmitting video streams by the terminal when the painting is switched back and forth in the foreground in the mirror image screen throwing process of the terminal to the vehicle screen can be solved, user experience is improved, and system performance of the vehicle central control system is optimized.
The foregoing description is only an overview of the present invention, and is intended to be implemented in accordance with the teachings of the present invention in order that the same may be more clearly understood and to make the same and other objects, features and advantages of the present invention more readily apparent.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to designate like parts throughout the figures.
In the drawings:
FIG. 1 is a flow chart of steps of a data display method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a terminal and a vehicle-to-machine interconnection provided in an embodiment of the present invention;
FIG. 3 is a flowchart illustrating steps for video data transmission according to an embodiment of the present invention;
FIG. 4 is a flowchart illustrating steps of another method for displaying data according to an embodiment of the present invention;
fig. 5 is a block diagram of a data display device according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present invention are shown in the drawings, it should be understood that the present invention may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.
Referring to fig. 1, a step flowchart of a data display method provided by an embodiment of the present invention is shown, where the method is applicable to a vehicle central control system, and the vehicle central control system is loaded in a vehicle and has a function of mobile phone interconnection and screen projection. For example, the cell phone interconnection screen throwing function may include CarPlay, carLife and Android Auto. The method may include:
step 101, acquiring a display instruction, and switching the screen throwing state from the closed state to the display state according to the display instruction.
In the embodiment of the invention, the screen-throwing state is used for representing whether the terminal interface is displayed on the vehicle screen or not, and can be one of the following states: a closed state and a display state. And when the screen-throwing state is a display state, displaying a terminal interface on a vehicle machine screen. And opening an interface corresponding to the target application displayed on the terminal interface based on the selection operation of the vehicle-mounted screen, so that the editing operation of the terminal on the vehicle-mounted screen is realized. And when the screen throwing state is the closing state, terminating the video data transmission of the terminal. The initial screen-throwing state is a closed state, wherein switching the screen-throwing state from the display state to the closed state may be referred to as switching to the background. Switching the view screen from the off state to the display state may be referred to as switching to the foreground.
In one example, the display instruction is generated in response to a click operation of a vehicle body screen by a user, or in response to a pressing operation of a display button on a console in a vehicle by the user, or in response to detection of establishment of a communication connection with the terminal. And the system switches the screen throwing state from the closing state to the display state according to the display instruction. While in the display state, the types of target applications that can be displayed on the in-vehicle screen may include: navigation class, music class, talk class, etc. In another example, the closing instruction may be generated in response to a click operation of a closing control by the user, or in response to a click operation of a closing button by the user, or in response to a reverse gear shift operation of a vehicle by the user. And the system switches the screen throwing state from a display state to a closing state according to the closing instruction.
In one example, a closing control and a display control are arranged on a screen of a vehicle, and a user can complete state switching of screen throwing based on clicking of the two controls. In another example, a display button and a close button may be disposed near the screen of the vehicle, and the state of the screen may be switched by the user clicking the two buttons.
In another example, in order to improve driving safety, a user needs to display a reverse image through a vehicle-mounted screen when the vehicle is reversed, so that a reversing situation of the vehicle can be observed in real time, and when the vehicle starts reversing, a screen throwing state needs to be switched to a closing state. Therefore, when the system detects that the user operates the vehicle gear, for example, detects that the user is engaged in reverse gear, the system determines that the user is backing up, and immediately generates a closing instruction to switch the screen-throwing state from the display state to the closing state.
Step 102, obtaining target video data from a system cache, wherein the target video data comprises: decoding information and a target key frame, wherein the target key frame is the last frame key frame acquired before state switching.
And step 103, analyzing and displaying the target key frame according to the decoding information.
In the embodiment of the invention, after the display instruction is acquired, the system preferentially calls the target video data from the buffer, for example, the target video data may include decoding information and a target key frame. According to the decoding information, the target key frame can be analyzed, so that the target key frame can be rendered and displayed on a vehicle screen. Key frames may also be referred to as I frames, and a single I frame may be considered a still picture. The target key frame is the last frame key frame acquired before state switching, namely, the last frame I frame corresponding to the video data acquired from the terminal by the system before the switching operation of switching the screen throwing state from the display state to the closing state is performed.
The system establishes communication connection with the terminal through a USB connection line or WIFI, generates a corresponding display instruction after the communication connection is established, acquires corresponding video data from the terminal when the system acquires the display instruction for the first time, and displays a video stream corresponding to the video data on a vehicle screen. The terminal may compress the video stream into video data in the form of data packets in a target video compression format and transmit it to the system. In the video data transmission process, the acquired first packet data may be decoding information corresponding to the target video compression format. The second packet data obtained may be an image set corresponding to the terminal video stream. For example, the target video compression format may be an h.264 coding format, and the corresponding image set may include: key frames and reference frames. And sequentially decoding the image set according to the decoding information, so that key frames and reference frames in the image set can be read, and rendering and displaying are performed to form a video stream.
The vehicle central control system can comprise a serial port driver, a wireless network card driver, a distribution layer, a mobile phone interconnection logic layer and a decoding layer. The serial port driver and the wireless network card driver are operated in a Kernel (also called Kernel) of the vehicle machine and used for transmitting bottom layer data. In one example, when the terminal and the vehicle machine establish a communication connection through a serial port driver, as shown in fig. 2, the serial port driver, for example, a USB driver, may be used for transmission of the underlying data; the distribution layer, for example, a Java layer, is used for data distribution, and video data and audio data are respectively transmitted to the mobile phone interconnection logic layer by using different channels. The Java layer and the cell phone interconnection logic layer may include at least the following channels: control command data channels, video data channels, music data channels, voice recognition audio data channels, voice recognition recording data channels, and touch screen event data channels. The mobile phone interconnection logic layer is used for data processing and is responsible for data splitting and data integration; the decoding layer, e.g., c++ layer, is used to interface with the underlying decoder and initialize the video player. In the process of analyzing the video stream, the C++ layer preferentially sends decoding information into a mobile phone interconnection logic layer for caching. Under the condition that the key frame is acquired, the acquired key frame is taken as a target key frame, and the C++ layer sends the target key frame into a mobile phone interconnection logic layer for caching. The data storage module can be preset in the mobile phone interconnection logic layer, and the decoding information and the target key frame are taken as target video data to be cached in a pile space of the data storage module. In order to save the buffer space, only one frame of target key frame may be buffered, for example, after each frame of key frame is acquired from the terminal, the key frame is used as a new target key frame, and the previously acquired key frame is replaced. Therefore, when the screen-throwing state is switched subsequently, the target key frame is the last frame key frame acquired before the state switching.
Referring to fig. 3, the system acquires corresponding video data from the terminal and performs image display of the video stream, and the corresponding steps may be as follows:
step S301, the mobile phone terminal transmits the video data to the car phone inner core.
And step S302, the car kernel transmits the video data to a distribution layer.
Step S303, the distribution layer transmits the video data to a mobile phone interconnection logic layer.
Step S304, the mobile phone interconnection logic layer caches decoding information and target key frames corresponding to the video data, and transmits the video data to a decoding layer.
In step S305, the decoding layer decodes the video data based on the decoding information, and sends each frame of picture obtained by decoding to the video player.
And step S306, the video player sends the acquired pictures into a vehicle machine screen one by one in sequence to display, so that the image display of the terminal is realized, and a video stream is generated.
In addition, when the system acquires the closing instruction, the corresponding application program is switched, the image display corresponding to the video stream is closed, that is, the mobile phone interconnection is returned to the background, the corresponding closing instruction needs to be sent to the terminal, and the corresponding steps can be as follows:
step S307, the video player stops transmitting pictures to the car phone screen, and the mobile phone is interconnected and moved back to the background.
In step S308, the video player transmits a shutdown instruction to the decoding layer, where the shutdown instruction instructs the terminal to close the image, i.e. stop transmitting video data.
Step S309, the decoding layer transmits a closing instruction to the mobile phone interconnection logic layer.
Step S310, the mobile phone interconnection logic layer transmits a closing instruction to the distribution layer.
Step S311, the distribution layer transmits a closing instruction to the kernel of the vehicle.
Step S312, the car kernel transmits a closing instruction to the mobile phone terminal, and the mobile phone terminal stops transmitting the video data at the moment.
Therefore, after the system acquires the display instruction again, the corresponding application program is switched, and the mobile phone interconnection is switched to the foreground, so that the corresponding display instruction needs to be sent to the terminal, and the corresponding steps can be as follows:
step S313, the mobile phone interconnection is switched to the background.
In step S314, the video player transmits a display instruction to the decoding layer, wherein the display instruction instructs the terminal to display an image, i.e. starts to transmit video data.
Step S315, the decoding layer transmits a display instruction to the mobile phone interconnection logic layer.
Step S316, the mobile phone interconnection logic layer transmits a display instruction to the distribution layer.
In step S317, the distributing layer transmits a display instruction to the kernel of the vehicle.
Step S318, the car kernel transmits a display instruction to the mobile phone terminal, and the mobile phone terminal starts video data transmission at the moment.
When the mobile phone interconnection logic layer receives a display instruction, the target video data is directly called from the cache data in the mobile phone interconnection logic layer. Because the key frames can be independently decoded, other images do not need to be referred to, and after the target key frames are analyzed, the key frames can be displayed on a vehicle screen by a horse. The steps executed by the mobile phone interconnection logic layer after receiving the display instruction can be as follows:
step S319, the mobile phone interconnection logic layer transmits the target video data to the decoding layer;
in step S320, the decoding layer decodes the target key frame based on the decoding information, and sends a frame of picture obtained by decoding to the video player.
And step 321, the video player sends the acquired single-frame picture to a vehicle machine screen for display, so that the image display of the target key frame is realized.
If there is no buffering of the target video data, the mobile phone terminal needs to transmit the display instruction to the mobile phone terminal, and then the mobile phone terminal can realize the image display of the vehicle screen in sequence of step S301 (corresponding to step S322), step S302 (corresponding to step S323), step S303 (corresponding to step S324), step S304 (corresponding to step S325), step S305 (corresponding to step S326) and step S306 (corresponding to step S327). Therefore, the invention can directly improve the response speed of the display of the screen picture of the car machine after the display instruction is acquired, avoid the occurrence of the condition of black painting and improve the user experience.
And 104, acquiring video data from the terminal.
And 105, analyzing the video data according to the decoding information, and displaying the corresponding video stream after the target key frame.
In the embodiment of the invention, after switching to the foreground, the video data acquired from the terminal may only include the key frame and/or the reference frame. And analyzing the video data according to the cached decoding information, and continuing to display the corresponding video stream after the target key frame.
In summary, the method for displaying data provided in the embodiment of the present invention includes obtaining target video data from a system cache after obtaining a display instruction, where the target video data includes decoding information and a target key frame, and first analyzing the target key frame according to the decoding information and displaying the target key frame on a vehicle screen. And then obtaining video data from the terminal, and analyzing the video data according to the decoding information so as to continuously display the corresponding video stream after the target key frame. Therefore, the problem that black painting appears on a display page of a vehicle screen due to unfixed time of transmitting video streams by the terminal when the painting is switched back and forth in the foreground in the mirror image screen throwing process of the terminal to the vehicle screen can be solved, user experience is improved, and system performance of the vehicle central control system is optimized.
Referring to fig. 4, a flowchart illustrating steps of another data display method according to an embodiment of the present invention is shown, where the method may include:
step 401, obtaining a display instruction, and switching the screen-throwing state from the closed state to the display state according to the display instruction.
In the embodiment of the present invention, the description of step 401 refers to the description of step 101.
Step 402, obtaining target video data from a system cache, where the target video data includes: decoding information and a target key frame, the decoding information comprising: the target key frame is the last frame key frame acquired before state switching.
In the embodiment of the invention, after the display instruction is acquired, the system preferentially calls the target video data from the buffer, for example, the target video data may include decoding information and a target key frame. Key frames may also be referred to as I frames, and a single I frame may be considered a still picture. The target key frame is the last frame key frame acquired before state switching, namely the last frame I frame acquired by the system from the terminal before switching operation of switching the screen throwing state from the display state to the closing state is performed. In one example, when a terminal transmits a video stream in an h.264 coding format, its corresponding decoding information may include a sequence parameter set (Sequence Paramater Set, SPS) and a picture parameter set (Picture Paramater Set, PPS).
Analyzing and displaying the target key frame according to the decoding information, including: step 403-step 404.
Step 403, determining a target decoding parameter corresponding to the target key frame from the sequence parameter set and the image parameter set.
And step 404, analyzing and displaying the target key frame according to the target decoding parameters.
In the embodiment of the invention, the sequence parameter set and the image parameter set contain information parameters required by initializing the H.264 decoder, wherein the information parameters comprise parameters such as configuration, code stream level, single frame image size, filter and the like used for video stream compression coding. Thus, the decoding parameter for parsing the target key frame can be obtained from the information parameter, and the decoding parameter is taken as the target decoding parameter. According to the target decoding parameters, the target key frames can be analyzed, so that the target key frames can be rendered and displayed on a vehicle screen.
Step 405, obtaining video data from the terminal.
According to the decoding information, analyzing the video data, and displaying the corresponding video stream after the target key frame, wherein the method comprises the following steps: step 406-step 407.
Step 406, determining decoding parameters corresponding to the reference frame and the key frame from the sequence parameter set and the image parameter set.
Step 407, analyzing the reference frame and the key frame in sequence according to the decoding parameters, and displaying and analyzing the target key frame to generate a video stream.
In an embodiment of the present invention, the video data includes a reference frame and a key frame. The reference frame may be a forward reference frame, also referred to as a P-frame. I-frames and P-frames are sequences of encoded image data corresponding to a frame-by-frame video stream. The corresponding decoding parameters are all stored in the decoding information. Thus, decoding parameters corresponding to the I frame or the P frame can be determined from the SPS and the PPS. When an I frame is received from the terminal, the I frame contains all data corresponding to the page of picture, and the picture can be directly analyzed based on a single frame I frame. When a P frame is received from a terminal, it is a differential frame in which only the elements of the current picture that change from the corresponding picture of the P frame or I frame of the previous frame are contained. Therefore, in the process of analyzing the P frame, difference analysis can be performed based on the image data of the previous frame, and then the picture corresponding to the P frame is displayed. Similarly, a video stream is generated and displayed after the target key frame.
Since the number of editable applications included in the video stream mirrored from the terminal is small in consideration of the driving safety of the user, for example, for the target applications of music and conversation, the picture difference between the key frame acquired from the terminal and the key frame, and between the key frame and the reference frame is small. Therefore, after the screen throwing state is switched from the closing state to the displaying state, the video stream is displayed after the target key frame is preferentially displayed, and the phenomena of screen blocking, screen display and the like can not occur in the middle. Therefore, when the front desk is switched to, the black painting condition is avoided. The video stream playing fluency is improved, and the user experience is improved.
In another example, for a navigation class target application, the screen difference between the key frame acquired from the terminal and the key frame, and between the key frame and the reference frame is large. Therefore, the I frames can be updated according to the logic of the terminal, for example, the number of image frames between two I frames is reduced, so that image data analysis failure caused by excessive number of P frames is avoided, and the playing fluency of the video stream is improved.
In summary, another method for displaying data provided by the embodiment of the present invention includes obtaining target video data from a system cache after obtaining a display instruction, where the target video data includes decoding information and a target key frame, and first analyzing the target key frame according to the decoding information and displaying the target key frame on a vehicle screen. And then obtaining video data from the terminal, and analyzing the video data according to the decoding information so as to continuously display the corresponding video stream after the target key frame. Therefore, the problem that black painting appears on a display page of a vehicle screen due to unfixed time of transmitting video streams by the terminal when the painting is switched back and forth in the foreground in the mirror image screen throwing process of the terminal to the vehicle screen can be solved, user experience is improved, and system performance of the vehicle central control system is optimized.
It should be noted that, for simplicity of description, the method embodiments are shown as a series of acts, but it should be understood by those skilled in the art that the embodiments are not limited by the order of acts described, as some steps may occur in other orders or concurrently in accordance with the embodiments. Further, those skilled in the art will appreciate that the embodiments described in the specification are all preferred embodiments and that the acts referred to are not necessarily required by the embodiments of the present application.
Referring to fig. 5, a data display apparatus provided by an embodiment of the present invention may include:
the instruction obtaining module 501 is configured to obtain a display instruction, and switch the screen-throwing state from the closed state to the display state according to the display instruction.
The first data obtaining module 502 is configured to obtain, according to the display instruction, target video data from a system cache, where the target video data includes: decoding information and a target key frame, wherein the target key frame is the last frame key frame acquired before state switching.
And a key frame analyzing module 503, configured to analyze and display the target key frame according to the decoding information.
A second data acquisition module 504, configured to acquire video data from the terminal.
The video stream parsing module 505 is configured to parse the video data according to the decoding information, and display a corresponding video stream after the target key frame.
In an alternative embodiment of the invention, the instruction fetch module is further configured to:
and acquiring a closing instruction, switching the screen throwing state from a display state to a closing state according to the closing instruction, and acquiring a last frame key frame corresponding to the video data acquired before the state switching.
And replacing the target key frame in the system cache with the last frame key frame.
An alternative inventive embodiment, the decoding information comprises: a sequence parameter set and an image parameter set;
the key frame parsing module includes:
and the target parameter acquisition sub-module is used for determining target decoding parameters corresponding to the target key frames from the sequence parameter set and the image parameter set.
And the key frame analysis sub-module is used for analyzing and displaying the target key frame according to the target decoding parameters.
An alternative inventive embodiment, the video data includes a reference frame and a key frame;
the video stream parsing module includes:
and the decoding parameter acquisition sub-module is used for respectively determining decoding parameters corresponding to the reference frame and the key frame from the sequence parameter set and the image parameter set.
And the video stream analysis sub-module is used for sequentially analyzing the reference frame and the key frame according to the decoding parameters and displaying and analyzing after the target key frame to generate a video stream.
In an alternative embodiment of the invention, the instruction fetch module may be further configured to:
and responding to the clicking operation of the user on the closing control, and generating a closing instruction.
Alternatively, the acquiring the closing instruction includes:
and responding to the click operation of the closing button by the user, and generating a closing instruction.
Or, the acquiring the closing instruction includes:
and responding to the reverse gear shifting operation of the user on the vehicle gear, and generating a closing instruction.
An alternative inventive embodiment, the apparatus further comprises:
the communication module is used for establishing communication connection with the terminal;
and the data caching module is used for caching the target video data acquired from the terminal when the display instruction is acquired for the first time after the communication connection is established.
In summary, the data display device provided by the embodiment of the invention includes obtaining target video data from a system cache after obtaining a display instruction, wherein the target video data includes decoding information and target key frames, and analyzing the target key frames according to the decoding information and displaying the target key frames on a vehicle screen. And then obtaining video data from the terminal, and analyzing the video data according to the decoding information so as to continuously display the corresponding video stream after the target key frame. Therefore, the problem that black painting appears on a display page of a vehicle screen due to unfixed time of transmitting video streams by the terminal when the painting is switched back and forth in the foreground in the mirror image screen throwing process of the terminal to the vehicle screen can be solved, user experience is improved, and system performance of the vehicle central control system is optimized.
In this specification, each embodiment is described in a progressive manner, and each embodiment is mainly described by differences from other embodiments, and identical and similar parts between the embodiments are all enough to be referred to each other.
As will be readily appreciated by those skilled in the art: any combination of the above embodiments is possible, and thus is an embodiment of the present invention, but the present specification is not limited by the text.
In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
Similarly, it should be appreciated that in the above description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be construed as reflecting the intention that: i.e., the claimed invention requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.
Those skilled in the art will appreciate that the modules in the apparatus of the embodiments may be adaptively changed and disposed in one or more apparatuses different from the embodiments. The modules or units or components of the embodiments may be combined into one module or unit or component and, furthermore, they may be divided into a plurality of sub-modules or sub-units or sub-components. Any combination of all features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or units of any method or apparatus so disclosed, may be used in combination, except insofar as at least some of such features and/or processes or units are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings), may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
An electronic device, comprising:
one or more processors;
a memory;
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the methods described in the above embodiments.
A computer readable storage medium storing a computer program for use in connection with an electronic device, the computer program being executable by a processor to perform the method of the above embodiments.
It will be apparent to those skilled in the art that embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the invention may take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal device, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiment and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or terminal device comprising the element.
The foregoing has described in detail a data display method and a data display device according to the present invention, and specific examples have been provided herein to illustrate the principles and embodiments of the present invention, the above examples being provided only to assist in understanding the method and core idea of the present invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in accordance with the ideas of the present invention, the present description should not be construed as limiting the present invention in view of the above.
Claims (9)
1. A data display method, characterized in that it is applied to a vehicle-mounted central control system, the method comprising:
acquiring a display instruction, and switching the screen throwing state from a closed state to a display state according to the display instruction;
obtaining target video data from a system cache, the target video data comprising: decoding information and a target key frame, wherein the target key frame is the last frame key frame acquired before state switching;
analyzing and displaying the target key frame according to the decoding information;
acquiring video data from a terminal;
analyzing the video data according to the decoding information, and displaying a corresponding video stream after the target key frame;
wherein the last frame key frame comprises: before switching operation of switching the screen throwing state from the display state to the closing state is performed, the system acquires a corresponding last frame I frame in the video data acquired by the terminal;
the decoding information includes: a sequence parameter set and an image parameter set;
the analyzing and displaying the target key frame according to the decoding information includes:
determining target decoding parameters corresponding to the target key frames from the sequence parameter set and the image parameter set;
and analyzing the target key frame according to the target decoding parameters and displaying the target key frame.
2. The data display method according to claim 1, characterized in that the method further comprises:
acquiring a closing instruction, switching the screen throwing state from a display state to a closing state according to the closing instruction, and acquiring a last frame key frame corresponding to the video data acquired before state switching;
and replacing the target key frame in the system cache with the last frame key frame.
3. The data display method according to claim 1, wherein the video data includes a reference frame and a key frame;
the parsing the video data according to the decoding information, displaying the corresponding video stream after the target key frame, includes:
determining decoding parameters corresponding to the reference frame and the key frame from the sequence parameter set and the image parameter set respectively;
and according to the decoding parameters, analyzing the reference frame and the key frame in sequence, and displaying and analyzing after the target key frame to generate a video stream.
4. The data display method according to claim 2, wherein the acquiring a closing instruction includes:
responding to the click operation of the user on the closing control, and generating a closing instruction;
alternatively, the acquiring the closing instruction includes:
responding to the click operation of the closing button by the user, and generating a closing instruction;
or, the acquiring the closing instruction includes:
and responding to the reverse gear shifting operation of the user on the vehicle gear, and generating a closing instruction.
5. The data display method according to claim 1, characterized in that the method further comprises:
establishing communication connection with the terminal;
and when the display instruction is acquired for the first time after the communication connection is established, caching the target video data acquired from the terminal.
6. A data display device for use in an on-board central control system, the device comprising:
the instruction acquisition module is used for acquiring a display instruction and switching the screen throwing state from the closing state to the display state according to the display instruction;
the first data acquisition module is used for acquiring target video data from the system cache, wherein the target video data comprises: decoding information and a target key frame, wherein the target key frame is the last frame key frame acquired before state switching;
the key frame analysis module is used for analyzing and displaying the target key frame according to the decoding information;
the second data acquisition module is used for acquiring video data from the terminal;
the video stream analyzing module is used for analyzing the video data according to the decoding information and displaying a corresponding video stream after the target key frame;
wherein the last frame key frame comprises: before switching operation of switching the screen throwing state from the display state to the closing state is performed, the system acquires a corresponding last frame I frame in the video data acquired by the terminal;
the decoding information includes: a sequence parameter set and an image parameter set;
the video stream parsing module includes:
the decoding parameter acquisition sub-module is used for respectively determining decoding parameters corresponding to the reference frame and the key frame from the sequence parameter set and the image parameter set;
and the video stream analysis sub-module is used for sequentially analyzing the reference frame and the key frame according to the decoding parameters and displaying and analyzing after the target key frame to generate a video stream.
7. The data display device of claim 6, wherein the instruction acquisition module is further configured to:
acquiring a closing instruction, switching the screen throwing state from a display state to a closing state according to the closing instruction, and acquiring a last frame key frame corresponding to the video data acquired before state switching;
and replacing the target key frame in the system cache with the last frame key frame.
8. An electronic device, comprising:
one or more processors;
a memory;
one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs configured to perform the method of any of claims 1-5.
9. A computer readable storage medium storing a computer program for use in connection with an electronic device, the computer program being executable by a processor to perform the method of any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111649852.XA CN114567802B (en) | 2021-12-29 | 2021-12-29 | Data display method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111649852.XA CN114567802B (en) | 2021-12-29 | 2021-12-29 | Data display method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114567802A CN114567802A (en) | 2022-05-31 |
| CN114567802B true CN114567802B (en) | 2024-02-09 |
Family
ID=81711433
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111649852.XA Active CN114567802B (en) | 2021-12-29 | 2021-12-29 | Data display method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114567802B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116389352A (en) * | 2023-03-17 | 2023-07-04 | 深圳市同行者科技有限公司 | Method, system and related equipment for transmitting vehicle-mounted interactive screen-throwing data |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102238232A (en) * | 2010-05-04 | 2011-11-09 | 微软公司 | Using double buffering for screen sharing |
| CN102510541A (en) * | 2011-12-30 | 2012-06-20 | Tcl数码科技（深圳）有限责任公司 | Multi-screen interaction video and audio content switching method and media player |
| JP2015149662A (en) * | 2014-02-07 | 2015-08-20 | 株式会社リコー | Data transmission system, terminal device, method, and program |
| CN108268226A (en) * | 2016-12-30 | 2018-07-10 | 乐视汽车（北京）有限公司 | The picture of synchronous terminal screen to vehicle device method, terminal and system |
| CN109218731A (en) * | 2017-06-30 | 2019-01-15 | 腾讯科技（深圳）有限公司 | The throwing screen method, apparatus and system of mobile device |
| CN111273883A (en) * | 2020-01-20 | 2020-06-12 | 北京远特科技股份有限公司 | Same-screen display method and device for multiple operating systems and terminal equipment |
| CN111314648A (en) * | 2020-02-28 | 2020-06-19 | 联想(北京)有限公司 | Information processing method, processing device, first electronic equipment and server |
| CN111694625A (en) * | 2019-03-14 | 2020-09-22 | 阿里巴巴集团控股有限公司 | Method and equipment for projecting screen to vehicle machine by vehicle box |
| CN112214186A (en) * | 2019-07-11 | 2021-01-12 | 上海博泰悦臻网络技术服务有限公司 | Information sharing method and vehicle-mounted terminal |
| CN112416278A (en) * | 2020-11-10 | 2021-02-26 | 北京五八信息技术有限公司 | Screen sharing method and device, electronic equipment and storage medium |
| WO2021092827A1 (en) * | 2019-11-14 | 2021-05-20 | 深圳爱特天翔科技有限公司 | Video signal black-screen-free switching processing method and device |
| CN113138737A (en) * | 2021-04-16 | 2021-07-20 | 阿波罗智联(北京)科技有限公司 | Display control method, device, equipment, medium and program product for screen projection scene |
| CN113395606A (en) * | 2020-03-13 | 2021-09-14 | 华为技术有限公司 | URL screen projection method and device |
| JP2021175063A (en) * | 2020-04-23 | 2021-11-01 | セイコーエプソン株式会社 | Method for controlling image display device, and image display device |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9185149B2 (en) * | 2012-06-25 | 2015-11-10 | Salesforce.Com, Inc. | Systems, methods, and apparatuses for implementing frame aggregation with screen sharing |
| DE102015002923B4 (en) * | 2015-03-06 | 2023-01-12 | Mekra Lang Gmbh & Co. Kg | Display device for a vehicle, in particular a commercial vehicle |
| US10805615B2 (en) * | 2016-12-14 | 2020-10-13 | LogMeln, Inc. | Synchronizing video signals using cached key frames |
| JP2019092110A (en) * | 2017-11-16 | 2019-06-13 | キヤノン株式会社 | Projection apparatus, communication apparatus, and control method for the apparatuses, program, and projection system |
-
2021
- 2021-12-29 CN CN202111649852.XA patent/CN114567802B/en active Active
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102238232A (en) * | 2010-05-04 | 2011-11-09 | 微软公司 | Using double buffering for screen sharing |
| CN102510541A (en) * | 2011-12-30 | 2012-06-20 | Tcl数码科技（深圳）有限责任公司 | Multi-screen interaction video and audio content switching method and media player |
| JP2015149662A (en) * | 2014-02-07 | 2015-08-20 | 株式会社リコー | Data transmission system, terminal device, method, and program |
| CN108268226A (en) * | 2016-12-30 | 2018-07-10 | 乐视汽车（北京）有限公司 | The picture of synchronous terminal screen to vehicle device method, terminal and system |
| CN109218731A (en) * | 2017-06-30 | 2019-01-15 | 腾讯科技（深圳）有限公司 | The throwing screen method, apparatus and system of mobile device |
| CN111694625A (en) * | 2019-03-14 | 2020-09-22 | 阿里巴巴集团控股有限公司 | Method and equipment for projecting screen to vehicle machine by vehicle box |
| CN112214186A (en) * | 2019-07-11 | 2021-01-12 | 上海博泰悦臻网络技术服务有限公司 | Information sharing method and vehicle-mounted terminal |
| WO2021092827A1 (en) * | 2019-11-14 | 2021-05-20 | 深圳爱特天翔科技有限公司 | Video signal black-screen-free switching processing method and device |
| CN111273883A (en) * | 2020-01-20 | 2020-06-12 | 北京远特科技股份有限公司 | Same-screen display method and device for multiple operating systems and terminal equipment |
| CN111314648A (en) * | 2020-02-28 | 2020-06-19 | 联想(北京)有限公司 | Information processing method, processing device, first electronic equipment and server |
| CN113395606A (en) * | 2020-03-13 | 2021-09-14 | 华为技术有限公司 | URL screen projection method and device |
| JP2021175063A (en) * | 2020-04-23 | 2021-11-01 | セイコーエプソン株式会社 | Method for controlling image display device, and image display device |
| CN112416278A (en) * | 2020-11-10 | 2021-02-26 | 北京五八信息技术有限公司 | Screen sharing method and device, electronic equipment and storage medium |
| CN113138737A (en) * | 2021-04-16 | 2021-07-20 | 阿波罗智联(北京)科技有限公司 | Display control method, device, equipment, medium and program product for screen projection scene |
Non-Patent Citations (2)
| Title |
|---|
| 基于Android的DLNA多屏互动系统的设计与开发;何衍;《中国优秀硕士学位论文全文数据库电子期刊》;全文 * |
| 车载信息娱乐系统软件优化与改进;朱芙蓉 等;《汽车实用技术》;第46卷(第23期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114567802A (en) | 2022-05-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11711623B2 (en) | Video stream processing method, device, terminal device, and computer-readable storage medium | |
| CN101740084B (en) | Clipping method and mobile terminal of multi-media segment | |
| US8713472B2 (en) | Display apparatus, a method for a display control, and program | |
| CN112165632B (en) | Video processing method, device and equipment | |
| KR101646958B1 (en) | Media encoding using changed regions | |
| US20090096927A1 (en) | System and method for video coding using variable compression and object motion tracking | |
| CN112261226A (en) | Horizontal screen interaction method and device, electronic equipment and storage medium | |
| US20160021338A1 (en) | Method for performing a video talk enhancement function and an electric device having the same | |
| KR20080085008A (en) | Method and system for enabling a user to play a large screen game by means of a mobile device | |
| CN105992005A (en) | Video decoding method and device and terminal device | |
| CN106598514B (en) | Method and system for switching virtual reality mode in terminal equipment | |
| US11785195B2 (en) | Method and apparatus for processing three-dimensional video, readable storage medium and electronic device | |
| CN110740261A (en) | Video recording method, device, terminal and storage medium | |
| CN114567802B (en) | Data display method and device | |
| US9055272B2 (en) | Moving image reproduction apparatus, information processing apparatus, and moving image reproduction method | |
| CN112866782A (en) | Video playing method, video playing device and electronic equipment | |
| CN115719586A (en) | Screen refresh rate adjusting method and device, electronic equipment and storage medium | |
| CN111367598B (en) | Method and device for processing action instruction, electronic equipment and computer readable storage medium | |
| CN113596583A (en) | Video stream bullet time data processing method and device | |
| KR102139331B1 (en) | Apparatus, server, and method for playing moving picture contents | |
| JP5071061B2 (en) | Digital tv receiver | |
| CN113141480A (en) | Screen recording method, device, equipment and storage medium | |
| CN101009894B (en) | Method for displaying information regarding the condition of a portable terminal | |
| CN115494996B (en) | Interaction method, interaction equipment and vehicle | |
| CN115767159A (en) | Screen projection method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |