CN112911337B - Method and device for configuring video cover pictures of terminal equipment - Google Patents

Method and device for configuring video cover pictures of terminal equipment Download PDF

Info

Publication number
CN112911337B
CN112911337B CN202110118428.6A CN202110118428A CN112911337B CN 112911337 B CN112911337 B CN 112911337B CN 202110118428 A CN202110118428 A CN 202110118428A CN 112911337 B CN112911337 B CN 112911337B
Authority
CN
China
Prior art keywords
decoding
test
picture
terminal device
format
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110118428.6A
Other languages
Chinese (zh)
Other versions
CN112911337A (en
Inventor
邢凯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Dajia Internet Information Technology Co Ltd
Original Assignee
Beijing Dajia Internet Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Dajia Internet Information Technology Co Ltd filed Critical Beijing Dajia Internet Information Technology Co Ltd
Priority to CN202110118428.6A priority Critical patent/CN112911337B/en
Publication of CN112911337A publication Critical patent/CN112911337A/en
Application granted granted Critical
Publication of CN112911337B publication Critical patent/CN112911337B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display

Abstract

The disclosure provides a method and a device for configuring a video cover picture of a terminal device. The method comprises the following steps: the method comprises the steps that a terminal device sends decoding test result information and cover picture request information to a server, wherein the decoding test result information is obtained by decoding a test picture through the terminal device; determining the format of a video cover picture for the terminal equipment of the same model by a server according to decoding test result information of a plurality of terminal equipment of the same model; the server sends the information about the video cover picture corresponding to the format of the determined video cover picture to the terminal equipment; and acquiring the video cover picture by the terminal equipment according to the received information about the video cover picture. The method can determine the format of the video cover picture according to the performance of the terminal equipment, and can display the video cover picture faster.

Description

Method and device for configuring video cover pictures of terminal equipment
Technical Field
The disclosure relates to the technical field of internet, and in particular relates to a method, a device and a system for configuring camera configuration parameters of terminal equipment.
Background
With the vigorous development of the short video and live broadcast industries, various video playing services occupy a large amount of Internet surfing time and network traffic of people. On the consumption side, the video watching jamming condition and clarity greatly influence the consumption experience of the user. For example, in a short video service, a cover picture of a video is the first step of watching the video, and a user selects to search the video through the cover picture and decides whether to watch the video, so that the loading speed of the cover picture of the video greatly influences the consumption experience of the user.
The format of the picture has a great influence on the loading speed. For example, the heif picture format employs a coding format of High Efficiency Video Coding (HEVC), with a compression ratio of 90% less than the commonly used cover picture format jpeg and 30% less than webp. The adoption of the cover picture with the high compression ratio can obviously reduce the time consumption of picture downloading, but HEVC coding complexity is high, and performance problems possibly exist on terminal equipment with certain models, so that the problems of slow picture display and the like are caused.
In the related art, this problem is solved by means of a model blacklist: and adding the models which do not support the decoding of the specific picture format or have poor performance into a blacklist, and only issuing cover pictures in a default general format for the models. This approach may lead to a problem of reduced user experience due to the inability to update the blacklist in time.
Disclosure of Invention
The disclosure provides a method, a device and a system for configuring video cover pictures of terminal equipment.
According to a first aspect of the present disclosure, there is provided a method for configuring a video cover picture of a terminal device, comprising: transmitting decoding test result information and cover picture request information to a server, wherein the decoding test result information is obtained by decoding a test picture through terminal equipment; and receiving information about the video cover picture from the server, and acquiring the video cover picture according to the received information about the video cover picture, wherein the acquired video cover picture has a predetermined format, and the predetermined format is determined by the server according to decoding test result information transmitted by a plurality of terminal devices of the same model of the terminal device.
According to a first aspect of the disclosure, the method further comprises: transmitting a decoding test request including model information of the terminal device to a server, and receiving decoding test configuration information as a response from the server; performing a decoding operation for the test picture to obtain decoding test result information in response to the decoding test configuration information indicating that a decoding test is performed; and in response to the decoding test configuration information indicating that the decoding test is not performed, directly sending cover picture request information to a server without performing a decoding operation for the test picture.
According to a first aspect of the present disclosure, the terminal device transmits cover picture request information to a server while transmitting decoding test result information within a predetermined period of time after a cold start, wherein the terminal device does not transmit the decoding test result information any more in response to transmitting the decoding test result information a predetermined number of times to the server or the predetermined period of time has elapsed.
According to a first aspect of the disclosure, the test pictures include still and/or moving pictures in at least one format, each format having a particular resolution, frame rate and encoding scheme.
According to the first aspect of the disclosure, the decoding test result information includes model information of the terminal device, an encoding mode of the test picture, a picture resolution, a frame rate, and decoding time consumption.
According to a first aspect of the disclosure, the information about the video cover picture includes a download address indicating the video cover picture having the predetermined format, and the acquiring the video cover picture from the received information about the video cover picture includes: downloading the encoded video cover picture from the downloading address of the video cover picture, decoding the encoded video cover picture and rendering the decoded video cover picture to a picture control for video.
According to a second aspect of the present disclosure, there is provided a terminal device comprising: the cover request module is configured to send decoding test result information and cover picture request information to the server, wherein the decoding test result information is obtained by decoding a test picture through the terminal equipment; and the cover acquisition module is configured to receive the information about the video cover picture from the server and acquire the video cover picture according to the received information about the video cover picture, wherein the video cover picture acquired by the cover acquisition module has a preset format, and the preset format is determined by the server according to decoding test result information sent by a plurality of terminal devices with the same model of the terminal device.
According to a second aspect of the present disclosure, the terminal device further includes: a test module configured to transmit a decoding test request including model information of the terminal device to a server, and receive decoding test configuration information as a response from the server, wherein the decoding test is performed in response to the decoding test configuration information indicating that a decoding test is performed, the test module performing a decoding operation for a test picture to obtain decoding test result information; and responding to the decoding test configuration information to indicate that the decoding test is not executed, and not executing decoding operation for the test picture by the test module, wherein the cover request module directly sends cover picture request information to the server.
According to a second aspect of the present disclosure, the cover request module transmits cover picture request information to the server while transmitting decoding test result information for a predetermined period of time after a cold start, wherein the cover request module no longer transmits the decoding test result information in response to transmitting the decoding test result information to the server a predetermined number of times or the predetermined period of time has elapsed.
According to a second aspect of the disclosure, the test pictures include still and/or moving pictures in at least one format, each format having a particular resolution, frame rate and encoding scheme.
According to a second aspect of the present disclosure, the decoding test result information includes model information of the terminal device, an encoding mode of the test picture, a picture resolution, a frame rate, and decoding time consumption.
According to a second aspect of the disclosure, the information about the video cover picture includes a download address indicating the video cover picture having a predetermined encoding format, and the cover acquisition module is configured to download the encoded video cover picture from the download address of the video cover picture, decode the encoded video cover picture, and render the decoded video cover picture to a picture control for the video.
According to a third aspect of the present disclosure, there is provided a method for configuring a video cover picture of a terminal device, comprising: receiving decoding test result information and cover picture request information aiming at a test picture from a plurality of terminal devices with the same model of the terminal device; determining the format of a video cover picture of the terminal equipment aiming at the model according to the decoding test result information of the plurality of terminal equipment; and sending the information about the video cover picture corresponding to the determined format of the video cover picture to the terminal equipment.
According to a third aspect of the disclosure, the method further comprises: receiving a decoding test request comprising model information of the terminal equipment from the terminal equipment, and determining an identifier corresponding to the model of the terminal equipment; transmitting decoding test configuration information including information indicating to perform decoding tests to the terminal device in response to determining that the identification indicates to perform decoding tests; and in response to determining that the identification indicates that the decoding test is not performed, transmitting decoding test configuration information including information indicating that the decoding test is not performed to the terminal device.
According to the third aspect of the present disclosure, when the number of times the decoding test has been performed for the same model of terminal device of the terminal device exceeds a predetermined value, the identification corresponding to the model of terminal device indicates that the decoding test is not performed; when the number of times that the decoding test has been performed for the same model of terminal device of the terminal device does not exceed the predetermined value, the identification corresponding to the model of terminal device indicates that the decoding test has been performed.
According to a third aspect of the present disclosure, the test pictures include still pictures and/or moving pictures downloaded from a server in at least one format, each format having a specific resolution, frame rate and encoding scheme.
According to a third aspect of the present disclosure, the decoding test result information includes model information of the terminal device, an encoding mode of the test picture, a picture resolution, a frame rate, and decoding time consumption.
According to a third aspect of the disclosure, the determining a format of a video cover picture for the model of the terminal device includes: determining average decoding time consumption of the terminal equipment of the model for the test picture according to decoding test result information received from the plurality of terminal equipment; and determining the format of the video cover picture of the terminal equipment of the model according to the average decoding time consumption of the tested picture.
According to a third aspect of the disclosure, the determining the format of the video cover picture for the model of the terminal device according to the average decoding time consumption for the test picture comprises: in response to determining that the average decoding time consumption corresponding to the format of the test picture is less than a threshold, determining the format of the test picture as the format of the video cover picture for the terminal device of the model; in response to determining that the average decoding time consumption corresponding to the format of the test picture exceeds a threshold, determining a default format as the format of the video cover picture for the model of the terminal device.
According to a third aspect of the disclosure, the determining the format of the video cover picture for the model of the terminal device according to the average decoding time consumption for the test picture includes: determining at least one format of the test picture that has an average decoding time consumption less than a threshold; and determining the format of the test picture with the highest priority in the at least one format as the format of the video cover picture of the terminal equipment with the model.
According to a fourth aspect of the present disclosure, there is provided a server for configuring a video cover picture of a terminal device, comprising: a receiving module configured to receive decoding test result information and cover picture request information for a test picture from a plurality of terminal devices of the same model of the terminal device; the determining module is configured to determine the format of the video cover picture of the terminal equipment with the model according to the decoding test result information of the plurality of terminal equipment; and the sending module is configured to send the information about the video cover picture corresponding to the determined format of the video cover picture to the terminal equipment.
According to a fourth aspect of the disclosure, the server further comprises a test request processing module configured to: receiving a decoding test request comprising model information of the terminal equipment from the terminal equipment and determining an identifier corresponding to the model of the terminal equipment; transmitting decoding test configuration information including information indicating to perform decoding tests to the terminal device in response to determining that the identification indicates to perform decoding tests; and in response to determining that the identification indicates that the decoding test is not performed, transmitting decoding test configuration information including information indicating that the decoding test is not performed to the terminal device.
According to the fourth aspect of the present disclosure, when the number of times the decoding test has been performed for the same model of terminal device of the terminal device exceeds a predetermined value, the identification corresponding to the model of terminal device indicates that the decoding test is not performed; when the number of times that the decoding test has been performed for the same model of terminal device of the terminal device does not exceed the predetermined value, the identification corresponding to the model of terminal device indicates that the decoding test has been performed.
According to a fourth aspect of the present disclosure, the test pictures include still and/or moving pictures having at least one format, each format of the still and/or moving pictures having a particular resolution, frame rate and encoding scheme.
According to a fourth aspect of the present disclosure, the decoding test result information includes model information of the terminal device, an encoding mode of the test picture, a picture resolution, a frame rate, and decoding time consumption.
According to a fourth aspect of the disclosure, the determining module comprises: the decoding time consumption determining module is configured to determine average decoding time consumption of the terminal equipment of the model for the test pictures according to decoding test result information received from the plurality of terminals; and the format determining module is used for determining the format of the video cover picture of the terminal equipment with the model according to the average decoding time consumption of the test picture.
According to a fourth aspect of the disclosure, the format determination module is configured to: in response to determining that the average decoding time consumption corresponding to the format of the test picture is less than a threshold, determining the format of the test picture as the format of the video cover picture for the terminal device of the model; in response to determining that the average decoding time consumption corresponding to the format of the test picture exceeds a threshold, determining a default format as the format of the video cover picture for the model of the terminal device.
According to a fourth aspect of the disclosure, the format determination module is configured to: determining at least one format of the test picture that has an average decoding time consumption less than a threshold; and determining the format of the test picture with the highest priority in the at least one format as the format of the video cover picture of the terminal equipment with the model.
According to a fifth aspect of the present disclosure, there is provided a method for configuring a video cover picture of a terminal device, comprising: decoding is carried out on the test pictures by the terminal equipment, decoding test result information is generated, and the decoding test result information is sent to the server; determining formats of video cover pictures of terminal equipment aiming at the model by a server according to decoding test result information of a plurality of terminal equipment with the same model of the terminal equipment, and transmitting information about the video cover pictures corresponding to the determined formats of the video cover pictures to the terminal equipment in response to a request of the terminal equipment for the video cover pictures; and acquiring the video cover picture by the terminal equipment according to the received information about the video cover picture.
According to a sixth aspect of the present disclosure, there is provided a system for configuring a video cover picture of a terminal device, comprising: the terminal equipment is configured to send decoding test result information and cover picture request information to a server, wherein the decoding test result information is obtained by decoding a test picture through the terminal equipment; and the server is configured to determine the format of the video cover picture of the terminal equipment aiming at the model according to decoding test result information of a plurality of terminal equipment with the same model of the terminal equipment, and send information about the video cover picture corresponding to the determined format of the video cover picture to the terminal equipment, wherein the terminal equipment acquires the video cover picture according to the received information about the video cover picture.
According to a seventh aspect of the present disclosure, there is provided an electronic device comprising: at least one processor; at least one memory storing computer-executable instructions, wherein the computer-executable instructions, when executed by the at least one processor, cause the at least one processor to perform the video cover picture configuration method as described above.
According to an eighth aspect of the present disclosure, there is provided a storage medium, which when executed by a processor of a terminal device/server, enables the terminal device/server to perform the video cover picture configuration method as described above.
According to a ninth aspect of the present disclosure, there is provided a computer program product, characterized in that instructions in the computer program product are executed by at least one processor in a terminal device/server to perform the video cover picture configuration method as described above.
The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects: the format of the video cover suitable for being displayed on the terminal equipment of the same model is determined according to decoding test results of pictures of the preset format from the terminal equipment of the same model, so that the display speed of the pictures of the video cover is improved, and the user experience is improved. In addition, the method for configuring the video cover does not need manual maintenance, can automatically update the newly-appearing equipment in time, and improves the efficiency of configuring the video cover picture.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure and do not constitute an undue limitation on the disclosure.
Fig. 1 is a system environment illustrating configuring a video cover picture of a terminal device according to an exemplary embodiment.
Fig. 2 is a flowchart illustrating a method of configuring a video cover picture of a terminal device performed by the terminal device according to an exemplary embodiment.
Fig. 3 is a flowchart illustrating a method of configuring a video cover picture of a terminal device performed by a server according to an exemplary embodiment.
Fig. 4 is a block diagram illustrating a terminal device according to an exemplary embodiment.
Fig. 5 is a block diagram illustrating a server according to an exemplary embodiment.
Fig. 6 is a schematic diagram illustrating a terminal device for performing a camera parameter configuration method according to an exemplary embodiment.
Fig. 7 is a schematic diagram illustrating a server for performing a method of configuring a video cover picture of a terminal device according to an exemplary embodiment.
Fig. 8 is a flowchart illustrating a method of configuring a video cover picture of a terminal device according to an exemplary embodiment.
Fig. 9 is a diagram illustrating a system for configuring a video cover picture of a terminal device according to an exemplary embodiment.
Detailed Description
In order to enable those skilled in the art to better understand the technical solutions of the present disclosure, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.
It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the foregoing figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the disclosure described herein may be capable of operation in sequences other than those illustrated or described herein. The embodiments described in the examples below are not representative of all embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as detailed in the accompanying claims.
It should be noted that, in this disclosure, "at least one of the items" refers to a case where three types of juxtaposition including "any one of the items", "a combination of any of the items", "an entirety of the items" are included. For example, "including at least one of a and B" includes three cases side by side as follows: (1) comprises A; (2) comprising B; (3) includes A and B. For example, "at least one of the first and second steps is executed", that is, three cases are juxtaposed as follows: (1) performing step one; (2) executing the second step; (3) executing the first step and the second step.
Fig. 1 illustrates a system environment implementing a method and apparatus for configuring a video cover picture of a terminal device according to an exemplary embodiment of the present disclosure. As shown in fig. 1, the system environment may include a plurality of terminal apparatuses 100-1, 100-2, … 100-n, a server 200. Here, the terminal device 100 may be a terminal device having a communication function and a camera function, and for example, the terminal device 100 in the embodiment of the present disclosure may be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, a netbook, a personal digital assistant (personal digital assistant, PDA), an augmented reality (augmented reality, AR)/a Virtual Reality (VR) device. Various video playing applications may be run on the terminal device 100, such as a short video application, a live application, a social application, a video conferencing application, an online education application, and the like. The terminal device 100 is connected to and communicates with the server 200 through a network while running the applications, thereby using the corresponding video services provided by the server 200.
According to an exemplary embodiment of the present disclosure, the plurality of terminal apparatuses 100-1, 100-2, … 100-n may determine decoding performance for a picture of a specific format by decoding a test picture, and transmit the test result to the server 200 through a network. N terminal apparatuses of the same model may be provided in the terminal apparatuses 100-1, 100-2, … 100-N, so that the server 200 may statistically obtain data on performance of the terminal apparatuses 100 of the same model when decoding pictures of a specific format, and may further make a decision based on the data to determine an optimal video cover format for a terminal apparatus of a certain model. For example, for a particular model of smartphone, the server 200 may collect thousands of test data recorded by the smartphone in decoding pictures in the HEIF encoding format, and determine from the collected test data whether the model of smartphone has a better performance for decoding pictures in the HEIF encoding format. A method of configuring a video cover picture performed at a terminal device and a method of determining a video cover picture performed at a server will be described with reference to fig. 2 and 3, respectively.
Fig. 2 illustrates a flowchart of a method of configuring a video cover picture performed by a terminal device according to an exemplary embodiment of the present disclosure. In the following description, a smartphone is described as an example of a terminal device, but the present disclosure is not limited thereto. The method of configuring a video cover picture according to an exemplary embodiment of the present disclosure may be performed by an application installed in a terminal device. For example, the method may be performed at the time of a cold start application, so that the configuration for the video cover picture may be predetermined before the video cover picture is loaded, without affecting the playback of the video.
Specifically, first, in step S210, decoding test result information obtained by performing decoding on a test picture by a terminal device and cover picture request information are transmitted to a server.
Next, in step S220, information about the video cover picture is received from the server, and the video cover picture is acquired according to the received information about the video cover picture.
According to an exemplary embodiment of the present disclosure, the terminal device may transmit the cover picture request information to the server while transmitting the decoding test result information within a predetermined period of time after the cold start, wherein the terminal device does not transmit the decoding test result information any more in response to transmitting the decoding test result information to the server a predetermined number of times or the predetermined period of time elapses.
For example, when the user installs the video application and opens the video application for the first time, the video application may perform decoding for the test picture and generate decoding test result information at step S210. The test picture here may be a picture having at least one format stored in advance in the terminal device. For example, at least one format of the test picture may be stored in the terminal device at the time of installing the application, and the test picture may also be downloaded in advance from the server according to an exemplary embodiment of the present disclosure. In this way, the format of the test picture can be configured at the server end and issued to the terminal equipment, so that the decoding performance can be tested for the terminal equipment more flexibly.
According to an exemplary embodiment of the present disclosure, the format of the picture may include at least an encoding manner of the picture. For example, the format of the test picture may be a HEIF encoded picture, a WEBP encoded picture, or a JPEG encoded picture. It should be understood that the encoding method of the picture is not limited to the above encoding method. The decoding test result information may include at least decoding time-consuming information of the terminal device for a test picture of a certain format. If the tested picture has a plurality of formats, the decodable test result information may include a decoding time-consuming information table corresponding to each format.
According to an exemplary embodiment of the present disclosure, the test pictures may include still pictures and/or moving pictures having at least one format, each having a specific resolution, frame rate, and encoding scheme. Accordingly, the decoding test result information may include information such as model information of the terminal device, encoding mode of the test picture, picture resolution, frame rate, decoding time consumption, and the like. Here, decoding time-consuming refers to time taken from the start of decoding the test picture to the completion of display of the test picture.
It should be understood that the various picture characteristics included in the format of the test pictures mentioned above are merely illustrative, and that one skilled in the art may employ pictures having other characteristics as test pictures according to test needs. It should be understood that the above-mentioned information items included in the decoding test result information are also only illustrative, and those skilled in the art may add or reduce the information items included in the decoding test result information according to the test needs, for example, may add information such as memory occupancy and/or CPU occupancy as the decoding test result information, or may use a test picture of uniform resolution without adding picture resolution information, etc., to which exemplary embodiments of the present disclosure are not limited. For example, if the test picture is a moving picture encoded in the HEIF mode, with a resolution of 1080p and a frame rate of 30fps, the decoding test result information may include model information of the terminal device, the encoding mode information HEIF, the resolution information 1080p, and the frame rate information of 30fps, and decoding time consumption of the test picture for the format.
According to an exemplary embodiment of the present disclosure, the generated decoding test result information and cover picture request information may be transmitted to the server according to a predetermined protocol through the communication unit of the terminal device at step S210. For example, the terminal device may access a network (e.g., a 3G, 4G, 5G mobile communication network) through the communication unit, so that a video application running on the terminal device may transmit decoding test result information and cover picture request information to the server through a preset protocol such as HTTP protocol. In this way, after the server receives the decoding test result information from the plurality of terminal devices, the format of the video cover picture for the terminal device can be determined according to the decoding test performance of the terminal devices of the same model for the picture of the predetermined format.
According to an exemplary embodiment of the present disclosure, before performing the decoding test (S210), the terminal device may transmit a decoding test request including model information of the terminal device to the server and receive decoding test configuration information as a response from the server. And the terminal equipment performs decoding operation on the test picture to obtain decoding test result information in response to the decoding test configuration information indicating that the decoding test is performed, and directly requests the server to acquire the video cover picture without performing the decoding operation on the test picture in response to the decoding test configuration information indicating that the decoding test is not performed. In this way, if it is determined at the server side that enough decoding test result information has been received from the terminal device of the model in the previous process, the performance of the terminal device of the model is known and the format of the video cover picture available for the terminal device is determined, the terminal device can be notified to skip the step of the test, thereby avoiding repeated execution of the test each time the video application is opened.
According to an exemplary embodiment of the present disclosure, if the decoding test configuration information indicates that the decoding test needs to be performed, the decoding test configuration information may further include an address for downloading the test picture, so that the terminal device may acquire the picture for performing the test according to the address.
According to an exemplary embodiment of the present disclosure, the received information about the video cover picture may include a download address indicating a video cover picture having a predetermined format (e.g., a Uniform Resource Locator (URL) for downloading the video cover picture) such that, after receiving the download address of the video cover picture, the terminal device may download the encoded video cover picture from the download address, decode the encoded video cover picture and render the decoded video cover picture to a picture control for video at step S220. Here, the server determines a format of a video cover picture suitable for the terminal device based on decoding test result information transmitted by a plurality of terminal devices of the same model of the terminal device. For example, if it is determined from the test result information that the terminal device has poor decoding performance (for example, decoding takes more time than a threshold or the memory occupancy is too high) for the test picture with the resolution of 1080p and the frame rate of 30fps of the HEIF encoding, the server may send the address of the video cover picture in other formats. For example, the address of a WEBP-encoded or JPEG encoded video cover picture may be transmitted.
As described above, since the decoding test is performed on the test picture in the predetermined format, the server can determine the format of the cover picture suitable for the terminal device, so that the loading speed of the cover picture for loading the video can be increased, and a better experience is brought to the user.
A method of configuring a video cover picture of a terminal device performed by a server according to an exemplary embodiment of the present disclosure will be described below with reference to fig. 3.
According to an exemplary embodiment of the present disclosure, the server may be a server for providing a service related to video. For example, the server may be a server that provides services related to a short video application, a live application, a social application, a video conferencing application, an instant messaging application, or an online educational application. The server may acquire various information from the terminal device through communication interaction with an application installed in the terminal device.
As shown in fig. 3, in step S310, the server receives decoding test result information and cover picture request information for a test picture from a plurality of terminal devices of the same model of the terminal device. As shown in fig. 1, the server 200 may receive decoding test result information from a plurality of terminal apparatuses 100-1, 100-2, 100-3, … 100-n, wherein decoding test results of terminal apparatuses of the same signals among the plurality of terminal apparatuses 100-1, 100-2, 100-3, … 100-n may be obtained.
According to an exemplary embodiment of the present disclosure, decoding test identifications for various models of terminal devices may be stored in a server. Each time decoding test result information is received from a certain model of terminal device, the decoding test result information of the received model of terminal device may be counted, and if a predetermined number (e.g., 100) of decoding test result information have been collected, the decoding test identifier corresponding to the model of terminal device may be changed to indicate no decoding test.
According to an exemplary embodiment of the present disclosure, in response to determining that the identification indicates that a decoding test is performed, decoding test configuration information including information indicating that a decoding test is performed is transmitted to the terminal device; and in response to determining that the identification indicates that the decoding test is not performed, transmitting decoding test configuration information including information indicating that the decoding test is not performed to the terminal device. That is, when the number of times the decoding test has been performed for the same model of terminal device exceeds a predetermined value, the identification corresponding to the model of terminal device indicates that the decoding test is not performed, and when the number of times the decoding test has been performed for the same model of terminal device does not exceed the predetermined value, the identification corresponding to the model of terminal device indicates that the decoding test is performed.
According to an exemplary embodiment of the present disclosure, the test picture may include still pictures and/or moving pictures having at least one format downloaded from the server, each of the still pictures and/or moving pictures having a specific resolution, frame rate, and encoding scheme, and the decoding test result information may include model information of the terminal device, encoding scheme of the test picture, picture resolution, frame rate, and decoding time consumption.
Next, in step S320, the format of the video cover picture for the model terminal device is determined according to the decoding test result information of the plurality of terminal devices.
According to an exemplary embodiment of the present disclosure, an average decoding time consumption of the model terminal device for the test picture may be determined according to decoding test result information received from the plurality of terminals, and a format of a video cover picture for the model terminal device may be determined according to the average decoding time consumption for the test picture at step S320. That is, if decoding test result information is received from 100 terminal devices of the same model, an average time consumption of the 100 devices for a test picture may be calculated, and if the average time consumption is lower than a threshold value, a format in which the test picture may be used as a format of a video cover picture of the terminal device of the model is determined.
According to an exemplary embodiment of the present disclosure, the format of the test picture is determined to be the format of the video cover picture for the model of the terminal device in response to determining that the average decoding time consumption corresponding to the format of the test picture is less than a threshold, and the default format is determined to be the format of the video cover picture for the model of the terminal device in response to determining that the average decoding time consumption corresponding to the format of the test picture exceeds the threshold.
For example, if the test picture issued by the server is a HEIF encoded picture and the decoding test result information received from the terminal device indicates that the decoding time consumption of the terminal device for the HEIF encoded test picture is above a threshold, the server may determine that it is not suitable to apply the HEIF encoded cover picture on the terminal device. At this time, a cover picture such as a JPEG encoding format may be used as a default cover picture.
According to an exemplary embodiment of the present disclosure, if the test pictures issued by the server have a plurality of formats, the server may determine at least one format of the test pictures having average decoding time less than a threshold value, and determine the format of the test picture having the highest priority among the at least one format as the format of the video cover picture for the terminal device of the model. Here, the priority may be a preference order for pictures of different formats set according to a predetermined rule.
For example, for coding schemes, the priority ordering may be HEIF > WEBP > JPEG, for resolutions, 1080p >720p >480p, for frame rates, 30fps >20fps >10fps. In this way, the priorities of the various formats of the test pictures can be determined. For example, if the test pictures are HEIF encoded, 1080p resolution, 30fps frame rate motion pictures and WEBP encoded, 1080p resolution, 30fps frame rate motion pictures, both of which are less than a threshold decoding time consuming, the server may determine the higher priority HEIF encoded, 1080p resolution, 30fps frame rate as the format of the video cover picture for the model of terminal device.
Then, in step S330, information about the video cover picture corresponding to the determined format of the video cover picture is transmitted to the terminal device. According to an exemplary embodiment of the present disclosure, when a request for a video cover picture is received from a terminal device, information about the video cover picture corresponding to the determined format of the video cover picture may be transmitted to the terminal device. The information about the video cover picture includes a download address indicating the video cover picture having a predetermined encoding format so that the terminal device can acquire the video cover from the corresponding download address.
As described above, according to the method of the exemplary embodiments of the present disclosure, a server may determine a format of a video cover suitable for display on a terminal device of the same model according to decoding test results for pictures of a predetermined format from a plurality of terminal devices of the same model, thereby improving a presentation speed of the video cover pictures and improving user experience. In addition, the method for configuring the video cover does not need manual maintenance, can automatically update the newly-appearing equipment in time, and improves the efficiency of configuring the video cover picture.
Fig. 4 is a block diagram illustrating a terminal device 400 according to an exemplary embodiment. As shown in fig. 4, a terminal device 400 according to an exemplary embodiment of the present disclosure includes: the cover request module 410 is configured to decode test result information and cover picture request information, where the decoded test result information is obtained by performing decoding on a test picture by a terminal device; the cover acquisition module 420 is configured to receive information about the video cover picture from the server and acquire the video cover picture according to the received information about the video cover picture, wherein the video cover picture acquired by the cover acquisition module has a predetermined format, and the predetermined format is determined by the server according to decoding test result information sent by a plurality of terminal devices of the same model of the terminal device.
According to an exemplary embodiment of the present disclosure, the terminal device 400 may further include: a test module 430 configured to transmit a decoding test request including model information of the terminal device to a server, and receive decoding test configuration information as a response from the server, wherein the test module 430 performs a decoding operation for a test picture to obtain decoding test result information in response to the decoding test configuration information indicating that a decoding test is performed; in response to the decoding test configuration information indicating that the decoding test is not performed, the test module 430 does not perform a decoding operation for the test picture, and the cover acquisition module 420 directly transmits cover picture request information to the server.
According to an exemplary embodiment of the present disclosure, the cover request module 410 transmits cover picture request information to the server while transmitting decoding test result information for a predetermined period of time after a cold start, wherein the cover request module 410 does not transmit the decoding test result information any more in response to transmitting the decoding test result information to the server a predetermined number of times or the predetermined period of time elapses.
According to an exemplary embodiment of the present disclosure, the test pictures include still and/or moving pictures having at least one format, each format of the still and/or moving pictures having a specific resolution, frame rate, and encoding scheme.
According to an exemplary embodiment of the present disclosure, the decoding test result information includes model information of the terminal device, an encoding mode of the test picture, a picture resolution, a frame rate, and decoding time consumption.
According to an exemplary embodiment of the present disclosure, the information about the video cover picture includes a download address indicating the video cover picture having a predetermined encoding format, and the cover acquisition module 420 is configured to download the encoded video cover picture from the download address of the video cover picture, decode the encoded video cover picture, and render the decoded video cover picture to a picture control for the video.
Fig. 5 is a block diagram illustrating a server 500 according to an exemplary embodiment of the present disclosure. As shown in fig. 5, the server 500 may be implemented as the server 200 in fig. 1. According to an exemplary embodiment of the present disclosure, the server 500 for configuring a video cover picture of a terminal device may include: a receiving module 510 configured to receive decoding test result information and cover picture request information for a test picture from a plurality of terminal devices of the same model of the terminal device; a determining module 520 configured to determine a format of a video cover picture for the model terminal device according to decoding test result information of the plurality of terminal devices; and the sending module 530 is configured to send information about the video cover picture corresponding to the determined format of the video cover picture to the terminal device.
According to an exemplary embodiment of the present disclosure, the server 500 may further include a test request processing module 530 configured to: receiving a decoding test request including model information of a terminal device (e.g., 100-1 in fig. 2) from the terminal device and determining an identification corresponding to the model of the terminal device; transmitting decoding test configuration information including information indicating to perform decoding tests to the terminal device in response to determining that the identification indicates to perform decoding tests; and in response to determining that the identification indicates that the decoding test is not performed, transmitting decoding test configuration information including information indicating that the decoding test is not performed to the terminal device.
According to an exemplary embodiment of the present disclosure, when the number of times that the decoding test has been performed for the same model of the terminal device exceeds a predetermined value, the identification corresponding to the model of the terminal device indicates that the decoding test is not performed; when the number of times that the decoding test has been performed for the same model of terminal device of the terminal device does not exceed the predetermined value, the identification corresponding to the model of terminal device indicates that the decoding test has been performed.
According to an exemplary embodiment of the present disclosure, the test pictures include still pictures and/or moving pictures having at least one format, each of which has a specific resolution, frame rate, and encoding scheme.
According to an exemplary embodiment of the present disclosure, the decoding test result information includes model information of the terminal device, an encoding mode of the test picture, a picture resolution, a frame rate, and decoding time consumption.
According to an exemplary embodiment of the present disclosure, the determining module 520 may include: a decoding time-consuming determining module 521 configured to determine an average decoding time consuming of the terminal device of the model for the test picture according to decoding test result information received from the plurality of terminals; the format determination module 522 is configured to determine the format of the video cover picture for the model of the terminal device based on the average decoding time consumption for the test picture.
According to an exemplary embodiment of the present disclosure, the format determination module 522 is configured to: in response to determining that the average decoding time consumption corresponding to the format of the test picture is less than a threshold, determining the format of the test picture as the format of the video cover picture for the terminal device of the model; in response to determining that the average decoding time consumption corresponding to the format of the test picture exceeds a threshold, determining a default format as the format of the video cover picture for the model of the terminal device.
According to an exemplary embodiment of the present disclosure, the format determination module 522 is configured to: determining at least one format of the test picture that has an average decoding time consumption less than a threshold; and determining the format of the test picture with the highest priority in the at least one format as the format of the video cover picture of the terminal equipment with the model.
Fig. 6 is a block diagram illustrating a structure of a terminal device for configuring a video cover picture according to an exemplary embodiment of the present disclosure. The terminal device 600 may be, for example: smart phones, tablet computers, MP4 (Moving Picture Experts Group Audio Layer IV, motion picture expert compression standard audio layer 4) players, notebook computers or desktop computers. Terminal device 600 may also be referred to by other names of user devices, portable terminals, laptop terminals, desktop terminals, etc.
In general, the terminal device 600 includes: a processor 601 and a memory 602.
Processor 601 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 601 may be implemented in at least one hardware form of DSP (Digital Signal Processing ), FPGA (Field Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array ). The processor 601 may also include a main processor, which is a processor for processing data in an awake state, also called a CPU (Central Processing Unit ), and a coprocessor; a coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 601 may integrate a GPU (Graphics Processing Unit, image processor) for rendering and drawing of content required to be displayed by the display screen. In some embodiments, the processor 601 may also include an AI (Artificial Intelligence ) processor for processing computing operations related to machine learning.
The memory 602 may include one or more computer-readable storage media, which may be non-transitory. The memory 602 may also include high-speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in memory 602 is used to store at least one instruction for execution by processor 601 to implement a video cover picture configuration method provided by an exemplary embodiment of the present disclosure as described in fig. 2.
In some embodiments, the terminal device 600 may further optionally include: a peripheral interface 603, and at least one peripheral. The processor 601, memory 602, and peripheral interface 603 may be connected by a bus or signal line. The individual peripheral devices may be connected to the peripheral device interface 603 via buses, signal lines or a circuit board. Specifically, the peripheral device includes: at least one of radio frequency circuitry 604, a touch display 605, a camera 606, audio circuitry 607, a positioning component 608, and a power supply 609.
Peripheral interface 603 may be used to connect at least one Input/Output (I/O) related peripheral to processor 601 and memory 602. In some embodiments, the processor 601, memory 602, and peripheral interface 603 are integrated on the same chip or circuit board; in some other embodiments, either or both of the processor 601, memory 602, and peripheral interface 603 may be implemented on separate chips or circuit boards, which is not limited in this embodiment.
The Radio Frequency circuit 604 is configured to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 604 communicates with a communication network and other communication devices via electromagnetic signals. The radio frequency circuit 604 converts an electrical signal into an electromagnetic signal for transmission, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 604 includes: antenna systems, RF transceivers, one or more amplifiers, tuners, oscillators, digital signal processors, codec chipsets, subscriber identity module cards, and so forth. The radio frequency circuit 604 may communicate with other terminals via at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: metropolitan area networks, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and/or WiFi (Wireless Fidelity ) networks. In some embodiments, the radio frequency circuitry 604 may also include NFC (Near Field Communication, short range wireless communication) related circuitry, which is not limited by the present disclosure.
The display screen 605 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display 605 is a touch display, the display 605 also has the ability to collect touch signals at or above the surface of the display 605. The touch signal may be input as a control signal to the processor 601 for processing. At this point, the display 605 may also be used to provide virtual buttons and/or virtual keyboards, also referred to as soft buttons and/or soft keyboards. In some embodiments, the display 605 may be one and disposed on the front panel of the terminal device 600; in other embodiments, the display 605 may be at least two, respectively disposed on different surfaces of the terminal 600 or in a folded design; in still other embodiments, the display 605 may be a flexible display, disposed on a curved surface or a folded surface of the terminal 600. Even more, the display 605 may be arranged in a non-rectangular irregular pattern, i.e., a shaped screen. The display 605 may be made of LCD (Liquid Crystal Display ), OLED (Organic Light-Emitting Diode) or other materials.
The camera assembly 606 is used to capture images or video. Optionally, the camera assembly 606 includes a front camera and a rear camera. Typically, the front camera is disposed on the front panel of the terminal and the rear camera is disposed on the rear surface of the terminal. In some embodiments, the at least two rear cameras are any one of a main camera, a depth camera, a wide-angle camera and a tele camera, so as to realize that the main camera and the depth camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize a panoramic shooting and Virtual Reality (VR) shooting function or other fusion shooting functions. In some embodiments, camera assembly 606 may also include a flash. The flash lamp can be a single-color temperature flash lamp or a double-color temperature flash lamp. The dual-color temperature flash lamp refers to a combination of a warm light flash lamp and a cold light flash lamp, and can be used for light compensation under different color temperatures.
The audio circuit 607 may include a microphone and a speaker. The microphone is used for collecting sound waves of users and environments, converting the sound waves into electric signals, and inputting the electric signals to the processor 601 for processing, or inputting the electric signals to the radio frequency circuit 604 for voice communication. For the purpose of stereo acquisition or noise reduction, a plurality of microphones may be respectively disposed at different portions of the terminal 600. The microphone may also be an array microphone or an omni-directional pickup microphone. The speaker is used to convert electrical signals from the processor 601 or the radio frequency circuit 604 into sound waves. The speaker may be a conventional thin film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, not only the electric signal can be converted into a sound wave audible to humans, but also the electric signal can be converted into a sound wave inaudible to humans for ranging and other purposes. In some embodiments, the audio circuit 607 may also include a headphone jack.
The location component 608 is used to locate the current geographic location of the terminal device 600 to enable navigation or LBS (Location Based Service, location based services). The positioning component 608 may be a positioning component based on the United states GPS (Global Positioning System ), the Beidou system of China, the Granati system of Russia, or the Galileo system of the European Union.
The power supply 609 is used to power the various components in the terminal device 600. The power source 609 may be alternating current, direct current, disposable battery or rechargeable battery. When the power source 609 includes a rechargeable battery, the rechargeable battery may support wired or wireless charging. The rechargeable battery may also be used to support fast charge technology.
In some embodiments, the terminal device 600 further includes one or more sensors 610. The one or more sensors 610 include, but are not limited to: acceleration sensor 611, gyroscope sensor 612, pressure sensor 613, fingerprint sensor 614, optical sensor 615, and proximity sensor 616.
The acceleration sensor 611 can detect the magnitudes of accelerations on three coordinate axes of the coordinate system established with the terminal 600. For example, the acceleration sensor 611 may be used to detect components of gravitational acceleration in three coordinate axes. The processor 601 may control the touch display screen 605 to display a user interface in a landscape view or a portrait view according to the gravitational acceleration signal acquired by the acceleration sensor 611. The acceleration sensor 611 may also be used for the acquisition of motion data of a game or a user.
The gyro sensor 612 may detect a body direction and a rotation angle of the terminal 600, and the gyro sensor 612 may collect a 3D motion of the user on the terminal 600 in cooperation with the acceleration sensor 611. The processor 601 may implement the following functions based on the data collected by the gyro sensor 612: motion sensing (e.g., changing UI according to a tilting operation by a user), image stabilization at shooting, game control, and inertial navigation.
The pressure sensor 613 may be disposed at a side frame of the terminal 600 and/or at a lower layer of the touch screen 605. When the pressure sensor 613 is disposed at a side frame of the terminal 600, a grip signal of the terminal 600 by a user may be detected, and a left-right hand recognition or a shortcut operation may be performed by the processor 601 according to the grip signal collected by the pressure sensor 613. When the pressure sensor 613 is disposed at the lower layer of the touch screen 605, the control of the operability control on the UI is realized by the processor 601 according to the pressure operation of the user on the touch screen 605. The operability controls include at least one of a button control, a scroll bar control, an icon control, and a menu control.
The fingerprint sensor 614 is used for collecting the fingerprint of the user, and the processor 601 identifies the identity of the user according to the fingerprint collected by the fingerprint sensor 614, or the fingerprint sensor 614 identifies the identity of the user according to the collected fingerprint. Upon recognizing that the user's identity is a trusted identity, the processor 601 authorizes the user to perform relevant sensitive operations including unlocking the screen, viewing encrypted information, downloading software, paying for and changing settings, etc. The fingerprint sensor 614 may be provided on the front, back or side of the terminal device 600. When a physical key or vendor Logo is provided on the terminal device 600, the fingerprint sensor 614 may be integrated with the physical key or vendor Logo.
The optical sensor 615 is used to collect ambient light intensity. In one embodiment, processor 601 may control the display brightness of touch display 605 based on the intensity of ambient light collected by optical sensor 615. Specifically, when the intensity of the ambient light is high, the display brightness of the touch display screen 605 is turned up; when the ambient light intensity is low, the display brightness of the touch display screen 605 is turned down. In another embodiment, the processor 601 may also dynamically adjust the shooting parameters of the camera assembly 606 based on the ambient light intensity collected by the optical sensor 615.
A proximity sensor 616, also referred to as a distance sensor, is typically provided on the front panel of the terminal device 600. The proximity sensor 616 is used to collect the distance between the user and the front face of the terminal device 600. In one embodiment, when the proximity sensor 616 detects a gradual decrease in the distance between the user and the front face of the terminal 600, the processor 601 controls the touch display 605 to switch from the bright screen state to the off screen state; when the proximity sensor 616 detects that the distance between the user and the front surface of the terminal device 600 gradually increases, the processor 601 controls the touch display screen 605 to switch from the off-screen state to the on-screen state.
It will be appreciated by those skilled in the art that the structure shown in fig. 6 is not limiting of the terminal device 600 and may include more or fewer components than shown, or may combine certain components, or may employ a different arrangement of components.
Fig. 7 is a block diagram showing the structure of a server 700. Referring to fig. 7, a server 700 includes one or more processing processors 710 and memory 720. The memory 720 may include one or more programs for performing the video cover picture configuration method as described above with reference to fig. 3. The server 700 may also include a power component 730 configured to perform power management of the server 700, a wired or wireless network interface 740 configured to connect the server 700 to a network, and an input output (I/O) interface 750. The server 700 may operate based on an operating system stored in memory 720, such as Windows Server, mac OS XTM, unixTM, linuxTM, freeBSDTM, or the like.
Fig. 8 shows a flowchart of a method of configuring a video cover picture of a terminal device according to an embodiment of the present disclosure. As shown in fig. 8, the method includes:
in step S810, the terminal device sends decoding test result information and cover picture request information to the server, where the decoding test result information is obtained by decoding the test picture by the terminal device; determining the format of a video cover picture for the terminal equipment of the same model by a server according to decoding test result information of a plurality of terminal equipment of the same model; the server sends the information about the video cover picture corresponding to the format of the determined video cover picture to the terminal equipment; and acquiring the video cover picture by the terminal equipment according to the received information about the video cover picture.
In step S820, the format of the video cover picture for the terminal device of the same model is determined by the server according to the decoding test result information of the plurality of terminal devices of the same model.
In step S830, the server transmits information about the video cover picture corresponding to the determined format of the video cover picture to the terminal device.
Finally, in step S840, a video cover picture is acquired by the terminal device according to the received information about the video cover picture.
According to an exemplary embodiment of the present disclosure, the method may further include, before performing the decoding test, the terminal device may transmit a decoding test request including model information of the terminal device to the server (S801), and receive decoding test configuration information as a response from the server (S803). And the terminal equipment performs decoding test operation aiming at the test picture in response to the decoding test configuration information indicating that the decoding test is performed, and directly requests the server to acquire the video cover picture without performing the decoding operation aiming at the test picture in response to the decoding test configuration information indicating that the decoding test is not performed. The process of generating the decoding test result information and determining the cover picture format for a specific model of terminal device has been described above with reference to fig. 2 to 5, and will not be described in detail herein.
Fig. 9 illustrates a system for configuring video cover pictures of terminal devices according to an exemplary embodiment of the present disclosure, the system including a plurality of terminal devices 900-1, 900-2, 900-3, … 900-n of the same model, and a server 910. The terminal device 900 is configured to transmit decoding test result information and cover picture request information to the server, wherein the decoding test result information is obtained by the terminal device performing decoding on the test picture. The server 910 is configured to determine a format of a video cover picture for the terminal device 900 of the same model according to decoding test result information of a plurality of terminal devices 900-1, 900-2, 900-3, … -n of the terminal device, and send information about the video cover picture corresponding to the determined format of the video cover picture to the terminal device 900, wherein the terminal device 900 acquires the video cover picture according to the received information about the video cover picture. The process of generating the decoding test result information and determining the cover picture format for a specific model of terminal device has been described above with reference to fig. 2 to 5, and will not be described in detail herein.
According to an exemplary embodiment of the present disclosure, server 910 may be implemented as a distributed server such that a portion of the functions and/or processes performed by the server may be implemented in the distributed server. For example, the decoding test result information may be stored in the logging server and a corresponding decoding test result information table may be generated, so that the server 910 may read the corresponding decoding test result information table from the logging server and perform a corresponding operation when receiving a decoding test request or a jacket photograph request.
According to an embodiment of the present disclosure, there may also be provided a computer-readable storage medium storing instructions, wherein the instructions, when executed by at least one processor, cause the at least one processor to perform a method of configuring a video cover picture according to the present disclosure. Examples of the computer readable storage medium herein include: read-only memory (ROM), random-access programmable read-only memory (PROM), electrically erasable programmable read-only memory (EEPROM), random-access memory (RAM), dynamic random-access memory (DRAM), static random-access memory (SRAM), flash memory, nonvolatile memory, CD-ROM, CD-R, CD + R, CD-RW, CD+RW, DVD-ROM, DVD-R, DVD + R, DVD-RW, DVD+RW, DVD-RAM, BD-ROM, BD-R, BD-R LTH, BD-RE, blu-ray or optical disk storage, hard Disk Drives (HDD), solid State Disks (SSD), card memory (such as multimedia cards, secure Digital (SD) cards or ultra-fast digital (XD) cards), magnetic tape, floppy disks, magneto-optical data storage, hard disks, solid state disks, and any other means configured to store computer programs and any associated data, data files and data structures in a non-transitory manner and to provide the computer programs and any associated data, data files and data structures to a processor or computer to enable the processor or computer to execute the programs. The computer programs in the computer readable storage media described above can be run in an environment deployed in a computer device, such as a client, host, proxy device, server, etc., and further, in one example, the computer programs and any associated data, data files, and data structures are distributed across networked computer systems such that the computer programs and any associated data, data files, and data structures are stored, accessed, and executed in a distributed fashion by one or more processors or computers.
In accordance with embodiments of the present disclosure, a computer program product may also be provided, instructions in which are executable by a processor of a computer device to perform the above-described method.
According to the method, the device, the terminal equipment, the server and the computer readable storage medium for configuring the video cover picture, the format of the video cover suitable for being displayed on the terminal equipment of the same model can be determined according to the decoding test results of the pictures with the preset format from the plurality of terminal equipment of the same model, so that the display speed of the video cover picture is improved, and the user experience is improved. In addition, the method for configuring the video cover does not need manual maintenance, can automatically update the newly-appearing equipment in time, and improves the efficiency of configuring the video cover picture.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any adaptations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It is to be understood that the present disclosure is not limited to the precise arrangements and instrumentalities shown in the drawings, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (26)

1. A method for configuring a video cover picture of a terminal device, comprising:
transmitting a decoding test request including model information of the terminal device to a server, and receiving decoding test configuration information as a response from the server;
performing a decoding operation for the test picture to obtain decoding test result information in response to the decoding test configuration information indicating that a decoding test is performed;
transmitting decoding test result information and cover picture request information to a server, wherein the decoding test result information is obtained by decoding a test picture through terminal equipment;
receiving information about the video cover picture from the server, and acquiring the video cover picture according to the received information about the video cover picture,
wherein the acquired video cover picture has a predetermined format which is a format with the best decoding performance determined by the server according to decoding test result information transmitted by a plurality of terminal devices of the same model of the terminal device,
Wherein in response to the decoding test configuration information indicating that the decoding test is not performed, the cover picture request information is directly transmitted to the server without performing the decoding operation for the test picture,
wherein when the number of times the server has performed the decoding test for the same model of terminal equipment exceeds a predetermined value, the identification corresponding to the model of terminal equipment indicates that the decoding test is not performed, and when the number of times the decoding test has been performed for the same model of terminal equipment does not exceed the predetermined value, the identification corresponding to the model of terminal equipment indicates that the decoding test is performed.
2. The method of claim 1, wherein the terminal device transmits the cover picture request information to the server while transmitting the decoding test result information within a predetermined period of time after the cold start,
wherein the terminal device does not transmit the decoding test result information any more in response to the decoding test result information being transmitted to the server a predetermined number of times or the predetermined period of time having elapsed.
3. The method of claim 1, wherein the test pictures comprise still and/or moving pictures in at least one format, each format still and/or moving picture having a particular resolution, frame rate, and encoding scheme.
4. The method of claim 1, wherein the decoding test result information includes model information of the terminal device, a coding manner of the test picture, a picture resolution, a frame rate, and decoding time consumption.
5. The method of claim 1, wherein the information about the video cover picture includes a download address indicating the video cover picture having the predetermined format,
the acquiring the video cover picture according to the received information about the video cover picture comprises:
downloading the encoded video cover picture from the downloading address of the video cover picture, decoding the encoded video cover picture and rendering the decoded video cover picture to a picture control for video.
6. A terminal device, comprising:
a test module configured to transmit a decoding test request including model information of the terminal device to a server, and to receive decoding test configuration information as a response from the server, and to perform a decoding test in response to the decoding test configuration information indicating that a decoding operation for a test picture is performed to obtain decoding test result information;
the cover request module is configured to send decoding test result information and cover picture request information to the server, wherein the decoding test result information is obtained by decoding a test picture through the terminal equipment;
A cover acquisition module configured to receive information about the video cover picture from the server and acquire the video cover picture according to the received information about the video cover picture,
wherein the video cover picture acquired by the cover acquisition module has a predetermined format which is determined by the server according to decoding test result information transmitted by a plurality of terminal devices of the same model of the terminal device and has the best decoding performance,
wherein, in response to the decoding test configuration information indicating that the decoding test is not performed, the test module does not perform a decoding operation for the test picture, the cover request module directly transmits cover picture request information to the server,
wherein when the number of times the server has performed the decoding test for the same model of terminal equipment exceeds a predetermined value, the identification corresponding to the model of terminal equipment indicates that the decoding test is not performed, and when the number of times the decoding test has been performed for the same model of terminal equipment does not exceed the predetermined value, the identification corresponding to the model of terminal equipment indicates that the decoding test is performed.
7. The terminal device of claim 6, wherein the cover request module transmits cover picture request information to the server while transmitting decoding test result information for a predetermined period of time after the cold start,
wherein the cover request module does not transmit the decoding test result information in response to the decoding test result information being transmitted to the server a predetermined number of times or the predetermined period of time having elapsed.
8. The terminal device of claim 6, wherein the test pictures include still and/or moving pictures in at least one format, each format still and/or moving picture having a particular resolution, frame rate, and encoding scheme.
9. The terminal device of claim 6, wherein the decoding test result information includes model information of the terminal device, a coding manner of the test picture, a picture resolution, a frame rate, and decoding time consumption.
10. The terminal device of claim 6, wherein the information about the video cover picture includes a download address indicating the video cover picture having a predetermined encoding format,
the cover acquisition module is configured to download the encoded video cover picture from the download address of the video cover picture, decode the encoded video cover picture and render the decoded video cover picture to a picture control for the video.
11. A method for configuring a video cover picture of a terminal device, comprising:
receiving a decoding test request comprising model information of the terminal equipment from the terminal equipment, and determining an identifier corresponding to the model of the terminal equipment;
transmitting decoding test configuration information including information indicating to perform decoding tests to the terminal device in response to determining that the identification indicates to perform decoding tests;
receiving decoding test result information and cover picture request information aiming at a test picture from a plurality of terminal devices with the same model of the terminal device;
determining the format of a video cover picture with the best decoding performance for the terminal equipment of the model according to the decoding test result information of the plurality of terminal equipment;
transmitting information about the video cover picture corresponding to the determined format of the video cover picture to the terminal device,
wherein in response to determining that the identification indicates that the decoding test is not performed, transmitting decoding test configuration information including information indicating that the decoding test is not performed to the terminal device,
wherein when the number of times the decoding test has been performed for the same model of terminal equipment exceeds a predetermined value, the identification corresponding to the model of terminal equipment indicates that the decoding test is not performed, and when the number of times the decoding test has been performed for the same model of terminal equipment does not exceed the predetermined value, the identification corresponding to the model of terminal equipment indicates that the decoding test is performed.
12. The method of claim 11, wherein the test pictures comprise still and/or moving pictures downloaded from a server in at least one format, each format having a particular resolution, frame rate and encoding scheme.
13. The method of claim 11, wherein the decoding test result information includes model information of the terminal device, a coding manner of the test picture, a picture resolution, a frame rate, and decoding time consumption.
14. The method of claim 11, wherein the determining the format of the video cover picture for the model of the terminal device comprises:
determining average decoding time consumption of the terminal equipment of the model for the test picture according to decoding test result information received from the plurality of terminal equipment;
and determining the format of the video cover picture of the terminal equipment of the model according to the average decoding time consumption of the tested picture.
15. The method of claim 14, wherein the determining the format of the video cover picture for the model of the terminal device based on the average decoding time consumption for the test picture comprises:
In response to determining that the average decoding time consumption corresponding to the format of the test picture is less than a threshold, determining the format of the test picture as the format of the video cover picture for the terminal device of the model;
in response to determining that the average decoding time consumption corresponding to the format of the test picture exceeds a threshold, determining a default format as the format of the video cover picture for the model of the terminal device.
16. The method of claim 14, wherein the determining the format of the video cover picture for the model of the terminal device based on the average decoding time consumption for the test picture comprises:
determining at least one format of the test picture that has an average decoding time consumption less than a threshold;
and determining the format of the test picture with the highest priority in the at least one format as the format of the video cover picture of the terminal equipment with the model.
17. A server for configuring a video cover picture of a terminal device, comprising:
a test request processing module configured to receive a decoding test request including model information of the terminal device from the terminal device and determine an identification corresponding to the terminal device of the model, to send decoding test configuration information including information indicating that decoding test is performed to the terminal device in response to determining that the identification indicates that decoding test is performed, and to send decoding test configuration information including information indicating that decoding test is not performed to the terminal device in response to determining that the identification indicates that decoding test is not performed;
A receiving module configured to receive decoding test result information and cover picture request information for a test picture from a plurality of terminal devices of the same model of the terminal device;
a determining module configured to determine a format of a video cover picture having an optimal decoding performance for the terminal device of the model according to decoding test result information of the plurality of terminal devices;
a transmission module configured to transmit information about the video cover picture corresponding to the determined format of the video cover picture to the terminal device,
wherein when the number of times the decoding test has been performed for the same model of terminal equipment exceeds a predetermined value, the identification corresponding to the model of terminal equipment indicates that the decoding test is not performed, and when the number of times the decoding test has been performed for the same model of terminal equipment does not exceed the predetermined value, the identification corresponding to the model of terminal equipment indicates that the decoding test is performed.
18. The server of claim 17, wherein the test pictures include still and/or moving pictures in at least one format, each format still and/or moving picture having a particular resolution, frame rate, and encoding scheme.
19. The server according to claim 17, wherein the decoding test result information includes model information of the terminal device, a coding manner of the test picture, a picture resolution, a frame rate, and decoding time consumption.
20. The server of claim 17, wherein the determination module comprises:
the decoding time consumption determining module is configured to determine average decoding time consumption of the terminal equipment of the model for the test picture according to decoding test result information received from the plurality of terminal equipment;
and the format determining module is used for determining the format of the video cover picture of the terminal equipment with the model according to the average decoding time consumption of the test picture.
21. The server of claim 20, wherein the format determination module is configured to:
in response to determining that the average decoding time consumption corresponding to the format of the test picture is less than a threshold, determining the format of the test picture as the format of the video cover picture for the terminal device of the model;
in response to determining that the average decoding time consumption corresponding to the format of the test picture exceeds a threshold, determining a default format as the format of the video cover picture for the model of the terminal device.
22. The server of claim 20, wherein the format determination module is configured to:
determining at least one format of the test picture that has an average decoding time consumption less than a threshold;
and determining the format of the test picture with the highest priority in the at least one format as the format of the video cover picture of the terminal equipment with the model.
23. A method for configuring a video cover picture of a terminal device, comprising:
transmitting, by a terminal device, a decoding test request including model information of the terminal device to a server;
receiving, by a server, a decoding test request including model information of the terminal device from the terminal device and determining an identification corresponding to the model of the terminal device, transmitting decoding test configuration information including information indicating that the decoding test is performed to the terminal device in response to determining that the identification indicates that the decoding test is performed, and transmitting decoding test configuration information including information indicating that the decoding test is not performed to the terminal device in response to determining that the identification indicates that the decoding test is not performed;
executing a decoding test by the terminal equipment in response to the decoding test configuration information instruction, executing a decoding operation aiming at the test picture to obtain decoding test result information, and sending the decoding test result information and cover picture request information to the server, wherein the decoding test result information is obtained by executing decoding on the test picture by the terminal equipment;
The server determines the format of the video cover picture with the best decoding performance for the terminal equipment of the same model according to the decoding test result information of the plurality of terminal equipment of the same model of the terminal equipment;
the server sends the information about the video cover picture corresponding to the format of the determined video cover picture to the terminal equipment;
and acquiring the video cover picture by the terminal equipment according to the received information about the video cover picture.
24. A system for configuring a video cover picture of a terminal device, comprising:
a terminal device configured to transmit a decoding test request including model information of the terminal device to a server, receive decoding test configuration information from the server, instruct execution of a decoding test in response to the decoding test configuration information, perform a decoding operation for a test picture to obtain decoding test result information, and transmit the decoding test result information and cover picture request information to the server, wherein the decoding test result information is obtained by the terminal device performing decoding on the test picture;
a server configured to receive a decoding test request including model information of the terminal device from the terminal device and determine an identification corresponding to the terminal device of the model, to transmit decoding test configuration information including information indicating that the decoding test is performed to the terminal device in response to determining that the identification indicates that the decoding test is performed, to transmit decoding test configuration information including information indicating that the decoding test is not performed to the terminal device in response to determining that the identification indicates that the decoding test is not performed, and to determine a format of a video cover picture having an optimal decoding performance for the terminal device of the model according to decoding test result information of a plurality of terminal devices of the same model of the terminal device, and to transmit information on the video cover picture corresponding to the determined format of the video cover picture to the terminal device,
The terminal equipment acquires the video cover picture according to the received information about the video cover picture.
25. An electronic device, comprising:
at least one processor;
at least one memory storing computer-executable instructions,
wherein the computer executable instructions, when executed by the at least one processor, cause the at least one processor to perform the method of any of claims 1 to 5 or 11 to 16.
26. A storage medium, which when executed by a processor of a terminal device/server, enables the terminal device/server to perform the method of any one of claims 1 to 5 or 11 to 16.
CN202110118428.6A 2021-01-28 2021-01-28 Method and device for configuring video cover pictures of terminal equipment Active CN112911337B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110118428.6A CN112911337B (en) 2021-01-28 2021-01-28 Method and device for configuring video cover pictures of terminal equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110118428.6A CN112911337B (en) 2021-01-28 2021-01-28 Method and device for configuring video cover pictures of terminal equipment

Publications (2)

Publication Number Publication Date
CN112911337A CN112911337A (en) 2021-06-04
CN112911337B true CN112911337B (en) 2023-06-20

Family

ID=76119610

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110118428.6A Active CN112911337B (en) 2021-01-28 2021-01-28 Method and device for configuring video cover pictures of terminal equipment

Country Status (1)

Country Link
CN (1) CN112911337B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113727139A (en) * 2021-07-30 2021-11-30 北京达佳互联信息技术有限公司 Method and device for determining cover picture, server and storage medium

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102007774A (en) * 2008-04-18 2011-04-06 日本电气株式会社 Server device, content distribution method, and program
CN105338358A (en) * 2014-07-25 2016-02-17 阿里巴巴集团控股有限公司 Image decoding method and device
CN106998477A (en) * 2017-04-05 2017-08-01 腾讯科技(深圳)有限公司 The front cover display methods and device of live video
CN107948660A (en) * 2017-11-16 2018-04-20 北京小米移动软件有限公司 The method and device of Video coding adaptation
CN108810657A (en) * 2018-06-15 2018-11-13 网宿科技股份有限公司 A kind of method and system of setting video cover
WO2019128229A1 (en) * 2017-12-29 2019-07-04 中兴通讯股份有限公司 Methods and devices for transmitting and processing video data, terminal, and server
CN110058887A (en) * 2018-01-16 2019-07-26 腾讯科技(深圳)有限公司 Method for processing video frequency, device, computer readable storage medium and computer equipment
CN110278452A (en) * 2019-06-24 2019-09-24 北京字节跳动网络技术有限公司 Video Acceleration of starting method, apparatus, storage medium, terminal and server
CN110324706A (en) * 2018-03-30 2019-10-11 优酷网络技术(北京)有限公司 A kind of generation method, device and the computer storage medium of video cover
CN110636284A (en) * 2019-10-25 2019-12-31 腾讯科技(深圳)有限公司 Decoding capability detection method and device

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7219163B2 (en) * 2002-03-14 2007-05-15 Hewlett-Packard Development Company, L.P. Method and system that tailors format of transmission to suit client capabilities and link characteristics
CN105812705B (en) * 2014-12-31 2019-04-12 华为终端(东莞)有限公司 A kind of video communication method, terminal and system
CN105159639B (en) * 2015-08-21 2018-07-27 小米科技有限责任公司 Audio cover display methods and device
CN110858920A (en) * 2018-08-23 2020-03-03 武汉斗鱼网络科技有限公司 Video decoding method, mobile terminal, server, system and storage medium

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102007774A (en) * 2008-04-18 2011-04-06 日本电气株式会社 Server device, content distribution method, and program
CN105338358A (en) * 2014-07-25 2016-02-17 阿里巴巴集团控股有限公司 Image decoding method and device
CN106998477A (en) * 2017-04-05 2017-08-01 腾讯科技(深圳)有限公司 The front cover display methods and device of live video
CN107948660A (en) * 2017-11-16 2018-04-20 北京小米移动软件有限公司 The method and device of Video coding adaptation
WO2019128229A1 (en) * 2017-12-29 2019-07-04 中兴通讯股份有限公司 Methods and devices for transmitting and processing video data, terminal, and server
CN110058887A (en) * 2018-01-16 2019-07-26 腾讯科技(深圳)有限公司 Method for processing video frequency, device, computer readable storage medium and computer equipment
CN110324706A (en) * 2018-03-30 2019-10-11 优酷网络技术(北京)有限公司 A kind of generation method, device and the computer storage medium of video cover
CN108810657A (en) * 2018-06-15 2018-11-13 网宿科技股份有限公司 A kind of method and system of setting video cover
CN110278452A (en) * 2019-06-24 2019-09-24 北京字节跳动网络技术有限公司 Video Acceleration of starting method, apparatus, storage medium, terminal and server
CN110636284A (en) * 2019-10-25 2019-12-31 腾讯科技(深圳)有限公司 Decoding capability detection method and device

Also Published As

Publication number Publication date
CN112911337A (en) 2021-06-04

Similar Documents

Publication Publication Date Title
CN108401124B (en) Video recording method and device
CN108966008B (en) Live video playback method and device
CN110022489B (en) Video playing method, device and storage medium
CN109327608B (en) Song sharing method, terminal, server and system
CN108881286B (en) Multimedia playing control method, terminal, sound box equipment and system
CN110248236B (en) Video playing method, device, terminal and storage medium
CN109144346B (en) Song sharing method and device and storage medium
CN110418152B (en) Method and device for carrying out live broadcast prompt
CN110533585B (en) Image face changing method, device, system, equipment and storage medium
CN107896337B (en) Information popularization method and device and storage medium
CN110290392B (en) Live broadcast information display method, device, equipment and storage medium
CN112104648A (en) Data processing method, device, terminal, server and storage medium
CN110662105A (en) Animation file generation method and device and storage medium
CN113747199A (en) Video editing method, video editing apparatus, electronic device, storage medium, and program product
CN111083554A (en) Method and device for displaying live gift
CN107888975B (en) Video playing method, device and storage medium
CN111399796B (en) Voice message aggregation method and device, electronic equipment and storage medium
CN112911337B (en) Method and device for configuring video cover pictures of terminal equipment
CN111294551B (en) Method, device and equipment for audio and video transmission and storage medium
CN112616082A (en) Video preview method, device, terminal and storage medium
CN110113669B (en) Method and device for acquiring video data, electronic equipment and storage medium
CN112770177A (en) Multimedia file generation method, multimedia file release method and device
CN112492331B (en) Live broadcast method, device, system and storage medium
CN112203020B (en) Method, device and system for configuring camera configuration parameters of terminal equipment
CN110996115B (en) Live video playing method, device, equipment, storage medium and program product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant