CN114598912B - Multimedia file display method and device, storage medium and electronic equipment - Google Patents
Multimedia file display method and device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN114598912B CN114598912B CN202210126684.4A CN202210126684A CN114598912B CN 114598912 B CN114598912 B CN 114598912B CN 202210126684 A CN202210126684 A CN 202210126684A CN 114598912 B CN114598912 B CN 114598912B
- Authority
- CN
- China
- Prior art keywords
- multimedia file
- reading
- format
- target
- video frames
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 57
- 230000002452 interceptive effect Effects 0.000 claims abstract description 75
- 230000003993 interaction Effects 0.000 claims abstract description 30
- 230000005540 biological transmission Effects 0.000 claims abstract description 22
- 238000000605 extraction Methods 0.000 claims description 15
- 238000013507 mapping Methods 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 9
- 238000006243 chemical reaction Methods 0.000 claims description 6
- 101100065699 Arabidopsis thaliana ETC1 gene Proteins 0.000 claims description 3
- 101100065701 Arabidopsis thaliana ETC2 gene Proteins 0.000 claims description 3
- 241001465754 Metazoa Species 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 11
- 238000010438 heat treatment Methods 0.000 abstract description 6
- 238000009877 rendering Methods 0.000 abstract description 6
- 230000008569 process Effects 0.000 description 12
- 230000006870 function Effects 0.000 description 5
- 230000008901 benefit Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000010276 construction Methods 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012886 linear function Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The application discloses a multimedia file display method, a device, a storage medium and electronic equipment. The method comprises the following steps: receiving interactive operation of a user aiming at a target interactive object; determining a reading sequence and a reading rate of the video frames based on the interactive operation; reading video frames in each compressed texture format from a target multimedia file corresponding to a target interactive object at least based on the reading sequence and the reading rate; and transmitting the read video frames to a display device in real time for display. According to the method and the device, the video frames in the compressed texture format are acquired and displayed by the real-time transmission value display equipment, so that the requirements on the memory space and the memory transmission rate can be reduced, and smooth interaction experience is realized. Meanwhile, the requirements of the equipment on CG rendering capability can be reduced, the effect of the real physical world is realized, and the heating value and the power consumption of the mobile equipment are reduced.
Description
Technical Field
The present application relates to the field of media playing technologies, and in particular, to a method and apparatus for displaying a multimedia file, a storage medium, and an electronic device.
Background
In interactive video or other forms of interactive media content, it is desirable to be able to play video frames in real-time and smoothly as feedback while the user interacts with objects in the frames. However, in the existing video interaction, since the memory of the terminal device is limited, for example, when playing at 6 times of speed, the bandwidth required by the memory is 1.2Gbps x 6=7.2 Gbps, and the mobile device usually adopts the LPDDR memory, the latest version of the LPDDR5 memory has a bandwidth of 6400Mbps, which is less than 7.2Gbps, thereby causing the problems of video playing being stuck and unsmooth, and affecting the interaction experience of the user.
Disclosure of Invention
In view of the above, the present invention provides a method, an apparatus, a storage medium and an electronic device for displaying a multimedia file, which are mainly aimed at solving the problems of video playing jamming and unsmooth in the interaction process at present.
In order to solve the above-mentioned problems, the application provides a multimedia file display method, which comprises the following steps:
receiving interactive operation of a user aiming at a target interactive object;
Determining a reading sequence and a reading rate of the video frames based on the interactive operation;
Based on the reading sequence and the reading rate, video frames in each compressed texture format are read from a target multimedia file which corresponds to the target interactive object and is stored in a preset position in a compressed texture format;
And transmitting the read video frames to a display device in real time for display.
Optionally, before receiving the interactive operation of the user on the target interactive object, the method further includes:
After decoding video in real time, performing format conversion on each decoded original video frame to obtain each video frame in a compressed texture format so as to obtain the target multimedia file; or receiving video frames in each compressed texture format to obtain the target multimedia file;
And sequentially storing the video frames in the compressed texture format to a preset position according to a queue storage mode.
Optionally, the method further comprises: establishing a mapping relation between the interactive object and the multimedia file;
before reading the video frames in each compressed texture format from the target multimedia file corresponding to the target interactive object based on the reading sequence and the reading rate, the method further comprises:
and searching the mapping relation based on the target interactive object to determine the target multimedia file.
Optionally, the determining the reading sequence and the reading rate of the video frames based on the interactive operation specifically includes:
determining that the reading sequence is reverse sequence reading or sequence reading based on the moving direction of the operating body in the interactive operation;
and determining the reading rate based on the number of pixels of the screen, through which the operating body slides in the interactive operation.
Optionally, the method further comprises: determining a start video frame corresponding to an initial touch point of an operation body;
The method for reading the video frames in the compressed texture format at least based on the reading sequence and the reading rate comprises the following steps of:
And sequentially extracting video frames in each compressed texture format from the target multimedia file based on the starting video frame, the reading sequence and the reading rate.
Optionally, the method further comprises:
Judging the current transmission rate of the video frame based on the storage bandwidth limit value;
in the case that the current transmission rate is determined to be greater than the storage bandwidth limit, the method further includes:
And carrying out frame loss processing on the read video frames.
In order to solve the above problems, the present application provides a multimedia file display device, comprising:
The receiving module is used for receiving the interaction operation of the user aiming at the target interaction object;
The determining module is used for determining the reading sequence and the reading rate of the video frames based on the interaction operation;
The reading module is used for reading video frames in each compressed texture format from a target multimedia file which corresponds to the target interactive object and is stored in a preset position in a compressed texture format based on at least the reading sequence and the reading rate;
and the transmission module is used for transmitting the read video frames to the display equipment in real time for display.
Optionally, the multimedia file display device in the application further comprises a processing module and a storage module;
the processing module is used for: after decoding video in real time, performing format conversion on each decoded original video frame to obtain each video frame in a compressed texture format so as to obtain the target multimedia file; or receiving video frames in each compressed texture format to obtain the target multimedia file;
The storage module is used for: and sequentially storing the video frames in the compressed texture format to a preset position according to a queue storage mode.
To solve the above-mentioned technical problem, the present application is a storage medium storing a computer program which, when executed by a processor, implements the steps of the multimedia file display method of any one of the above-mentioned technical problems.
In order to solve the above technical problems, the present application provides an electronic device, at least including a memory, and a processor, where the memory stores a computer program, and the processor implements the steps of the method for displaying a multimedia file according to any one of the above steps when executing the computer program on the memory.
According to the method and the device, the video frames in the compressed texture format are obtained and displayed, so that the requirements on the memory space and the memory transmission rate can be reduced, and smooth interaction experience is realized. Meanwhile, the requirements of the equipment on CG rendering capability can be reduced, the effect of the real physical world is realized, and the heating value and the power consumption of the mobile equipment are reduced.
The foregoing description is only an overview of the present invention, and is intended to be implemented in accordance with the teachings of the present invention in order that the same may be more clearly understood and to make the same and other objects, features and advantages of the present invention more readily apparent.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to designate like parts throughout the figures. In the drawings:
FIG. 1 is a flowchart of a method for displaying multimedia files according to an embodiment of the present application;
FIG. 2 is a flowchart of a method for displaying multimedia files according to another embodiment of the present application;
Fig. 3 is a block diagram illustrating a multimedia file displaying apparatus according to another embodiment of the present application.
Detailed Description
Various aspects and features of the present application are described herein with reference to the accompanying drawings.
It should be understood that various modifications may be made to the embodiments of the application herein. Therefore, the above description should not be taken as limiting, but merely as exemplification of the embodiments. Other modifications within the scope and spirit of the application will occur to persons of ordinary skill in the art.
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the application and, together with a general description of the application given above, and the detailed description of the embodiments given below, serve to explain the principles of the application.
These and other characteristics of the application will become apparent from the following description of a preferred form of embodiment, given as a non-limiting example, with reference to the accompanying drawings.
It is also to be understood that, although the application has been described with reference to some specific examples, those skilled in the art can certainly realize many other equivalent forms of the application.
The above and other aspects, features and advantages of the present application will become more apparent in light of the following detailed description when taken in conjunction with the accompanying drawings.
Specific embodiments of the present application will be described hereinafter with reference to the accompanying drawings; however, it is to be understood that the disclosed embodiments are merely exemplary of the application, which can be embodied in various forms. Well-known and/or repeated functions and constructions are not described in detail to avoid obscuring the application in unnecessary or unnecessary detail. Therefore, specific structural and functional details disclosed herein are not intended to be limiting, but merely as a basis for the claims and as a representative basis for teaching one skilled in the art to variously employ the present application in virtually any appropriately detailed structure.
The specification may use the word "in one embodiment," "in another embodiment," "in yet another embodiment," or "in other embodiments," which may each refer to one or more of the same or different embodiments in accordance with the application.
The embodiment of the application provides a multimedia file display method which can be applied to terminal equipment. As shown in fig. 1, the method in this embodiment includes the following steps:
Step S101, receiving interaction operation of a user aiming at a target interaction object;
In this step, the interactive object may be a person, an animal, an object, etc. in the multimedia file, or may be a predetermined virtual interactive key. The mapping relation between each interactive object and the multimedia file can be pre-established, so that when a user performs interactive operation on the interactive object, the corresponding multimedia file can be triggered to be displayed for interactive feedback. The interactive operation in this step may specifically be a sliding operation, a clicking operation, a pressing operation, or the like.
Step S102, determining the reading sequence and the reading rate of video frames based on the interactive operation;
In this step, when the interactive operation is a sliding operation, the reading order may be determined based on the moving direction of the operating body in the sliding operation, for example, the reading order is a reverse order reading when sliding leftwards, and the reading order is a sequential reading when sliding rightwards. In determining the reading rate, the reading rate may be determined based on the number of pixels of the screen that the operator slides over in the interactive operation. That is, the extraction interval of video frames in the queue is related to the speed of interaction, e.g., a frame is read every 10 screen pixels the finger slides. When the interactive operation is a click operation, the reading sequence can be determined according to the click direction of the operation body of the click operation, for example, the left click is a reverse sequence reading, and the right click is a sequence reading; the read rate may be determined based on the click frequency of the click operation when determining the read rate, e.g., the higher the click frequency, the faster the read rate.
Step S103, based on at least the reading sequence and the reading rate, video frames in each compressed texture format are read from a target multimedia file which corresponds to the target interactive object and is stored in a predetermined position in a compressed texture format;
In this step, the compressed texture format may specifically be any one of the following: ETC1 format, PVRTC format, DXT format, ASTC format, ETC2 format, and so forth. In the implementation process of the step, the initial video frame can be further determined, so that the GPU in the terminal device can sequentially extract video frames in each compressed texture format from the target multimedia file by taking the reading sequence as the video frame extraction sequence and the reading rate as the video frame extraction rate from the initial video frame of the target multimedia file.
Step S104, the read video frames are transmitted to the display equipment in real time for display.
In the implementation process, after the video frame is read, the read video frame can be transmitted to the display device for display in real time.
In the embodiment, the video frames in the compressed texture format are acquired and displayed by the real-time transmission value display device, so that the requirements on the memory space and the memory transmission rate can be reduced, and smooth interaction experience is realized. Meanwhile, the requirements of the equipment on CG rendering capability can be reduced, the effect of the real physical world is realized, and the heating value and the power consumption of the mobile equipment are reduced
On the basis of the above embodiment, in order to display a target multimedia file more smoothly and achieve better interactive feedback, the embodiment provides a multimedia file display method, as shown in fig. 2, which specifically includes the following steps:
Step S201, after decoding video in real time, converting the format of each decoded original video frame to obtain each video frame in compressed texture format so as to obtain the target multimedia file; or receiving video frames in each compressed texture format to obtain the target multimedia file; and sequentially storing the video frames in the compressed texture format to a preset position according to a queue storage mode.
In this step, the terminal device may be used to perform format conversion processing on each video frame of each multimedia file, so as to obtain a video frame in compressed texture format; the method comprises the steps that other equipment stores all video frames, namely, original data after video coding is compressed into compressed textures in real time by a client; or the client can also directly receive the video frames in the compressed texture format sent by other devices and then directly transmit the video frames to the GPU for display. In a specific implementation process, in order to reduce the file size of the multimedia file, the compressed texture format target multimedia file may be further compressed. In the storing process, the storing mode may be specifically a mode of storing in a sequential queue or a circular queue, that is, a corresponding storage block (storage position) may be allocated to each multimedia file in advance, and then video frames in each compressed texture format of the multimedia file are stored in the corresponding storage block (storage position) in a mode of storing in a sequential queue.
Step S202, a mapping relationship between the interactive object and the multimedia file is established.
In the step, the mapping relation is established between the pre-shot multimedia file and the interactive object, so that when a user performs interactive operation on the interactive object, the target multimedia file can be quickly found by searching the mapping relation, and the target multimedia file is displayed as interactive feedback, thereby providing guarantee for realizing the interactive feedback in real time and smoothly.
Step S203, receiving the interaction operation of a user aiming at a target interaction object;
Step S204, searching the mapping relation based on the target interactive object to determine a target multimedia file;
step S205, determining a starting video frame;
In the implementation process, after the target multimedia file is determined, the initial video frame can be determined according to the video corresponding to the initial touch point of the operating body. Specifically, the starting video frame may also be determined according to a predetermined position, for example, the predetermined position may be a center position of a video frame storage queue of the target multimedia file, or may be a starting position of the video frame storage queue, or the like.
Step S206, determining the reading sequence and the reading rate of the video frames based on the interactive operation;
In this step, when the interactive operation is a sliding operation, the reading order may be determined based on the moving direction of the operating body in the sliding operation, for example, the reading order is a reverse order reading when sliding leftwards, and the reading order is a sequential reading when sliding rightwards. In determining the reading rate, the reading rate may be determined based on the number of pixels of the screen that the operator slides over in the interactive operation. That is, the extraction interval of video frames in the queue is related to the speed of interaction, e.g., a frame is read every 10 screen pixels the finger slides. When the interactive operation is a click operation, the reading sequence can be determined according to the click direction of the operation body of the click operation, for example, the left click is a reverse sequence reading, and the right click is a sequence reading; the read rate may be determined based on the click frequency of the click operation when determining the read rate, e.g., the higher the click frequency, the faster the read rate.
Step S207, based on the start video frame, sequentially extracting video frames in each compressed texture format from the target multimedia file with the reading order as a video frame extraction order and the reading rate as a video frame extraction rate.
In the implementation process, the extraction interval of the video frames is related to the interaction speed, for example, the method is pre-configured: extracting a video frame every 10 screen pixels of the finger sliding, or configuring the extraction rate to be 10 frames/second when the interaction rate is less than or equal to 2 cm/s; when the interaction rate is greater than 2cm/s and less than or equal to 4cm/s, the extraction rate is 20 frames/s, and when the interaction rate is greater than 4cm/s, the extraction rate is 30 frames/s. In this step, a smooth display effect is achieved, and the extraction rate may also be a function of the interaction speed. The function may be a linear function, a piecewise function as in the example above, or a higher order function to achieve a richer effect, such as a fade-in fade-out effect.
Step S208, the read video frames are transmitted to the display device in real time for display.
According to the embodiment, the initial video frames, the reading sequence and the reading rate are determined, so that the video frames in each compressed texture format can be sequentially read and displayed, real-time and smooth interactive feedback can be realized, and the interactive display effect of the multimedia file is improved.
In this embodiment, in order to ensure a real-time and smooth interaction effect, the current transmission rate of the video frame may be further determined based on the storage bandwidth limit value; in the case that the current transmission rate is determined to be greater than the storage bandwidth limit, the method further includes: and carrying out frame loss processing on the read video frames. That is, when the current transmission rate is greater than the storage bandwidth, a part of the read video frames are transmitted to the display terminal.
In the implementation process of the embodiment, each video frame can be read according to a preset display form, and any position frame in the queue can be randomly accessed and read according to a preset interval, so that out-of-order playing/displaying of the target multimedia file is realized.
In the application, as the compressed texture format is a format which can be directly read and displayed by the GPU, the image can be rendered without decompression, so that a large amount of memory can be saved, and real-time and smooth interactive feedback can be realized.
Another embodiment of the present application provides a multimedia file displaying apparatus, as shown in fig. 3, including:
The receiving module 1 is used for receiving the interaction operation of a user aiming at a target interaction object;
A determining module 2, configured to determine a reading order and a reading rate of the video frames based on the interactive operation;
a reading module 3, configured to read video frames in each compressed texture format from a target multimedia file corresponding to a target interactive object and stored in a predetermined position in a compressed texture format based at least on the reading order and the reading rate;
And the transmission module 4 is used for transmitting the read video frames to the display equipment in real time for display.
Specifically, the multimedia file display device further comprises a processing module and a storage module; the processing module is used for: after decoding video in real time, performing format conversion on each decoded original video frame to obtain each video frame in a compressed texture format so as to obtain the target multimedia file; or receiving video frames in each compressed texture format to obtain the target multimedia file; the storage module is used for: and sequentially storing the video frames in the compressed texture format to a preset position according to a queue storage mode.
Specifically, the multimedia file display device further includes a building module and a searching module, where the building module is configured to: and establishing a mapping relation between the interactive object and the multimedia file. The searching module is specifically configured to: and searching the mapping relation based on the target interactive object to determine the target multimedia file.
In a specific implementation process of this embodiment, the determining module is specifically configured to: determining that the reading sequence is reverse sequence reading or sequence reading based on the moving direction of the operating body in the interactive operation; and determining the reading rate based on the number of pixels of the screen, through which the operating body slides in the interactive operation.
Specifically, the determining module is further configured to: and determining a starting video frame of the starting video frame corresponding to the initial touch point of the operating body. The reading module is specifically configured to: and sequentially extracting video frames in each compressed texture format from the target multimedia file based on the starting video frame, the reading sequence and the reading rate.
The embodiment further comprises a judging module in the concrete implementation process, which is used for judging the current transmission rate of the video frame based on the storage bandwidth limit value; and under the condition that the current transmission rate is judged to be larger than the storage bandwidth limit, carrying out frame loss processing on the read video frame.
According to the method and the device, the video frames in the compressed texture format are obtained and displayed, so that the requirements on the memory space and the memory transmission rate can be reduced, and smooth interaction experience is realized. Meanwhile, the requirements of the equipment on CG rendering capability can be reduced, the effect of the real physical world is realized, and the heating value and the power consumption of the mobile equipment are reduced.
Another embodiment of the present application provides a storage medium storing a computer program which, when executed by a processor, performs the method steps of:
Step one, receiving interactive operation of a user aiming at a target interactive object;
Step two, determining the reading sequence and the reading rate of the video frames based on the interaction operation;
Step three, based on the reading sequence and the reading rate, video frames in each compressed texture format are read from a target multimedia file which corresponds to a target interactive object and is stored in a preset position in a compressed texture format;
and step four, transmitting the read video frames to display equipment in real time for display.
The specific implementation process of the above method steps may refer to any one of the embodiments of the multimedia file display method, and this embodiment is not repeated here.
According to the method and the device, the video frames in the compressed texture format are acquired and displayed by the real-time transmission value display equipment, so that the requirements on the memory space and the memory transmission rate can be reduced, and smooth interaction experience is realized. Meanwhile, the requirements of the equipment on CG rendering capability can be reduced, the effect of the real physical world is realized, and the heating value and the power consumption of the mobile equipment are reduced.
A further embodiment of the application provides an electronic device comprising at least a memory, a processor, the memory having stored thereon a computer program, the processor, when executing the computer program on the memory, implementing the method steps of:
Step one, receiving interactive operation of a user aiming at a target interactive object;
Step two, determining the reading sequence and the reading rate of the video frames based on the interaction operation;
Step three, based on the reading sequence and the reading rate, video frames in each compressed texture format are read from a target multimedia file which corresponds to a target interactive object and is stored in a preset position in a compressed texture format;
and step four, transmitting the read video frames to display equipment in real time for display.
The specific implementation process of the above method steps may refer to any one of the embodiments of the multimedia file display method, and this embodiment is not repeated here.
According to the method and the device, the video frames in the compressed texture format are acquired and displayed by the real-time transmission value display equipment, so that the requirements on the memory space and the memory transmission rate can be reduced, and smooth interaction experience is realized. Meanwhile, the requirements of the equipment on CG rendering capability can be reduced, the effect of the real physical world is realized, and the heating value and the power consumption of the mobile equipment are reduced.
The above embodiments are only exemplary embodiments of the present application and are not intended to limit the present application, the scope of which is defined by the claims. Various modifications and equivalent arrangements of this application will occur to those skilled in the art, and are intended to be within the spirit and scope of the application.
Claims (5)
1. A multimedia file display method, comprising:
receiving interactive operation of a user aiming at a target interactive object; the interactive object comprises: characters, animals and objects in the multimedia file;
Determining that the reading sequence is reverse sequence reading or sequence reading based on the moving direction of the operating body in the interactive operation;
determining the reading rate based on the number of pixels of the screen through which the operator slides in the interactive operation;
determining a start video frame corresponding to an initial touch point of an operation body;
Based on the initial video frames, taking the reading sequence as a video frame extraction sequence and taking the reading rate as a video frame extraction rate, sequentially extracting video frames in each compressed texture format from a target multimedia file which corresponds to a target interactive object and is stored in a preset position in a compressed texture format; the compressed texture format includes: ETC1 format, PVRTC format, ASTC format, ETC2 format;
transmitting the read video frames to display equipment in real time for display;
The method further comprises the steps of: establishing a mapping relation between the interactive object and the multimedia file;
before reading the video frames in each compressed texture format from the target multimedia file corresponding to the target interactive object based on the reading sequence and the reading rate, the method further comprises:
searching the mapping relation based on the target interactive object to determine the target multimedia file;
before receiving the interactive operation of the user for the target interactive object, the method further comprises the following steps:
After decoding video in real time, performing format conversion on each decoded original video frame to obtain each video frame in a compressed texture format so as to obtain the target multimedia file; or receiving video frames in each compressed texture format to obtain the target multimedia file;
And sequentially storing the video frames in the compressed texture format to a preset position according to a queue storage mode.
2. The method of claim 1, wherein the method further comprises:
Judging the current transmission rate of the video frame based on the storage bandwidth limit value;
in the case that the current transmission rate is determined to be greater than the storage bandwidth limit, the method further includes:
And carrying out frame loss processing on the read video frames.
3. A multimedia file display device, comprising:
The receiving module is used for receiving the interaction operation of the user aiming at the target interaction object; the interactive object comprises: characters, animals and objects in the multimedia file;
The determining module is used for determining that the reading sequence is reverse reading or sequential reading based on the moving direction of the operating body in the interactive operation; and determining the reading rate based on the number of pixels of the screen that the operator slides over in the interactive operation; the method comprises the steps of determining a starting video frame corresponding to an initial touch point of an operation body;
The reading module is used for sequentially extracting video frames in each compressed texture format from a target multimedia file which corresponds to a target interactive object and is stored in a preset position in a compressed texture format based on the starting video frame, wherein the reading sequence is the video frame extraction sequence, and the reading rate is the video frame extraction rate; the compressed texture format includes: ETC1 format, PVRTC format, ASTC format, ETC2 format;
the transmission module is used for transmitting the read video frames to the display equipment in real time for display;
the device also comprises a building module and a searching module, wherein the building module is used for: establishing a mapping relation between the interactive object and the multimedia file;
The searching module is specifically configured to: searching the mapping relation based on the target interactive object to determine the target multimedia file;
the multimedia file display device also comprises a processing module and a storage module;
the processing module is used for: after decoding video in real time, performing format conversion on each decoded original video frame to obtain each video frame in a compressed texture format so as to obtain the target multimedia file; or receiving video frames in each compressed texture format to obtain the target multimedia file;
The storage module is used for: and sequentially storing the video frames in the compressed texture format to a preset position according to a queue storage mode.
4. A storage medium storing a computer program which, when executed by a processor, implements the steps of the multimedia file display method of any one of the preceding claims 1-2.
5. An electronic device comprising at least a memory, a processor, said memory having stored thereon a computer program, said processor, when executing the computer program on said memory, implementing the steps of the method for displaying a multimedia file according to any of the preceding claims 1-2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210126684.4A CN114598912B (en) | 2022-02-10 | 2022-02-10 | Multimedia file display method and device, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210126684.4A CN114598912B (en) | 2022-02-10 | 2022-02-10 | Multimedia file display method and device, storage medium and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114598912A CN114598912A (en) | 2022-06-07 |
| CN114598912B true CN114598912B (en) | 2024-05-10 |
Family
ID=81804833
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210126684.4A Active CN114598912B (en) | 2022-02-10 | 2022-02-10 | Multimedia file display method and device, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114598912B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115861499B (en) * | 2022-11-24 | 2023-07-14 | 无锡车联天下信息技术有限公司 | Playing method, playing device, equipment and medium for sequence frame animation |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011223056A (en) * | 2010-04-02 | 2011-11-04 | Taito Corp | Video playback method |
| CN102419685A (en) * | 2010-09-24 | 2012-04-18 | Lg电子株式会社 | Mobile terminal and method for controlling playback speed thereof |
| CN103686411A (en) * | 2013-12-11 | 2014-03-26 | 深圳Tcl新技术有限公司 | Method for playing video and multimedia device |
| CN110430450A (en) * | 2019-08-02 | 2019-11-08 | 北京奇艺世纪科技有限公司 | A kind of method, apparatus and electronic equipment of video location |
| CN111061412A (en) * | 2019-10-31 | 2020-04-24 | 北京奇艺世纪科技有限公司 | Playing control method and device for multimedia resources |
| CN111311716A (en) * | 2020-02-27 | 2020-06-19 | Oppo广东移动通信有限公司 | Animation playing method and device, terminal equipment and storage medium |
| CN112437345A (en) * | 2020-11-20 | 2021-03-02 | 北京字跳网络技术有限公司 | Video speed doubling playing method and device, electronic equipment and storage medium |
| CN112929705A (en) * | 2021-02-02 | 2021-06-08 | 腾讯科技（深圳）有限公司 | Texture compression and decompression method and device, computer equipment and storage medium |
-
2022
- 2022-02-10 CN CN202210126684.4A patent/CN114598912B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2011223056A (en) * | 2010-04-02 | 2011-11-04 | Taito Corp | Video playback method |
| CN102419685A (en) * | 2010-09-24 | 2012-04-18 | Lg电子株式会社 | Mobile terminal and method for controlling playback speed thereof |
| CN103686411A (en) * | 2013-12-11 | 2014-03-26 | 深圳Tcl新技术有限公司 | Method for playing video and multimedia device |
| CN110430450A (en) * | 2019-08-02 | 2019-11-08 | 北京奇艺世纪科技有限公司 | A kind of method, apparatus and electronic equipment of video location |
| CN111061412A (en) * | 2019-10-31 | 2020-04-24 | 北京奇艺世纪科技有限公司 | Playing control method and device for multimedia resources |
| CN111311716A (en) * | 2020-02-27 | 2020-06-19 | Oppo广东移动通信有限公司 | Animation playing method and device, terminal equipment and storage medium |
| CN112437345A (en) * | 2020-11-20 | 2021-03-02 | 北京字跳网络技术有限公司 | Video speed doubling playing method and device, electronic equipment and storage medium |
| CN112929705A (en) * | 2021-02-02 | 2021-06-08 | 腾讯科技（深圳）有限公司 | Texture compression and decompression method and device, computer equipment and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| GPU视频纹理技术在三维电影播放中的应用;成效;万旺根;余小清;徐鸿玮;;计算机工程与设计(第18期);4020-4023 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114598912A (en) | 2022-06-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109600666B (en) | Video playing method, device, medium and electronic equipment in game scene | |
| US20180270496A1 (en) | Composite video streaming using stateless compression | |
| CN110708589B (en) | Information sharing method and device, storage medium and electronic device | |
| EP2559270B1 (en) | Method and apparatus for generating and playing animation message | |
| CN106170922B (en) | The source code of data and decoded device and method | |
| WO2022257699A1 (en) | Image picture display method and apparatus, device, storage medium and program product | |
| US9055272B2 (en) | Moving image reproduction apparatus, information processing apparatus, and moving image reproduction method | |
| CN109840879B (en) | Image rendering method and device, computer storage medium and terminal | |
| EP3410302B1 (en) | Graphic instruction data processing method, apparatus | |
| CN103780949B (en) | A kind of multi-medium data method for recording | |
| US8620096B2 (en) | Virtualization server for presentation virtualization and image data encoding method | |
| CN114598912B (en) | Multimedia file display method and device, storage medium and electronic equipment | |
| CN111436009B (en) | Real-time video stream transmission and display method and transmission and play system | |
| CN106470353B (en) | Multimedia data processing method and device and electronic equipment | |
| CN111294600A (en) | Compression method, decompression method and device for video sequence frame | |
| CN113630621B (en) | Video processing method, related device and storage medium | |
| CN115037944B (en) | Cloud streaming media hard decoding method and device and storage medium | |
| CN116668741A (en) | Cloud desktop display method, image display method, device and storage medium | |
| CN112601096A (en) | Video decoding method, device, equipment and readable storage medium | |
| CN109547839A (en) | The dynamic previewing processing method and processing device of live content, medium, electronic equipment | |
| US20050141861A1 (en) | Method and system for reverse playback of compressed data | |
| JP2009118464A (en) | Decoding variable-length code in jpeg application | |
| CN113973224A (en) | Method for transmitting media information, computing device and storage medium | |
| CN118662878A (en) | Game terminal, cloud server, cloud game control method, and storage medium | |
| CN108668170B (en) | Image information processing method and device, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |