CN114390333B - Interface content display method, device, equipment and storage medium - Google Patents
Interface content display method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN114390333B CN114390333B CN202210122179.2A CN202210122179A CN114390333B CN 114390333 B CN114390333 B CN 114390333B CN 202210122179 A CN202210122179 A CN 202210122179A CN 114390333 B CN114390333 B CN 114390333B
- Authority
- CN
- China
- Prior art keywords
- interface
- sub
- display
- control task
- video stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 56
- 230000008859 change Effects 0.000 claims abstract description 22
- 230000008569 process Effects 0.000 claims description 9
- 238000009877 rendering Methods 0.000 claims description 5
- 125000004122 cyclic group Chemical group 0.000 claims description 4
- 239000002131 composite material Substances 0.000 claims description 2
- 230000002194 synthesizing effect Effects 0.000 abstract description 18
- 230000007246 mechanism Effects 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 8
- 238000007792 addition Methods 0.000 description 4
- 230000000903 blocking effect Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
- H04N21/4438—Window management, e.g. event handling following interaction with the user interface
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
- H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Business, Economics & Management (AREA)
- Marketing (AREA)
- Software Systems (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the invention discloses a method, a device, equipment and a storage medium for displaying interface content, wherein the method comprises the following steps: when video playing is detected, adding a sub-interface in a display interface, and creating a refresh control task; when the generation of the video stream is detected, the attribute value of the sub-interface is adjusted through the refresh control task; and when the attribute value change is detected through the interface main thread, sending a request refreshing instruction to a display module for synthesizing and displaying the generated video stream. The video playing mechanism is optimized, so that the video stream is played more smoothly, and the watching experience of a user is remarkably improved.
Description
Technical Field
The embodiment of the application relates to the technical field of computers, in particular to an interface content display method, an interface content display device, interface content display equipment and a storage medium.
Background
With the high-speed development of the internet, especially the mobile internet, mobile applications are widely developed, and the scenes of video playing at the mobile terminal are more and more, especially the applications mainly for short video playing are more and more common. In order to improve user experience, ensuring smooth playing of short video as much as possible, and avoiding frame dropping and jamming is a concern for those skilled in the art.
In the related art, when video playing is performed based on a system control as a carrier, a refresh request is required to be sent after video stream data is loaded, and when system resources are tense, obvious frame dropping and blocking phenomena occur when a display interface displays pictures, so that the viewing experience of a user is affected, and improvement is required.
Disclosure of Invention
The embodiment of the invention provides an interface content display method, device, equipment and storage medium, which solve the problems of frame dropping and blocking in the video stream playing process when system resources are tense, optimize a video playing mechanism, enable the video stream to be played more smoothly and remarkably improve the watching experience of users.
In a first aspect, an embodiment of the present invention provides a method for displaying interface content, where the method includes:
when video playing is detected, adding a sub-interface in a display interface, and creating a refresh control task;
when the generation of the video stream is detected, the attribute value of the sub-interface is adjusted through the refresh control task;
and when the attribute value change is detected through the interface main thread, sending a request refreshing instruction to a display module for synthesizing and displaying the generated video stream.
In a second aspect, an embodiment of the present invention further provides an interface content display apparatus, including:
the interface adding module is configured to add a sub-interface in the display interface and create a refresh control task when video playing is detected;
the interface adjusting module is configured to adjust the attribute value of the sub-interface through the refresh control task when the generation of the video stream is detected;
and the interface generation module is used for sending a request refreshing instruction to the display module when the attribute value change is detected through the interface main thread, and is used for synthesizing and displaying the generated video stream.
In a third aspect, an embodiment of the present invention further provides an interface content display apparatus, including:
one or more processors;
storage means for storing one or more programs,
and when the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the interface content display method according to the embodiment of the present invention.
In a fourth aspect, embodiments of the present invention further provide a storage medium storing computer-executable instructions that, when executed by a computer processor, are configured to perform the interface content display method according to the embodiments of the present invention.
In the embodiment of the invention, when video playing is detected, a sub-interface is added in the display interface, and a refresh control task is created, when video stream generation is detected, the attribute value of the sub-interface is adjusted through the refresh control task, when attribute value change is detected through an interface main thread, a refresh request instruction is sent to the display module for synthesizing and displaying the generated video stream, the display method of the interface content is characterized in that refresh trigger does not depend on video stream generation, and the smoothness of the interface display content can be ensured under the condition of system resource shortage, thereby obviously improving the watching experience of users.
Drawings
Fig. 1 is a flow chart of an interface content display method according to an embodiment of the present invention;
FIG. 2 is a flow chart of another method for displaying interface content according to an embodiment of the present invention;
FIG. 3 is a flow chart of another method for displaying interface content according to an embodiment of the present invention;
FIG. 4 is a flow chart of another method for displaying interface content according to an embodiment of the present invention;
FIG. 5 is a flow chart of another method for displaying interface content according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of adding a sub-interface to a display interface according to an embodiment of the present invention;
FIG. 7 is a flow chart of another method for displaying interface content according to an embodiment of the present invention;
FIG. 8 is a schematic diagram of another sub-interface addition performed on a display interface according to an embodiment of the present invention;
fig. 9 is a block diagram of an interface content display device according to an embodiment of the present invention;
fig. 10 is a schematic structural diagram of an interface content display device according to an embodiment of the present invention.
Detailed Description
Embodiments of the present invention will be described in further detail below with reference to the drawings and examples. It should be understood that the particular embodiments described herein are illustrative only and are not limiting of embodiments of the invention. It should be further noted that, for convenience of description, only some, but not all of the structures related to the embodiments of the present invention are shown in the drawings.
The terms first, second and the like in the description and in the claims, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged, as appropriate, such that embodiments of the present application may be implemented in sequences other than those illustrated or described herein, and that the objects identified by "first," "second," etc. are generally of a type and not limited to the number of objects, e.g., the first object may be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.
Fig. 1 is a flow chart of an interface content display method provided by an embodiment of the present invention, which can be used in a video playing process, and the method can be executed by a computing device, such as a server, an intelligent terminal, a notebook, a tablet computer, etc., and specifically includes the following steps:
step S101, when video playing is detected, adding a sub-interface in a display interface, and creating a refresh control task.
The display interface is a picture displayed by the display device, and the display content of the display interface is a video picture under the video playing scene. When video playing is detected, adding a sub-interface in the display interface. Specifically, when the video play button in the display interface is detected to be triggered, a sub-interface is added in the display interface. Alternatively, a sub-interface may be added to the display interface when video playback is detected through a call interface provided by the video software. In another embodiment, the method further comprises the step of monitoring display content in the display interface, and adding a sub-interface in the display interface when the video playing picture is determined.
In one embodiment, the process of adding the sub-interface in the display interface may use a preset function, such as addView, where different layout modes of the display interface correspond to different sub-interface adding methods. And respectively adopting a corresponding interface adding method to add sub-interfaces for the display interfaces of the linear layout and the relative layout.
In one embodiment, the interface refresh is controlled by way of creating a refresh control task. The refresh control task may be created when video play is detected, may be created after system initialization, or may be created when video play application start is detected.
And step S102, when the generation of the video stream is detected, the attribute value of the sub-interface is adjusted through the refresh control task.
In one embodiment, decoding of video data by a video decoding thread generates video frame data, with a plurality of consecutive video frames comprising a video stream for rendering play. When the generation of video stream data is detected, the attribute value of the sub-interface is adjusted through the refresh control task. Wherein the attribute values of the sub-interfaces characterize various relevant parameters of the sub-interfaces, such as transparency, size, layout angle, etc., i.e. the attribute values of the sub-interfaces are changed by running refresh control tasks.
And step 103, when the attribute value change is detected through an interface main thread, sending a request refreshing instruction to a display module for synthesizing and displaying the generated video stream.
In one embodiment, the attribute value of the sub-interface is changed through the refresh control task, when the attribute value of the sub-interface changes, the interface main thread detects that the content of the interface changes, and then a refresh request instruction is correspondingly sent to the display module. The refresh request command may be a request for obtaining a vertical pulse signal issued by the display module, where the vertical pulse signal is also referred to as a vertical signal, and is a signal issued by the display module at a fixed time interval for refresh unified processing. When the interface main thread detects the vertical pulse signal, the video stream is acquired, and rendered and drawn through the rendering thread so as to be finally synthesized and displayed in the display interface.
According to the scheme, when video playing is detected, a sub-interface is added in the display interface, a refreshing control task is created, when video stream generation is detected, the attribute value of the sub-interface is adjusted through the refreshing control task, when attribute value change is detected through an interface main thread, a refreshing request instruction is sent to the display module for synthesizing and displaying the generated video stream, the display method of the interface content is independent of video stream generation in refreshing triggering, smoothness of the interface display content can be guaranteed under the condition of system resource shortage, and viewing experience of a user is remarkably improved.
Fig. 2 is a flow chart of another method for displaying interface contents according to an embodiment of the present invention, which provides a way to adjust attribute values of a sub-interface through a refresh control task, as shown in fig. 2, and specifically includes:
step S201, when video playing is detected, adding a sub-interface in a display interface, and creating a refresh control task.
And step S202, when the generation of the video stream is detected, the attribute value of the sub-interface is adjusted at intervals of preset time by the refresh control task.
In one embodiment, the attribute values of the sub-interfaces are adjusted at regular intervals by a refresh control task. Alternatively, the fixed time interval may be 20 ms, or a refresh time interval obtained according to the test calculation and when the frames are not blocked or dropped during the picture playing, the refresh time interval is obtained according to the corresponding playing frame number per second.
And step 203, when the attribute value change is detected through the interface main thread, a request refreshing instruction is sent to a display module for synthesizing and displaying the generated video stream.
According to the method, the attribute value of the sub-interface is adjusted every preset time through the refresh control task, the generation of video stream data is not needed to be relied as a refresh trigger condition, and the problem of picture blocking caused by delay of a refresh trigger request due to system resource tension is avoided.
Fig. 3 is a flow chart of another method for displaying interface contents according to an embodiment of the present invention, which provides a specific manner of adjusting attribute values of a sub-interface through a refresh control task, as shown in fig. 3, and specifically includes:
step S301, when video playing is detected, adding a sub-interface in a display interface, and creating a refresh control task.
And step S302, when the generation of the video stream is detected, the transparency of the sub-interface is adjusted at intervals of preset time through the refresh control task.
In one embodiment, when adjusting the attribute value of the sub-interface, the transparency attribute value is selected as the adjustment object. Where transparency characterizes the degree of transparency of the sub-interface, an exemplary representation may be represented by a total of 256 values from 0 to 255, e.g., 0 for full transparency and 255 for opacity.
Optionally, the specific adjustment mode may be: randomly selecting transparency values of the sub-interfaces in a set transparency value range interval, wherein the corresponding transparency values in two adjacent adjustment processes are different in size; or sequentially carrying out the cyclic adjustment of the increment or decrement of the transparency value in the transparency value range interval of the sub-interface; or sequentially selecting the transparency values of the sub-interfaces between the set first transparency values and the second transparency values.
The transparency value is represented by a 0-order and is fully transparent, and 255-order is represented by opaque, for example, the transparency value can be in a range of 0 to 10, in a manner of randomly selecting the transparency value of the sub-interface in a range of the set transparency value. Meanwhile, in order to achieve the purpose of adjusting the attribute value of the sub-interface, the corresponding transparency values in the adjacent two adjustment processes are different in size. For example, taking an adjustment for every 20 ms as an example, assuming that the transparency value of the initial sub-interface is 0, the transparency value of the sub-interface is adjusted to 5 in the interval of 0 to 10 in the 20 th ms, and 2 in the interval of 0 to 10 in the 40 th ms, respectively.
The transparency value is fully transparent in order of 0, and 255 is opaque, for example, and may be in the interval of 0 to 10. For example, the incremental loop adjustment may take an adjustment performed once every 20 ms as an example, and assuming that the transparency value of the initial sub-interface is 0, the transparency value of the sub-interface is adjusted to 1 by sequentially increasing the selected value in the interval from 0 to 10 in the 20 th ms, and the transparency value of the sub-interface is adjusted to 2 by sequentially increasing the selected value in the interval from 0 to 10 in the 40 th ms. After 10 is selected in a manner of sequentially increasing the selection value in the interval of 0 to 10, 0 is selected next time when the transparency value of the sub-interface is selected. For example, the process of decreasing the cycle adjustment may take an adjustment performed once every 20 milliseconds as an example, and assuming that the transparency value of the initial sub-interface is 10, the transparency value of the sub-interface is adjusted to 9 by sequentially increasing the selection value in the interval from 0 to 10 in the 20 th millisecond, and the transparency value of the sub-interface is adjusted to 8 by sequentially increasing the selection value in the interval from 0 to 10 in the 40 th millisecond. After selecting 0 in a manner of sequentially increasing the selection value in the interval of 0 to 10, selecting 10 next time when selecting the transparency value of the sub-interface.
For the mode that transparency values of the sub-interfaces are sequentially selected between a set first transparency value and a set second transparency value, the transparency values are fully transparent in 0 order, the transparency is opaque in 255 order, and the first transparency value can be 0 and the second transparency value can be 1. For example, taking an adjustment every 20 ms as an example, assuming that the transparency value of the initial sub-interface is 0, the 20 th ms selects a value of 1, and accordingly, the transparency value of the sub-interface is adjusted to 1, the 40 th ms selects a value of 0, and accordingly, the transparency value of the sub-interface is adjusted to 1, and so on.
And step 303, when the transparency change is detected through an interface main thread, sending a request refreshing instruction to a display module for synthesizing and displaying the generated video stream.
According to the method, when video playing is detected, a sub-interface is added in a display interface, a refresh control task is created, when video stream generation is detected, transparency of the sub-interface is adjusted every preset time through the refresh control task, when transparency change is detected through an interface main thread, a refresh request instruction is sent to a display module for synthesizing and displaying the generated video stream, and specifically, when transparency adjustment is carried out, transparency values of the sub-interface are randomly selected in a set transparency value range interval, wherein corresponding transparency values in two adjacent adjustment processes are different; or sequentially carrying out the cyclic adjustment of the increment or decrement of the transparency value in the transparency value range interval of the sub-interface; or the transparency values of the sub-interfaces are sequentially selected between the set first transparency values and the second transparency values, the display method of the interface content is independent of video stream generation, and under the condition of system resource shortage, the transparency of the sub-interfaces can be adjusted at intervals to trigger the interface refresh, so that the smoothness of the interface display content is ensured, and the viewing experience of a user is remarkably improved.
Fig. 4 is a flow chart of another method for displaying interface contents according to an embodiment of the present invention, which provides another specific way to adjust attribute values of a sub-interface through a refresh control task, as shown in fig. 4, and specifically includes:
step S401, when video playing is detected, adding a sub-interface in a display interface, and creating a refresh control task.
And step S402, when the generation of the video stream is detected, adjusting the layout angle of the sub-interface at intervals of preset time by the refresh control task.
The layout angle is used as one of attribute values of the sub-interface, and characterizes the layout direction style of the sub-interface. For example, the sub-interfaces can be rotated to adjust the layout direction of the sub-interfaces in a rotating manner by four different directions, taking a square sub-interface as an example and taking the center point of the sub-interface as a rotation reference point, and rotating clockwise by 90 degrees to change the layout angle of the sub-interface.
Optionally, the manner of adjusting the layout angle of the sub-interface at intervals of a preset time by using the refresh control task may be: and according to a preset rotation direction, sequentially adjusting the layout angles of the sub-interfaces, wherein the rotation direction comprises a clockwise direction and a counterclockwise direction. The preset time is exemplified by 20 ms, and the sub-interface is turned every 20 ms to change the attribute value.
And step S403, when the layout angle change is detected through an interface main thread, sending a request refreshing instruction to a display module for synthesizing and displaying the generated video stream.
According to the method, when video playing is detected, a sub-interface is added in a display interface, a refreshing control task is created, when video stream generation is detected, the layout angle of the sub-interface is adjusted at intervals of preset time through the refreshing control task, when the change of the layout angle is detected through an interface main thread, a refreshing request instruction is sent to a display module for synthesizing and displaying the generated video stream, and under the condition of system resource shortage, the layout angle of the sub-interface can be adjusted at intervals, interface refreshing is triggered, smoothness of interface display content is guaranteed, and viewing experience of a user is remarkably improved.
Fig. 5 is a flow chart of another method for displaying interface contents provided by the embodiment of the present invention, which provides a specific manner of adding a sub-interface in a display interface, as shown in fig. 5, and specifically includes:
and step S501, when video playing is detected, identifying a playing interface in a current display interface, adding a sub-interface in an area which does not contain the playing interface in the display interface, and creating a refresh control task.
In one embodiment, when adding the sub-interface, the playing interface in the current display interface is identified, and the sub-interface is added in a region of the display interface which does not contain the playing interface. Illustratively, for non-full screen play modes, sub-interface additions are made in the area of the non-play interface. Fig. 6 is a schematic diagram of adding a sub-interface on a display interface according to an embodiment of the present invention. As shown in fig. 6, in the display interface 500, an area 501 including a play interface and an area 502 including a non-play interface are added to an arbitrary position in the area 502 when a sub-interface is added, and are added at a position 503 as illustrated in the example.
And step S502, when the generation of the video stream is detected, the attribute value of the sub-interface is adjusted through the refresh control task.
And step S503, when the attribute value change is detected through an interface main thread, sending a request refreshing instruction to a display module for synthesizing and displaying the generated video stream.
According to the method, when video playing is detected, a playing interface in a current display interface is identified, a sub-interface is added in an area which does not contain the playing interface in the display interface, a refreshing control task is created, when video stream generation is detected, attribute values of the sub-interface are adjusted through the refreshing control task, when attribute value change is detected through an interface main thread, a request refreshing instruction is sent to a display module for synthesizing and displaying the generated video stream, and the refreshing trigger is independent of video stream generation.
Fig. 7 is a flow chart of another method for displaying interface contents according to an embodiment of the present invention, which provides a specific manner of adding a sub-interface in a display interface, as shown in fig. 7, and specifically includes:
and step S601, adding a sub-interface at a preset position of a display interface when video playing is detected, wherein the preset position comprises an edge position of the display interface, and creating a refresh control task.
In one embodiment, when the sub-interface is added, the sub-interface is added at a preset position of the display interface, wherein the preset position comprises an edge position of the display interface. In an exemplary full screen mode, the sub-interface is added at the edge of the display interface. Fig. 8 is a schematic diagram of another sub-interface addition performed on a display interface according to an embodiment of the present invention. As shown in fig. 8, in the display interface 600, the display of the full-screen playing interface is performed, and at the peripheral edge position of the display interface 600, addition of the sub-interface is performed as an example at a position 601.
And step S602, when the generation of the video stream is detected, the attribute value of the sub-interface is adjusted through the refresh control task.
And step 603, when the attribute value change is detected through an interface main thread, sending a request refreshing instruction to a display module for synthesizing and displaying the generated video stream.
According to the method, when video playing is detected, a sub-interface is added at a preset position of a display interface, the preset position comprises an edge position of the display interface, a refreshing control task is created, when video stream generation is detected, attribute values of the sub-interface are adjusted through the refreshing control task, when attribute value change is detected through an interface main thread, a request refreshing instruction is sent to a display module for synthesizing and displaying the generated video stream, and refreshing triggering is independent of video stream generation.
In one embodiment, the above-described added sub-interface is a single-pixel background-free interface. In order to reduce the influence of adding the sub-interface to the original playing interface to the maximum extent, the sub-interface is optionally a single-pixel background-free interface, so that a user cannot perceive the existence of the interface when watching the video, and smooth playing of the video stream is ensured.
Fig. 9 is a block diagram of an interface content display device according to an embodiment of the present invention, where the device is configured to execute the interface content display method according to the foregoing embodiment, and the device has functional modules and beneficial effects corresponding to the execution method. As shown in fig. 9, the apparatus specifically includes: an interface adding module 101, an interface adjusting module 102, and an interface generating module 103, wherein,
an interface adding module 101 configured to add a sub-interface in a display interface and create a refresh control task when video playback is detected;
the interface adjustment module 102 is configured to adjust the attribute value of the sub-interface through the refresh control task when the generation of the video stream is detected;
and the interface generating module 103 is configured to send a request refreshing instruction to the display module when the attribute value change is detected through an interface main thread, and the request refreshing instruction is used for carrying out composite display on the generated video stream.
According to the scheme, when video playing is detected, a sub-interface is added in the display interface, a refreshing control task is created, when video stream generation is detected, the attribute value of the sub-interface is adjusted through the refreshing control task, when attribute value change is detected through an interface main thread, a refreshing request instruction is sent to the display module for synthesizing and displaying the generated video stream, the display method of the interface content is independent of video stream generation in refreshing triggering, smoothness of the interface display content can be guaranteed under the condition of system resource shortage, and viewing experience of a user is remarkably improved.
In one possible embodiment, the interface adjustment module 102 is specifically configured to:
and adjusting the attribute value of the sub-interface at preset time intervals through the refresh control task.
In one possible embodiment, the interface adjustment module 102 is specifically configured to:
the transparency of the sub-interface is adjusted at intervals of preset time through the refresh control task, wherein the transparency adjustment mode of the sub-interface comprises any one of the following modes:
randomly selecting the transparency value of the sub-interface in a set transparency value range interval, wherein the corresponding transparency values in two adjacent adjustment processes are different in size;
sequentially performing incremental or decremental cyclic adjustment on the transparency values of the sub-interfaces in a set transparency value range interval;
and sequentially selecting the transparency values of the sub-interfaces between the set first transparency values and the set second transparency values.
In one possible embodiment, the interface adjustment module 102 is specifically configured to:
the layout angle of the sub-interface is adjusted at intervals of preset time through the refresh control task, wherein the mode for adjusting the layout angle of the sub-interface comprises the following steps:
and adjusting the layout angle of the sub-interfaces in sequence according to a preset rotation direction, wherein the rotation direction comprises a clockwise direction and a counterclockwise direction.
In one possible embodiment, the interface adding module 101 is specifically configured to:
identifying a playing interface in a current display interface, and adding a sub-interface in a region which does not contain the playing interface in the display interface; or alternatively
And adding a sub-interface at a preset position of a display interface, wherein the preset position comprises an edge position of the display interface.
In one possible embodiment, the sub-interface is a single-pixel background-free interface.
In one possible embodiment, the interface generation module 103 is specifically configured to:
after sending a refresh request instruction to a display module, responding to a vertical pulse signal generated by the display module, reading the generated video stream data, and synthesizing and displaying the video stream through a rendering thread and the interface main thread.
Fig. 10 is a schematic structural diagram of an interface content display apparatus according to an embodiment of the present invention, where, as shown in fig. 10, the apparatus includes a processor 201, a memory 202, an input device 203, and an output device 204; the number of processors 201 in the device may be one or more, one processor 201 being taken as an example in fig. 10; the processor 201, memory 202, input device 203, and output device 204 in the apparatus may be connected by a bus or other means, for example in fig. 10. The memory 202 is a computer readable storage medium, and may be used to store a software program, a computer executable program, and modules, such as program instructions/modules corresponding to the interface content display method in the embodiment of the present invention. The processor 201 executes various functional applications of the device and data processing by executing software programs, instructions and modules stored in the memory 202, i.e., implements the interface content display method described above. The input means 203 may be used to receive entered numeric or character information and to generate key signal inputs related to user settings and function control of the device. The output device 204 may include a display device such as a display screen.
The embodiment of the present invention also provides a storage medium containing computer executable instructions, which when executed by a computer processor, are configured to perform an interface content display method described in the foregoing embodiment, and specifically includes:
when video playing is detected, adding a sub-interface in a display interface, and creating a refresh control task;
when the generation of the video stream is detected, the attribute value of the sub-interface is adjusted through the refresh control task;
and when the attribute value change is detected through the interface main thread, sending a request refreshing instruction to a display module for synthesizing and displaying the generated video stream.
It should be noted that, in the embodiment of the interface content display apparatus, each unit and module included are only divided according to the functional logic, but not limited to the above-mentioned division, so long as the corresponding functions can be implemented; in addition, the specific names of the functional units are also only for distinguishing from each other, and are not used to limit the protection scope of the embodiments of the present invention.
Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the embodiments of the present invention are not limited to the particular embodiments described herein, but are capable of numerous obvious changes, rearrangements and substitutions without departing from the scope of the embodiments of the present invention. Therefore, while the embodiments of the present invention have been described in connection with the above embodiments, the embodiments of the present invention are not limited to the above embodiments, but may include many other equivalent embodiments without departing from the spirit of the embodiments of the present invention, and the scope of the embodiments of the present invention is determined by the scope of the appended claims.
Claims (8)
1. The interface content display method is characterized by comprising the following steps:
when triggering video playing, adding a sub-interface in a display interface, and creating a refresh control task;
when the generation of a video stream is detected, the attribute value of the sub-interface is adjusted through the refresh control task, wherein the adjustment of the attribute value of the sub-interface is carried out at intervals of preset time through the refresh control task, the video stream consists of a plurality of continuous video frame data, and the video frame data is generated by decoding video data through a video decoding thread;
when the attribute value change is detected through an interface main thread, a request refreshing instruction is sent to a display module, the generated video stream data is read and responded to a vertical pulse signal generated by the display module, and the video stream is synthesized and displayed through a rendering thread and the interface main thread.
2. The interface content display method according to claim 1, wherein adjusting the attribute value of the sub-interface at intervals of a preset time by the refresh control task includes:
the transparency of the sub-interface is adjusted at intervals of preset time through the refresh control task, wherein the transparency adjustment mode of the sub-interface comprises any one of the following modes:
randomly selecting the transparency value of the sub-interface in a set transparency value range interval, wherein the corresponding transparency values in two adjacent adjustment processes are different in size;
sequentially performing incremental or decremental cyclic adjustment on the transparency values of the sub-interfaces in a set transparency value range interval;
and sequentially selecting the transparency values of the sub-interfaces between the set first transparency values and the set second transparency values.
3. The interface content display method according to claim 1, wherein adjusting the attribute value of the sub-interface at intervals of a preset time by the refresh control task includes:
the layout angle of the sub-interface is adjusted at intervals of preset time through the refresh control task, wherein the mode for adjusting the layout angle of the sub-interface comprises the following steps:
and adjusting the layout angle of the sub-interfaces in sequence according to a preset rotation direction, wherein the rotation direction comprises a clockwise direction and a counterclockwise direction.
4. The interface content display method according to claim 1, wherein adding a sub-interface in the display interface comprises:
identifying a playing interface in a current display interface, and adding a sub-interface in a region which does not contain the playing interface in the display interface; or alternatively
And adding a sub-interface at a preset position of a display interface, wherein the preset position comprises an edge position of the display interface.
5. The interface content display method according to any one of claims 1 to 4, wherein the sub-interface is a single-pixel background-free interface.
6. An interface content display apparatus, comprising:
the interface adding module is configured to add a sub-interface in the display interface and create a refresh control task when triggering video playing;
the interface adjustment module is configured to adjust the attribute value of the sub-interface through the refresh control task when the generation of the video stream is detected, wherein the adjustment module comprises the step of adjusting the attribute value of the sub-interface through the refresh control task at intervals of preset time, wherein the video stream consists of a plurality of continuous video frame data, and the video frame data is generated by decoding video data through a video decoding thread;
and the interface generation module is configured to send a request refreshing instruction to the display module when the attribute value change is detected through an interface main thread, receive and respond to the vertical pulse signal generated by the display module, read the generated video stream data, and perform composite display on the video stream through a rendering thread and the interface main thread.
7. An interface content display apparatus, the apparatus comprising: one or more processors; storage means for storing one or more programs that when executed by the one or more processors cause the one or more processors to implement the interface content display method of any of claims 1-5.
8. A storage medium storing computer executable instructions which when executed by a computer processor are for performing the interface content display method of any one of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210122179.2A CN114390333B (en) | 2022-02-09 | 2022-02-09 | Interface content display method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210122179.2A CN114390333B (en) | 2022-02-09 | 2022-02-09 | Interface content display method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114390333A CN114390333A (en) | 2022-04-22 |
| CN114390333B true CN114390333B (en) | 2024-04-02 |
Family
ID=81205861
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210122179.2A Active CN114390333B (en) | 2022-02-09 | 2022-02-09 | Interface content display method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114390333B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2019184955A (en) * | 2018-04-16 | 2019-10-24 | シャープ株式会社 | Video processing device, television receiver, control program, and recording medium |
| CN113204656A (en) * | 2021-03-31 | 2021-08-03 | 北京达佳互联信息技术有限公司 | Multimedia resource display method, device, equipment and storage medium |
| WO2021164445A1 (en) * | 2020-02-19 | 2021-08-26 | 华为技术有限公司 | Notification processing method, electronic apparatus, and system |
| CN113362783A (en) * | 2020-03-06 | 2021-09-07 | 华为技术有限公司 | Refresh rate switching method and electronic equipment |
| US11146847B1 (en) * | 2020-08-08 | 2021-10-12 | Haystack TV, Inc. | Dynamic context-based video streaming overlay generation |
| CN113766324A (en) * | 2020-06-02 | 2021-12-07 | 深圳市万普拉斯科技有限公司 | Video playing control method and device, computer equipment and storage medium |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8626718B2 (en) * | 2010-10-29 | 2014-01-07 | Verizon Patent And Licensing Inc. | Content caching based on refresh and expiration times |
| US9430123B2 (en) * | 2012-10-09 | 2016-08-30 | Sap Se | Triggering a refresh of displayed content on a mobile device |
-
2022
- 2022-02-09 CN CN202210122179.2A patent/CN114390333B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2019184955A (en) * | 2018-04-16 | 2019-10-24 | シャープ株式会社 | Video processing device, television receiver, control program, and recording medium |
| WO2021164445A1 (en) * | 2020-02-19 | 2021-08-26 | 华为技术有限公司 | Notification processing method, electronic apparatus, and system |
| CN113362783A (en) * | 2020-03-06 | 2021-09-07 | 华为技术有限公司 | Refresh rate switching method and electronic equipment |
| CN113766324A (en) * | 2020-06-02 | 2021-12-07 | 深圳市万普拉斯科技有限公司 | Video playing control method and device, computer equipment and storage medium |
| US11146847B1 (en) * | 2020-08-08 | 2021-10-12 | Haystack TV, Inc. | Dynamic context-based video streaming overlay generation |
| CN113204656A (en) * | 2021-03-31 | 2021-08-03 | 北京达佳互联信息技术有限公司 | Multimedia resource display method, device, equipment and storage medium |
Non-Patent Citations (2)
| Title |
|---|
| 基于Spring Cloud微服务架构的短视频社区的设计与实现;孔维昌;《中国优秀硕士学位论文全文数据库电子期刊》;全文 * |
| 基于国产化平台的雷达回波视频软件绘制研究;李华君;张超;陈婧;林悦;;雷达与对抗(02);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114390333A (en) | 2022-04-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8775965B1 (en) | Immersive mode for a web browser | |
| US10254955B2 (en) | Progressively indicating new content in an application-selectable user interface | |
| US9547525B1 (en) | Drag toolbar to enter tab switching interface | |
| CN111866423B (en) | Screen recording method for electronic terminal and corresponding equipment | |
| CN103562862B (en) | Global composition system | |
| CN114648951B (en) | Method for controlling dynamic change of screen refresh rate and electronic equipment | |
| EP3985658A1 (en) | Information display method and apparatus | |
| US20160291846A1 (en) | Generating carousel user interface with graphics processing unit | |
| CN105190701B (en) | Synthesis system based on primitive and method | |
| US9703466B2 (en) | Method, device and terminal for implementing rotation of floating window | |
| KR20130098332A (en) | Method and apparatus for accommodating display migration among a plurality of physical displays | |
| CN111124668A (en) | Memory release method and device, storage medium and terminal | |
| CN111107427B (en) | Image processing method and related product | |
| US20070002014A1 (en) | Pointer for a large display | |
| CN111951206A (en) | Image synthesis method, image synthesis device and terminal equipment | |
| CN107077347B (en) | View management architecture | |
| US11721306B2 (en) | Method and apparatus for providing a picture-in-picture (PIP) overlay window on a single physical monitor | |
| CN114390333B (en) | Interface content display method, device, equipment and storage medium | |
| CN115421631A (en) | Interface display method and device | |
| CN114827737A (en) | Image generation method and device and electronic equipment | |
| CN111949150A (en) | Method and device for controlling peripheral switching, storage medium and electronic equipment | |
| CN113034653A (en) | Animation rendering method and device | |
| EP4300979A1 (en) | Display method, terminal, and storage medium | |
| US20220362668A1 (en) | Information display method and apparatus, terminal, storage medium, and computer program product | |
| CN113589992B (en) | Game interface interaction method, game interface interaction device, medium and terminal equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |