CN108228278B - Method and device for loading video desktop - Google Patents

Method and device for loading video desktop Download PDF

Info

Publication number
CN108228278B
CN108228278B CN201711490018.4A CN201711490018A CN108228278B CN 108228278 B CN108228278 B CN 108228278B CN 201711490018 A CN201711490018 A CN 201711490018A CN 108228278 B CN108228278 B CN 108228278B
Authority
CN
China
Prior art keywords
data
loading
target image
stream data
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201711490018.4A
Other languages
Chinese (zh)
Other versions
CN108228278A (en
Inventor
鲁磊
李侦侦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Qihoo Technology Co Ltd
Original Assignee
Beijing Qihoo Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Qihoo Technology Co Ltd filed Critical Beijing Qihoo Technology Co Ltd
Priority to CN201711490018.4A priority Critical patent/CN108228278B/en
Publication of CN108228278A publication Critical patent/CN108228278A/en
Application granted granted Critical
Publication of CN108228278B publication Critical patent/CN108228278B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/445Program loading or initiating
    • G06F9/44521Dynamic linking or loading; Link editing at or after load time, e.g. Java class loading
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The embodiment of the invention provides a method and a device for loading a video desktop, wherein the method comprises the following steps: acquiring source video data; extracting image stream data and audio stream data from the source video data; determining a corresponding relation between the image stream data and the audio stream data; loading target image stream data and target audio stream data which meet preset conditions in a desktop program object of the mobile terminal according to the corresponding relation; the desktop matched with the target image stream data and the target audio stream data is displayed, the problem that only static wallpaper can be replaced as the desktop of the mobile terminal in the prior art is solved, and the display form of the desktop of the mobile terminal is increased; the user can select different source video data according to own hobbies or requirements, so that a corresponding video desktop is customized, and the interestingness of using the mobile terminal by the user is increased.

Description

Method and device for loading video desktop
Technical Field
The invention relates to the technical field of communication, in particular to a method and a device for loading a video desktop.
Background
With the progress of mobile technology, mobile terminals such as smart phones and the like become an indispensable part of work and life of people.
At present, mobile terminals such as smart phones and the like all provide a function of replacing desktop wallpaper, and users can replace mobile phone desktops according to interests of the users. For example, the user may use a favorite picture or a photo of his family as the desktop wallpaper of the mobile phone.
Although the desktop wallpapers that can be replaced by users on the existing mobile phones are various, the desktop wallpapers are usually static and are monotonous and uninteresting.
Disclosure of Invention
In view of the above problems, the present invention is proposed to provide a method for loading a video desktop and a corresponding apparatus for loading a video desktop that overcome or at least partially solve the above problems.
According to an aspect of the present invention, there is provided a method for loading a video desktop, including:
acquiring source video data;
extracting image stream data and audio stream data from the source video data;
determining a corresponding relation between the image stream data and the audio stream data;
loading target image stream data and target audio stream data which meet preset conditions in a desktop program object of the mobile terminal according to the corresponding relation;
and displaying the desktop matched with the target image stream data and the target audio stream data.
Optionally, the image stream data includes a plurality of frames of image frames, the audio stream data includes a plurality of audio data segments, and the extracting the image stream data and the audio stream data from the source video data includes:
according to the time sequence, the source video data is disassembled into a plurality of frames of image frames and a plurality of audio data segments, and the plurality of frames of image frames and the plurality of audio data segments are respectively provided with corresponding time stamp marks.
Optionally, the step of determining the correspondence between the image stream data and the audio stream data includes:
it is determined that there is a correspondence between image frames and audio data segments that contain the same timestamp marker.
Optionally, before the step of loading, according to the correspondence, target image stream data and target audio stream data that satisfy a preset condition in a desktop program object of the mobile terminal, the method further includes:
a loading location in a desktop object of the mobile terminal is determined.
Optionally, the step of determining a loading position in a desktop object of the mobile terminal includes:
acquiring layout information of each application program in a desktop program object of the mobile terminal;
and determining the loading position according to the layout information of each application program.
Optionally, the step of determining a loading position in a desktop object of the mobile terminal includes:
and receiving a loading position selected by a user in a desktop program object of the mobile terminal.
Optionally, the step of loading target image stream data and target audio stream data that satisfy a preset condition in the desktop program object of the mobile terminal according to the correspondence includes:
determining the playing time length of the target image stream;
according to the playing time length, sequentially extracting target image frames with corresponding time lengths from the multi-frame image frames and target audio data segments with corresponding relations of the target image frames;
loading the target image frame and target audio data segment at the loading location.
Optionally, the step of loading the target image frame and target audio data segment at the loading position comprises:
determining a region size of the loading location;
scaling the target image frame to match the region size;
and loading the zoomed target image frame and the target audio data segment at the loading position.
Optionally, the step of loading target image stream data and target audio stream data that satisfy a preset condition in the desktop program object of the mobile terminal according to the correspondence includes:
determining the playing time length of the target image stream;
according to the playing time length, sequentially extracting target image frames with corresponding time length from the multi-frame image frames;
acquiring specific audio with corresponding duration;
loading the target image frame and specific audio at the loading position.
Optionally, the step of loading the target image frame and specific audio at the loading position comprises:
determining a region size of the loading location;
scaling the target image frame to match the region size;
the scaled target image frame and the specific audio are loaded at the loading position.
Optionally, the step of determining the playing time length of the target image stream includes:
respectively determining timestamp markers of a starting image frame and an ending image frame of a target image stream in the source video data;
and determining the playing time length of the target image stream according to the timestamp mark.
Optionally, the source video data includes first data and second data, and the step of loading target image stream data and target audio stream data that satisfy a preset condition in a desktop program object of the mobile terminal according to the correspondence includes:
loading first target image stream data of first data and second target audio stream data of second data at the loading position; alternatively, the first and second electrodes may be,
second target image stream data of the first data and first target audio stream data of the second data are loaded at the loading position.
Optionally, the step of presenting a desktop matching the target image stream data and the target audio stream data comprises:
and playing the target image stream data and the target audio stream data.
Optionally, the step of presenting a desktop matching the target image stream data and the target audio stream data comprises:
and when an operation instruction of a user at the loading position is received, playing the target image stream data and the target audio stream data.
Optionally, the step of playing the target image stream data and the target audio stream data includes:
determining system setting information in the mobile terminal;
and if the system setting information is mute setting and/or vibration setting, playing the target image stream data in a mute state.
Optionally, the step of obtaining source video data includes:
determining a storage position of source video data in the mobile terminal;
the source video data is extracted from the storage location.
Optionally, the step of obtaining source video data includes:
source video data is downloaded from a server.
According to another aspect of the present invention, there is provided an apparatus for loading a video desktop, including:
the acquisition module is used for acquiring source video data;
the extraction module is used for extracting image stream data and audio stream data from the source video data;
the determining module is used for determining the corresponding relation between the image stream data and the audio stream data;
the loading module is used for loading target image stream data and target audio stream data which meet preset conditions in a desktop program object of the mobile terminal according to the corresponding relation;
and the display module is used for displaying the desktop matched with the target image stream data and the target audio stream data.
Optionally, the image stream data includes a plurality of frames of image frames, the audio stream data includes a plurality of audio data segments, and the extracting module includes:
and the source video data disassembling submodule is used for respectively disassembling the source video data into a plurality of frames of image frames and a plurality of audio data segments according to a time sequence, and the plurality of frames of image frames and the plurality of audio data segments are respectively provided with corresponding timestamp marks.
Optionally, the determining module includes:
and the corresponding relation determining submodule is used for determining that the image frame and the audio data segment containing the same timestamp marker have corresponding relation.
Optionally, the method further comprises:
and the loading position determining module is used for determining the loading position in the desktop program object of the mobile terminal.
Optionally, the loading position determining module includes:
the layout information acquisition submodule is used for acquiring the layout information of each application program in a desktop program object of the mobile terminal;
and the loading position determining submodule is used for determining the loading position according to the layout information of each application program.
Optionally, the loading position determining module includes:
and the loading position receiving submodule is used for receiving the loading position selected by the user in the desktop program object of the mobile terminal.
Optionally, the loading module includes:
the playing time length determining submodule is used for determining the playing time length of the target image stream;
the target image frame and target audio data segment extraction submodule is used for sequentially extracting target image frames with corresponding time lengths from the multi-frame image frames according to the playing time lengths and target audio data segments with corresponding relationships of the target image frames;
a target image frame and target audio data segment loading sub-module for loading the target image frame and target audio data segment at the loading location.
Optionally, the target image frame and target audio data segment loading sub-module includes:
a first area size determination unit configured to determine an area size of the loading position;
a first target image frame scaling unit for scaling the target image frame to match the region size;
and the target image frame and target audio data segment loading unit is used for loading the zoomed target image frame and target audio data segment at the loading position.
Optionally, the loading module includes:
the playing time length determining submodule is used for determining the playing time length of the target image stream;
the target image frame extraction submodule is used for sequentially extracting target image frames with corresponding duration from the multi-frame image frames according to the playing duration;
the specific audio acquisition submodule is used for acquiring specific audio with corresponding duration;
a target image frame and specific audio loading sub-module for loading the target image frame and specific audio at the loading location.
Optionally, the target image frame and specific audio loading sub-module comprises:
a second area size determination unit configured to determine an area size of the loading position;
a second target image frame scaling unit for scaling the target image frame to match the region size;
and the target image frame and specific audio loading unit is used for loading the zoomed target image frame and specific audio at the loading position.
Optionally, the playing time length determining sub-module includes:
a timestamp marking determination unit for determining timestamp markings of a start image frame and an end image frame of a target image stream in the source video data, respectively;
and the playing time length determining unit is used for determining the playing time length of the target image stream according to the timestamp mark.
Optionally, the source video data includes first data and second data, and the loading module includes:
a first loading submodule for loading first target image stream data of first data and second target audio stream data of second data at the loading position; alternatively, the first and second electrodes may be,
a second loading submodule for loading second target image stream data of the first data and first target audio stream data of the second data at the loading position.
Optionally, the presentation module comprises:
and the playing sub-module is used for playing the target image stream data and the target audio stream data, or playing the target image stream data and the target audio stream data when receiving an operation instruction of a user at the loading position.
Optionally, the playing sub-module includes:
a system setting information determination unit for determining system setting information in the mobile terminal;
and the mute playing unit is used for playing the target image stream data in a mute state if the system setting information is mute setting and/or vibration setting.
Optionally, the obtaining module includes:
the storage position determining submodule is used for determining the storage position of the source video data in the mobile terminal;
a source video data extraction sub-module to extract the source video data from the storage location.
Optionally, the obtaining module includes:
and the source video data downloading submodule is used for downloading the source video data from the server.
According to a third aspect of the present invention, there is provided an apparatus for loading a video desktop, including a processor, a memory, and a computer program stored in the memory and executable on the processor, where the computer program, when executed by the processor, implements the steps of the method for loading a video desktop as described above.
According to a fourth aspect of the present invention, a computer-readable storage medium is provided, on which a computer program is stored, which computer program, when being executed by a processor, realizes the above-mentioned steps of the method of loading a video desktop.
According to the embodiment of the invention, the source video data is obtained, the image stream data and the audio stream data are extracted from the source video data, and the corresponding relation between the image stream data and the audio stream data is determined, so that the target image stream data and the target audio stream data meeting the preset conditions can be loaded in the desktop program object of the mobile terminal according to the corresponding relation, and the desktop matched with the target image stream data and the target audio stream data is displayed. According to the embodiment, the target image stream data and the target audio stream data are loaded in the mobile terminal, so that a corresponding video desktop can be customized, the problem that only static wallpaper can be replaced as the desktop of the mobile terminal in the prior art is solved, and the display form of the desktop of the mobile terminal is increased; the user can select different source video data according to own hobbies or requirements, so that a corresponding video desktop is customized, and the interestingness of using the mobile terminal by the user is increased.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
FIG. 1 is a flow chart illustrating steps of a method for loading a video desktop according to an embodiment of the invention;
FIG. 2 is a flow chart illustrating steps of another method for loading a video desktop according to an embodiment of the invention;
FIG. 3 is a flowchart illustrating steps of a method for loading a video desktop according to an embodiment of the invention; and the number of the first and second groups,
fig. 4 is a schematic block diagram of an apparatus for loading a video desktop according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
Referring to fig. 1, a schematic flowchart illustrating steps of a method for loading a video desktop according to an embodiment of the present invention may specifically include the following steps:
step 101, acquiring source video data;
it should be noted that the method can be applied to various mobile terminals. Such as a cell phone, tablet computer, laptop computer, etc. The embodiment does not limit the specific type of the mobile terminal.
Generally, a mobile terminal may provide a desktop object in which a user may place various applications installed in the mobile terminal, thereby forming a desktop of the mobile terminal. Generally, the desktop of the mobile terminal is replaceable.
In the embodiment of the invention, in order to load the video desktop in the mobile terminal, the source video data to be loaded may be obtained first. The source video data is a section of video that is subsequently processed for loading into a video desktop.
In the embodiment of the present invention, the source video data may be a certain piece of video data stored in the mobile terminal.
Generally, a user may store some video files in the mobile terminal, and thus may directly use the video files as source video data.
In a specific implementation, a storage location of the source video data in the mobile terminal may be determined first, and then the source video data may be extracted from the location.
Alternatively, the source video data may be downloaded from a server. The present embodiment does not limit how the source video data is acquired.
Step 102, extracting image stream data and audio stream data from the source video data;
in the embodiment of the present invention, the image stream data may refer to an image stream composed of a plurality of frames of images extracted from source video data; the audio stream data may be an audio stream composed of a plurality of audio data segments extracted from the source video data.
Therefore, in a specific implementation, the source video data can be disassembled into a plurality of frames of image frames and a plurality of audio data segments respectively according to the time sequence. The time sequence may be a play time sequence of the source video data.
After the plurality of frames of image frames and the plurality of audio data segments are extracted in time sequence, corresponding timestamp markers may be set for each image frame and each audio data segment, respectively.
Step 103, determining a corresponding relation between the image stream data and the audio stream data;
in the embodiment of the present invention, the corresponding relationship between each disassembled image frame and each audio data segment may be determined according to the playing time sequence of the source video data. The correspondence may mean that the image frame and the audio data segment having the correspondence should be played simultaneously before the source video data is disassembled.
In a particular implementation, it may be determined that there is a correspondence between image frames and audio data segments that contain the same timestamp marker. That is, for a certain video frame and a certain audio data segment having the same, the source video data which is not disassembled is played at the same time.
Step 104, loading target image stream data and target audio stream data which meet preset conditions in a desktop program object of the mobile terminal according to the corresponding relation;
in the embodiment of the present invention, the target image stream data and the target audio stream data that satisfy the preset condition may refer to an image stream formed by a plurality of image frames selected by a user among a plurality of image frames obtained after disassembly, and an audio stream formed by a plurality of audio data segments having a corresponding relationship with the plurality of image frames.
After the target image stream data and the target audio stream data are determined, the loading positions of the target image stream data and the target audio stream data in the desktop program object of the mobile terminal can be determined, and then the target image stream data and the target audio stream data are loaded at the loading positions.
It should be noted that the source video data may include a plurality of, for example, the first data and the second data.
Therefore, after the first data and the second data are disassembled respectively, a plurality of frames of the first image frame, a plurality of pieces of the first audio data of the first data, and a plurality of frames of the second image frame and a plurality of pieces of the second audio data of the second data can be obtained.
Then, first target image stream data, first target audio stream data of the first data, and second target image stream data and second target audio stream data of the second data may be formed from the plurality of frames of the first image frame, the plurality of pieces of the first audio data, and the plurality of frames of the second image frame and the plurality of pieces of the second audio data.
When the source video data includes a plurality of data, the correspondence between the target image stream data and the target audio stream data may be determined according to the play time periods of the target image stream data and the target audio stream data.
For example, for an image stream and an audio stream having the same play time length, they can be considered to have corresponding correspondence.
Therefore, when target image stream data and target audio stream data are loaded into a desktop object of the mobile terminal, first target image stream data of the first data and second target audio stream data of the second data may be loaded at the determined loading position; alternatively, the second target image stream data of the first data and the first target audio stream data of the second data are loaded at the above-mentioned loading position.
And 105, displaying the desktop matched with the target image stream data and the target audio stream data.
In the embodiment of the invention, after the target image stream data and the target audio stream data are loaded, a video desktop of the mobile terminal matched with the target image stream data and the target audio stream data can be formed and displayed to the user.
In a specific implementation, after the video desktop is loaded and formed, the target image stream data and the target audio stream data can be automatically played at a certain time point, so that the desktop of the mobile terminal presents a corresponding video effect.
Or, after the video desktop is loaded and formed, the corresponding video effect can be displayed according to the operation instruction of the user.
For example, when an operation instruction such as clicking or touching of the user at the loading position is received, the target image stream data and the target audio stream data may be played, so that a corresponding video effect is presented.
It should be noted that, whether the target image stream data and the target audio stream data are automatically played or played according to the operation instruction of the user, the corresponding system setting information in the mobile terminal may be considered first.
For example, after the system setting information in the mobile terminal is determined, if the system setting information is a mute setting and/or a vibration setting, the target image stream may be played in a mute state without playing the generated target audio stream, thereby avoiding inconvenience to the user due to playing of audio stream data.
In the embodiment of the invention, by acquiring the source video data, extracting the image stream data and the audio stream data from the source video data and determining the corresponding relationship between the image stream data and the audio stream data, the target image stream data and the target audio stream data which meet the preset conditions can be loaded in the desktop program object of the mobile terminal according to the corresponding relationship so as to show the desktop matched with the target image stream data and the target audio stream data. According to the embodiment, the target image stream data and the target audio stream data are loaded in the mobile terminal, so that a corresponding video desktop can be customized, the problem that only static wallpaper can be replaced as the desktop of the mobile terminal in the prior art is solved, and the display form of the desktop of the mobile terminal is increased; the user can select different source video data according to own hobbies or requirements, so that a corresponding video desktop is customized, and the interestingness of using the mobile terminal by the user is increased.
Referring to fig. 2, a schematic flow chart illustrating steps of another method for loading a video desktop according to an embodiment of the present invention is shown, which may specifically include the following steps:
step 201, acquiring source video data;
it should be noted that the method can be applied to various mobile terminals. Such as a cell phone, tablet computer, laptop computer, etc. The embodiment does not limit the specific type of the mobile terminal. For convenience of understanding, the present embodiment takes the mobile terminal as a mobile phone as an example for description.
In the embodiment of the present invention, the source video data may be a video file stored in the mobile phone, or may also be a video file currently downloaded from a server. The source of the source video data is not limited in this embodiment.
Step 202, according to a time sequence, respectively disassembling the source video data into a plurality of frames of image frames and a plurality of audio data segments, wherein the plurality of frames of image frames and the plurality of audio data segments respectively have corresponding timestamp marks;
in the embodiment of the invention, the source video data can be disassembled into the multi-frame image frame and the plurality of audio data segments respectively according to the time sequence. The time sequence may be a play time sequence of the source video data.
After the plurality of frames of image frames and the plurality of audio data segments are extracted in time sequence, corresponding timestamp markers may be set for each image frame and each audio data segment, respectively.
Step 203, determining that the image frames and the audio data segments containing the same timestamp marks have a corresponding relation;
in the embodiment of the present invention, the image frames and the audio data segments having a correspondence relationship therebetween may mean that the image frames and the audio data segments having a correspondence relationship should be played simultaneously before the source video data is disassembled.
In a particular implementation, it may be determined that there is a correspondence between image frames and audio data segments that contain the same timestamp marker. That is, for a certain video frame and a certain audio data segment having the same, the source video data which is not disassembled is played at the same time.
Step 204, determining a loading position in a desktop program object of the mobile terminal;
in the embodiment of the invention, before determining the target image stream data and the target audio stream data and planning to load the target image stream data and the target audio stream data into the desktop program object of the mobile phone, a specific loading position can be determined first.
In a particular implementation, where the target image stream data and the target audio stream data should be loaded may be determined based on the current desktop layout of the handset. Therefore, the layout information of each application program in the desktop program object of the mobile phone can be obtained first, and then the loading position can be determined according to the layout information of each application program.
For example, if icons of a plurality of applications are placed on the upper half of the desktop of the mobile phone, the lower half of the desktop may be used as a loading position for loading target image stream data and target audio stream data in order to avoid the influence on the normal use of the applications by the user after loading the target image stream data and the target audio stream data.
Alternatively, it is also possible to determine where the target image stream data and the target audio stream data should be loaded according to the user's selection.
In a specific implementation, a loading position selected by a user in a desktop program object of a mobile phone can be received, and the position selected by the user is used as a position for loading target image stream data and target audio stream data.
Of course, the above is only an example, and a person skilled in the art or a user may determine the specific loading position when loading the target image stream data and the target audio stream data according to actual needs, which is not limited in this embodiment.
Step 205, determining the playing time length of the target image stream;
in the embodiment of the present invention, the target image stream may refer to a piece of image data that can be subsequently loaded into a desktop object of a mobile phone.
In determining the target image stream, a play time of the target image stream may be first determined.
In a specific implementation, time stamp marks of a start image frame and an end image frame of a target image stream in source video data may be respectively determined, and then a play duration of the target image stream may be determined according to the time stamp marks.
Specifically, it is possible to determine which frame the start frame and the end frame of the target image stream data are, respectively, and then to set the difference between the time stamps of the start frame and the end frame as the play time length of the target image stream.
Step 206, according to the playing duration, sequentially extracting target image frames with corresponding durations from the multi-frame image frames and target audio data segments with corresponding relationships of the target image frames;
in the embodiment of the present invention, after the playing time length of the target image stream data is determined, a plurality of image frames with corresponding time lengths may be sequentially extracted from the start frame as the target image frame, and a plurality of audio data segments corresponding to the extracted image frames may be extracted as the target audio data segments.
In a specific implementation, the start frame and the end frame may be determined first, and then all the image frames located between the start frame and the end frame, and the plurality of audio data segments having corresponding relations with the all the image frames may be extracted.
Step 207, loading the target image frame and the target audio data segment at the loading position.
After the target image frame and the target audio data segment are extracted, the target image frame and the target audio data segment can be loaded at a predetermined loading position to show a corresponding video desktop.
In the embodiment of the present invention, when loading the target image frame and the target audio data segment, the region size of the loading position may be determined first, then the target image frame is scaled to match the region size, and then the scaled target image frame and the scaled target audio data segment are loaded at the loading position.
According to the embodiment of the invention, the source video data is disassembled into the image frames and the audio data segments, the target image frames and the target audio data segments are generated according to the corresponding relation between the image frames and the audio data segments and are loaded into the desktop program object of the mobile phone, so that the corresponding video desktop can be displayed, the display form of the desktop of the mobile phone is increased, a user can select different source video data according to own hobbies or requirements, the corresponding video desktop is customized, and the interestingness of the user when the user uses the mobile phone is increased.
Referring to fig. 3, a schematic flowchart illustrating steps of a method for loading a video desktop according to an embodiment of the present invention may specifically include the following steps:
step 301, acquiring source video data;
302, according to a time sequence, respectively disassembling the source video data into a plurality of frames of image frames and a plurality of audio data segments, where the plurality of frames of image frames and the plurality of audio data segments have corresponding timestamp marks respectively;
step 303, determining that the image frame and the audio data segment containing the same timestamp mark have a corresponding relation;
step 304, determining a loading position in a desktop program object of the mobile terminal;
step 305, determining the playing time length of the target image stream;
since steps 301 to 305 in this embodiment are similar to steps 201 to 205 in the above embodiment, reference may be made to each other, and details of this embodiment are not described again.
Step 306, sequentially extracting target image frames with corresponding duration from the multi-frame image frames according to the playing duration;
in the embodiment of the invention, after the playing time of the target image stream data is determined, a plurality of image frames with corresponding time duration can be sequentially extracted from the starting frame to be used as the target image frames.
In a specific implementation, the start frame and the end frame may be determined first, and then all image frames located between the start frame and the end frame may be extracted.
Step 307, acquiring specific audio with corresponding duration;
in the embodiment of the present invention, the specific audio may refer to any audio data other than the audio data in the source video data.
In a specific implementation, a specific piece of audio with the playing time length can be obtained according to the playing time length determined in step 305.
Step 308, loading the target image frame and specific audio at the loading position;
after the target image frame and the specific audio are obtained, the target image frame and the specific audio can be loaded at a predetermined loading position to reveal a corresponding video desktop.
In the embodiment of the present invention, when loading the target image frame and the specific audio, the region size of the loading position may be determined first, then the target image frame is scaled to match the region size, and then the scaled target image frame and the specific audio are loaded at the loading position.
And 309, when an operation instruction of the user at the loading position is received, playing the target image frame and the specific audio.
In the embodiment of the invention, after the video desktop is loaded and formed, the corresponding video effect can be displayed according to the operation instruction of the user.
For example, when an operation instruction such as clicking or touching of the user at the loading position is received, the target image frame and the specific audio may be played, so that the corresponding video effect is presented.
In the embodiment of the invention, after the source video data is disassembled to obtain the plurality of image frames, the target image frame can be generated based on the obtained plurality of image frames, then the target image frame is combined with the specific audio and loaded into the desktop program object of the mobile terminal, so that the corresponding video effect is shown, the interestingness of the user in using the mobile terminal is increased, and the showing form of the desktop of the mobile terminal is increased.
For simplicity of explanation, the method embodiments are described as a series of acts or combinations, but those skilled in the art will appreciate that the embodiments are not limited by the order of acts described, as some steps may occur in other orders or concurrently with other steps in accordance with the embodiments of the invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
Referring to fig. 4, a schematic structural block diagram of an apparatus for loading a video desktop according to an embodiment of the present invention is shown, which may specifically include the following modules:
an obtaining module 401, configured to obtain source video data;
an extracting module 402, configured to extract image stream data and audio stream data from the source video data;
a determining module 403, configured to determine a correspondence between the image stream data and the audio stream data;
a loading module 404, configured to load target image stream data and target audio stream data that meet a preset condition in a desktop object of the mobile terminal according to the correspondence;
and a showing module 405, configured to show a desktop matched with the target image stream data and the target audio stream data.
In an embodiment of the present invention, the image stream data may include a plurality of image frames, the audio stream data may include a plurality of audio data segments, and the extracting module 402 may specifically include the following sub-modules:
and the source video data disassembling submodule is used for respectively disassembling the source video data into a plurality of frames of image frames and a plurality of audio data segments according to a time sequence, and the plurality of frames of image frames and the plurality of audio data segments are respectively provided with corresponding timestamp marks.
In this embodiment of the present invention, the determining module 403 may specifically include the following sub-modules:
and the corresponding relation determining submodule is used for determining that the image frame and the audio data segment containing the same timestamp marker have corresponding relation.
In the embodiment of the present invention, the apparatus may further include the following modules:
and the loading position determining module is used for determining the loading position in the desktop program object of the mobile terminal.
In the embodiment of the present invention, the loading position determining module may specifically include the following sub-modules:
the layout information acquisition submodule is used for acquiring the layout information of each application program in a desktop program object of the mobile terminal;
and the loading position determining submodule is used for determining the loading position according to the layout information of each application program.
In this embodiment of the present invention, the loading position determining module may further include the following sub-modules:
and the loading position receiving submodule is used for receiving the loading position selected by the user in the desktop program object of the mobile terminal.
In this embodiment of the present invention, the loading module 404 may specifically include the following sub-modules:
the playing time length determining submodule is used for determining the playing time length of the target image stream;
the target image frame and target audio data segment extraction submodule is used for sequentially extracting target image frames with corresponding time lengths from the multi-frame image frames according to the playing time lengths and target audio data segments with corresponding relationships of the target image frames;
a target image frame and target audio data segment loading sub-module for loading the target image frame and target audio data segment at the loading location.
In this embodiment of the present invention, the target image frame and target audio data segment loading sub-module may specifically include the following units:
a first area size determination unit configured to determine an area size of the loading position;
a first target image frame scaling unit for scaling the target image frame to match the region size;
and the target image frame and target audio data segment loading unit is used for loading the zoomed target image frame and target audio data segment at the loading position.
In this embodiment of the present invention, the loading module 404 may further include the following sub-modules:
the playing time length determining submodule is used for determining the playing time length of the target image stream;
the target image frame extraction submodule is used for sequentially extracting target image frames with corresponding duration from the multi-frame image frames according to the playing duration;
the specific audio acquisition submodule is used for acquiring specific audio with corresponding duration;
a target image frame and specific audio loading sub-module for loading the target image frame and specific audio at the loading location.
In an embodiment of the present invention, the target image frame and the specific audio loading sub-module may specifically include the following units:
a second area size determination unit configured to determine an area size of the loading position;
a second target image frame scaling unit for scaling the target image frame to match the region size;
and the target image frame and specific audio loading unit is used for loading the zoomed target image frame and specific audio at the loading position.
In this embodiment of the present invention, the play duration determining submodule may specifically include the following units:
a timestamp marking determination unit for determining timestamp markings of a start image frame and an end image frame of a target image stream in the source video data, respectively;
and the playing time length determining unit is used for determining the playing time length of the target image stream according to the timestamp mark.
In this embodiment of the present invention, the source video data may include first data and second data, and the loading module 404 may further include the following sub-modules:
a first loading submodule for loading first target image stream data of first data and second target audio stream data of second data at the loading position; alternatively, the first and second electrodes may be,
a second loading submodule for loading second target image stream data of the first data and first target audio stream data of the second data at the loading position.
In this embodiment of the present invention, the presentation module 405 may specifically include the following sub-modules:
and the playing sub-module is used for playing the target image stream data and the target audio stream data, or playing the target image stream data and the target audio stream data when receiving an operation instruction of a user at the loading position.
In the embodiment of the present invention, the play sub-module may specifically include the following units:
a system setting information determination unit for determining system setting information in the mobile terminal;
and the mute playing unit is used for playing the target image stream data in a mute state if the system setting information is mute setting and/or vibration setting.
In this embodiment of the present invention, the obtaining module 401 may specifically include the following sub-modules:
the storage position determining submodule is used for determining the storage position of the source video data in the mobile terminal;
a source video data extraction sub-module to extract the source video data from the storage location.
In this embodiment of the present invention, the obtaining module 401 may further include the following sub-modules:
and the source video data downloading submodule is used for downloading the source video data from the server.
The embodiment of the present invention further provides an apparatus for loading a video desktop, which includes a processor, a memory, and a computer program stored in the memory and capable of running on the processor, where the computer program, when executed by the processor, implements the steps of the method for loading a video desktop as described above.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method for loading a video desktop as described above are implemented.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
The algorithms and displays presented herein are not inherently related to any particular computer, virtual machine, or other apparatus. Various general purpose systems may also be used with the teachings herein. The required structure for constructing such a system will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.
In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.
Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.
The various component embodiments of the invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It will be understood by those skilled in the art that a microprocessor or Digital Signal Processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components of the method and apparatus for loading a video desktop according to embodiments of the present invention. The present invention may also be embodied as apparatus or device programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing the present invention may be stored on computer-readable media or may be in the form of one or more signals. Such a signal may be downloaded from an internet website or provided on a carrier signal or in any other form.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.
The invention discloses A1 and a method for loading a video desktop, which comprises the following steps:
acquiring source video data;
extracting image stream data and audio stream data from the source video data;
determining a corresponding relation between the image stream data and the audio stream data;
loading target image stream data and target audio stream data which meet preset conditions in a desktop program object of the mobile terminal according to the corresponding relation;
and displaying the desktop matched with the target image stream data and the target audio stream data.
A2, the method of a1, the image stream data comprising a plurality of frames of image frames, the audio stream data comprising a plurality of audio data segments, the extracting image stream data and audio stream data from the source video data comprising:
according to the time sequence, the source video data is disassembled into a plurality of frames of image frames and a plurality of audio data segments, and the plurality of frames of image frames and the plurality of audio data segments are respectively provided with corresponding time stamp marks.
A3, the method of a2, the step of determining the correspondence between the image stream data and the audio stream data comprising:
it is determined that there is a correspondence between image frames and audio data segments that contain the same timestamp marker.
A4, the method according to A3, further comprising, before the step of loading the target image stream data and the target audio stream data satisfying the preset condition in the desktop object of the mobile terminal according to the correspondence relationship:
a loading location in a desktop object of the mobile terminal is determined.
A5, the method of A4, wherein the step of determining the loading position in the desktop object of the mobile terminal comprises:
acquiring layout information of each application program in a desktop program object of the mobile terminal;
and determining the loading position according to the layout information of each application program.
A6, the method of A4, wherein the step of determining the loading position in the desktop object of the mobile terminal comprises:
and receiving a loading position selected by a user in a desktop program object of the mobile terminal.
A7, the method according to a4, wherein the step of loading the target image stream data and the target audio stream data satisfying the preset conditions in the desktop object of the mobile terminal according to the correspondence comprises:
determining the playing time length of the target image stream;
according to the playing time length, sequentially extracting target image frames with corresponding time lengths from the multi-frame image frames and target audio data segments with corresponding relations of the target image frames;
loading the target image frame and target audio data segment at the loading location.
A8, the method of A7, the step of loading the target image frame and target audio data segment at the loading position comprising:
determining a region size of the loading location;
scaling the target image frame to match the region size;
and loading the zoomed target image frame and the target audio data segment at the loading position.
A9, the method according to a4, wherein the step of loading the target image stream data and the target audio stream data satisfying the preset conditions in the desktop object of the mobile terminal according to the correspondence comprises:
determining the playing time length of the target image stream;
according to the playing time length, sequentially extracting target image frames with corresponding time length from the multi-frame image frames;
acquiring specific audio with corresponding duration;
loading the target image frame and specific audio at the loading position.
A10, the method of A9, the step of loading the target image frame and specific audio at the loading position comprising:
determining a region size of the loading location;
scaling the target image frame to match the region size;
the scaled target image frame and the specific audio are loaded at the loading position.
A11, the method according to any one of a7-a10, wherein the step of determining the playing time length of the target image stream comprises:
respectively determining timestamp markers of a starting image frame and an ending image frame of a target image stream in the source video data;
and determining the playing time length of the target image stream according to the timestamp mark.
A12, the method according to a1, wherein the source video data includes first data and second data, and the step of loading target image stream data and target audio stream data satisfying preset conditions in a desktop object of the mobile terminal according to the correspondence includes:
loading first target image stream data of first data and second target audio stream data of second data at the loading position; alternatively, the first and second electrodes may be,
second target image stream data of the first data and first target audio stream data of the second data are loaded at the loading position.
A13, the method of A1, the step of rendering a desktop that matches the target image stream data and target audio stream data comprising:
and playing the target image stream data and the target audio stream data.
A14, the method of A4, the step of rendering a desktop that matches the target image stream data and target audio stream data comprising:
and when an operation instruction of a user at the loading position is received, playing the target image stream data and the target audio stream data.
A15, the method of a13 or a14, the step of playing the target image stream data and the target audio stream data comprising:
determining system setting information in the mobile terminal;
and if the system setting information is mute setting and/or vibration setting, playing the target image stream data in a mute state.
A16, the method of a15, the step of obtaining source video data comprising:
determining a storage position of source video data in the mobile terminal;
the source video data is extracted from the storage location.
A17, the method of a15, the step of obtaining source video data comprising:
source video data is downloaded from a server.
The invention also discloses B18, a device for loading the video desktop, which comprises:
the acquisition module is used for acquiring source video data;
the extraction module is used for extracting image stream data and audio stream data from the source video data;
the determining module is used for determining the corresponding relation between the image stream data and the audio stream data;
the loading module is used for loading target image stream data and target audio stream data which meet preset conditions in a desktop program object of the mobile terminal according to the corresponding relation;
and the display module is used for displaying the desktop matched with the target image stream data and the target audio stream data.
B19, the apparatus of B18, the image stream data comprising a plurality of frames of image frames, the audio stream data comprising a plurality of audio data segments, the extraction module comprising:
and the source video data disassembling submodule is used for respectively disassembling the source video data into a plurality of frames of image frames and a plurality of audio data segments according to a time sequence, and the plurality of frames of image frames and the plurality of audio data segments are respectively provided with corresponding timestamp marks.
B20, the apparatus of B19, the determining module comprising:
and the corresponding relation determining submodule is used for determining that the image frame and the audio data segment containing the same timestamp marker have corresponding relation.
B21, the apparatus of B20, further comprising:
and the loading position determining module is used for determining the loading position in the desktop program object of the mobile terminal.
B22, the apparatus of B21, the load position determining module comprising:
the layout information acquisition submodule is used for acquiring the layout information of each application program in a desktop program object of the mobile terminal;
and the loading position determining submodule is used for determining the loading position according to the layout information of each application program.
B23, the apparatus of B21, the load position determining module comprising:
and the loading position receiving submodule is used for receiving the loading position selected by the user in the desktop program object of the mobile terminal.
B24, the apparatus as in B21, the load module comprising:
the playing time length determining submodule is used for determining the playing time length of the target image stream;
the target image frame and target audio data segment extraction submodule is used for sequentially extracting target image frames with corresponding time lengths from the multi-frame image frames according to the playing time lengths and target audio data segments with corresponding relationships of the target image frames;
a target image frame and target audio data segment loading sub-module for loading the target image frame and target audio data segment at the loading location.
B25, the apparatus as described in B24, the target image frame and target audio data segment loading sub-module comprising:
a first area size determination unit configured to determine an area size of the loading position;
a first target image frame scaling unit for scaling the target image frame to match the region size;
and the target image frame and target audio data segment loading unit is used for loading the zoomed target image frame and target audio data segment at the loading position.
B26, the apparatus as in B21, the load module comprising:
the playing time length determining submodule is used for determining the playing time length of the target image stream;
the target image frame extraction submodule is used for sequentially extracting target image frames with corresponding duration from the multi-frame image frames according to the playing duration;
the specific audio acquisition submodule is used for acquiring specific audio with corresponding duration;
a target image frame and specific audio loading sub-module for loading the target image frame and specific audio at the loading location.
B27, the apparatus as in B26, the target image frame and specific audio loading sub-module comprising:
a second area size determination unit configured to determine an area size of the loading position;
a second target image frame scaling unit for scaling the target image frame to match the region size;
and the target image frame and specific audio loading unit is used for loading the zoomed target image frame and specific audio at the loading position.
B28, the device as defined in any one of B24-B27, wherein the play-time-length determination submodule includes:
a timestamp marking determination unit for determining timestamp markings of a start image frame and an end image frame of a target image stream in the source video data, respectively;
and the playing time length determining unit is used for determining the playing time length of the target image stream according to the timestamp mark.
B29, the apparatus of B18, the source video data comprising first data and second data, the load module comprising:
a first loading submodule for loading first target image stream data of first data and second target audio stream data of second data at the loading position; alternatively, the first and second electrodes may be,
a second loading submodule for loading second target image stream data of the first data and first target audio stream data of the second data at the loading position.
B30, the apparatus as described in B18, the presentation module comprising:
and the playing sub-module is used for playing the target image stream data and the target audio stream data, or playing the target image stream data and the target audio stream data when receiving an operation instruction of a user at the loading position.
B31, the apparatus as described in B30, the play sub-module comprising:
a system setting information determination unit for determining system setting information in the mobile terminal;
and the mute playing unit is used for playing the target image stream data in a mute state if the system setting information is mute setting and/or vibration setting.
B32, the apparatus as in B31, the obtaining module comprising:
the storage position determining submodule is used for determining the storage position of the source video data in the mobile terminal;
a source video data extraction sub-module to extract the source video data from the storage location.
B33, the apparatus as in B31, the obtaining module comprising:
and the source video data downloading submodule is used for downloading the source video data from the server.
The invention also discloses C34, and an apparatus for loading a video desktop, which comprises a processor, a memory, and a computer program stored in the memory and running on the processor, wherein the computer program, when executed by the processor, implements the steps of the method for loading a video desktop as described in any one of A1-A17.
The invention also discloses C35, a computer readable storage medium on which a computer program is stored which, when being executed by a processor, carries out the steps of the method of loading a video desktop as claimed in any one of a1 to a 17.

Claims (31)

1. A method of loading a video desktop, comprising:
acquiring source video data;
extracting image stream data and audio stream data from the source video data, wherein the image stream data refers to an image stream formed by a plurality of frames of image frames extracted from the source video data, and the audio stream data refers to an audio stream formed by a plurality of audio data segments extracted from the source video data;
determining a corresponding relation between the image stream data and the audio stream data;
loading target image stream data and target audio stream data meeting preset conditions in a desktop program object of the mobile terminal according to the corresponding relation, and placing each application program installed in the mobile terminal in the desktop program object so as to form a desktop of the mobile terminal;
displaying a desktop matched with the target image stream data and the target audio stream data;
before the step of loading the target image stream data and the target audio stream data which meet the preset conditions in the desktop program object of the mobile terminal according to the corresponding relation, the method further comprises the following steps:
determining a loading position in a desktop program object of the mobile terminal;
the step of determining the loading position in the desktop object of the mobile terminal comprises the following steps:
acquiring layout information of each application program in a desktop program object of the mobile terminal;
and determining the loading position according to the layout information of each application program.
2. The method of claim 1, wherein the image stream data comprises a plurality of frames of image frames, the audio stream data comprises a plurality of audio data segments, and the step of extracting the image stream data and the audio stream data from the source video data comprises:
according to the time sequence, the source video data is disassembled into a plurality of frames of image frames and a plurality of audio data segments, and the plurality of frames of image frames and the plurality of audio data segments are respectively provided with corresponding time stamp marks.
3. The method of claim 2, wherein the step of determining the correspondence between the image stream data and the audio stream data comprises:
it is determined that there is a correspondence between image frames and audio data segments that contain the same timestamp marker.
4. The method of claim 1, wherein the step of determining a loading location in a desktop object of the mobile terminal comprises:
and receiving a loading position selected by a user in a desktop program object of the mobile terminal.
5. The method according to claim 1, wherein the step of loading target image stream data and target audio stream data satisfying a preset condition in the desktop object of the mobile terminal according to the correspondence comprises:
determining the playing time length of the target image stream;
according to the playing time length, sequentially extracting target image frames with corresponding time lengths from the multi-frame image frames and target audio data segments with corresponding relations of the target image frames;
loading the target image frame and target audio data segment at the loading location.
6. The method of claim 5, wherein the step of loading the target image frame and target audio data segment at the loading location comprises:
determining a region size of the loading location;
scaling the target image frame to match the region size;
and loading the zoomed target image frame and the target audio data segment at the loading position.
7. The method according to claim 1, wherein the step of loading target image stream data and target audio stream data satisfying a preset condition in the desktop object of the mobile terminal according to the correspondence comprises:
determining the playing time length of the target image stream;
according to the playing time length, sequentially extracting target image frames with corresponding time length from the multi-frame image frames;
acquiring specific audio with corresponding duration;
loading the target image frame and specific audio at the loading position.
8. The method as recited in claim 7, wherein the step of loading the target image frame and specific audio at the loading location comprises:
determining a region size of the loading location;
scaling the target image frame to match the region size;
the scaled target image frame and the specific audio are loaded at the loading position.
9. The method of any of claims 5-8, wherein the step of determining a playback time duration for the target image stream comprises:
respectively determining timestamp markers of a starting image frame and an ending image frame of a target image stream in the source video data;
and determining the playing time length of the target image stream according to the timestamp mark.
10. The method according to claim 1, wherein the source video data includes first data and second data, and the step of loading target image stream data and target audio stream data satisfying a preset condition in the desktop object of the mobile terminal according to the correspondence includes:
loading first target image stream data of first data and second target audio stream data of second data at the loading position; alternatively, the first and second electrodes may be,
second target image stream data of the first data and first target audio stream data of the second data are loaded at the loading position.
11. The method of claim 1, wherein the step of rendering the desktop that matches the target image stream data and the target audio stream data comprises:
and playing the target image stream data and the target audio stream data.
12. The method of claim 1, wherein the step of rendering the desktop that matches the target image stream data and the target audio stream data comprises:
and when an operation instruction of a user at the loading position is received, playing the target image stream data and the target audio stream data.
13. The method of claim 11 or 12, wherein the step of playing the target image stream data and the target audio stream data comprises:
determining system setting information in the mobile terminal;
and if the system setting information is mute setting and/or vibration setting, playing the target image stream data in a mute state.
14. The method of claim 13, wherein the step of obtaining source video data comprises:
determining a storage position of source video data in the mobile terminal;
the source video data is extracted from the storage location.
15. The method of claim 13, wherein the step of obtaining source video data comprises:
source video data is downloaded from a server.
16. An apparatus for loading a video desktop, comprising:
the acquisition module is used for acquiring source video data;
the extraction module is used for extracting image stream data and audio stream data from the source video data, wherein the image stream data refers to an image stream formed by a plurality of frames of image frames extracted from the source video data, and the audio stream data refers to an audio stream formed by a plurality of audio data segments extracted from the source video data;
the determining module is used for determining the corresponding relation between the image stream data and the audio stream data;
the loading module is used for loading target image stream data and target audio stream data which meet preset conditions in a desktop program object of the mobile terminal according to the corresponding relation;
the display module is used for displaying a desktop matched with the target image stream data and the target audio stream data;
the device for loading the video desktop further comprises:
the loading position determining module is used for determining the loading position in the desktop program object of the mobile terminal;
the loading position determining module includes:
the layout information acquisition submodule is used for acquiring the layout information of each application program in a desktop program object of the mobile terminal;
and the loading position determining submodule is used for determining the loading position according to the layout information of each application program.
17. The apparatus of claim 16, wherein the image stream data comprises a plurality of frames of image frames, the audio stream data comprises a plurality of audio data segments, the extraction module comprises:
and the source video data disassembling submodule is used for respectively disassembling the source video data into a plurality of frames of image frames and a plurality of audio data segments according to a time sequence, and the plurality of frames of image frames and the plurality of audio data segments are respectively provided with corresponding timestamp marks.
18. The apparatus of claim 17, wherein the determining module comprises:
and the corresponding relation determining submodule is used for determining that the image frame and the audio data segment containing the same timestamp marker have corresponding relation.
19. The apparatus of claim 18, wherein the load position determination module comprises:
and the loading position receiving submodule is used for receiving the loading position selected by the user in the desktop program object of the mobile terminal.
20. The apparatus of claim 16, wherein the loading module comprises:
the playing time length determining submodule is used for determining the playing time length of the target image stream;
the target image frame and target audio data segment extraction submodule is used for sequentially extracting target image frames with corresponding time lengths from the multi-frame image frames according to the playing time lengths and target audio data segments with corresponding relationships of the target image frames;
a target image frame and target audio data segment loading sub-module for loading the target image frame and target audio data segment at the loading location.
21. The apparatus of claim 20, wherein the target image frame and target audio data segment loading sub-module comprises:
a first area size determination unit configured to determine an area size of the loading position;
a first target image frame scaling unit for scaling the target image frame to match the region size;
and the target image frame and target audio data segment loading unit is used for loading the zoomed target image frame and target audio data segment at the loading position.
22. The apparatus of claim 16, wherein the loading module comprises:
the playing time length determining submodule is used for determining the playing time length of the target image stream;
the target image frame extraction submodule is used for sequentially extracting target image frames with corresponding duration from the multi-frame image frames according to the playing duration;
the specific audio acquisition submodule is used for acquiring specific audio with corresponding duration;
a target image frame and specific audio loading sub-module for loading the target image frame and specific audio at the loading location.
23. The apparatus of claim 22, wherein the target image frame and specific audio loading sub-module comprises:
a second area size determination unit configured to determine an area size of the loading position;
a second target image frame scaling unit for scaling the target image frame to match the region size;
and the target image frame and specific audio loading unit is used for loading the zoomed target image frame and specific audio at the loading position.
24. The apparatus of any of claims 20-23, wherein the playout duration determination submodule comprises:
a timestamp marking determination unit for determining timestamp markings of a start image frame and an end image frame of a target image stream in the source video data, respectively;
and the playing time length determining unit is used for determining the playing time length of the target image stream according to the timestamp mark.
25. The apparatus of claim 16, wherein the source video data comprises first data and second data, the loading module comprising:
a first loading submodule for loading first target image stream data of first data and second target audio stream data of second data at the loading position; alternatively, the first and second electrodes may be,
a second loading submodule for loading second target image stream data of the first data and first target audio stream data of the second data at the loading position.
26. The apparatus of claim 16, wherein the presentation module comprises:
and the playing sub-module is used for playing the target image stream data and the target audio stream data, or playing the target image stream data and the target audio stream data when receiving an operation instruction of a user at the loading position.
27. The apparatus of claim 26, wherein the play sub-module comprises:
a system setting information determination unit for determining system setting information in the mobile terminal;
and the mute playing unit is used for playing the target image stream data in a mute state if the system setting information is mute setting and/or vibration setting.
28. The apparatus of claim 27, wherein the acquisition module comprises:
the storage position determining submodule is used for determining the storage position of the source video data in the mobile terminal;
a source video data extraction sub-module to extract the source video data from the storage location.
29. The apparatus of claim 27, wherein the acquisition module comprises:
and the source video data downloading submodule is used for downloading the source video data from the server.
30. An apparatus for loading a video desktop, comprising a processor, a memory and a computer program stored on the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the steps of the method for loading a video desktop as claimed in any one of claims 1 to 15.
31. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method of loading a video desktop according to any one of claims 1 to 15.
CN201711490018.4A 2017-12-29 2017-12-29 Method and device for loading video desktop Active CN108228278B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711490018.4A CN108228278B (en) 2017-12-29 2017-12-29 Method and device for loading video desktop

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711490018.4A CN108228278B (en) 2017-12-29 2017-12-29 Method and device for loading video desktop

Publications (2)

Publication Number Publication Date
CN108228278A CN108228278A (en) 2018-06-29
CN108228278B true CN108228278B (en) 2021-07-30

Family

ID=62647509

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711490018.4A Active CN108228278B (en) 2017-12-29 2017-12-29 Method and device for loading video desktop

Country Status (1)

Country Link
CN (1) CN108228278B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108881766B (en) * 2018-07-12 2020-04-28 北京微播视界科技有限公司 Video processing method, device, terminal and storage medium
CN110968280B (en) * 2018-09-30 2023-07-18 中兴通讯股份有限公司 Application layout reduction method, device, equipment and storage medium
CN109597668A (en) * 2018-10-26 2019-04-09 北京奇安信科技有限公司 A kind of wallpaper replacement processing method and processing device
CN110248237B (en) * 2019-07-04 2021-09-28 广州华多网络科技有限公司 Video playing method, device, equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101656099A (en) * 2008-08-18 2010-02-24 安凯(广州)软件技术有限公司 Audio and video production and play method used for MP3 player
CN104216760A (en) * 2013-05-29 2014-12-17 腾讯科技(深圳)有限公司 Method and device for interaction of dynamic wallpaper and system desktop
CN106468996A (en) * 2016-09-07 2017-03-01 北京众纳鑫海网络技术有限公司 The background video control method of computer video desktop and device
CN106658070A (en) * 2017-01-19 2017-05-10 深圳市云点科技有限公司 Video redirecting method and device
CN107038033A (en) * 2017-04-14 2017-08-11 成都奇鲁科技有限公司 Desktop background display methods and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101656099A (en) * 2008-08-18 2010-02-24 安凯(广州)软件技术有限公司 Audio and video production and play method used for MP3 player
CN104216760A (en) * 2013-05-29 2014-12-17 腾讯科技(深圳)有限公司 Method and device for interaction of dynamic wallpaper and system desktop
CN106468996A (en) * 2016-09-07 2017-03-01 北京众纳鑫海网络技术有限公司 The background video control method of computer video desktop and device
CN106658070A (en) * 2017-01-19 2017-05-10 深圳市云点科技有限公司 Video redirecting method and device
CN107038033A (en) * 2017-04-14 2017-08-11 成都奇鲁科技有限公司 Desktop background display methods and device

Also Published As

Publication number Publication date
CN108228278A (en) 2018-06-29

Similar Documents

Publication Publication Date Title
US11527027B2 (en) Photo and video collaboration platform
CN108228278B (en) Method and device for loading video desktop
US9330098B2 (en) User interface operating method and electronic device with the user interface and program product storing program for operating the user interface
RU2639651C2 (en) Image identification and organization according to model without user intervention
CN105808044A (en) Information push method and device
US20110066492A1 (en) Information processing system, information processing method, and computer program
TW201426608A (en) Portable electronic device, content recommendation method and computer-readable medium
CN109492607B (en) Information pushing method, information pushing device and terminal equipment
CN105512187B (en) Information display method and information display device based on display picture
US20160323631A1 (en) Method for presenting digital media content and apparatus
JP2018506082A (en) Font addition method, apparatus, program, and recording medium
CN104536990A (en) Picture display method and terminal
CN106407310B (en) Video file processing method and video file processing device
EP3058469A2 (en) Method and apparatus for identifying media files based upon contextual relationships
WO2018163032A1 (en) System and method for navigating in a digital environment
JP2018508061A (en) Adaptive electronic documents
WO2015193748A1 (en) Information acquiring apparatus and method, and electronic device
CN111913635B (en) Three-dimensional panoramic picture display method and device, mobile terminal and storage medium
US8902252B2 (en) Digital image selection in a surface computing device
CN109617987B (en) Application program picture publishing method, client and electronic equipment
JP6829391B2 (en) Information processing equipment, information distribution method, and information distribution program
CN112464691A (en) Image processing method and device
CN112837107A (en) Cross-platform commodity recommendation method and device and computer equipment
CN111222065A (en) Information display method and device, electronic equipment and medium
CN110188078A (en) A kind of information prompting method, device, equipment and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant