CN109862193B - Incoming call video control method and device in terminal - Google Patents
Incoming call video control method and device in terminal Download PDFInfo
- Publication number
- CN109862193B CN109862193B CN201910293586.8A CN201910293586A CN109862193B CN 109862193 B CN109862193 B CN 109862193B CN 201910293586 A CN201910293586 A CN 201910293586A CN 109862193 B CN109862193 B CN 109862193B
- Authority
- CN
- China
- Prior art keywords
- target
- video
- target video
- audio
- playing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The embodiment of the application provides a method and a device for controlling incoming call videos in a terminal, and belongs to the field of mobile control. The method comprises the following steps: separating the set video to be processed to obtain corresponding target audio and target video; replacing the set incoming call ring tone in the terminal with the target audio, and simultaneously monitoring the incoming call event in the terminal in real time; calling the target video to play after an incoming call event is monitored; and extracting a target progress corresponding to the target audio when the target video starts to play, and performing fast-forward playing on the target video according to the target progress so as to keep the target video and the target audio synchronous. According to the scheme, the time delay between the audio and the video is extracted, and the video part is fast forwarded according to the time delay, so that the corresponding video part and the corresponding audio part are synchronously loaded on a screen when a call comes, and the delay phenomenon caused by low video loading speed is avoided.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a method and an apparatus for controlling incoming videos.
Background
With the rapid development of network technology, mobile terminals have begun to change from simply providing telephony devices to a platform for running general-purpose software. The platform no longer aims at providing call management, but provides an operating environment including various application software such as call management, game and entertainment, office events, mobile payment and the like, and with a great deal of popularization, the platform has been deeply developed to the aspects of life and work of people.
The mobile terminal generally uses music ring as incoming call prompt, and few incoming call prompt methods are performed through videos. At present, some operators set some videos at a server end of an operated telecommunication network, and send the videos through the telecommunication network when equipment calls, but the bandwidth of the telecommunication network is limited, and when the videos serving as incoming calls are loaded on mobile equipment, the situations of blocking, delaying and the like are more, so that the playing effect is poor.
Disclosure of Invention
The embodiment of the application aims to provide a method and a device for controlling incoming call videos in a terminal so as to meet the requirement of synchronously playing the incoming call videos in the terminal.
In order to solve the above technical problem, the embodiment of the present application is implemented as follows:
according to a first aspect of an embodiment of the present application, a method for controlling incoming videos in a terminal is provided, which is applied to a terminal device, and the method includes:
separating the set video to be processed to obtain corresponding target audio and target video;
replacing the set incoming call ring tone in the terminal with the target audio, and simultaneously monitoring the incoming call event in the terminal in real time;
calling the target video to play after an incoming call event is monitored;
and extracting a target progress corresponding to the target audio when the target video starts to play, and performing fast-forward playing on the target video according to the target progress so as to keep the playing progress of the target video and the target audio synchronous.
In an embodiment of the present application, the method further includes:
when the video to be processed is separated, the video to be processed is unpacked to obtain a target audio and a target video, and a synchronous clock between the target audio and the target video is obtained;
the synchronous clock records relative time sequence playing information between the target audio and the target video, and is used for enabling the target audio and the target video to be played synchronously.
In an embodiment of the present application, the method further includes:
and after the incoming call event is monitored, calling a video playing plug-in to play the target video, and meanwhile, setting an answering interface corresponding to the incoming call event on a playing interface corresponding to the target video.
In an embodiment of the present application, the method further includes:
when the target progress corresponding to the target audio is extracted when the target video starts to play,
and calling the synchronous clock according to the target progress to carry out real-time synchronization to obtain the synchronous progress corresponding to the target video, and fast forwarding in the video playing plug-in unit according to the synchronous progress to render the target video.
In an embodiment of the present application, when the target video starts to play,
extracting the called loading time of the video playing plug-in;
predicting the buffer time of the target video decoded by the video playing plug-in according to the size and the format of the target video;
and adding the loading time and the buffering time, and analyzing and correcting by synthesizing the target progress corresponding to the target audio to obtain the synchronous progress corresponding to the target video.
In an embodiment of the present application, when the target video starts to play,
monitoring the current playing progress corresponding to the target audio in real time;
and searching in the synchronous clock according to the current playing progress corresponding to the target audio, and acquiring the synchronous progress corresponding to the target video according to a timestamp in the synchronous clock.
In an embodiment of the present application, the method further includes: and respectively monitoring the playing progress corresponding to the target video and the target audio in real time according to the synchronous clock, and if the difference value corresponding to the target video and the target audio is greater than a set threshold value, fast forwarding the target video in the video player again according to the difference value, and rendering the target video again.
According to a second aspect of embodiments of the present application, there is provided an apparatus for controlling incoming videos in a terminal, the apparatus including:
the separation module is used for separating the set video to be processed to obtain corresponding target audio and target video;
the monitoring module is used for replacing the set incoming call ringtone in the terminal with the target audio and simultaneously monitoring the incoming call event in the terminal in real time;
the calling module is used for calling the target video to play after monitoring an incoming call event;
and the synchronization module is used for extracting a target progress corresponding to the target audio when the target video starts to play, and fast-forwarding the target video according to the target progress so as to keep the playing progress of the target video and the target audio synchronous.
In an embodiment of the present application, in the separation module, when the video to be processed is separated,
decapsulating the video to be processed to obtain a target audio and a target video, and obtaining a synchronous clock between the target audio and the target video;
the synchronous clock records relative time sequence playing information between the target audio and the target video, and is used for enabling the target audio and the target video to be played synchronously.
In an embodiment of the present application, the apparatus further includes:
in the adjusting module, after an incoming call event is monitored, a video playing plug-in is called to play the target video, and meanwhile, an answering interface corresponding to the incoming call event is arranged on a playing interface corresponding to the target video
In an embodiment of the present application, the synchronization module specifically includes:
and the real-time synchronization unit is used for calling the synchronous clock according to the target progress to carry out real-time synchronization so as to obtain the synchronous progress corresponding to the target video, and fast-forwarding in the video playing plug-in unit according to the synchronous progress so as to render the target video.
In an embodiment of the present application, the real-time synchronization unit specifically includes,
the time extraction subunit is used for extracting the called loading time of the video playing plug-in;
the prediction subunit is used for predicting the buffering time of the target video decoded by the video playing plug-in according to the size and the format of the target video;
and the correcting subunit is used for summing the loading time and the buffering time, and analyzing and correcting the target progress corresponding to the target audio in a comprehensive manner to obtain the synchronous progress corresponding to the target video.
In an embodiment of the present application, the real-time synchronization unit specifically includes,
the monitoring subunit is used for monitoring the current playing progress corresponding to the target audio in real time;
and the matching subunit is used for searching in the synchronous clock according to the current playing progress corresponding to the target audio, and acquiring the synchronous progress corresponding to the target video according to a timestamp in the synchronous clock.
In an embodiment of the present application, the apparatus further includes: and the monitoring module is used for respectively monitoring the playing progress corresponding to the target video and the target audio in real time according to the synchronous clock, and fast forwarding the target video in the video player again according to the difference value and rendering the target video again if the difference value corresponding to the target video and the target audio is greater than a set threshold value.
According to the technical scheme provided by the embodiment of the application, when the incoming call video stored in the terminal is played, the established video to be processed is separated to obtain the corresponding target audio and the target video; replacing the set incoming call ring tone in the terminal with the target audio, and simultaneously monitoring the incoming call event in the terminal in real time; calling the target video to play after an incoming call event is monitored; and extracting a target progress corresponding to the target audio when the target video starts to play, and performing fast-forward playing on the target video according to the target progress so as to keep the playing progress of the target video and the target audio synchronous. When a certain video file is required to be displayed in an incoming call interface as incoming call video, because the terminal sets the original incoming call ring tone, the audio part of the video file is required to be separated, the separated audio part is used for replacing the original incoming call ring tone, and when the video part of the video file is played as the incoming call video, the audio part is separated, so that delay is generated when the audio part and the video part are played simultaneously; according to the scheme, the time delay between the audio and the video is extracted, and the video part is fast forwarded according to the time delay, so that the corresponding video part and the corresponding audio part are synchronously loaded on a screen when a call comes, and the delay phenomenon caused by low video loading speed is avoided.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the present specification, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart of a control method of incoming video in a terminal according to an embodiment of the present application;
fig. 2 is a schematic diagram of a case where a target audio of a control method of incoming videos in a terminal according to an embodiment of the present application is loaded;
fig. 3 is a schematic diagram illustrating that a target video corresponding to a called target audio is called after the target audio of a method for controlling an incoming call video in a terminal according to an embodiment of the present application is called;
fig. 4 is a schematic diagram of a target audio and a target video to be synchronized in a control method of an incoming call video in a terminal according to an embodiment of the present application;
fig. 5 is a schematic diagram of a synchronized target audio and target video of a control method of an incoming call video in a terminal according to an embodiment of the present application;
fig. 6 is a schematic diagram of a target audio and a target video being played again in the control method of an incoming call video in the terminal according to the embodiment of the present application;
fig. 7 is a schematic structural diagram of an electronic device corresponding to incoming videos in a terminal according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of a control device for incoming call video in a terminal according to an embodiment of the present application.
Detailed Description
In order to make those skilled in the art better understand the technical solutions in the present specification, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present specification, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present specification without any creative effort shall fall within the protection scope of the present specification.
The embodiment of the application provides a method and a device for editing characters in a picture.
First, a method for controlling incoming videos in a terminal according to an embodiment of the present application is described below.
It should be noted that the method provided in the embodiment of the present application is applicable to a terminal device, and in practical application, the terminal device may include: smart phones, tablet computers, smart watches, notebook/desktop computers, and the like, which are not limited in this application.
When a certain video file is used as an incoming call video to be displayed in an incoming call interface, the inherent incoming call ring tone is originally set in the terminal, so that the audio part of the video file needs to be separated in order to avoid the terminal from playing two ring tones simultaneously, the separated audio part is used for replacing the original incoming call ring tone, and the audio part is directly called as the ring tone to be played after an incoming call event is triggered. On the other hand, when the video part of the video file is played as the incoming video, since the audio part is separated and the video file is large, the time for calling the video playing plug-in to play is long, delay is generated when the audio part and the video part are played simultaneously, and the corresponding video part and the audio part are played asynchronously when the same video file is played.
According to the scheme, the time delay between the audio and the video is extracted, and the video part is fast forwarded according to the time delay, so that the corresponding video part and the corresponding audio part are synchronously loaded on a screen when a call comes, and the delay phenomenon caused by low video loading speed is avoided.
Fig. 1 is a flowchart of a method for controlling incoming videos in a terminal according to an embodiment of the present application, and as shown in fig. 1, the method may include the following steps:
in step 101, a predetermined video to be processed is separated to obtain a corresponding target audio and a corresponding target video.
When the terminal receives an incoming call event, the antenna module in the terminal notifies the bottom layer of the operating system, and the operating system controls each application to start working, wherein one of the applications is to notify the system that the ring tone should be played. In this embodiment, a designated video is selected from the local short video and the UGC video downloaded from the server segment as a video to be processed, when a call needs to be answered, the video playing plug-in is called to play the video, and then a playing interface of the video to be processed is presented on a screen of the mobile phone.
The video to be processed is unpacked, the video to be processed is equivalent to a corresponding container of the target audio and the target video, the target audio and a synchronous clock between the target audio and the target audio are generated after the video to be processed is decompressed.
The audio to be processed corresponds to a plurality of packaged formats, such as MP4, MKV, RMVB, TS, FLV, AVI, etc., and it is used to put the compressed and encoded video data and audio data together according to a certain format. For example, after the video to be processed in FLV format is subjected to decapsulation operation, the h.264 encoded video stream and the AAC encoded audio stream, as well as the synchronous clocks of the two streams, are output.
The synchronous clock records relative time sequence playing information between the target audio and the target video, and synchronously records each video frame and each audio frame which are played through a timestamp.
And when the target video and the target audio are played subsequently, the target audio and the target video are decoded respectively to become uncompressed audio and video original data for playing by a video module and an audio module in the terminal. The compression coding standards for audio include AAC, MP3, AC-3, etc., and the compression coding standards for video include H.264, MPEG2, VC-1, etc. By decoding, the compression-encoded video data is output as uncompressed color data, such as YUV420P, RGB, and the like; the compressed and coded audio data is output as uncompressed audio sample data, such as PCM data, and the decoded video and audio data are played through a video module and an audio module in the terminal respectively, so that the target audio and the target video are played.
Step 102: replacing the set incoming call ring tone in the terminal with the target audio, and simultaneously monitoring the incoming call event in the terminal in real time;
when a certain video file is used as an incoming call video to be displayed in an incoming call interface, the terminal is originally provided with an inherent incoming call ring tone, so that the two ring tones are not played simultaneously, the original incoming call ring tone needs to be replaced by a separated target audio frequency, an incoming call event is triggered, the audio frequency part is directly called to be played as the ring tone, and the target audio frequency is directly used as the ring tone to be played after the incoming call event is monitored subsequently.
Step 103: calling the target video to play after an incoming call event is monitored;
in the embodiment, the incoming call event in the terminal is monitored in real time, once the incoming call event is monitored, the ringtone playing event and the video playing event are triggered, and the target video is played by taking the target audio as the ringtone and calling the video playing plug-in to play the target video. Because the requirement of the incoming call event is responded, the answering interface associated with the incoming call event is arranged on the video playing interface, so that the user can answer in the answering interface.
Step 104: and extracting a target progress corresponding to the target audio when the target video starts to play, and performing fast-forward playing on the target video according to the target progress so as to keep the playing progress of the target video and the target audio synchronous.
Calling the synchronous clock according to the target progress to perform real-time synchronization, which specifically comprises the following steps: after the target video is monitored to start playing, extracting the target progress corresponding to the played part of the target audio at the moment, searching in real time in a synchronous clock according to the target progress, searching the synchronous progress which the corresponding target video should reach at the moment, calling a corresponding interface of a video playing plug-in according to the synchronous progress to control, fast-forwarding and playing the target video, rendering the target video according to the corresponding progress after fast-forwarding, and enabling the target video to be played synchronously with the target audio.
In other embodiments, the target progress that the target audio has been played is inevitably inaccurate simply according to the target progress that the target audio has been played, and at this time, the target progress that the target audio has been played is adjusted according to the time consumed by both the video playing plugin and the video decoding, specifically:
A. extracting the called loading time of the video playing plug-in;
and timing the calling time corresponding to the video playing plug-in according to the API in the terminal, and extracting the calling time of the video playing plug-in.
B. Predicting the buffer time of the target video decoded by the video playing plug-in according to the size and the format of the target video;
because the decoding process corresponding to the target video needs to be finished by consuming time, the corresponding buffering time is related to the processing capacity of the video module of the mobile phone and the size of the target video, and the decoding time corresponding to different formats of videos is different. Grouping according to the size of the target video and the dominant frequency of the video module, if the group is within 5M, the group is within 5-10M, the group is within 500MHz, and the group is within 1GHz, counting the corresponding buffer time respectively, uploading the counted buffer time to a server for storage analysis, and taking the buffer time corresponding to the dominant frequency of the video module and the same video size as the buffer time of the target video decoded by the video playing plugin when the target video is opened.
C. And adding the loading time and the buffering time, and analyzing and correcting by synthesizing the target progress corresponding to the target audio to obtain the synchronous progress corresponding to the target video.
And after the loading time and the buffering time are added, averaging the time with the corresponding time of the played target audio, so as to analyze and correct the target progress corresponding to the target audio, and taking the averaged time as the synchronous progress corresponding to the target video, thereby more accurately estimating the delay time of the target video.
And calling a set interface of the video player in real time according to the target progress to carry out fast forward on the target video, so that the playing progress of the target video is synchronous with the target audio, and the video file is normally played.
When the incoming call video stored in the terminal is played, the established video to be processed is separated to obtain the corresponding target audio and the target video; replacing the set incoming call ring tone in the terminal with the target audio, and simultaneously monitoring the incoming call event in the terminal in real time; calling the target video to play after an incoming call event is monitored; and extracting a target progress corresponding to the target audio when the target video starts to play, and performing fast-forward playing on the target video according to the target progress so as to keep the target video and the target audio synchronous. According to the scheme, the time delay between the audio and the video is extracted, and the video part is fast forwarded according to the time delay, so that the corresponding video part and the corresponding audio part are synchronously loaded on a screen when a call comes, and the delay phenomenon caused by low video loading speed is avoided.
In another alternative embodiment, the control of incoming call video in the terminal is performed
Step 201: separating the set video to be processed to obtain corresponding target audio and target video;
in this embodiment, the terminal receives the setting of the user, and takes a 15s to-be-processed video as an incoming call video corresponding to the terminal. And the terminal downloads the corresponding video to be processed in the flv format selected by the user from the server to the terminal, and decapsulates the video to be processed. And extracting corresponding target audio in the aac format, target video coded by H.264 and a corresponding synchronous clock, and downloading the target audio and the target video to a cache directory of the terminal.
Step 202: replacing the set incoming call ring tone in the terminal with the target audio, and simultaneously monitoring the incoming call event in the terminal in real time;
in this embodiment, a setting menu in the terminal is traversed, and a setting option of the ring tone is replaced with a target audio. Meanwhile, a monitoring process is set, and incoming events in the terminal are monitored in real time.
Step 203: calling the target video to play after an incoming call event is monitored;
as shown in fig. 2, after the incoming call event is monitored, the target audio is played as an incoming call ring tone, and meanwhile, the video player plug-in is called to load the target video in the video player plug-in, so that the target video is displayed in the incoming call interface.
Meanwhile, in order to ensure the normal display of the answering interface corresponding to the incoming call event, namely the answering key, the refusing key, the incoming call number and the like are normally displayed in the incoming call interface, the video playing plug-in playing the target video is placed below the answering interface for display.
After the target video is called to be played, the target video can be rendered on the incoming call interface, namely, the user can see the selected video to be processed.
Step 204: and extracting a target progress corresponding to the target audio when the target video starts to play, and performing fast-forward playing on the target video according to the target progress so as to keep the target video and the target audio synchronous.
In this embodiment, the current playing progress corresponding to the target audio is monitored in real time through an audio playing interface corresponding to a terminal system; as shown in fig. 3 and 4, after the target audio is played from the beginning as the incoming ringtone, the video player plug-in is called, and the target video stored in the cache directory is loaded in the video player plug-in, which takes 500 ms. As shown in fig. 4, in the process of playing the video to be processed, if no processing is performed at this time, the target video will start to be played from the time 0, and the target audio as the ring tone is already played for 500ms, which may cause a delay situation caused by audio-video mismatch.
And in an audio playing interface corresponding to the terminal system, searching in the synchronous clock according to the current playing progress corresponding to the target audio, namely 500ms, and acquiring the synchronous progress corresponding to the target video according to a timestamp in the synchronous clock.
In this embodiment, as shown in fig. 5, the synchronous clock is called according to the target progress to perform real-time synchronization, so as to obtain a synchronous progress corresponding to the target video, and fast-forward in the video playing plugin according to the synchronous progress, that is, after the target video is loaded, the target video starts to be played at a fast-forward time of 500ms, and the target video is rendered according to a video playing interface corresponding to a terminal system, so that the target video and a target audio serving as a ring tone are played synchronously.
Due to the fact that instruction transmission and event triggering in the terminal comprise fast forward operation of the target video and monitoring of the current playing progress corresponding to the target audio consume a certain time, a certain error exists in obtaining the target progress corresponding to the target video. In other embodiments, the terminals adopting the display modules with different main frequencies are classified according to high, middle and low gears, and the buffering time of the target videos with various formats at the high, middle and low gears respectively is extracted from other terminals of the whole network in a big data mode, so that the buffering time of the target videos with each format corresponding to each gear terminal is estimated, and the buffering time of the target videos decoded by the video playing plugin is obtained. And after the video playing plug-in is called, adding the called loading time and the called buffering time by using the video playing plug-in, thereby predicting the delay time corresponding to the target video and the target audio serving as the incoming call ringtone in a statistical analysis mode. And correcting the target progress corresponding to the target video according to the delay time, in the embodiment, averaging the target progress and the target progress, and performing fast-forward playing on the target video according to the average value as the target progress, so that the fast-forward progress corresponding to the target video is more accurate, the video part and the audio part corresponding to the video to be processed are synchronously loaded, and the delay phenomenon caused by the slow video loading speed is avoided.
As shown in fig. 6, if the incoming call interface does not receive the triggering operation of the user for a long time, the target video and the target audio corresponding to the video to be processed will be played circularly after the playing is finished, in the case of a longer time of the loop play, the two inevitably cause a certain delay, and in other embodiments, every predetermined time interval, respectively monitoring the playing progress corresponding to the target video and the target audio according to the synchronous clock, if the difference value corresponding to the two is larger than the set threshold value, fast-forwarding the target video in the video player again according to the difference value, and the target video is rendered again, the target audio and the target video are continuously corrected synchronously, therefore, when the incoming call ringtone in the terminal continuously rings, the target video and the target audio corresponding to the video to be processed are always in a synchronous playing state.
When the incoming call video stored in the terminal is played, the established video to be processed is separated to obtain the corresponding target audio and the target video; replacing the set incoming call ring tone in the terminal with the target audio, and simultaneously monitoring the incoming call event in the terminal in real time; calling the target video to play after an incoming call event is monitored; and extracting a target progress corresponding to the target audio when the target video starts to play, and performing fast-forward playing on the target video according to the target progress so as to keep the target video and the target audio synchronous. According to the scheme, the time delay between the audio and the video is extracted, and the video part is fast forwarded according to the time delay, so that the corresponding video part and the corresponding audio part are synchronously loaded on a screen when a call comes, and the delay phenomenon caused by low video loading speed is avoided.
Fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application. Referring to fig. 7, at a hardware level, the electronic device includes a processor, and optionally further includes an internal bus, a network interface, and a memory. The Memory may include a Memory, such as a Random-Access Memory (RAM), and may further include a non-volatile Memory, such as at least 1 disk Memory. Of course, the electronic device may also include hardware required for other services.
The processor, the network interface, and the memory may be connected to each other via an internal bus, which may be an ISA (Industry Standard Architecture) bus, a PCI (peripheral component Interconnect) bus, an EISA (Extended Industry Standard Architecture) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one double-headed arrow is shown in FIG. 7, but this does not indicate only one bus or one type of bus.
And the memory is used for storing programs. In particular, the program may include program code comprising computer operating instructions. The memory may include both memory and non-volatile storage and provides instructions and data to the processor.
The processor reads the corresponding computer program from the nonvolatile memory into the memory and then runs the computer program to form the device of the expression embedding input method candidate item on the logic level. The processor is used for executing the program stored in the memory and is specifically used for executing the following operations:
separating the set video to be processed to obtain corresponding target audio and target video;
replacing the set incoming call ring tone in the terminal with the target audio, and simultaneously monitoring the incoming call event in the terminal in real time;
calling the target video to play after an incoming call event is monitored;
and extracting a target progress corresponding to the target audio when the target video starts to play, and performing fast-forward playing on the target video according to the target progress so as to keep the target video and the target audio synchronous.
The method for controlling incoming videos in a terminal in a picture according to the embodiment shown in fig. 7 of the present application can be applied to a processor, or implemented by the processor. The processor may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware in a processor or instructions in the form of software. The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components. The various methods, steps, and logic blocks disclosed in the embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in a memory, and a processor reads information in the memory and completes the steps of the method in combination with hardware of the processor.
The electronic device may further execute the method shown in fig. 1, and implement the function of the apparatus for editing text in a picture in the embodiment shown in fig. 1, which is not described herein again in this embodiment of the present application.
Of course, besides the software implementation, the electronic device in this specification does not exclude other implementations, such as logic devices or a combination of software and hardware, and the like, that is, the execution subject of the following processing flow is not limited to each logic unit, and may also be hardware or logic devices.
Embodiments of the present application also propose a computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a portable electronic device comprising a plurality of application programs, enable the portable electronic device to perform the method of the embodiment shown in fig. 1, and in particular to perform the following method:
separating the set video to be processed to obtain corresponding target audio and target video;
replacing the set incoming call ring tone in the terminal with the target audio, and simultaneously monitoring the incoming call event in the terminal in real time;
calling the target video to play after an incoming call event is monitored;
and extracting a target progress corresponding to the target audio when the target video starts to play, and performing fast-forward playing on the target video according to the target progress so as to keep the playing progress of the target video and the target audio synchronous.
Fig. 8 is a schematic structural diagram of a control device for incoming call video in a terminal according to an embodiment of the present application. Referring to fig. 8, in a software implementation, an apparatus 800 for editing text in a picture may include: a separation module 801, a monitoring module 802, a calling module 803, and a rendering module 804, wherein,
a separation module 801, configured to separate a predetermined video to be processed to obtain a corresponding target audio and a corresponding target video;
a monitoring module 802, configured to replace a set ring tone in the terminal with the target audio, and monitor an incoming call event in the terminal in real time;
a calling module 803, configured to call the target video to play after an incoming call event is monitored;
a synchronization module 804, configured to extract a target progress corresponding to the target audio when the target video starts to be played, and fast forward play the target video according to the target progress, so that the target video and the target audio are kept synchronized in playing progress.
In the separation module 801, when the video to be processed is separated,
decapsulating the video to be processed to obtain a target audio and a target video, and obtaining a synchronous clock between the target audio and the target video;
the synchronous clock records relative time sequence playing information between the target audio and the target video, and is used for enabling the target audio and the target video to be played synchronously.
The device further comprises: in the adjusting module 703, after an incoming call event is monitored, a video playing plug-in is called to play the target video, and meanwhile, an answering interface corresponding to the incoming call event is set on a playing interface corresponding to the target video.
The synchronization module 704 specifically includes:
and the real-time synchronization unit is used for calling the synchronous clock according to the target progress to carry out real-time synchronization so as to obtain the synchronous progress corresponding to the target video, and fast-forwarding in the video playing plug-in unit according to the synchronous progress so as to render the target video.
The real-time synchronization unit specifically comprises a real-time synchronization unit,
the time extraction subunit is used for extracting the called loading time of the video playing plug-in;
the prediction subunit is used for predicting the buffering time of the target video decoded by the video playing plug-in according to the size and the format of the target video;
and the correcting subunit is used for summing the loading time and the buffering time, and analyzing and correcting the target progress corresponding to the target audio in a comprehensive manner to obtain the synchronous progress corresponding to the target video.
The real-time synchronization unit specifically comprises a real-time synchronization unit,
the monitoring subunit is used for monitoring the current playing progress corresponding to the target audio in real time;
and the matching subunit is used for searching in the synchronous clock according to the current playing progress corresponding to the target audio, and acquiring the synchronous progress corresponding to the target video according to a timestamp in the synchronous clock.
The device further comprises: and the monitoring module is used for respectively monitoring the playing progress corresponding to the target video and the target audio in real time according to the synchronous clock, and fast forwarding the target video in the video player again according to the difference value and rendering the target video again if the difference value corresponding to the target video and the target audio is greater than a set threshold value.
In short, the above description is only a preferred embodiment of the present disclosure, and is not intended to limit the scope of the present disclosure. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present specification shall be included in the protection scope of the present specification.
The systems, devices, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions. One typical implementation device is a computer. In particular, the computer may be, for example, a personal computer, a laptop computer, a cellular telephone, a camera phone, a smartphone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
Claims (14)
1. A method for controlling incoming call video in a terminal is characterized by comprising the following steps:
separating the set video to be processed to obtain corresponding target audio and target video;
replacing the set incoming call ring tone in the terminal with the target audio, and simultaneously monitoring the incoming call event in the terminal in real time;
after an incoming call event is monitored, the target video is called to play while the target audio is used as a ring tone to play;
and extracting a target progress corresponding to the target audio when the target video starts to play, and performing fast-forward play on the target video according to the target progress and the delay time of the target video to keep the target video and the target audio playing progress synchronous, wherein the delay time of the target video is determined by the called loading time of a playing plug-in based on the target video and the decoding cache time of the target video by the video playing plug-in.
2. The method of claim 1, comprising: when the video to be processed is separated,
decapsulating the video to be processed to obtain a target audio and a target video, and obtaining a synchronous clock between the target audio and the target video;
the synchronous clock records relative time sequence playing information between the target audio and the target video, and is used for enabling the target audio and the target video to be played synchronously.
3. The method of claim 1, further comprising: and after the incoming call event is monitored, calling a video playing plug-in to play the target video, and meanwhile, setting an answering interface corresponding to the incoming call event on a playing interface corresponding to the target video.
4. The method according to claim 2, wherein when the target progress corresponding to the target audio is extracted when the target video starts playing,
and calling the synchronous clock according to the target progress to carry out real-time synchronization to obtain the synchronous progress corresponding to the target video, and fast forwarding in the video playing plug-in unit according to the synchronous progress to render the target video.
5. The method of claim 4, wherein when the target video begins playing,
extracting the called loading time of the video playing plug-in;
predicting the buffer time of the target video decoded by the video playing plug-in according to the size and the format of the target video;
and adding the loading time and the buffering time, and analyzing and correcting by synthesizing the target progress corresponding to the target audio to obtain the synchronous progress corresponding to the target video.
6. The method of claim 4, wherein when the target video begins playing,
monitoring the current playing progress corresponding to the target audio in real time;
and searching in the synchronous clock according to the current playing progress corresponding to the target audio, and acquiring the synchronous progress corresponding to the target video according to a timestamp in the synchronous clock.
7. The method according to any one of claims 2, 4-6, further comprising: and respectively monitoring the playing progress of the target video and the target audio in real time according to the synchronous clock, and if the difference value corresponding to the target video and the target audio is greater than a set threshold value, fast forwarding the target video again according to the difference value, and rendering the target video again.
8. An apparatus for controlling incoming video in a terminal, the apparatus comprising:
the separation module is used for separating the set video to be processed to obtain corresponding target audio and target video;
the monitoring module is used for replacing the set incoming call ringtone in the terminal with the target audio and simultaneously monitoring the incoming call event in the terminal in real time;
the calling module is used for calling the target video to play while playing by taking the target audio as a ring tone after monitoring an incoming call event;
and the synchronization module is used for extracting a target progress corresponding to the target audio when the target video starts to be played, and fast-forwarding the target video according to the target progress and the delay time of the target video to keep the playing progress of the target video and the target audio synchronous, wherein the delay time of the target video is determined by the called loading time of the playing plug-in of the target video and the decoding cache time of the target video by the video playing plug-in.
9. The apparatus according to claim 8, wherein in the separation module, when the video to be processed is separated,
decapsulating the video to be processed to obtain a target audio and a target video, and obtaining a synchronous clock between the target audio and the target video;
the synchronous clock records relative time sequence playing information between the target audio and the target video, and is used for enabling the target audio and the target video to be played synchronously.
10. The apparatus of claim 8, further comprising: and after an incoming call event is monitored in the calling module, calling a video playing plug-in to play the target video, and meanwhile, setting an answering interface corresponding to the incoming call event on a playing interface corresponding to the target video.
11. The apparatus according to claim 9, wherein the synchronization module specifically includes:
and the real-time synchronization unit is used for calling the synchronous clock according to the target progress to carry out real-time synchronization so as to obtain the synchronous progress corresponding to the target video, and fast-forwarding in the video playing plug-in unit according to the synchronous progress so as to render the target video.
12. The apparatus of claim 11, wherein the real-time synchronization unit specifically comprises,
the time extraction subunit is used for extracting the called loading time of the video playing plug-in;
the prediction subunit is used for predicting the buffering time of the target video decoded by the video playing plug-in according to the size and the format of the target video;
and the correcting subunit is used for summing the loading time and the buffering time, and analyzing and correcting the target progress corresponding to the target audio in a comprehensive manner to obtain the synchronous progress corresponding to the target video.
13. The apparatus of claim 11, wherein the real-time synchronization unit specifically comprises,
the monitoring subunit is used for monitoring the current playing progress corresponding to the target audio in real time;
and the matching subunit is used for searching in the synchronous clock according to the current playing progress corresponding to the target audio, and acquiring the synchronous progress corresponding to the target video according to a timestamp in the synchronous clock.
14. The apparatus according to any one of claims 9, 11-13, further comprising: and the monitoring module is used for respectively monitoring the playing progresses of the target video and the target audio in real time according to the synchronous clock, and if the difference value corresponding to the target video and the target audio is greater than a set threshold value, fast forwarding the target video again according to the difference value and rendering the target video again.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910293586.8A CN109862193B (en) | 2019-04-12 | 2019-04-12 | Incoming call video control method and device in terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910293586.8A CN109862193B (en) | 2019-04-12 | 2019-04-12 | Incoming call video control method and device in terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109862193A CN109862193A (en) | 2019-06-07 |
| CN109862193B true CN109862193B (en) | 2020-10-02 |
Family
ID=66903839
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910293586.8A Active CN109862193B (en) | 2019-04-12 | 2019-04-12 | Incoming call video control method and device in terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109862193B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112653920B (en) * | 2020-12-18 | 2022-05-24 | 北京字跳网络技术有限公司 | Video processing method, device, equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103402073A (en) * | 2013-08-22 | 2013-11-20 | 聚领信息技术（上海）有限公司 | Method for realizing video communication by input/ output (I/ O) separation way |
| CN105872699A (en) * | 2016-04-28 | 2016-08-17 | 乐视控股（北京）有限公司 | Video playing control method and device |
| CN106658133A (en) * | 2016-10-26 | 2017-05-10 | 广州市百果园网络科技有限公司 | Audio and video synchronous playing method and terminal |
| CN107360458A (en) * | 2017-06-30 | 2017-11-17 | 广东欧珀移动通信有限公司 | Control method for playing back, device, storage medium and terminal |
| CN107454447A (en) * | 2017-09-04 | 2017-12-08 | 青岛海信电器股份有限公司 | A kind of plug-in loading method of player, device and television set |
| CN109348070A (en) * | 2018-12-21 | 2019-02-15 | 北京金山安全软件有限公司 | Caller identification method and device |
| JP2019033503A (en) * | 2012-08-20 | 2019-02-28 | ウォルジエン エルエルシー | Video call center |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| ATE464740T1 (en) * | 2000-12-15 | 2010-04-15 | British Telecomm | TRANSMISSION OF SOUND AND/OR IMAGE MATERIAL |
| JP2006211431A (en) * | 2005-01-28 | 2006-08-10 | Kyocera Corp | Telephone set with stream receiving function and stream reproducing method in telephone set with stream receiving function |
| CN102055970A (en) * | 2009-11-09 | 2011-05-11 | 鸿富锦精密工业（深圳）有限公司 | Multi-standard video decoding system |
| KR20150001881A (en) * | 2013-06-26 | 2015-01-07 | 캠프모바일 주식회사 | Method and system for providing video multimedia ringtone |
| CN104681047B (en) * | 2013-11-26 | 2018-03-23 | 中国移动通信集团公司 | A kind of adaptive video player method, device and terminal |
| CN104853239B (en) * | 2015-04-27 | 2018-08-31 | 浙江生辉照明有限公司 | Audio-visual synchronization control method for playing back and system |
| CN108632557B (en) * | 2017-03-20 | 2021-06-08 | 中兴通讯股份有限公司 | Audio and video synchronization method and terminal |
-
2019
- 2019-04-12 CN CN201910293586.8A patent/CN109862193B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2019033503A (en) * | 2012-08-20 | 2019-02-28 | ウォルジエン エルエルシー | Video call center |
| CN103402073A (en) * | 2013-08-22 | 2013-11-20 | 聚领信息技术（上海）有限公司 | Method for realizing video communication by input/ output (I/ O) separation way |
| CN105872699A (en) * | 2016-04-28 | 2016-08-17 | 乐视控股（北京）有限公司 | Video playing control method and device |
| CN106658133A (en) * | 2016-10-26 | 2017-05-10 | 广州市百果园网络科技有限公司 | Audio and video synchronous playing method and terminal |
| CN107360458A (en) * | 2017-06-30 | 2017-11-17 | 广东欧珀移动通信有限公司 | Control method for playing back, device, storage medium and terminal |
| CN107454447A (en) * | 2017-09-04 | 2017-12-08 | 青岛海信电器股份有限公司 | A kind of plug-in loading method of player, device and television set |
| CN109348070A (en) * | 2018-12-21 | 2019-02-15 | 北京金山安全软件有限公司 | Caller identification method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109862193A (en) | 2019-06-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11336953B2 (en) | Video processing method, electronic device, and computer-readable medium | |
| US20170111414A1 (en) | Video playing method and device | |
| CN105338424B (en) | A kind of method for processing video frequency and system | |
| CN110996134B (en) | Video playing method, device and storage medium | |
| EP3119070A1 (en) | Method and device for determining a crank phone number | |
| WO2020248909A1 (en) | Video decoding method and apparatus, computer device, and storage medium | |
| CN106470284B (en) | Method, device, system, server and communication device for eliminating acoustic echo | |
| CN111078343A (en) | Screen capturing method and screen capturing device for mobile terminal and mobile terminal | |
| US9787999B2 (en) | Method for decreasing the bit rate needed to transmit videos over a network by dropping video frames | |
| US9800631B2 (en) | Method and a media device for pre-buffering media content streamed to the media device from a server system | |
| WO2018121649A1 (en) | Incoming call management method and apparatus | |
| US9100632B2 (en) | Method for providing video call analysis service and an electronic device thereof | |
| TWI771480B (en) | Method, device and electronic device for forwarding chat information | |
| CN109862193B (en) | Incoming call video control method and device in terminal | |
| US20120014295A1 (en) | Electronic device, storage medium storing information processing program and information processing method | |
| CN112910592B (en) | Clock synchronization method and device, terminal and storage medium | |
| KR101342210B1 (en) | Device and method for controlling screen brightness in wireless terminal | |
| CN111352605A (en) | Audio playing and sending method and device | |
| WO2005062587A1 (en) | A method and apparatus for providing caller id information to telephone users | |
| CN112637668B (en) | Video playing method, device, equipment and medium | |
| CN110568925A (en) | lock screen display control method, terminal and computer storage medium | |
| WO2022193141A1 (en) | Multimedia file playing method and related apparatus | |
| CN107391733B (en) | Music file fast grouping method, music file fast grouping device and terminal | |
| CN112423099A (en) | Video loading method and device and electronic equipment | |
| CN113301254A (en) | Video recording method, processing method, device, terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220801 Address after: No.16 and 17, unit 1, North District, Kailin center, No.51 Jinshui East Road, Zhengzhou area (Zhengdong), Henan pilot Free Trade Zone, Zhengzhou City, Henan Province, 450000 Patentee after: Zhengzhou Apas Technology Co.,Ltd. Address before: E301-27, building 1, No.1, hagongda Road, Tangjiawan Town, Zhuhai City, Guangdong Province Patentee before: ZHUHAI TIANYAN TECHNOLOGY Co.,Ltd. |
|
| TR01 | Transfer of patent right |