CN105163188A - Video content processing method, device and apparatus - Google Patents

Video content processing method, device and apparatus Download PDF

Info

Publication number
CN105163188A
CN105163188A CN201510549853.5A CN201510549853A CN105163188A CN 105163188 A CN105163188 A CN 105163188A CN 201510549853 A CN201510549853 A CN 201510549853A CN 105163188 A CN105163188 A CN 105163188A
Authority
CN
China
Prior art keywords
image
video content
video
processed
processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510549853.5A
Other languages
Chinese (zh)
Inventor
高毅
王洪强
葛云源
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xiaomi Inc
Original Assignee
Xiaomi Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xiaomi Inc filed Critical Xiaomi Inc
Priority to CN201510549853.5A priority Critical patent/CN105163188A/en
Publication of CN105163188A publication Critical patent/CN105163188A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

The invention relates to a video content processing method, device and apparatus. The method comprises: when a video is played, pre-reading video content; obtaining an image to be processed from the pre-read video content; replacing the image to be processed with a target image to obtain the video content containing the target image; and when the video content is played, playing the video content containing the target image. The video content processing method is capable of processing the image in the video content according to the requirements of a user.

Description

Video content processing method, device and equipment
Technical Field
The present disclosure relates to the field of mobile communications technologies, and in particular, to a method, an apparatus, and a device for processing video content.
Background
With the rapid development of electronic technology and internet technology, users increasingly like to watch videos using various electronic devices. In the content of the video broadcast, the video program content itself or the advertisement content may include various images, such as head portraits of stars or certain commodity images, such as commodity images of a certain brand, an electric appliance, a handbag, etc.
Disclosure of Invention
The disclosure provides a video content processing method, a video content processing device and video content processing equipment, which can process images in video content according to user requirements.
According to a first aspect of embodiments of the present disclosure, there is provided a video content processing method, the method including: when the video is played, reading the video content in advance;
acquiring an image to be processed in the pre-read video content;
replacing the image to be processed with a target image to obtain video content comprising the target image;
and when the video content is played, playing the video content comprising the target image.
Optionally, the obtaining the image to be processed from the pre-read video content includes:
according to a preset image recognition algorithm and a history processing image, identifying an image to be processed corresponding to the history processing image in the pre-read video content, wherein the history processing image is an image subjected to image replacement processing in history playing.
Optionally, the identifying, in the pre-read video content, an image to be processed corresponding to the image processed in history further includes:
and identifying the width, the height and the position of the image to be processed in the current frame video content.
Optionally, replacing the image to be processed with a target image, and obtaining the video content including the target image includes:
reading a pre-stored target image, and adjusting the target image to be the same as the width and the height of the image to be processed in the current frame of video content by utilizing an image processing technology;
and deleting the image to be processed from the current frame of video content by utilizing an image processing technology according to the width and the height of the image to be processed and the position of the image to be processed in the current frame of video content, and adding the adjusted target image to the deleted position.
Optionally, the identifying, in the pre-read video content, the to-be-processed image corresponding to the history processing image includes:
searching all images to be processed corresponding to the historical processing images in the pre-read video content according to the historical processing images; or,
and searching other corresponding images to be processed in the video content read in advance according to the identified first image to be processed corresponding to the historical processing image and the recorded information of the time when the image to be processed appears in the video content.
Optionally, when the video is played, reading the video content in advance, including:
when the video is played, the video content downloaded to the local or the video content being downloaded from the server buffer is read in advance.
Optionally, the method further includes:
detecting image delineation operation in a video screen when a historical video is played;
and identifying the circled image as a history processing image and storing the history processing image.
Optionally, when the historical video is played, detecting an image delineating operation in a video screen, and identifying and storing the delineated image as a historical processing image includes:
when a historical video is played, detecting an image delineation operation in a video screen, wherein the image delineation operation is an operation that a track defined by sliding operation along an image contour is a closed graph or a closed degree meets a set threshold; and identifying the content in the image contour obtained by the image delineation operation as a history processing image and storing the history processing image.
Optionally, the method further includes:
storing the video content of replacing the image to be processed with the target image;
and when the video is played next time, detecting whether the stored video content has the video content corresponding to the video to be played, if the stored video content has the video content corresponding to the video to be played, playing the stored video content, and if the stored video content does not find the video content corresponding to the video to be played, executing the step of replacing the image to be processed with the target image to obtain the video content comprising the target image.
According to a second aspect of the embodiments of the present disclosure, there is provided a video content processing apparatus, the apparatus comprising:
the pre-reading module is used for pre-reading video contents when the video is played;
the acquisition module is used for acquiring an image to be processed from the video content read in advance by the pre-reading module;
the replacing module is used for replacing the image to be processed acquired by the acquiring module with a target image to obtain video content comprising the target image;
and the playing module is used for playing the video content which is obtained by the replacing module and comprises the target image when the video content is played.
Optionally, the obtaining module includes:
the preset unit is used for presetting an image recognition algorithm and a history processing image;
and the identification unit is used for identifying an image to be processed corresponding to the historical processing image in the pre-read video content according to the image identification algorithm and the historical processing image preset by the preset unit, wherein the historical processing image is an image subjected to image replacement processing in historical playing.
Optionally, the replacing module includes:
the adjusting unit is used for reading a pre-stored target image and adjusting the target image to be the same as the width and the height of the image to be processed in the current frame of video content by utilizing an image processing technology;
and the replacing unit is used for deleting the image to be processed from the current frame of video content by utilizing an image processing technology according to the width and the height of the image to be processed and the position of the image to be processed in the current frame of video content, and adding the target image adjusted by the adjusting unit to the deleted position.
Optionally, the pre-reading module includes:
the local pre-reading unit is used for pre-reading the video content downloaded to the local during video playing; or,
and the network pre-reading unit is used for pre-reading the video content which is being buffered and downloaded from the server during video playing.
Optionally, the apparatus further comprises:
and the gesture processing module is used for detecting image delineation operation in a video screen when the historical video is played, identifying the delineated image as a historical processing image and storing the historical processing image.
Optionally, the apparatus further comprises:
the storage module is used for storing the video content of the target image which is replaced by the image to be processed;
the detection processing module is used for detecting whether video content corresponding to the video to be played exists in the video content stored in the storage module when the video is played next time, if the stored video content includes the video content corresponding to the video to be played, the stored video content is played by the playing module, and if the stored video content does not find the video content corresponding to the video to be played, the image to be processed is replaced by the target image by the replacing module, so that the video content including the target image is obtained.
According to a third aspect of the embodiments of the present disclosure, there is provided a terminal device, the device including: a processor and a memory for storing processor-executable instructions;
wherein the processor is configured to:
when the video is played, reading the video content in advance;
acquiring an image to be processed in the pre-read video content;
replacing the image to be processed with a target image to obtain video content comprising the target image;
and when the video content is played, playing the video content comprising the target image.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:
according to the video playing method and device, when the video is played, the video content in the video content is read in advance, the image to be processed is obtained from the read video content in advance, the image to be processed is replaced by the target image, and the video content comprising the target image is obtained.
According to the method and the device, an image recognition algorithm and a historical processing image can be preset, so that the to-be-processed image corresponding to the historical processing image can be recognized in the pre-read video content according to the preset image recognition algorithm and the historical processing image.
According to the method and the device, the target image can be adjusted and then replaced, so that the replacement effect is better, if the target image is adjusted to be the same as the width and the height of the image to be processed in the current frame of video content, the image to be processed can be deleted from the current frame of video content by utilizing an image processing technology according to the width and the height of the image to be processed and the position of the image to be processed in the current frame of video content during replacement, and the adjusted target image is added to the deleted position.
The present disclosure may find the to-be-processed image corresponding to the history processing image in the video content in different manners, for example, directly search according to the history processing image, or search according to the information of the occurrence time of the identified first to-be-processed image corresponding to the history processing image and the recorded to-be-processed image in the video content.
The present disclosure may pre-read video content in different ways, such as pre-reading video content that has been downloaded locally or video content that is being downloaded from a server buffer.
According to the method and the device, misoperation is avoided, the identification accuracy is improved, when the historical video is played, the image delineation operation in the video screen is detected, the delineated track is a closed graph or the closure degree meets a set threshold value, and then the content in the image contour obtained by the image delineation operation is identified as a historical processing image and stored.
The method can also store the video content for replacing the image to be processed with the target image so as to be convenient for subsequent use, so that whether the stored video content has the video content corresponding to the video to be played is detected when the video is played next time, if the stored video content has the video content corresponding to the video to be played, the stored video content can be directly played without executing replacement operation, and if the stored video content does not find the video content corresponding to the video to be played, the replacement operation is executed.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
Fig. 1 is a flow chart illustrating a video content processing method according to an exemplary embodiment of the present disclosure.
Fig. 2 is a flow chart illustrating another video content processing method according to an exemplary embodiment of the present disclosure.
Fig. 3 is a flow chart illustrating another video content processing method according to an exemplary embodiment of the present disclosure.
Fig. 4 is a block diagram of a video content processing apparatus according to an exemplary embodiment of the present disclosure.
Fig. 5 is a block diagram of another video content processing apparatus shown in accordance with an exemplary embodiment of the present disclosure.
Fig. 6 is a block diagram of a terminal device shown in accordance with an exemplary embodiment of the present disclosure.
Fig. 7 is a block diagram illustrating an arrangement of a device according to an exemplary embodiment of the present disclosure.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
The terminology used in the present disclosure is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. As used in this disclosure and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present disclosure. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
Fig. 1 is a flowchart illustrating a video content processing method according to an exemplary embodiment, which may be used in a terminal, and includes the following steps:
in step 101, video content is read in advance when video is played.
In this step, the video content that has been downloaded locally or the video content being downloaded from the server buffer may be read in advance.
In step 102, a to-be-processed image is acquired in the previously read video content.
In this step, an image to be processed corresponding to a history processing image may be identified in the pre-read video content according to a preset image identification algorithm and the history processing image, where the history processing image is an image subjected to image replacement processing in history playing.
Identifying an image to be processed corresponding to the history processing image in the previously read video content, and further comprising: and identifying the width, the height and the position of the image to be processed in the current frame video content.
Identifying an image to be processed corresponding to the history processing image in the previously read video content includes: searching all images to be processed corresponding to the historical processing images in the pre-read video content according to the historical processing images; or searching other corresponding images to be processed in the video content read in advance according to the identified first image to be processed corresponding to the historical processing image and the recorded information of the time when the image to be processed appears in the video content.
In step 103, replacing the image to be processed with a target image to obtain video content including the target image.
Reading a pre-stored target image, and adjusting the target image to be the same as the width and the height of the image to be processed in the current frame of video content by using an image processing technology;
and deleting the image to be processed from the current frame of video content by utilizing an image processing technology according to the width and the height of the image to be processed and the position of the image to be processed in the current frame of video content, and adding the adjusted target image to the deleted position.
In step 104, when the video content is played, the video content including the target image is played.
As can be seen from this embodiment, in video playing, the video content in the video content is read in advance, the image to be processed is obtained from the video content read in advance, and the image to be processed is replaced with the target image, so as to obtain the video content including the target image.
Fig. 2 is a flow chart illustrating another video content processing method according to an exemplary embodiment of the present disclosure. Compared with the flow of fig. 1, the flow of fig. 2 includes the delineation operation of the image during the history playing and the storage after the video content replacement so that the video can be directly used during the playing again.
The method can be used in a terminal and comprises the following steps:
in step 201, at the time of history video playing, an image delineation operation in a video screen is detected, and the delineated image is recognized as a history processing image and stored.
In the step, when a historical video is played, detecting an image delineation operation in a video screen, wherein the image delineation operation is an operation that a track defined by sliding operation along an image contour is a closed graph or a closed degree meets a set threshold; and identifying the content in the image contour obtained by the image delineation operation as a history processing image and storing the history processing image.
The set threshold may be empirically derived, and the present disclosure is not limited thereto, and generally 80% may be used as the threshold, i.e., the closure degree is required to be 80% or more.
In step 202, the video content is read in advance when the video is played.
This step can be referred to the description of step 101.
In step 203, a to-be-processed image is acquired in the previously read video content.
This step can be seen in the description of step 102.
In step 204, the image to be processed is replaced with a target image, and video content including the target image is obtained.
This step can be referred to as the description of step 103.
In step 205, when the video content is played, the video content including the target image is played.
This step can be seen in the description of step 104.
In step 206, the video content in which the image to be processed is replaced with the target image is stored.
In step 207, during the next video playing, it is detected whether there is a video content corresponding to the video to be played in the stored video content, and if there is a video content corresponding to the video to be played in the stored video content, the stored video content is played.
In this step, if the video content corresponding to the video to be played is not found in the stored video content, the step of replacing the image to be processed with the target image to obtain the video content including the target image is performed.
As can be seen from this embodiment, the present disclosure may detect an image delineation operation in a video screen when a historical video is played, and identify and store a content in an image profile obtained by the image delineation operation as a historical processing image, so as to subsequently identify, according to the historical processing image and a preset image identification algorithm, an image to be processed corresponding to the historical processing image from pre-read video content; the method can also store the video content for replacing the image to be processed with the target image so as to be convenient for subsequent use, so that whether the stored video content has the video content corresponding to the video to be played is detected when the video is played next time, if the stored video content has the video content corresponding to the video to be played, the stored video content can be directly played without executing replacement operation, and if the stored video content does not find the video content corresponding to the video to be played, the replacement operation is executed.
Fig. 3 is a flow chart illustrating another video content processing method according to an exemplary embodiment of the present disclosure. The method can be used in a terminal and comprises the following steps:
in step 301, it is detected that a progress bar of a video is dragged to a set time point in a video screen.
When a user watches a video, if a certain image in the video, such as a certain commodity image, is found to be disliked or even annoying by the user, the user can drag a progress bar of the video and drag a video screen to a time point containing the commodity image. At this time, the terminal drags the progress bar, which detects the video, in the video screen to a set time point, where the video screen of the set time point includes the commodity image.
If a plurality of time points in the video comprise a certain commodity image in the video screen, the commodity image can be dragged to any one of the time points.
In step 302, an image delineation operation in a video screen is detected, and the degree of closure of the delineation track is checked.
In the step, it is detected that the user performs a delineating operation on the commodity image in the current video screen, and the outline of the commodity image is circled, that is, for the user, the user slides a finger to circle the commodity image. In the step, in order to accurately identify the circled track and reduce misoperation, when the track is a closed graph or the closing degree meets a set threshold value, the content in the image contour obtained by the image delineation operation is identified as an image to be replaced. The set threshold may be empirically derived, and the present disclosure is not limited thereto, and generally 80% may be used as the threshold, i.e., the closure degree is required to be 80% or more. If the track is not a closed figure or the closing degree of the track does not meet a set threshold value, if only a small part of the outline is drawn, the track is not identified as an image needing to be replaced.
In step 303, after the degree of closure of the circumscribed trajectory satisfies the requirement, the image circumscribed on the video screen is read and recognized as a history processed image and stored.
After the step 302 checks that the degree of closure of the defined track meets the requirement, the step reads the defined track, that is, the image in the defined outline, identifies the commodity image in the track as a history processing image, that is, an image to be replaced, by using a related image identification technology, and stores the image in the database. The image recognition technology may be, for example, statistical pattern recognition, structural pattern recognition, fuzzy pattern recognition, etc., and the present disclosure is not limited thereto as long as the image within the trajectory can be recognized.
This step may also record the time at which the historically processed images appear, so that image lookup operations are performed using the recorded time information when the video is played again.
In step 304, a target image is determined for replacing the defined image.
In this step, a target image for replacing the defined image is determined according to the setting of the user.
After the commodity image to be replaced is defined as the history processing image in the above step screen, the target image for replacing the defined image is determined. The user can set the favorite commodity image stored in the local terminal or the server as the target image for replacement according to the prompt output by the interface. According to the user's setting, the terminal determines a target image for replacing the defined image.
In addition, the target image for replacing the defined image can be preset at the local terminal, so that the user is not required to be prompted to select and set the target image for replacement after the commodity image required to be replaced is defined.
In step 305, when the video is played again, the video content is read in advance.
When it is detected that the video starts to play again, whether the video is downloaded to the local in advance or is being buffered in a network with a server, the video content is read in advance, that is, each frame of video image in the video is acquired in advance.
In step 306, the video content read in advance is searched for an image to be processed that matches the stored image processed in history.
In the step, all images to be processed corresponding to the historical processing images are matched and identified in the pre-read video content according to the previously stored historical processing images by using a related image identification algorithm. Alternatively, other corresponding images to be processed may be searched for in the video content read in advance according to the information of the identified first image to be processed corresponding to the image to be processed in the history and the recorded time when the image to be processed appears in the video content.
When a to-be-processed image matching the stored history-processed image is identified, information about the image of the to-be-processed image, including the size (e.g., width, height) of the image, the position in the current frame video content, and the like, may be recorded and stored for subsequent operations.
In step 307, the size of the target image is adjusted.
In the step, a pre-stored target image is read, the width and the height of the recorded image to be processed are utilized, and the target image is adjusted to be the same as the width and the height of the image to be processed in the current frame of video content by utilizing a related image processing technology. Related image processing technologies, generally, different software may be used to process an image, and the disclosure is not limited as long as image resizing can be achieved.
In step 308, the image to be processed is replaced with the target image, and the video content including the target image is obtained.
In the step, according to the width and the height of the image to be processed and the position of the image in the current frame of video content, the image to be processed is deleted from the current frame of video content by using an image processing technology, and the adjusted target image is added to the deleted position, so that the image replacement is realized.
In step 309, the video content in which the image to be processed is replaced with the target image is stored.
This step stores the video image of this frame after the image replacement is completed.
In step 310, when the video content is played, the video content including the target image is played.
In this step, when the video is subsequently played to a certain frame of video image of the replaced image, the replaced image is directly displayed.
In step 311, during the next video playing, it is detected whether there is a video content corresponding to the video to be played in the stored video content, and if there is a video content corresponding to the video to be played in the stored video content, the stored video content is played.
In this step, if the video content corresponding to the video to be played is not found in the stored video content, the step of replacing the image to be processed with the target image is performed to obtain the video content including the target image.
It should be noted that, the present disclosure may replace various images appearing in the video content according to the user's needs, for example, commodity images, such as commodity images of a certain brand, an electric appliance, a handbag, etc., and may also be other images, such as star images, etc.
According to the embodiment, by the technical scheme, after the commodity image needing to be replaced is defined by the user, the commodity image corresponding to each frame of image in the subsequent video can be automatically identified and replaced for the user, so that the requirement that the user wants to see the favorite image when watching the video is met, and the user experience is improved. The method comprises the steps of firstly, recognizing that a defined image needs to be replaced after a video screen played by a video detects the defined image, using the defined image as a history processing image, and setting a target image for replacing the defined image; when the video is played again, the video content in the video is read in advance, the image to be processed matched with the historical processing image is searched in the video content and replaced by the target image, therefore, when the video is played to the corresponding video content, the image appearing in the video content is the image which is wanted to be seen by the user after replacement, the problem that the image in the video content is processed according to the requirement of the user, such as replacement, is solved, and the user can replace various images in the video content by favorite images according to the favorite.
Corresponding to the foregoing video content processing method embodiment, the present disclosure also provides embodiments of a video content processing apparatus and a corresponding terminal.
Fig. 4 is a block diagram of a video content processing apparatus according to an exemplary embodiment of the present disclosure.
As shown in fig. 4, the video content processing apparatus includes: the device comprises a pre-reading module 401, an acquisition module 402, a replacement module 403 and a playing module 404.
The pre-reading module 401 is configured to pre-read video content when a video is played.
An obtaining module 402, configured to obtain an image to be processed from the video content read in advance by the pre-reading module 402.
A replacing module 403, configured to replace the image to be processed acquired by the acquiring module 402 with the target image, so as to obtain video content including the target image.
A playing module 404, configured to play the video content including the target image obtained by the replacing module 403 when the video content is played.
In the embodiment, when the video is played, the video content in the video is read in advance, the image to be processed is obtained from the pre-read video content, and the image to be processed is replaced by the target image, so that the video content comprising the target image is obtained.
Fig. 5 is a block diagram of another video content processing apparatus shown in accordance with an exemplary embodiment of the present disclosure.
As shown in fig. 5, the video content processing apparatus includes a pre-reading module 401, an obtaining module 402, a replacing module 403, a playing module 404, a gesture processing module 405, a storage module 406, and a detection processing module 407.
The functions of the pre-reading module 401, the obtaining module 402, the replacing module 403 and the playing module 404 can be referred to the description in fig. 4.
Wherein, the obtaining module 402 comprises: a presetting unit 4021 and an identification unit 4022.
The preset unit 4021 is configured to preset an image recognition algorithm and a history processing image.
The identifying unit 4022 is configured to identify an image to be processed corresponding to a history processing image in the pre-read video content according to an image identification algorithm and the history processing image preset by the presetting unit 402, where the history processing image is an image subjected to image replacement processing in history playing.
The identifying unit 4022 identifies an image to be processed corresponding to a history processing image in the video content read in advance, and further includes: and identifying the width, the height and the position of the image to be processed in the current frame video content.
The identification unit 4022 identifying an image to be processed corresponding to a history processing image in the video content read in advance includes: searching all to-be-processed images corresponding to the historical processing images in the pre-read video content according to the historical processing images; or searching other corresponding images to be processed in the video content read in advance according to the information of the identified first image to be processed corresponding to the historical processing image and the recorded time when the image to be processed appears in the video content.
The replacement module 403 includes: an adjustment unit 4031 and a replacement unit 4032.
An adjusting unit 4031, configured to read a pre-stored target image, and adjust the target image to be the same as the width and height of the image to be processed in the current frame of video content by using an image processing technique.
A replacing unit 4032, configured to delete the image to be processed from the current frame of video content by using an image processing technique according to the width and height of the image to be processed and the position in the current frame of video content, and add the target image adjusted by the adjusting unit 4031 to the deleted position.
The pre-reading module 401 includes: a local pre-reading unit 4011 or a network pre-reading unit 4012.
The local pre-reading unit 4011 is configured to, when playing a video, pre-read video content that has been downloaded to the local.
The network pre-reading unit 4012 is configured to pre-read video content that is being buffered and downloaded from the server during video playing.
And the gesture processing module 405 is configured to detect an image delineation operation in a video screen when the historical video is played, and recognize the delineated image as a historical processing image and store the historical processing image.
When a historical video is played, the gesture processing module 405 detects an image delineation operation in a video screen, wherein the image delineation operation is an operation that a track defined by sliding operation along an image contour is a closed graph or a closed degree meets a set threshold; and identifying the content in the image contour obtained by the image delineation operation as a history processing image and storing the history processing image.
And a storage module 406, configured to store video content obtained by replacing the image to be processed with the target image.
The detection processing module 407 is configured to detect whether video content corresponding to the video to be played exists in the video content stored in the storage module 406 when the video is played next time, if the video content corresponding to the video to be played exists in the stored video content, the playing module 404 plays the stored video content, and if the video content corresponding to the video to be played is not found in the stored video content, the replacement module 403 replaces the image to be processed with the target image to obtain the video content including the target image.
As can be seen from this embodiment, the present disclosure may detect an image delineation operation in a video screen when a historical video is played, and identify and store a content in an image profile obtained by the image delineation operation as a historical processing image, so as to subsequently identify, according to the historical processing image and a preset image identification algorithm, an image to be processed corresponding to the historical processing image from pre-read video content; the method can also store the video content for replacing the image to be processed with the target image so as to be convenient for subsequent use, so that whether the stored video content has the video content corresponding to the video to be played or not is detected when the video is played next time, and if the stored video content has the video content corresponding to the video to be played, the stored video content can be directly played without executing replacement operation.
The implementation process of the functions and actions of each unit in the above device is specifically described in the implementation process of the corresponding step in the above method, and is not described herein again.
For the device embodiments, since they substantially correspond to the method embodiments, reference may be made to the partial description of the method embodiments for relevant points. The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the disclosed solution. One of ordinary skill in the art can understand and implement it without inventive effort.
Correspondingly, the disclosure also provides a terminal.
Fig. 6 is a block diagram of a terminal device shown in accordance with an exemplary embodiment of the present disclosure.
As shown in fig. 6, the terminal device includes: a processor 601 and a memory 602 for storing processor-executable instructions;
wherein the processor 601 is configured to:
when the video is played, reading the video content in advance;
acquiring an image to be processed in the pre-read video content;
replacing the image to be processed with a target image to obtain video content comprising the target image;
and when the video content is played, playing the video content comprising the target image.
It should be noted that, for other programs stored in the memory 602, reference is specifically made to the description in the foregoing method flow, and details are not described here again, and the processor 601 is also configured to execute other programs stored in the memory 602.
Fig. 7 is a block diagram illustrating an arrangement of a device according to an exemplary embodiment of the present disclosure.
For example, the device 700 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.
Referring to fig. 7, device 700 may include one or more of the following components: processing component 702, memory 704, power component 706, multimedia component 708, audio component 710, input/output (I/O) interface 77, sensor component 714, and communication component 716.
The processing component 702 generally controls the overall operation of the device 700, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 702 may include one or more processors 720 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 702 may include one or more modules that facilitate interaction between the processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate interaction between the multimedia component 708 and the processing component 702.
The memory 704 is configured to store various types of data to support operation at the device 700. Examples of such data include instructions for any application or method operating on device 700, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 704 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The power supply component 706 provides power to the various components of the device 700. The power components 706 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 700.
The multimedia component 708 includes a screen that provides an output interface between the device 700 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 708 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 700 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 710 is configured to output and/or input audio signals. For example, the audio component 710 includes a Microphone (MIC) configured to receive external audio signals when the device 700 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 704 or transmitted via the communication component 716. In some embodiments, audio component 710 also includes a speaker for outputting audio signals.
The I/O interface 77 provides an interface between the processing component 702 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 714 includes one or more sensors for providing status assessment of various aspects of the device 700. For example, the sensor assembly 714 may detect an open/closed state of the device 700, the relative positioning of components, such as a display and keypad of the device 700, the sensor assembly 714 may also detect a change in the position of the device 700 or a component of the device 700, the presence or absence of user contact with the device 700, orientation or acceleration/deceleration of the device 700, and a change in the temperature of the device 700. The sensor assembly 714 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 714 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 714 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 716 is configured to facilitate wired or wireless communication between the device 700 and other devices. The device 700 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 716 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the device 700 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as the memory 704 comprising instructions, executable by the processor 720 of the device 700 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
A non-transitory computer readable storage medium in which instructions, when executed by a processor of a terminal, enable the terminal to perform a video content processing method, the method comprising:
when the video is played, reading the video content in advance;
acquiring an image to be processed in the pre-read video content;
replacing the image to be processed with a target image to obtain video content comprising the target image;
and when the video content is played, playing the video content comprising the target image.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims (16)

1. A method for processing video content, comprising:
when the video is played, reading the video content in advance;
acquiring an image to be processed in the pre-read video content;
replacing the image to be processed with a target image to obtain video content comprising the target image;
and when the video content is played, playing the video content comprising the target image.
2. The video content processing method according to claim 1, wherein the obtaining of the image to be processed in the pre-read video content comprises:
according to a preset image recognition algorithm and a history processing image, identifying an image to be processed corresponding to the history processing image in the pre-read video content, wherein the history processing image is an image subjected to image replacement processing in history playing.
3. The video content processing method according to claim 2, wherein the identifying of the to-be-processed image corresponding to the history processing image in the video content read in advance further comprises:
and identifying the width, the height and the position of the image to be processed in the current frame video content.
4. The video content processing method according to claim 3, wherein the replacing the image to be processed with a target image to obtain the video content including the target image comprises:
reading a pre-stored target image, and adjusting the target image to be the same as the width and the height of the image to be processed in the current frame of video content by utilizing an image processing technology;
and deleting the image to be processed from the current frame of video content by utilizing an image processing technology according to the width and the height of the image to be processed and the position of the image to be processed in the current frame of video content, and adding the adjusted target image to the deleted position.
5. The video content processing method according to claim 2, wherein the identifying, in the video content read in advance, the to-be-processed image corresponding to the history processing image includes:
searching all images to be processed corresponding to the historical processing images in the pre-read video content according to the historical processing images; or,
and searching other corresponding images to be processed in the video content read in advance according to the identified first image to be processed corresponding to the historical processing image and the recorded information of the time when the image to be processed appears in the video content.
6. The method of claim 1, wherein the pre-reading the video content during the video playing comprises:
when the video is played, the video content downloaded to the local or the video content being downloaded from the server buffer is read in advance.
7. The video content processing method according to claim 1, wherein the method further comprises:
detecting image delineation operation in a video screen when a historical video is played;
and identifying the circled image as a history processing image and storing the history processing image.
8. The video content processing method according to claim 7, wherein the detecting an image delineation operation in a video screen at the time of the history video playing, and the recognizing and storing the delineated image as the history processing image comprises:
when a historical video is played, detecting an image delineation operation in a video screen, wherein the image delineation operation is an operation that a track defined by sliding operation along an image contour is a closed graph or a closed degree meets a set threshold;
and identifying the content in the image contour obtained by the image delineation operation as a history processing image and storing the history processing image.
9. The video content processing method according to any one of claims 1 to 8, wherein the method further comprises:
storing the video content of replacing the image to be processed with the target image;
and when the video is played next time, detecting whether the stored video content has the video content corresponding to the video to be played, if the stored video content has the video content corresponding to the video to be played, playing the stored video content, and if the stored video content does not find the video content corresponding to the video to be played, executing the step of replacing the image to be processed with the target image to obtain the video content comprising the target image.
10. A video content processing apparatus, comprising:
the pre-reading module is used for pre-reading video contents when the video is played;
the acquisition module is used for acquiring an image to be processed from the video content read in advance by the pre-reading module;
the replacing module is used for replacing the image to be processed acquired by the acquiring module with a target image to obtain video content comprising the target image;
and the playing module is used for playing the video content which is obtained by the replacing module and comprises the target image when the video content is played.
11. The video content processing apparatus according to claim 10, wherein the obtaining module comprises:
the preset unit is used for presetting an image recognition algorithm and a history processing image;
and the identification unit is used for identifying an image to be processed corresponding to the historical processing image in the pre-read video content according to the image identification algorithm and the historical processing image preset by the preset unit, wherein the historical processing image is an image subjected to image replacement processing in historical playing.
12. The video content processing apparatus according to claim 10, wherein the replacement module comprises:
the adjusting unit is used for reading a pre-stored target image and adjusting the target image to be the same as the width and the height of the image to be processed in the current frame of video content by utilizing an image processing technology;
and the replacing unit is used for deleting the image to be processed from the current frame of video content by utilizing an image processing technology according to the width and the height of the image to be processed and the position of the image to be processed in the current frame of video content, and adding the target image adjusted by the adjusting unit to the deleted position.
13. The video content processing apparatus according to claim 10, wherein the read-ahead module comprises:
the local pre-reading unit is used for pre-reading the video content downloaded to the local during video playing; or,
and the network pre-reading unit is used for pre-reading the video content which is being buffered and downloaded from the server during video playing.
14. The video content processing apparatus according to claim 10, wherein said apparatus further comprises:
and the gesture processing module is used for detecting image delineation operation in a video screen when the historical video is played, identifying the delineated image as a historical processing image and storing the historical processing image.
15. The video content processing apparatus according to any one of claims 10 to 14, wherein the apparatus further comprises:
the storage module is used for storing the video content of the target image which is replaced by the image to be processed;
the detection processing module is used for detecting whether video content corresponding to the video to be played exists in the video content stored in the storage module when the video is played next time, if the stored video content includes the video content corresponding to the video to be played, the stored video content is played by the playing module, and if the stored video content does not find the video content corresponding to the video to be played, the image to be processed is replaced by the target image by the replacing module, so that the video content including the target image is obtained.
16. A terminal device, comprising:
a processor and a memory for storing processor-executable instructions;
wherein the processor is configured to:
when the video is played, reading the video content in advance;
acquiring an image to be processed in the pre-read video content;
replacing the image to be processed with a target image to obtain video content comprising the target image;
and when the video content is played, playing the video content comprising the target image.
CN201510549853.5A 2015-08-31 2015-08-31 Video content processing method, device and apparatus Pending CN105163188A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510549853.5A CN105163188A (en) 2015-08-31 2015-08-31 Video content processing method, device and apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510549853.5A CN105163188A (en) 2015-08-31 2015-08-31 Video content processing method, device and apparatus

Publications (1)

Publication Number Publication Date
CN105163188A true CN105163188A (en) 2015-12-16

Family

ID=54803928

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510549853.5A Pending CN105163188A (en) 2015-08-31 2015-08-31 Video content processing method, device and apparatus

Country Status (1)

Country Link
CN (1) CN105163188A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105979383A (en) * 2016-06-03 2016-09-28 北京小米移动软件有限公司 Image acquisition method and device
CN108986117A (en) * 2018-07-18 2018-12-11 北京优酷科技有限公司 Video image segmentation method and device
CN109168028A (en) * 2018-11-06 2019-01-08 北京达佳互联信息技术有限公司 Video generation method, device, server and storage medium
CN110691261A (en) * 2019-09-30 2020-01-14 咪咕视讯科技有限公司 Multimedia data interaction method, communication device and computer readable storage medium
CN111770380A (en) * 2020-01-16 2020-10-13 北京沃东天骏信息技术有限公司 Video processing method and device

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030063223A1 (en) * 2001-10-03 2003-04-03 Ojo Olukayode Anthony Detecting static areas
CN101197945A (en) * 2007-12-26 2008-06-11 北京中星微电子有限公司 Method and device for generating special video effect
KR20090052737A (en) * 2007-11-21 2009-05-26 이현주 Apparatus and method for complexing image in visual communication terminal
US20100189175A1 (en) * 2009-01-26 2010-07-29 Panasonic Corporation Moving image processing device, moving image processing method and imaging apparatus
CN102196245A (en) * 2011-04-07 2011-09-21 北京中星微电子有限公司 Video play method and video play device based on character interaction
CN102609208A (en) * 2012-02-13 2012-07-25 广州市动景计算机科技有限公司 Method and system for word capture on screen of touch screen equipment, and touch screen equipment
US20130050395A1 (en) * 2011-08-29 2013-02-28 DigitalOptics Corporation Europe Limited Rich Mobile Video Conferencing Solution for No Light, Low Light and Uneven Light Conditions
JP2013179563A (en) * 2011-10-19 2013-09-09 Mitsubishi Electric Corp Video processing device, video display device, video recording device, video processing method, and video processing program
CN103634503A (en) * 2013-12-16 2014-03-12 苏州大学 Video manufacturing method based on face recognition and behavior recognition and video manufacturing method based on face recognition and behavior recognition
CN103873741A (en) * 2014-04-02 2014-06-18 北京奇艺世纪科技有限公司 Method and device for substituting area of interest in video
CN104092957A (en) * 2014-07-16 2014-10-08 浙江航天长峰科技发展有限公司 Method for generating screen video integrating image with voice
CN104427395A (en) * 2013-08-23 2015-03-18 三星电子株式会社 Electronic device and method for using captured image in electronic device

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030063223A1 (en) * 2001-10-03 2003-04-03 Ojo Olukayode Anthony Detecting static areas
KR20090052737A (en) * 2007-11-21 2009-05-26 이현주 Apparatus and method for complexing image in visual communication terminal
CN101197945A (en) * 2007-12-26 2008-06-11 北京中星微电子有限公司 Method and device for generating special video effect
US20100189175A1 (en) * 2009-01-26 2010-07-29 Panasonic Corporation Moving image processing device, moving image processing method and imaging apparatus
CN102196245A (en) * 2011-04-07 2011-09-21 北京中星微电子有限公司 Video play method and video play device based on character interaction
US20130050395A1 (en) * 2011-08-29 2013-02-28 DigitalOptics Corporation Europe Limited Rich Mobile Video Conferencing Solution for No Light, Low Light and Uneven Light Conditions
JP2013179563A (en) * 2011-10-19 2013-09-09 Mitsubishi Electric Corp Video processing device, video display device, video recording device, video processing method, and video processing program
CN102609208A (en) * 2012-02-13 2012-07-25 广州市动景计算机科技有限公司 Method and system for word capture on screen of touch screen equipment, and touch screen equipment
CN104427395A (en) * 2013-08-23 2015-03-18 三星电子株式会社 Electronic device and method for using captured image in electronic device
CN103634503A (en) * 2013-12-16 2014-03-12 苏州大学 Video manufacturing method based on face recognition and behavior recognition and video manufacturing method based on face recognition and behavior recognition
CN103873741A (en) * 2014-04-02 2014-06-18 北京奇艺世纪科技有限公司 Method and device for substituting area of interest in video
CN104092957A (en) * 2014-07-16 2014-10-08 浙江航天长峰科技发展有限公司 Method for generating screen video integrating image with voice

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105979383A (en) * 2016-06-03 2016-09-28 北京小米移动软件有限公司 Image acquisition method and device
CN105979383B (en) * 2016-06-03 2019-04-30 北京小米移动软件有限公司 Image acquiring method and device
CN108986117A (en) * 2018-07-18 2018-12-11 北京优酷科技有限公司 Video image segmentation method and device
CN108986117B (en) * 2018-07-18 2021-06-04 阿里巴巴(中国)有限公司 Video image segmentation method and device
CN109168028A (en) * 2018-11-06 2019-01-08 北京达佳互联信息技术有限公司 Video generation method, device, server and storage medium
CN110691261A (en) * 2019-09-30 2020-01-14 咪咕视讯科技有限公司 Multimedia data interaction method, communication device and computer readable storage medium
CN111770380A (en) * 2020-01-16 2020-10-13 北京沃东天骏信息技术有限公司 Video processing method and device

Similar Documents

Publication Publication Date Title
CN107454465B (en) Video playing progress display method and device and electronic equipment
CN109446994B (en) Gesture key point detection method and device, electronic equipment and storage medium
CN105845124B (en) Audio processing method and device
EP3327590A1 (en) Method and device for adjusting video playback position
CN108668080B (en) Method and device for prompting degree of dirt of lens and electronic equipment
CN107870712B (en) Screenshot processing method and device
CN104469437A (en) Advertisement pushing method and device
CN103914634A (en) Image encryption method, image encryption device and electronic device
CN106896991B (en) Method and device for updating information
CN105631803B (en) The method and apparatus of filter processing
CN109360197B (en) Image processing method and device, electronic equipment and storage medium
US9959487B2 (en) Method and device for adding font
CN111553372B (en) Training image recognition network, image recognition searching method and related device
EP3796317A1 (en) Video processing method, video playing method, devices and storage medium
CN105163188A (en) Video content processing method, device and apparatus
CN106409317B (en) Method and device for extracting dream speech
CN106559712A (en) Video playback processing method, device and terminal device
CN106354504B (en) Message display method and device
EP4068119A1 (en) Model training method and apparatus for information recommendation, electronic device and medium
CN106331328B (en) Information prompting method and device
CN112200040A (en) Occlusion image detection method, device and medium
CN110502648A (en) Recommended models acquisition methods and device for multimedia messages
CN108984098B (en) Information display control method and device based on social software
CN110399082A (en) A kind of terminal attribute control method, device, electronic equipment and medium
CN104902318B (en) Control method for playing back and terminal device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20151216