WO2022242577A1 - Video processing method and apparatus, and electronic device - Google Patents

Video processing method and apparatus, and electronic device Download PDF

Info

Publication number
WO2022242577A1
WO2022242577A1 PCT/CN2022/092837 CN2022092837W WO2022242577A1 WO 2022242577 A1 WO2022242577 A1 WO 2022242577A1 CN 2022092837 W CN2022092837 W CN 2022092837W WO 2022242577 A1 WO2022242577 A1 WO 2022242577A1
Authority
WO
WIPO (PCT)
Prior art keywords
target
target video
video
input
user
Prior art date
Application number
PCT/CN2022/092837
Other languages
French (fr)
Chinese (zh)
Inventor
杭宇
Original Assignee
维沃移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 维沃移动通信有限公司 filed Critical 维沃移动通信有限公司
Publication of WO2022242577A1 publication Critical patent/WO2022242577A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/04Real-time or near real-time messaging, e.g. instant messaging [IM]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/06Message adaptation to terminal or network requirements
    • H04L51/063Content adaptation, e.g. replacement of unsuitable content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/07User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail characterised by the inclusion of specific contents
    • H04L51/10Multimedia information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44008Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting

Definitions

  • the present application belongs to the field of video technology, and in particular relates to a video processing method, device and electronic equipment.
  • the purpose of the embodiments of the present application is to provide a video processing method, device, and electronic device, which can solve the problem in the prior art that the process of determining a video of interest to a user is cumbersome and time-consuming.
  • the embodiment of the present application provides a video processing method, the method comprising:
  • a first identification is displayed, and the first identification is used to indicate that the target video includes the second object.
  • an embodiment of the present application provides a video processing device, which includes:
  • the receiving module is used to receive the target video sent by the target chat object
  • the first display module is configured to display a first mark when the first object in the target video matches a preset second object, and the first mark is used to indicate that the target video includes the second object.
  • the embodiment of the present application provides an electronic device, the electronic device includes a processor, a memory, and a program or instruction stored in the memory and operable on the processor.
  • the program or instruction is executed by the processor, the The steps of the method of the first aspect.
  • the embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method in the first aspect are implemented.
  • the embodiment of the present application provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the method in the first aspect.
  • the target video sent by the target chat object is received, and when the first object in the target video matches the preset second object, a first logo is displayed, and the first logo is used to indicate the target video Include the second object.
  • the first logo can be displayed on the target video including the second object, which helps the user to efficiently acquire videos with interesting content.
  • FIG. 1 is a schematic flow diagram of a video processing method provided in an embodiment of the present application
  • Fig. 2 is one of the example diagrams of the conversational interface in the embodiment of the present application.
  • Fig. 3 is the second example diagram of the conversation interface in the embodiment of the present application.
  • Fig. 4 is the third example diagram of the conversation interface in the embodiment of the present application.
  • Fig. 5 is one of the example diagrams of the target window in the embodiment of the present application.
  • Fig. 6 is the second example diagram of the target window in the embodiment of the present application.
  • Fig. 7 is the third example diagram of the target window in the embodiment of the present application.
  • Figure 8 is one of the example diagrams of the setting interface in the embodiment of the present application.
  • Figure 9 is the second example diagram of the setting interface in the embodiment of this application.
  • Figure 10 is the third example diagram of the setting interface in the embodiment of this application.
  • Figure 11 is the fourth example diagram of the setting interface in the embodiment of this application.
  • Figure 12 is the fifth example diagram of the setting interface in the embodiment of this application.
  • FIG. 13 is a schematic flowchart of a video processing method provided in an embodiment of the present application in a specific application example
  • FIG. 14 is a schematic structural diagram of a video processing device provided by an embodiment of the present application.
  • Fig. 15 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
  • FIG. 16 is a schematic diagram of a hardware structure of an electronic device provided by an embodiment of the present application.
  • the video processing method provided by the embodiment of the present application includes:
  • Step 101 receiving the target video sent by the target chat partner
  • Step 102 In the case that the first object in the target video matches the preset second object, display a first mark, where the first mark is used to indicate that the target video includes the second object.
  • the logos in this application are used to indicate text, symbols, images, etc. of information, and controls or other containers may be used as carriers for displaying information, including but not limited to text logos, symbol logos, and image logos.
  • the video processing method provided in the embodiment of the present application may be applied to an electronic device, and the electronic device may be a personal computer or a mobile terminal, etc., and is not specifically limited here.
  • the video sent by the server or other types of terminal devices can be received through these application programs.
  • the target video received in the above step 101 may be a video received by the electronic device from other terminal devices.
  • chat groups there may be chat groups.
  • a video sent by user A in the chat group will be received by other users of the chat group.
  • user A can be considered as the above-mentioned target chat partner.
  • User B may be another user in the chat group. After user B receives the video sent by user A through the electronic device, it may be difficult for user B to directly know whether there is content of interest in the video, such as interested persons or items etc. Usually, user B needs to click to play the video after entering the corresponding conversation interface, so as to confirm whether the video contains the content he is interested in.
  • user A may send multiple videos, and only a part of the multiple videos may include the content that user B is interested in. From the perspective of user B, after receiving these multiple videos through the electronic device, he may enter the conversation interface and click to play these multiple videos one by one to determine the video that includes the content he is interested in.
  • the target chat object of sending the target video may not only be a user, but also a robot customer service and the like.
  • the robot customer service can send a video to the electronic device according to the keywords sent by the user of the electronic device.
  • the robot customer service can regularly send videos to the electronic device according to the historical viewing records of the user of the electronic device or the preset interest tags.
  • the user may need to click to play the multiple videos one by one to determine the video that includes the content of interest.
  • the preset second object may correspond to the content that the user of the electronic device is interested in.
  • the second object may be an object preset by the user, or may also be an object automatically determined by the electronic device according to historical operation data of the user.
  • the second object may be a character, an animal, or an object, which is not specifically limited here.
  • the second object may be a target person.
  • the user may select an image or video taken of the target person as a material and add it to the material library.
  • the electronic device can identify the second object in these materials based on a machine learning algorithm.
  • the second object may also be an animal such as a dog or a cat, or an object such as a house or a vehicle.
  • an animal such as a dog or a cat
  • an object such as a house or a vehicle.
  • the target video generally also includes the first object, such as a person or an object.
  • the first object in the target video may also be obtained by identifying the target video through a machine learning algorithm.
  • the video processing method provided by the embodiment of the present application will be described below mainly by taking the first object and the second object both as characters as an example.
  • user B can set himself as the second object. From the perspective of the electronic device, after receiving the user B's selection input of the image including his own face under the condition that the relevant setting interface is displayed, the image selected by the user can be recognized to determine the second object.
  • the electronic device used by user B can identify the image frames in the target video to obtain the first object.
  • the first object can also be a human face.
  • it can be considered that the first object in the target video matches the preset second object.
  • the selected features for determining whether the first object matches the second object may be not only human face features, but also body features, etc., which are not specifically limited here.
  • the identification process of the image frame in the target video by the electronic device may be performed in the background. For example, when a conversation interface is displayed on the electronic device, the target video received on the conversation interface may be buffered, and the target video may be played in the background to identify image frames in the target video to obtain the first object.
  • the electronic device may also cache the target video and identify the image frame after receiving the target video through the above-mentioned social application program. That is to say, the first object in the target video can still be acquired when the conversation interface of the chat group is not displayed.
  • the electronic device may also acquire the first object in the target video when the user clicks to play the target video.
  • the timing for the electronic device to acquire the first object in the target video is not specifically limited here.
  • a first identification may be displayed, and the first identification is used to indicate that the target video is a video matching the second object.
  • a conversation interface is displayed on the electronic device
  • a first logo may be displayed at a position corresponding to the thumbnail of the target video.
  • the first identification may be a text identification, for example, the content of the first identification may be "@userB", "videos you may be interested in”, and so on.
  • the first mark may also be a picture mark or an icon mark, etc., which are not specifically limited here.
  • the first identifier may be a preset floating control, such as a floating ball or a floating icon. That is to say, if the first object in the target video matches the preset second object, the electronic device may display a floating control in a preset area to prompt that a video including the second object has been received.
  • step 102 the user may be prompted that the video including the second object has been received by displaying the first logo.
  • the specific display position of the thumbnail of the target video in the current display interface may be indicated by the first identifier.
  • the video processing method provided by the embodiment of the present application receives the target video sent by the target chat object, and displays the first identification when the first object in the target video matches the preset second object, and the first identification is used for Indicating that the target video includes a second object.
  • the first logo can be displayed on the target video including the second object, which helps the user to efficiently acquire videos with interesting content.
  • the target chat object is an object in the target chat group
  • the video processing method may further include:
  • the target chat object may be a video sent in the chat group.
  • the target chat object may be an object in a chat group.
  • the target chat object is an object in the target chat group, and the target chat object sends the target video in the target chat group.
  • user B may be interested in multiple contents, and user B may be interested in person X and person Y (both may correspond to the second object) at the same time.
  • the video including person X and the video including person Y may usually be received in different chat groups.
  • a chat group and a second object can be pre-established relationship between.
  • the target video may be a video sent to a target chat group, and the target chat group may be associated with a corresponding second object.
  • the user can associate character X with the chat group HX, and associate character Y with the chat group HY by inputting on the electronic device.
  • the electronic device may determine the person X as the second object associated with the target chat group.
  • association relationship between the chat group and the second object can be regarded as the association relationship between different chat groups and the second object in a social application. In practical applications, it may also be an association relationship established between the application program and the second object.
  • the application program to which the target chat group belongs can be determined, and the target chat group can be determined according to the preset association relationship between the application program and the second object The second object associated with the group.
  • the character X can be associated with the application program AX, and the character Y can be associated with the application program AY.
  • the character X can be determined as the second object associated with the target chat group.
  • the second object associated with the target chat group may be used to perform a similarity comparison on the first object in the target video.
  • both the first object and the second object can be people, and comparing the similarity between the first object and the second object can be to compare the facial features and other contents of the two to obtain the similarity between the two. Spend.
  • the similarity can also be regarded as the probability of identifying the first object as the second object.
  • the second object may be the preset animal "dog”
  • the similarity comparison result between the first object and the second object may be the probability of identifying the first object as "dog”. corresponds to the above similarity.
  • the similarity between the first object and the second object is greater than the similarity threshold, it may be determined that the first object matches the second object.
  • the similarity threshold may be preset, and the specific value is 90%. When the similarity between the first object and the second object is greater than 90%, it may be determined that the first object matches the second object.
  • the electronic device may omit the process of using the second object not associated with the target chat group to compare the similarity of the first object in the target video.
  • the second object associated with the target chat group in the case of receiving the target video sent to the target chat group, the second object associated with the target chat group can be obtained, and the second object associated with the target chat group can be combined with The similarity comparison is performed on the first object in the target video, which can effectively reduce the consumption of computing resources brought about by the similarity comparison process.
  • the association relationship between the chat group and the second object may specifically be associated with the second object through group information of the chat group.
  • the group information of the chat group may be the name of the chat group or the number corresponding to the chat group.
  • the chat group name can be associated with the second object.
  • the associated second object can be determined according to the chat group name of the target chat group.
  • the following describes the display manner of the first logo with an example.
  • FIG. 2 is an example diagram of a conversation interface of a target chat group.
  • multiple video thumbnails (marked as VP1 in the figure) may be displayed, and these videos may be sent to the target chat group by user A (corresponding to the target chat object).
  • target videos including the second object can be obtained.
  • FIG. 3 is an example diagram of displaying the first identifier for the target video including the second object in the conversation interface of the target chat group.
  • the first logo can be displayed on the side of the thumbnail of the target video (marked as VP2 in the figure), and specifically displayed as the text of "@UserB" (marked as T1 in the figure).
  • the first logo can be displayed in the form of pop-up windows or floating windows, and preset prompt texts can be displayed in these pop-up windows or floating windows.
  • the user can quickly learn which specific videos contain content of interest to him/herself, without having to click and play each video one by one, which effectively saves user operation time and improves user experience.
  • the mark displayed on the target video including the second object in the target chat group may not be limited to the above-mentioned first identifier.
  • FIG. 4 is an example diagram of displaying a second mark on a target video including a second object in a conversation interface of a target chat group.
  • the second mark may be displayed on the side of the thumbnail of the target video, and specifically displayed as words "90%" and "50%" (marked as T2 in the figure). Wherein, these words may be used to indicate the matching degree between the first object and the second object in the target video.
  • the video processing method may further include:
  • the matching degree is used to indicate the similarity between the first object and the second object, or the matching degree is used to indicate the target image frame in the target video ratio, the target image frame is an image frame including the first object, and the similarity between the first object and the second object is greater than the similarity threshold;
  • a second identification is displayed, and the second identification is used to indicate the matching degree between the first object and the second object in the target video.
  • the similarity between the first object and the second object may be the similarity of facial features, etc.
  • the similarity can be obtained through a preset face recognition model.
  • the second object may also be a generic animal or item.
  • the second object may be an animal dog
  • the similarity between the first object and the second object may also be the probability that the first object is an animal dog obtained by identifying the image frame of the target video by a corresponding recognition model.
  • the above similarity can be directly used as the matching degree between the target video and the second object.
  • the degree of matching between the first object in the target video and the preset second object may also be determined by the proportion of the target image frame in the target video.
  • the target image frame may be an image frame including a first object, and the similarity between the first object and the second object is greater than a similarity threshold.
  • the second object may be person X.
  • the similarity between the person and person X is greater than a similarity threshold, it can be considered that the image frame includes person X.
  • the target video has 100 image frames, and the person X is included in 60 image frames, then these 60 image frames correspond to the aforementioned target image frames.
  • the proportion of the target image frame in the target video is 60%.
  • the matching degree between the target video and the second object is 60%.
  • the matching degree between the first object and the second object can be obtained by combining the above similarity degree and the proportion of the target image frame.
  • the above similarity and the ratio of the image frame may be weighted and averaged to obtain the matching degree between the first object and the second object.
  • a second logo can be displayed at a position matching its thumbnail.
  • the second identification may include a percentage, which may indicate how well the first object matches the second object.
  • the second identifier may also include decimals or scores, and may indicate the degree of matching between the first object and the second object.
  • the matching degree between the first object and the second object can be determined according to the similarity between the first object and the second object, or according to the proportion of the target image frame in the target video, and can be used to indicate the
  • the second identification method of the matching degree reminds the user of the matching degree, which helps the user to quickly locate the video of interest, and provides the user with a basis for selecting the video that can be watched first, and improves the user experience.
  • the target chat object after receiving the target video sent by the target chat object, there may be a process of displaying the first identification and displaying the second identification.
  • the specific display timings of these two kinds of marks may be the same or different.
  • the current display interface of the electronic device is the main interface of the social application program
  • the target video is received and the first object in the target video matches the preset second object
  • the The first logo is displayed on the main interface, and the first logo may be located near the image logo of the target chat group.
  • the conversation interface of the target chat group is displayed in response to the user's input, the second identifier may be displayed on the conversation interface.
  • the first identification and the second identification may be simultaneously displayed for the target video in the conversation interface of the target chat group.
  • the electronic device when the electronic device matches a target video that includes the content that the user is interested in, it can display the first logo for the target video, and/or display the second logo for indicating the matching degree, which can be Effectively remind the user to reduce the user's retrieval time for the target video.
  • first logo or second logo may not affect the user's viewing of other unmarked videos.
  • the electronic device may receive the target video without displaying the target chat group.
  • the electronic device displays a target chat group, it is difficult to simultaneously display thumbnails of all target videos when the number of received target videos is large, or the intervals between multiple received target videos are large.
  • the video processing method further Can include:
  • a target window is displayed, and the target window includes a thumbnail of the target video.
  • FIG. 5 is an example diagram of displaying a target window (marked as W in the figure) in an electronic device.
  • the target window may be a floating window.
  • the electronic device when the electronic device receives the target video, it may cache the target video, play the target video in the background, identify the first object in the target video, and match the first object with the second object. All the above-mentioned processing procedures can be performed in the background, and the target window can be displayed when the first object in the target video matches the second object.
  • the above-mentioned target window may be displayed on the desktop, or may be displayed on the running interface of the application program, or may also be displayed on the conversation interface of the target chat group.
  • the target window may include a thumbnail of the target video (labeled WP in the figure).
  • the electronic device can prompt the user to receive a video that may be of interest to the user, which helps to improve the timeliness of the prompting process.
  • the thumbnail image of the target video includes a third identifier, and the third identifier is used to indicate a degree of matching between the first object and the second object in the target video.
  • the matching degree between the first object and the second object in the target video may be indicated by a third identifier.
  • the manner of determining the matching degree between the first object and the second object in the target video is described in the above embodiments, and will not be repeated here.
  • the above-mentioned third identification (marked as WT in the figure) can be displayed in the upper left corner of the thumbnail of the target video, where the matching degree can be specifically displayed, such as "90%", "50%” etc.
  • the third mark can also be located in other positions in the thumbnail image, which can be set according to actual needs, and it only needs to be able to reflect the matching degree between the first object and the second object in the target video.
  • the thumbnail of the target video includes a third identifier, which helps the user quickly determine the target video of interest from the target window, and provides a reference for the user to select a target video for priority playback.
  • the number of received videos may be multiple, and the number of target videos including the first object matched with the second object may also be multiple.
  • the thumbnails of each target video can be sorted and displayed in the target window according to the degree of matching between the first object and the second object in each target video .
  • the thumbnails of each target video may be sequentially displayed in descending order of the matching degrees between the first object and the second object in each target video. In this way, the user can preferentially watch the target video containing more interesting content according to the order of the thumbnails of each target video.
  • the thumbnails of each target video may respectively include corresponding third identifiers.
  • the electronic device may receive user input on the thumbnail to operate on the corresponding target video.
  • the video processing method further includes at least one of the following:
  • the target video is deleted in response to the fourth input.
  • the first input may correspond to the user's click input on the thumbnail of the target video, and when the electronic device receives the user's click input on the thumbnail of the target video, in response to the click input, Play the target video.
  • the second input may correspond to the user's double-click input on the thumbnail of the target video, and accordingly, the electronic device may store the target video when the double-click input is received.
  • the third input may correspond to the user's long press input on the thumbnail of the target video, and accordingly, in the case of receiving the long press input, the electronic device may forward the target video.
  • the electronic device may forward the target video.
  • icons of applications that can be used to forward the target video may be displayed.
  • the fourth input may correspond to the user's dragging input of the target video along a preset path.
  • the user can drag the thumbnail of the target video to the outer area of the target window, and the electronic device can respond to the user's drag output, delete the target video from the memory used for caching files, and display it clearly in the target window.
  • the thumbnail of the target video As a feasible implementation manner, after all thumbnails of the target video in the target window are deleted, the target window can be hidden.
  • two operation controls whose names are respectively "store” and “forward” may also be displayed, and when a click input from the user on the operation control is received, , and further perform corresponding processing on the target video.
  • displaying the target window when the first object in the target video matches the preset second object above may specifically include:
  • the target window is displayed in response to the input.
  • a target operation control may be displayed when a target video of interest to the user is received.
  • the target operation control can be a floating button, and the floating button can occupy a small display area, so as to avoid too much blocking of the current display content of the electronic device.
  • the target window can be further loaded, and the image of the target video can be displayed in the target window. thumbnail.
  • the first object in the target video is obtained by using a preset recognition model to identify the target video;
  • the video processing method may further include:
  • the target video is used as a training sample to train the recognition model
  • the fifth input is used for storing or forwarding the target video.
  • the first object in the target video when the first object in the target video is a person, the first object may be obtained by recognizing an image frame in the target video through a face recognition model. Similarly, when the first object is an animal or an object, the first object can also be identified from the target video by using a recognition model trained with relevant samples.
  • the corresponding training samples may be marked images or videos.
  • the quality of training samples is generally affected by the accuracy of labeling.
  • the target video can be regarded as an unlabeled video to a certain extent, and after the target video is input into the recognition model, a corresponding recognition result can be obtained.
  • the recognition result may indicate whether the first object in the target video matches the second object.
  • the target video can be used as a positive sample for optimal training of the recognition model.
  • Whether the recognition result is correct can be reflected by the user's operation on the target video. For example, in the case where the first logo is displayed for a certain target video, if the forwarding or storing operation of the target video by the user is received, it is considered that the user is indeed interested in the target video, that is, the recognition model is The recognition result of the target video can be considered correct.
  • the fifth input to the target video may correspond to the above-mentioned input for storing or forwarding the target video, and there is no specific limitation here.
  • the fifth input can be considered as the user's positive operation on the target video.
  • the target video can be used as a positive sample to train the recognition model, thereby helping to improve the recognition accuracy of the recognition model.
  • the video processing method may further include:
  • the setting interface includes P file identifiers, one file identifier indicates an image file, and P is a positive integer;
  • image files such as pictures or videos may be pre-stored in the electronic device.
  • these image files may be obtained by shooting the second object through a camera, or may also be pictures or videos including the second object sent by other terminals.
  • P file identifiers may be displayed, and the P file identifiers may correspond to P image files.
  • the thumbnails of multiple image files may be displayed in a matrix manner, and the user may drag the interface up and down to switch and display the thumbnails of the image files.
  • the image identifier of an image file may also be displayed separately, such as a video screenshot, and the user may drag the interface left and right to switch and display the image identifier of the image file.
  • thumbnails or image identifiers can all be considered as file identifiers of image files.
  • the user can make optional input.
  • the user can click on the file identifier to select the file identifier; or, the user can also drag the file identifier to a preset display area to select the file identifier.
  • the selection and input of the file identifiers may not be limited to the methods in the above examples, and specific input methods may be set according to actual needs, which will not be listed here.
  • the selection operation of the file identifier can be regarded as the selection operation of the image file associated with the file identifier.
  • the electronic device can identify the selected image files, that is, the Q image files indicated by the above Q file identifiers, to obtain the second object.
  • the number of second objects obtained by identifying the above Q image files may be one or multiple.
  • the recognized second object may include person X and person Y at the same time.
  • a floating ball called "Material Library” (marked as F in the figure) can be displayed on the interface.
  • a material library interface may be displayed, and in the material library interface, existing materials for obtaining the second object, such as pictures or videos, may be included.
  • users can swipe left and right to switch and view existing materials.
  • FIG. 8 is an example diagram of the material library interface.
  • the material library interface may also include a button control named "Upload” (marked as B1 in the figure).
  • B1 button control
  • thumbnails of pictures or videos in the album may be displayed in a preset display area (marked as R in the figure).
  • the material library interface at this time can be regarded as the above-mentioned setting interface.
  • the material library interface may also include a button control named "Binding" (marked as B2 in the figure). After the user selects the thumbnail of the picture or video in the album, he can further click the "Bind” button control to add the picture or video corresponding to the selected thumbnail to the material library.
  • the materials in the material library can also be used for recognition to obtain the second object.
  • the preset association relationship may be obtained by setting in a related setting interface.
  • the video processing method before the above step 101, before receiving the target video sent by the target chat partner, the video processing method may further include:
  • the display setting interface includes P file identifications in the setting interface, and a file identification indicates an image file, and P is a positive integer;
  • At least one candidate chat group option is displayed, where Q is a positive integer less than or equal to P;
  • the second object in the Q image files is stored in association with the target chat group corresponding to the target chat group option.
  • the electronic device may display at least one candidate chat group option, and the candidate chat group option may include group information of the candidate chat group.
  • the candidate chat group may be an existing chat group in a social application.
  • group information such as a chat group name, a chat group image identifier, or a corresponding number of the chat group.
  • the above-mentioned candidate chat group options may be specifically displayed as the chat group name, chat group image logo or number, etc. of the candidate chat group, which may not be specifically limited here.
  • a pop-up window may be displayed, or a selection page may be switched and displayed.
  • candidate chat groups such as "X school class one discussion group”, "Y company meeting group” and "Z family life group” can be displayed in the pop-up window
  • the name of the chat group or further display the chat group image logo formed by the combination of group member image thumbnails in front of each chat group name.
  • chat group names or chat group image identifiers may correspond to the aforementioned candidate chat group options.
  • the user can click and input the name of the chat group of "discussion group of class 1 of X school".
  • the user's click input of the chat group name "X School Class 1 Discussion Group” can be regarded as the selection input of the target chat group option.
  • the electronic device can identify the Q image files indicated by the Q file identifiers, and obtain the second object therein.
  • the specific manner of identifying the image file to obtain the second object has been described in detail in the above embodiments, and will not be repeated here.
  • the electronic device may associate and store the second object in the Q image files and the target chat group corresponding to the target chat group option.
  • the electronic device identifies Q image files selected by the user to obtain a second object, and associates and stores the second object with the "discussion group of Class 1 of X school".
  • the electronic device receives the target video sent to the chat group corresponding to "X School Class One Discussion Group"
  • the electronic device can identify the first object in the target video; Content, determining the second object associated with the "discussion group of Class 1 of X school”; and displaying the first identifier when the first object matches the second object.
  • the display setting interface in the case of receiving the user's selection input of Q file identifiers, displays at least one candidate chat group option;
  • the selection input of the group option identifies the second object in the Q image files indicated by the Q file identifiers, and associates and stores the second object with the target chat group corresponding to the target chat group option.
  • the user may need to perform more input processes.
  • the electronic device may switch to display the application selection interface as shown in FIG. 10 .
  • icons of multiple application programs and their application names may be displayed.
  • the application names may be "Application A”, “Application B”, and "Application C”.
  • a function selection interface as shown in FIG. 11 may be further displayed.
  • options such as “select group”, “share to Moments”, and “favorite” may be included.
  • the user can associate corresponding second objects with different groups in different application programs; on the other hand, it can also satisfy the user's different usage needs for the selected image files.
  • the first setting interface used to display the above P file identifiers as the first setting interface.
  • the first setting interface also includes a first operation control;
  • the video processing method may further include:
  • a second setting interface In the case of receiving the sixth input to the first operation control, in response to the sixth input, a second setting interface is displayed, the second setting interface includes the group information of the target chat group, the information associated with the target chat group A file identification of the image file and at least one second operation control;
  • the first operation control may correspond to a button control named "association” (marked as B3 in the figure).
  • association a button control named "association" (marked as B3 in the figure).
  • FIG. 12 can be regarded as an example diagram of the second setting interface.
  • group information of the target chat group can be displayed.
  • the target chat group may refer to the chat group associated with the second object.
  • the association relationship between the target chat group and the second object may be embodied as the association relationship between the group information of the target chat group and the second object.
  • the group information of the target chat group may include the chat group name (marked as TN in the figure) and chat group image identification (marked as TP in the figure) .
  • the chat group name may be "group 1", “group 2" and “group 3" and so on; and the chat group image logo may be a group avatar of the chat group.
  • the second object can be obtained by identifying the selected image file.
  • the target chat group is also associated with the image file.
  • the file identifier (marked as RP in the figure) of the image file associated with the target chat group may be displayed under the group information of the target chat group.
  • the file identifier may be a thumbnail of an image file or the like.
  • At least one second operation control (marked as K in the figure) may be associated and displayed.
  • the second operation control includes an operation control named "Modify” and an operation control named "Delete”.
  • "group 1" is associated with an image file A.
  • the thumbnails of P image files, or the thumbnails of the materials in the above-mentioned material library can be displayed for the user to select .
  • the association between image file A and "group 1" can be canceled, and the association between image file B and "group 1" can be established.
  • the video processing method may include:
  • Step 1301 establishing an association between the material for matching the video and the social software group
  • the video here may refer to a video received through social software.
  • the materials used for video matching can be videos or pictures selected by the user on the setting interface, and these selected videos or pictures can be uploaded to a preset material library.
  • these materials can establish specified relationships with specific social software groups. For example, in practical applications, through the setting of the specified relationship, it is possible to match person A to a video sent to one group, and match person B to a video sent to another group, and so on.
  • Step 1302 the group receives video resources, and checks whether there is a material database resource matching; if yes, execute step 1303; if not, end;
  • a video resource may include a first object such as a character or an item, and similarly, a material library resource may also include a second object such as a character or an item.
  • Step 1303 perform intelligent matching according to the uploaded material, and the matched content can remind the user;
  • a first identifier is displayed, and the first identifier may be in the form of "@user” or in the form of a matching degree value.
  • Step 1304 automatically cache the extracted video into the floating ball, and sort according to certain rules
  • the target video when it is determined that the target video is a video matched by the second object, the target video may be cached, and a thumbnail of the target video may be displayed in the floating ball, or after receiving an input to the floating ball , loads a window to display the thumbnail of the target video.
  • the thumbnails of the target videos may be sorted and displayed according to the matching relationship, so that the user can find the target with a high degree of interest more quickly video.
  • thumbnails of the target videos may also be sorted and displayed according to rules such as the time sequence in which the target videos are received.
  • Step 1305 judging whether the user has performed positive operations such as saving and forwarding the video in the floating ball, if so, go to step 1306; if not, go to step 1307;
  • the user inputs the thumbnail of the video in the floating ball, which can cause the electronic device to perform corresponding processing on the corresponding video resource.
  • a user may long press a thumbnail of a video, and in response to the user's long press input, a control for saving the video and a control for forwarding the video may be displayed. After receiving the user's input on these controls, the video can be saved and forwarded accordingly.
  • Saving and forwarding the video can be considered as a positive operation of the user. To a certain extent, it can be considered that the user is really interested in the video in the floating ball. Conversely, the user may also perform deletion operations on the video, and these operations may correspond to reverse operations of the user.
  • Step 1306 in response to the forward operation, perform operations such as saving or forwarding the video, and at the same time release the cache resources occupied by the video in the floating ball.
  • Step 1307 in response to the delete operation, the video is discarded, and the cache resources occupied by the video in the floating ball are released.
  • the electronic device when the user uploads material resources, the electronic device can automatically perform video resource matching algorithm tasks in the background.
  • the matched video reminds the user, allowing the user to choose a reference.
  • the matched video can be cached in the floating team queue, which is convenient for users to perform quick operations. Users can quickly save, forward and other operations to save users time and allow users to focus more on the content they care about. In terms of presentation, users can be notified not only of the most relevant matching matches, but also tell users a matching priority level through the matching degree ratio, give users more detailed reference opinions, and make user decisions more accurate. It is more informative.
  • the video processing method provided in the embodiment of the present application may be executed by a video processing device, or a control module in the video processing device for executing the video processing method.
  • the video processing device provided in the embodiment of the present application is described by taking the video processing device executing the video processing method as an example.
  • the video processing device 1400 provided in the embodiment of the present application includes:
  • the receiving module 1401 is used to receive the target video sent by the target chat object
  • the first display module 1402 is configured to display a first identification when the first object in the target video matches a preset second object, and the first identification is used to indicate that the target video includes the second object.
  • the target chat object is an object in the target chat group
  • the video processing device 1400 may also include:
  • the first obtaining module is used to obtain a preset second object associated with the target chat group
  • a comparison module configured to compare the similarity between the first object and the second object
  • a determining module configured to determine that the first object matches the second object when the similarity between the first object and the second object is greater than a similarity threshold.
  • the video processing device 1400 may also include:
  • the second obtaining module is used to obtain the matching degree between the first object in the target video and the preset second object; wherein, the matching degree is used to indicate the similarity between the first object and the second object, or the matching degree is used for Indicate the proportion of the target image frame in the target video, where the target image frame is an image frame including a first object, and the similarity between the first object and the second object is greater than a similarity threshold;
  • the second display module is configured to display a second identification, and the second identification is used to indicate the matching degree between the first object and the second object in the target video.
  • the video processing device 1400 may also include:
  • the third display module is configured to display a target window when the first object in the target video matches the preset second object, and the target window includes a thumbnail of the target video.
  • the thumbnail of the target video includes a third identifier, and the third identifier is used to indicate a matching degree between the first object and the second object in the target video.
  • the first object in the target video is obtained by using a preset recognition model to identify the target video;
  • the video processing device 1400 may further include at least one of the following:
  • Playing module for receiving the user's first input to the thumbnail of the target video in the target window, in response to the first input, play the target video
  • the first storage module is used to store the target video in response to the second input in the case of receiving the second input of the user to the thumbnail of the target video in the target window;
  • the forwarding module is used to forward the target video in response to the third input in response to the third input of the thumbnail of the target video in the target window when the user is received;
  • a deletion module configured to delete the target video in response to the fourth input in response to the fourth input from the user on the thumbnail of the target video in the target window.
  • the first object in the target video is obtained by using a preset recognition model to identify the target video;
  • the video processing device 1400 may also include:
  • the training module is used to train the recognition model by using the target video as a training sample in response to the fifth input when receiving the fifth input from the user to the target video;
  • the fifth input is used for storing or forwarding the target video.
  • the video processing device 1400 may also include:
  • the fourth display module is used to display the setting interface, the setting interface includes P file identifiers, one file identifier indicates an image file, and P is a positive integer;
  • the fifth display module is used to display at least one candidate chat group option when receiving the user's selection input of Q file identifiers, where Q is a positive integer less than or equal to P;
  • the identification module is used to identify the second object in the Q image files indicated by the Q file identifiers when receiving the user's selection input of the target chat group option in at least one candidate chat group option;
  • the second storage module is used for associating and storing the second object in the Q image files and the target chat group corresponding to the target chat group option.
  • the video processing device receives the target video sent by the target chat object, and displays a message indicating that the target video includes the second object in the case of the first object in the target video and the preset second object.
  • the first logo helps users to quickly find the video they are interested in.
  • a second identification for indicating the matching degree between the first object and the second object in the target video may also be displayed, which is for the user Provide a basis for selecting the target video for priority viewing. Through the target window, the thumbnail of the target video is displayed, which can facilitate the user to perform quick operations on the target video, and effectively improve the user experience.
  • the video processing device in this embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal.
  • the device may be a mobile electronic device or a non-mobile electronic device.
  • the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a handheld computer, a vehicle electronic device, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant).
  • non-mobile electronic devices can be servers, network attached storage (Network Attached Storage, NAS), personal computer (personal computer, PC), television (television, TV), teller machine or self-service machine, etc., this application Examples are not specifically limited.
  • Network Attached Storage NAS
  • personal computer personal computer, PC
  • television television
  • teller machine or self-service machine etc.
  • the video processing device in this embodiment of the present application may be a device with an operating system.
  • the operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in this embodiment of the present application.
  • the video processing device provided in the embodiment of the present application can implement various processes implemented by the method embodiments in FIG. 1 to FIG. 13 , and details are not repeated here to avoid repetition.
  • the embodiment of the present application also provides an electronic device, which is used to execute each process of the above video processing method embodiment, and can achieve the same technical effect. To avoid repetition, details are not repeated here.
  • the embodiment of the present application also provides an electronic device 1500, including a processor 1501, a memory 1502, and a program or instruction stored in the memory 1502 and operable on the processor 1501.
  • the program Or, when the instruction is executed by the processor 1501, each process of the above-mentioned video processing method embodiment can be realized, and the same technical effect can be achieved. To avoid repetition, details are not repeated here.
  • the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.
  • FIG. 16 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
  • the electronic device 1600 includes, but is not limited to: a radio frequency unit 1601, a network module 1602, an audio output unit 1603, an input unit 1604, a sensor 1605, a display unit 1606, a user input unit 1607, an interface unit 1608, a memory 1609, and a processor 1610, etc. part.
  • the electronic device 1600 can also include a power supply (such as a battery) for supplying power to various components, and the power supply can be logically connected to the processor 1610 through the power management system, so that the management of charging, discharging, and function can be realized through the power management system. Consumption management and other functions.
  • a power supply such as a battery
  • the structure of the electronic device shown in FIG. 16 does not constitute a limitation to the electronic device.
  • the electronic device may include more or fewer components than shown in the figure, or combine some components, or arrange different components, which will not be repeated here. .
  • the radio frequency unit 1601 is used to receive the target video sent by the target chat object
  • the display unit 1606 is configured to display a first identification when the first object in the target video matches a preset second object, where the first identification is used to indicate that the target video includes the second object.
  • the electronic device receives the target video sent by the target chat object, and displays the second object that can be used to indicate that the target video includes the second object when the first object in the target video matches the preset second object.
  • a logo In this embodiment of the present application, the second object may be the content of interest preset by the user. By displaying the first logo on the target video that matches the second object, it is helpful for the user to efficiently obtain the video with the content of interest.
  • the target chat object is an object in the target chat group
  • the processor 1610 may be configured to acquire a preset second object associated with the target chat group
  • the processor 1610 may be configured to acquire a degree of matching between the first object in the target video and a preset second object; wherein, the degree of matching is used to indicate the degree of similarity between the first object and the second object, or, the degree of matching The degree is used to indicate the proportion of the target image frame in the target video, the target image frame is an image frame including the first object, and the similarity between the first object and the second object is greater than the similarity threshold;
  • the display unit 1606 may be configured to display a second identifier, where the second identifier is used to indicate a matching degree between the first object and the second object in the target video.
  • the display unit 1606 may also be configured to display a target window when the first object in the target video matches a preset second object, and the target window includes a thumbnail of the target video. .
  • the thumbnail of the target video includes a third identifier, and the third identifier is used to indicate a matching degree between the first object and the second object in the target video.
  • the processor 1610 may be used for at least one of the following:
  • the target video is deleted in response to the fourth input.
  • the first object in the target video is obtained by using a preset recognition model to identify the target video;
  • the processor 1610 may be configured to, in the case of receiving a fifth input from the user on the target video, respond to the fifth input, and use the target video as a training sample to train the recognition model;
  • the fifth input is used for storing or forwarding the target video.
  • the display unit 1606 is also used to display a setting interface, the setting interface includes P file identifiers, one file identifier indicates an image file, and P is a positive integer;
  • At least one candidate chat group option is displayed, where Q is a positive integer less than or equal to P;
  • the processor 1610 may be configured to identify the second one of the Q image files indicated by the Q file identifiers in the case of receiving the user's selection input of the target chat group option in at least one candidate chat group option. object;
  • the second object in the Q image files is stored in association with the target chat group corresponding to the target chat group option.
  • the input unit 1604 may include a graphics processor (Graphics Processing Unit, GPU) 16041 and a microphone 16042, and the graphics processor 16041 is used for the image capture device (such as the image data of the still picture or video obtained by the camera) for processing.
  • the display unit 1606 may include a display panel 16061, and the display panel 16061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like.
  • the user input unit 1607 includes a touch panel 16071 and other input devices 16072 . Touch panel 16071, also called touch screen.
  • the touch panel 16071 may include two parts: a touch detection device and a touch controller.
  • Other input devices 16072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which will not be repeated here.
  • Memory 1609 can be used to store software programs as well as various data, including but not limited to application programs and operating systems.
  • the processor 1610 may integrate an application processor and a modem processor, wherein the application processor mainly processes operating systems, user interfaces, and application programs, and the modem processor mainly processes wireless communications. It can be understood that the foregoing modem processor may not be integrated into the processor 1610 .
  • the embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, each process of the above video processing method embodiment is realized, and the same technology can be achieved. Effect, in order to avoid repetition, will not repeat them here.
  • the processor is the processor in the electronic device in the foregoing embodiments.
  • Readable storage medium including computer readable storage medium, such as computer read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk, etc. non-transitory computer readable storage medium.
  • the embodiment of the present application also provides a computer program product, the computer program product can be executed by a processor to implement the various processes of the above video processing method embodiment, and can achieve the same technical effect, in order to avoid repetition, it will not be repeated here .
  • the embodiment of the present application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above video processing method embodiments, and can achieve the same Technical effects, in order to avoid repetition, will not be repeated here.
  • chips mentioned in the embodiments of the present application may also be called system-on-chip, system-on-chip, system-on-a-chip, or system-on-a-chip.
  • the term “comprising”, “comprising” or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the phrase “comprising a " does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising that element.
  • the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved. Functions are performed, for example, the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

Abstract

The present application belongs to the technical field of video processing and discloses a video processing method and apparatus and an electronic device. The video processing method comprises: receiving a target video sent by a target chat object; and if a first object in the target video matches a preset second object, displaying a first identifier, the first identifier being used for indicating that the target video comprises the second object.

Description

视频处理方法、装置及电子设备Video processing method, device and electronic equipment
相关申请的交叉引用Cross References to Related Applications
本申请要求享有于2021年05月20日提交的名称为“视频处理方法、装置及电子设备”的中国专利申请202110553846.8的优先权,该申请的全部内容通过引用并入本文中。This application claims the priority of the Chinese patent application 202110553846.8 entitled "Video Processing Method, Device and Electronic Equipment" filed on May 20, 2021, the entire content of which is incorporated herein by reference.
技术领域technical field
本申请属于视频技术领域,具体涉及一种视频处理方法、装置及电子设备。The present application belongs to the field of video technology, and in particular relates to a video processing method, device and electronic equipment.
背景技术Background technique
随着通信技术的发展,用户可以通过电子设备获取到海量视频。然而,现有技术中,在电子设备接收到视频的情况下,用户可能需要点击观看视频,来确定视频中是否存在自身感兴趣的内容,尤其是在收到多个视频的情况下,需要一个一个地播放观看视频,才可确定哪个视频是自己感兴趣的,确定的过程繁琐且费时。With the development of communication technology, users can obtain massive videos through electronic devices. However, in the prior art, when an electronic device receives a video, the user may need to click to watch the video to determine whether there is content of interest in the video, especially in the case of receiving multiple videos, a Only by playing and watching videos one by one can you determine which video you are interested in. The process of determining is cumbersome and time-consuming.
发明内容Contents of the invention
本申请实施例的目的是提供一种视频处理方法、装置及电子设备,能够解决现有技术中确定用户感兴趣视频的过程繁琐且费时的问题。The purpose of the embodiments of the present application is to provide a video processing method, device, and electronic device, which can solve the problem in the prior art that the process of determining a video of interest to a user is cumbersome and time-consuming.
第一方面,本申请实施例提供了一种视频处理方法,该方法包括:In the first aspect, the embodiment of the present application provides a video processing method, the method comprising:
接收目标聊天对象发送的目标视频;Receive the target video sent by the target chat partner;
在目标视频中的第一对象与预设的第二对象匹配的情况下,显示第一标识,第一标识用于指示目标视频包括第二对象。If the first object in the target video matches the preset second object, a first identification is displayed, and the first identification is used to indicate that the target video includes the second object.
第二方面,本申请实施例提供了一种视频处理装置,该装置包括:In a second aspect, an embodiment of the present application provides a video processing device, which includes:
接收模块,用于接收目标聊天对象发送的目标视频;The receiving module is used to receive the target video sent by the target chat object;
第一显示模块,用于在目标视频中的第一对象与预设的第二对象匹配的情况下,显示第一标识,第一标识用于指示目标视频包括第二对象。The first display module is configured to display a first mark when the first object in the target video matches a preset second object, and the first mark is used to indicate that the target video includes the second object.
第三方面,本申请实施例提供了一种电子设备,该电子设备包括处理器、存储器及存储在存储器上并可在处理器上运行的程序或指令,程序或指令被处理器执行时实现如第一方面的方法的步骤。In the third aspect, the embodiment of the present application provides an electronic device, the electronic device includes a processor, a memory, and a program or instruction stored in the memory and operable on the processor. When the program or instruction is executed by the processor, the The steps of the method of the first aspect.
第四方面,本申请实施例提供了一种可读存储介质,可读存储介质上存储程序或指令,程序或指令被处理器执行时实现如第一方面的方法的步骤。In a fourth aspect, the embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method in the first aspect are implemented.
第五方面,本申请实施例提供了一种芯片,芯片包括处理器和通信接口,通信接口和处理器耦合,处理器用于运行程序或指令,实现如第一方面的方法。In the fifth aspect, the embodiment of the present application provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the method in the first aspect.
在本申请实施例中,接收目标聊天对象发送的目标视频,在目标视频中的第一对象与预设的第二对象匹配的情况下,显示第一标识,该第一标识用于指示目标视频包括第二对象。本申请实施例通过对第一对象与第二对象的匹配,可以对包括第二对象的目标视频显示第一标识,有助于用户高效获取存在感兴趣内容的视频。In the embodiment of the present application, the target video sent by the target chat object is received, and when the first object in the target video matches the preset second object, a first logo is displayed, and the first logo is used to indicate the target video Include the second object. In this embodiment of the present application, by matching the first object with the second object, the first logo can be displayed on the target video including the second object, which helps the user to efficiently acquire videos with interesting content.
附图说明Description of drawings
图1是本申请实施例提供的视频处理方法的流程示意图;FIG. 1 is a schematic flow diagram of a video processing method provided in an embodiment of the present application;
图2是本申请实施例中会话界面的示例图之一;Fig. 2 is one of the example diagrams of the conversational interface in the embodiment of the present application;
图3是本申请实施例中会话界面的示例图之二;Fig. 3 is the second example diagram of the conversation interface in the embodiment of the present application;
图4是本申请实施例中会话界面的示例图之三;Fig. 4 is the third example diagram of the conversation interface in the embodiment of the present application;
图5是本申请实施例中目标窗口的示例图之一;Fig. 5 is one of the example diagrams of the target window in the embodiment of the present application;
图6是本申请实施例中目标窗口的示例图之二;Fig. 6 is the second example diagram of the target window in the embodiment of the present application;
图7是本申请实施例中目标窗口的示例图之三;Fig. 7 is the third example diagram of the target window in the embodiment of the present application;
图8是本申请实施例中设置界面的示例图之一;Figure 8 is one of the example diagrams of the setting interface in the embodiment of the present application;
图9是本申请实施例中设置界面的示例图之二;Figure 9 is the second example diagram of the setting interface in the embodiment of this application;
图10是本申请实施例中设置界面的示例图之三;Figure 10 is the third example diagram of the setting interface in the embodiment of this application;
图11是本申请实施例中设置界面的示例图之四;Figure 11 is the fourth example diagram of the setting interface in the embodiment of this application;
图12是本申请实施例中设置界面的示例图之五;Figure 12 is the fifth example diagram of the setting interface in the embodiment of this application;
图13是本申请实施例提供的视频处理方法在一个具体应用例中的流程示意图;FIG. 13 is a schematic flowchart of a video processing method provided in an embodiment of the present application in a specific application example;
图14是本申请实施例提供的视频处理装置的结构示意图;FIG. 14 is a schematic structural diagram of a video processing device provided by an embodiment of the present application;
图15是本申请实施例提供的电子设备的结构示意图;Fig. 15 is a schematic structural diagram of an electronic device provided by an embodiment of the present application;
图16是本申请实施例提供的电子设备的硬件结构示意图。FIG. 16 is a schematic diagram of a hardware structure of an electronic device provided by an embodiment of the present application.
具体实施方式Detailed ways
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员获得的所有其他实施例,都属于本申请保护的范围。The following will clearly describe the technical solutions in the embodiments of the present application with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, but not all of them. All other embodiments obtained by persons of ordinary skill in the art based on the embodiments in this application belong to the protection scope of this application.
本申请的说明书和权利要求书中的术语“第一”、“第二”等是用于区别类似的对象,而不用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便本申请的实施例能够以除了在这里图示或描述的那些以外的顺序实施,且“第一”、“第二”等所区分的对象通常为一类,并不限定对象的个数,例如第一对象可以是一个,也可以是多个。此外,说明书以及权利要求中“和/或”表示所连接对象的至少其中之一,字符“/”,一般表示前后关联对象是一种“或”的关系。The terms "first", "second" and the like in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific sequence or sequence. It should be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments of the application can be practiced in sequences other than those illustrated or described herein, and that references to "first," "second," etc. distinguish Objects are generally of one type, and the number of objects is not limited. For example, there may be one or more first objects. In addition, "and/or" in the specification and claims means at least one of the connected objects, and the character "/" generally means that the related objects are an "or" relationship.
下面结合附图,通过具体的实施例及其应用场景对本申请实施例提供的视频处理方法及装置进行详细地说明。The video processing method and device provided in the embodiments of the present application will be described in detail below through specific embodiments and application scenarios with reference to the accompanying drawings.
如图1所示,本申请实施例提供的视频处理方法,包括:As shown in Figure 1, the video processing method provided by the embodiment of the present application includes:
步骤101,接收目标聊天对象发送的目标视频; Step 101, receiving the target video sent by the target chat partner;
步骤102,在目标视频中的第一对象与预设的第二对象匹配的情况下,显示第一标识,第一标识用于指示目标视频包括第二对象。本申请中的标识用于指示信息的文字、符号、图像等,可以以控件或者其他容器作为显示信息的载体,包括但不限于文字标识、符号标识、图像标识。Step 102: In the case that the first object in the target video matches the preset second object, display a first mark, where the first mark is used to indicate that the target video includes the second object. The logos in this application are used to indicate text, symbols, images, etc. of information, and controls or other containers may be used as carriers for displaying information, including but not limited to text logos, symbol logos, and image logos.
本申请实施例提供的视频处理方法可以是应用于电子设备中的,该电子设备可以是个人电脑或者移动终端等,此处不做具体限定。The video processing method provided in the embodiment of the present application may be applied to an electronic device, and the electronic device may be a personal computer or a mobile terminal, etc., and is not specifically limited here.
结合一些应用场景,电子设备中运行有视频应用程序或者社交应用程序时,可以通过这些应用程序可以接收服务器或其他类型终端设备发送的视频。在上述步骤101中接收的目标视频,可以是电子设备从其他终端设备处接收的视频。Combined with some application scenarios, when video application programs or social application programs are running in the electronic device, the video sent by the server or other types of terminal devices can be received through these application programs. The target video received in the above step 101 may be a video received by the electronic device from other terminal devices.
举例来说,在社交应用程序中,可能具有聊天群组。聊天群组中的一个用户A在聊天群组中发送的视频,会被该聊天群组的其他用户所接收。此时,用户A可以认为是上述的目标聊天对象。For example, in a social application, there may be chat groups. A video sent by user A in the chat group will be received by other users of the chat group. At this point, user A can be considered as the above-mentioned target chat partner.
用户B可以是该聊天群组中的另一用户,用户B在通过电子设备接收到用户A发送的视频后,可能较难直接获知该视频中是否具有自身感兴趣的内容,比如感兴趣的人物或者物品等。通常情况下,用户B需要在进入到相应的会话界面中,点击播放该视频,才能够确认视频中的是否包括自身感兴趣的内容。User B may be another user in the chat group. After user B receives the video sent by user A through the electronic device, it may be difficult for user B to directly know whether there is content of interest in the video, such as interested persons or items etc. Usually, user B needs to click to play the video after entering the corresponding conversation interface, so as to confirm whether the video contains the content he is interested in.
而在一些场景中,用户A可能发送了多个视频,这多个视频中,可能仅有一部分包括了用户B感兴趣的内容。而从用户B的角度来说,在通过电子设备接收到这多个视频后,可能进入到会话界面后,逐一点击播放这多个视频,来确定包括了自身感兴趣内容的视频。However, in some scenarios, user A may send multiple videos, and only a part of the multiple videos may include the content that user B is interested in. From the perspective of user B, after receiving these multiple videos through the electronic device, he may enter the conversation interface and click to play these multiple videos one by one to determine the video that includes the content he is interested in.
可见,用户B在获取自身感兴趣内容的视频的过程中,存在获取效率较低的问题。It can be seen that, in the process of obtaining the video of the content that user B is interested in, there is a problem of low acquisition efficiency.
当然,在实际应用中,发送目标视频的目标聊天对象,除了可以是用户外,还可以是机器人客服等。比如,机器人客服可以根据电子设备的用户发送的关键词,向电子设备发送视频。或者,机器人客服可以根据电子设备的用户的历史观看记录或者预先设置的兴趣标签,定期向电子设备发送视频等。Of course, in practical applications, the target chat object of sending the target video may not only be a user, but also a robot customer service and the like. For example, the robot customer service can send a video to the electronic device according to the keywords sent by the user of the electronic device. Alternatively, the robot customer service can regularly send videos to the electronic device according to the historical viewing records of the user of the electronic device or the preset interest tags.
类似地,在机器人客服发送了多个视频的情况下,用户可能需要逐一点击播放这多个视频,确定包括了自身感兴趣内容的视频。Similarly, in the case that the robot customer service has sent multiple videos, the user may need to click to play the multiple videos one by one to determine the video that includes the content of interest.
结合以上应用场景的举例,在步骤102中,预设的第二对象可以对应电子设备的用户感兴趣的内容。With reference to the examples of the above application scenarios, in step 102, the preset second object may correspond to the content that the user of the electronic device is interested in.
具体来说,本实施例中,第二对象可以是用户预设的对象,或者也可以是电子设备根据用户的历史操作数据自动确定的对象等。从内容来说, 第二对象可以是人物、动物或者物品等,此处不做具体限定。Specifically, in this embodiment, the second object may be an object preset by the user, or may also be an object automatically determined by the electronic device according to historical operation data of the user. In terms of content, the second object may be a character, an animal, or an object, which is not specifically limited here.
结合一个举例,第二对象可以是一目标人物,在对第二对象进行设置时,用户可以选择对该目标人物拍摄得到的图像或者视频作为素材,加入到素材库中。而电子设备可以基于机器学习算法,识别出这些素材中的第二对象。As an example, the second object may be a target person. When setting the second object, the user may select an image or video taken of the target person as a material and add it to the material library. The electronic device can identify the second object in these materials based on a machine learning algorithm.
当然,在实际应用中,第二对象也可以是例如狗、猫的动物,或者例如房屋、车辆的物品等。在设置第二对象时,选择对这些第二对象进行拍摄得到的图像或视频作为识别素材即可。Of course, in practical applications, the second object may also be an animal such as a dog or a cat, or an object such as a house or a vehicle. When setting the second objects, it is sufficient to select images or videos obtained by shooting these second objects as identification materials.
与第二对象类似地,在目标视频中一般也包括有第一对象,例如人物或者物品等。目标视频中的第一对象,也可以通过机器学习算法对目标视频进行识别得到。Similar to the second object, the target video generally also includes the first object, such as a person or an object. The first object in the target video may also be obtained by identifying the target video through a machine learning algorithm.
为了简化描述,下文中主要以第一对象与第二对象均为人物为例,来对本申请实施例提供的视频处理方法进行说明。To simplify the description, the video processing method provided by the embodiment of the present application will be described below mainly by taking the first object and the second object both as characters as an example.
结合上文中的聊天群组的应用场景的举例,用户B可以将自身设置为第二对象。从电子设备的角度来说,可以在显示有相关的设置界面的情况下,接收用户B对包括有自身人脸的图像的选择输入后,识别用户选择的图像,确定第二对象。With reference to the example of the application scenario of the chat group above, user B can set himself as the second object. From the perspective of the electronic device, after receiving the user B's selection input of the image including his own face under the condition that the relevant setting interface is displayed, the image selected by the user can be recognized to determine the second object.
用户B所使用的电子设备在接收到目标视频后,可以对目标视频中的图像帧进行识别,得到第一对象。该第一对象同样可以是人脸。当根据人脸特征比对,确定第一对象与第二对象指示的为同一人物时,可以认为目标视频中的第一对象与预设的第二对象匹配。After receiving the target video, the electronic device used by user B can identify the image frames in the target video to obtain the first object. The first object can also be a human face. When it is determined according to the facial feature comparison that the first object and the second object indicate the same person, it can be considered that the first object in the target video matches the preset second object.
当然,在实际应用中,用于确定第一对象与第二对象是否匹配所选用的特征,可以不仅仅是人脸特征,也可以是身体特征等等,此处不做具体限定。Of course, in practical applications, the selected features for determining whether the first object matches the second object may be not only human face features, but also body features, etc., which are not specifically limited here.
电子设备对目标视频中的图像帧的识别过程,可以是后台进行的。例如,在电子设备中显示有会话界面的情况下,可以对在该会话界面接收到的目标视频进行缓存,并后台播放目标视频,以对目标视频中的图像帧进行识别,得到第一对象。The identification process of the image frame in the target video by the electronic device may be performed in the background. For example, when a conversation interface is displayed on the electronic device, the target video received on the conversation interface may be buffered, and the target video may be played in the background to identify image frames in the target video to obtain the first object.
在一些可行的实施方式中,电子设备也可以是在通过上述社交应用程 序接收到目标视频的情况下,即可对目标视频进行缓存以及对图像帧进行识别。也就是说,在未显示有聊天群组的会话界面的情况下,依然可以对目标视频中的第一对象进行获取。In some feasible implementation manners, the electronic device may also cache the target video and identify the image frame after receiving the target video through the above-mentioned social application program. That is to say, the first object in the target video can still be acquired when the conversation interface of the chat group is not displayed.
当然,电子设备也可以在用户点击播放目标视频的情况下,对目标视频中的第一对象进行获取。Of course, the electronic device may also acquire the first object in the target video when the user clicks to play the target video.
换而言之,电子设备对目标视频中的第一对象的获取时机,此处不做具体限定。In other words, the timing for the electronic device to acquire the first object in the target video is not specifically limited here.
本实施例中,在目标视频中的第一对象与预设的第二对象匹配的情况下,可以显示第一标识,该第一标识用于指示目标视频为与第二对象匹配的视频。In this embodiment, when the first object in the target video matches the preset second object, a first identification may be displayed, and the first identification is used to indicate that the target video is a video matching the second object.
举例来说,在电子设备中显示有会话界面的情况下,该会话界面中通常可以存在接收到的视频的缩略图。当其中的一个视频,即上述的目标视频中的第一对象与第二对象匹配时,可以在与该目标视频的缩略图对应的位置显示一第一标识。For example, in the case where a conversation interface is displayed on the electronic device, there may usually be a thumbnail of the received video in the conversation interface. When one of the videos, that is, the first object in the above-mentioned target video matches the second object, a first logo may be displayed at a position corresponding to the thumbnail of the target video.
该第一标识可以是文字标识,例如,第一标识的内容可以是“@用户B”、“您可能感兴趣的视频”等。当然,第一标识也可以是图片标识或者图标标识等等,此处不做具体限定。The first identification may be a text identification, for example, the content of the first identification may be "@userB", "videos you may be interested in", and so on. Certainly, the first mark may also be a picture mark or an icon mark, etc., which are not specifically limited here.
而在另一些举例中,第一标识可以是预设的悬浮控件,例如悬浮球或者悬浮图标。也就是说,在目标视频中的第一对象与预设的第二对象匹配的情况下,电子设备可以在预设的区域显示悬浮控件,以提示已接收到包括第二对象的视频。In other examples, the first identifier may be a preset floating control, such as a floating ball or a floating icon. That is to say, if the first object in the target video matches the preset second object, the electronic device may display a floating control in a preset area to prompt that a video including the second object has been received.
总的来说,在步骤102中,可以通过显示第一标识,来提示用户已接收到包括第二对象的视频。或者,进一步地,可以通过第一标识指示目标视频的缩略图在当前显示界面中的具体显示位置。In general, in step 102, the user may be prompted that the video including the second object has been received by displaying the first logo. Or, further, the specific display position of the thumbnail of the target video in the current display interface may be indicated by the first identifier.
本申请实施例提供的视频处理方法,接收目标聊天对象发送的目标视频,在目标视频中的第一对象与预设的第二对象匹配的情况下,显示第一标识,该第一标识用于指示目标视频包括第二对象。本申请实施例通过对第一对象与第二对象的匹配,可以对包括第二对象的目标视频显示第一标识,有助于用户高效获取存在感兴趣内容的视频。The video processing method provided by the embodiment of the present application receives the target video sent by the target chat object, and displays the first identification when the first object in the target video matches the preset second object, and the first identification is used for Indicating that the target video includes a second object. In this embodiment of the present application, by matching the first object with the second object, the first logo can be displayed on the target video including the second object, which helps the user to efficiently acquire videos with interesting content.
可选地,目标聊天对象为目标聊天群组中的对象;Optionally, the target chat object is an object in the target chat group;
相应地,步骤101,接收目标聊天对象发送的目标视频之后,视频处理方法还可以包括:Correspondingly, in step 101, after receiving the target video sent by the target chat object, the video processing method may further include:
获取预设的与目标聊天群组关联的第二对象;Obtain a preset second object associated with the target chat group;
将第一对象与第二对象进行相似度比对;Comparing the similarity between the first object and the second object;
在第一对象与第二对象的相似度大于相似度阈值的情况下,确定第一对象与第二对象匹配。If the similarity between the first object and the second object is greater than the similarity threshold, it is determined that the first object matches the second object.
如上一实施例中的举例所示的,目标聊天对象可以是在聊天群组中发送的视频。换而言之,目标聊天对象可以是聊天群组中的对象。为了简化描述,可以认为目标聊天对象是目标聊天群组中的对象,且目标聊天对象是在目标聊天群组发送目标视频。As shown in the example in the previous embodiment, the target chat object may be a video sent in the chat group. In other words, the target chat object may be an object in a chat group. To simplify the description, it can be considered that the target chat object is an object in the target chat group, and the target chat object sends the target video in the target chat group.
再次结合上文中聊天群组的应用场景的举例,用户B感兴趣的内容可以存在多个,用户B可能同时对人物X与人物Y(均可以对应第二对象)感兴趣。然而,包括人物X的视频与包括人物Y的视频通常可能是在不同的聊天群组中进行接收的。Combining again with the example of the application scenario of the chat group above, user B may be interested in multiple contents, and user B may be interested in person X and person Y (both may correspond to the second object) at the same time. However, the video including person X and the video including person Y may usually be received in different chat groups.
为了避免在一个聊天群组中接收到目标视频的情况下,同时使用人物X与人物Y对目标视频中的第一对象进行匹配,本实施例中,可以预先建立有聊天群组与第二对象之间的关联关系。In order to avoid matching the first object in the target video with character X and character Y at the same time when the target video is received in a chat group, in this embodiment, a chat group and a second object can be pre-established relationship between.
具体来说,目标视频可以是发送至目标聊天群组的视频,而目标聊天群组可以关联有相应的第二对象。Specifically, the target video may be a video sent to a target chat group, and the target chat group may be associated with a corresponding second object.
例如,在相关的设置界面,用户可以通过在电子设备上的输入,将人物X与聊天群组HX进行关联,将人物Y与聊天群组HY进行关联。For example, in the related setting interface, the user can associate character X with the chat group HX, and associate character Y with the chat group HY by inputting on the electronic device.
当聊天群组HX作为上述的目标聊天群组接收到目标视频时,电子设备可以将人物X确定为与目标聊天群组关联的第二对象。When the chat group HX receives the target video as the above-mentioned target chat group, the electronic device may determine the person X as the second object associated with the target chat group.
在以上举例中,聊天群组与第二对象的关联关系,可以认为是一个社交应用中的不同的聊天群组与第二对象的关联关系。在实际应用中,也可以是在应用程序与第二对象之间建立的关联关系。In the above example, the association relationship between the chat group and the second object can be regarded as the association relationship between different chat groups and the second object in a social application. In practical applications, it may also be an association relationship established between the application program and the second object.
换而言之,在通过目标聊天群组接收到目标视频的情况下,可以确定目标聊天群组所属的应用程序,并根据预设的应用程序与第二对象的关联 关系,来确定目标聊天群组关联的第二对象。In other words, when the target video is received through the target chat group, the application program to which the target chat group belongs can be determined, and the target chat group can be determined according to the preset association relationship between the application program and the second object The second object associated with the group.
举例来说,在设置的过程中,可以将人物X与应用程序AX进行关联,将人物Y与应用程序AY进行关联。在通过应用程序AX中的任一聊天群组(对应目标聊天群组)接收到目标视频时,可以将人物X确定为与目标聊天群组关联的第二对象。For example, during the setting process, the character X can be associated with the application program AX, and the character Y can be associated with the application program AY. When the target video is received through any chat group (corresponding to the target chat group) in the application program AX, the character X can be determined as the second object associated with the target chat group.
在获取到与目标聊天群组关联的第二对象的情况下,可以使用与目标聊天群组关联的第二对象对目标视频中的第一对象进行相似度比对。In the case that the second object associated with the target chat group is acquired, the second object associated with the target chat group may be used to perform a similarity comparison on the first object in the target video.
结合一个举例,第一对象与第二对象均可以是人物,将第一对象与第二对象进行相似度比对,可以是对两者的人脸特征等内容进行比对,得到两者的相似度。Combined with an example, both the first object and the second object can be people, and comparing the similarity between the first object and the second object can be to compare the facial features and other contents of the two to obtain the similarity between the two. Spend.
当然,相似度也可以认为是将第一对象识别为第二对象的概率。比如,第二对象可以是预设的动物“狗”,第一对象与第二对象之间的相似度比对结果,可以是将第一对象识别为“狗”的概率,该概率在一定程度上对应了上述的相似度。Of course, the similarity can also be regarded as the probability of identifying the first object as the second object. For example, the second object may be the preset animal "dog", and the similarity comparison result between the first object and the second object may be the probability of identifying the first object as "dog". corresponds to the above similarity.
当第一对象与第二对象的相似度大于相似度阈值时,可以确定第一对象与第二对象匹配。When the similarity between the first object and the second object is greater than the similarity threshold, it may be determined that the first object matches the second object.
比如,相似度阈值可以是预设的,具体数值为90%。当第一对象与第二对象之间的相似度大于90%时,可以确定第一对象与第二对象匹配。For example, the similarity threshold may be preset, and the specific value is 90%. When the similarity between the first object and the second object is greater than 90%, it may be determined that the first object matches the second object.
在一些示例中,可以省略电子设备使用与目标聊天群组不关联的第二对象,对目标视频中的第一对象进行相似度比对的过程。In some examples, the electronic device may omit the process of using the second object not associated with the target chat group to compare the similarity of the first object in the target video.
可见,本实施例中,在接收到发送至目标聊天群组的目标视频的情况下,可以获取与该目标聊天群组关联的第二对象,并将该目标聊天群组关联的第二对象与目标视频中的第一对象进行相似度比对,可以有效减少相似度比对过程所带来的计算资源的消耗。It can be seen that in this embodiment, in the case of receiving the target video sent to the target chat group, the second object associated with the target chat group can be obtained, and the second object associated with the target chat group can be combined with The similarity comparison is performed on the first object in the target video, which can effectively reduce the consumption of computing resources brought about by the similarity comparison process.
在一些示例中,聊天群组与第二对象之间的关联关系,具体可以是通过聊天群组的群组信息与第二对象进行关联的。In some examples, the association relationship between the chat group and the second object may specifically be associated with the second object through group information of the chat group.
比如,聊天群组的群组信息,可以是该聊天群组的名称或者聊天群组对应的编号等。在设置过程中,可以将聊天群组名称与第二对象关联。在接收到发送至目标聊天群组的情况下,可以根据目标聊天群组的聊天群组 名称,确定关联的第二对象。For example, the group information of the chat group may be the name of the chat group or the number corresponding to the chat group. During the setup process, the chat group name can be associated with the second object. In the case of receiving and sending to the target chat group, the associated second object can be determined according to the chat group name of the target chat group.
以下针对第一标识的显示方式进行举例说明。The following describes the display manner of the first logo with an example.
如图2所示,图2为目标聊天群组的会话界面一个示例图。在该目标聊天群组中,可以显示了多个视频的缩略图(在图中标记为VP1),且这些视频可以是用户A(对应目标聊天对象)发送至目标聊天群组中的。As shown in FIG. 2, FIG. 2 is an example diagram of a conversation interface of a target chat group. In the target chat group, multiple video thumbnails (marked as VP1 in the figure) may be displayed, and these videos may be sent to the target chat group by user A (corresponding to the target chat object).
一般来说,基于对这些视频中的第一对象的识别,可以得到包括第二对象的目标视频。In general, based on the recognition of the first object in these videos, target videos including the second object can be obtained.
如图3所示,图3为在目标聊天群组的会话界面中,对包括第二对象的目标视频显示第一标识的一个示例图。在该示例图中,第一标识可以显示于目标视频的缩略图(在图中标记为VP2)一侧,且具体显示为“@用户B”的文字(在图中标记为T1)。As shown in FIG. 3 , FIG. 3 is an example diagram of displaying the first identifier for the target video including the second object in the conversation interface of the target chat group. In this example figure, the first logo can be displayed on the side of the thumbnail of the target video (marked as VP2 in the figure), and specifically displayed as the text of "@UserB" (marked as T1 in the figure).
具体来说,第一标识可以采用弹窗或者悬浮窗等形式进行显示,在这些弹窗或悬浮窗中,可以显示有预设的提示文字。Specifically, the first logo can be displayed in the form of pop-up windows or floating windows, and preset prompt texts can be displayed in these pop-up windows or floating windows.
基于显示的第一标识,用户可以比较快速地获知具体哪些视频中包括有自身感兴趣的内容,而无需逐一点击播放各视频,有效节省用户操作时间,提高用户使用体验。Based on the displayed first identifier, the user can quickly learn which specific videos contain content of interest to him/herself, without having to click and play each video one by one, which effectively saves user operation time and improves user experience.
当然,在一些实施方式中,在目标聊天群组中对包括第二对象的目标视频显示的标记,可以并不限于上述的第一标识。Certainly, in some implementation manners, the mark displayed on the target video including the second object in the target chat group may not be limited to the above-mentioned first identifier.
如图4所示,图4为在目标聊天群组的会话界面中,对包括第二对象的目标视频显示第二标记的一个示例图。在该示例图中,第二标识可以显示于目标视频的缩略图一侧,且具体显示为“90%”、“50%”的文字(在图中标记为T2)。其中,这些文字可以用于指示目标视频中的第一对象与第二对象的匹配度。As shown in FIG. 4 , FIG. 4 is an example diagram of displaying a second mark on a target video including a second object in a conversation interface of a target chat group. In this example figure, the second mark may be displayed on the side of the thumbnail of the target video, and specifically displayed as words "90%" and "50%" (marked as T2 in the figure). Wherein, these words may be used to indicate the matching degree between the first object and the second object in the target video.
具体来说,在这些实施方式中,上述步骤101,接收目标聊天对象发送的目标视频之后,视频处理方法还可以包括:Specifically, in these embodiments, after the above-mentioned step 101 receives the target video sent by the target chat object, the video processing method may further include:
获取目标视频中的第一对象与预设的第二对象的匹配度;其中,匹配度用于指示第一对象与第二对象的相似度,或者,匹配度用于指示目标视频中目标图像帧的占比,目标图像帧为包括第一对象的图像帧,第一对象与第二对象之间的相似度大于相似度阈值;Obtain the matching degree between the first object in the target video and the preset second object; wherein, the matching degree is used to indicate the similarity between the first object and the second object, or the matching degree is used to indicate the target image frame in the target video ratio, the target image frame is an image frame including the first object, and the similarity between the first object and the second object is greater than the similarity threshold;
显示第二标识,第二标识用于指示目标视频中的第一对象与第二对象的匹配度。A second identification is displayed, and the second identification is used to indicate the matching degree between the first object and the second object in the target video.
结合上文中第一对象与第二对象均为人物的应用场景,第一对象与第二对象的相似度,可以是人脸特征的相似度等。相应地,该相似度可以是通过预设的人脸识别模型得到的。Combining with the above application scenario where both the first object and the second object are people, the similarity between the first object and the second object may be the similarity of facial features, etc. Correspondingly, the similarity can be obtained through a preset face recognition model.
当然,在另一些应用场景的举例中,第二对象也可以是泛指的动物或者物品。例如,第二对象可以是动物狗,第一对象与第二对象的相似度,也可以是相应的识别模型对目标视频的图像帧进行识别,得到第一对象为动物狗的概率等。Of course, in some other examples of application scenarios, the second object may also be a generic animal or item. For example, the second object may be an animal dog, and the similarity between the first object and the second object may also be the probability that the first object is an animal dog obtained by identifying the image frame of the target video by a corresponding recognition model.
在一些示例中,上述的相似度可以直接作为目标视频与第二对象的匹配度。In some examples, the above similarity can be directly used as the matching degree between the target video and the second object.
目标视频中的第一对象与预设的第二对象的匹配度,也可以通过目标视频中目标图像帧的占比来进行确定。该目标图像帧可以是包括第一对象的图像帧,第一对象与第二对象之间的相似度大于相似度阈值。The degree of matching between the first object in the target video and the preset second object may also be determined by the proportion of the target image frame in the target video. The target image frame may be an image frame including a first object, and the similarity between the first object and the second object is greater than a similarity threshold.
举例来说,第二对象可以是人物X。通常情况下,在一个图像帧中若包括某一人物,且该人物与人物X之间的相似度大于相似度阈值时,可以认为该图像帧中包括了人物X。在此基础上,若目标视频具有100个图像帧,且其中的60个图像帧中包括了人物X,则这60个图像帧即对应了上述的目标图像帧。For example, the second object may be person X. Generally, if a person is included in an image frame, and the similarity between the person and person X is greater than a similarity threshold, it can be considered that the image frame includes person X. On this basis, if the target video has 100 image frames, and the person X is included in 60 image frames, then these 60 image frames correspond to the aforementioned target image frames.
在目标视频的100个图像帧中,存在60个目标图像帧,即目标图像帧在目标视频中的占比为60%。此时,可以认为目标视频与第二对象的匹配度为60%。Among the 100 image frames of the target video, there are 60 target image frames, that is, the proportion of the target image frame in the target video is 60%. At this point, it can be considered that the matching degree between the target video and the second object is 60%.
当然,在实际应用中,第一对象与第二对象的匹配度,可以同时结合上述的相似度与目标图像帧的占比得到。例如,可以将上述的相似度与图像帧的占比进行加权平均进行,得到第一对象与第二对象的匹配度等。Of course, in practical applications, the matching degree between the first object and the second object can be obtained by combining the above similarity degree and the proportion of the target image frame. For example, the above similarity and the ratio of the image frame may be weighted and averaged to obtain the matching degree between the first object and the second object.
参见图4,针对目标视频,在与其缩略图匹配的位置,可以显示第二标识。该第二标识可以包括百分数,该百分数可以指示第一对象与第二对象的匹配度。Referring to FIG. 4 , for the target video, a second logo can be displayed at a position matching its thumbnail. The second identification may include a percentage, which may indicate how well the first object matches the second object.
当然,在实际应用中,第二标识也可以是包括小数或者分值等,可以 指示第一对象与第二对象的匹配度即可。Of course, in practical applications, the second identifier may also include decimals or scores, and may indicate the degree of matching between the first object and the second object.
本实施方式中,可以根据第一对象与第二对象的相似度,或者,根据目标视频中目标图像帧的占比来确定第一对象与第二对象的匹配度,并通过显示可用于指示该匹配度的第二标识的方式,向用户提示该匹配度,有助于用户能够快速定位到感兴趣的视频,并为用户提供可优先观看的视频的选择依据,提升用户使用体验。In this embodiment, the matching degree between the first object and the second object can be determined according to the similarity between the first object and the second object, or according to the proportion of the target image frame in the target video, and can be used to indicate the The second identification method of the matching degree reminds the user of the matching degree, which helps the user to quickly locate the video of interest, and provides the user with a basis for selecting the video that can be watched first, and improves the user experience.
在一些实施方式中,在接收目标聊天对象发送的目标视频之后,可以存在显示第一标识与显示第二标识的过程。这两种标记的具体显示时机可以是相同的,也可以是不同的。In some implementations, after receiving the target video sent by the target chat object, there may be a process of displaying the first identification and displaying the second identification. The specific display timings of these two kinds of marks may be the same or different.
比如,在一个示例中,在电子设备的当前显示界面为社交应用程序的主界面的情况下,若接收到目标视频,且目标视频中的第一对象与预设的第二对象匹配,则可以在主界面上显示第一标识,该第一标识可以位于目标聊天群组的图像标识附近。当响应于用户的输入,显示该目标聊天群组的会话界面的情况下,可以在该会话界面中显示第二标识。For example, in one example, if the current display interface of the electronic device is the main interface of the social application program, if the target video is received and the first object in the target video matches the preset second object, then the The first logo is displayed on the main interface, and the first logo may be located near the image logo of the target chat group. When the conversation interface of the target chat group is displayed in response to the user's input, the second identifier may be displayed on the conversation interface.
在另一个示例中,可以在目标聊天群组的会话界面中,针对目标视频同时显示第一标识与第二标识。In another example, the first identification and the second identification may be simultaneously displayed for the target video in the conversation interface of the target chat group.
综上可见,本申请实施例中,电子设备在匹配到包括用户感兴趣内容的目标视频时,可以针对目标视频显示第一标识,和/或,显示用于指示匹配度的第二标识,可以对用户进行有效提醒,减少用户对目标视频的检索时间。To sum up, in the embodiment of the present application, when the electronic device matches a target video that includes the content that the user is interested in, it can display the first logo for the target video, and/or display the second logo for indicating the matching degree, which can be Effectively remind the user to reduce the user's retrieval time for the target video.
当然,显示上述的第一标识或第二标识后,这些标识可以并不影响用户对其他未标记的视频的观看。Of course, after the above-mentioned first logo or second logo is displayed, these logos may not affect the user's viewing of other unmarked videos.
在一些应用场景中,电子设备可能是在未显示上述目标聊天群组的情况下,接收到目标视频。或者,电子设备在显示有目标聊天群组的情况下,接收的目标视频的数量较多,或者接收的多个目标视频之间的间隔较多时,难以对所有目标视频的缩略图进行同时显示。In some application scenarios, the electronic device may receive the target video without displaying the target chat group. Alternatively, when the electronic device displays a target chat group, it is difficult to simultaneously display thumbnails of all target videos when the number of received target videos is large, or the intervals between multiple received target videos are large.
为了在以上应用场景中,电子设备也能够比较直观地向用户提示与第二对象匹配的目标视频,在一个实施方式中,上述步骤101,接收目标聊天对象发送的目标视频之后,视频处理方法还可以包括:In order to enable the electronic device to intuitively prompt the user with the target video that matches the second object in the above application scenarios, in one embodiment, after the above step 101 receives the target video sent by the target chat object, the video processing method further Can include:
在目标视频中的第一对象与预设的第二对象匹配的情况下,显示目标窗口,目标窗口包括目标视频的缩略图。If the first object in the target video matches the preset second object, a target window is displayed, and the target window includes a thumbnail of the target video.
如图5所示,图5为在电子设备中显示目标窗口(在图中标记为W)的一个示例图。其中,目标窗口可以是一悬浮窗口。As shown in FIG. 5 , FIG. 5 is an example diagram of displaying a target window (marked as W in the figure) in an electronic device. Wherein, the target window may be a floating window.
在一个举例中,电子设备在接收到目标视频的情况下,可以对目标视频进行缓存,后台播放目标视频,识别目标视频中的第一对象,并将第一对象与第二对象进行匹配。上述处理过程均可以是后台进行的,在目标视频中的第一对象与第二对象匹配的情况下,可以显示目标窗口。In an example, when the electronic device receives the target video, it may cache the target video, play the target video in the background, identify the first object in the target video, and match the first object with the second object. All the above-mentioned processing procedures can be performed in the background, and the target window can be displayed when the first object in the target video matches the second object.
换而言之,上述的目标窗口,可以是显示在桌面中,也可以是显示在应用程序的运行界面中,或者,也可以是显示在目标聊天群组的会话界面中等。In other words, the above-mentioned target window may be displayed on the desktop, or may be displayed on the running interface of the application program, or may also be displayed on the conversation interface of the target chat group.
目标窗口可以包括目标视频的缩略图(在图中标记为WP)。如此,电子设备在不同的显示状态下,均可以向用户提示接收到其可能感兴趣的视频,有助于提高提示过程的及时性。The target window may include a thumbnail of the target video (labeled WP in the figure). In this way, in different display states, the electronic device can prompt the user to receive a video that may be of interest to the user, which helps to improve the timeliness of the prompting process.
结合上文实施例,目标视频中的第一对象与第二对象之间可以存在一匹配度。相应地,在一个实施方式中,目标视频的缩略图包括第三标识,第三标识用于指示目标视频中的第一对象与第二对象的匹配度。With reference to the above embodiments, there may be a matching degree between the first object and the second object in the target video. Correspondingly, in one embodiment, the thumbnail image of the target video includes a third identifier, and the third identifier is used to indicate a degree of matching between the first object and the second object in the target video.
换而言之,在目标窗口中,可以通过第三标识来指示目标视频中的第一对象与第二对象之间的匹配度。而目标视频中的第一对象与第二对象之间的匹配度的确定方式,在上文实施例中进行了描述,此处不做赘述。In other words, in the target window, the matching degree between the first object and the second object in the target video may be indicated by a third identifier. The manner of determining the matching degree between the first object and the second object in the target video is described in the above embodiments, and will not be repeated here.
如图6所示,在一个示例中,上述的第三标识(在图中标记为WT)可以显示在目标视频的缩略图中的左上角,其中可以具体显示匹配度,例如“90%”、“50%”等。As shown in Figure 6, in an example, the above-mentioned third identification (marked as WT in the figure) can be displayed in the upper left corner of the thumbnail of the target video, where the matching degree can be specifically displayed, such as "90%", "50%" etc.
当然,第三标识也可以是位于缩略图中的其他位置,可根据实际需要进行设置,能够体现目标视频中的第一对象与第二对象的匹配度即可。Of course, the third mark can also be located in other positions in the thumbnail image, which can be set according to actual needs, and it only needs to be able to reflect the matching degree between the first object and the second object in the target video.
本实施方式中,目标视频的缩略图包括第三标识,从而有助于用户从目标窗口中快速确定感兴趣的目标视频,并为用户选择优先播放的目标视频提供参考。In this embodiment, the thumbnail of the target video includes a third identifier, which helps the user quickly determine the target video of interest from the target window, and provides a reference for the user to select a target video for priority playback.
在实际应用中,接收的视频的数量可能是多个,包括与第二对象匹配 的第一对象的目标视频的数量也可以是多个。In practical applications, the number of received videos may be multiple, and the number of target videos including the first object matched with the second object may also be multiple.
相应地,在一个实施方式中,在目标视频为多个的情况下,可以根据各个目标视频中的第一对象与第二对象的匹配度,在目标窗口中对各个目标视频的缩略图排序显示。Correspondingly, in one embodiment, when there are multiple target videos, the thumbnails of each target video can be sorted and displayed in the target window according to the degree of matching between the first object and the second object in each target video .
例如,可以按照各目标视频中第一对象与第二对象的匹配度的从大到小的顺序,依次显示各个目标视频的缩略图。如此用户可以根据各个目标视频的缩略图的顺序,优先观看包括更多感兴趣内容的目标视频。For example, the thumbnails of each target video may be sequentially displayed in descending order of the matching degrees between the first object and the second object in each target video. In this way, the user can preferentially watch the target video containing more interesting content according to the order of the thumbnails of each target video.
当然,为了使得用户能够更加直观地获取到各目标视频中第一对象与第二对象的匹配度,可以使得各个目标视频的缩略图分别包括对应的第三标识。Of course, in order to enable the user to obtain the matching degree between the first object and the second object in each target video more intuitively, the thumbnails of each target video may respectively include corresponding third identifiers.
在目标窗口包括有目标视频的缩略图的情况下,电子设备可以接收用户对缩略图的输入,以对响应的目标视频进行操作。In the case that the target window includes a thumbnail of the target video, the electronic device may receive user input on the thumbnail to operate on the corresponding target video.
具体来说,在一些实施方式中,显示目标窗口之后,视频处理方法还包括以下至少一项:Specifically, in some implementation manners, after displaying the target window, the video processing method further includes at least one of the following:
在接收到用户对目标窗口中目标视频的缩略图的第一输入的情况下,响应于第一输入,播放目标视频;In the case of receiving the user's first input to the thumbnail of the target video in the target window, in response to the first input, play the target video;
在接收到用户对目标窗口中目标视频的缩略图的第二输入的情况下,响应于第二输入,存储目标视频;storing the target video in response to the second input in response to receiving a second user input of a thumbnail image of the target video in the target window;
在接收到用户对目标窗口中目标视频的缩略图的第三输入的情况下,响应于第三输入,转发目标视频;In the case of receiving a third input from the user to the thumbnail of the target video in the target window, forwarding the target video in response to the third input;
在接收到用户对目标窗口中目标视频的缩略图的第四输入的情况下,响应于第四输入,删除目标视频。In case a user's fourth input of the thumbnail of the target video in the target window is received, the target video is deleted in response to the fourth input.
以下结合一些具体应用场景,来对上述实施方式进行举例说明。The foregoing implementation manner is illustrated below in conjunction with some specific application scenarios.
在一些举例中,第一输入可以对应用户对目标视频的缩略图的单击输入,电子设备在接收到用户对目标视频的缩略图的单击输入的情况下,可以响应于该单击输入,播放目标视频。In some examples, the first input may correspond to the user's click input on the thumbnail of the target video, and when the electronic device receives the user's click input on the thumbnail of the target video, in response to the click input, Play the target video.
第二输入可以对应用户对目标视频的缩略图的双击输入,相应地,在接收到双击输入的情况下,电子设备可以存储目标视频。The second input may correspond to the user's double-click input on the thumbnail of the target video, and accordingly, the electronic device may store the target video when the double-click input is received.
第三输入可以对应用户对目标视频的缩略图的长按输入,相应地,在 接收到长按输入的情况下,电子设备可以转发目标视频。而为了便于用户选择具体通过何种应用转发目标视频,在接收到该长按输入后,可以显示可用于转发目标视频的应用的图标。The third input may correspond to the user's long press input on the thumbnail of the target video, and accordingly, in the case of receiving the long press input, the electronic device may forward the target video. In order to facilitate the user to choose which application to forward the target video through, after receiving the long press input, icons of applications that can be used to forward the target video may be displayed.
第四输入可以对应用户对目标视频沿预设路径的拖动输入。比如,用户可以将目标视频的缩略图拖动至目标窗口的外部区域,而电子设备可以响应于用户的拖动输出,将目标视频从用于缓存文件的内存中删除,并在目标窗口中清楚目标视频的缩略图。而作为可行的实施方式,在目标窗口中的目标视频的缩略图全部删除后,可以隐藏目标窗口。The fourth input may correspond to the user's dragging input of the target video along a preset path. For example, the user can drag the thumbnail of the target video to the outer area of the target window, and the electronic device can respond to the user's drag output, delete the target video from the memory used for caching files, and display it clearly in the target window. The thumbnail of the target video. As a feasible implementation manner, after all thumbnails of the target video in the target window are deleted, the target window can be hidden.
当然,以上仅是对电子设备响应于用户的输入对目标视频进行处理的一些举例说明。在实际应用中,不同的输入操作与对目标视频的处理方式的关联关系,可以根据实际需要进行调整。Of course, the above are only some examples of processing the target video by the electronic device in response to the user's input. In practical applications, the relationship between different input operations and processing methods for the target video can be adjusted according to actual needs.
比如,在接收到对目标视频的缩略图的长按输入时,也可以显示名称分别为“存储”与“转发”的两个操作控件,并在接收到用户对操作控件的点击输入的情况下,进一步对目标视频进行相应的处理。For example, when a long-press input on the thumbnail of the target video is received, two operation controls whose names are respectively "store" and "forward" may also be displayed, and when a click input from the user on the operation control is received, , and further perform corresponding processing on the target video.
可见,通过显示目标窗口,用户可以无需深入到应用程序的特定会话界面中以对目标视频进行管理,缩短了简化了操作路径,有助于提高操作效率。It can be seen that by displaying the target window, the user does not need to go deep into the specific session interface of the application program to manage the target video, which shortens and simplifies the operation path and helps to improve the operation efficiency.
作为一个可选的实施方式,上述在目标视频中的第一对象与预设的第二对象匹配的情况下,显示目标窗口,可以具体包括:As an optional implementation manner, displaying the target window when the first object in the target video matches the preset second object above may specifically include:
在目标视频中的第一对象与预设的第二对象匹配的情况下,显示目标操作控件;In the case that the first object in the target video matches the preset second object, displaying target operation controls;
在接收到对该目标操作控件的输入的情况下,响应于该输入,显示目标窗口。In case an input to the target manipulation control is received, the target window is displayed in response to the input.
本实施方式中,可以在接收到用户感兴趣的目标视频的情况下,显示一目标操作控件。该目标操作控件可以是一悬浮按钮,该悬浮按钮可以是占据较小的显示区域,避免对电子设备的当前显示内容造成过多的遮挡。In this implementation manner, a target operation control may be displayed when a target video of interest to the user is received. The target operation control can be a floating button, and the floating button can occupy a small display area, so as to avoid too much blocking of the current display content of the electronic device.
而接收到对该目标操作控件的输入的情况下,例如,接收到对目标操作控件的单击、双击或者长按输入的情况下,可以进一步加载目标窗口,并在目标窗口中显示目标视频的缩略图。And when the input of the target operation control is received, for example, when a single click, double-click or long press input is received to the target operation control, the target window can be further loaded, and the image of the target video can be displayed in the target window. thumbnail.
可选地,目标视频中的第一对象为使用预设的识别模型对目标视频进行识别得到;Optionally, the first object in the target video is obtained by using a preset recognition model to identify the target video;
相应地,在显示第一标识之后,视频处理方法还可以包括:Correspondingly, after displaying the first logo, the video processing method may further include:
在接收到对目标视频的第五输入的情况下,将目标视频作为训练样本对识别模型进行训练;In the case of receiving the fifth input to the target video, the target video is used as a training sample to train the recognition model;
其中,第五输入用于存储或转发目标视频。Wherein, the fifth input is used for storing or forwarding the target video.
如上文所示的,目标视频中的第一对象为人物的情况下,第一对象可以是通过人脸识别模型对目标视频中的图像帧进行识别得到。类似地,当第一对象是动物或者物品的情况下,也可以是采用经过相关样本训练后的识别模型,从目标视频中识别出第一对象。As shown above, when the first object in the target video is a person, the first object may be obtained by recognizing an image frame in the target video through a face recognition model. Similarly, when the first object is an animal or an object, the first object can also be identified from the target video by using a recognition model trained with relevant samples.
容易理解的是,一般情况下,对于基于机器学习算法的识别模型,通常需要使用相应的训练样本对其进行充分训练,以使得识别模型具有较好的识别效果。训练样本的数量与质量,对训练得到的识别模型的识别效果有着较大的影响。It is easy to understand that, in general, for a recognition model based on a machine learning algorithm, it usually needs to be fully trained with corresponding training samples, so that the recognition model has a better recognition effect. The quantity and quality of training samples have a great influence on the recognition effect of the trained recognition model.
具体到本申请实施例中所采用的识别模型,对应的训练样本可以是经过标注的图像或者视频等。训练样本的质量,一般会受到标注的准确性的影响。Specific to the recognition model used in the embodiment of the present application, the corresponding training samples may be marked images or videos. The quality of training samples is generally affected by the accuracy of labeling.
本实施例中,目标视频在一定程度上可以认为是未经标注的视频,将目标视频输入到识别模型中后,可以得到相应的识别结果。该识别结果可以指示目标视频中的第一对象是否与第二对象匹配。In this embodiment, the target video can be regarded as an unlabeled video to a certain extent, and after the target video is input into the recognition model, a corresponding recognition result can be obtained. The recognition result may indicate whether the first object in the target video matches the second object.
若识别结果指示目标视频中的第一对象与第二对象匹配,且该识别结果为正确的识别结果,则可以将该目标视频作为一正样本,对识别模型进行优化训练。If the recognition result indicates that the first object in the target video matches the second object, and the recognition result is a correct recognition result, then the target video can be used as a positive sample for optimal training of the recognition model.
而识别结果是否正确,则可以通过用户对目标视频的操作情况进行体现。举例来说,在针对某一目标视频显示了第一标识的情况下,若接收到用户对该目标视频的转发或者存储操作,则认为用户确实对该目标视频是感兴趣的,即识别模型对目标视频的识别结果可以认为是正确的。Whether the recognition result is correct can be reflected by the user's operation on the target video. For example, in the case where the first logo is displayed for a certain target video, if the forwarding or storing operation of the target video by the user is received, it is considered that the user is indeed interested in the target video, that is, the recognition model is The recognition result of the target video can be considered correct.
本实施例中,对目标视频的第五输入,可以对应上述用于对目标视频进行存储或者转发的输入等,此处可不做具体限定。In this embodiment, the fifth input to the target video may correspond to the above-mentioned input for storing or forwarding the target video, and there is no specific limitation here.
总的来说,第五输入可以认为是用户对目标视频的正向操作。在接收到对目标视频的第五输入的情况下,可以将该目标视频作为正样本,来对识别模型进行训练,从而有助于提高识别模型的识别精准度。In general, the fifth input can be considered as the user's positive operation on the target video. In the case of receiving the fifth input of the target video, the target video can be used as a positive sample to train the recognition model, thereby helping to improve the recognition accuracy of the recognition model.
以下将针对第二对象的一些设置方式进行举例说明。The following will illustrate some setting methods of the second object with examples.
在一个实施方式中,上述步骤101,接收目标视频之前,视频处理方法还可以包括:In one embodiment, before the above-mentioned step 101 receives the target video, the video processing method may further include:
显示设置界面,设置界面中包括有P个文件标识,一个文件标识指示一个影像文件,P为正整数;Display the setting interface, the setting interface includes P file identifiers, one file identifier indicates an image file, and P is a positive integer;
在接收对Q个文件标识的选择输入的情况下,识别Q个文件标识指示的Q个影像文件,得到第二对象,Q为小于或等于P的正整数。In the case of receiving selection input for Q file identifiers, identify Q image files indicated by the Q file identifiers to obtain a second object, where Q is a positive integer less than or equal to P.
一般来说,电子设备中可以预先存储有图片或者视频等类型的影像文件。比如,这些影像文件可以是通过相机对第二对象进行拍摄得到,或者,也可以是其他终端发送的包括有第二对象的图片或视频等。Generally speaking, image files such as pictures or videos may be pre-stored in the electronic device. For example, these image files may be obtained by shooting the second object through a camera, or may also be pictures or videos including the second object sent by other terminals.
在设置界面中,可以显示有P个文件标识,这P个文件标识可以对应有P个影像文件。In the setting interface, P file identifiers may be displayed, and the P file identifiers may correspond to P image files.
具体来说,设置界面中,可以是通过矩阵的方式,展示多个影像文件的缩略图,用户可以上下拖动界面,以对影像文件的缩略图进行切换显示。Specifically, in the setting interface, the thumbnails of multiple image files may be displayed in a matrix manner, and the user may drag the interface up and down to switch and display the thumbnails of the image files.
或者,设置界面中,也可以是单独显示一个影像文件的图像标识,例如视频截图等,用户可以左右拖动界面,以对影像文件的图像标识进行切换显示。Alternatively, in the setting interface, the image identifier of an image file may also be displayed separately, such as a video screenshot, and the user may drag the interface left and right to switch and display the image identifier of the image file.
上述的缩略图或者图像标识等,均可以认为是影像文件的文件标识。针对这些文件标识,用户可以进行选择输入。The above-mentioned thumbnails or image identifiers can all be considered as file identifiers of image files. For these file identifiers, the user can make optional input.
例如,用户可以点击文件标识,以对该文件标识进行选中;或者,用户也可以将文件标识拖动至预设的显示区域,以对该文件标识进行选中。For example, the user can click on the file identifier to select the file identifier; or, the user can also drag the file identifier to a preset display area to select the file identifier.
当然,在实际应用中,对文件标识的选择输入可以不限于上述举例中的方式,可以根据实际需要设置具体的输入方式,此处不做一一列举说明。Of course, in practical applications, the selection and input of the file identifiers may not be limited to the methods in the above examples, and specific input methods may be set according to actual needs, which will not be listed here.
容易理解的是,对文件标识的选择操作,在一定程度上可以认为是对文件标识关联的影像文件的选择操作。相应地,电子设备可以对这些选中的影像文件,也就是上述Q个文件标识指示的Q个影像文件进行识别,得 到第二对象。It is easy to understand that, to a certain extent, the selection operation of the file identifier can be regarded as the selection operation of the image file associated with the file identifier. Correspondingly, the electronic device can identify the selected image files, that is, the Q image files indicated by the above Q file identifiers, to obtain the second object.
可见,本实施方式中,通过显示包括有P个文件标识的设置界面,可以方便用户选择用于得到第二对象的影像文件,提高操作效率。It can be seen that in this embodiment, by displaying a setting interface including P file identifiers, it is convenient for the user to select an image file for obtaining the second object, and the operation efficiency is improved.
在一个示例中,通过对上述Q个影像文件的识别,得到的第二对象的数量可以是一个,也可以是多个。In an example, the number of second objects obtained by identifying the above Q image files may be one or multiple.
例如,当用户在对文件标识的选择输入的过程中,对应选择了包括有人物X的图片以及包括有人物Y的图片,则识别得到的第二对象可以同时包括人物X与人物Y。For example, when the user correspondingly selects a picture including person X and a picture including person Y during the process of selecting and inputting the file identifier, the recognized second object may include person X and person Y at the same time.
以下结合一些应用场景,来对第二对象的设置过程进行说明。The setting process of the second object will be described below in conjunction with some application scenarios.
如图7所示,在电子设备中显示桌面或者显示应用程序的运行界面的情况下,均可以在界面中显示一名称为“素材库”的悬浮球(在图中标记为F)。在接收对该悬浮球的输入后,可以显示一素材库界面,在该素材库界面中,可以包括已有的用于得到第二对象的素材,例如图片或者视频等。在素材库界面中,用户可以左右滑动来切换查看已有的素材。As shown in FIG. 7 , when the desktop or the running interface of the application is displayed on the electronic device, a floating ball called "Material Library" (marked as F in the figure) can be displayed on the interface. After receiving the input of the hovering ball, a material library interface may be displayed, and in the material library interface, existing materials for obtaining the second object, such as pictures or videos, may be included. In the material library interface, users can swipe left and right to switch and view existing materials.
如图8所示,图8为上述素材库界面的一个示例图。在该示例图中,素材库界面还可以包括名称为“上传”的按钮控件(在图中标记为B1)。在接收到用于对“上传”按钮控件的输入后,可以在预设的显示区域(在图中标记为R)显示相册中的图片或视频的缩略图。此时的素材库界面可以认为是上述的设置界面。As shown in FIG. 8, FIG. 8 is an example diagram of the material library interface. In this example figure, the material library interface may also include a button control named "Upload" (marked as B1 in the figure). After receiving an input for the "upload" button control, thumbnails of pictures or videos in the album may be displayed in a preset display area (marked as R in the figure). The material library interface at this time can be regarded as the above-mentioned setting interface.
如图8所示,素材库界面中还可以包括名称为“绑定”的按钮控件(在图中标记为B2)。用户在对相册中的图片或视频的缩略图进行选中后,可以进一步点击“绑定”按钮控件,将选中的缩略图对应的图片或视频加入到素材库中。As shown in FIG. 8 , the material library interface may also include a button control named "Binding" (marked as B2 in the figure). After the user selects the thumbnail of the picture or video in the album, he can further click the "Bind" button control to add the picture or video corresponding to the selected thumbnail to the material library.
素材库中的素材,也可以用于进行识别得到第二对象。The materials in the material library can also be used for recognition to obtain the second object.
如上文实施例所示的,聊天群组与第二对象之间可以预设有关联关系。相应地,该预设的关联关系,可以是在相关的设置界面进行设置得到的。As shown in the above embodiments, there may be a preset association relationship between the chat group and the second object. Correspondingly, the preset association relationship may be obtained by setting in a related setting interface.
相应地,作为上一实施方式的一种变化例,本实施方式中,上述步骤101,接收目标聊天对象发送的目标视频之前,视频处理方法还可以包括:Correspondingly, as a modification example of the previous embodiment, in this embodiment, before the above step 101, before receiving the target video sent by the target chat partner, the video processing method may further include:
显示设置界面,设置界面中包括有P个文件标识,一个文件标识指示 一个影像文件,P为正整数;The display setting interface includes P file identifications in the setting interface, and a file identification indicates an image file, and P is a positive integer;
在接收到用户对Q个文件标识的选择输入的情况下,显示至少一个候选聊天群组选项,Q为小于或等于P的正整数;In the case of receiving user selection input on Q file identifiers, at least one candidate chat group option is displayed, where Q is a positive integer less than or equal to P;
在接收到用户对至少一个候选聊天群组选项中的目标聊天群组选项的选择输入的情况下,识别Q个文件标识指示的Q个影像文件中的第二对象;In the case of receiving a user's selection input of a target chat group option in at least one candidate chat group option, identifying a second object in the Q image files indicated by the Q file identifiers;
将Q个影像文件中的第二对象与目标聊天群组选项对应的目标聊天群组关联存储。The second object in the Q image files is stored in association with the target chat group corresponding to the target chat group option.
本实施方式中,设置界面中的具体内容及其显示方式可以是与上一实施方式一致的,为简化说明,此处不再赘述。In this implementation manner, the specific content and display manner in the setting interface may be consistent with the previous implementation manner, and will not be repeated here for simplicity of description.
电子设备在接收到用户对Q个文件标识的选择输入后,可以显示至少一个候选聊天群组选项,候选聊天群组选项可以包括候选聊天群组的群组信息。After receiving the user's selection input of the Q file identifiers, the electronic device may display at least one candidate chat group option, and the candidate chat group option may include group information of the candidate chat group.
举例来说,候选聊天群组可以社交应用程序中已有的聊天群组。对于候选聊天群组,通常可以具有聊天群组名称、聊天群组图像标识或者聊天群组对应的编号等群组信息。上述的候选聊天群组选项,可以具体显示为候选聊天群组的聊天群组名称、聊天群组图像标识或者编号等等,此处可不做具体限定。For example, the candidate chat group may be an existing chat group in a social application. For a candidate chat group, there may generally be group information such as a chat group name, a chat group image identifier, or a corresponding number of the chat group. The above-mentioned candidate chat group options may be specifically displayed as the chat group name, chat group image logo or number, etc. of the candidate chat group, which may not be specifically limited here.
在接收到Q个文件标识的选择输入的情况下,可以显示一弹窗,或者切换显示一选择页面。When the selection input of Q file identifiers is received, a pop-up window may be displayed, or a selection page may be switched and displayed.
比如,如图9所示,在显示弹窗的情况下,在该弹窗中可以显示“X学校一班讨论群”、“Y公司会议群”以及“Z家庭生活群”等候选聊天群组的聊天群组名称,或者,进一步在各聊天群组名称前方显示由群组成员图像缩略图组合形成的聊天群组图像标识等。这些聊天群组名称或者聊天群组图像标识可以对应上述候选聊天群组选项。For example, as shown in Figure 9, when a pop-up window is displayed, candidate chat groups such as "X school class one discussion group", "Y company meeting group" and "Z family life group" can be displayed in the pop-up window The name of the chat group, or further display the chat group image logo formed by the combination of group member image thumbnails in front of each chat group name. These chat group names or chat group image identifiers may correspond to the aforementioned candidate chat group options.
若用户需要在“X学校一班讨论群”中对包括有第二对象的视频进行标识,则用户可以对“X学校一班讨论群”的聊天群组名称进行点击输入。此时,用户“X学校一班讨论群”这一聊天群组名称的点击输入,可以认为是对目标聊天群组选项的选择输入。If the user needs to identify the video containing the second object in the "discussion group of class 1 of X school", the user can click and input the name of the chat group of "discussion group of class 1 of X school". At this point, the user's click input of the chat group name "X School Class 1 Discussion Group" can be regarded as the selection input of the target chat group option.
在接收到对目标聊天群组选项的选择输入的情况下,电子设备可以对 Q个文件标识指示的Q个影像文件进行识别,得到其中的第二对象。而对影像文件进行识别得到第二对象的具体方式,已在上文实施例中进行了详细描述,此处不再赘述。When receiving the selection input of the target chat group option, the electronic device can identify the Q image files indicated by the Q file identifiers, and obtain the second object therein. The specific manner of identifying the image file to obtain the second object has been described in detail in the above embodiments, and will not be repeated here.
电子设备可以将Q个影像文件中的第二对象与目标聊天群组选项对应的目标聊天群组关联存储。The electronic device may associate and store the second object in the Q image files and the target chat group corresponding to the target chat group option.
比如,电子设备对用户选择Q个影像文件进行识别,得到第二对象,并将第二对象与“X学校一班讨论群”进行关联存储。在后续的使用过程中,如电子设备接收到发送至“X学校一班讨论群”对应的聊天群组中的目标视频时,电子设备可以识别目标视频中的第一对象;根据上述关联存储的内容,确定与“X学校一班讨论群”关联的第二对象;并在第一对象与第二对象匹配的情况下,显示第一标识。For example, the electronic device identifies Q image files selected by the user to obtain a second object, and associates and stores the second object with the "discussion group of Class 1 of X school". In the subsequent use process, if the electronic device receives the target video sent to the chat group corresponding to "X School Class One Discussion Group", the electronic device can identify the first object in the target video; Content, determining the second object associated with the "discussion group of Class 1 of X school"; and displaying the first identifier when the first object matches the second object.
本实施方式中,显示设置界面,在接收到用户对Q个文件标识的选择输入的情况下,显示至少一个候选聊天群组选项的;在接收到对至少一个候选聊天群组选项中的目标聊天群组选项的选择输入,识别Q个文件标识指示的Q个影像文件中的第二对象,并将第二对象与目标聊天群组选项对应的目标聊天群组关联存储。本实施方式有助于用户比较快捷地对第二对象与目标聊天群组的关联关系进行设置。In this embodiment, the display setting interface, in the case of receiving the user's selection input of Q file identifiers, displays at least one candidate chat group option; The selection input of the group option identifies the second object in the Q image files indicated by the Q file identifiers, and associates and stores the second object with the target chat group corresponding to the target chat group option. This implementation manner helps the user to quickly set the association relationship between the second object and the target chat group.
在一个示例中,在从图8所示的界面切换至如图9所示的界面的过程中,用户可能需要进行更多的输入过程。In one example, during the process of switching from the interface shown in FIG. 8 to the interface shown in FIG. 9 , the user may need to perform more input processes.
比如,在接收到用户对图8中所示的“绑定”按钮控件的输入后,电子设备可以切换显示如图10所示的应用选择界面。For example, after receiving the user's input on the "binding" button control shown in FIG. 8 , the electronic device may switch to display the application selection interface as shown in FIG. 10 .
在应用选择界面中,可以显示多个应用程序的图标及其应用名称。比如,应用名称可以是“应用程序A”、“应用程序B”以及“应用程序C”等。In the application selection interface, icons of multiple application programs and their application names may be displayed. For example, the application names may be "Application A", "Application B", and "Application C".
若接收到用户对“应用程序B”的点击输入的情况下,可以进一步显示如图11所示的功能选择界面。比如,在该功能选择界面中,可以包括“选择群组”、“分享到朋友圈”以及“收藏”等类型的选项。If the user's click input on "application program B" is received, a function selection interface as shown in FIG. 11 may be further displayed. For example, in the function selection interface, options such as "select group", "share to Moments", and "favorite" may be included.
而在接收到用户对“选择群组”的选项后,可以切换至图9所示的界面。After receiving the user's option of "select group", it can switch to the interface shown in FIG. 9 .
基于以上操作过程,一方面,用户可以对不同应用程序中的不同群组关联相应的第二对象;另一方面,也可以满足用户对选择的影像文件的不同使用需要。Based on the above operation process, on the one hand, the user can associate corresponding second objects with different groups in different application programs; on the other hand, it can also satisfy the user's different usage needs for the selected image files.
定义用于显示上述P个文件标识的设置界面为第一设置界面,为了便于用户对已经设置的第二对象进行管理,在一个实施方式中,第一设置界面中还包括第一操作控件;Define the setting interface used to display the above P file identifiers as the first setting interface. In order to facilitate the user to manage the second object that has been set, in one embodiment, the first setting interface also includes a first operation control;
相应地,显示第一设置界面之后,视频处理方法还可以包括:Correspondingly, after the first setting interface is displayed, the video processing method may further include:
在接收到对第一操作控件的第六输入的情况下,响应于第六输入,显示第二设置界面,第二设置界面中包括目标聊天群组的群组信息、与目标聊天群组关联的影像文件的文件标识以及至少一个第二操作控件;In the case of receiving the sixth input to the first operation control, in response to the sixth input, a second setting interface is displayed, the second setting interface includes the group information of the target chat group, the information associated with the target chat group A file identification of the image file and at least one second operation control;
在接收到对任一第二操作控件的第七输入的情况下,响应于第七输入,更新目标聊天群组的群组信息与影像文件之间的关联关系。In the case of receiving a seventh input to any second operation control, in response to the seventh input, the association between the group information of the target chat group and the image file is updated.
以下结合一个举例,对本实施方式的具体实现过程进行说明。The specific implementation process of this embodiment will be described below with an example.
如图8所示,在图8所示的界面中,第一操作控件可以对应的是名称为“关联”的按钮控件(在图中标记为B3)。在接收到对“关联”按钮控件的点击输入后,可以切换显示如图12所示的界面。As shown in FIG. 8 , in the interface shown in FIG. 8 , the first operation control may correspond to a button control named "association" (marked as B3 in the figure). After receiving the click input on the "association" button control, the interface shown in FIG. 12 can be switched and displayed.
如图12所示,图12可以认为是第二设置界面的一个示例图。在该第二设置界面,可以显示有目标聊天群组的群组信息。As shown in FIG. 12, FIG. 12 can be regarded as an example diagram of the second setting interface. On the second setting interface, group information of the target chat group can be displayed.
一般来说,目标聊天群组可以是指关联有第二对象的聊天群组。结合上文实施例的描述,目标聊天群组与第二对象的关联关系,可以具体体现为目标聊天群组的群组信息与第二对象的关联关系。In general, the target chat group may refer to the chat group associated with the second object. In combination with the description of the above embodiments, the association relationship between the target chat group and the second object may be embodied as the association relationship between the group information of the target chat group and the second object.
如图12所示,在第二设置界面中,目标聊天群组的群组信息,可以包括聊天群组名称(在图中标记为TN)与聊天群组图像标识(在图中标记为TP)。其中,聊天群组名称可以是“群组1”、“群组2”以及“群组3”等等;而聊天群组图像标识,可以是聊天群组的群组头像等。As shown in Figure 12, in the second setting interface, the group information of the target chat group may include the chat group name (marked as TN in the figure) and chat group image identification (marked as TP in the figure) . Wherein, the chat group name may be "group 1", "group 2" and "group 3" and so on; and the chat group image logo may be a group avatar of the chat group.
一般来说,第二对象可以是对选择的影像文件进行识别得到。目标聊天群组与第二对象存在关联关系,因此,目标聊天群组也关联至影像文件。如图12所示,可以在目标聊天群组的群组信息下方,显示与该目标聊天群组关联的影像文件的文件标识(在图中标记为RP)。比如,文件标识可以 是影像文件的缩略图等。In general, the second object can be obtained by identifying the selected image file. There is an association relationship between the target chat group and the second object, therefore, the target chat group is also associated with the image file. As shown in FIG. 12 , the file identifier (marked as RP in the figure) of the image file associated with the target chat group may be displayed under the group information of the target chat group. For example, the file identifier may be a thumbnail of an image file or the like.
此外,针对各文件标识,可以关联显示有至少一个第二操作控件(在图中标记为K)。比如,如图12所示,第二操作控件包括名称为“修改”的操作控件与名称为“删除”的操作控件。In addition, for each file identifier, at least one second operation control (marked as K in the figure) may be associated and displayed. For example, as shown in FIG. 12 , the second operation control includes an operation control named "Modify" and an operation control named "Delete".
结合一些应用场景的举例,“群组1”关联有影像文件A。当接收到对显示于影像文件A的文件标识后方的“修改”操作控件的输入时,可以显示P个影像文件的缩略图,或者是上述素材库中的素材的缩略图,以供用户进行选择。当用户选择了影像文件B的缩略图后,可以取消影像文件A与“群组1”的关联关系,并建立影像文件B与“群组1”的关联关系。Taking some examples of application scenarios, "group 1" is associated with an image file A. When the input to the "modify" operation control displayed behind the file identification of image file A is received, the thumbnails of P image files, or the thumbnails of the materials in the above-mentioned material library, can be displayed for the user to select . After the user selects the thumbnail of image file B, the association between image file A and "group 1" can be canceled, and the association between image file B and "group 1" can be established.
当接收到对显示于影像文件A的文件标识后方的“删除”操作控件的输入时,可以取消影像文件A与“群组1”的关联关系。When an input to the "delete" operation control displayed behind the file identification of image file A is received, the association between image file A and "group 1" can be canceled.
可见,通过显示第二设置界面,可以满足用户对已存在的目标聊天群组的群组信息与影像文件之间的关联关系的修改需求,提升操作方便性。It can be seen that by displaying the second setting interface, the user's requirement for modifying the association between the existing group information of the target chat group and the image file can be satisfied, and the operation convenience can be improved.
以下结合一个具体应用例,来对本申请实施例提供的视频处理方法进行说明。The following describes the video processing method provided by the embodiment of the present application in conjunction with a specific application example.
如图13所示,该具体应用例中,视频处理方法可以包括:As shown in Figure 13, in this specific application example, the video processing method may include:
步骤1301,建立用于匹配视频的素材与社交软件群组之间的关联关系;Step 1301, establishing an association between the material for matching the video and the social software group;
用户可以上传用于视频匹配的素材,并指定素材到具体社交软件群组。Users can upload materials for video matching and assign materials to specific social software groups.
此处的视频,可以是指在通过社交软件接收的视频。而用于视频匹配的素材,则可以是用户在设置界面选择的视频或者图片等,这些选择的视频或者图片可以上传至预设的素材库中。The video here may refer to a video received through social software. The materials used for video matching can be videos or pictures selected by the user on the setting interface, and these selected videos or pictures can be uploaded to a preset material library.
此外,这些素材可以与具体的社交软件群组建立指定关系。比如,在实际应用中,通过该指定关系的设置,可以在对发送至一个群组的视频匹配人物A,对发送至另一个群组的视频匹配人物B等。In addition, these materials can establish specified relationships with specific social software groups. For example, in practical applications, through the setting of the specified relationship, it is possible to match person A to a video sent to one group, and match person B to a video sent to another group, and so on.
步骤1302,群组接收到视频资源,检查是否有素材库资源匹配;若是,执行步骤1303;若否,则结束; Step 1302, the group receives video resources, and checks whether there is a material database resource matching; if yes, execute step 1303; if not, end;
一般来说,视频资源中可以包括人物或物品等第一对象,同样地,素材库资源中也可以包括人物或物品等第二对象。Generally speaking, a video resource may include a first object such as a character or an item, and similarly, a material library resource may also include a second object such as a character or an item.
检查是否有素材库资源匹配,可以是指视频资源中的第一对象,是否 与素材库资源中的第二对象相匹配。Check whether there is a material library resource match, which may refer to whether the first object in the video resource matches the second object in the material library resource.
步骤1303,根据上传的素材进行智能化匹配,匹配内容可以对用户进行提醒; Step 1303, perform intelligent matching according to the uploaded material, and the matched content can remind the user;
即在目标视频中的第一对象与预设的第二对象匹配的情况下,显示第一标识,该第一标识可以是“@用户”的形式,也可以是匹配度数值的形式。That is, when the first object in the target video matches the preset second object, a first identifier is displayed, and the first identifier may be in the form of "@user" or in the form of a matching degree value.
步骤1304,自动把提取到的视频缓存到悬浮球中,按一定的规则进行排序; Step 1304, automatically cache the extracted video into the floating ball, and sort according to certain rules;
换而言之,在确定目标视频为第二对象匹配的视频的情况下,可以将目标视频进行缓存,并在悬浮球中显示目标视频的缩略图,或者是在接收到对悬浮球的输入后,加载一窗口,来显示目标视频的缩略图。In other words, when it is determined that the target video is a video matched by the second object, the target video may be cached, and a thumbnail of the target video may be displayed in the floating ball, or after receiving an input to the floating ball , loads a window to display the thumbnail of the target video.
此外,如上文所示,目标视频与第二对象之间可以存在匹配度关系,可以按照匹配度关系来对目标视频的缩略图进行排序显示,以便用户能够更加快速地查找感兴趣程度高的目标视频。In addition, as shown above, there may be a matching relationship between the target video and the second object, and the thumbnails of the target videos may be sorted and displayed according to the matching relationship, so that the user can find the target with a high degree of interest more quickly video.
当然,在实际应用中,也可以根据接收目标视频的时间顺序等规则,来对目标视频的缩略图进行排序显示。Of course, in practical applications, the thumbnails of the target videos may also be sorted and displayed according to rules such as the time sequence in which the target videos are received.
步骤1305,判断用户针对悬浮球中的视频是否进行了保存、转发等正向操作,若是,执行步骤1306;若否,执行步骤1307; Step 1305, judging whether the user has performed positive operations such as saving and forwarding the video in the floating ball, if so, go to step 1306; if not, go to step 1307;
用户在悬浮球中的视频的缩略图进行输入,可以使得电子设备对相应的视频资源进行相应的处理。The user inputs the thumbnail of the video in the floating ball, which can cause the electronic device to perform corresponding processing on the corresponding video resource.
例如,用户可以长按视频的缩略图,响应于用户的长按输入,可以显示用于保存视频的控件和用于转发视频的控件。在接收到用户对这些控件的输入后,可以相应对视频进行保存与转发。For example, a user may long press a thumbnail of a video, and in response to the user's long press input, a control for saving the video and a control for forwarding the video may be displayed. After receiving the user's input on these controls, the video can be saved and forwarded accordingly.
对视频进行保存与转发,可以认为是用户的正向操作,在一定程度上可以认为用户确实对悬浮球中视频感兴趣。而相反地,用户也可能对视频进行删除的操作,这些操作则可以对应了用户的反向操作。Saving and forwarding the video can be considered as a positive operation of the user. To a certain extent, it can be considered that the user is really interested in the video in the floating ball. Conversely, the user may also perform deletion operations on the video, and these operations may correspond to reverse operations of the user.
步骤1306,响应于正向操作,对视频进行保存或转发等操作,同时释放位于悬浮球中视频所占用的缓存资源。 Step 1306, in response to the forward operation, perform operations such as saving or forwarding the video, and at the same time release the cache resources occupied by the video in the floating ball.
步骤1307,响应于删除操作,对视频进行舍弃,释放位于悬浮球中视 频所占用的缓存资源。 Step 1307, in response to the delete operation, the video is discarded, and the cache resources occupied by the video in the floating ball are released.
结合以上具有应用场景可见,基于本申请实施例提供的视频处理方法,用户在上传素材资源的情况下,电子设备可以自动在后台进行视频资源匹配算法任务,匹配完成后,在群组中指定到匹配到的视频提醒用户,让用户有所选择参考。另外还可以将匹配得到视频缓存在悬浮球队列中,方便用户进行快捷操作,用户可以快速进行保存、转发等操作,达到节省用户时间的目的,让用户更加聚焦于自己所关心的内容。在呈现方式上不仅仅可以是匹配相关度最高的几个通知用户,还可以是通过匹配度比例告诉用户一个匹配的优先等级,更加精细化的给予用户参考意见,也对于用户的决策更加精准,更加有参考意义。Combining the above application scenarios, it can be seen that based on the video processing method provided by the embodiment of the present application, when the user uploads material resources, the electronic device can automatically perform video resource matching algorithm tasks in the background. The matched video reminds the user, allowing the user to choose a reference. In addition, the matched video can be cached in the floating team queue, which is convenient for users to perform quick operations. Users can quickly save, forward and other operations to save users time and allow users to focus more on the content they care about. In terms of presentation, users can be notified not only of the most relevant matching matches, but also tell users a matching priority level through the matching degree ratio, give users more detailed reference opinions, and make user decisions more accurate. It is more informative.
需要说明的是,本申请实施例提供的视频处理方法,执行主体可以为视频处理装置,或者该视频处理装置中的用于执行视频处理方法的控制模块。本申请实施例中以视频处理装置执行视频处理方法为例,说明本申请实施例提供的视频处理装置。It should be noted that, the video processing method provided in the embodiment of the present application may be executed by a video processing device, or a control module in the video processing device for executing the video processing method. In the embodiment of the present application, the video processing device provided in the embodiment of the present application is described by taking the video processing device executing the video processing method as an example.
如图14所示,本申请实施例提供的视频处理装置1400,包括:As shown in Figure 14, the video processing device 1400 provided in the embodiment of the present application includes:
接收模块1401,用于接收目标聊天对象发送的目标视频;The receiving module 1401 is used to receive the target video sent by the target chat object;
第一显示模块1402,用于在目标视频中的第一对象与预设的第二对象匹配的情况下,显示第一标识,第一标识用于指示目标视频包括第二对象。The first display module 1402 is configured to display a first identification when the first object in the target video matches a preset second object, and the first identification is used to indicate that the target video includes the second object.
可选地,目标聊天对象为目标聊天群组中的对象;Optionally, the target chat object is an object in the target chat group;
相应地,视频处理装置1400还可以包括:Correspondingly, the video processing device 1400 may also include:
第一获取模块,用于获取预设的与目标聊天群组关联的第二对象;The first obtaining module is used to obtain a preset second object associated with the target chat group;
比对模块,用于将第一对象与第二对象进行相似度比对;A comparison module, configured to compare the similarity between the first object and the second object;
确定模块,用于在第一对象与第二对象的相似度大于相似度阈值的情况下,确定第一对象与第二对象匹配。A determining module, configured to determine that the first object matches the second object when the similarity between the first object and the second object is greater than a similarity threshold.
可选地,视频处理装置1400还可以包括:Optionally, the video processing device 1400 may also include:
第二获取模块,用于获取目标视频中的第一对象与预设的第二对象的匹配度;其中,匹配度用于指示第一对象与第二对象的相似度,或者,匹配度用于指示目标视频中目标图像帧的占比,目标图像帧为包括第一对象的图像帧,第一对象与第二对象之间的相似度大于相似度阈值;The second obtaining module is used to obtain the matching degree between the first object in the target video and the preset second object; wherein, the matching degree is used to indicate the similarity between the first object and the second object, or the matching degree is used for Indicate the proportion of the target image frame in the target video, where the target image frame is an image frame including a first object, and the similarity between the first object and the second object is greater than a similarity threshold;
第二显示模块,用于显示第二标识,第二标识用于指示目标视频中的第一对象与第二对象的匹配度。The second display module is configured to display a second identification, and the second identification is used to indicate the matching degree between the first object and the second object in the target video.
可选地,视频处理装置1400还可以包括:Optionally, the video processing device 1400 may also include:
第三显示模块,用于在目标视频中的第一对象与预设的第二对象匹配的情况下,显示目标窗口,目标窗口包括目标视频的缩略图。The third display module is configured to display a target window when the first object in the target video matches the preset second object, and the target window includes a thumbnail of the target video.
可选地,目标视频的缩略图包括第三标识,第三标识用于指示目标视频中的第一对象与第二对象的匹配度。Optionally, the thumbnail of the target video includes a third identifier, and the third identifier is used to indicate a matching degree between the first object and the second object in the target video.
可选地,目标视频中的第一对象为使用预设的识别模型对目标视频进行识别得到;Optionally, the first object in the target video is obtained by using a preset recognition model to identify the target video;
相应地,视频处理装置1400还可以包括以下至少一项:Correspondingly, the video processing device 1400 may further include at least one of the following:
播放模块,用于在接收到用户对目标窗口中目标视频的缩略图的第一输入的情况下,响应于第一输入,播放目标视频;Playing module, for receiving the user's first input to the thumbnail of the target video in the target window, in response to the first input, play the target video;
第一存储模块,用于在接收到用户对目标窗口中目标视频的缩略图的第二输入的情况下,响应于第二输入,存储目标视频;The first storage module is used to store the target video in response to the second input in the case of receiving the second input of the user to the thumbnail of the target video in the target window;
转发模块,用于在接收到用户对目标窗口中目标视频的缩略图的第三输入的情况下,响应于第三输入,转发目标视频;The forwarding module is used to forward the target video in response to the third input in response to the third input of the thumbnail of the target video in the target window when the user is received;
删除模块,用于在接收到用户对目标窗口中目标视频的缩略图的第四输入的情况下,响应于第四输入,删除目标视频。A deletion module, configured to delete the target video in response to the fourth input in response to the fourth input from the user on the thumbnail of the target video in the target window.
可选地,目标视频中的第一对象为使用预设的识别模型对目标视频进行识别得到;Optionally, the first object in the target video is obtained by using a preset recognition model to identify the target video;
相应地,视频处理装置1400还可以包括:Correspondingly, the video processing device 1400 may also include:
训练模块,用于在接收到用户对目标视频的第五输入的情况下,响应于第五输入,将目标视频作为训练样本,对识别模型进行训练;The training module is used to train the recognition model by using the target video as a training sample in response to the fifth input when receiving the fifth input from the user to the target video;
其中,第五输入用于存储或转发目标视频。Wherein, the fifth input is used for storing or forwarding the target video.
可选地,视频处理装置1400还可以包括:Optionally, the video processing device 1400 may also include:
第四显示模块,用于显示设置界面,设置界面中包括有P个文件标识,一个文件标识指示一个影像文件,P为正整数;The fourth display module is used to display the setting interface, the setting interface includes P file identifiers, one file identifier indicates an image file, and P is a positive integer;
第五显示模块,用于在接收到用户对Q个文件标识的选择输入的情况下,显示至少一个候选聊天群组选项,Q为小于或等于P的正整数;The fifth display module is used to display at least one candidate chat group option when receiving the user's selection input of Q file identifiers, where Q is a positive integer less than or equal to P;
识别模块,用于在接收到用户对至少一个候选聊天群组选项中的目标聊天群组选项的选择输入的情况下,识别Q个文件标识指示的Q个影像文件中的第二对象;The identification module is used to identify the second object in the Q image files indicated by the Q file identifiers when receiving the user's selection input of the target chat group option in at least one candidate chat group option;
第二存储模块,用于将Q个影像文件中的第二对象与目标聊天群组选项对应的目标聊天群组关联存储。The second storage module is used for associating and storing the second object in the Q image files and the target chat group corresponding to the target chat group option.
本申请实施例提供的视频处理装置,接收目标聊天对象发送的目标视频,在目标视频中的第一对象与预设的第二对象的情况下,显示用于指示该目标视频包括第二对象的第一标识,有助于用户快速查找到感兴趣的视频。此外,在目标视频中的第一对象与预设的第二对象的情况下,还可以显示用于指示目标视频中的第一对象与第二对象之间的匹配度的第二标识,为用户选择优先观看的目标视频提供依据。通过目标窗口,显示目标视频的缩略图,可以方便用户对目标视频进行快捷操作,有效提升用户的使用体验。The video processing device provided in the embodiment of the present application receives the target video sent by the target chat object, and displays a message indicating that the target video includes the second object in the case of the first object in the target video and the preset second object. The first logo helps users to quickly find the video they are interested in. In addition, in the case of the first object in the target video and the preset second object, a second identification for indicating the matching degree between the first object and the second object in the target video may also be displayed, which is for the user Provide a basis for selecting the target video for priority viewing. Through the target window, the thumbnail of the target video is displayed, which can facilitate the user to perform quick operations on the target video, and effectively improve the user experience.
本申请实施例中的视频处理装置可以是装置,也可以是终端中的部件、集成电路、或芯片。该装置可以是移动电子设备,也可以为非移动电子设备。示例性的,移动电子设备可以为手机、平板电脑、笔记本电脑、掌上电脑、车载电子设备、可穿戴设备、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本或者个人数字助理(personal digital assistant,PDA)等,非移动电子设备可以为服务器、网络附属存储器(Network Attached Storage,NAS)、个人计算机(personal computer,PC)、电视机(television,TV)、柜员机或者自助机等,本申请实施例不作具体限定。The video processing device in this embodiment of the present application may be a device, or may be a component, an integrated circuit, or a chip in a terminal. The device may be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a handheld computer, a vehicle electronic device, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant). assistant, PDA), etc., non-mobile electronic devices can be servers, network attached storage (Network Attached Storage, NAS), personal computer (personal computer, PC), television (television, TV), teller machine or self-service machine, etc., this application Examples are not specifically limited.
本申请实施例中的视频处理装置可以为具有操作系统的装置。该操作系统可以为安卓(Android)操作系统,可以为iOS操作系统,还可以为其他可能的操作系统,本申请实施例不作具体限定。The video processing device in this embodiment of the present application may be a device with an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in this embodiment of the present application.
本申请实施例提供的视频处理装置能够实现图1至图13的方法实施例实现的各个过程,为避免重复,这里不再赘述。The video processing device provided in the embodiment of the present application can implement various processes implemented by the method embodiments in FIG. 1 to FIG. 13 , and details are not repeated here to avoid repetition.
本申请实施例还提供一种电子设备,用于执行上述视频处理方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。The embodiment of the present application also provides an electronic device, which is used to execute each process of the above video processing method embodiment, and can achieve the same technical effect. To avoid repetition, details are not repeated here.
可选地,如图15所示,本申请实施例还提供一种电子设备1500,包括处理器1501,存储器1502,存储在存储器1502上并可在处理器1501上运行的程序或指令,该程序或指令被处理器1501执行时实现上述的视频处理方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。Optionally, as shown in FIG. 15 , the embodiment of the present application also provides an electronic device 1500, including a processor 1501, a memory 1502, and a program or instruction stored in the memory 1502 and operable on the processor 1501. The program Or, when the instruction is executed by the processor 1501, each process of the above-mentioned video processing method embodiment can be realized, and the same technical effect can be achieved. To avoid repetition, details are not repeated here.
需要说明的是,本申请实施例中的电子设备包括上述的移动电子设备和非移动电子设备。It should be noted that the electronic devices in the embodiments of the present application include the above-mentioned mobile electronic devices and non-mobile electronic devices.
图16为实现本申请实施例的一种电子设备的硬件结构示意图。FIG. 16 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
该电子设备1600包括但不限于:射频单元1601、网络模块1602、音频输出单元1603、输入单元1604、传感器1605、显示单元1606、用户输入单元1607、接口单元1608、存储器1609、以及处理器1610等部件。The electronic device 1600 includes, but is not limited to: a radio frequency unit 1601, a network module 1602, an audio output unit 1603, an input unit 1604, a sensor 1605, a display unit 1606, a user input unit 1607, an interface unit 1608, a memory 1609, and a processor 1610, etc. part.
本领域技术人员可以理解,电子设备1600还可以包括给各个部件供电的电源(比如电池),电源可以通过电源管理系统与处理器1610逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。图16中示出的电子设备结构并不构成对电子设备的限定,电子设备可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置,在此不再赘述。Those skilled in the art can understand that the electronic device 1600 can also include a power supply (such as a battery) for supplying power to various components, and the power supply can be logically connected to the processor 1610 through the power management system, so that the management of charging, discharging, and function can be realized through the power management system. Consumption management and other functions. The structure of the electronic device shown in FIG. 16 does not constitute a limitation to the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine some components, or arrange different components, which will not be repeated here. .
其中,射频单元1601,用于接收目标聊天对象发送的目标视频;Wherein, the radio frequency unit 1601 is used to receive the target video sent by the target chat object;
显示单元1606,用于在目标视频中的第一对象与预设的第二对象匹配的情况下,显示第一标识,第一标识用于指示目标视频包括第二对象。The display unit 1606 is configured to display a first identification when the first object in the target video matches a preset second object, where the first identification is used to indicate that the target video includes the second object.
本申请实施例提供的电子设备,接收目标聊天对象发送的目标视频,在目标视频中的第一对象与预设的第二对象匹配的情况下,显示可用于指示目标视频包括第二对象的第一标识。本申请实施例,第二对象可以是用户预设的感兴趣内容,通过对与第二对象匹配的目标视频显示第一标识,有助于用户高效获取到存在感兴趣内容的视频。The electronic device provided in the embodiment of the present application receives the target video sent by the target chat object, and displays the second object that can be used to indicate that the target video includes the second object when the first object in the target video matches the preset second object. a logo. In this embodiment of the present application, the second object may be the content of interest preset by the user. By displaying the first logo on the target video that matches the second object, it is helpful for the user to efficiently obtain the video with the content of interest.
可选地,目标聊天对象为目标聊天群组中的对象;Optionally, the target chat object is an object in the target chat group;
相应地,处理器1610,可用于获取预设的与目标聊天群组关联的第二对象;Correspondingly, the processor 1610 may be configured to acquire a preset second object associated with the target chat group;
将第一对象与第二对象进行相似度比对;Comparing the similarity between the first object and the second object;
在第一对象与第二对象的相似度大于相似度阈值的情况下,确定第一对象与第二对象匹配。If the similarity between the first object and the second object is greater than the similarity threshold, it is determined that the first object matches the second object.
可选地,处理器1610,可用于获取目标视频中的第一对象与预设的第二对象的匹配度;其中,匹配度用于指示第一对象与第二对象的相似度,或者,匹配度用于指示目标视频中目标图像帧的占比,目标图像帧为包括第一对象的图像帧,第一对象与第二对象之间的相似度大于相似度阈值;Optionally, the processor 1610 may be configured to acquire a degree of matching between the first object in the target video and a preset second object; wherein, the degree of matching is used to indicate the degree of similarity between the first object and the second object, or, the degree of matching The degree is used to indicate the proportion of the target image frame in the target video, the target image frame is an image frame including the first object, and the similarity between the first object and the second object is greater than the similarity threshold;
显示单元1606,可用于显示第二标识,第二标识用于指示目标视频中的第一对象与第二对象的匹配度。The display unit 1606 may be configured to display a second identifier, where the second identifier is used to indicate a matching degree between the first object and the second object in the target video.
可选地,显示单元1606,还可以用于在目标视频中的第一对象与预设的第二对象匹配的情况下,显示目标窗口,目标窗口包括目标视频的缩略图。。Optionally, the display unit 1606 may also be configured to display a target window when the first object in the target video matches a preset second object, and the target window includes a thumbnail of the target video. .
可选地,目标视频的缩略图包括第三标识,第三标识用于指示目标视频中的第一对象与第二对象的匹配度。Optionally, the thumbnail of the target video includes a third identifier, and the third identifier is used to indicate a matching degree between the first object and the second object in the target video.
可选地,处理器1610,可以用于以下至少一项:Optionally, the processor 1610 may be used for at least one of the following:
在接收到用户对目标窗口中目标视频的缩略图的第一输入的情况下,响应于第一输入,播放目标视频;In the case of receiving the user's first input to the thumbnail of the target video in the target window, in response to the first input, play the target video;
在接收到用户对目标窗口中目标视频的缩略图的第二输入的情况下,响应于第二输入,存储目标视频;storing the target video in response to the second input in response to receiving a second user input of a thumbnail image of the target video in the target window;
在接收到用户对目标窗口中目标视频的缩略图的第三输入的情况下,响应于第三输入,转发目标视频;In the case of receiving a third input from the user to the thumbnail of the target video in the target window, forwarding the target video in response to the third input;
在接收到用户对目标窗口中目标视频的缩略图的第四输入的情况下,响应于第四输入,删除目标视频。In case a user's fourth input of the thumbnail of the target video in the target window is received, the target video is deleted in response to the fourth input.
可选地,目标视频中的第一对象为使用预设的识别模型对目标视频进行识别得到;Optionally, the first object in the target video is obtained by using a preset recognition model to identify the target video;
相应地,处理器1610,可用于在接收到用户对目标视频的第五输入的情况下,响应于第五输入,将目标视频作为训练样本,对识别模型进行训练;Correspondingly, the processor 1610 may be configured to, in the case of receiving a fifth input from the user on the target video, respond to the fifth input, and use the target video as a training sample to train the recognition model;
其中,第五输入用于存储或转发目标视频。Wherein, the fifth input is used for storing or forwarding the target video.
可选地,显示单元1606,还用于显示设置界面,设置界面中包括有P 个文件标识,一个文件标识指示一个影像文件,P为正整数;Optionally, the display unit 1606 is also used to display a setting interface, the setting interface includes P file identifiers, one file identifier indicates an image file, and P is a positive integer;
在接收到用户对Q个文件标识的选择输入的情况下,显示至少一个候选聊天群组选项,Q为小于或等于P的正整数;In the case of receiving user selection input on Q file identifiers, at least one candidate chat group option is displayed, where Q is a positive integer less than or equal to P;
相应地,处理器1610,可用于在接收到用户对至少一个候选聊天群组选项中的目标聊天群组选项的选择输入的情况下,识别Q个文件标识指示的Q个影像文件中的第二对象;Correspondingly, the processor 1610 may be configured to identify the second one of the Q image files indicated by the Q file identifiers in the case of receiving the user's selection input of the target chat group option in at least one candidate chat group option. object;
将Q个影像文件中的第二对象与目标聊天群组选项对应的目标聊天群组关联存储。The second object in the Q image files is stored in association with the target chat group corresponding to the target chat group option.
应理解的是,本申请实施例中,输入单元1604可以包括图形处理器(Graphics Processing Unit,GPU)16041和麦克风16042,图形处理器16041对在视频捕获模式或图像捕获模式中由图像捕获装置(如摄像头)获得的静态图片或视频的图像数据进行处理。显示单元1606可包括显示面板16061,可以采用液晶显示器、有机发光二极管等形式来配置显示面板16061。用户输入单元1607包括触控面板16071以及其他输入设备16072。触控面板16071,也称为触摸屏。触控面板16071可包括触摸检测装置和触摸控制器两个部分。其他输入设备16072可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆,在此不再赘述。存储器1609可用于存储软件程序以及各种数据,包括但不限于应用程序和操作系统。处理器1610可集成应用处理器和调制解调处理器,其中,应用处理器主要处理操作系统、用户界面和应用程序等,调制解调处理器主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到处理器1610中。It should be understood that, in this embodiment of the present application, the input unit 1604 may include a graphics processor (Graphics Processing Unit, GPU) 16041 and a microphone 16042, and the graphics processor 16041 is used for the image capture device ( Such as the image data of the still picture or video obtained by the camera) for processing. The display unit 1606 may include a display panel 16061, and the display panel 16061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1607 includes a touch panel 16071 and other input devices 16072 . Touch panel 16071, also called touch screen. The touch panel 16071 may include two parts: a touch detection device and a touch controller. Other input devices 16072 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which will not be repeated here. Memory 1609 can be used to store software programs as well as various data, including but not limited to application programs and operating systems. The processor 1610 may integrate an application processor and a modem processor, wherein the application processor mainly processes operating systems, user interfaces, and application programs, and the modem processor mainly processes wireless communications. It can be understood that the foregoing modem processor may not be integrated into the processor 1610 .
本申请实施例还提供一种可读存储介质,可读存储介质上存储有程序或指令,该程序或指令被处理器执行时实现上述视频处理方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。The embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, each process of the above video processing method embodiment is realized, and the same technology can be achieved. Effect, in order to avoid repetition, will not repeat them here.
其中,处理器为上述实施例中的电子设备中的处理器。可读存储介质,包括计算机可读存储介质,如计算机只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等的非暂态计算机可读存储介质。Wherein, the processor is the processor in the electronic device in the foregoing embodiments. Readable storage medium, including computer readable storage medium, such as computer read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk, etc. non-transitory computer readable storage medium.
本申请实施例还提供一种计算机程序产品,所述计算机程序产品可被处理器执行以实现上述视频处理方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。The embodiment of the present application also provides a computer program product, the computer program product can be executed by a processor to implement the various processes of the above video processing method embodiment, and can achieve the same technical effect, in order to avoid repetition, it will not be repeated here .
本申请实施例另提供了一种芯片,芯片包括处理器和通信接口,通信接口和处理器耦合,处理器用于运行程序或指令,实现上述视频处理方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。The embodiment of the present application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above video processing method embodiments, and can achieve the same Technical effects, in order to avoid repetition, will not be repeated here.
应理解,本申请实施例提到的芯片还可以称为系统级芯片、系统芯片、芯片系统或片上系统芯片等。It should be understood that the chips mentioned in the embodiments of the present application may also be called system-on-chip, system-on-chip, system-on-a-chip, or system-on-a-chip.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。此外,需要指出的是,本申请实施方式中的方法和装置的范围不限按示出或讨论的顺序来执行功能,还可包括根据所涉及的功能按基本同时的方式或按相反的顺序来执行功能,例如,可以按不同于所描述的次序来执行所描述的方法,并且还可以添加、省去、或组合各种步骤。另外,参照某些示例所描述的特征可在其他示例中被组合。It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising that element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved. Functions are performed, for example, the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以计算机软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端(可以是手机,计算机,服务器,或者网络设备等)执行本申请各个实施例的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation. Based on such an understanding, the technical solution of the present application can be embodied in the form of computer software products, which are stored in a storage medium (such as ROM/RAM, magnetic disk, etc.) , optical disc), including several instructions to enable a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods of various embodiments of the present application.
上面结合附图对本申请的实施例进行了描述,但是本申请并不局限于上述的具体实施方式,上述的具体实施方式仅仅是示意性的,而不是限制 性的,本领域的普通技术人员在本申请的启示下,在不脱离本申请宗旨和权利要求所保护的范围情况下,还可做出很多形式,均属于本申请的保护之内。The embodiments of the present application have been described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementations. The above-mentioned specific implementations are only illustrative and not restrictive. Those of ordinary skill in the art will Under the inspiration of this application, without departing from the purpose of this application and the scope of protection of the claims, many forms can also be made, all of which belong to the protection of this application.

Claims (21)

  1. 一种视频处理方法,包括:A video processing method, comprising:
    接收目标聊天对象发送的目标视频;Receive the target video sent by the target chat partner;
    在所述目标视频中的第一对象与预设的第二对象匹配的情况下,显示第一标识,所述第一标识用于指示所述目标视频包括所述第二对象。If the first object in the target video matches the preset second object, a first identification is displayed, where the first identification is used to indicate that the target video includes the second object.
  2. 根据权利要求1所述的方法,其中,所述目标聊天对象为目标聊天群组中的对象;The method according to claim 1, wherein the target chat object is an object in a target chat group;
    所述接收目标聊天对象发送的目标视频之后,所述方法还包括:After receiving the target video sent by the target chat object, the method also includes:
    获取预设的与所述目标聊天群组关联的第二对象;Acquiring a preset second object associated with the target chat group;
    将所述第一对象与第二对象进行相似度比对;performing a similarity comparison between the first object and the second object;
    在所述第一对象与所述第二对象的相似度大于相似度阈值的情况下,确定所述第一对象与所述第二对象匹配。If the similarity between the first object and the second object is greater than a similarity threshold, it is determined that the first object matches the second object.
  3. 根据权利要求1所述的方法,其中,所述接收目标聊天对象发送的目标视频之后,所述方法还包括:The method according to claim 1, wherein, after receiving the target video sent by the target chat object, the method further comprises:
    获取所述目标视频中的第一对象与预设的第二对象的匹配度;所述匹配度用于指示所述第一对象与所述第二对象的相似度,或者,所述匹配度用于指示所述目标视频中目标图像帧的占比,所述目标图像帧为包括第一对象的图像帧,所述第一对象与所述第二对象之间的相似度大于相似度阈值;Obtain the matching degree between the first object in the target video and the preset second object; the matching degree is used to indicate the similarity between the first object and the second object, or, the matching degree is used To indicate the proportion of a target image frame in the target video, the target image frame is an image frame including a first object, and the similarity between the first object and the second object is greater than a similarity threshold;
    显示第二标识,所述第二标识用于指示所述目标视频中的第一对象与所述第二对象的匹配度。Displaying a second identifier, where the second identifier is used to indicate a matching degree between the first object and the second object in the target video.
  4. 根据权利要求1所述的方法,其中,所述接收目标聊天对象发送的目标视频之后,所述方法还包括:The method according to claim 1, wherein, after receiving the target video sent by the target chat object, the method further comprises:
    在所述目标视频中的第一对象与预设的第二对象匹配的情况下,显示目标窗口,所述目标窗口包括所述目标视频的缩略图。If the first object in the target video matches the preset second object, a target window is displayed, and the target window includes a thumbnail of the target video.
  5. 根据权利要求4所述的方法,其中,所述目标视频的缩略图包括第 三标识,所述第三标识用于指示所述目标视频中的第一对象与所述第二对象的匹配度。The method according to claim 4, wherein the thumbnail of the target video includes a third mark, and the third mark is used to indicate a degree of matching between the first object and the second object in the target video.
  6. 根据权利要求4所述的方法,其中,所述显示目标窗口之后,所述方法还包括以下至少一项:The method according to claim 4, wherein after the target window is displayed, the method further comprises at least one of the following:
    在接收到用户对所述目标窗口中所述目标视频的缩略图的第一输入的情况下,响应于所述第一输入,播放所述目标视频;In the case of receiving a user's first input to the thumbnail of the target video in the target window, playing the target video in response to the first input;
    在接收到用户对所述目标窗口中所述目标视频的缩略图的第二输入的情况下,响应于所述第二输入,存储所述目标视频;storing the target video in response to receiving a second user input of a thumbnail of the target video in the target window in response to the second input;
    在接收到用户对所述目标窗口中所述目标视频的缩略图的第三输入的情况下,响应于所述第三输入,转发所述目标视频;In case a third input of the thumbnail of the target video in the target window by the user is received, forwarding the target video in response to the third input;
    在接收到用户对所述目标窗口中所述目标视频的缩略图的第四输入的情况下,响应于所述第四输入,删除所述目标视频。In case a fourth user input on the thumbnail of the target video in the target window is received, the target video is deleted in response to the fourth input.
  7. 根据权利要求1所述的方法,其中,所述目标视频中的第一对象为使用预设的识别模型对所述目标视频进行识别得到;The method according to claim 1, wherein the first object in the target video is obtained by using a preset recognition model to identify the target video;
    所述显示第一标识之后,所述方法还包括:After the display of the first logo, the method further includes:
    在接收到用户对所述目标视频的第五输入的情况下,响应于所述第五输入,将所述目标视频作为训练样本,对所述识别模型进行训练;In the case of receiving a fifth input from the user to the target video, in response to the fifth input, using the target video as a training sample to train the recognition model;
    所述第五输入用于存储或转发所述目标视频。The fifth input is used for storing or forwarding the target video.
  8. 根据权利要求1所述的方法,其中,所述接收目标聊天对象发送的目标视频之前,所述方法还包括:The method according to claim 1, wherein, before receiving the target video sent by the target chat object, the method further comprises:
    显示设置界面,所述设置界面中包括有P个文件标识,一个文件标识指示一个影像文件,P为正整数;Displaying a setting interface, the setting interface includes P file identifiers, one file identifier indicates an image file, and P is a positive integer;
    在接收到用户对Q个所述文件标识的选择输入的情况下,显示至少一个候选聊天群组选项,Q为小于或等于P的正整数;In the case of receiving the user's selection input of Q said file identifiers, at least one candidate chat group option is displayed, where Q is a positive integer less than or equal to P;
    在接收到用户对所述至少一个候选聊天群组选项中的目标聊天群组选项的选择输入的情况下,识别Q个所述文件标识指示的Q个影像文件中的第二对象;In the case of receiving the user's selection input of the target chat group option in the at least one candidate chat group option, identifying the second object in the Q image files indicated by the Q file identifiers;
    将所述Q个影像文件中的第二对象与所述目标聊天群组选项对应的目 标聊天群组关联存储。The second object in the Q image files is stored in association with the target chat group corresponding to the target chat group option.
  9. 一种视频处理装置,包括:A video processing device, comprising:
    接收模块,用于接收目标聊天对象发送的目标视频;The receiving module is used to receive the target video sent by the target chat object;
    第一显示模块,用于在所述目标视频中的第一对象与预设的第二对象匹配的情况下,显示第一标识,所述第一标识用于指示所述目标视频包括所述第二对象。The first display module is configured to display a first identification when the first object in the target video matches a preset second object, and the first identification is used to indicate that the target video includes the first object. Two objects.
  10. 根据权利要求9所述的装置,其中,所述目标聊天对象为目标聊天群组中的对象;The device according to claim 9, wherein the target chat object is an object in a target chat group;
    所述装置还包括:The device also includes:
    第一获取模块,用于获取预设的与所述目标聊天群组关联的第二对象;A first acquiring module, configured to acquire a preset second object associated with the target chat group;
    比对模块,用于将所述第一对象与第二对象进行相似度比对;A comparison module, configured to perform a similarity comparison between the first object and the second object;
    确定模块,用于在所述第一对象与所述第二对象的相似度大于相似度阈值的情况下,确定所述第一对象与所述第二对象匹配。A determining module, configured to determine that the first object matches the second object when the similarity between the first object and the second object is greater than a similarity threshold.
  11. 根据权利要求9所述的装置,还包括:The apparatus of claim 9, further comprising:
    第二获取模块,用于获取所述目标视频中的第一对象与预设的第二对象的匹配度;所述匹配度用于指示所述第一对象与所述第二对象的相似度,或者,所述匹配度用于指示所述目标视频中目标图像帧的占比,所述目标图像帧为包括第一对象的图像帧,所述第一对象与所述第二对象之间的相似度大于相似度阈值;The second obtaining module is used to obtain the matching degree between the first object in the target video and the preset second object; the matching degree is used to indicate the similarity between the first object and the second object, Alternatively, the matching degree is used to indicate the proportion of the target image frame in the target video, the target image frame is an image frame including the first object, and the similarity between the first object and the second object The degree is greater than the similarity threshold;
    第二显示模块,用于显示第二标识,所述第二标识用于指示所述目标视频中的第一对象与所述第二对象的匹配度。The second display module is configured to display a second identification, and the second identification is used to indicate the matching degree between the first object and the second object in the target video.
  12. 根据权利要求9所述的装置,还包括:The apparatus of claim 9, further comprising:
    第三显示模块,用于在所述目标视频中的第一对象与预设的第二对象匹配的情况下,显示目标窗口,所述目标窗口包括所述目标视频的缩略图。A third display module, configured to display a target window when the first object in the target video matches a preset second object, where the target window includes a thumbnail of the target video.
  13. 根据权利要求12所述的装置,其中,所述目标视频的缩略图包括第三标识,所述第三标识用于指示所述目标视频中的第一对象与所述第二对象的匹配度。The device according to claim 12, wherein the thumbnail of the target video includes a third identifier, and the third identifier is used to indicate a degree of matching between the first object and the second object in the target video.
  14. 根据权利要求12所述的装置,还包括以下至少一项:The apparatus of claim 12, further comprising at least one of the following:
    播放模块,用于在接收到用户对所述目标窗口中所述目标视频的缩略图的第一输入的情况下,响应于所述第一输入,播放所述目标视频;A playing module, configured to play the target video in response to the first input in response to the first input from the user on the thumbnail of the target video in the target window;
    第一存储模块,用于在接收到用户对所述目标窗口中所述目标视频的缩略图的第二输入的情况下,响应于所述第二输入,存储所述目标视频;A first storage module, configured to store the target video in response to the second input in response to receiving a second input from the user on the thumbnail of the target video in the target window;
    转发模块,用于在接收到用户对所述目标窗口中所述目标视频的缩略图的第三输入的情况下,响应于所述第三输入,转发所述目标视频;A forwarding module, configured to forward the target video in response to the third input in response to receiving a third input from the user on the thumbnail of the target video in the target window;
    删除模块,用于在接收到用户对所述目标窗口中所述目标视频的缩略图的第四输入的情况下,响应于所述第四输入,删除所述目标视频。A deletion module, configured to delete the target video in response to the fourth input in response to the fourth input from the user on the thumbnail of the target video in the target window.
  15. 根据权利要求9所述的装置,其中,所述目标视频中的第一对象为使用预设的识别模型对所述目标视频进行识别得到;The device according to claim 9, wherein the first object in the target video is obtained by using a preset recognition model to identify the target video;
    所述装置还包括:The device also includes:
    训练模块,用于在接收到用户对所述目标视频的第五输入的情况下,响应于所述第五输入,将所述目标视频作为训练样本,对所述识别模型进行训练;A training module, configured to use the target video as a training sample to train the recognition model in response to the fifth input when receiving the fifth input from the user to the target video;
    所述第五输入用于存储或转发所述目标视频。The fifth input is used for storing or forwarding the target video.
  16. 根据权利要求9所述的装置,还包括:The apparatus of claim 9, further comprising:
    第四显示模块,用于显示设置界面,所述设置界面中包括有P个文件标识,一个文件标识指示一个影像文件,P为正整数;The fourth display module is used to display a setting interface, the setting interface includes P file identifiers, one file identifier indicates an image file, and P is a positive integer;
    第五显示模块,用于在接收到用户对Q个所述文件标识的选择输入的情况下,显示至少一个候选聊天群组选项,Q为小于或等于P的正整数;The fifth display module is used to display at least one candidate chat group option when receiving the user's selection input of Q said file identifiers, where Q is a positive integer less than or equal to P;
    识别模块,用于在接收到用户对所述至少一个候选聊天群组选项中的目标聊天群组选项的选择输入的情况下,识别Q个所述文件标识指示的Q个影像文件中的第二对象;An identifying module, configured to identify the second one of the Q image files indicated by the Q file identifiers in the case of receiving the user's selection input of the target chat group option in the at least one candidate chat group option. object;
    第二存储模块,用于将所述Q个影像文件中的第二对象与所述目标聊天群组选项对应的目标聊天群组关联存储。The second storage module is configured to associate and store the second object in the Q image files with the target chat group corresponding to the target chat group option.
  17. 一种电子设备,包括处理器,存储器及存储在所述存储器上并可在所述处理器上运行的程序或指令,所述程序或指令被所述处理器执行时 实现如权利要求1-8中任一项所述的视频处理方法的步骤。An electronic device, comprising a processor, a memory, and a program or instruction stored in the memory and operable on the processor, when the program or instruction is executed by the processor, claims 1-8 are realized The step of the video processing method described in any one.
  18. 一种电子设备,用于执行如权利要求1-8中任一项所述的视频处理方法的步骤。An electronic device, configured to execute the steps of the video processing method according to any one of claims 1-8.
  19. 一种可读存储介质,所述可读存储介质上存储程序或指令,所述程序或指令被处理器执行时实现如权利要求1-8中任一项所述的视频处理方法的步骤。A readable storage medium storing programs or instructions on the readable storage medium, and implementing the steps of the video processing method according to any one of claims 1-8 when the programs or instructions are executed by a processor.
  20. 一种计算机程序产品,所述计算机程序产品可被处理器执行以实现如权利要求1-8中任一项所述的视频处理方法的步骤。A computer program product, the computer program product can be executed by a processor to implement the steps of the video processing method according to any one of claims 1-8.
  21. 一种芯片,所述芯片包括处理器和通信接口,提供的通信接口和提供的处理器耦合,提供的处理器用于运行程序或指令,实现如权利要求1-8中任一项所述的视频处理方法的步骤。A chip, the chip includes a processor and a communication interface, the provided communication interface is coupled to the provided processor, and the provided processor is used to run programs or instructions to realize the video as described in any one of claims 1-8 The steps of the processing method.
PCT/CN2022/092837 2021-05-20 2022-05-13 Video processing method and apparatus, and electronic device WO2022242577A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110553846.8 2021-05-20
CN202110553846.8A CN113315691B (en) 2021-05-20 2021-05-20 Video processing method and device and electronic equipment

Publications (1)

Publication Number Publication Date
WO2022242577A1 true WO2022242577A1 (en) 2022-11-24

Family

ID=77373804

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/092837 WO2022242577A1 (en) 2021-05-20 2022-05-13 Video processing method and apparatus, and electronic device

Country Status (2)

Country Link
CN (1) CN113315691B (en)
WO (1) WO2022242577A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113315691B (en) * 2021-05-20 2023-02-24 维沃移动通信有限公司 Video processing method and device and electronic equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180034879A1 (en) * 2015-08-17 2018-02-01 E-Plan, Inc. Systems and methods for augmenting electronic content
CN111061912A (en) * 2018-10-16 2020-04-24 华为技术有限公司 Method for processing video file and electronic equipment
CN111314759A (en) * 2020-03-02 2020-06-19 腾讯科技(深圳)有限公司 Video processing method and device, electronic equipment and storage medium
CN111770386A (en) * 2020-05-29 2020-10-13 维沃移动通信有限公司 Video processing method, video processing device and electronic equipment
CN113315691A (en) * 2021-05-20 2021-08-27 维沃移动通信有限公司 Video processing method and device and electronic equipment

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2587826A4 (en) * 2010-10-29 2013-08-07 Huawei Tech Co Ltd Extraction and association method and system for objects of interest in video
CN103020173B (en) * 2012-11-27 2017-02-08 北京百度网讯科技有限公司 Video image information searching method and system for mobile terminal and mobile terminal
CN105488489A (en) * 2015-12-17 2016-04-13 掌赢信息科技(上海)有限公司 Short video message transmitting method, electronic device and system
CN110378247B (en) * 2019-06-26 2023-09-26 腾讯科技(深圳)有限公司 Virtual object recognition method and device, storage medium and electronic device
CN110650367A (en) * 2019-08-30 2020-01-03 维沃移动通信有限公司 Video processing method, electronic device, and medium
CN112084370A (en) * 2020-09-10 2020-12-15 维沃移动通信有限公司 Video processing method and device and electronic equipment
CN112203142A (en) * 2020-12-03 2021-01-08 浙江岩华文化科技有限公司 Video processing method and device, electronic device and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180034879A1 (en) * 2015-08-17 2018-02-01 E-Plan, Inc. Systems and methods for augmenting electronic content
CN111061912A (en) * 2018-10-16 2020-04-24 华为技术有限公司 Method for processing video file and electronic equipment
CN111314759A (en) * 2020-03-02 2020-06-19 腾讯科技(深圳)有限公司 Video processing method and device, electronic equipment and storage medium
CN111770386A (en) * 2020-05-29 2020-10-13 维沃移动通信有限公司 Video processing method, video processing device and electronic equipment
CN113315691A (en) * 2021-05-20 2021-08-27 维沃移动通信有限公司 Video processing method and device and electronic equipment

Also Published As

Publication number Publication date
CN113315691A (en) 2021-08-27
CN113315691B (en) 2023-02-24

Similar Documents

Publication Publication Date Title
US11860935B2 (en) Presenting content items based on previous reactions
US11962547B2 (en) Content item module arrangements
US10712936B2 (en) First electronic device and information processing method applicable to first or second electronic device comprising a first application
WO2022052749A1 (en) Message processing method, apparatus and device, and storage medium
US11425062B2 (en) Recommended content viewed by friends
US20220210100A1 (en) Presenting reactions from friends
WO2022052817A1 (en) Search processing method and apparatus, and terminal and storage medium
US11477143B2 (en) Trending content view count
CN110691028B (en) Message processing method, device, terminal and storage medium
WO2023061313A1 (en) Message display method and apparatus
CN111565143A (en) Instant messaging method, equipment and computer readable storage medium
WO2023061276A1 (en) Data recommendation method and apparatus, electronic device, and storage medium
WO2023024970A1 (en) Information processing method, related device, and readable storage medium
WO2022242577A1 (en) Video processing method and apparatus, and electronic device
CN112783594A (en) Message display method and device and electronic equipment
CN113037925B (en) Information processing method, information processing apparatus, electronic device, and readable storage medium
CN113965614A (en) Session creation method and device and electronic equipment
CN113590008A (en) Chat message display method and device and electronic equipment
CN113099033A (en) Information sending method, information sending device and electronic equipment
WO2023131092A1 (en) Information display method and apparatus
WO2022143661A1 (en) Candidate information display method and apparatus, and electronic device
WO2023284640A1 (en) Picture processing method and electronic device
WO2022222821A1 (en) Information display method and apparatus
CN111324262A (en) Application interface control method, device, terminal and medium
WO2022237877A1 (en) Information processing method and apparatus, and electronic device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22803899

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE