CN110121115B - Method and device for determining wonderful video clip - Google Patents

Method and device for determining wonderful video clip Download PDF

Info

Publication number
CN110121115B
CN110121115B CN201810119195.XA CN201810119195A CN110121115B CN 110121115 B CN110121115 B CN 110121115B CN 201810119195 A CN201810119195 A CN 201810119195A CN 110121115 B CN110121115 B CN 110121115B
Authority
CN
China
Prior art keywords
determining
extreme value
target video
segment
calculation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810119195.XA
Other languages
Chinese (zh)
Other versions
CN110121115A (en
Inventor
杨柳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba China Co Ltd
Original Assignee
Alibaba China Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba China Co Ltd filed Critical Alibaba China Co Ltd
Priority to CN201810119195.XA priority Critical patent/CN110121115B/en
Publication of CN110121115A publication Critical patent/CN110121115A/en
Application granted granted Critical
Publication of CN110121115B publication Critical patent/CN110121115B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25866Management of end-user data
    • H04N21/25891Management of end-user data being end-user preferences
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Social Psychology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Graphics (AREA)
  • Studio Devices (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The disclosure relates to a method and a device for determining a highlight video clip. The method comprises the following steps: obtaining the playing amount of the target video at each calculation moment; determining the extreme value calculation time of the playing amount according to the calculation time corresponding to the maximum value in the playing amount of each calculation time; determining a sub-mirror segment to which the extreme value calculation moment belongs in the target video; and determining a highlight video clip in the target video according to the split mirror clip to which the extreme value calculation moment belongs. According to the method and the device, the highlight video clip can be determined from the target video according to the playing amount of the target video at each calculation moment, the subjective judgment depending on people is avoided, the accuracy of determining the highlight video clip can be improved, the determined highlight video clip is guaranteed to be a popular video clip in the target video, time can be saved, and the labor cost can be reduced.

Description

Method and device for determining highlight video clip
Technical Field
The present disclosure relates to the field of video technologies, and in particular, to a method and an apparatus for determining a highlight video clip.
Background
In the related art, if a highlight video segment in a video needs to be determined, a complete video needs to be watched manually (for example, by a video website operator or a video uploader), the highlight video segment in the video is determined according to subjective judgment and the pop-up amount in each time period, and the video is manually clipped to extract the highlight video segment. This approach relies on human subjective judgment that the artificially identified highlight video segment is not necessarily the most popular video segment in the video. In addition, this method requires a lot of time to determine the highlight video clip, and the labor cost is high.
Disclosure of Invention
In view of this, the present disclosure provides a method and an apparatus for determining a highlight video segment.
According to an aspect of the present disclosure, there is provided a method of determining a highlight video clip, including:
obtaining the playing amount of the target video at each calculation moment;
determining the extreme value calculation time of the playing amount according to the calculation time corresponding to the maximum value in the playing amount of each calculation time;
determining a sub-mirror segment to which the extreme value calculation moment belongs in the target video;
and determining a highlight video clip in the target video according to the split mirror clip to which the extreme value calculation moment belongs.
In a possible implementation manner, determining an extremum calculation time of the play volume according to the calculation time corresponding to the maximum value in the play volumes at the respective calculation times includes:
and determining the calculation time with the maximum playing amount in the calculation times as the extreme value calculation time.
In a possible implementation manner, determining an extremum calculation time of the play volume according to the calculation time corresponding to the maximum value in the play volumes at the respective calculation times includes:
generating a play amount curve corresponding to the target video according to the play amount at each calculation moment;
and determining the calculation time corresponding to the N maximum value points with the maximum playing quantity in the playing quantity curve as the extreme value calculation time, wherein N is a positive integer.
In a possible implementation manner, determining the partial mirror segment to which the extremum calculating time belongs includes:
performing shot segmentation on the target video, and determining the time range of each split-lens segment of the target video;
and determining the partial mirror segment to which the extreme value calculation moment belongs according to the time range of each partial mirror segment.
In a possible implementation manner, determining a highlight video segment in the target video according to the split mirror segment to which the extremum calculation time belongs includes:
and under the condition that the number of the sub-mirror segments to which the extreme value calculation moment belongs is multiple, combining the sub-mirror segments to which the extreme value calculation moments belong to obtain a wonderful video segment in the target video.
According to another aspect of the present disclosure, there is provided a highlight video segment determination apparatus including:
the acquisition module is used for acquiring the playing amount of the target video at each calculation moment;
the first determining module is used for determining the extreme value calculating time of the playing amount according to the calculating time corresponding to the maximum value in the playing amount of each calculating time;
the second determining module is used for determining the split mirror segment to which the extreme value calculating moment belongs in the target video;
and the third determining module is used for determining a highlight video clip in the target video according to the split mirror clip to which the extreme value calculation moment belongs.
In one possible implementation manner, the first determining module is configured to:
and determining the computing time with the maximum playing amount in all the computing times as the extreme value computing time.
In one possible implementation manner, the first determining module includes:
the generating submodule is used for generating a play amount curve corresponding to the target video according to the play amount at each calculation moment;
and the first determining submodule is used for determining the calculation time corresponding to the N maximum value points with the maximum playing quantity in the playing quantity curve as the extreme value calculation time, wherein N is a positive integer.
In one possible implementation manner, the second determining module includes:
the second determining submodule is used for carrying out shot segmentation on the target video and determining the time range of each sub-lens segment of the target video;
and the third determining submodule is used for determining the split mirror segment to which the extreme value calculating moment belongs according to the time range of each split mirror segment.
In one possible implementation manner, the third determining module is configured to:
and under the condition that the number of the sub-mirror segments to which the extreme value calculation moments belong is multiple, combining the sub-mirror segments to which the extreme value calculation moments belong to obtain the wonderful video segments in the target video.
According to another aspect of the present disclosure, there is provided an apparatus for determining a highlight video clip, including: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to perform the above method.
According to another aspect of the present disclosure, there is provided a non-transitory computer readable storage medium having computer program instructions stored thereon, wherein the computer program instructions, when executed by a processor, implement the above-described method.
According to the method and the device for determining the highlight video clip, the playing amount of the target video at each computing moment is obtained, the extreme value computing moment of the playing amount is determined according to the computing moment corresponding to the maximum value in the playing amount of each computing moment, the sub-mirror clip to which the extreme value computing moment belongs is determined, and the highlight video clip in the target video is determined according to the sub-mirror clip to which the extreme value computing moment belongs.
Other features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments, which proceeds with reference to the accompanying drawings.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate exemplary embodiments, features, and aspects of the disclosure and, together with the description, serve to explain the principles of the disclosure.
Fig. 1 shows a flowchart of a method for determining a highlight video segment according to an embodiment of the present disclosure.
Fig. 2 shows an exemplary flowchart of step S12 of the determination method of highlight video segment according to an embodiment of the present disclosure.
Fig. 3 shows an exemplary flowchart of step S13 of the determination method of highlight video segment according to an embodiment of the present disclosure.
Fig. 4 shows a block diagram of a determination apparatus of a highlight video segment according to an embodiment of the present disclosure.
Fig. 5 shows an exemplary block diagram of a highlight video segment determination apparatus according to an embodiment of the present disclosure.
Fig. 6 is a block diagram illustrating an apparatus 800 for highlight video segment determination according to an example embodiment.
Fig. 7 is a block diagram illustrating an apparatus 1900 for highlight video segment determination according to an example embodiment.
Detailed Description
Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. In the drawings, like reference numbers can indicate functionally identical or similar elements. While the various aspects of the embodiments are presented in drawings, the drawings are not necessarily drawn to scale unless specifically indicated.
The word "exemplary" is used exclusively herein to mean "serving as an example, embodiment, or illustration. Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.
Furthermore, in the following detailed description, numerous specific details are set forth in order to provide a better understanding of the present disclosure. It will be understood by those skilled in the art that the present disclosure may be practiced without some of these specific details. In some instances, methods, means, elements and circuits that are well known to those skilled in the art have not been described in detail so as not to obscure the subject matter of the present disclosure.
Fig. 1 shows a flowchart of a method for determining a highlight video segment according to an embodiment of the present disclosure. The method may be applied to a server or a terminal device, and is not limited herein. As shown in fig. 1, the method includes steps S11 to S14.
In step S11, the play amount at each calculation time of the target video is acquired.
Wherein the target video may represent any video for which a highlight video segment needs to be determined.
In one possible implementation, each calculation time of the target video may be 1 second. In this implementation, the play volume per second of the target video may be obtained.
In this embodiment, if the playing amount at a certain calculation time is large, it can be indicated that the video content at the calculation time is popular with the user to a great extent.
In step S12, the extremum calculation time of the play volume is determined based on the calculation time corresponding to the maximum value among the play volumes at the respective calculation times.
And the number of the extreme value calculation moments of the playing amount is one or more.
In a possible implementation manner, determining an extremum calculation time of the play volume according to a calculation time corresponding to a maximum value in the play volumes at each calculation time may include: and determining the calculation time with the maximum playing amount in each calculation time as the extreme value calculation time. In this implementation, one extreme value calculation time may be determined from the respective calculation times of the target video, and the highlight video segment may be determined based on the extreme value calculation time.
In step S13, the partial mirror segment to which the extreme value calculation time belongs in the target video is determined.
In step S14, a highlight video segment in the target video is determined according to the split mirror segment to which the extremum calculation time belongs.
In a possible implementation manner, determining a highlight video segment in the target video according to the partial mirror segment to which the extremum calculation time belongs may include: and under the condition that the number of the sub-mirror segments to which the extreme value calculation moment belongs is one, determining the sub-mirror segments to which the extreme value calculation moment belongs as the wonderful video segments in the target video.
In another possible implementation manner, determining a highlight video segment in the target video according to the split mirror segment to which the extremum calculation time belongs may include: and under the condition that the number of the sub-mirror segments to which the extreme value calculation moments belong is multiple, combining the sub-mirror segments to which the extreme value calculation moments belong to obtain the wonderful video segments in the target video.
According to the method and the device, the playing amount of the target video at each computing time is obtained, the extreme value computing time of the playing amount is determined according to the computing time corresponding to the maximum value in the playing amount of each computing time, the split-mirror segment to which the extreme value computing time belongs is determined, and the highlight video segment in the target video is determined according to the split-mirror segment to which the extreme value computing time belongs, so that the highlight video segment can be determined from the target video according to the playing amount of each computing time of the target video, human-dependent subjective judgment is avoided, accuracy of determining the highlight video segment can be improved, the determined highlight video segment is guaranteed to be a popular video segment in the target video, time can be saved, and labor cost can be reduced.
Fig. 2 shows an exemplary flowchart of step S12 of the determination method of highlight video segment according to an embodiment of the present disclosure. As shown in fig. 2, step S12 may include step S121 and step S122.
In step S121, a playback volume curve corresponding to the target video is generated based on the playback volumes at the respective calculation times.
The horizontal axis of the coordinate corresponding to the play amount curve may be the calculation time, and the vertical axis of the coordinate may be the play amount.
In step S122, the calculation time corresponding to the N maximum value points with the largest playing amount in the playing amount curve is determined as the extremum calculation time, where N is a positive integer.
And the number of the sub-mirror segments to which the computing moments corresponding to the N maximum point points belong is greater than or equal to 1 and less than or equal to N.
Fig. 3 shows an exemplary flowchart of step S13 of the determination method of highlight video segment according to an embodiment of the present disclosure. As shown in fig. 3, step S13 may include step S131 and step S132.
In step S131, shot segmentation is performed on the target video, and the time range of each split segment of the target video is determined.
In a possible implementation manner, performing shot segmentation on the target video, and determining a time range of each split segment of the target video may include: extracting the characteristics of each key frame of the target video; calculating the similarity of the adjacent key frames according to the characteristics of the adjacent key frames; determining that shot switching exists between adjacent key frames under the condition that the similarity of the adjacent key frames is smaller than a first threshold; and determining that the adjacent key frames belong to the same shot when the similarity of the adjacent key frames is greater than or equal to a first threshold. In the case where there is a shot cut between adjacent key frames, a subsequent key frame of the adjacent key frames may be used as a start frame of a new shot. For example, in a case where the key frame 2 is a key frame subsequent to the key frame 1, and there is a shot cut between the key frame 1 and the key frame 2, the key frame 2 may be used as a start frame of a new shot. In this embodiment, a video segment corresponding to one shot of the target video may be determined as one split-mirror segment.
In another possible implementation manner, performing shot segmentation on the target video, and determining a time range of each split-lens segment of the target video may include: and tracking the moving target in the target video by adopting a moving target tracking technology so as to determine the time range of each sub-lens segment of the target video.
In another possible implementation manner, performing shot segmentation on the target video, and determining a time range of each split-lens segment of the target video may include: scene recognition technology is adopted to carry out scene recognition on each key frame of the target video; in the case where scenes of adjacent key frames are different, it may be determined that there is a shot cut between the adjacent key frames.
In step S132, the partial mirror segment to which the extremum value calculating time belongs is determined according to the time range of each partial mirror segment.
For example, the extremum calculating time is 00.
Fig. 4 shows a block diagram of a determination apparatus of a highlight video segment according to an embodiment of the present disclosure. As shown in fig. 4, the apparatus includes: an obtaining module 41, configured to obtain a play amount of each calculation time of the target video; the first determining module 42 is configured to determine an extremum calculation time of the playing amount according to the calculation time corresponding to the maximum value in the playing amounts at each calculation time; a second determining module 43, configured to determine a segment of the target video to which the extreme value calculating time belongs; and the third determining module 44 is configured to determine a highlight video clip in the target video according to the split mirror clip to which the extreme value calculation time belongs.
In one possible implementation, the first determining module 42 is configured to: and determining the calculation time with the maximum playing amount in each calculation time as the extreme value calculation time.
Fig. 5 shows an exemplary block diagram of a highlight video segment determination apparatus according to an embodiment of the present disclosure. As shown in fig. 5:
in one possible implementation, the first determining module 42 includes: the generating submodule 421 is configured to generate a play amount curve corresponding to the target video according to the play amount at each calculation time; the first determining submodule 422 is configured to determine, as an extremum value calculating time, a calculating time corresponding to N maximum value points with the largest play amount in the play amount curve, where N is a positive integer.
In one possible implementation, the second determining module 43 includes: the second determining submodule 431 is used for performing shot segmentation on the target video and determining the time range of each split-lens segment of the target video; and a third determining submodule 432, configured to determine, according to the time range of each partial mirror segment, a partial mirror segment to which the extreme value calculation time belongs.
In one possible implementation, the third determining module 44 is configured to: and under the condition that the number of the sub-mirror segments to which the extreme value calculation moments belong is multiple, combining the sub-mirror segments to which the extreme value calculation moments belong to obtain the wonderful video segments in the target video.
According to the method, the playing amount of the target video at each calculation moment is obtained, the extreme value calculation moment of the playing amount is determined according to the calculation moment corresponding to the maximum value in the playing amount of each calculation moment, the split mirror segment to which the extreme value calculation moment belongs is determined, the split mirror segment to which the moment belongs is calculated according to the extreme value, and the highlight video segment in the target video is determined.
Fig. 6 is a block diagram illustrating an apparatus 800 for highlight video segment determination according to an example embodiment. For example, the apparatus 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.
Referring to fig. 6, the apparatus 800 may include one or more of the following components: processing component 802, memory 804, power component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814, and communication component 816.
The processing component 802 generally controls overall operation of the device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing components 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.
The memory 804 is configured to store various types of data to support operations at the apparatus 800. Examples of such data include instructions for any application or method operating on device 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or non-volatile memory devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
Power components 806 provide power to the various components of device 800. The power components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the apparatus 800.
The multimedia component 808 includes a screen that provides an output interface between the device 800 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 800 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the apparatus 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.
The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 814 includes one or more sensors for providing various aspects of state assessment for the device 800. For example, the sensor assembly 814 may detect the open/closed status of the device 800, the relative positioning of components, such as a display and keypad of the device 800, the sensor assembly 814 may also detect a change in the position of the device 800 or a component of the device 800, the presence or absence of user contact with the device 800, the orientation or acceleration/deceleration of the device 800, and a change in the temperature of the device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object in the absence of any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 816 is configured to facilitate communication between the apparatus 800 and other devices in a wired or wireless manner. The apparatus 800 may access a wireless network based on a communication standard, such as WiFi,2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer-readable storage medium, such as the memory 804, is also provided that includes computer program instructions executable by the processor 820 of the device 800 to perform the above-described methods.
Fig. 7 is a block diagram illustrating an apparatus 1900 for highlight video segment determination in accordance with an exemplary embodiment. For example, the apparatus 1900 may be provided as a server. Referring to fig. 7, the device 1900 includes a processing component 1922 further including one or more processors and memory resources, represented by memory 1932, for storing instructions, e.g., applications, executable by the processing component 1922. The application programs stored in memory 1932 may include one or more modules that each correspond to a set of instructions. Further, the processing component 1922 is configured to execute instructions to perform the above-described method.
The device 1900 may also include a power component 1926 configured to perform power management of the device 1900, a wired or wireless network interface 1950 configured to connect the device 1900 to a network, and an input/output (I/O) interface 1958. The device 1900 may operate based on an operating system stored in memory 1932, such as Windows Server, mac OS XTM, unixTM, linuxTM, freeBSDTM, or the like.
In an exemplary embodiment, a non-transitory computer readable storage medium, such as the memory 1932, is also provided that includes computer program instructions executable by the processing component 1922 of the apparatus 1900 to perform the above-described methods.
The present disclosure may be systems, methods, and/or computer program products. The computer program product may include a computer-readable storage medium having computer-readable program instructions embodied thereon for causing a processor to implement various aspects of the present disclosure.
The computer-readable storage medium may be a tangible device that can hold and store the instructions for use by the instruction execution device. The computer readable storage medium may be, for example, but not limited to, an electronic memory device, a magnetic memory device, an optical memory device, an electromagnetic memory device, a semiconductor memory device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a Static Random Access Memory (SRAM), a portable compact disc read-only memory (CD-ROM), a Digital Versatile Disc (DVD), a memory stick, a floppy disk, a mechanical coding device, such as punch cards or in-groove projection structures having instructions stored thereon, and any suitable combination of the foregoing. Computer-readable storage media as used herein is not to be construed as transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., optical pulses through a fiber optic cable), or electrical signals transmitted through electrical wires.
The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.
The computer program instructions for carrying out operations of the present disclosure may be assembler instructions, instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, the electronic circuitry that can execute the computer-readable program instructions implements aspects of the present disclosure by utilizing the state information of the computer-readable program instructions to personalize the electronic circuitry, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA).
Various aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.
These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
Having described embodiments of the present disclosure, the foregoing description is intended to be exemplary, not exhaustive, and not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein was chosen in order to best explain the principles of the embodiments, the practical application, or technical improvements to the technology in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.

Claims (12)

1. A method for determining highlight video segments, comprising:
acquiring the playing amount of the target video at each calculation moment;
determining the extreme value calculation time of the playing amount according to the calculation time corresponding to the maximum value in the playing amount of each calculation time;
determining a sub-lens segment to which the extreme value calculation moment belongs in the target video, wherein the sub-lens segment is a video segment corresponding to the same shot;
and determining a highlight video clip in the target video according to the split mirror clip to which the extreme value calculation moment belongs.
2. The method of claim 1, wherein determining the extreme value calculation time of the playing amount according to the calculation time corresponding to the maximum value in the playing amounts of the respective calculation times comprises:
and determining the calculation time with the maximum playing amount in the calculation times as the extreme value calculation time.
3. The method of claim 1, wherein determining the extreme value calculation time of the playing amount according to the calculation time corresponding to the maximum value in the playing amounts at the respective calculation times comprises:
generating a play amount curve corresponding to the target video according to the play amount at each calculation moment;
and determining the calculation time corresponding to the N maximum value points with the maximum playing quantity in the playing quantity curve as the extreme value calculation time, wherein N is a positive integer.
4. The method of claim 1, wherein determining the segment of the partial mirror to which the extremum calculating time belongs comprises:
performing shot segmentation on the target video, and determining the time range of each split lens segment of the target video;
and determining the partial mirror segment to which the extreme value calculation moment belongs according to the time range of each partial mirror segment.
5. The method of claim 1, wherein determining the highlight video segment in the target video according to the partial mirror segment to which the extremum calculating time belongs comprises:
and under the condition that the number of the sub-mirror segments to which the extreme value calculation moments belong is multiple, combining the sub-mirror segments to which the extreme value calculation moments belong to obtain the wonderful video segments in the target video.
6. An apparatus for determining highlight video segments, comprising:
the acquisition module is used for acquiring the playing amount of each calculation moment of the target video;
the first determining module is used for determining the extreme value calculating time of the playing amount according to the calculating time corresponding to the maximum value in the playing amount of each calculating time;
the second determining module is used for determining a sub-lens segment to which the extreme value calculation moment belongs in the target video, wherein the sub-lens segment is a video segment corresponding to the same shot;
and the third determining module is used for determining a highlight video clip in the target video according to the split mirror clip to which the extreme value calculation moment belongs.
7. The apparatus of claim 6, wherein the first determining module is configured to:
and determining the calculation time with the maximum playing amount in the calculation times as the extreme value calculation time.
8. The apparatus of claim 6, wherein the first determining module comprises:
the generating submodule is used for generating a play amount curve corresponding to the target video according to the play amount at each calculation moment;
and the first determining submodule is used for determining the calculation time corresponding to the N maximum value points with the maximum playing quantity in the playing quantity curve as the extreme value calculation time, wherein N is a positive integer.
9. The apparatus of claim 6, wherein the second determining module comprises:
the second determining submodule is used for carrying out shot segmentation on the target video and determining the time range of each sub-lens segment of the target video;
and the third determining submodule is used for determining the sub-mirror segment to which the extreme value computing moment belongs according to the time range of each sub-mirror segment.
10. The apparatus of claim 6, wherein the third determining module is configured to:
and under the condition that the number of the sub-mirror segments to which the extreme value calculation moment belongs is multiple, combining the sub-mirror segments to which the extreme value calculation moments belong to obtain a wonderful video segment in the target video.
11. An apparatus for determining a highlight video segment, comprising:
a processor;
a memory for storing processor-executable instructions;
wherein the processor is configured to perform the method of any one of claims 1 to 5.
12. A non-transitory computer readable storage medium having computer program instructions stored thereon, wherein the computer program instructions, when executed by a processor, implement the method of any of claims 1 to 5.
CN201810119195.XA 2018-02-06 2018-02-06 Method and device for determining wonderful video clip Active CN110121115B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810119195.XA CN110121115B (en) 2018-02-06 2018-02-06 Method and device for determining wonderful video clip

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810119195.XA CN110121115B (en) 2018-02-06 2018-02-06 Method and device for determining wonderful video clip

Publications (2)

Publication Number Publication Date
CN110121115A CN110121115A (en) 2019-08-13
CN110121115B true CN110121115B (en) 2023-02-10

Family

ID=67520013

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810119195.XA Active CN110121115B (en) 2018-02-06 2018-02-06 Method and device for determining wonderful video clip

Country Status (1)

Country Link
CN (1) CN110121115B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113992975B (en) * 2021-10-13 2023-10-17 咪咕视讯科技有限公司 Video playing method, device, equipment and computer storage medium
CN115150663B (en) * 2022-07-01 2023-12-15 北京奇艺世纪科技有限公司 Heat curve generation method and device, electronic equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104284216A (en) * 2014-10-23 2015-01-14 Tcl集团股份有限公司 Method and system for generating video highlight clip
CN104410920A (en) * 2014-12-31 2015-03-11 合一网络技术(北京)有限公司 Video segment playback amount-based method for labeling highlights
CN104581400A (en) * 2015-02-10 2015-04-29 飞狐信息技术(天津)有限公司 Video content processing method and video content processing device
CN105635749A (en) * 2014-10-31 2016-06-01 广州市动景计算机科技有限公司 Method and device for generating video frame set
CN106170104A (en) * 2016-07-01 2016-11-30 广州华多网络科技有限公司 Determination method, device and the server of video highlight fragment

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101796580B1 (en) * 2011-11-28 2017-11-14 한국전자통신연구원 Apparatus and method for extracting highlight section of music

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104284216A (en) * 2014-10-23 2015-01-14 Tcl集团股份有限公司 Method and system for generating video highlight clip
CN105635749A (en) * 2014-10-31 2016-06-01 广州市动景计算机科技有限公司 Method and device for generating video frame set
CN104410920A (en) * 2014-12-31 2015-03-11 合一网络技术(北京)有限公司 Video segment playback amount-based method for labeling highlights
CN104581400A (en) * 2015-02-10 2015-04-29 飞狐信息技术(天津)有限公司 Video content processing method and video content processing device
CN106170104A (en) * 2016-07-01 2016-11-30 广州华多网络科技有限公司 Determination method, device and the server of video highlight fragment

Also Published As

Publication number Publication date
CN110121115A (en) 2019-08-13

Similar Documents

Publication Publication Date Title
US20210326587A1 (en) Human face and hand association detecting method and a device, and storage medium
CN107692997B (en) Heart rate detection method and device
CN108985176B (en) Image generation method and device
CN107944409B (en) Video analysis method and device capable of distinguishing key actions
CN108093315B (en) Video generation method and device
CN108259991B (en) Video processing method and device
CN110519655B (en) Video editing method, device and storage medium
CN106960014B (en) Associated user recommendation method and device
CN108924644B (en) Video clip extraction method and device
CN110933488A (en) Video editing method and device
CN110858924B (en) Video background music generation method and device and storage medium
CN106534951B (en) Video segmentation method and device
CN108495168B (en) Bullet screen information display method and device
CN108320208B (en) Vehicle recommendation method and device
CN107508573B (en) Crystal oscillator oscillation frequency correction method and device
CN111523346B (en) Image recognition method and device, electronic equipment and storage medium
CN108174269B (en) Visual audio playing method and device
CN106599191B (en) User attribute analysis method and device
CN110493637B (en) Video splitting method and device
CN109495765B (en) Video interception method and device
CN110633715B (en) Image processing method, network training method and device and electronic equipment
CN110121115B (en) Method and device for determining wonderful video clip
CN109992754B (en) Document processing method and device
CN110955800A (en) Video retrieval method and device
CN110333903B (en) Method and device for determining page loading duration

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20200521

Address after: 310052 room 508, floor 5, building 4, No. 699, Wangshang Road, Changhe street, Binjiang District, Hangzhou City, Zhejiang Province

Applicant after: Alibaba (China) Co.,Ltd.

Address before: 200241 room 1162, building 555, Dongchuan Road, Shanghai, Minhang District

Applicant before: SHANGHAI QUAN TOODOU CULTURAL COMMUNICATION Co.,Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant