CN110769305B

CN110769305B - Video display method and device, block chain system and storage medium

Info

Publication number: CN110769305B
Application number: CN201911168652.5A
Authority: CN
Inventors: 蒋鹏
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2019-09-12
Filing date: 2019-09-12
Publication date: 2021-05-18
Anticipated expiration: 2039-09-12
Also published as: CN110602544B; CN110602544A; CN110769305A

Abstract

The invention provides a video display method and device, a block chain system and a storage medium; the method comprises the following steps: the method comprises the steps that a client node receives a screen recording instruction aiming at a target application in the running process of the target application; based on the screen recording instruction, performing screen recording operation on the current screen content operated by the target application, and acquiring screen recording video information; intercepting at least one video frame or video clip from the screen recording video information, and carrying out specific element analysis and identification processing; when a video frame or a video clip is analyzed or a specific element is identified, acquiring the current time point of the specific element, and obtaining a target video to be pushed to embody the specific element from the screen recording video information based on the current time point; the client node sends the target video to the consensus node; after verifying the authority of the client node successfully, the consensus node fills the target video into a new block, and when the information blocks are in agreement, the new block is added to the tail of the block chain; the client node presents the target video based on the blockchain network.

Description

Video display method and device, block chain system and storage medium

Description of the cases

The present application is proposed based on chinese patent application with application number 201910867381.6, application date 2019, 09/12/h, invention name video display method and apparatus, electronic device, and storage medium, and divisional cases are proposed within the scope of the chinese patent application, and the entire content of the chinese patent application is incorporated herein by reference.

Technical Field

The present invention relates to video processing, image recognition technologies, and block chain technologies, and in particular, to a video display method and apparatus, a block chain system, and a storage medium.

Background

The screen recording software is used for recording the content displayed by the terminal within a period of time, such as: when a player needs to record the game process in the game process, the player can start the screen recording function of the screen recording software before the game starts, and stop the screen recording after the game is finished, so that the screen recording video corresponding to the game process is obtained.

In the related art, when playing back a video recorded on a screen, a current game needs to be switched, the video recorded on the screen needs to be played again, and a certain video frame, such as a highlight video frame, containing specific information is watched by manually dragging the playing progress.

However, in the process of playing the highlight video clip, the player needs to quit the game and play the screen recording video, the process is complicated, and the current game is interrupted.

Disclosure of Invention

Embodiments of the present invention provide a video display method and apparatus, a block chain system, and a storage medium, which can implement playback of video information without interrupting a current operation, and improve intelligence of playing video information including a specific element.

The technical scheme of the embodiment of the invention is realized as follows:

the embodiment of the invention provides a video display method, which is applied to a block chain system comprising a client node and a plurality of consensus nodes and comprises the following steps:

the client node receives a screen recording instruction aiming at a target application in the running process of the target application;

responding to the screen recording instruction, and performing screen recording operation on the current screen content operated by the target application so as to acquire screen recording video information of the target application;

intercepting at least one video frame or video clip from the screen recording video information, and carrying out specific element analysis and identification processing on the video frame or video clip;

when the specific element is analyzed or identified in the video frame or the video clip, acquiring a current time point of the specific element, and acquiring video information with preset duration before and/or after the current time point from the screen recording video information based on the current time point to obtain a target video to be pushed or displayed, wherein the target video embodies the correlation of the theme of the specific element;

the client node sends the target video to a consensus node of a block chain network;

after verifying the authority of the client node successfully, the consensus node fills the target video into a new block, and when the information blocks are in consensus, adds the new block to the tail of a block chain;

and the client node displays a target video related to the specific element theme to a user based on the block chain network.

An embodiment of the present invention provides a block chain system, including: the system comprises a client and a plurality of consensus nodes;

the client node is used for receiving screen recording instructions aiming at the target application in the running process of the target application; responding to the screen recording instruction, and performing screen recording operation on the current screen content operated by the target application so as to acquire screen recording video information of the target application; intercepting at least one video frame or video clip from the screen recording video information, and carrying out specific element analysis and identification processing on the video frame or video clip; when the specific element is analyzed or identified in the video frame or the video clip, acquiring a current time point of the specific element, and acquiring video information with preset duration before and/or after the current time point from the screen recording video information based on the current time point to obtain a target video to be pushed or displayed, wherein the target video embodies the correlation of the theme of the specific element; sending the target video to a consensus node of a block chain network;

the consensus node is used for filling the target video into a new block after the authority of the client node is verified to be successful, and when the information blocks are in consensus, the new block is added to the tail of the block chain;

the client node is further used for showing a target video related to the specific element theme to a user based on the blockchain network.

The embodiment of the invention provides a client node, which is applied to a blockchain system comprising the client node and a plurality of common nodes, wherein the client node comprises:

the device comprises a receiving unit, a display unit and a display unit, wherein the receiving unit is used for receiving a screen recording instruction aiming at a target application in the running process of the target application;

the acquisition unit is used for responding to the screen recording instruction and performing screen recording operation on the current screen content operated by the target application so as to acquire screen recording video information of the target application;

the intercepting unit is used for intercepting at least one video frame or video clip from the screen recording video information;

the identification unit is used for carrying out specific element analysis and identification processing on the video frame or the video segment;

the acquisition unit is used for acquiring the current time point of the specific element when the specific element is analyzed or identified in the video frame or the video clip, and acquiring video information with preset duration before the current time point and/or after the current time point from the screen recording video information based on the current time point to obtain a target video which is to be pushed or displayed and embodies the correlation of the theme of the specific element;

the sending unit is used for sending the target video to a consensus node of a block chain network;

and the display unit is used for displaying the target video which embodies the correlation of the specific element theme to the user based on the block chain network.

The embodiment of the invention provides a consensus node in a blockchain system, which is applied to the blockchain system comprising a client node and a plurality of consensus nodes, wherein the consensus node comprises:

an authentication unit for authenticating the authority of the client node;

and the adding unit is used for filling the target video into a new block after the authority of the client node is verified to be successful, and adding the new block to the tail part of the block chain when the information blocks are in consensus.

The embodiment of the invention provides a storage medium, which stores executable instructions and is used for causing a processor to execute so as to realize the video display method provided by the embodiment of the invention.

The embodiment of the invention has the following beneficial effects:

when the screen recording operation is carried out on the content displayed on the current screen of the target application, the identification result of the specific element is identified by analyzing or identifying the video frame or the video clip in the screen recording video information in real time, and simultaneously acquiring the current time point of the specific element at the moment, so that the video information with preset duration before and/or after the current time point can be acquired from the recorded screen recording information, the target video which is to be pushed or displayed and is related to the theme of the specific element is acquired, the target video is displayed on the display interface of the current screen, and the display content of the current display interface is not interrupted, the real-time acquisition and display of the target video information are realized through the real-time screen recording video information, the target video comprises the video information of the specific element, so that the intelligence of playing the video information comprising the specific element is improved.

Drawings

Fig. 1A is an alternative structural diagram of a system architecture of a video presentation system according to an embodiment of the present invention;

fig. 1B is an alternative structural diagram of a blockchain provided in an embodiment of the present invention;

fig. 1C is a schematic diagram of an alternative functional architecture of a blockchain network according to an embodiment of the present invention;

fig. 2 is an alternative structural diagram of an electronic device (e.g., a terminal) according to an embodiment of the present invention;

fig. 3A is a schematic flow chart of an alternative video display method according to an embodiment of the present invention;

fig. 3B is a schematic flow chart of another alternative video display method according to an embodiment of the present invention;

FIG. 4 is a schematic diagram of an exemplary interface for enabling a playback function of specific information according to an embodiment of the present invention;

fig. 5 is a schematic interface diagram illustrating that the administrator grants the screen recording right after the playback function of the specific information is started according to the embodiment of the present invention;

FIG. 6 is a schematic diagram of an exemplary target video clip provided by an embodiment of the present invention;

fig. 7 is a schematic interface diagram illustrating that the target video information is played in the form of a floating window after the playback function of the specific information is started according to the embodiment of the present invention;

fig. 8 is a schematic flow chart of a video presentation method according to another alternative embodiment of the present invention;

FIG. 9 is an alternative schematic diagram of character recognition provided by embodiments of the present invention;

FIG. 10 is another alternative schematic diagram of character recognition provided by an embodiment of the present invention;

FIG. 11 is a schematic diagram of an exemplary process for determining a game character according to an embodiment of the present invention;

FIG. 12 is a schematic diagram of a feature matching algorithm provided by an exemplary game character determination process provided by embodiments of the present invention;

FIG. 13 is a diagram illustrating an exemplary Hash averaging process provided by an embodiment of the invention;

fig. 14 is a schematic diagram illustrating a method for determining whether a video frame meets a preset requirement by determining whether image content changes according to an embodiment of the present invention;

fig. 15 is another schematic diagram for determining whether a video frame meets a preset requirement by determining whether image content changes according to an embodiment of the present invention;

FIG. 16 is an interface diagram of an exemplary control prompt display provided by embodiments of the present invention;

FIG. 17 is a schematic diagram of a display interface of an exemplary prompt box provided by an embodiment of the present invention;

fig. 18 is a data interaction diagram of an exemplary video presentation method provided by an embodiment of the present invention;

fig. 19 is a flowchart of an exemplary video presentation method provided by an embodiment of the present invention;

fig. 20 is a flowchart of an exemplary alternative video presentation method provided by an embodiment of the present invention;

fig. 21 is a scene schematic diagram of an exemplary video presentation method according to an embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail with reference to the accompanying drawings, the described embodiments should not be construed as limiting the present invention, and all other embodiments obtained by a person of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

In the following description, reference is made to "some embodiments" which describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or different subsets of all possible embodiments, and may be combined with each other without conflict.

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used herein is for the purpose of describing embodiments of the invention only and is not intended to be limiting of the invention.

Before further detailed description of the embodiments of the present invention, terms and expressions mentioned in the embodiments of the present invention are explained, and the terms and expressions mentioned in the embodiments of the present invention are applied to the following explanations.

1) The screen recording operation, which may also be referred to as screen recording or screen video recording, refers to a processing mode in which the electronic device collects display contents of all or part of the area of the display screen and encodes the collected display contents in a form of video stream to obtain a video file (screen recording video information). Optionally, the screen recording area may be the entire area of the display screen or a partial area of the display screen, when the screen recording area is the entire area of the display screen, the entire content displayed in the display screen is recorded in the video file, and when the screen recording area is the partial area of the display screen, the content displayed in the partial area is recorded in the video file. Optionally, when the screen recording region is a partial region of the display screen, the screen recording region may be set by a user, or may be automatically determined according to a window of a foreground running program displayed in the display screen, for example: if the display content of the application program 1 (target application) currently running in the foreground is displayed in the area a of the display screen, setting the area a as a screen recording area for screen recording according to the display area of the application program 1.

2) Specific information, which is an important scene or event that a certain application appears in the using process. For example, in a game application, scenes of wonderful game segments appear, where the scenes may be scenes or events such as killing, winning, and the like.

3) And the specific element is an element corresponding to certain specific information. The elements can be characters, graphs or other factors for representing important scenes or events. For example, for a game application, when the specific information represents a stage win such as a win or a lose, the specific element may be a "win or lose" character, or may be a graphic of "win or lose" or the like.

4) The method comprises the following steps of displaying a small window of an application program A on an interface of an application program B, wherein the small window of the application program A is a floating window.

5) The OCR, Optical Character Recognition, refers to a process of analyzing and recognizing an image file to obtain text and layout information therein.

6) And OpenCV: open Source Computer Vision Library, an Open-Source cross-platform Computer Vision Library from which many image processing algorithms come.

7) Transaction (Transaction), which is equivalent to the computer term "Transaction," includes operations that need to be committed to a blockchain network for execution and does not refer solely to transactions in the business context, which embodiments of the present invention follow in view of the convention of colloquially using "Transaction" in blockchain technology. In the embodiment of the invention, the transaction is video related data in a video display process and the like.

8) The Block chain (Blockchain) is a storage structure for encrypted and chained transactions formed by blocks (blocks).

9) And a block chain Network (Blockchain Network) for incorporating the new block into a set of a series of nodes of the block chain in a consensus manner.

10) Ledger (legger) is a general term for a blockchain (also called Ledger data) and a state database synchronized with the blockchain.

11) Smart Contracts (Smart Contracts), also called chain codes (chaincodes) or application codes, are programs deployed in nodes of a blockchain network, and the nodes execute the Smart Contracts called in the received transactions to perform operations of updating or querying key-value pair data of the state database.

12) Consensus (Consensus), a process in a blockchain network, is used to agree on transactions in a block among a plurality of nodes involved, the agreed block is to be appended to the end of the blockchain, and the mechanisms for achieving Consensus include Proof of workload (PoW), Proof of rights and interests (PoS, Proof of stamp), Proof of authorization of shares (DPoS, released Proof of stamp), Proof of Elapsed Time (PoET, Proof of Elapsed Time), and so on.

Referring to fig. 1A, fig. 1A is a schematic structural diagram of a video presentation system 100 according to an embodiment of the present invention, which includes a block chain network 200 (exemplarily illustrating a consensus node 210-1 to a consensus node 210-3), an authentication center 300, and a service agent 400, which are respectively described below.

The type of blockchain network 200 is flexible and may be, for example, any of a public chain, a private chain, or a federation chain. Taking a public link as an example, electronic devices such as user terminals and servers of any service entity can access the blockchain network 200 without authorization; taking a federation chain as an example, an electronic device (e.g., a terminal/server) under the jurisdiction of a service entity after obtaining authorization may access the blockchain network 200, and at this time, become a client node in the blockchain network 200.

In some embodiments, the client node may act as a mere watcher of the blockchain network 200, i.e., provides functionality to support a business entity to initiate a transaction (e.g., for uplink storage of data or querying of data on a chain), and may be implemented by default or selectively (e.g., depending on the specific business requirements of the business entity) with respect to the functions of the consensus node 210 of the blockchain network 200, such as a ranking function, a consensus service, and an accounting function, etc. Therefore, the data and the service processing logic of the service subject can be migrated into the block chain network 200 to the maximum extent, and the credibility and traceability of the data and service processing process are realized through the block chain network 200.

The consensus nodes in blockchain network 200 receive transactions (video presentations) submitted by client nodes (e.g., client node 410 of business entity 400 shown in fig. 1 as belonging to a user) from different business entities (e.g., business entity 400 and business entity 500 shown in fig. 1), perform the transactions to update the ledger or query the ledger, and various intermediate or final results of performing the transactions may be returned for display in the business entity's client nodes.

For example, the client node 410 may subscribe to events of interest in the blockchain network 200, such as transactions occurring in a particular organization/channel in the blockchain network 200, and the corresponding transaction notifications are pushed by the consensus node 210 to the client node 410, thereby triggering the corresponding business logic in the client node 410.

An exemplary application of the blockchain network is described below, taking an example in which a plurality of service entities access the blockchain network to implement management of video presentation.

Referring to fig. 1A, a plurality of business entities involved in the management link, such as the business entity 400, may be electronic devices capable of running a target application, register and register from the certificate authority 300 to obtain respective digital certificates, where the digital certificates include public keys of the business entities and digital signatures signed by the certificate authority 300 for the public keys and identity information of the business entities, and are used to be attached to a transaction together with the digital signature of the business entities for the transaction, and are sent to the blockchain network, so that the blockchain network takes the digital certificates and the signatures from the transaction, verifies the authenticity of the message (i.e., whether the message is not tampered) and the identity information of the business entities sending the message, and verifies the blockchain network according to the identity, for example, whether the blockchain network has the right to initiate the transaction. Clients running on electronic devices (e.g., terminals or servers) hosted by the business entity may request access from the blockchain network 200 to become client nodes.

The client node 410 of the service body 400 is used for receiving a screen recording instruction for a target application during the running process of the target application; responding to a screen recording instruction, and performing screen recording operation on the current screen content operated by the target application to acquire screen recording video information of the target application; intercepting at least one video frame or video clip from the screen recording video information, and carrying out specific element analysis and identification processing on the video frame or video clip; when a video frame or a video clip analyzes or identifies a specific element, acquiring the current time point of the specific element, and acquiring video information with preset duration before and/or after the current time point from screen recording video information based on the current time point to obtain a target video to be pushed or displayed and reflecting the correlation of the theme of the specific element; displaying a target video which embodies the theme correlation of the specific element to a user; and transmits the video frames or video clips and the corresponding analyzed and identified specific elements to the blockchain network 200.

The operation of sending the video frame or video clip and the corresponding specific element analyzed and identified to the blockchain network 200 may set service logic in the client node 410 in advance, and when an identification result including the specific element is generated, the client node 410 automatically sends the video frame or video clip and the corresponding specific element analyzed and identified to the blockchain network 200, or a service person of the service agent 400 logs in the client node 410, manually packages the video frame or video clip and the corresponding specific element analyzed and identified, and sends the video frame or video clip and the corresponding specific element analyzed and identified to the blockchain network 200. Upon transmission, the client node 410 generates a transaction corresponding to the update operation based on the video frames or video fragments and the corresponding specific elements analyzed and identified, specifies in the transaction the smart contract that needs to be invoked to implement the update operation and the parameters passed to the smart contract, and also carries the digital certificate of the client node 410, a signed digital signature (e.g., obtained by encrypting a digest of the transaction using a private key in the digital certificate of the client node 410), and broadcasts the transaction to the consensus node 210 in the blockchain network 200.

When the transaction is received in the consensus node 210 in the blockchain network 200, the digital certificate and the digital signature carried by the transaction are verified, after the verification is successful, whether the service agent 400 has the transaction right is determined according to the identity of the service agent 400 carried in the transaction, and the transaction fails due to any verification judgment of the digital signature and the right verification. After successful verification, node 210 signs its own digital signature (e.g., by encrypting the digest of the transaction using the private key of node 210-1) and continues to broadcast in blockchain network 200.

After receiving the transaction successfully verified, the consensus node 210 in the blockchain network 200 fills the transaction into a new block and broadcasts the new block. When a new block is broadcasted by the consensus node 210 in the block chain network 200, performing a consensus process on the new block, if the consensus is successful, adding the new block to the tail of the block chain stored in the new block, updating the state database according to a transaction result, and executing a transaction in the new block: and adding a key value pair comprising the video frame or the video segment and the corresponding analysis and recognition processed specific element in the state database for the transaction of submitting the updated video frame or the video segment and the corresponding analysis and recognition processed specific element.

After receiving the transaction in the consensus node 210 in the blockchain network 200, verifying the transaction, filling the block and making the consensus consistent, adding the filled new block to the tail of the blockchain stored in the new block, updating the state database according to the transaction result, and executing the transaction in the new block: for the submitted transaction for updating the identification result of the specific element corresponding to a certain video frame or video segment, updating the key value pair corresponding to the video frame or video segment in the state database according to the identification result of the specific element; and for the submitted transaction for inquiring a certain video frame or video segment, inquiring a key value pair corresponding to the certain video frame or video segment from the state database, and returning a transaction result.

It should be noted that fig. 1A schematically illustrates a process of directly linking a video frame or a video segment and a corresponding specific element processed by analysis and identification, but in other embodiments, for a case where the data size of the video frame is large, the client node 410 may pair the hash of the video frame and the hash of the identification result into a link, and store the original video frame and the identification result in a distributed file system or a database, thereby reducing the workload of the link operation.

As an example of a block chain, referring to fig. 1B, fig. 1B is a schematic structural diagram of a block chain in a block chain network 200 according to an embodiment of the present invention, where a head of each block may include hash values of all transactions in the block and also include hash values of all transactions in a previous block, a record of a newly generated transaction is filled in the block and is added to a tail of the block chain after being identified by a node in the block chain network, so as to form a chain growth, and a chain structure based on hash values between blocks ensures tamper resistance and forgery resistance of transactions in the block.

An exemplary functional architecture of a block chain network provided in the embodiment of the present invention is described below, referring to fig. 1C, fig. 1C is a schematic functional architecture diagram of a block chain network 200 provided in the embodiment of the present invention, which includes an application layer 201, a consensus layer 202, a network layer 203, a data layer 204, and a resource layer 205, which are described below respectively.

The resource layer 205 encapsulates the computing, storage, and communication resources that implement each node 210 in the blockchain network 200.

The data layer 204 encapsulates various data structures that implement the ledger, including blockchains implemented in files in a file system, state databases of the key-value type, and presence certificates (e.g., hash trees of transactions in blocks).

The network layer 203 encapsulates the functions of a Point-to-Point (P2P) network protocol, a data propagation mechanism and a data verification mechanism, an access authentication mechanism and service agent identity management.

Wherein the P2P network protocol implements communication between nodes 210 in the blockchain network 200, the data propagation mechanism ensures propagation of transactions in the blockchain network 200, and the data verification mechanism implements reliability of data transmission between nodes 210 based on cryptography methods (e.g., digital certificates, digital signatures, public/private key pairs); the access authentication mechanism is used for authenticating the identity of the service subject added into the block chain network 200 according to an actual service scene, and endowing the service subject with the authority of accessing the block chain network 200 when the authentication is passed; the business entity identity management is used to store the identity of the business entity that is allowed to access blockchain network 200, as well as the permissions (e.g., the types of transactions that can be initiated).

The consensus layer 202 encapsulates the functions of the mechanism for the nodes 210 in the blockchain network 200 to agree on a block (i.e., a consensus mechanism), transaction management, and ledger management. The consensus mechanism comprises consensus algorithms such as POS, POW and DPOS, and the pluggable consensus algorithm is supported.

The transaction management is configured to verify a digital signature carried in the transaction received by the node 210, verify identity information of the service entity, and determine whether the node has an authority to perform the transaction (read related information from the identity management of the service entity) according to the identity information; for the service agents authorized to access the blockchain network 200, the service agents all have digital certificates issued by the certificate authority, and the service agents sign the submitted transactions by using private keys in the digital certificates of the service agents, so that the legal identities of the service agents are declared.

The ledger administration is used to maintain blockchains and state databases. For the block with the consensus, adding the block to the tail of the block chain; executing the transaction in the acquired consensus block, updating the key-value pairs in the state database when the transaction comprises an update operation, querying the key-value pairs in the state database when the transaction comprises a query operation and returning a query result to the client node of the business entity. Supporting query operations for multiple dimensions of a state database, comprising: querying the chunk based on the chunk sequence number (e.g., hash value of the transaction); inquiring the block according to the block hash value; inquiring a block according to the transaction serial number; inquiring the transaction according to the transaction serial number; inquiring account data of a business main body according to an account (serial number) of the business main body; and inquiring the block chain in the channel according to the channel name.

The application layer 201 encapsulates various services that the blockchain network can implement, including tracing, crediting, and verifying transactions.

Embodiments of the present invention provide a video display method and apparatus, an electronic device, and a storage medium, which can implement playback of video information without interrupting a current operation, and improve intelligence for playing video information including a specific element. Next, an exemplary application when the electronic device is implemented as a terminal will be explained.

It should be noted that the video display method provided by the present invention can be applied to a terminal (i.e. the service body 400), and can also be applied to an implementation environment where the terminal and the server interact with each other. When the method is applied to a terminal, an application program (such as a target application) including a playback function and a screen recording function of specific information is installed in the terminal, and a screen recording instruction for the target application is received by the application program in the running process of the target application; responding to a screen recording instruction, and performing screen recording operation on the current screen content operated by the target application to acquire screen recording video information of the target application; intercepting at least one video frame or video clip from the screen recording video information, and carrying out specific element analysis and identification processing on the video frame or video clip; when a video frame or a video clip analyzes or identifies a specific element, acquiring the current time point of the specific element, and acquiring video information with preset duration before and/or after the current time point from screen recording video information based on the current time point to obtain a target video to be pushed or displayed and reflecting the correlation of the theme of the specific element; and showing the target video related to the specific element theme to the user. When the method is applied to an implementation environment of interaction between a terminal and a server, an application program with a screen recording function is installed in the terminal, after screen recording is carried out on display contents in a display screen of the terminal through the application program, the terminal sends images to be identified (namely video frames or video clips) in a screen recording video stream to the server, the server identifies specific elements of the video frames or the video clips, and feeds back identification results to the terminal, so that the target video is edited and played on a current display interface (such as in a prompt box) of a current screen.

The terminal is used for receiving a screen recording instruction aiming at the target application when the playback function of the specific information is started; the specific information is an important scene or event in the use process of the target application; responding to a screen recording instruction, performing screen recording operation on the current screen content, and acquiring screen recording video information of the target application; in the screen recording process, a video frame of a current screen is intercepted from screen recording video information, and the video frame is sent to a server. The server is used for identifying specific elements of the video frames to obtain an identification result; the specific element is a factor for judging specific information; and sending the identification result to the terminal. The terminal is further used for acquiring a current time point when the specific element exists in the identification result, and acquiring target video information with preset duration before the current time point from the screen recording video information; popping up a prompt box on a current display interface of the target application; and playing the target video information in the prompt box.

Referring to fig. 2, fig. 2 is a schematic structural diagram of a terminal 400 (corresponding to a service body) provided in an embodiment of the present invention, where the terminal 400 shown in fig. 2 includes: at least one processor 410, memory 450, at least one network interface 420, and a user interface 430. The various components in the terminal 400 are coupled together by a bus system 440. It is understood that the bus system 440 is used to enable communications among the components. The bus system 440 includes a power bus, a control bus, and a status signal bus in addition to a data bus. For clarity of illustration, however, the various buses are labeled as bus system 440 in fig. 2.

The Processor 410 may be an integrated circuit chip having Signal processing capabilities, such as a general purpose Processor, a Digital Signal Processor (DSP), or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, or the like, wherein the general purpose Processor may be a microprocessor or any conventional Processor, or the like.

The user interface 430 includes one or more output devices 431, including one or more speakers and/or one or more visual displays, that enable the presentation of media content. The user interface 430 also includes one or more input devices 432, including user interface components that facilitate user input, such as a keyboard, mouse, microphone, touch screen display, camera, other input buttons and controls.

The memory 450 includes either volatile memory or nonvolatile memory, and may include both volatile and nonvolatile memory. The non-volatile Memory may be a Read Only Memory (ROM), and the volatile Memory may be a Random Access Memory (RAM). The memory 450 described in embodiments of the invention is intended to comprise any suitable type of memory. Memory 450 optionally includes one or more storage devices physically located remote from processor 410.

In some embodiments, memory 450 is capable of storing data, examples of which include programs, modules, and data structures, or a subset or superset thereof, to support various operations, as exemplified below.

The operating system 451, which includes system programs for handling various basic system services and performing hardware-related tasks, such as a framework layer, a core library layer, a driver layer, etc., is used for implementing various basic services and for processing hardware-based tasks.

A network communication module 452 for communicating to other computing devices via one or more (wired or wireless) network interfaces 420, exemplary network interfaces 420 including: bluetooth, wireless-compatibility authentication (Wi-Fi), and Universal Serial Bus (USB), among others.

A display module 453 for enabling presentation of information (e.g., user interfaces for operating peripherals and displaying content and information) via one or more output devices 431 (e.g., display screens, speakers, etc.) associated with user interface 430.

An input processing module 454 for detecting one or more user inputs or interactions from one of the one or more input devices 432 and translating the detected inputs or interactions.

In some embodiments, the electronic device provided by the embodiments of the present invention may be implemented in software, and fig. 2 shows a video presentation apparatus 455 stored in a memory 450, which may be software in the form of programs and plug-ins, and includes the following software modules: a receiving unit 4551, a collecting unit 4552, an intercepting unit 4553, a recognizing unit 4554, an acquiring unit 4555, an ejecting unit 4556 (not shown in the figure), and a presenting unit 4557, the functions of which will be described in the following embodiments.

In other embodiments, the video display apparatus provided in the embodiments of the present invention may be implemented in hardware, and as an example, the video display apparatus provided in the embodiments of the present invention may be a processor in the form of a hardware decoding processor, which is programmed to execute the video display method provided in the embodiments of the present invention, for example, the processor in the form of the hardware decoding processor may employ one or more Application Specific Integrated Circuits (ASICs), DSPs, Programmable Logic Devices (PLDs), Complex Programmable Logic Devices (CPLDs), Field Programmable Gate Arrays (FPGAs), or other electronic components.

The video display method provided by the embodiment of the present invention will be described below with reference to exemplary applications and implementations of the terminal provided by the embodiment of the present invention.

Referring to fig. 3A, fig. 3A is an alternative flowchart of a video presentation method according to an embodiment of the present invention, which will be described with reference to the steps shown in fig. 3A.

S101, receiving a screen recording instruction aiming at the target application in the running process of the target application.

And S102, responding to a screen recording instruction, and performing screen recording operation on the current screen content operated by the target application to acquire screen recording video information of the target application.

S103, intercepting at least one video frame or video clip from the screen recording video information, and carrying out specific element analysis or identification processing on the video frame or video clip.

S104, when the video frame or the video clip is analyzed or the specific element is identified, the current time point of the specific element is obtained, and based on the current time point, video information with preset duration before and/or after the current time point is obtained from the screen recording video information, so that a target video which is to be pushed or displayed and embodies the correlation of the specific element theme is obtained.

And S105, displaying the target video which embodies the correlation of the specific element theme to the user.

In the embodiment of the present invention, a management program may be installed in the terminal, and the management program may be provided with a playback function and a screen recording function of specific information.

The playback function of the specific information is a function for instructing the terminal to play back a scene in which the specific information appears in the display screen, that is, the content being displayed on the current screen. And the screen recording function is used for indicating the terminal to start the function of recording the display content of the display screen.

It should be noted that, in the embodiment of the present invention, the management program installed in the terminal is used to manage some applications, and some applications may understand the target application in the embodiment of the present invention. The target application may include an entertainment application, a social application, or a tool application, etc., and the embodiments of the present invention are not limited thereto.

In some embodiments of the invention, the target application may be a gaming application, a karaoke application, a live application, among other applications.

Illustratively, as shown in fig. 4, an auxiliary tool list 310 is displayed in a display interface 300 of a management program, the auxiliary tool list 310 includes a playback function 311 of specific information, and after a user selects the playback function 311 of the specific information, a detailed introduction interface 320 of the playback function 311 of the specific information is displayed, since the implementation of the playback function 311 of the specific information is to be completed depending on an intelligent screen recording function (screen recording function), an application 321 and an application 322 supporting the intelligent screen recording function, i.e. a target application, are displayed in the detailed introduction interface 320, such as: when the management program is a game management program, the target applications supporting the intelligent screen recording function in the game management program are a game program A and a game program B. The detailed introduction interface further comprises an opening control 323, when a user selects the opening control 323, a screen recording opening message 324 is displayed, the screen recording opening message 324 is used for prompting that the intelligent screen recording function and the playback function of the specific information are started, the screen recording can be automatically started after the game is started to realize the playback of the specific information, and the opening message 324 is used for indicating that the pre-recorded screen recording function and the playback function of the specific information are started, and the playback function and the screen recording function of the specific information can be started after the game is started.

In S101, the video display method provided by the embodiment of the present invention is mainly applicable to a situation where, when the content of the target application is being displayed on the display screen, the content with specific information is played back again. The specific information may be understood as a scene or an event that is important in the use process of the target application in the embodiment of the present invention, for example, a highlight video clip or a highlight moment.

It should be noted that, the setting of the specific information corresponding to different applications is related to the function and the usage scenario of each application, and may be implemented well before implementation, and the embodiment of the present invention is not limited.

For example, for a gaming application, the specific information may be a killing event, a game winning event, a clearance event, or a memorial event.

In the embodiment of the present invention, the terminal may manage the target application, and the managing may include: the method comprises the steps of starting a playback function of specific information of a target application, or closing the playback function of the specific information of the target application, or other functions and the like. The target application is operated in the foreground scene, that is, the target application is operating at the moment, and the operation interface of the target application is displayed on the current screen, that is, the display screen of the terminal, so that the method is suitable for performing the playback function of the specific information. That is, in the embodiment of the present invention, for a target application running in the foreground, when the playback function of specific information of the target application is started in the hypervisor, a screen recording instruction for the target application may be received, and based on the screen recording instruction, the screen recording function is started to assist in implementing the playback function of the specific information.

It should be noted that the completion of the playback function of the specific information in the terminal needs to depend on the implementation of the screen recording function, and in the running process of the target application, the terminal needs to acquire the current screen content of the current screen real-time display target application through the screen recording function, determine the target video to be played back based on the real-time displayed content, and then play back the target video, that is, the acquisition of the playing object targeted by the video playback function of the specific information is obtained based on the real-time video stream acquired by the screen recording function or the clipping of the screen recording video information.

In the embodiment of the invention, the terminal can be set to automatically start the screen recording function when the playback function of the specific information is started.

In the embodiment of the invention, a screen recording instruction (screen recording starting instruction) aiming at a target application is received in the running process of the target application.

In some embodiments of the present invention, the terminal may further trigger the screen recording function by an operation, and embodiments of the present invention may be compatible with a scheme that only performs the screen recording function. In the embodiment of the present invention, the screen recording function may be automatically started by the terminal according to the application program currently running in the foreground, that is, when the target application currently running in the foreground just starts the playback function of the specific information, the screen recording function may also be started by the user after selecting the screen recording start control in the target application in the process of performing the playback function of the specific information.

In some embodiments of the present invention, when the terminal manages the target application, if the terminal wants to perform the playback function of the specific information, it needs to obtain the authorization required for performing the playback function of the specific information first to implement the function. The detailed authority requirement can be determined according to the actual requirement, and the embodiment of the invention is not limited.

Illustratively, in the embodiment of the present invention, the terminal may coordinate to implement the playback function of the specific information by reaching the prompt box authority, the stack top monitoring authority, the screen recording authority, the screenshot authority, and the like.

Wherein, the prompt box authority: the method is used for popping up the prompt box in the game to inform a user of the occurrence of the wonderful moment, and the real-time wonderful moment playback is also carried out in the prompt box. The stack top monitoring authority: the method is mainly used for automatically starting/ending the recording screen when a user switches in/out of a target application, and if the user does not have the authority, the user needs to manually start and end the recording. Screen recording permission: the function is a basis for screen recording, and is a necessary authority for granting the screen recording function.

It should be noted that, when monitoring the operation process of the terminal, the screen recording function generally monitors the target application running on the foreground of the terminal. Optionally, the monitoring of the application running in the foreground of the terminal is implemented in a stack top monitoring mode, where the stack top monitoring mode is a mode of monitoring the switching behavior of the terminal application, such as: and through the stack top performance, when the application program operated by the terminal is determined to be switched from the program A to the program B, that is, the application program operated by the current terminal foreground is determined to be the program B.

In some embodiments of the present invention, when it is determined that an application running in the terminal is a target application in a stack top monitoring manner, a screen recording function is started to record a screen of display contents of a display screen of the terminal.

In some embodiments of the present invention, the stack top monitoring mode needs to be applied after the management program acquires the stack top monitoring authority of the terminal, for example: after the user starts the playback function of the specific information, the system automatically prompts that the management program acquires the monitoring function of the foreground application program, and after the user confirms the prompt message, the stack top monitoring mode is started for monitoring.

In some embodiments of the present invention, the screen recording function further needs to acquire a screen recording permission of the terminal, that is, after the user authorizes the screen recording permission to the management program, the management program may start the screen recording function to record the display content of the display screen.

In some embodiments of the present invention, the screen recording function may further obtain a prompt box authority of the terminal, where the prompt box authority is used to play a playback process through a prompt box window in a screen recording process of the display content.

For example, as shown in fig. 5, after a user selects to start a playback function of specific information in a management program, the user needs to be supported by a screen recording function, then a right required by the screen recording function may be displayed in a display right opening interface 400, a right list 410 to be opened is displayed in the right opening interface 400, the right list 410 includes a screenshot right 411, a prompt box right 412, and a use case access right 413, where the use case access right 413 is the above-mentioned stack top monitoring right, and since the term stack top monitoring right is a professional term of a computer, the stack top monitoring right is displayed in the right opening interface 400 with the use case access right 413 as a display content. Illustratively, when the user checks the screenshot permission 411, a system message 420 is displayed in an overlapping manner on the permission opening interface 400, where the system message 420 is used to prompt the user to open the screenshot permission 411 to the management program, and after the user selects the determination control 421 in the system message 420, the terminal opens the permission to screenshot the display content of the display screen to the management program.

For example, when the permission of the prompt box is opened, and when the user opens the playback function of the specific information of the target application, and in the running process of the target application, and when the target video information to be played back is acquired, a prompt box may be further displayed in the current running interface, where the prompt box is used to play the target video information.

In S102, after the terminal acquires the screen recording instruction for the target application, the terminal starts to perform a real-time screen recording operation on the current screen content of the target application in response to the screen recording instruction, and the terminal acquires screen recording video information related to the target application in real time because the current screen, that is, the content corresponding to the target application, is being displayed on the display screen.

In the embodiment of the invention, in the process of acquiring the display content of the display screen by the terminal in the form of the video stream, the display content of the display screen is acquired in real time frame by frame, and the acquired video frame is used for generating the video stream (namely, screen recording video information) corresponding to the display content.

In some embodiments of the present invention, the terminal may record the screen recording start time.

In S103, the terminal captures at least one video frame or video segment, i.e., a real-time video frame or a real-time video segment, corresponding to the content displayed on the current screen from the acquired screen recording video information, and then the terminal can identify a specific element of the video frame to determine whether the video frame meets a preset requirement, so as to obtain an identification result (i.e., whether the video frame contains the specific element).

In some embodiments of the present invention, the terminal may intercept a video frame corresponding to the content displayed on the current screen, that is, a real-time video frame, from the acquired screen recording video information in the screen recording process.

In the embodiment of the invention, the video frames or video clips are intercepted every other preset intercepting duration in the screen recording process. In the screen recording process, the terminal acquires the display content of the currently acquired display screen (current screen) every preset intercepting duration to obtain a video frame or a video clip of the display content.

It should be noted that the video segment obtained by the terminal from the video stream every preset interception duration is a continuous multi-frame screenshot image, that is, a video sub-segment with a preset length is obtained from the video stream every preset interception duration, and the preset interception duration is greater than the duration corresponding to the preset length, and then the terminal can obtain the identification result by analyzing or identifying the video segment. In detail, the terminal performs framing processing on the video segments to obtain video subframes; and carrying out specific element analysis or identification processing on the video subframe to obtain an identification result. The analysis or recognition processing mode of the specific elements corresponding to the video subframe and the video frame may be a mode with the same principle, and the embodiment of the present invention is not limited.

The following description will be made with reference to a video frame (or a video subframe) as an example.

In the embodiment of the present invention, the preset requirement is used to match an image whose image content of the video frame meets the playback requirement, such as: when the management program is implemented as a game management program, when the video stream is played back, the highlight segment (specific information) needs to be clipped, and when the feature (specific element) corresponding to the highlight segment is identified in the video frame, it is determined that the video frame meets the preset requirement, such as: if the video frame comprises the keyword 'failure', it is determined that the player achieves stage victory in the game process before the video frame is displayed, and it is determined that the video frame meets the preset requirement, so that the recognition result of the specific element is obtained. Wherein the specific element is a factor for determining the specific information. The specific element may be a symbolic word, icon, number, or the like. Such as the "kill" word, "success" pictorial or word, etc.

In the embodiment of the invention, the process of analyzing or identifying the specific elements of the video frame by the terminal is the process of judging whether the video frame meets the preset requirement by the terminal, and the identification result is the judgment result. The process of the terminal determining whether the video frame meets the preset requirement may be a process of the terminal determining whether a specific element exists in the video frame. If the terminal judges that the video frame meets the preset requirement, obtaining an identification result with specific elements; and if the terminal judges that the video frame does not meet the preset requirement, obtaining an identification result without the specific element.

In some embodiments of the present invention, the method for the terminal to determine whether the video frame meets the preset requirement includes at least one of the following methods:

firstly, matching first image content in a video frame with required content in an image content list (template), and when the required content in the image content list is matched with the first image content, determining that the video frame meets a preset requirement.

And secondly, comparing the content of a first image in the video frame with the content of a second image in the latest video frame before the video frame, and determining that the video frame meets the preset requirement when the content of the first image is changed relative to the content of the second image.

In some embodiments of the present invention, the terminal performs a screen recording operation on the current screen content in response to the screen recording instruction, so that after acquiring screen recording video information of the target application, the terminal receives a screen recording stop instruction; the terminal may stop the screen recording operation for the current screen content of the target application based on the screen recording stop instruction.

It should be noted that, in the embodiment of the present invention, even if the terminal is running the target application on the current screen, if a screen recording instruction triggered by a user operation or a screen recording instruction triggered by another manner is received, the screen recording operation on the current screen is stopped, and then playback of the video of the specific information appearing in real time cannot be continuously implemented.

In S104, the result of the recognition of the video frame or the video segment by the terminal may or may not be the presence of the specific element. When the identification result is that the specific element exists (namely when the video frame or the video clip is analyzed or the specific element is identified), the terminal acquires the current time point of the specific element, and acquires video information with preset duration before and/or after the current time point from the screen recording video information based on the current time point to obtain a target video which is to be pushed or displayed and embodies the correlation of the theme of the specific element.

In some embodiments of the present invention, the current time point of the specific element may be a current time of the terminal, or may be a time when the specific element appears in the video stream, and the embodiments of the present invention are not limited.

In some embodiments of the present invention, the terminal may use the current time point as the ending time, and obtain, from the screen recording video information, a video stream with a preset duration before the ending time as the video information, or use the current time point as the starting time, and obtain, from the screen recording video information, a video stream with a preset duration after the starting time as the video information, or use the current time point as the middle point time, and obtain, from the screen recording video information, a video stream with a preset duration including the middle point time as the video information, so as to obtain the target video to be pushed or displayed, which embodies the theme of the specific element is related to. The target video here is video information containing specific information, for example, a highlight at the time of game.

It should be noted that, in the embodiment of the present invention, the terminal performs a screen recording operation on the display screen in real time, that is, there is screen recording video information obtained in real time, and when knowing that the current time point of the specific element exists, the terminal means that specific information appears around the current time point on the terminal, that is, an important scene appears, so that the terminal can clip the important scene in real time, that is, the terminal clips, from the screen recording video information, a target video with a preset duration before the current time point and/or after the current time point.

The preset duration is a preset duration in which specific information appears, the preset duration is generally set to be a relatively short time, for example, 10s, and the like, and the detailed setting of the preset duration can be made by considering an actual important scene or event or taking the occurrence duration as a reference, which is not limited in the embodiment of the present invention.

Illustratively, the time at which the screen recording starts is recorded, e.g., t0 ═ 11:11: 20. When the highlight moment occurs (for example, 11:15:30), the terminal directly informs the screen recording module to move forward for 10 seconds (preset duration) from the current time point, namely, the start time of the clip is t 1-11: 15:20, and the end time t 2-11: 15: 30.

It should be noted that, in the embodiment of the present invention, when the terminal acquires the target video, the screen recording operation is continued and is not stopped.

In some embodiments of the present invention, during the screen recording process, the terminal acquires a current time point, provided by the target application, of a specific element included in the display content of the current screen. That is, the terminal does not need to perform the identification process of S103, but the target application may determine the occurrence of the specific information of the specific element by itself, and notify the management program of the time when the specific information occurs, that is, obtain the current time point directly provided by the terminal, where the current time point is the time when the specific element is included in the display content of the current screen, so that the terminal may still obtain, from the screen recording video information, the video stream of the preset duration before the termination time and/or after the current time point as the target video with the current time point as the termination time.

In some embodiments of the present invention, when the specific element is not present as a result of the recognition (i.e., when the video frame or the video segment is not analyzed or the specific element is not recognized), the capturing of the next video frame or the video segment is continued for the next preset capturing duration, and the specific element recognition is continued for the next video frame or the video segment until the playback function of the specific information is turned off, so as to perform the playback function of the specific information of the target application in real time.

Illustratively, as shown in fig. 6, in the process of entering the game application and recording the screen, when the recognition result is that a specific element (for example, a death scene in the game application) exists, the terminal acquires the time of the current terminal, namely the death time, and takes a video with a preset time length before the death time as a target video from the screen recording video information.

It can be understood that, in addition to identifying whether the video frame or the video clip of the display screen by the terminal determines that the specific information appears, the terminal can acquire whether a scene or an event represented by the specific information appears by monitoring or detecting the target application itself without intercepting the video frame or the video clip of the video recording information acquired in real time, and when the scene or the event represented by the specific information appears, the terminal directly informs a management program of the terminal to acquire the current time point, so that the identification process is omitted, and the time for acquiring the target video is shortened.

In S105, after the terminal acquires the target video, the target video showing the correlation of the specific element theme may be presented to the user.

It is understood that, when the screen recording operation is performed on the content of the current screen display of the target application, the identification result of the specific element is identified by analyzing or identifying the video frame or the video clip in the screen recording video information in real time, and simultaneously acquiring the current time point of the specific element at the moment, so that the video information with preset duration before or after the current time point can be acquired from the recorded screen recording information, the target video which is to be pushed or displayed and is related to the theme of the specific element is acquired, the target video is displayed on the display interface of the current screen, and the display content of the current display interface is not interrupted, the real-time acquisition and display of the target video information are realized through the real-time screen recording video information, the target video comprises the video information of the specific element, so that the intelligence of playing the video information comprising the specific element is improved.

Fig. 3B is an alternative flowchart of the video presentation method according to the embodiment of the present invention, and the implementation of S105 may include S1051-S1052. The following were used:

s1051, popping up a prompt box on the current display interface of the target application.

And S1052, displaying the target video information related to the embodied specific element theme to the user in a prompt box.

In S1051 and S1052, if the terminal acquires the target video, it means that the terminal acquires the video to be played back in which the specific information appears, and therefore, the terminal can play back the target video.

It should be noted that, in the embodiment of the present invention, the terminal implements a scheme of playing the target video in a form of popping up a prompt box on the current implementation interface when the target application on the display screen is normally performed.

In the embodiment of the present invention, the prompt box may be in the form of a floating window, and the like, and the embodiment of the present invention is not limited as long as a play interface is added in the current display interface, so as to ensure that the current display of the interface is realized, and at the same time, a play interface of the target video is added.

The floating window is a layer of playing window added on the current display interface and used for playing the video clip. Illustratively, as shown in fig. 7, taking a management program as a game management program as an example, a target application is a game application, when a terminal grants a floating window permission (i.e., a prompt box permission) to the game management program, and a user starts a playback function of specific information of the game application, a game running interface 500 is displayed in the terminal interface, a floating window 510 is superimposed on the game running interface 500, the floating window 510 is used for the user to currently play a highlight segment in a game process of the game, and the floating window 510 is playing a highlight segment 511 (target video).

It can be understood that, in the video display method provided by the embodiment of the present invention, after the display content in the display screen is recorded, matching the video frame in the video stream obtained by recording the screen with the preset requirement, and when the video frame meets the preset requirement, cutting the video stream according to the obtained current time point to obtain the target video, pop up a prompt box in the current display interface being displayed on the display screen, play the target video (a specific element containing specific information) in the prompt box, thereby realizing the process of playing back the specific information, avoiding the process that the user needs to jump out of the currently running target application to play back when the user wants to play back the video segment, the target video segments are automatically clipped according to the preset requirements, and the played back target video is directly overlaid and displayed on the current display interface, so that the intelligence of playing the video information of the specific information is improved.

In some embodiments of the present invention, after S105, embodiments of the present invention further include: and S106.

S106, the terminal sends the video frame or the video clip and the corresponding specific element which is analyzed and identified to the block chain network, so that the specific element and the video frame or the video clip are filled into the new block by the node of the block chain network, and when the new block is identified in a consistent manner, the new block is added to the tail of the block chain.

It should be noted that, in the embodiment of the present invention, the terminal may further send the target video to the blockchain network, so that the node of the blockchain network fills the target video into the new block, and when the new blocks are identified consistently, the new block is added to the tail of the blockchain.

The embodiment of the invention can also combine with the block chain technology to uniformly send the specific elements, the video frames or the video clips and the target videos to the block chain network after the specific elements, the video frames or the video clips and the target videos are obtained. And the node of the blockchain network carries out relevant verification on the sent main body, including verification on a digital certificate, a digital signature and a write right, fills a specific element, a video frame or a video clip and a target video into the new block on the basis of successful verification, broadcasts the new block to other nodes of the blockchain network, and when the node of the blockchain network recognizes the new block together, each node adds the new block to the tail of the blockchain stored by the node. Through the mode, the non-tamper property of the low-custom identification result is ensured.

In some embodiments of the present invention, as shown in fig. 8, the implementing process of performing the specific element analysis and identification process on the video frame (video subframe) in S103 may further include: and S1031-1034. The following were used:

s1031, obtaining a target specific area corresponding to the target application from a preset specific area library; the specific area library is preset as a set of areas where specific information is located.

S1032, the video frame is cut based on the target specific area, and a target identification picture is obtained.

S1033, obtaining a target specific element template corresponding to the target application from a preset specific element template library, wherein the target specific area corresponds to the target specific element one by one.

And S1034, performing specific element analysis or recognition processing on the target recognition picture according to the target specific element template.

In the embodiment of the present invention, a preset specific area library and a preset specific element template library, that is, an image content list, may be set in the terminal. Presetting a specific region library as a set of regions where specific information is located; and presetting the specific element template library as a set in which the specific element is positioned.

It should be noted that, in the embodiment of the present invention, the image content list includes at least one of a requirement character and a requirement figure, where the requirement character is used to match with character content in the first image content (content of the target identification picture), and the requirement figure is used to match with a figure appearing in the first image content. It is understood that the object of the preset specific region library and the preset specific element template library includes at least one of text and graphics.

It should be noted that the preset specific area library and the preset specific element template library are directed to a plurality of target applications, and the corresponding specific areas and the specific element templates may be different according to different target applications, so that the terminal needs to first obtain a target specific area corresponding to a target application currently running in the foreground from the preset specific area library; then, only the part of the video frame located in the target specific area needs to be cut out for identification, that is, the video frame is cut out based on the target specific area to obtain a target identification picture, the target identification picture is identified by characters or figures, and the specific element template is a template requiring the characters or the figures, so that the terminal needs to firstly obtain a target specific element template (including a character template and a picture template) corresponding to a target application from a preset specific element template library, and then perform specific element identification on the target identification picture by taking the target specific element template as a standard, thereby obtaining an identification result.

For example, in the game process, when a user needs to select a game character, the required graphics in the image content list are different according to the difference of the game character, and then the game character selected by the user needs to be determined first, and then the required graphics in the image content list are determined according to the game character selected by the user.

For example, the manner of determining whether the target identification picture in the video frame meets the required content by cropping the target specific area includes any one of the following manners:

firstly, performing character recognition on a target recognition picture to obtain character content of the target recognition picture as first image content, and matching the character content with a required character (character template) in a target specific element template to obtain a recognition result.

Secondly, carrying out pattern detection on the target identification picture, and matching the detected pattern detection result with a required pattern (picture template) in the target specific element template so as to obtain an identification result.

Optionally, when the required graph is matched with the graph detection result, matching may be performed through a plurality of feature points, such as: and matching through 40 characteristic points, and determining that the required graph is matched with the graph detection result when more than 90% of the characteristic points are in accordance with the mutual matching relation.

In some embodiments of the present invention, when the target specific element template is a text template, the terminal performs text recognition on the target recognition picture to obtain a target text; when a template consistent with the target character exists in the target specific element template, analyzing or identifying the specific element (obtaining an identification result containing the specific element); when a template consistent with the target character does not exist in the target specific element template, analyzing or identifying that the specific element is not contained (obtaining an identification result of the specific element is not contained).

When the characters or characters in the target specific element template are correspondingly matched with the target characters of the target recognition picture, the screenshot image is determined to meet the preset requirement, and the recognition result containing the specific elements is obtained. And when no characters or characters in the target specific element template are correspondingly matched with the target characters of the target recognition picture, determining that the screenshot picture does not meet the preset requirement, and obtaining the recognition result without the specific elements.

In the embodiment of the invention, the terminal performs character recognition on the target recognition picture, and the means for obtaining the target characters can adopt a character recognition technology. Such as OCR recognition techniques.

Illustratively, the target-specific element template includes a requirement character: "beat-and-lose", "tie-three breaking-and-breaking", "sharp mango juice", as shown in fig. 9, a current game picture is displayed in a game interface 810, a video frame corresponding to the game picture is cut according to a target specific area to obtain a target recognition picture 820, character recognition is performed on the target recognition picture 820 to obtain character content "beat-and-lose", the character content is matched with a required character of a target specific element template, the required character "beat-and-lose" in the target specific element template is matched with the character content, so that the video frame meets a preset requirement.

Illustratively, the target recognition picture includes a required character "n beat", where the character "n" may be implemented as any numerical value, as shown in fig. 10, a current game screen is displayed in a game interface 910, a video frame corresponding to the game screen is cut according to a target specific region to obtain a target recognition picture 920, character recognition is performed on the target recognition picture 920 to obtain a character content "1 beat", the character content is matched with the required character in the target recognition picture, and the required character "n beat" in the target recognition picture is matched with the character content, so that the video frame meets a preset requirement.

In some embodiments of the present invention, when the target specific element template is a picture template, the terminal performs image recognition on the target recognition picture to obtain a recognition result.

In the embodiment of the present invention, the image recognition may adopt an image matching algorithm, such as template matching, mean hash matching, perceptual hash matching, various types of feature matching, and the like, and the embodiment of the present invention is not limited.

In the game process, when a user needs to select a game role, the required graphs in the image content list are different according to different game roles, and the required graphs in the image content list are determined according to the game role selected by the user after the game role selected by the user is determined.

Illustratively, as shown in fig. 11, a game match interface 1110 is displayed, a game character selected by a player in a game match is determined through the game match interface, first, the game match interface 1110 is cut through a target specific area to obtain a first target identification picture 1120, and whether a circle with a specific size exists in the first target identification picture 1120 is detected according to a hough circle detection algorithm provided by OpenCV, wherein the hough circle detection algorithm can detect whether a circular contour exists in an image according to set parameters, and the parameters include: a circular radius range (e.g., 45 pixels minimum radius and 55 pixels maximum radius for a 1920 x 1080 resolution handset), a minimum distance between circles (e.g., 100 pixels minimum distance between circles for a 1920 x 1080 resolution handset), a detection confidence (the larger the parameter value, the more circles detected), and other parameters. Then, the first target recognition picture is detected to obtain a detection result 1130, a target circle 1140 is determined and cut according to the circle center and the radius of each circle in the detection result 1130, the redundant part is removed to obtain a circular part 1150, the circular part 1150 is matched with the character pattern in the character table 1160 to determine the character corresponding to the circular part, and the requirement graph 1170 in the image content list is determined according to the character.

Illustratively, when there are many roles in the role table 1160, the primary screening is performed by using a perceptual hash algorithm in OpenCV, and the matching principle of the perceptual hash algorithm is as follows: calculating perceptual hash values of the two images, calculating a hamming distance between the two values, wherein the smaller the hamming distance is, the higher the similarity between the two images is, calculating the perceptual hash value of each character pattern in advance for each character in the angular table 1160, calculating the perceptual hash value of the circular part 1150 when the circular part 1150 needs to be matched with the character pattern in the angular table 1160, and calculating the hamming distance between the circular part 1150 and each character pattern, thereby realizing preliminary screening. Optionally, in the preliminary screening, a character pattern with a hamming distance smaller than a preset distance (a preset difference threshold) is selected as an alternative, and the preset distance may take a value of 15.

For example, if the screening result of the preliminary screening may include a plurality of character patterns, the circular portion 1150 is accurately matched with the candidate character patterns, and the accurate matching may adopt an image feature matching algorithm provided by OpenCV, where the features of the image refer to features of an edge, an angular point, a texture, and the like of the image, and the above elements can reflect the overall features of the image, and when the features of the two images have a similar distribution rule, the similarity of the two images is high. Optionally, the image feature matching algorithm comprises: at least one of SURF feature matching algorithm, SIFT feature matching algorithm and ORB feature matching algorithm. Illustratively, the ORB feature matching algorithm calculates feature points of the two images, and when the distribution of the feature points of the two images has a similar rule, it is determined that the two feature points are successfully matched, and the greater the number of the feature points successfully matched in the two images, the higher the similarity of the two images, as shown in fig. 12, the two points connected by a line between the first image 1210 and the second image 1220 are a pair of feature points successfully matched in the two images.

In the embodiment of the present invention, one of the above manners may be adopted to determine whether the video frame meets the preset requirement, and the embodiment of the present invention is not limited thereto.

Taking the mean hash matching as an example, in some embodiments of the present invention, when the target specific element template is a picture template, the terminal performs image recognition on the target recognition picture to obtain a target hash value; the terminal acquires a picture template hash value of a picture template in a target specific element template; and the terminal completes the specific element analysis or recognition processing (obtaining a recognition result) of the target recognition picture based on the target hash value and the picture template hash value.

In some embodiments of the present invention, the process of the terminal performing image recognition on the target recognition picture to obtain the target hash value is as follows: the terminal performs picture reduction processing on the target identification picture to obtain a reduced picture with a preset size; the terminal converts the reduced picture into a gray scale image with a preset size; calculating the gray average value of the gray image by the terminal; and the terminal compares each pixel in the gray level image with the gray level average value to obtain a target hash value with a preset size.

In some embodiments of the present invention, the terminal calculates a difference value between the target hash value and the picture template hash value; when the difference value is less than or equal to a preset difference threshold value, analyzing or identifying the specific element (obtaining an identification result containing the specific element); when the difference value is larger than a preset difference threshold value, analyzing or identifying that the specific element is not contained (obtaining an identification result that the specific element is not contained).

In an embodiment of the present invention, the predetermined size may be 64. The preset difference threshold represents a similarity threshold, which may be set to 15, and the detailed value setting may be determined based on the actual design, which is not limited in the embodiments of the present invention. The difference value may be a hamming distance or other numerical value indicating the features of similarity, and the embodiment of the present invention is not limited.

In the embodiment of the invention, when the target specific element template is the image template, the terminal performs image reduction processing on the target identification image to obtain a reduced image with a preset size; the terminal converts the reduced picture into a gray scale image with a preset size; calculating the gray average value of the gray image by the terminal; the terminal compares each pixel in the gray level image with the gray level mean value to obtain a target hash value with a preset size; the terminal acquires a picture template hash value of a picture template in a target specific element template; the terminal calculates a difference value between the target hash value and the picture template hash value; when the difference value is smaller than or equal to a preset difference threshold value, obtaining an identification result containing a specific element; and when the difference value is larger than a preset difference threshold value, obtaining a recognition result which does not contain the specific element.

For example, as shown in fig. 13, the terminal performs a picture reduction process on the target recognition picture to obtain 8 × 8 reduced pictures, which have 64 pixels in total; the terminal converts the reduced picture into a 64-level gray scale image; the terminal calculates the gray average value of 64 pixels of the gray map; the terminal compares each pixel in the gray level image with the gray level mean value to obtain a string of 64-bit target hash values; the terminal acquires a picture template hash value (64 bits, which is pre-stored) of a picture template in a target specific element template, calculates a Hamming distance between the target hash value and the picture template hash value, and obtains an identification result containing specific elements when the Hamming distance is less than or equal to a preset difference threshold; and when the Hamming distance is larger than a preset difference threshold value, obtaining an identification result which does not contain the specific element.

In the embodiment of the present invention, the process of obtaining the target hash value by comparing each pixel in the grayscale image with the grayscale mean value by the terminal is to mark 1 when the pixel value is greater than or equal to the grayscale mean value, and mark 0 when the pixel value is less than the grayscale mean value, so that a string of 64-bit target hash values is obtained after comparing the 64 uniform grayscale mean values of the pixels.

For example, the terminal may record a hash value of a picture template stored in an application in advance as HashA: 1101111000110100000011011100010100100001110010011000001110010000, assuming 0001110001100011110001111110010000000101001011001000110100001001 is the target hash value HashB, the terminal calculates the hamming distance of HashA and HashB. If the Hamming distance is smaller than a preset difference threshold (for example, 15), the similarity of the two pictures is considered to be extremely high, and the matching is successful, so that the recognition result containing the specific elements is obtained. If the Hamming distance (40) is larger than a preset difference threshold (for example, 15), the similarity of the two pictures is considered to be low, and the matching is not successful, namely, a recognition result which does not contain the specific element is obtained.

Illustratively, when the pattern detection is performed, taking the pattern detection as circular detection as an example for explanation, performing target specific region clipping on a video frame to obtain a target identification picture, detecting the target identification picture through a hough circle detection algorithm, detecting that the target identification picture includes a circle, matching the circle with a pattern in an image content list to obtain a pattern in the image content list, and determining that the video frame meets a preset requirement.

In some embodiments of the present invention, the terminal may further clip the video frame and the video frame immediately preceding the video frame to obtain a target identification picture of the mth video frame and a target identification picture of the (m-1) th screenshot image, and compare image contents in the two target identification pictures, where m is greater than or equal to 2. And when the current image content of the target identification picture is changed relative to the last image content, determining that the video frame meets the preset requirement.

For example, as shown in fig. 14, a current game screen is displayed in a game interface 1310, a video frame corresponding to the game screen is cut according to a target specific region to obtain a target identification picture 1320, a video frame immediately before the target identification picture is cut according to the same target specific region to obtain a target identification picture 1330, the target identification picture 1320 and the target identification picture 1330 are compared, and the content of the target identification picture 1320 changes relative to the target identification picture 1330, so that the video frame corresponding to the game interface 1310 meets a preset requirement.

Illustratively, as shown in fig. 15, a current game screen is displayed in a game interface 1410, a video frame corresponding to the game screen is cut according to a target specific region to obtain a target identification picture 1420, a video frame immediately before the target identification picture is cut according to the same target specific region to obtain a target identification picture 1430, the target identification picture 1420 is compared with the target identification picture 1430, and the content of the target identification picture 1420 does not change relative to the content of the target identification picture 1430, so that the video frame corresponding to the game interface 1410 does not meet a preset requirement.

In some embodiments of the present invention, after S104 and before S1052, a video showing method provided by the embodiments of the present invention may further include: S107-S109. The following were used:

s107, displaying a playback function control and time prompt information on a current display interface of the target application; and the playback function control is used for triggering the prompt box to display the video.

And S108, when the time prompt message becomes a preset value and a trigger instruction aiming at the playback function control is not received, closing the playback function control and quitting displaying the time prompt message.

And S109, responding to the trigger instruction and popping up a prompt box on the current display interface of the target application when the trigger instruction aiming at the playback function control is received before the time prompt information becomes the preset value.

In the embodiment of the invention, before the terminal pops up the prompt box, the terminal can directly pop up the prompt box when obtaining the target video. The terminal can also display a playback function control and time prompt information on the current display interface of the target application; the playback function control is used for triggering the prompt box to play the video, and the time prompt information is used for prompting the user of the remaining time for popping up the prompt box. When the time prompt information reaches the preset value, the representation prompt box can pop up, and at this time, if no trigger instruction generated by the user in touch control of the playback function control exists, the prompt box is not started by default. If the user touches the playback function control to start the instruction, the prompt box is started.

In the embodiment of the present invention, the total timing duration of the time prompt message may be preset, for example, 10 seconds, and then a countdown manner is adopted, so that when the total timing duration reaches, that is, the time prompt message becomes a preset value, but the embodiment of the present invention does not limit the timing manner and the total timing duration of the time prompt message.

For example, as shown in fig. 16, when the management program is implemented as a game management program, when the video stream is played back, it is necessary to clip a highlight (specific information), after the target video information is obtained, in the current game interface 1, a playback function control 2 (view video playback) and time prompt information 3(7 seconds) are displayed, when the time of 7 seconds does not become 0 second, if the user clicks the view video playback control, the terminal pops up a prompt box in the current game interface, and plays the target video information in the prompt box, otherwise, the view video playback control is closed, the time prompt information is quitted to be displayed, and the game interface is normally displayed.

It can be understood that the terminal can provide a control entrance capable of performing a video display function for the user in the display interface, so that the user has the option, and the humanized entrance and the intelligent design of video information playback are enriched.

In some embodiments of the present invention, after S1052, the video display method provided in the embodiments of the present invention may further include: and S110. The following were used:

and S110, closing the prompt box after the target video information is played.

In the embodiment of the invention, after the terminal plays or displays the target video and the target video information is played, the prompt box can be directly and automatically closed, the terminal quits and continues the normal running interface of the target application.

It can be understood that the terminal automatically exits the prompt box after the target video is played, so that the process of exiting by the user operation is saved, the implementation process is simple, the operation time is saved, and the efficiency of playback implementation is improved.

In some embodiments of the present invention, a play control, a play progress control, and a close control are arranged in the prompt box, and after S1052, the video display method provided in an embodiment of the present invention may further include: s111, or S112-S113, or S114. The following were used:

and S111, controlling the playing process of the target video based on the playing control or the playing progress control.

And S112, receiving a closing instruction generated by triggering the closing control.

And S113, responding to the closing instruction, and closing the prompt box.

In the embodiment of the invention, a playing control, a playing progress control and a closing control are arranged in the prompt box, wherein the playing control is used for indicating the control of playing or pausing the playing function, the playing progress control is used for indicating the adjustment of the playing progress, and the closing control is used for closing the prompt box and exiting.

Based on this, when the terminal plays the target video information, the user can realize different functions through different controls on the touch prompt box.

In the embodiment of the present invention, as shown in fig. 17, when the user touches the play control 1, a play instruction is generated, and based on the play instruction, the target video starts to be played. However, the terminal can also automatically play the target video when the prompt box pops up. When a user touches the playing control 1, a playing pause instruction is generated, and the playing of the target video which is being played is paused based on the playing pause instruction. And when the user touches the playing progress control 2, generating a playing adjustment instruction, and adjusting the target video being played to the position indicated by the playing adjustment instruction to start playing again based on the playing adjustment instruction. And when the user touches the closing control 3, a closing instruction is generated, the prompt box is closed based on the closing instruction, and the playing of the target video is quitted.

It can be understood that the terminal can control different playing modes of the target video through the controls with different functions arranged in the prompt box, so that diversified control of playing the target video is realized, and playing intelligence is improved.

And S114, when an exit instruction for the target application is received, stopping screen recording operation on the current screen based on the exit instruction, and closing the prompt box.

In the embodiment of the present invention, the management program implements management of the target application, so that when the target application exits, the playback function of the specific information for the target application can be directly ended, that is, when an exit instruction for the target application is received, based on the exit instruction, the screen recording operation on the current screen is stopped, and the prompt box is closed.

In some embodiments of the present invention, the terminal may also not stop the screen recording operation when the target application is closed, and the terminal is not closed until the user manually triggers the closing.

It can be understood that if the terminal actively closes the screen recording operation and the prompt box when exiting the target application, the operation running time can be saved, the running resources can be saved, and the intelligence of the playback function of the specific information can be improved.

In the following, an exemplary application of the embodiments of the present invention in a practical application scenario will be described.

Illustratively, the application scenarios of the embodiment of the present invention include at least one of the following scenarios:

first, the video display method provided by the embodiment of the present invention is applied to a game management program, identifies and clips a game highlight (specific information) through video frame identification, and plays the game highlight on a prompt box popped up from content displayed on a current screen, and the specific scenes are as follows:

the terminal is provided with a game management program, the game management program is provided with an intelligent screen recording function, the intelligent screen recording function is provided with a wonderful video editing function for a target game, when a user starts the intelligent screen recording function and starts the target game to play the game, the intelligent screen recording function in the game management program records a screen of the user in the game process of the target game, and whether an image frame in a screen recording video stream meets a preset requirement or not is identified in the screen recording process, illustratively, whether characters in the image frame meet characters corresponding to the wonderful video or not is identified, and the steps comprise: 1 killing, when the image frame meets the preset requirement, editing the video segment with the preset time length before the image frame according to the time stamp of the image frame in the video file to obtain a wonderful video segment, and playing the wonderful video segment on a prompt box popped up on the content displayed on the current screen.

Secondly, the video clip editing method provided by the embodiment of the invention is applied to a live broadcast management program, automatically clips live broadcast clips through video image recognition, and plays the live broadcast clips on a prompt box popped up from the content displayed on the current screen. The specific scenes are as follows:

install live management program in the terminal, be provided with intelligent record screen function in this live management program, this intelligence record screen function is provided with live section clip function to the live program of target, opens this intelligence record screen function when the user to start the live program of target and when broadcasting directly, this intelligence record screen function records the screen to this live process, and whether record the screen in-process accords with the requirement of predetermineeing to recording the image frame in the screen video stream and discern, if: and when the live broadcast process is a dance live broadcast process, identifying whether a character in the image frame is in a standing dance process, editing a video clip between the first image frame meeting the preset requirement and the last image frame meeting the preset requirement to obtain a live broadcast clip, and playing the live broadcast clip on a prompt box popped up from the content displayed on the current screen.

The following description is directed to a scenario applied to a game management program.

Exemplarily, fig. 18 is an overall data interaction diagram of a video presentation method corresponding to a video presentation apparatus according to an exemplary embodiment of the present invention, as shown in fig. 18, the video presentation apparatus includes: a screen recording module 610, a highlight moment identification module 620 and a highlight moment data management module 630.

The screen recording module 610 includes a video acquisition unit 611, where the video acquisition unit 611 is configured to acquire display contents of a display screen to obtain a screen recording video stream, and the screen recording module 610 further includes a picture acquisition unit 612, where the picture acquisition unit 612 is configured to acquire a still picture in the video stream every preset time period, and send the still picture to the highlight moment identification module 620.

The highlight moment recognition module 620 includes an image clipping unit 621, an image preprocessing unit 622, and an image recognition unit 623, where the image clipping unit 621 is configured to clip the still picture sent by the screen recording module 610 according to a preset clipping rule, and send the clipped picture to the image preprocessing unit 622, and the image preprocessing unit 622 is configured to preprocess the clipped picture, where the preprocessing process includes at least one of image feature extraction, image segmentation, image grayscale processing, contrast stretching, sharpness adjustment, and character recognition. The image preprocessing unit 622 sends the preprocessed image to the image recognition unit 623, the image recognition unit 623 is configured to match the preprocessed image with a preset requirement, and send the highlight moment details corresponding to the still picture to the highlight moment data management module 630 when the preprocessed image meets the preset requirement, after the screen recording is finished, the highlight moment data management module 630 sends the highlight moment details of the recorded still picture to the video clipping unit 613 in the screen recording module 611 for video clipping to obtain a target video clip, and finally, the target video clip can be played in a prompt box popped up in a current display interface of the running target application.

Illustratively, fig. 19 is a flowchart of an overall video presentation method according to another exemplary embodiment of the present invention, which is described by taking as an example that the method is applied to a game management program, and as shown in fig. 19, the method includes:

s201, when the playback function of the specific information is started, the video acquisition module starts to record the screen to obtain screen recording video information.

Optionally, when the playback function of the game management program for acquiring the specific information of the terminal is started, the video acquisition module performs screen recording on the display content of the display screen of the terminal to obtain screen recording video information acquired in real time in a variable manner.

Optionally, the screen recording starting manner is already described in detail in the above S101, and is not described herein again.

S202, the image acquisition module periodically acquires images from the screen recording video information.

Optionally, the image capturing module may capture an image from a video stream captured by the video capturing module, or may directly capture a display content of the display screen to achieve image capturing.

S203, selecting different image processing schemes according to the current running game.

Optionally, for different games, the positions of the user interfaces displaying the specific information are also different, illustratively, the specific area displaying the killing prompt message in game a is a first area displaying the content, and the specific area displaying the killing prompt message in game B is a second area displaying the content, then the first area is cut for game a, and the second area is cut for game B.

And S204, cutting out the target identification picture A according to the target specific area.

S205, judging whether the target identification picture A has expected image elements according to an image processing algorithm, and if not, continuing to execute S202; if yes, go to S206.

Alternatively, the desired image element may be at least one of a desired character, a desired pattern, and a desired variation.

S206, when the expected image elements appear in the target identification picture A, determining to identify the highlight moment.

Optionally, when an expected image element appears in the target identification picture a, the image corresponding to the target identification picture a is an image corresponding to the occurrence of highlights, and the highlights corresponding to the target identification picture a are recorded.

Optionally, a plurality of different highlight types may exist in one image, and the plurality of different highlight types of the image are identified by cutting and identifying the plurality of image areas differently.

And S207, editing a highlight video segment with preset time length before the highlight moment from the screen recording video information.

And S208, popping up a floating window in the currently displayed game interface.

And S209, playing the highlight video clip on the pop-up floating window.

Schematically, as shown in fig. 20, a video presentation method is described in conjunction with a game management program and a first game, as shown in fig. 20, the method including:

s301, the image acquisition module periodically acquires game images from the screen recording video information.

Optionally, after the game management program obtains the screen recording permission of the terminal, the video acquisition module performs screen recording on the display content of the display screen of the terminal, and optionally, the image acquisition module can acquire images from a video stream acquired by the video acquisition module after the screen recording starts, and can also directly capture the display content of the display screen to realize image acquisition.

S302, identifying whether killing occurs in the game image; if yes, executing S303; if not, S301 is executed.

Optionally, whether a hit or a kill occurs in the game match is identified by identifying the image content in the target identification picture of the first specific area.

And S303, recording the wonderful moment when the killing occurs in the game image.

And S304, editing the highlight video segment with preset time length before the highlight moment from the screen recording video information.

And S305, popping up a floating window in the currently displayed game interface.

S306, playing the highlight video clip on the pop-up floating window.

Illustratively, the process of fig. 20 is described with reference to fig. 21, as shown in fig. 21, after a game match starts, a game character is identified with reference to the game interface 2410, the game character is determined to be an angel, after a screenshot image corresponding to the game interface 2420 is captured, a highlight moment is determined to appear, a time point of the highlight moment of the screenshot image corresponding to the game interface 2420 is recorded, a target video clip a period of time before the highlight moment is obtained from a video stream recorded on a screen, a floating window pops up on the game interface 2420 being displayed, and the target video clip is displayed on the floating window, as shown in fig. 2430.

Continuing with the exemplary architecture of video presentation device 455 as implemented as software modules provided by embodiments of the present invention, in some embodiments, as shown in fig. 2, the software modules of video presentation device 455 stored in memory 450 may include:

a receiving unit 4551, configured to receive a screen recording instruction for a target application during running of the target application;

the acquisition unit 4552 is configured to perform a screen recording operation on current screen content in response to the screen recording instruction, so as to acquire screen recording video information of the target application;

an intercepting unit 4553, configured to intercept at least one video frame or video clip from the screen recording video information;

a recognition unit 4554, configured to perform specific element analysis and recognition on the video frame or video segment;

an obtaining unit 4555, configured to obtain a current time point of the specific element when the specific element is analyzed or identified in the video frame or the video clip, and obtain, based on the current time point, video information of a preset duration before the current time point and/or after the current time point from the screen recording video information, to obtain a target video to be pushed or displayed, where the target video embodies a theme correlation of the specific element;

and the presentation unit 4557 is configured to present, to the user, a target video related to the theme embodying the specific element.

In some embodiments of the invention, an eject unit 4556 is further included.

A pop-up unit 4556, configured to pop up a prompt box on a current display interface of the target application;

a presentation unit 4557, configured to present, to the user, the target video related to the specific element topic in the prompt box.

In some implementations of the present invention, the identifying unit 4554 is further configured to obtain a target specific area corresponding to the target application from a preset specific area library; the preset specific area library is a set of areas where specific information is located; clipping the video frame based on the target specific area to obtain a target identification picture; acquiring a target specific element template corresponding to the target application from a preset specific element template library, wherein the target specific area corresponds to the target specific element one to one; and carrying out specific element analysis or identification on the target identification picture according to the target specific element template.

In some implementations of the present invention, the identifying unit 4554 is further configured to perform text recognition on the target recognition picture to obtain a target text when the target specific element template is a text template; when a template consistent with the target character exists in the target specific element template, analyzing or identifying that the specific element is included; when the template consistent with the target character does not exist in the target specific element template, analyzing or identifying that the specific element is not included.

In some implementations of the present invention, the identifying unit 4554 is further configured to perform image identification on the target identification picture to obtain a target hash value when the target specific element template is a picture template; acquiring a picture template hash value of a picture template in the target specific element template; and obtaining the identification result based on the target hash value and the picture template hash value.

In some implementations of the present invention, the identifying unit 4554 is further configured to perform picture reduction processing on the target identification picture to obtain a reduced picture with a preset size; converting the reduced picture into a gray scale image with the preset size; calculating a gray average value of the gray image; and comparing each pixel in the gray-scale image with the gray-scale mean value to obtain a target hash value with a preset size, and completing specific element analysis or identification processing on the target identification image.

In some implementations of the invention, the identifying unit 4554 is further configured to calculate a difference value between the target hash value and the picture template hash value; when the difference value is smaller than or equal to a preset difference threshold value, analyzing or identifying that the specific element is included; when the difference value is larger than the preset difference threshold value, analyzing or identifying that the specific element is not included.

In some implementations of the invention, the software modules in video presentation device 455 may include: a display unit 4558 (not shown), and a closing unit 4559.

The display unit 4558 is configured to obtain video information of a preset duration before and/or after the current time point from the screen recording video information, obtain a target video to be pushed or displayed and showing the relation of the specific element theme, and display a playback function control and time prompt information on a current display interface of the target application before the target video showing the relation of the specific element theme is displayed to a user in the prompt box; the playback function control is used for triggering the prompt box to display videos;

the closing unit 4559 is configured to close the playback function control and quit displaying the time prompt information when the time prompt information becomes a preset value and a trigger instruction for the playback function control is not received;

the pop-up unit 4556 is further configured to, when a trigger instruction for the playback function control is received before the time prompt information becomes a preset value, respond to the trigger instruction, and pop up the prompt box on the current display interface of the target application.

In some implementations of the invention, the closing unit 4559 is configured to close the prompt box after the target video related to the specific element topic is presented to the user in the prompt box and the playing of the target video information is finished.

In some implementations of the present invention, the prompt box is provided with a play control, a play progress control, and a close control.

In some implementations of the present invention, the displaying unit 4557 is further configured to control a playing process of the target video information based on the playing control or the playing progress control after the target video related to the specific element theme is displayed to the user in the prompt box.

In some implementations of the present invention, the receiving unit 4551 is further configured to receive a close instruction triggering generation of the close control after the target video related to the specific element theme is presented to the user in the prompt box;

the closing unit 4559 is configured to close the prompt box in response to the closing instruction.

In some implementations of the invention, the closing unit 4559 is configured to, after the target video related to the specific element theme is presented to the user in the prompt box, when an exit instruction for the target application is received, based on the exit instruction, stop a screen recording operation on the current screen and close the prompt box.

In some implementations of the present invention, the receiving unit 4551 is further configured to, in response to the screen recording instruction, perform a screen recording operation on the current screen content to acquire screen recording video information of the target application, and then receive a screen recording stopping instruction;

the closing unit 4559 is configured to stop a screen recording operation on the current screen based on the screen recording stop instruction.

In some implementations of the invention, the obtaining unit 4555 is further configured to, in response to the screen recording instruction, perform a screen recording operation on the current screen content, so as to obtain a current time point, provided by the target application, of a specific element included in the display content of the current screen during the screen recording process after acquiring the screen recording video information of the target application and before obtaining, from the screen recording video information, the target video information of a preset time duration before the current time point and/or after the current time point.

In some implementations of the invention, the identifying unit 4554 is further configured to perform framing processing on the video segment to obtain a video subframe; and carrying out specific element analysis or identification processing on the video subframe.

In some embodiments of the present invention, the identifying unit 4554 is further configured to send the video frame or video segment and the corresponding analyzed and identified specific element to a blockchain network, so that a node of the blockchain network fills the specific element and the video frame or video segment into a new block, and when the information blocks are in agreement, adds the new block to the tail of the blockchain.

It can be understood that the terminal recognizes the recognition result of the specific element by recognizing the video frame in the screen recording video information in real time, and simultaneously obtains the current time point at the moment, so that the target video with the preset duration before the current time point and/or after the current time point can be obtained from the recorded screen recording information, and the target video is played in the prompt box popped up on the display interface of the current screen, so that the real-time target video can be obtained and played by recording the screen video information in real time under the condition that the display content of the current display interface is not interrupted, wherein the target video information represents the video information containing the specific information, and the intelligence of playing the video information of the specific information is improved.

The embodiment of the invention provides a storage medium stored with executable instructions, wherein the executable instructions are stored in the storage medium and can cause a processor to execute the video display method provided by the embodiment of the invention when being executed by the processor.

In some embodiments, the storage medium may be memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disk, or CD-ROM; or may be various devices including one or any combination of the above memories.

In some embodiments, executable instructions may be written in any form of programming language (including compiled or interpreted languages), in the form of programs, software modules, scripts or code, and may be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment.

By way of example, executable instructions may correspond, but do not necessarily have to correspond, to files in a file system, and may be stored in a portion of a file that holds other programs or data, such as in one or more scripts in a hypertext Markup Language (HTML) document, in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files that store one or more modules, sub-programs, or portions of code).

By way of example, executable instructions may be deployed to be executed on one computing device or on multiple computing devices at one site or distributed across multiple sites and interconnected by a communication network.

The above description is only an example of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, and improvement made within the spirit and scope of the present invention are included in the protection scope of the present invention.

Claims

1. A video presentation method applied to a blockchain system including a client node and a plurality of consensus nodes, comprising:

the client node sends the target video, the video frame or the video fragment and the specific element to a consensus node of a blockchain network;

after verifying that the client node succeeds in permission, the consensus node fills the target video, the video frame or the video clip and the specific element into a new block, and when the new blocks are consistent in consensus, the new block is added to the tail of a block chain;

the consensus node adds a key-value pair comprising the video frame or video segment and the specific element in a state database;

2. The method of claim 1, wherein the client node sending the target video, the video frame or video segment, and the particular element to the consensus node of the blockchain network comprises:

and the client node generates a transaction corresponding to the updating operation according to the target video, the video frame or the video fragment and the specific element, specifies an intelligent contract required to be called for realizing the updating operation, parameters transferred to the intelligent contract, a digital certificate of the client node and a signed digital signature in the transaction, and broadcasts the transaction to the consensus node in the blockchain network.

3. The method according to claim 2, wherein the consensus node, after verifying that the client node's right is successful, fills the target video, the video frame or the video segment, and the specific element into a new block, and appends the new block to the end of the block chain when the information block consensus is consistent, comprising:

the consensus node verifies a digital certificate and a digital signature carried by a transaction, and after the verification is successful, whether the client node has a transaction right is determined according to the identity of the client node carried by the transaction;

after the consensus node receives the transaction which is successfully verified, filling the transaction into a new block, and broadcasting;

and carrying out an information block consensus process on the new block, and adding the new block to the tail of the block chain stored by the new block if the information block consensus is successful.

4. The method according to any of claims 1 to 3, wherein said consensus node, after verifying that the client node's right is successful, fills the target video, the video frame or video segment, and the specific element into a new block, and when the information blocks are consensus, appends the new block to the end of a block chain, the method further comprising:

and the consensus node updates a state database according to the transaction result and executes the transaction in the new block.

5. A blockchain system, comprising: the system comprises a client and a plurality of consensus nodes;

the client node is used for receiving screen recording instructions aiming at the target application in the running process of the target application; responding to the screen recording instruction, and performing screen recording operation on the current screen content operated by the target application so as to acquire screen recording video information of the target application; intercepting at least one video frame or video clip from the screen recording video information, and carrying out specific element analysis and identification processing on the video frame or video clip; when the specific element is analyzed or identified in the video frame or the video clip, acquiring a current time point of the specific element, and acquiring video information with preset duration before and/or after the current time point from the screen recording video information based on the current time point to obtain a target video to be pushed or displayed, wherein the target video embodies the correlation of the theme of the specific element; sending the target video, the video frame or the video clip and the specific element to a consensus node of a blockchain network;

the consensus node is used for filling the target video, the video frame or the video fragment and the specific element into a new block after the authority of the client node is verified to be successful, and when the new blocks are in consensus, the new block is added to the tail of the block chain;

the consensus node is further used for adding a key-value pair comprising the video frame or video segment and the specific element in a state database;

6. The system of claim 5,

and the client node is further configured to generate a transaction corresponding to the update operation according to the target video, the video frame or the video fragment, and the specific element, specify an intelligent contract to be invoked for implementing the update operation and parameters transferred to the intelligent contract, and a digital certificate and a signed digital signature of the client node in the transaction, and broadcast the transaction to the consensus node in the blockchain network.

7. The system of claim 6,

the common identification node is also used for verifying a digital certificate and a digital signature carried by the transaction, and after the verification is successful, whether the client node has the transaction authority or not is confirmed according to the identity of the client node carried by the transaction; after receiving the transaction which is successfully verified, filling the transaction into a new block, and broadcasting; and carrying out an information block consensus process on the new block, and adding the new block to the tail of the block chain stored by the new block if the information block consensus is successful.

8. The system according to any one of claims 5 to 7,

the consensus node is further configured to, after the client node is successfully verified to have its right, fill the target video, the video frame or the video segment, and the specific element into a new block, and when the information blocks are in agreement, add the new block to the tail of the block chain, and then update the state database according to a transaction result by the consensus node, and execute a transaction in the new block.

9. A client node for use in a blockchain system comprising the client node and a plurality of consensus nodes, the client node comprising:

a sending unit, configured to send the target video, the video frame or the video segment, and the specific element to a consensus node of a blockchain network;

10. A consensus node in a blockchain system, for use in a blockchain system comprising a client node according to claim 9 and a plurality of consensus nodes, the consensus node comprising:

an authentication unit for authenticating the authority of the client node;

an adding unit, configured to, after the authority of the client node is verified successfully, fill the target video, the video frame or the video clip, and the specific element into a new block, and, when the new blocks are identical, add the new block to the tail of a block chain; adding a key-value pair comprising the video frame or video segment and the particular element in a state database.

11. A storage medium having stored thereon executable instructions for causing a processor to perform the method of any one of claims 1 to 4 when executed.