CN115866293A

CN115866293A - Video analysis method and video analysis system

Info

Publication number: CN115866293A
Application number: CN202211440997.3A
Authority: CN
Inventors: 付延松; 韩洁
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2022-11-17
Filing date: 2022-11-17
Publication date: 2023-03-28

Abstract

The embodiment of the application discloses a video analysis method and a video analysis system, relates to the field of intelligent analysis, and can improve the efficiency of intelligent video analysis. The specific scheme is as follows: first, a video analysis request is received. Wherein the video analysis request carries a target resolution; the video analysis request is used for requesting intelligent analysis on the target video. Then, sending a resource acquisition request to a resource server; the resource obtaining request is used for requesting a first resource file with the resolution as the target resolution in the resource files of the target video. Thereafter, a first resource file is received from the resource server. And finally, sending the first resource file to an analysis server so that the analysis server can intelligently analyze the first resource file to obtain an analysis result of the target video.

Description

Video analysis method and video analysis system

Technical Field

The present application relates to the field of intelligent devices, and in particular, to a video analysis method and a video analysis system.

Background

To bring a better user experience, a manufacturer of a display device may intelligently analyze a video before providing the video display to a user via the display device. The intelligent analysis can insert analysis results (which can be called dotting data) at each time point of the video after completing analysis of content identification, content positioning and the like of the video. Currently, the intelligent analysis process of video is generally completed at a system end (i.e., a cloud server). And the system end firstly needs to acquire the video resource to finish the intelligent analysis of the video. The current way to acquire multimedia resources may be to acquire video resources through network transmission. However, due to the limitation of network transmission, the larger the file corresponding to the multimedia resource is, the more time is consumed for transmission, so that the longer the time for completing the final intelligent analysis is, the lower the intelligent analysis efficiency is, and the user experience of the user (here, the operation management user of the display device manufacturer) is not high.

Disclosure of Invention

The embodiment of the application provides a video analysis method and a video analysis system, which can improve the efficiency of video intelligent analysis.

In order to achieve the above purpose, the embodiment of the present application adopts the following technical solutions:

in a first aspect, the present application provides a video analysis method applied to a scheduling device, where the method may include: first, a video analysis request is received. The video analysis request is used for requesting intelligent analysis on the target video. Then, sending a resource acquisition request to a resource server; the resource obtaining request is used for requesting a first resource file with the resolution as the target resolution in the resource files of the target video. Thereafter, a first resource file is received from the resource server. And finally, sending the first resource file to an analysis server so that the analysis server can perform intelligent analysis on the first resource file to obtain an analysis result of the target video.

Based on the technical scheme, when a certain video (namely, a target video) needs to be analyzed, an operation user sends a video analysis request to the scheduling device. The video analysis request is used for requesting intelligent analysis on the target video. And then the scheduling device can acquire the resource file of the target video from the resource server by sending a resource acquisition request to the resource server. The resource obtaining request carries a target resolution. The target resolution may then be the lowest resolution or lower resolution that the analysis server can accept when intelligently analyzing the video. In this way, the scheduling device obtains the first resource file of the target video resolved to the target resolution from the resource server. And then, the scheduling device can send the first resource file to an analysis server for analysis so as to obtain an analysis result of the target video. It can be seen that, based on the technical solution provided by the present application, when the analysis server needs to analyze the non-local video resource, the scheduling device sends a resource file with a lower resolution to the analysis server. Because the resolution ratio is lower, the resource file is smaller, the time consumption of network transmission is shorter, the time required for completing the final intelligent analysis is shorter, the intelligent analysis efficiency is higher, and the use experience of a user is better.

In a possible design manner of the first aspect, after sending the resource acquisition request to the resource server, before receiving the first resource file from the resource server, the method further includes: receiving a no resource response from the resource server; the no resource response is used for indicating that the first resource file does not exist in the resource server; sending recording indication information to a resource server; and the recording indication information is used for indicating the resource server to record the target video with the resolution as the target resolution, and returning to record to obtain the first resource file.

In a possible design of the first aspect, after sending the first resource file to the analysis server, the method further includes: receiving an analysis result of the target video from the analysis server; and sending the analysis result of the target video to the resource server.

In a possible design of the first aspect, after sending the first resource file to the analysis server, the method further includes: receiving a first video acquisition request from a user terminal; the first video acquisition request is used for requesting a target video; sending a second video acquisition request to the resource server; the second video acquisition request is used for requesting a second resource file in the resource files of the target video; the resolution of the second resource file is greater than or equal to the target resolution; receiving a second resource file from the resource server; obtaining an analysis result of a target video; and sending the second resource file and the analysis result of the target video to the user terminal.

In a possible design manner of the first aspect, obtaining an analysis result of the target video includes: sending an analysis result acquisition request to an analysis server; the analysis result acquisition request is used for requesting the analysis result of the target video; and receiving an analysis result of the target video from the analysis server.

In a second aspect, the present application provides a video analysis method, which is applied to a resource server. The method can comprise the following steps: receiving a resource acquisition request from a scheduling device; the resource obtaining request is used for requesting a first resource file with the target resolution in the resource files of the target video; and responding to the resource acquisition request, and sending the first resource file to the scheduling equipment so that the scheduling equipment sends the first resource file to the analysis server for analysis to obtain an analysis result.

Based on the technical scheme, under the condition that the scheduling equipment needs to acquire the resource file of the target video and send the resource file to the analysis server for intelligent analysis, the scheduling equipment sends a resource acquisition request to the resource server. The resource obtaining request carries a target resolution. The target resolution may then be the lowest resolution or lower resolution that the analysis server can receive while intelligently analyzing the video. And then, after receiving the resource acquisition request, the resource server sends the first resource file of the target resolution of the target video to the scheduling device. And then the scheduling device can send the first resource file to an analysis server for analysis to obtain an analysis result. Therefore, based on the technical scheme provided by the application, when the analysis server needs to analyze the non-local video resource, the scheduling device can acquire the resource file with the lower resolution from the resource server and further send the resource file to the analysis server for analysis. Because the resolution ratio is lower, the resource file is smaller, the time consumption of network transmission is shorter, the time required for completing the final intelligent analysis is shorter, the intelligent analysis efficiency is higher, and the use experience of a user is better.

In a possible design manner of the second aspect, sending a first resource file to a scheduling device in response to a resource obtaining request includes: and responding to the resource acquisition request, and sending the first resource file to the scheduling equipment under the condition that the first resource file is stored.

In a possible design manner of the second aspect, sending the first resource file to the scheduling device in response to the resource obtaining request includes: responding to the resource acquisition request, and sending a no-resource response to the scheduling equipment under the condition that the first resource file is not stored; the no resource response is used for indicating that the first resource file does not exist in the resource server; receiving recording indication information from scheduling equipment; the recording indication information is used for indicating the resource server to record the target video with the resolution as the target resolution, and returning to record to obtain a first resource file; sending a recording request to operation display equipment; the recording request is used for requesting to record the target video by taking the resolution as the target resolution and returning to the first resource file obtained by recording; receiving a first resource file from an operation display device; and transmitting the first resource file to the scheduling device.

In a possible design of the second aspect, the method further includes: receiving a second video acquisition request from the scheduling device; the second video acquisition request is used for requesting a second resource file in the resource files of the target video; the resolution of the second resource file is greater than or equal to the target resolution; and transmitting the second resource file to the scheduling device.

In a third aspect, the present application provides a video analysis apparatus, applied to a scheduling device, including: the device comprises a receiving module and a sending module. The receiving module is used for receiving a video analysis request; the video analysis request is used for requesting intelligent analysis on the target video. The sending module is used for sending a resource obtaining request to the resource server; the resource obtaining request is used for requesting a first resource file with the resolution as the target resolution in the resource files of the target video. The receiving module is also used for receiving a first resource file from the resource server; the sending module is further configured to send the first resource file to the analysis server, so that the analysis server performs intelligent analysis on the first resource file to obtain an analysis result of the target video.

In a possible design manner of the third aspect, after the sending module sends the resource obtaining request to the resource server, and before the receiving module receives the first resource file from the resource server, the receiving module is further configured to receive a no-resource response from the resource server; the no resource response is to indicate that the first resource file is not present in the resource server. The sending module is also used for sending recording indication information to the resource server; and the recording indication information is used for indicating the resource server to record the target video with the resolution as the target resolution, and returning to record to obtain the first resource file.

In a possible design manner of the third aspect, after the sending module sends the first resource file to the analysis server, the receiving module is further configured to receive an analysis result of the target video from the analysis server; the sending module is further used for sending the analysis result of the target video to the resource server.

In a possible design of the third aspect, the apparatus further includes an obtaining module. After the sending module sends the first resource file to the analysis server, the receiving module is further used for receiving a first video acquisition request from the user terminal; the first video acquisition request is used for requesting a target video. The sending module is further used for sending a second video acquisition request to the resource server; the second video acquisition request is used for requesting a second resource file in the resource files of the target video; the resolution of the second resource file is greater than or equal to the target resolution; the receiving module is also used for receiving a second resource file from the resource server; the acquisition module is used for acquiring an analysis result of the target video; the sending module is further configured to send the second resource file received by the receiving module and the analysis result of the target video acquired by the acquiring module to the user terminal.

In a possible design manner of the third aspect, the obtaining module is specifically configured to: sending an analysis result acquisition request to an analysis server; the analysis result acquisition request is used for requesting the analysis result of the target video; and receiving an analysis result of the target video from the analysis server.

In a fourth aspect, the present application provides a video analysis apparatus, which is applied to a resource server and includes a receiving module and a sending module. The receiving module is used for receiving a resource obtaining request from the scheduling equipment; the resource obtaining request is used for requesting a first resource file with the target resolution in the resource files of the target video; and the sending module is used for responding to the resource acquisition request received by the receiving module and sending the first resource file to the scheduling equipment so that the scheduling equipment sends the first resource file to the analysis server for analysis to obtain an analysis result.

In one possible embodiment of the fourth aspect, the apparatus further comprises a memory module. The sending module is specifically configured to: and responding to the resource acquisition request received by the receiving module, and sending the first resource file to the scheduling equipment under the condition that the first resource file is stored in the storage module.

In one possible embodiment of the fourth aspect, the apparatus further comprises a memory module. The sending module is specifically configured to: responding to the resource acquisition request received by the receiving module, and sending a no-resource response to the scheduling equipment under the condition that the first resource file is not stored in the storage module; the no resource response is used for indicating that the first resource file does not exist in the resource server; the receiving module is also used for receiving recording indication information from the scheduling equipment; the recording indication information is used for indicating the resource server to record the target video with the resolution as the target resolution, and returning to record to obtain a first resource file; the sending module is also used for sending a recording request to the operation display equipment; the recording request is used for requesting to record the target video by taking the resolution as the target resolution and returning to the first resource file obtained by recording; the receiving module is also used for receiving a first resource file from the operation display equipment; the sending module is further configured to send the first resource file to the scheduling device.

In a possible design manner of the fourth aspect, the receiving module is further configured to receive a second video obtaining request from the scheduling device; the second video acquisition request is used for requesting a second resource file in the resource files of the target video; the resolution of the second resource file is greater than or equal to the target resolution; the sending module is further configured to send the second resource file to the scheduling device.

In a fifth aspect, the present application provides a scheduling apparatus, including: communication interface, processor, memory, bus; the memory is used for storing computer execution instructions, and the processor is connected with the memory through a bus; the processor executes computer-executable instructions stored in the memory when the scheduling apparatus is run to cause the scheduling apparatus to perform the video analysis method as provided in the first aspect and any one of its possible designs.

In a sixth aspect, the present application provides a resource server, including: communication interface, processor, memory, bus; the memory is used for storing computer execution instructions, and the processor is connected with the memory through a bus; when the resource server is running, the processor executes the computer-executable instructions stored by the memory to cause the resource server to perform the video analytics method as provided in the second aspect and any one of its possible designs.

In a seventh aspect, the present application provides a computer-readable storage medium, which includes executable instructions, when the executable instructions are executed on a scheduling apparatus, causing the scheduling apparatus to perform the video analysis method as provided in the first aspect and any one of the possible design manners thereof.

In an eighth aspect, the present application provides a computer-readable storage medium comprising executable instructions that, when executed on a resource server, cause the resource server to perform the video analytics method as provided in the first aspect and any one of its possible designs.

In a ninth aspect, the present application provides a computer program product for causing a scheduling apparatus to perform the video analysis method as provided in the first aspect and any one of its possible designs when the computer program product is run on the scheduling apparatus.

In a tenth aspect, the present application provides a computer program product, which when run on a resource server, causes the resource server to perform the video analysis method as provided in the second aspect and any one of its possible designs.

In an eleventh aspect, the present application provides a video analysis system, including a scheduling device, a resource server, and an analysis server, where the scheduling device establishes communication connections with the resource server and the analysis server, the scheduling device is configured to execute the video analysis method provided in the first aspect and any possible design thereof, and the resource server is configured to execute the video analysis method provided in the second aspect and any possible design thereof.

The technical effects brought by any one of the design manners in the third aspect to the eleventh aspect may be referred to the technical effects brought by the different design manners in the first aspect and the second aspect, and are not described herein again.

Drawings

Fig. 1 is a schematic diagram illustrating a video analysis method according to an embodiment of the present disclosure;

fig. 2 is a schematic structural diagram of a video analysis system according to an embodiment of the present application;

fig. 3 is a schematic structural diagram of an operation display device according to an embodiment of the present application;

fig. 4 is a schematic diagram of a software architecture for operating a display device according to an embodiment of the present disclosure;

fig. 5 is a schematic structural diagram of a server according to an embodiment of the present application;

fig. 6 is a first flowchart illustrating a video analysis method according to an embodiment of the present disclosure;

fig. 7 is a schematic flowchart illustrating a video analysis method according to an embodiment of the present application;

FIG. 8 is a schematic diagram of another video analysis method provided in an embodiment of the present application;

fig. 9 is a third schematic flowchart of a video analysis method according to an embodiment of the present application;

fig. 10 is a fourth schematic flowchart of a video analysis method according to an embodiment of the present application;

fig. 11 is a schematic flowchart of a video analysis method according to an embodiment of the present application;

fig. 12 is a schematic flowchart illustrating a video analysis method according to a sixth embodiment of the present application;

fig. 13 is a seventh flowchart illustrating a video analysis method according to an embodiment of the present application;

fig. 14 is a schematic structural diagram of a video analysis apparatus according to an embodiment of the present application;

fig. 15 is a schematic structural diagram of another video analysis apparatus according to an embodiment of the present application.

Detailed Description

To make the purpose and embodiments of the present application clearer, the following will clearly and completely describe the exemplary embodiments of the present application with reference to the attached drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, and not all of the embodiments.

It should be noted that the brief descriptions of the terms in the present application are only for convenience of understanding of the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.

The terms "first," "second," "third," and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises" and "comprising," and any variations thereof, in this application are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to all elements expressly listed but may include other elements not expressly listed or inherent to such product or device.

The term "and/or" in this application is only one kind of association relationship describing the association object, and means that there may be three kinds of relationships, for example, a and/or B, and may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, the character "/" in the present disclosure generally indicates that the former and latter associated objects are in an "or" relationship.

All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments described herein without inventive step, are intended to be within the scope of the claims appended hereto. In addition, while the disclosure herein has been presented in terms of one or more exemplary examples, it should be appreciated that aspects of the disclosure may be implemented solely as a complete embodiment. It should be noted that the brief descriptions of the terms in the present application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.

In practice, while a user watches a video on a user terminal (e.g., a smart television, a smart phone, etc.), when watching a certain person, a scene, and an article in the video, the user may want to watch a highlight video of the person, a highlight video of the scene, or a purchase link of the article. However, if the video is identified and analyzed in real time, the computing power of the user terminal may be insufficient, and the correlation analysis cannot be completed.

Based on this, in order to bring a better use experience to the user, a manufacturer of the display device may perform intelligent analysis on the video before providing video display to the user through the display device, and may generally adopt a VCA (video content analysis) technology. The intelligent analysis can insert analysis results (which can be called dotting data) at each time point of the video after completing analysis of content identification, content positioning and the like of the video. Then, in the process that the user views the video on the user terminal, the user terminal can actively recommend the content corresponding to the analysis result of the video to the user, or the user terminal can respond to the search operation of the user and display the highlight video corresponding to a certain task or the highlight video corresponding to a certain theme to the user. For example, video analysis results in that if intelligent analysis is performed on a certain video, it is determined that down is appeared in 1-10 seconds and brand A cosmetics are appeared in 20-30 seconds of the whole video. In the final analysis result, a mark indicating down certain cosmetics is inserted in the data of 1-10 seconds in the video, and a mark of brand a cosmetics or link information of brand a cosmetics is inserted in the data of 20-30 seconds. Later, if the user searches for a down through the user terminal, the user terminal may combine all video segments inserted with a marker indicating the down into a highlight display for the user to view. If the user sees the content of 20-30 seconds in the video, the user terminal may display a purchase link of brand a cosmetics to the user according to the label of brand a cosmetics or the link information of brand a cosmetics.

Currently, the intelligent analysis process of video is generally completed at the system end (i.e., cloud server). And the system end firstly needs to acquire the video resource to finish the intelligent analysis of the video. The current way to acquire multimedia resources may be to acquire video resources through network transmission. However, due to the limitation of network transmission, the larger the file corresponding to the multimedia resource is, the more time is consumed for transmission, so that the longer the time for completing the final intelligent analysis is, the lower the intelligent analysis efficiency is, and the user experience of the user (here, the operation management user of the display device manufacturer) is not high.

Based on this, referring to fig. 1, an embodiment of the present application provides a video analysis method, in which a user may pre-store a lowest resolution (i.e., a target resolution) that can be received when an analysis server can perform intelligent analysis in a scheduling device in advance. When an operator of a manufacturer of a display device needs to analyze a certain video (i.e., a target video) in advance, an operator (specifically, a cloud management background) sends a video analysis request for requesting intelligent analysis of the target video to a scheduling device. And under the condition that the scheduling equipment receives the target video, the scheduling equipment requests the resource server to acquire the resource file of the target video with the resolution as the target resolution. And then, the scheduling equipment can send the first resource file acquired from the resource server to the analysis server through the network for analysis so as to obtain an analysis result of the target video. Therefore, based on the technical scheme provided by the application, when the analysis server needs to analyze the non-local video resource, the scheduling device sends the resource file with the lower resolution to the analysis server after acquiring the resource file with the lower resolution from the resource server. Because the resolution ratio is lower, the resource file is smaller, the network transmission time consumption is shorter, the time required for completing the whole intelligent analysis process is shorter, the intelligent analysis efficiency is higher, and the use experience of a user (specifically, an operation user) is better.

The video analysis method provided by the present application is described in detail below with reference to the accompanying drawings.

Fig. 2 is a schematic diagram illustrating a configuration of a video analysis system to which the video analysis method may be applied according to an exemplary embodiment. Referring to fig. 2, the video analysis system includes an operation management terminal 01, a scheduling apparatus 02, a resource server 03, an operation display apparatus 04, and an analysis server 05.

The operation management terminal 01 and the scheduling device 02, the scheduling device 02 and the resource server 03, the resource service 03 and the operation display device 04, and the scheduling device 02 and the analysis server 05 all perform data communication in a wired or wireless communication manner. In addition, in the embodiment of the present application, the scheduling device 02 may exist independently, may be a part of the operation management terminal 01, may be a part of the resource server 03, and may analyze a part of the server 05. Further, the operation display device 04 and the operation management terminal 01 may be independent devices, or may be the same device. In this regard, the present application is not particularly limited.

In the application, an operator may send a video analysis request to the scheduling device 02 through the operation management terminal 01, so that the scheduling device 02 obtains a resource file of a target video corresponding to the video analysis request from the resource server 03, and sends the resource file to the analysis server 05 for analysis to obtain an analysis result.

If the resource server 03 stores the resource file required by the scheduling device 02, the resource server 03 may obtain the corresponding resource file from its own memory and send the resource file to the scheduling device. If the resource server 03 does not store the resource file needed by the scheduling device 02, the resource server 03 may instruct the operation display device 04 to record the corresponding video to obtain the resource file needed by the scheduling device.

For example, in the embodiment of the present application, the operation management terminal 01 may be a mobile phone, a tablet computer, a desktop, a laptop, a handheld computer, a notebook, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a Personal Digital Assistant (PDA), an Augmented Reality (AR) \ Virtual Reality (VR) device, and the like, which may be installed and used with the operation management platform, and the embodiment of the present disclosure does not particularly limit the specific form of the operation management terminal 01. The operation management terminal 01 may perform human-computer interaction with a user through one or more modes, such as a keyboard, a touch pad, a touch screen, a remote controller, voice interaction, or a handwriting device.

For example, if the scheduling device 02 is a separate device in the present application, the scheduling device 02 may be any device installed with scheduling capability. The scheduling capability specifically refers to receiving an instruction or information of a device (e.g., an operation management terminal, a resource server, an analysis server) communicating with the scheduling device, and further acquiring corresponding data from another device connected to the scheduling device 02 or transmitting data to another device connected to the scheduling device 02.

Furthermore, the scheduling device 02 can establish a communication connection with at least one user terminal 06. When receiving a video playing request from the user terminal 06, the scheduling device 02 may obtain a corresponding resource file from the resource server 03 and return the resource file to the user terminal 06, so as to display the resource file.

For example, the resource server 03 in the present application may be a single server, a server cluster formed by multiple servers, or a cloud computing service center, which is not specifically limited in this application. In the embodiment of the present application, the resource server 03 is mainly used for storing resource files of a plurality of videos. Wherein each video may have at least one resource file, the resolution of different resource files of the same video being different. For example, a video may have five resource files with resolutions of 4K, 1080P, 720P, 480P, 360P, respectively. The resource server 03 may also transmit a corresponding resource file to the scheduling device in the case of receiving a resource acquisition request from the scheduling device 02. In addition, in the resource server 03, if there is no resource file required by the scheduling device, the resource server may, on its own initiative or in a case of receiving an instruction from the scheduling device, instruct the operation display device 04 connected to the resource server 03 to record a corresponding video to obtain a relevant resource file, and transmit the resource file to the scheduling device for use.

The operation display device 04 in the present application mainly refers to a display device owned by an operator corresponding to the operation management terminal 01. The operation display device 04 is normally always displayed, and may perform a corresponding operation (e.g., a recording operation) in response to an instruction of the resource server 03. That is to say, the operation display device 04 may cooperate with the resource server 03 to complete a part of the flow in the video analysis method provided by the present application.

For recording convenience, a recording application (or a recording service function) may be installed in the operation display device 04, that is, the operation display device 04 has a capability of recording videos.

Further, the operator can control the operation display device 04 through the mobile terminal 100 and the control apparatus 200. The control device 200 may be a remote controller, and the communication means of the remote controller and the operation display apparatus 04 includes infrared protocol communication, bluetooth protocol communication, wireless or other wired communication means. The operator can also input user instructions through keys on the remote controller, voice input, control panel input, etc. to control the operation display device 04. In addition, the operation display device 04 may also directly receive a voice input or a voice command of the operator through a module (e.g., MIC) configured therein to acquire the voice command. In some embodiments, tablets, computers, laptops, and other smart devices may also be used to control operational display device 04. In some embodiments, the same or mutually matched software applications may be installed on the mobile terminal 100 and the operation display device 04, so as to implement connection communication through a network protocol, and further implement the purpose of one-to-one control operation and data communication. In this case, the audio and video content displayed on the mobile terminal 100 may also be transmitted to the operation display device 04, so as to implement the synchronous display function.

For example, the operation display device 04 in the present application may have various implementation forms, and may be a display device that can perform voice input, such as a television, a smart television, a laser projection device, a display (monitor), an electronic whiteboard (electronic whiteboard), an electronic desktop (electronic table), and so on. The embodiments of the present application do not limit the specific form of the display device. In the embodiment of the present application, a display device is taken as a television as an example for schematic description.

Of course, in some embodiments, the operation display device 04 and the operation management terminal 01 may be the same device, for example, a personal computer with a recording function.

For example, the analysis server 05 and the resource server 03 in the present application are similar in form, except that the processing capacity of the analysis server 05 is much stronger than that of the resource server 03, and the storage capacity is much smaller than that of the resource server 03. In the present application, the analysis server 05 may have a capability of intelligently analyzing the video. The intelligent analysis may specifically be to analyze (identify and locate) the content of the video to obtain an analysis result (which may be referred to as dotting data). Further, the analysis server 05 may also insert the analysis result into the corresponding video to obtain a new video. For example, if a tang appears in 1-10 seconds and brand a cosmetics appear in 10-20 seconds as a result of analyzing a certain video, a mark indicating the tang may be inserted into data corresponding to a video clip of 1-10 seconds of the video, and a mark indicating brand a cosmetics may be inserted into data corresponding to a video clip of 10-20 seconds.

Exemplarily, taking the operation display device 04 as a television as an example, fig. 3 shows a schematic structural diagram of the operation display device 04 provided in the embodiment of the present application.

As shown in fig. 3, the operation display apparatus 04 includes at least one of a tuning demodulator 110, a communicator 120, a detector 130, an external device interface 140, a controller 150, a display 160, an audio output interface 170, a memory, a power supply, and a user interface.

In some embodiments the controller comprises a processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input/output.

The display 160 includes a display screen component for displaying pictures, and a driving component for driving image display, and is used for receiving image signals from the controller output, displaying video content, image content, and a menu manipulation Interface component, and a user manipulation User Interface (UI).

The display 160 may be a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

The communicator 120 is a component for communicating with an external device or a server according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The operation display device 04 may establish transmission and reception of a control signal and a data signal with the external control device 200 or the server 02 through the communicator 120.

A user interface for receiving a control signal for controlling the apparatus 200 (e.g., an infrared remote controller, etc.).

The detector 130 is used to collect signals of the external environment or interaction with the outside. For example, the detector 130 includes a light receiver, a sensor for collecting the intensity of ambient light; alternatively, the detector 130 includes an image collector, such as a camera, which may be used to collect external environment scenes, attributes of the user, or user interaction gestures, or the detector 130 includes a sound collector, such as a microphone, which is used to receive external sounds.

The external device interface 140 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, and the like. The interface may be a composite input/output interface formed by the plurality of interfaces.

The tuner demodulator 110 receives a broadcast television signal through a wired or wireless reception manner, and demodulates an audio and video signal, such as an EPG data signal, from a plurality of wireless or wired broadcast television signals.

In some embodiments, controller 150 and modem 110 may be located in different separate devices, that is, modem 110 may also be located in an external device of the main device where controller 150 is located, such as an external set-top box.

The controller 150 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 150 controls the overall operation of the operation display device 04. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 160, the controller 150 may perform an operation related to the object selected by the user command.

In some embodiments the controller comprises at least one of a Central Processing Unit (CPU), a video processor, an audio processor, a Graphics Processing Unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory), a first to nth interface for input/output, a communication Bus (Bus), and the like.

The user may input a user command on a Graphical User Interface (GUI) displayed on the display 160, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

A "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables the conversion of the internal form of information to a form acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the display device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc. visual interface elements.

It will be appreciated that, in general, the implementation of display device functions requires the cooperation of software in addition to the support of the hardware described above.

In some embodiments, taking an operating system used for operating the display device 04 as an Android system as an example, referring to fig. 4, a system for operating the display device 04 may be divided into four layers, which are, from top to bottom, an Application (Applications) layer (referred to as an "Application layer"), an Application Framework (referred to as a "Framework layer"), an Android runtime (Android runtime) and system library layer (referred to as a "system runtime library layer"), and a kernel layer.

In some embodiments, at least one application program runs in the application program layer, and the application programs may be windows (windows) programs carried by an operating system, system setting programs, clock programs or the like; or an application developed by a third party developer. In this embodiment of the application, the application program layer may include a recording application, and the application may be configured to record a video played by the operation display device 04, and the resolution during recording may be adjustable, for example, the recording may be performed at any resolution of 4k, 1080P, 720P, and 360P resolutions. In this embodiment, the application may specifically control the operation display device 04 to play a related video after receiving the recording request sent by the resource server 03, and record the video with the resolution indicated by the recording request. After the recording is completed, the recording application may also return the recorded resource file to the resource server 03. Of course, the control of the operation display device 04 to play the relevant video may be performed by a video application on the operation display device 04, and the resource file may be sent by calling a communication interface of the operation display device. In particular implementations, the application packages in the application layer are not limited to the above examples.

The framework layer provides an Application Programming Interface (API) and a programming framework for the application. The application framework layer includes some predefined functions or services. The application framework layer acts as a processing center that decides to let the applications in the application layer act. The application program can access the resources in the system and obtain the services of the system in execution through the API interface.

As shown in fig. 4, the application framework layer in the embodiment of the present application includes a manager (Managers), a Content Provider (Content Provider), a View system (View system), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used for interacting with all activities running in the system; the Location Manager (Location Manager) is used for providing the system service or application with the access of the system Location service; a Package Manager (Package Manager) for retrieving various information about an application Package currently installed on the device; a Notification Manager (Notification Manager) for controlling display and clearing of Notification messages; a Window Manager (Window Manager) is used to manage icons, windows, toolbars, wallpapers, and desktop components on a user interface.

In some embodiments, the activity manager is used to manage the lifecycle of the various applications and the usual navigation fallback functions, such as controlling exit, opening, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of a display screen, judging whether a status bar exists, locking the screen, intercepting the screen, controlling the change of the display window (for example, reducing the display window, displaying a shake, displaying a distortion deformation, and the like), and the like.

In some embodiments, the system runtime layer provides support for the upper layer, i.e., the framework layer, and when the framework layer is used, the android operating system runs the C/C + + library included in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software. The inner core layer comprises at least one of the following drivers: audio drive, demonstration drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.), MIC drive and power drive etc..

Fig. 5 shows an exemplary structural diagram of a server. The server may be a specific example of the resource server or the analysis server in the foregoing embodiments. Referring to fig. 5, the server includes one or more processors 201, a communication line 202, and at least one communication interface (which is only exemplarily illustrated in fig. 5 to include a communication interface 203 and one processor 201), and optionally may further include a memory 204.

The processor 201 may be a general processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more ics for controlling the execution of programs in accordance with the present invention.

The communication line 202 may include a path for communication between different components.

The communication interface 203, which may be a transceiver module, is used for communicating with other devices or communication networks, such as ethernet, RAN, wireless Local Area Networks (WLAN), etc. For example, the transceiver module may be a transceiver, or the like. Optionally, the communication interface 203 may also be a transceiver circuit located in the processor 201 to realize signal input and signal output of the processor.

The memory 204 may be a device having a storage function. Such as, but not limited to, read-only memory (ROM) or other types of static storage devices that may store static information and instructions, random Access Memory (RAM) or other types of dynamic storage devices that may store information and instructions, electrically erasable programmable read-only memory (EEPROM), compact disk read-only memory (CD-ROM) or other optical disk storage, optical disk storage (including compact disk, laser disk, optical disk, digital versatile disk, blu-ray disk, etc.), magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. The memory may be separate and coupled to the processor via communication line 202. The memory may also be integral to the processor.

The memory 204 is used for storing computer-executable instructions for executing the present application, and is controlled by the processor 201 to execute. The processor 201 is configured to execute computer-executable instructions stored in the memory 204, so as to implement corresponding steps in the video analysis method provided in the embodiment of the present application.

Alternatively, in this embodiment of the present application, the processor 201 may also perform functions related to processing in the video analysis method provided in the following embodiments of the present application, and the communication interface 203 is responsible for communicating with other devices (for example, an operation display device, a scheduling device) or a communication network, which is not specifically limited in this embodiment of the present application.

Optionally, the computer-executable instructions in this embodiment may also be referred to as application program codes, which is not specifically limited in this embodiment.

In particular implementations, processor 201 may include one or more CPUs, such as CPU0 and CPU1 in fig. 5, as one embodiment.

In particular implementations, a server may include multiple processors, such as processor 201 and processor 207 in FIG. 5, for example, as an embodiment. Each of these processors may be a single-core (si) processor or a multi-core (multi-core) processor. The processor herein may include, but is not limited to, at least one of: various computing devices that run software, such as a Central Processing Unit (CPU), a microprocessor, a Digital Signal Processor (DSP), a Microcontroller (MCU), or an artificial intelligence processor, may each include one or more cores for executing software instructions to perform operations or processing.

In one embodiment, the server may further include an output device 205 and an input device 206. The output device 205 is in communication with the processor 201 and may display information in a variety of ways. For example, the output device 205 may be a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display device, a Cathode Ray Tube (CRT) display device, a projector (projector), or the like. The input device 206 is in communication with the processor 201 and may receive user input in a variety of ways. For example, the input device 206 may be a mouse, a keyboard, a touch screen device, or a sensing device, among others.

The server may be a general purpose device or a dedicated device. For example, the server may be a desktop computer, a laptop computer, a web server, a Personal Digital Assistant (PDA), a mobile phone, a tablet computer, a wireless terminal device, an embedded device, or a device having a similar structure as in fig. 5. The embodiment of the application does not limit the type of the server.

The video or the resource file of the video referred to in the present application may be data authorized by the user or sufficiently authorized by each party.

The method in the following embodiments may be implemented in the video analysis system described in the previous embodiments. In the following embodiments, an operation display device is taken as a television as an example, and a video analysis method provided in the embodiments of the present application is described.

Based on the video analysis system shown in fig. 2, taking a scheduling device as an independent device as an example, referring to fig. 6, an embodiment of the present application provides a video analysis method, which may include S601-S607:

s601, the scheduling device receives a video analysis request.

Specifically, under the condition that an operator needs to perform intelligent analysis on a certain video in advance, the operator can send a video analysis request to the scheduling device through the operation management terminal. Based on this, referring to fig. 6, S601 may include: and the operation management terminal sends a video analysis request to the scheduling equipment.

The video analysis request is used for requesting intelligent analysis on the target video. For example, the video analysis request may carry video information mediaID of the target video. The mediaID may uniquely specify a particular video source name, such as XX. The mediaID may specifically consist of a title programind plus an episode name serieID. For example, XX in XX is the title programind, and XX in XX is the title serieID. Of course, the video information indicating the target video may be any other feasible implementation manner, and the present application does not specifically limit this.

S602, the scheduling device sends a resource acquisition request to the resource server.

The resource obtaining request is used for requesting a first resource file with a target resolution in the resource files of the target video. The resource obtaining request may carry video information indicating a target video and a target resolution.

It can be understood that after the scheduling device obtains the video analysis request, the scheduling device needs to obtain a resource file of the target video from the resource server and then sends the resource file to the analysis server for intelligent analysis, so as to obtain an analysis result of the target video. In the process of uploading the resource file to the analysis server by the scheduling device through the network, the lower the resolution of the resource file is, the faster the transmission process is. Furthermore, when the analysis server analyzes the video, the acceptable resolution of the resource file is generally not as high as when the user watches the video. Based on this, in order to improve the transmission efficiency, the time period required for intelligent analysis of the video is further reduced. The user can configure the minimum resolution that the analysis server can receive, i.e. the target resolution, in the scheduling device in advance. Illustratively, the target resolution may be 360P.

S603, the resource server receives a resource acquisition request from the scheduling device.

S604, the resource server responds to the resource obtaining request and sends the first resource file to the scheduling equipment.

The resource server may store resource files of a plurality of videos, and each video may have a plurality of resource files with different resolutions. After receiving the resource acquisition request from the scheduling device, the resource server may acquire the corresponding resource file and return the resource file to the scheduling device.

In practice, the resource server does not necessarily store the resource file of the target video, or the first resource file of which the resolution of the target video is the target resolution. There are two cases in practice for the resource server to send the implementation of the first resource file to the scheduling device (implementation of S604):

in the first case: and the resource server only acquires the first resource file from the memory of the resource server, if the first resource file can be acquired, the first resource file is sent to the scheduling equipment, and if the first resource file cannot be acquired, the flow is ended. Based on this, in some embodiments, referring to fig. 7 in combination with fig. 6, S604 may specifically be S1-S3:

s1, the resource server responds to the resource acquisition request and judges whether a resource file of a target video is stored.

In the case where the resource server determines that the resource file storing the target video is stored, S2 is performed. And in the case that the resource server determines that the resource text of the target video is not stored, ending the process.

The resource server may specifically determine whether the resource file of the target video is stored in its own memory by using the video information of the target video carried in the resource acquisition request.

S2, the resource server judges whether a first resource file exists in the resource files of the target video.

In the case where the resource server determines that the first resource file exists in the resource files of the target video, S3 is performed. And under the condition that the resource server determines that the first resource file does not exist in the resource files of the target video, the process is ended.

The resource server may specifically determine whether the first resource file exists by using the target resolution carried in the resource acquisition request.

It should be noted that S1 and S2 may be the same determination step, that is, the resource server determines whether the first resource file is stored. If the execution of S3 is present, the flow ends if not present.

Actually, the two determination steps S1 and S2 may not exist, the resource server may execute S3 when the first resource file exists, and the process may be ended when the first resource file does not exist.

And S3, the resource server sends the first resource file to the scheduling equipment under the condition that the first resource file is stored.

Based on the technical solutions corresponding to the above S1-S3, the resource server may send the first resource file to the scheduling device in time under the condition that the resource server itself stores the first resource file, so that the scheduling device completes the subsequent video analysis process.

In the second case: if the resource server stores the first resource file, the resource server may return the first resource file stored by the resource server to the scheduling device. Referring to fig. 8 in conjunction with fig. 1, if the resource server does not store the first resource file (for example, the resource file of the live video), the resource server may record the first resource file by instructing the television to obtain the first resource file. Based on this, in an implementation manner, referring to fig. 9 in conjunction with fig. 6, S604 may specifically be X1-X12:

and X1, the resource server responds to the resource acquisition request and judges whether the resource file of the target video is stored or not.

In the case where the resource server determines that the resource file storing the target video is stored, X2 is executed. If the resource server determines that the resource file of the target video is not stored, X4 is executed.

And X2, the resource server judges whether a first resource file exists in the resource files of the target video.

In the case where the resource server determines that the first resource file exists in the resource files of the target video, X3 is executed. In the case where the resource server determines that the first resource file does not exist in the resource files of the target video, X4 is executed.

It should be noted that X1 and X2 may be the same determination step, that is, the resource server determines whether the first resource file is stored. If there is execution X3, if not, then X4 is executed.

In practice, there may not be the two determination steps X1 and X2, and the resource server may execute X3 if there is a first resource file, and execute X4 if there is no first resource file.

And X3, the resource server sends the first resource file to the scheduling equipment under the condition that the first resource file is stored.

And X4, the resource server sends a no-resource response to the scheduling equipment under the condition that the first resource file is not stored.

Wherein the no resource response user indicates that the first resource file does not exist in the resource server.

And X5, the scheduling equipment receives a no-resource response from the resource server.

When receiving the no-resource response from the resource server, the scheduling device may send recording indication information to the resource server in order to obtain the first resource file, so that the resource server records the target video to obtain the first resource file.

And X6, the scheduling equipment sends recording indication information to the resource server.

The recording indication information is used for indicating the resource server to record the target video with the resolution as the target resolution, and the first resource file is obtained by returning and recording. The recording indication information may carry video information of the target video and the target resolution.

And X7, the resource server receives the recording indication information from the scheduling equipment.

After receiving the recording indication information, the resource server may send a recording request to the television, so that the television records the target video at the target resolution, i.e., execute X8.

And X8, the resource server sends a recording request to the television.

The recording request is used for requesting to record the target video with the resolution as the target resolution, and the first resource file obtained by recording is returned. The recording request may carry video information of the target video and the target resolution.

And X9, the television receives a recording request from the resource server, responds to the recording request, plays the target video, and records the target video with the resolution as the target resolution to obtain a first resource file.

The television can search the resources of the target video according to the video information of the target video in the recording request, then play the target video and record the target video. In a specific implementation process, in order to record less consumed time, the television can play the target video at a multiple speed.

And X10, the television sends the first resource file to the resource server.

And X11, the resource server receives a first resource file from the television.

And X12, the resource server sends the first resource file to the scheduling equipment.

Based on the technical scheme corresponding to the X1-X12, the resource server can store the first resource file in the resource server, and obtain the first resource file by virtue of the recording capability of the television. Therefore, the first resource file can be sent to the scheduling equipment, so that the video analysis process can be smoothly carried out.

In another possible design mode, after receiving a resource acquisition request of the scheduling device, if it is determined that the resource server does not store the first resource file, the resource server may actively send a recording request to the television to further acquire the first resource file. Based on this, referring to fig. 10 in conjunction with fig. 9, after X2, if the resource server determines that the first resource file does not exist in the resource files of the target video, X8-X12 is executed.

Based on the scheme, compared with the technical scheme corresponding to the X1-X12, the signaling interaction between the resource server and the scheduling equipment can be reduced, and the consumption of communication resources is reduced. In addition, the reduction of signaling interaction can also reduce the time required by the video analysis method under the condition that the resource server does not store the first resource file. Meanwhile, signaling interaction is reduced, the possibility of faults is reduced, and the reliability of the video analysis method can be ensured to a certain extent.

S605, the scheduling device receives a first resource file from the resource server.

S606, the scheduling device sends the first resource file to the analysis server.

Specifically, when the scheduling device sends the first resource file to the analysis server, the scheduling device may also send an analysis request like the analysis server in order that the analysis server may perform intelligent analysis on the first resource file. The analysis request may be for requesting the analysis server to intelligently analyze the first resource file.

S607, the analysis server receives the first resource file from the scheduling device, and intelligently analyzes the first resource file to obtain an analysis result of the target video.

After the analysis server obtains the first resource file, any feasible intelligent analysis method (for example, video Content Analysis (VCA)) may be used to perform content analysis on the first resource file to obtain an analysis result of the target video, or obtain dotting data.

Further, in order to facilitate the use of the operator, the analysis server may further insert the analysis result into the first resource file. Specifically, the analysis results of different video segments or different video frames may be inserted into the data of the response. After that, the analysis server may further send the first resource file into which the analysis result is inserted to the resource server, so that the resource server updates the first resource file stored by the resource server.

Of course, the analysis result of the target video may also exist alone, and in this case, as shown in fig. 11 in combination with fig. 6, after S607, the method may further include S608-S611:

s608, the analysis server may send the analysis result of the target video to the scheduling device.

And S609, the scheduling equipment receives the analysis result of the target video from the analysis server.

S610, the scheduling equipment sends the analysis result of the target video to the resource server.

S611, the resource server receives and stores the analysis result of the target video from the scheduling device.

When the resource server stores the analysis result of the target video, the analysis result can be associated with the target video, so that the subsequent use is facilitated.

Based on the technical solutions corresponding to the above S608-S611, the analysis result of the target video can be stored in the resource server in time, and when the subsequent user terminal needs to watch the target video, the resource server can return the analysis result to the user terminal for use.

Subsequently, if the user terminal requests the resource server to play the target video through the scheduling device, the resource server may send the resource file of the target video and the analysis result of the target video to the scheduling device together, so that the scheduling device sends the resource file of the target video and the analysis result of the target video to the user terminal for playing. The user terminal may display the recommended content based on the analysis result when playing. For example, the analysis results may be applied in the following centralized scenario:

the first scenario is: in the process of playing the video by the user terminal, if the user triggers the user terminal to identify a certain content in the video, the specific content in the analysis result is found according to the playing time point. For example, the content recognition command is triggered at the xx second, and the content in the second analysis result is found to be "komodo julian", and then the user terminal can directly display the result.

The second scenario is: if cosmetics and automobiles appear at a certain time point in the process of playing the video by the user terminal, advertisements of the cosmetics are put in when the cosmetics appear and advertisements of the automobiles are put in when the automobiles appear according to the analysis result and the pre-embedded advertisement strategy.

The third scenario is: for short videos, if a user searches videos of a certain category, video segments of the video with the category object appearing in different videos can be integrated according to analysis results of a plurality of videos to obtain a video collection, and the video collection is displayed to the user for viewing. Such as gourmet food, pets, etc.

The fourth scenario is as follows: for a certain actor in a certain television play, the user terminal can determine the video frequency band of the actor according to the analysis result and splice the video frequency bands. When the user triggers the user terminal to only show the segments of a certain actor, only the video segments in which the actor appears or the spliced video can be played.

Of course, the analysis results may be applied in any feasible scenario.

It should be noted that, if the scheduling device is not a separate device, the steps performed by the scheduling device in the foregoing embodiment may be performed by a module that implements the scheduling device in the device in which the scheduling device is located. This is not specifically limited by the present application.

Based on the technical scheme provided by the application, when a certain video (namely a target video) needs to be analyzed, an operation user sends a video analysis request to scheduling equipment. The video analysis request is used for requesting intelligent analysis on the target video. And then the scheduling device can acquire the resource file of the target video from the resource server by sending a resource acquisition request to the resource server. The resource obtaining request carries a target resolution. The target resolution may then be the lowest resolution or lower resolution that the analysis server can accept when intelligently analyzing the video. In this way, the scheduling device obtains the first resource file of the target video resolved to the target resolution from the resource server. And then, the scheduling device can send the first resource file to an analysis server for analysis so as to obtain an analysis result of the target video. It can be seen that, based on the technical solution provided by the present application, when the analysis server needs to analyze the non-local video resource, the scheduling device sends a resource file with a lower resolution to the analysis server. Because the resolution ratio is lower, the resource file is smaller, the time consumption of network transmission is shorter, the time required for completing the final intelligent analysis is shorter, the intelligent analysis efficiency is higher, and the use experience of a user is better.

In some embodiments, after analyzing the target video to obtain the analysis result, if the user terminal requests the target video, the scheduling device may send the analysis result of the target video and the resource file of the target video to the user terminal for use. Based on this, referring to fig. 12 in conjunction with fig. 6, after S606 (or after S607), the method further includes S612-S618:

s612, the scheduling device receives a first video acquisition request from the user terminal.

The first video acquisition request is used for requesting a target video. The first video acquisition request is used for requesting a target video.

The user terminal may be any terminal that can establish a communication connection with the scheduling device, such as a television.

S613, the scheduling device sends a second video acquisition request to the resource server.

In order to ensure the viewing experience of the user, the scheduling device usually obtains the resource file with the highest resolution or higher resolution to provide the resource file to the user terminal. Based on this, the second video acquisition request may be used to request a second resource file of the resource files of the target video. And the resolution of the second resource file is greater than or equal to the target resolution.

Certainly, in an actual implementation process, the first video acquisition request sent by the user terminal to the user terminal may carry a preset resolution. The preset resolution may be determined by a resolution selection operation when the user views the video through the user terminal, or may be determined by the user using the video application on the user terminal according to an account number that the user logs in (for example, if an account number for which a member is opened, the preset resolution is higher, and if an account number for which a member is not opened, the preset resolution is lower), or may be determined in any other feasible manner. The preset resolution is equal to or greater than the target resolution in the foregoing embodiment. Therefore, the resolution of the video watched by the user is as large as possible, and the use experience of the user is improved.

S614, the resource server receives a second video acquisition request from the scheduling device.

S615, the resource server sends the second resource file to the scheduling equipment.

S616, the scheduling equipment acquires the analysis result of the target video.

In one possible implementation manner, the scheduling device may obtain an analysis result of the target video from the analysis server. Based on this, referring to fig. 13 in conjunction with fig. 10, S616 may specifically include S6161-S6164:

s6161, the dispatching device sends an analysis result acquisition request to the analysis server.

Wherein the analysis result acquisition request is used for requesting the analysis result of the target video

S6162, the analysis server receives an analysis result obtaining request from the scheduling device.

S6163, the analysis server sends the analysis result of the target video to the scheduling device.

S6164, the dispatching equipment receives the analysis result of the target video from the analysis server.

Based on the scheme, the scheduling equipment can acquire the analysis result of the target video and further can send the analysis result to the user terminal for use.

In another possible implementation manner, after the analysis server obtains the analysis result of the target video through analysis, the analysis result is stored in the resource server through the scheduling device, or after the analysis server inserts the analysis result into the target video, a new target video is stored in the resource server through the scheduling device. The resource server will carry the analysis result of the target video when sending the target video to the scheduling device. In this case, the analysis result that the scheduling device needs to obtain the target video may be carried in the second resource file that the resource server sends to the scheduling device. At this time, the second video acquisition request may also be used to request the analysis result of the target video.

S617, the scheduling device sends the second resource file and the analysis result of the target video to the user terminal.

And S618, the user terminal receives the second resource file and the analysis result of the target video from the scheduling device.

Based on the technical solutions corresponding to S612 to S618, the user terminal may also obtain an analysis result of the target video when obtaining the target video from the scheduling device. Therefore, the user terminal can display the corresponding recommended content according to the analysis result in the process of playing the second resource file, and the user experience is improved.

The scheme provided by the embodiment of the application is mainly introduced from the perspective of a method. To implement the above functions, it includes hardware structures and/or software modules for performing the respective functions. Those of skill in the art will readily appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as hardware or combinations of hardware and computer software. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

In the embodiment of the present application, the functional modules of the devices in the video analysis system may be divided according to the method example, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. It should be noted that, in the embodiment of the present application, the division of the module is schematic, and is only one logic function division, and there may be another division manner in actual implementation.

Referring to fig. 14, an embodiment of the present application provides a video analysis apparatus, which is applied to a scheduling device. The video analysis apparatus may include a receiving module 141, a transmitting module 142, and an obtaining module 143.

The receiving module 141 is configured to receive a video analysis request; the video analysis request is used for requesting intelligent analysis on the target video. A sending module 142, configured to send a resource obtaining request to a resource server; the resource obtaining request is used for requesting a first resource file with the resolution as the target resolution in the resource files of the target video. A receiving module 141, further configured to receive a first resource file from a resource server; the sending module 142 is further configured to send the first resource file to the analysis server, so that the analysis server performs intelligent analysis on the first resource file to obtain an analysis result of the target video.

In a possible design, after the sending module 142 sends the resource obtaining request to the resource server, and before the receiving module 141 receives the first resource file from the resource server, the receiving module 141 is further configured to receive a no-resource response from the resource server; the no resource response is to indicate that the first resource file is not present in the resource server. The sending module 142 is further configured to send recording indication information to the resource server; and the recording indication information is used for indicating the resource server to record the target video with the resolution as the target resolution, and returning to record to obtain the first resource file.

In a possible design, after the sending module 142 sends the first resource file to the analysis server, the receiving module 141 is further configured to receive an analysis result of the target video from the analysis server; the sending module 142 is further configured to send the analysis result of the target video to the resource server.

In one possible embodiment, the apparatus further includes an acquisition module 143. After the sending module 142 sends the first resource file to the analysis server, the receiving module 141 is further configured to receive a first video acquisition request from the user terminal; the first video acquisition request is used for requesting a target video. The sending module 142 is further configured to send a second video obtaining request to the resource server; the second video acquisition request is used for requesting a second resource file in the resource files of the target video; the resolution of the second resource file is greater than or equal to the target resolution; the receiving module 141 is further configured to receive a second resource file from the resource server; the obtaining module 143 is configured to obtain an analysis result of the target video; the sending module 142 is further configured to send, to the user terminal, the second resource file received by the receiving module 141 and the analysis result of the target video acquired by the acquiring module 143.

In one possible design, the obtaining module 143 is specifically configured to: sending an analysis result acquisition request to an analysis server; the analysis result acquisition request is used for requesting the analysis result of the target video; and receiving an analysis result of the target video from the analysis server.

With regard to the video analysis apparatus applied to the scheduling device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the foregoing embodiment of the video analysis method, and will not be described in detail here.

Referring to fig. 15, an embodiment of the present application further provides a video analysis apparatus, which is applied to a resource server. The apparatus includes a receiving module 151, a transmitting module 152, and a storage module 153.

The receiving module 151 is configured to receive a resource obtaining request from a scheduling device; the resource obtaining request is used for requesting a first resource file with the target resolution in the resource files of the target video; a sending module 152, configured to send the first resource file to the scheduling device in response to the resource obtaining request received by the receiving module 151, so that the scheduling device sends the first resource file to the analysis server for analysis to obtain an analysis result.

In a possible embodiment of the fourth aspect, the apparatus further comprises a storage module 153. The sending module 152 is specifically configured to: in response to the resource acquisition request received by the receiving module 151, in the case that the storage module 153 stores a first resource file, the first resource file is sent to the scheduling apparatus.

In a possible embodiment of the fourth aspect, the apparatus further comprises a storage module 153. The sending module 152 is specifically configured to: in response to the resource acquisition request received by the receiving module 151, sending a no-resource response to the scheduling device when the storage module 153 does not store the first resource file; the no resource response is used for indicating that the first resource file does not exist in the resource server; the receiving module 151 is further configured to receive recording indication information from a scheduling apparatus; the recording indication information is used for indicating the resource server to record the target video with the resolution as the target resolution, and returning to record to obtain a first resource file; the sending module 152 is further configured to send a recording request to the operation display device; the recording request is used for requesting to record the target video by taking the resolution as the target resolution and returning to the first resource file obtained by recording; the receiving module 151 is further configured to receive a first resource file from an operation display device; the sending module 152 is further configured to send the first resource file to the scheduling device.

In a possible design manner of the fourth aspect, the receiving module 151 is further configured to receive a second video obtaining request from the scheduling device; the second video acquisition request is used for requesting a second resource file in the resource files of the target video; the resolution of the second resource file is greater than or equal to the target resolution; the sending module 152 is further configured to send the second resource file to the scheduling device.

With regard to the video analysis apparatus applied to the resource server in the above embodiment, the specific manner in which each module performs the operation has been described in detail in the foregoing embodiment of the video analysis method, and will not be described in detail here.

It should be understood that the division of units or modules (hereinafter referred to as units) in the above apparatus is only a division of logical functions, and may be wholly or partially integrated into one physical entity or physically separated in actual implementation. And the units in the device can be realized in the form of software called by the processing element; or may be implemented entirely in hardware; part of the units can also be realized in the form of software called by a processing element, and part of the units can be realized in the form of hardware.

For example, each unit may be a processing element separately set up, or may be implemented by being integrated into a chip of the apparatus, or may be stored in a memory in the form of a program, and a processing element of the apparatus calls and executes the function of the unit. In addition, all or part of the units can be integrated together or can be independently realized. The processing element described herein, which may also be referred to as a processor, may be an integrated circuit having signal processing capabilities. In the implementation process, the steps of the method or the units above may be implemented by integrated logic circuits of hardware in a processor element or in a form called by software through the processor element.

In one example, the units in the above apparatus may be one or more integrated circuits configured to implement the above method, such as: one or more ASICs, or one or more DSPs, or one or more FPGAs, or a combination of at least two of these integrated circuit forms.

As another example, when a unit in a device may be implemented in the form of a processing element scheduler, the processing element may be a general purpose processor, such as a CPU or other processor capable of invoking programs. As another example, these units may be integrated together, implemented in the form of a system on chip SOC.

In one implementation, the means for implementing the respective corresponding steps of the above method by the above apparatus may be implemented in the form of a processing element scheduler. For example, the apparatus may include a processing element and a storage element, the processing element calling a program stored by the storage element to perform the video analysis method described in the above method embodiments. The memory elements may be memory elements on the same chip as the processing elements, i.e. on-chip memory elements.

In another implementation, the program for performing the above method may be in a memory element on a different chip than the processing element, i.e. an off-chip memory element. At this time, the processing element calls or loads a program from the off-chip storage element onto the on-chip storage element to call and execute the video analysis method described in the above method embodiment.

An embodiment of the present application further provides a scheduling apparatus, including: communication interface, processor, memory, bus; the memory is used for storing computer execution instructions, and the processor is connected with the memory through a bus; when the scheduling apparatus is running, the processor executes computer-executable instructions stored by the memory to cause the scheduling apparatus to perform the methods provided in the above-described method embodiments.

An embodiment of the present application further provides a resource server, including: communication interface, processor, memory, bus; the memory is used for storing computer execution instructions, and the processor is connected with the memory through a bus; when the resource server is running, the processor executes computer-executable instructions stored by the memory to cause the resource server to perform the methods provided in the method embodiments described above.

For example, the embodiment of the present application also provides a chip, which may be applied to the scheduling device or the resource server. The chip includes one or more interface circuits and one or more processors; the interface circuit and the processor are interconnected through a line; the processor receives and executes computer instructions from the memory of the display device through the interface circuitry to implement the methods described in the method embodiments above.

Embodiments of the present application further provide a computer-readable storage medium having executable instructions stored thereon. The executable instructions, when executed by the scheduling apparatus, cause the scheduling apparatus to implement the video analysis method as described above.

Embodiments of the present application also provide a computer-readable storage medium having executable instructions stored thereon. The executable instructions, when executed by the resource server, enable the resource server to implement the video analytics method as described above.

An embodiment of the present application further provides a computer program product, which includes computer instructions executed by the foregoing scheduling apparatus, and when the computer program product is executed in the scheduling apparatus, the scheduling apparatus may implement the video analysis method in the foregoing method embodiment.

The embodiment of the present application further provides a computer program product, which includes computer instructions executed by the resource server as described above, and when the computer program product is executed in the resource server, the resource server may implement the video analysis method in the above method embodiment.

The embodiment of the present application further provides a video analysis system, where the system includes a scheduling device, a resource server, and an analysis server, where the scheduling device establishes a communication connection with the resource server and the analysis server, the scheduling device is configured to execute relevant steps in the video analysis method in the foregoing method embodiment, and the resource server is configured to execute relevant steps in the video analysis method in the foregoing method embodiment.

Through the above description of the embodiments, it is clear to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely used as an example, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules to complete all or part of the above described functions.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described device embodiments are merely illustrative, and for example, the division of the modules or units is only one type of logical functional division, and other divisions may be realized in practice, for example, multiple units or components may be combined or integrated into another device, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may be one physical unit or a plurality of physical units, that is, may be located in one place, or may be distributed in a plurality of different places. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be embodied in the form of software products, such as: and (5) programming. The software product is stored in a program product, such as a computer readable storage medium, and includes several instructions for causing a device (which may be a single chip, a chip, or the like) or a processor (processor) to perform all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk or an optical disk, and various media capable of storing program codes.

The above description is only an embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A video analysis method applied to a scheduling device, the method comprising:

receiving a video analysis request; the video analysis request is used for requesting intelligent analysis on a target video;

sending a resource acquisition request to a resource server; the resource obtaining request is used for requesting a first resource file with a target resolution in the resource files of the target video;

receiving a first resource file from the resource server;

and sending the first resource file to an analysis server so that the analysis server can perform intelligent analysis on the first resource file to obtain an analysis result of the target video.

2. The method of claim 1, wherein after sending the resource acquisition request to the resource server and before receiving the first resource file from the resource server, the method further comprises:

receiving a no resource response from the resource server; the no resource response is to indicate that the first resource file is not present in the resource server;

sending recording indication information to the resource server; and the recording indication information is used for indicating the resource server to record the target video with the resolution being the target resolution, and returning to record to obtain the first resource file.

3. The method of claim 1, wherein after sending the first resource file to an analytics server, the method further comprises:

receiving an analysis result of the target video from the analysis server;

and sending the analysis result of the target video to a resource server.

4. The method of any of claims 1-3, wherein after sending the first resource file to an analytics server, the method further comprises:

receiving a first video acquisition request from a user terminal; the first video acquisition request is used for requesting the target video;

sending a second video acquisition request to the resource server; the second video acquisition request is used for requesting a second resource file in the resource files of the target video; the resolution of the second resource file is greater than or equal to the target resolution;

receiving the second resource file from the resource server;

obtaining an analysis result of the target video;

and sending the second resource file and the analysis result of the target video to the user terminal.

5. The method of claim 4, wherein the obtaining the analysis result of the target video comprises:

sending an analysis result acquisition request to the analysis server; the analysis result acquisition request is used for requesting the analysis result of the target video;

receiving an analysis result of the target video from the analysis server.

6. A video analysis method is applied to a resource server, and the method comprises the following steps:

receiving a resource acquisition request from a scheduling device; the resource obtaining request is used for requesting a first resource file with the target resolution in the resource files of the target video;

and responding to the resource acquisition request, and sending the first resource file to the scheduling equipment so that the scheduling equipment sends the first resource file to an analysis server for analysis to obtain an analysis result.

7. The method of claim 6, wherein the sending the first resource file to the scheduling device in response to the resource acquisition request comprises:

and responding to the resource acquisition request, and sending the first resource file to the scheduling equipment under the condition that the first resource file is stored.

8. The method of claim 6, wherein the sending the first resource file to the scheduling device in response to the resource acquisition request comprises:

responding to the resource acquisition request, and sending a no-resource response to the scheduling equipment under the condition that the first resource file is not stored; the no resource response is to indicate that the first resource file is not present in the resource server;

receiving recording indication information from the scheduling equipment; the recording indication information is used for indicating the resource server to record the target video with the resolution as the target resolution, and returning to record to obtain the first resource file;

sending a recording request to operation display equipment; the recording request is used for requesting to record the target video by taking the resolution as the target resolution, and returning the first resource file obtained by recording;

receiving the first resource file from the operation display device;

and sending the first resource file to the scheduling equipment.

9. The method according to any one of claims 6-8, further comprising:

receiving a second video acquisition request from the scheduling device; the second video acquisition request is used for requesting a second resource file in the resource files of the target video; the resolution of the second resource file is greater than or equal to the target resolution;

and sending the second resource file to the scheduling equipment.

10. A video analysis system comprising a scheduling device, a resource server and an analysis server, the scheduling device establishing a communication connection with the resource server and the analysis server, the scheduling device being configured to perform the video analysis method according to any one of claims 1 to 5, and the resource server being configured to perform the video analysis method according to any one of claims 6 to 9.