WO2020186917A1 - Method for creating video processing task item and method for scheduling input video stream - Google Patents

Abstract

Disclosed are a method for creating a video processing task item and a method for scheduling an input video stream, relating to the technical field of artificial intelligence visual identification. The method for creating a video processing task item comprises: when an event for creating a video processing task item is detected on a user interface, determining information of a camera related to a video processing task item; determining a task item name of the video processing task item and a running time period of the video processing task item; and creating a video processing task item on the user interface based on the information of the camera related to the video processing task item, the task item name and the running time period. By means of the method for creating a video processing task item provided in the embodiments of the present application, a user can create a video processing task item on a user interface of a video processing system, so that the user can intuitively learn any information related to the video processing task item.

Description

Method for creating video processing task item and scheduling method for input video stream Technical field

This application relates to the field of artificial intelligence visual recognition technology, and in particular to a method for creating video processing task items, a method for scheduling input video streams, a device for creating video processing task items, a device for scheduling input video streams, electronic equipment, and computer readable Storage medium.

Background of the invention

Currently, when there is a video task to be processed, the user usually adds the input video stream corresponding to the video task to the video processing system to complete the processing of the video task. However, the user cannot intuitively learn any information about the video task on the video processing system.

Therefore, the development of a video processing system that enables users to intuitively obtain video task information has become an urgent problem to be solved.

Summary of the invention

In order to solve the above technical problems, this application is proposed. The embodiment of the present application provides a method for creating a video processing task item and a method for scheduling an input video stream.

According to one aspect of the present application, a method for creating a video processing task item is provided, which includes: when an event for creating a video processing task item is detected on a user interface, determining camera information related to the video processing task item; Determine the task item name of the video processing task item and the running time period of the video processing task item; and create a video processing task item on the user interface based on the camera information, task item name and running time period related to the video processing task item.

According to another aspect of the present application, a method for scheduling input video streams is provided, wherein one video processing task item is related to information of at least one camera, one camera acquires one input video stream, and multiple video processing task items correspond to multiple The scheduling method includes: determining the type of the video stream in the multiple input video stream; adding the video stream of the first preset type to the computing resource pool; and determining the video stream of the second preset type Perform real-time recording.

According to another aspect of the present application, there is provided a device for creating a video processing task item, including: a first determining module, configured to determine and video processing when an event for creating a video processing task item is detected on a user interface Camera information related to the task item; and determine the task item name of the video processing task item and the running time period of the video processing task item; create a module to be based on the camera information, task item name and operation related to the video processing task item Time period, create a video processing task item on the user interface.

According to another aspect of the present application, there is provided an input video stream scheduling device, wherein one video processing task item is related to information of at least one camera, one camera acquires one input video stream, and multiple video processing task items correspond to multiple Input video streams, the scheduling device includes: a second determining module, used to determine the type of the video stream in the multiple input video streams; a scheduling module, used to add the video streams of the first preset type to the computing resource pool; And a recording module for real-time recording of the video stream of the second preset type.

According to another aspect of the present application, there is provided an electronic device, including: a processor; and a memory, in which computer program instructions are stored, and when the computer program instructions are executed by the processor, the processor executes the above-mentioned first aspect. Any one of the methods described above; or, when the computer program instructions are executed by the processor, the processor executes any one of the methods described in the second aspect above.

According to another aspect of the present application, a computer-readable storage medium is provided. The computer-readable storage medium stores computer program instructions. When the computer program instructions are run by a processor, the processor executes the Or, when the computer program instructions are executed by the processor, the processor executes any of the methods described in the second aspect.

The method for creating a video processing task item provided by the embodiment of the present application enables a user to create a video processing task item on the user interface of the video processing system, thereby enabling the user to intuitively learn any information about the video processing task item.

In the method for scheduling input video streams provided by the embodiments of this application, by determining the type of each input video stream, input video streams with high weights can be processed in the computing resource pool first, thereby avoiding important input video streams Problems that cannot be dealt with because computing resources are occupied.

Brief description of the drawings

By describing the embodiments of the present application in more detail in conjunction with the accompanying drawings, the above and other objectives, features and advantages of the present application will become more apparent. The accompanying drawings are used to provide a further understanding of the embodiments of the application, and constitute a part of the specification. Together with the embodiments of the application, they are used to explain the application, and do not constitute a limitation to the application. In the drawings, the same reference numerals generally represent the same components or steps.

Figure 1 is a schematic frame diagram of a video system to which this application applies.

Fig. 2 is a schematic flowchart of a method for creating a video processing task item provided by an exemplary embodiment of the present application.

Fig. 3 is a schematic flowchart of a method for creating a video processing task item provided by another exemplary embodiment of the present application.

Fig. 4 is a schematic flowchart of a method for scheduling an input video stream provided by an exemplary embodiment of the present application.

Fig. 5 is a schematic flowchart of a method for scheduling an input video stream provided by another exemplary embodiment of the present application.

Fig. 6 is a schematic flowchart of a method for scheduling an input video stream according to another exemplary embodiment of the present application.

Fig. 7 is a schematic diagram of the overall process provided by an exemplary embodiment of the present application.

Fig. 8a is a schematic diagram of a video processing task item provided by an exemplary embodiment of the present application.

Fig. 8b is a schematic diagram of processing logic provided by an exemplary embodiment of the present application.

Fig. 8c is a schematic diagram of the time dimension of an input video stream provided by an exemplary embodiment of the present application.

Fig. 9 is a schematic structural diagram of an apparatus for creating a video processing task item provided by an exemplary embodiment of the present application.

Fig. 10 is a schematic structural diagram of an apparatus for creating a video processing task item provided by another exemplary embodiment of the present application.

Fig. 11 is a schematic structural diagram of a device for scheduling an input video stream provided by an exemplary embodiment of the present application.

Fig. 12 is a block diagram of an electronic device provided by an exemplary embodiment of the present application.

How to implement this application

Hereinafter, an exemplary embodiment according to the present application will be described in detail with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments of the present application, and it should be understood that the present application is not limited by the exemplary embodiments described herein.

Application overview

As mentioned in the background art, the prior art video processing system completes the processing of the video task by adding the input video stream corresponding to the video task to be processed into the video processing system, but the video processing system does not Any information about the video task, so that the user cannot intuitively learn any information about the video task from the video processing system.

Therefore, this application provides a method for creating a video processing task item, a method for scheduling an input video stream, an apparatus for creating a video processing task item, an apparatus for scheduling an input video stream, electronic equipment, and a computer-readable storage medium. The method for creating a video processing task item includes determining the camera information related to the video processing task item when an event for creating a video processing task item is detected on the user interface; determining the task item name of the video processing task item and the video processing The running time period of the task item; and based on the camera information, the name of the task item and the running time period related to the video processing task item, a video processing task item is created on the user interface. The method for creating a video processing task item provided by the embodiment of the present application enables a user to create a video processing task item on the user interface of the video processing system, thereby enabling the user to intuitively learn any information about the video processing task item.

Exemplary system

Figure 1 is a schematic frame diagram of a video system to which this application applies.

As shown in FIG. 1, the video system may include a plurality of cameras 130 and an electronic device 110, and the plurality of cameras 130 may communicate with the electronic device 110 through a transmission network 120. Specifically, the camera 130 transmits the acquired input video stream to the electronic device 110 through the transmission network 120, so that the electronic device 110 can process the input video stream. Here, the transmission network 120 may refer to a wired network or a wireless network, and the transmission mode of the transmission network 120 is not limited here.

Exemplary method

Fig. 2 is a schematic flowchart of a method for creating a video processing task item provided by an exemplary embodiment of the present application. This embodiment can be executed on the electronic device 110 shown in FIG. 1. As shown in FIG. 2, the method may include the following steps:

Step 205: When an event for creating a video processing task item is detected on the user interface, determine the information of the camera 130 related to the video processing task item.

Specifically, the user can interact with the electronic device 110 through a user interface. For example, the user interface may include a create button for a video processing task item. When the user triggers the button, the electronic device 110 can detect an event for creating a video processing task item, and display the information of the camera 130 connected to the system on the user interface for the user to select. Before making the selection, the user has determined the video processing task item, and has learned the relevant camera 130 information according to the determined video processing task item. When making a selection, the user completes the determination of the information of the camera 130 related to the video processing task item according to the learned information of the related camera 130.

Here, one video processing task item is related to at least one camera 130. Correspondingly, multiple video processing task items are related to multiple cameras 130, and there may be a situation in which cameras 130 are multiplexed between different video processing task items. In addition, since one camera 130 obtains one input video stream, one video processing task item is related to at least one input video stream. Correspondingly, multiple video processing task items are related to multiple input video streams, and there may be multiplexing of input video streams between different video processing task items.

The following describes the concept of the video processing task item in conjunction with the application scenario of the shoe store. In order to learn more about the situation in the store, the shopkeeper set up cameras in the four directions of the shoe store. In order to facilitate the distinction, the four cameras may be called camera a, camera b, camera c, and camera d, respectively. In order to understand the track of people in the front desk area of the shoe store, it is necessary to use the input video streams obtained by these four cameras. In order to know the number of users entering and exiting the foreground area, the input video streams obtained by camera a and camera c need to be used. Here, for the electronic device 110, counting the trajectories of personnel in the foreground area and the number of users entering and exiting the foreground area is the video processing task item. Because the trajectory of people in the front desk area is related to camera a, camera b, camera c, and camera d, and the number of users entering and leaving the front desk area is related to camera a and camera c, the trajectory of people in the front desk area and the number of users entering and leaving the front desk area are multiplexed. The input video stream of is the input video stream obtained by camera a and the input video stream obtained by camera c.

Step 210: Determine the task item name of the video processing task item and the running time period of the video processing task item.

Specifically, the task item name can be used to identify different video processing task items. The running time period can be used to determine the execution status of the video processing task item, thereby laying a foundation for directly displaying the execution status of the video processing task item on the user interface.

Here, the running time period may include a running start time point and a running end time point, and the running time period may be determined according to the shooting position of the camera 130 corresponding to the video processing task item (ie, the task scene). For some video processing task items in the shooting position, the content of the input video stream processed by the electronic device 110 every day may not be 24 hours of content. In other words, the running time period of the video processing task item can be determined according to actual needs, thereby avoiding the waste of computing resources.

In addition, the setting of the running time period also allows the electronic device 110 to spare computing resources, so that the electronic device 110 can process other input video streams to be processed during the time period when the computing resources are spared.

Step 215: Create a video processing task item on the user interface based on the information of the camera 130 related to the video processing task item, the name of the task item, and the running time period.

Specifically, a task list may exist on the user interface, and the created video processing task item may be displayed in the task list. In addition, the information of the corresponding camera 130, the name of the task item, and the running time period can also be displayed in the task list, so that the user can check the information. It should be understood that when there is an error message in the information, the user can click the error message to modify it.

The method for creating a video processing task item provided by the embodiment of the present application allows a user to create a video processing task item on the user interface of the electronic device 110, thereby enabling the user to intuitively learn any information about the video processing task item.

Fig. 3 is a schematic flowchart of a method for creating a video processing task item provided by another exemplary embodiment of the present application.

In an embodiment of the present application, steps 205, 210, and 215 may be performed multiple times, so that multiple video processing task items are created on the user interface. After multiple video processing task items are created on the user interface, as shown in FIG. 3, the method may further include the following steps:

Step 220: Execute multiple video processing task items.

Specifically, step 220 is to process multiple input video streams corresponding to the multiple video processing task items. When a multiplexed input video stream exists in the multiple video processing task items, the multiplexed input video stream is processed only once.

In addition, step 220 may be automatically performed in a polling manner. For example, when there is a newly created video processing task item in the task list of the user interface, due to the existence of the polling mechanism, the newly created video processing task item will be automatically executed in step 220. For example, the time interval between two adjacent queries may be 10 seconds.

Furthermore, for the specific implementation of step 220, reference may be made to the following embodiment of the method for scheduling an input video stream. In order to avoid repetition, details are not repeated here.

Here, from the user’s perspective, the electronic device 110 processes the multiple input video streams corresponding to the multiple video processing task items by executing multiple video processing task items. The method is intuitive and concise, thereby avoiding the need for the user to first Inform multiple video processing task items to multiple persons with professional knowledge to learn the multiple input video streams corresponding to the multiple video processing task items, and then add the learned multiple input video streams to the prior art video processing system In the process, the processing efficiency is accelerated and the user operation is easy.

Furthermore, the execution process of step 220 may be hidden from the user, thereby further increasing the user-friendliness of the user experience.

Step 225: Determine the execution status of each video processing task item.

Specifically, step 225 may also be interspersed in the execution process of step 220 in a polling manner, and the execution status may include at least the video processing task item is running, the video processing task item has finished running, or the video processing task item is waiting to be executed.

For example, when there is a video stream waiting to be processed in the input video stream corresponding to a video processing task item, the execution state of the video processing task item can be determined as the video processing task item waiting to be run. When the running end time point of a video processing task item is equal to the current time point, the execution status of the video processing task item can be updated from the video processing task item being running to the video processing task item running end. For the remaining cases, the execution status can be determined as the video processing task item is running.

Step 230: Display the execution status of each video processing task item on the user interface.

Specifically, the task list of the user interface may include an execution status bar. After the execution status of a video processing task item is determined, the execution status of the video processing task item can be displayed in the execution status bar. It should be understood that when the execution status of a video processing task item is updated, due to the existence of the polling mechanism, the corresponding status in the execution status column can also be updated.

In the embodiment of the present application, the electronic device 110 processes the video processing task item and displays the execution status of the video processing task item on the user interface. From the perspective of the user, it is compared with the prior art video processing system. , The processing result is more intuitive, and the user-friendly experience is higher.

The method for creating a video processing task item according to an embodiment of the present application is described above, and the method for scheduling an input video stream according to an embodiment of the present application is described below with reference to FIGS. 4 to 6. Here, the scheduling method of the input video stream may be a specific implementation of step 220 in FIG. 3.

Fig. 4 is a schematic flowchart of a method for scheduling an input video stream provided by an exemplary embodiment of the present application. This embodiment can be executed on the electronic device 110 shown in FIG. 1. As shown in FIG. 4, the scheduling method of the input video stream may include the following steps. That is, step 220 in FIG. 3 may include the following steps:

Step 2200: Determine the type of the video stream in the multiple input video stream.

Specifically, for the current video processing system, computing resources are limited, which results in that the video processing system can only process a limited number of input video streams. However, when a user adds an input video stream to be processed to a video processing system in the prior art, since the user may not be able to consider the weight of each input video stream, some important input video streams are occupied due to the occupation of computing resources. Cannot be processed. Therefore, it becomes particularly important to determine the type of the video stream in the multiple input video stream.

Here, the multiple input video streams can be divided into two types, namely a first preset type of video stream and a second preset type of video stream, and the weight of the first preset type of video stream is greater than or equal to the second preset type. Set the weight of the type of video stream.

Step 2205: Add a video stream whose type belongs to the first preset type into the computing resource pool.

Since the weight of the video stream of the first preset type is greater than the weight of the video stream of the second preset type, the video stream of the first preset type will be preferentially added to the computing resource pool for processing, thereby avoiding important The input video stream cannot be processed due to the occupied computing resources.

Step 2210: Perform real-time recording of the video stream whose type belongs to the second preset type.

Specifically, since the video stream of the second preset type has a waiting state, during the waiting time period, in order to avoid missing the corresponding video content, the video stream of the second preset type can be recorded in real time. .

In an embodiment of the present application, after step 2210, the method may further include adding the recording content of the video stream of the second preset type to the computing resource pool after the video stream of the first preset type is taken from the computing resource pool. Resource pool.

Specifically, for the electronic device 110 whose computing resources are completely occupied, when an input video stream is taken out of the computing resource pool, the waiting input video stream can be added to the computing resource pool for processing, so as to make full use of Computing resources, processing more video processing tasks, and speeding up the processing rate of each video processing task. Correspondingly, the processing of the input video stream in the waiting state by the computing resource pool may first be the processing of the recorded content of the video stream.

In another embodiment of the present application, before adding the recorded content of the second preset type of video stream to the computing resource pool, the method may further include determining whether each video stream of the first preset type in the computing resource pool is The third preset condition is met, and when the video stream of the first preset type meets the third preset condition, the video stream of the first preset type is taken from the computing resource pool.

For example, for different video processing task items, the multiplexed input video streams may have different statistical time periods, and the statistical time periods may include statistical start time points and statistical end time points. Specifically, the third preset condition may be that the current time point is the same as the latest statistical end time point of a video stream of the first preset type in the computing resource pool. It should be understood that when the video stream of the first preset type is not multiplexed, the latest statistical end time point is the statistical end time point of the first preset type video stream.

In the embodiment of the present application, by determining the type of each input video stream, the input video stream with high weight can be processed in the computing resource pool first, thereby avoiding important input video streams due to the occupation of computing resources. Problems that cannot be handled.

Fig. 5 is a schematic flowchart of a method for scheduling an input video stream provided by another exemplary embodiment of the present application. Fig. 6 is a schematic flowchart of a method for scheduling an input video stream according to another exemplary embodiment of the present application.

In an embodiment of the present application, as shown in FIG. 5, on the basis of the embodiment described in FIG. 4, step 2200 may include the following steps:

Step 22000: Count the number of task items that multiplex multiple video processing task items for each input video stream.

Specifically, the weight of the input video stream may be determined by the number of task items multiplexing multiple video processing task items. The order of statistics can follow the order in which the video processing task items are created in the task list.

For example, as shown in FIG. 6, step 22000 in FIG. 5 can be specifically implemented through the following steps:

Step 220000: sequentially determine whether the input video stream corresponding to each of the multiple video processing task items has been added to the video stream set. Here, the judgment order of the multiple video processing task items may follow the creation order of the multiple video processing task items. The order of judging the multiple input video streams corresponding to a video processing task item may follow the order of selection of the corresponding camera 130.

Step 220002: If an input video stream corresponding to a video processing task item is not added to the video stream set, add the input video stream to the video stream set, and add the number of task items in the video stream set to the preset number. For example, the preset number can be 1.

Step 220004: If one input video stream corresponding to a video processing task item has been added to the video stream set, then the number of task items in the video stream set is added to the preset number.

Step 22002: Arrange the multiple input video streams according to the number of task items from high to low to form a scheduling queue.

Specifically, by comparing the number of task items of one input video stream with the number of task items of other input video streams, the input video stream with the largest number of task items can be selected and put into the queue, and so on to form the aforementioned scheduling queue. Here, the input video stream is added from the end of the queue.

In an embodiment of the present application, there may be a situation where the number of task items corresponding to at least two input video streams is equal. In this case, step 22002 may include arranging the input video streams with the same number of task items in order of counting the number of task items, so as to realize the arrangement of the input video streams with the same number of task items.

Step 22004: According to the order of the scheduling queue, it is determined whether each input video stream meets the first preset condition or the second preset condition.

Specifically, it is sequentially determined from the head to the end of the dispatch queue whether each input video stream meets the first preset condition or the second preset condition.

It should be understood that when the input video stream is not multiplexed by multiple video processing task items, the earliest statistical start time point of the input video stream is the statistical start time point.

In an embodiment of the present application, step 2205 in FIG. 4 may specifically include determining the input video stream as a video stream of the first preset type when the input video stream meets the first preset condition, and the input The video stream is added to the computing resource pool.

In another embodiment of the present application, step 2210 in FIG. 4 may specifically include when the input video stream meets the second preset condition, determining the input video stream as a video stream of the second preset type, and Input video stream for real-time recording.

For example, the first preset condition may mean that the current time point is the same as the earliest statistical start time point of the input video stream being judged, and the number of input video streams in the computing resource pool is less than the preset number. The second preset condition may mean that the current time point is the same as the earliest statistical start time point of the input video stream being judged, and the number of input video streams in the computing resource pool is equal to the preset number.

The following describes the embodiments of the present application in more detail with reference to specific examples.

Fig. 7 is a schematic diagram of the overall process provided by an exemplary embodiment of the present application. Fig. 8a is a schematic diagram of a video processing task item provided by an exemplary embodiment of the present application. Fig. 8b is a schematic diagram of processing logic provided by an exemplary embodiment of the present application. Fig. 8c is a schematic diagram of the time dimension of an input video stream provided by an exemplary embodiment of the present application.

Step 710: When an event for creating a video processing task item is detected on the user interface, determine the camera information related to the video processing task item.

Specifically, when creating a video processing task item, it is necessary to select camera information related to the video processing task item from multiple camera information.

Step 715: Determine the task item name and running time period of the video processing task item.

Here, the task item name can be entered by the user or selected by the user. Similarly, the operating time period is the same.

Step 720: Create a video processing task item on the user interface based on the camera information, task item name, and running time period.

For example, as shown in FIG. 8a, the created video processing task items may be a video processing task item 311, a video processing task item 312, and a video processing task item 313, respectively. These video processing task items are related to five cameras, which are marked as Camera1, Camera2, Camera3, Camera4, and Camera5, and the obtained input video streams can be marked as input video stream 301, input video stream 302, input video stream 303, input Video stream 304 and input video stream 305. Specifically, the video processing task item 311 is related to the input video stream 301, the input video stream 302, the input video stream 303, and the input video stream 304, and the running time period of the video processing task item 311 is 8:00-19:00. The video processing task item 312 is related to the input video stream 301 and the input video stream 304, and the running time period of the video processing task item 312 is 8:00-20:00. The video processing task item 313 is related to the input video stream 301, the input video stream 302, the input video stream 304, and the input video stream 305, and the running time period of the video processing task item 313 is 10:00-18:00.

As shown in FIG. 8b, the processing of the three video processing task items by the electronic device 110 can be divided into three levels, namely a task layer, a video stream layer, and a computing layer. The task layer can complete the creation of the video processing task item 311, the video processing task item 312, and the video processing task item 313 successively.

Step 725: Count the number of task items in which each input video stream in the multiple input video streams corresponding to the multiple video processing task items multiplex the multiple video processing task items.

As shown in Figure 8b, the video stream layer can complete the weight determination of each input video stream, so that the input video stream with high weight can be dispatched to the computing resource pool 330 first for processing, thereby avoiding important input video streams due to computing Resources are occupied and cannot be processed. Here, the weight of each input video stream can be measured by multiplexing the number of task items of multiple video processing task items. For example, as shown in FIG. 8a, the input video stream 301 and the input video stream 304 are all multiplexed by three task items: the video processing task item 311, the video processing task item 312, and the video processing task item 313, and the input video stream 302 is video processed The task item 311 and the video processing task item 313 are multiplexed with two task items, and the input video stream 303 and the input video stream 305 are both used by only one task item.

Here, the specific implementation of step 725 can refer to FIG. 6. In step 725, the multiple input video streams are removed from multiple video processing tasks, and the removed input video streams are placed in the video stream set, and the video stream set can be as shown in the video stream layer in Figure 8b .

Step 730: Arrange the multiple input video streams according to the number of task items mentioned above from high to low to form a scheduling queue. Here, input video streams with the same number of task items can be arranged in order of the number of statistical task items.

For example, as shown in Figure 8a, since the number of task items for input video stream 301, input video stream 302, input video stream 303, input video stream 304, and input video stream 305 are 3, 2, 1, and 3, respectively Therefore, the order of the multiple input video streams in the dispatch queue may be input video stream 301, input video stream 304, input video stream 302, input video stream 303, and input video stream 305.

As shown in the task layer of Fig. 8b, since the video processing task item 311 is related to the input video stream 303 but not related to the input video stream 305, the video processing task item 313 is related to the input video stream 305 but not related to the input video stream 303, Moreover, the creation of the video processing task item 311 is before the creation of the video processing task item 313. Therefore, compared with the input video stream 305, the input video stream 303 is first added to the video stream set 320, and the number of task items is counted first, so that The input video stream 303 may be arranged in front of the input video stream 305 in the scheduling queue.

Step 735: Determine whether the current time point is equal to the earliest statistical start time point of one input video stream in the scheduling queue. Here, step 735 may be performed by polling, and the time interval between two adjacent queries may be preset according to actual conditions.

As shown in Figure 8b, the computing layer can complete the scheduling and processing of multiple input video streams. Here, the scheduling of multiple input video streams may refer to adding multiple input video streams in the scheduling queue to the computing resource pool 330 or the waiting queue 331 sequentially.

Specifically, from the head to the end of the scheduling queue, it is sequentially determined whether the current time point is the same as the earliest statistical start time point of the input video stream in the scheduling queue. For example, as shown in FIG. 8a, a video processing task item 311, a video processing task item 312, and a video processing task item 313 multiplex the input video stream 301. For the video processing task item 311, the statistical time period of the input video stream 301 is 8:00-19:00. For the video processing task item 312, the statistical time period of the input video stream 301 is 8:00-20:00. For the video processing task item 313, the statistical time period of the input video stream 301 is 10:00-18:00. Therefore, as shown in Figure 8c, in a day, the earliest statistical start time of the input video stream 301 is 8:00, and the latest statistical end time of the input video stream 301 is 20:00, that is, the input video stream 301 The actual statistical time period is 8:00-20:00. Similarly, the actual statistical time period of each of the input video stream 302, the input video stream 303, the input video stream 304, and the input video stream 305 is the same.

It should be understood that when there is no multiplexing of the input video stream, the earliest statistical start time point of the input video stream is the statistical start time point of the input video stream.

Specifically, when the judgment result of step 735 is yes, step 740 is executed. When the judgment result of step 735 is no, continue to execute step 735 to judge whether the current time point is equal to the earliest statistical start time point of the next input video stream in the scheduling queue.

Step 740: Determine whether the number of input video streams in the computing resource pool is less than a preset number or equal to a preset number.

Specifically, when the judgment result of step 740 is less than the preset number, step 745 is executed. When the judgment result of step 740 is equal to the preset number, step 750 is executed. Here, the preset number may be the maximum number of input video streams that the computing resource pool can process simultaneously.

Step 745: Add the input video stream to the computing resource pool.

For example, as shown in Figure 8c, at 8:00, the four input video streams of input video stream 301, input video stream 304, input video stream 302, and input video stream 303 reach the start time point of statistics and are added to the computing resource pool 330 In the operation. At 10:00, the input video stream 305 has also reached the start time point of statistics, but the computing resources are insufficient at this time, the input video stream 305 is added to the waiting queue 331, and the content is recorded in real time to be processed. At 19:00, since the running time period of the video processing task item 311 and the video processing task item 313 has ended, the input video stream 302 and the input video stream 303 are taken from the computing resource pool 330, and the remaining computing The resource will be used to process the recorded content of the input video stream 305. At 20:00, since the running time period of the video processing task item 312 has ended, the input video stream 301 and the input video stream 304 are taken out of the computing resource pool 330. At 8:00 in the morning of the next day, the video processing task item 311, the video processing task item 312, and the video processing task item 313 can start to be executed again.

Specifically, after step 745 is performed, step 735 is continued to determine whether the current time point is equal to the earliest statistical start time point of the next input video stream in the scheduling queue.

In step 750, the input video stream is added to the waiting queue, and the input video stream is recorded in real time.

Specifically, the input video stream in the computing resource pool may refer to the video stream of the first preset type mentioned in the previous embodiment, and the input video stream in the waiting queue may refer to the second preset type mentioned in the previous embodiment. Video stream.

Furthermore, the input video stream can be inserted from the head of the waiting queue, so that the order of the input video streams in the waiting queue is consistent with the order of the input video streams in the scheduling queue. Here, the arrangement order refers to the arrangement according to the number of task items from high to low.

For example, as shown in the computing layer in FIG. 8b, the computing resource pool 330 can only carry simultaneous computing of four input video streams. Therefore, the input video streams corresponding to Camera1, Camera4, Camera2, Camera3 are preferentially added to the computing resource pool 330 for computing. The input video stream corresponding to Camera5 is added to the waiting queue 331 due to insufficient computing resources.

Step 755: Determine whether the current time point is the same as the latest statistical end time point of one input video stream in the computing resource pool.

Specifically, when the judgment result of step 755 is yes, step 760 is executed. When the determination result of step 755 is no, continue to perform step 755 to determine whether the current time point is the same as the latest statistical end time point of the next input video stream in the computing resource pool.

Step 760: Take the input video stream from the computing resource pool, and add the recording content corresponding to the input video stream at the head of the queue in the waiting queue to the computing resource pool. Correspondingly, the input video stream at the head of the queue will also be taken out of the waiting queue.

Specifically, when the input video stream corresponding to a video processing task item has been taken out from the computing resource pool, the formatting processing result generated after the corresponding input video stream is calculated will be counted again, and the video processing task will be generated based on the calculation. The statistical results of the items for direct use by users.

Step 765: Determine the execution status of each of the multiple video processing task items.

Here, step 765 can be polled for execution, and when an input video stream is added to the computing resource pool, step 765 can start to be executed, and the determined sequence can be based on the creation sequence of the multiple video processing task items.

In addition, the execution status may include at least the video processing task item is running, the video processing task item has finished running, or the video processing task item is waiting to be executed.

Specifically, when at least one input video stream corresponding to a video processing task item is in the waiting queue, the execution state of the video processing task item is that the video processing task item is waiting to run. When the running end time point of a video processing task item is equal to the current time point, the execution status of the video processing task item is updated from the video processing task item running to the video processing task item running end. For the remaining cases, the execution status is that the video processing task item is running.

Step 770: Display the execution status of each video processing task item on the user interface.

Exemplary device

Fig. 9 is a schematic structural diagram of an apparatus for creating a video processing task item provided by an exemplary embodiment of the present application.

As shown in FIG. 9, the device for creating a video processing task item may include a first determining module 140 for determining a camera related to the video processing task item when an event for creating a video processing task item is detected on the user interface. 130 information, and determine the task item name of the video processing task item and the running time period of the video processing task item; the creation module 141 is used to based on the information of the camera 130, the task item name and the running time period related to the video processing task item , Create a video processing task item on the user interface.

The apparatus for creating a video processing task item provided by the embodiment of the present application allows a user to create a video processing task item on the user interface of the electronic device 110, thereby enabling the user to intuitively learn any information about the video processing task item.

Fig. 10 is a schematic structural diagram of an apparatus for creating a video processing task item provided by another exemplary embodiment of the present application.

In an embodiment of the present application, multiple video processing task items are created on the user interface. As shown in FIG. 10, the device may further include an execution module 142 for executing multiple video processing task items and determining each The execution status of the video processing task item; the display module 143 is used to display the execution status of each video processing task item on the user interface. Here, the execution status may include at least the video processing task item is running, the video processing task item has finished running, or the video processing task item is waiting to be executed.

In an embodiment of the present application, one camera 130 acquires one input video stream, and one video processing task item corresponds to at least one input video stream. The execution module 142 determines the type of the video stream in the multiple input video streams, and classifies the type as the first A video stream of a preset type is added to the computing resource pool, and the video stream of the second preset type is recorded in real time.

In an embodiment of the present application, after the execution module 142 performs real-time recording of the video stream of the second preset type, after the video stream of the first preset type is taken from the computing resource pool, the second The recording content of the preset type of video stream is added to the computing resource pool.

In an embodiment of the present application, the execution module 142 counts the number of task items in which each input video stream multiplexes multiple video processing task items, and arranges the multiple input video streams according to the number of task items from high to low to form a schedule. Queues, and sequentially determine whether each input video stream meets the first preset condition or the second preset condition according to the order of the scheduling queue.

In an embodiment of the present application, when the input video stream meets the first preset condition, the execution module 142 determines the input video stream as a video stream of the first preset type, and adds the input video stream to the computing resource pool .

In an embodiment of the present application, when the input video stream meets the second preset condition, the execution module 142 determines the input video stream as a video stream of the second preset type, and records the input video stream in real time.

In an embodiment of the present application, the execution module 142 arranges input video streams with the same number of task items in order of counting the number of task items.

In an embodiment of the present application, the execution module 142 sequentially determines whether the input video stream corresponding to each of the multiple video processing task items has been added to the video stream set, if one input video stream corresponding to one video processing task item has not been added to the video stream set , The input video stream is added to the video stream set, and the number of task items in the video stream set is added to the preset number, and if an input video stream corresponding to a video processing task item has been added to the video stream set, the video The number of task items in the stream set plus the preset number.

In an embodiment of the present application, the execution module 142 also determines whether each video stream of the first preset type in the computing resource pool conforms to the first preset type of video stream before adding the recording content of the second preset type of video stream to the computing resource pool. Three preset conditions, and when the video stream of the first preset type meets the third preset condition, the video stream of the first preset type is taken from the computing resource pool.

In the embodiment of the device for creating a video processing task item, the operations and functions of the first determining module 140, the creating module 141, the execution module 142, and the display module 143 can refer to the embodiment of the method for creating a video processing task item, in order to avoid repetition. , I won’t repeat it here.

Fig. 11 is a schematic structural diagram of a device for scheduling an input video stream provided by an exemplary embodiment of the present application. This embodiment may be a component of the electronic device 110 shown in FIG. 1 above.

In the video system where the device for scheduling input video streams is located, one video processing task item is related to the information of at least one camera 130, one camera 130 obtains one input video stream, and multiple video processing task items correspond to multiple input video streams. As shown in FIG. 11, the scheduling device may include a second determining module 150, configured to determine the type of video stream in the multiple input video streams; scheduling module 151, configured to add video streams of the first preset type A computing resource pool; and a recording module 152 for real-time recording of the video stream of the second preset type.

In the embodiment of the present application, by determining the type of each input video stream, the input video stream with high weight can be processed in the computing resource pool first, thereby avoiding important input video streams due to the occupation of computing resources. Problems that cannot be handled.

In an embodiment of the present application, after the scheduling module 151 performs real-time recording of the video stream of the second preset type, after the video stream of the first preset type is taken from the computing resource pool, the second The recording content of the preset type of video stream is added to the computing resource pool.

In an embodiment of the present application, the second determining module 150 counts the number of task items in which each input video stream multiplexes multiple video processing task items, and arranges the multiple input video streams in descending order of the number of task items. A dispatch queue is formed, and according to the sequence of the dispatch queue, it is determined whether each input video stream meets the first preset condition or the second preset condition.

In an embodiment of the present application, when the input video stream meets the first preset condition, the scheduling module 151 determines the input video stream as a video stream of the first preset type, and adds the input video stream to the computing resource pool .

In an embodiment of the present application, when the input video stream meets the second preset condition, the recording module 152 determines the input video stream as a video stream of the second preset type, and records the input video stream in real time.

In an embodiment of the present application, the second determining module 150 arranges the input video streams with the same number of task items in order of counting the number of task items.

In an embodiment of the present application, the second determining module 150 sequentially determines whether the input video stream corresponding to each of the multiple video processing task items has been added to the video stream set, if one input video stream corresponding to one video processing task item has not been added to the video stream Stream set, add the input video stream to the video stream set, add the number of task items in the video stream set to the preset number, and if one input video stream corresponding to a video processing task item has been added to the video stream set, add The number of task items in the video stream set plus the preset number.

In an embodiment of the present application, the scheduling module 151 also determines whether each video stream of the first preset type in the computing resource pool conforms to the first preset type of video stream before adding the recording content of the second preset type of video stream to the computing resource pool. Three preset conditions, and when the video stream of the first preset type meets the third preset condition, the video stream of the first preset type is taken from the computing resource pool.

In the embodiment of the input video stream scheduling apparatus, the operations and functions of the second determining module 150, the scheduling module 151, and the recording module 152 can refer to the embodiment of the input video stream scheduling method. In order to avoid repetition, it will not be repeated here. .

Exemplary electronic equipment

Hereinafter, an electronic device according to an embodiment of the present application will be described with reference to FIG. 12. Fig. 12 is a block diagram of an electronic device provided by an exemplary embodiment of the present application.

As shown in FIG. 12, the electronic device 160 includes one or more processors 161 and a memory 162.

The processor 161 may be a central processing unit (CPU) or another form of processing unit having data processing capability and/or instruction execution capability, and may control other components in the electronic device 160 to perform desired functions.

The memory 162 may include one or more computer program products, and the computer program products may include various forms of computer-readable storage media, such as volatile memory and/or nonvolatile memory. The volatile memory may include random access memory (RAM) and/or cache memory (cache), for example. The non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 161 may run the program instructions to implement the method for creating video processing task items in the various embodiments of the present application described above. And/or other desired functions, or implement the input video stream scheduling method of the various embodiments of the present application described above and/or other desired functions. Various contents such as input signals, signal components, noise components, etc. can also be stored in the computer-readable storage medium.

In an example, the electronic device 160 may further include: an input device 163 and an output device 164, and these components are interconnected by a bus system and/or other forms of connection mechanisms (not shown).

For example, the input device 163 may be a communication network connector, and may also include a keyboard, a mouse, and so on.

The output device 164 can output various information to the outside, and can include, for example, a display, a speaker, a printer, and a communication network and a remote output device connected thereto.

Of course, for simplicity, only some of the components related to the present application in the electronic device 160 are shown in FIG. 12, and components such as buses, input/output interfaces, etc. are omitted. In addition, the electronic device 160 may also include any other appropriate components according to specific application conditions.

Exemplary computer program product and computer readable storage medium

In addition to the above methods and devices, the embodiments of the present application may also be computer program products, which include computer program instructions, which when run by a processor cause the processor to execute the “exemplary method” described above in this specification The steps in the method for creating video processing task items according to various embodiments of the present application described in the section, or the steps in the method for scheduling input video streams.

The computer program product can be used to write program codes for performing the operations of the embodiments of the present application in any combination of one or more programming languages, the programming languages include object-oriented programming languages, such as Java, C++, etc. , Also includes conventional procedural programming languages, such as "C" language or similar programming languages. The program code can be executed entirely on the user's computing device, partly on the user's device, executed as an independent software package, partly on the user's computing device and partly executed on the remote computing device, or entirely on the remote computing device or server Executed on.

In addition, the embodiments of the present application may also be a computer-readable storage medium, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the processor executes the "exemplary method" part of this specification. The steps in the method for creating video processing task items according to various embodiments of the present application described in, or the steps in the method for scheduling input video streams.

The computer-readable storage medium may adopt any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may include, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the above, for example. More specific examples (non-exhaustive list) of readable storage media include: electrical connections with one or more wires, portable disks, hard disks, random access memory (RAM), read only memory (ROM), erasable Type programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.

The above describes the basic principles of this application in conjunction with specific embodiments. However, it should be pointed out that the advantages, advantages, effects, etc. mentioned in this application are only examples and not limitations. These advantages, advantages, effects, etc. cannot be considered as Required for each embodiment of this application. In addition, the specific details disclosed above are only for illustrative purposes and easy-to-understand functions, rather than limitations, and the above details do not limit the application to the implementation of the above specific details.

The block diagrams of the devices, devices, equipment, and systems involved in this application are merely illustrative examples and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagrams. As those skilled in the art will recognize, these devices, devices, equipment, and systems can be connected, arranged, and configured in any manner. Words such as "include", "include", "have", etc. are open vocabulary and mean "including but not limited to" and can be used interchangeably. The terms "or" and "and" as used herein refer to the terms "and/or" and can be used interchangeably, unless the context clearly indicates otherwise. The term "such as" used herein refers to the phrase "such as but not limited to" and can be used interchangeably.

It should also be pointed out that in the device, equipment and method of the present application, each component or each step can be decomposed and/or recombined. These decompositions and/or recombinations shall be regarded as equivalent solutions of this application.

The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use this application. Various modifications to these aspects are very obvious to those skilled in the art, and the general principles defined herein can be applied to other aspects without departing from the scope of this application. Therefore, the present application is not intended to be limited to the aspects shown here, but in accordance with the widest scope consistent with the principles and novel features disclosed herein.

The above description has been given for the purposes of illustration and description. In addition, this description is not intended to limit the embodiments of the present application to the form disclosed herein. Although a number of example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions, and subcombinations thereof.

Claims (22)

1. A method for creating video processing task items, including:

   When an event for creating a video processing task item is detected on the user interface, determine the camera information related to the video processing task item;

   Determining the task item name of the video processing task item and the running time period of the video processing task item; and

   Create the video processing task item on the user interface based on the information of the camera related to the video processing task item, the name of the task item, and the running time period.
2. The method according to claim 1, wherein a plurality of the video processing task items are created on the user interface, and the method further comprises:

   Executing the multiple video processing task items;

   Determining the execution status of each of the video processing task items; and

   The execution status of each video processing task item is displayed on the user interface, where the execution status includes at least: the video processing task item is running, the video processing task item has finished running, or the video processing task item is waiting to be executed.
3. The method according to claim 2, wherein one said camera acquires one input video stream, one said video processing task item corresponds to at least one said input video stream, and said executing said multiple video processing task items include:

   Determining the types of video streams in the multiple input video streams;

   Adding the video stream of the first preset type to the computing resource pool; and

   Real-time recording of the video stream of the second preset type.
4. The method according to claim 3, wherein, after the real-time recording of the video stream of the second preset type, the method further comprises:

   After the video stream of the first preset type is taken from the computing resource pool, the recording content of the video stream of the second preset type is added to the computing resource pool.
5. The method according to claim 3, wherein the determining the type of the video stream in the multiple input video streams comprises:

   Counting the number of task items in which each input video stream multiplexes the multiple video processing task items;

   Arranging the multiple input video streams according to the number of the task items from high to low to form a scheduling queue; and

   It is determined in sequence according to the arrangement sequence of the scheduling queue whether each input video stream meets the first preset condition or the second preset condition.
6. The method according to claim 5, wherein the adding the video stream of the first preset type to the computing resource pool comprises:

   When the input video stream meets the first preset condition, determine the input video stream as a video stream of the first preset type, and add the input video stream to the computing resource pool .
7. The method according to claim 5, wherein the real-time recording of the video stream of the second preset type comprises:

   When the input video stream meets the second preset condition, the input video stream is determined as the second preset type of video stream, and the input video stream is recorded in real time.
8. The method according to claim 5, wherein the arranging the multiple channels of the input video streams according to the number of the task items from high to low comprises:

   Arrange the input video streams with the same number of task items in order of counting the number of task items.
9. The method according to claim 5, wherein said counting the number of task items in which each input video stream multiplexes said multiple video processing task items comprises:

   Sequentially determining whether the input video stream corresponding to each of the multiple video processing task items has been added to a video stream set;

   If one input video stream corresponding to one video processing task item is not added to the video stream set, add the input video stream to the video stream set, and add the The number of tasks plus the preset number; and

   If one input video stream corresponding to one video processing task item has been added to the video stream set, then the number of task items in the video stream set is added to the preset number.
10. The method according to claim 4, wherein before the adding the recording content of the second preset type of video stream to the computing resource pool, the method further comprises:

    Determine whether each video stream of the first preset type in the computing resource pool meets a third preset condition; and

    When the video stream of the first preset type meets the third preset condition, the video stream of the first preset type is taken from the computing resource pool.
11. A method for scheduling input video streams, wherein one video processing task item is related to information of at least one camera, one camera acquires one input video stream, and multiple video processing task items correspond to multiple inputs For video streams, the scheduling method includes:

    Determining the types of video streams in the multiple input video streams;

    Adding the video stream of the first preset type to the computing resource pool; and

    Real-time recording of the video stream of the second preset type.
12. The method according to claim 11, wherein after the real-time recording of the video stream of the second preset type, the method further comprises:

    After the video stream of the first preset type is taken from the computing resource pool, the recording content of the video stream of the second preset type is added to the computing resource pool.
13. The method according to claim 11, wherein said determining the type of the video stream in the multiple input video streams comprises:

    Counting the number of task items in which each input video stream multiplexes the multiple video processing task items;

    Arranging the multiple input video streams according to the number of the task items from high to low to form a scheduling queue; and

    It is determined in sequence according to the arrangement sequence of the scheduling queue whether each input video stream meets the first preset condition or the second preset condition.
14. The method according to claim 13, wherein the adding the video stream of the first preset type to the computing resource pool comprises:

    When the input video stream meets the first preset condition, determine the input video stream as a video stream of the first preset type, and add the input video stream to the computing resource pool .
15. The method according to claim 13, wherein the real-time recording of the video stream of the second preset type comprises:

    When the input video stream meets the second preset condition, the input video stream is determined as the second preset type of video stream, and the input video stream is recorded in real time.
16. The method according to claim 13, wherein the arranging the multiple channels of the input video streams according to the number of the task items from high to low comprises:

    Arrange the input video streams with the same number of task items in order of counting the number of task items.
17. The method according to claim 13, wherein said counting the number of task items in which each input video stream multiplexes said plurality of video processing task items comprises:

    Sequentially determining whether the input video stream corresponding to each of the multiple video processing task items has been added to a video stream set;

    If one input video stream corresponding to one video processing task item is not added to the video stream set, add the input video stream to the video stream set, and add the The number of tasks plus the preset number; and

    If one input video stream corresponding to one video processing task item has been added to the video stream set, then the number of task items in the video stream set is added to the preset number.
18. The method according to claim 12, wherein, before said adding the recording content of the second preset type of video stream to the computing resource pool, the method further comprises:

    Determine whether each video stream of the first preset type in the computing resource pool meets a third preset condition; and

    When the video stream of the first preset type meets the third preset condition, the video stream of the first preset type is taken from the computing resource pool.
19. A device for creating video processing task items includes:

    The first determining module is used for determining the camera information related to the video processing task item when an event for creating a video processing task item is detected on the user interface; and determining the task item name of the video processing task item And the running time period of the video processing task item;

    The creation module is configured to create the video processing task item on the user interface based on the camera information related to the video processing task item, the name of the task item, and the running time period.
20. A scheduling device for an input video stream, wherein one video processing task item is related to information of at least one camera, one camera acquires one input video stream, and multiple video processing task items correspond to multiple inputs For a video stream, the scheduling device includes:

    The second determining module is configured to determine the type of the video stream in the multiple input video streams;

    A scheduling module, configured to add the video stream of the first preset type to the computing resource pool; and

    The recording module is used for real-time recording of the video stream of the second preset type.
21. An electronic device including:

    Processor; and

    A memory in which computer program instructions are stored, and when the computer program instructions are executed by the processor, the processor executes the method according to any one of claims 1 to 10; or, the Computer program instructions, when executed by the processor, cause the processor to perform the method according to any one of claims 11 to 18.
22. A computer-readable storage medium having computer program instructions stored on the computer-readable storage medium, and when the computer program instructions are executed by a processor, the processor executes any one of claims 1 to 10 The method; or, when the computer program instructions are executed by a processor, the processor executes the method according to any one of claims 11 to 18.

Images