JP2021072630A - Video playback method, terminal, and system - Google Patents

Abstract

To provide a video playback method, apparatus, and system.SOLUTION: The present invention includes: dividing an original playback image into at least two regions of interest; determining, among the at least two regions of interest, a first region of interest where a triggering event occurs; obtaining decoded data of a first video image displayed in the first region of interest; and rendering the decoded data of the first video image to a specified playback window for playing. Using the video playback method, apparatus, and system according to embodiments of the present invention, an original playback image is divided into multiple regions of interest, and an image in a region of interest where a triggering event occurs is displayed separately. Therefore, in one aspect, a user is capable of observing clearer images in the region of interest, and in another aspect, the user is capable of tracking images in the multiple regions of interest at the same time, thereby significantly improving user experience.SELECTED DRAWING: Figure 2

Description

The present invention relates to the field of video surveillance, particularly to video playback methods, terminals, and systems in the field of video surveillance.

High-definition video has now become an important technological trend in the field of video surveillance. And cameras with 720p or 1080p resolutions are becoming more and more widely used in the field of video surveillance. With the constant increase in camera resolution, the range that a single camera can monitor has become wider and the details of the image have become clearer. At the same time, intelligent analysis technology for video images is gradually being put into practice. The technological development of hardware devices has made it possible for hardware performance to meet the demand for performing intelligent analysis on multiple areas of interest within the same image. This saves a lot of money compared to manual monitoring.

Current video surveillance clients generally play video images from multiple cameras at the same time. However, due to the increased resolution of video images, the total resolution of video images from multiple cameras often exceeds the resolution range of the client monitor. Taking a 22-inch display as an example, this display generally supports a maximum resolution of 1920 x 1080. That is, the display can only reproduce 1080p images from a single feed. If multiple feeds of 1080p images are played back on this monitor at the same time, the images must be zoomed out. In addition to the playback window, there are also multiple auxiliary function panels on the interface of a typical video surveillance client, such as the title bar, camera list, and pan-tilt-zoom control panel, which also include video images. Reduce the display area of. Therefore, the image that can be reproduced in the playback window is much smaller than the original image.

Especially when an event (eg, an event triggered by intelligent analysis) occurs in a video image, the area of the image where the event occurs is even smaller. This is because the image is downsized during playback, which is inconvenient for the user to see.
When the observer monitors the image with the naked eye, it is difficult for the observer to notice the change in detail, and as a result, important information is missed.

Most clients now offer the ability to zoom in on a selected area of an image. That is, the area of the video reproduction image is selected by sliding the mouse, and the selected area is zoomed in. This improves the image quality of the target area to some extent. However, the digital zoom of the video image causes some loss of pixel information, which affects the image quality and also the effect of the user's observation of the details of the image. In addition, when the zoom function is used within the selected area, in one aspect requires manual operation by the user, and when an event suddenly occurs, the user does not have time to perform any operation, therefore. Miss the event. In another aspect, if the event occurs within another area of the image, it is not possible to zoom in on several areas at the same time. Therefore, the user experience is relatively inferior.

Embodiments of the present invention provide video playback methods, terminals, and systems, which can improve the user experience.

In a first aspect, an embodiment of the present invention provides a video reproduction method, the method of dividing the original reproduced image into at least two target areas and triggering within at least two target areas. The step of determining the first target area where the event occurs, the step of acquiring the decoded data of the first video image displayed in the first target area, and the decoding data of the first video image are It has a step to draw in a designated playback window for playback.

In the first possible embodiment of the first aspect, the method further comprises a step of determining the correspondence between each target area of at least two target areas and the designated playback window. The step of drawing the decrypted data of the first video image in the designated playback window for playback is to draw the decrypted data of the first video image into the first target for playback according to the correspondence. It has a step to draw in the specified playback window corresponding to the area.

In connection with the first possible implementation of the first aspect or the first possible implementation of the first aspect, in the second possible implementation of the first aspect, a trigger event occurs in at least two target areas. The step of determining the first target area has a step of determining the trigger operation executed by the user on the target area in the original reproduced image, and the trigger operation is a click operation or a double-click operation. , Or an operation of selecting a target area, and further having a step of determining the target area in which the trigger operation is executed as the first target area.

In connection with the first possible implementation of the first aspect or the first possible implementation of the first aspect, in the third possible implementation of the first aspect, a trigger event occurs in at least two target areas. The first target area is determined by the step of acquiring the coordinate metadata of the trigger event occurrence point in the original reproduced image and the target area to which the trigger event occurrence point belongs according to the coordinate metadata. It has a step to determine as an area.

In relation to any one of the first to third possible implementations of the first aspect or the first aspect, in the fourth possible implementation of the first aspect, the first subject area The step of acquiring the decoded data of the first video image displayed inside is the step of acquiring the decoded data of the original reproduced image and the decoded data of the first video image according to the decoded data of the original reproduced image. It has a step to determine.

In the fifth possible embodiment of the first aspect, in connection with any one of the first to fourth possible embodiments of the first aspect or the first aspect, of the first video image. The step of drawing the decoded data in the designated playback window for playback comprises the step of drawing the decrypted data of the first video image in the designated playback window for playback in a zoomed-in manner. The specified playback window is larger than the first target area.

In the sixth possible embodiment of the first aspect, in connection with any one of the first to fifth possible embodiments of the first aspect or the first aspect, of the first video image. The step of drawing the decoded data in the designated playback window for playback is the step of popping up an independent playback window and the step of drawing the decrypted data of the first video image in a separate playback window for playback. Has with steps.

In a second aspect, an embodiment of the present invention provides a video playback terminal, which is selected by a split module configured to split the original playback image into at least two target areas, and a split module. Among at least two target areas issued, a first decision module configured to determine the first target area in which the trigger event occurs, and a first target determined by the first decision module. An acquisition module configured to acquire the decrypted data of the first video image displayed in the area and the decrypted data of the first video image acquired by the acquisition module are designated for playback. It has a playback module configured to draw in the playback window.

In the first possible embodiment of the second aspect, the terminal is configured to determine the correspondence between each target area of at least two target areas and the designated playback window. A second determination module is further provided, and the reproduction module is a first for reproducing the decoded data of the first video image acquired by the acquisition module according to the correspondence determined by the second determination module. It is further configured to draw in the designated playback window corresponding to the target area of.

In the second possible embodiment of the second aspect, in connection with the first possible embodiment of the second aspect or the second aspect, the first determination module is in the original reproduced image. It has a first decision unit configured to determine the trigger action performed by the user on the target area, and the trigger action is a click action, a double click action, or an action of selecting the target area. In addition, it has a second determination unit configured to determine the target area on which the trigger operation determined by the first determination unit is executed as the first target area.

In the third possible embodiment of the second aspect, in connection with the first possible embodiment of the second aspect or the second aspect, the first determination module is in the original reproduced image. According to the first acquisition unit configured to acquire the coordinate metadata of the trigger event occurrence point and the coordinate metadata acquired by the first acquisition unit, the target area to which the trigger event occurrence point belongs is the first target. It has a third determination unit configured to determine as an area.

In connection with any one of the first to third possible implementations of the second aspect or the second aspect, in the fourth possible implementation of the second aspect, the acquisition module is the original. The decrypted data of the first video image is determined according to the second acquisition unit configured to acquire the decoded data of the reproduced image and the decoded data of the original reproduced image acquired by the second acquisition unit. It has a third decision unit configured in.

In connection with any one of the first to fourth possible embodiments of the second aspect or the second aspect, in the fifth possible embodiment of the second aspect, the regeneration module is the first. The decoded data of the video image of the above is further configured to be drawn in a designated playback window for playback in a zoomed-in manner, the designated playback window being larger than the first target area.

In connection with any one of the first to fifth possible implementations of the second aspect or the second aspect, in the sixth possible implementation of the second aspect, the regeneration module is independent. A display unit configured to display a playback window and a playback unit configured to draw the decoded data of the first video image in a separate playback window popped up by the display unit for playback. Have.

In a third aspect, an embodiment of the invention provides a video playback system, which captures a video image and encodes the video image with a terminal according to the second aspect of the invention. A video capture system configured to generate a media stream, a server configured to capture the media stream generated by the video capture system and supply this media stream to the terminal, and the server captured by the server. A storage device configured to store a media stream is provided, and the terminal is selected by a division module configured to divide the original reproduced image into at least two target areas, and a division module. Among at least two target areas, a first decision module configured to determine a first target area in which a trigger event occurs and a first target area determined by the first decision module. The acquisition module configured to acquire the decrypted data of the first video image displayed in, and the decrypted data of the first video image acquired by the acquisition module are placed in the designated playback window for playback. It has a playback module configured to draw.

Based on the above-mentioned technical solution, using the video playback method, terminal, and system according to the embodiment of the present invention, the original reproduced image is divided into a plurality of target areas, and the target area in which the trigger event occurs. The image inside is displayed separately. Thus, in one aspect, the user can observe clearer image details within the area of interest, and in another aspect, the user can track image details within multiple areas of interest at the same time. This can greatly improve the user experience.

In order to more clearly explain the technical solution in the embodiment of the present invention, the following briefly introduces the accompanying drawings necessary for explaining the embodiment of the present invention. Obviously, the accompanying drawings in the following description will only show some embodiments of the present invention, and one of ordinary skill in the art will derive further drawings from these attached drawings without creative effort. Can be done.

Provides video playback methods, terminals, and systems in the field of video surveillance.

It is a schematic block diagram of an exemplary application scenario according to one embodiment of the present invention. It is a schematic flow chart of the video reproduction method by one Embodiment of this invention. It is another schematic flow chart of the video reproduction method by one Embodiment of this invention. It is a schematic flow chart of the method of dividing the original reproduced image into a target area by one Embodiment of this invention. It is another schematic flow chart of the method of dividing the original reproduced image into a target area by one Embodiment of this invention. It is a schematic flow chart of the method of determining the target area in which a trigger event occurs according to one Embodiment of this invention. It is another schematic flow chart of the method of determining the target area where a trigger event occurs according to one Embodiment of this invention. It is a schematic flow chart of the method of acquiring the decoded data of the target area by one Embodiment of this invention. It is a schematic flow chart of the method of reproducing the image in a target area by one Embodiment of this invention. It is a schematic flow chart of the video reproduction method by another embodiment of this invention. It is another schematic flow chart of the video reproduction method by another embodiment of this invention. It is another schematic flow chart of the video reproduction method by another embodiment of this invention. It is the schematic of the reproduction of the target area by one Embodiment of this invention. It is the schematic of the reproduction of the target area by one Embodiment of this invention. It is a schematic block diagram of the terminal according to one Embodiment of this invention. It is another schematic block diagram of the terminal by one Embodiment of this invention. It is a 1st determination module schematic block diagram by one Embodiment of this invention. It is another schematic block diagram of the 1st determination module according to one Embodiment of this invention. It is a block diagram of acquisition module according to one Embodiment of this invention. It is a block diagram of the reproduction module according to one Embodiment of this invention. It is a system schematic block diagram by one Embodiment of this invention. It is a terminal schematic block diagram by another embodiment of this invention.

Hereinafter, the technical solutions in the embodiments of the present invention will be described clearly and completely in relation to the accompanying drawings in the embodiments of the present invention. Obviously, the embodiments described are only some, but not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort shall fall within the scope of protection of the present invention.

FIG. 1 is a schematic configuration diagram of an exemplary application scenario according to an embodiment of the present invention. As shown in FIG. 1, a video surveillance system to which an embodiment of the present invention is applicable includes a terminal having a video capture device, a central server, a storage device, and a client, and the video capture device captures a video image. It can be used for, and by encoding a video image, a media stream can be generated and the video image is transmitted over the network. For example, video capture devices may include devices such as network cameras, analog cameras, encoders, and digital video recorders (DVRs for short). After being connected to the central server, the terminal client can request the video stream, decrypt and display the video stream, and present the onsite video image to the user.

The central server may include a management server and a media server. The media server may be responsible for receiving the media stream, recording and storing the data in the media stream in a storage device, and transferring the media stream to the client for playback on demand. The management server can serve functions such as user login, authentication, and service scheduling. The central server is also accessed by multiple clients and can manage network connections between various video surveillance systems and the like. The storage device may be, for example, a disk array. A disk array can play a role in storing video data, and to store video data, network attached storage (NAS for short), storage area network (SAN for short), Alternatively, the server itself can be used.

It should be understood that the video surveillance system shown in FIG. 1 is merely an applicable embodiment of the method of the invention and is not intended to limit the object and function of the invention. .. The present invention should not be described as subject to the requirements for any one or any combination of the components of the video surveillance system shown in FIG. However, in order to elaborate on the present invention more clearly, embodiments of the present invention will be described below by taking an application scenario of a video surveillance system as an example. However, the present invention is not limited to this.

Technical solutions for video data transmission in embodiments of the present invention include various communication networks or communication systems, such as the Global System for Mobile Communications, "GSM® for short." "), Code Division Multiple Access (abbreviated as" CDMA ") system, Wideband Code Division Multiple Access (abbreviated as" WCDMA (registered trademark) ") system, general-purpose packet radio service ( general packet radio service, "GPRS" for short, Long Term Evolution ("LTE" for short) system, LTE frequency division duplex ("FDD" for short) system, LTE time Time division duplex ("TDD" for short) system, Universal Mobile Telecommunication System ("UMTS" for short), or Worldwide Interoperability for Microwave Access. It should be understood that for Microwave Access, abbreviated as "WiMAX") communication system can be used. The embodiments of the present invention are not limited thereto.

FIG. 2 is a schematic flowchart of a video reproduction method 100 according to an embodiment of the present invention.
This method 100 can be performed by a video player. This device is, for example, a terminal or a client. As shown in FIG. 2, the method 100 has the following steps.
S110: The original reproduced image is divided into at least two target areas.
S120: Among at least two target areas, the first target area in which the trigger event occurs is determined.
S130: Acquires the decoded data of the first video image displayed in the first target area.
S140: The decoded data of the first video image is drawn in the designated playback window for playback.

In order not to affect the quality of the playback video and to improve the effect of user observation on the details of the image, especially if multiple video images are displayed in the same window in a zoomed out way. The video playback device can first divide the original playback image into a plurality of target areas. Then, the decoded data of the video image displayed in the target area where the trigger event occurs is obtained. Therefore, the video playback device can draw the decoded data of the video image in an independent designated playback window for playback. In this way, the details of the image that the user is interested in can be displayed in a separate window. Then, the effect of user observation on the details of the image is improved.

Therefore, in the video reproduction method according to the embodiment of the present invention, the original reproduced image is divided into a plurality of target areas, and the images are separately displayed in the target area where the trigger event occurs. Thus, in one aspect, the user can observe clearer image details within the area of interest, and in another aspect, the user can track image details in multiple areas of interest at the same time. This greatly improves the user experience.

It should be understood that in embodiments of the present invention, video includes not only video files, but also real-time video streams. Although embodiments of the present invention have been described by taking playback of a real-time video stream as an example, embodiments of the present invention are not limited thereto.

In an embodiment of the invention, as an option, method 100 further comprises the following steps, as shown in FIG.
S150: Determines the correspondence between each target area in at least two target areas and the designated playback window.

The step of drawing the decoded data of the first video image in the designated playback window for playback has the following steps.
S141: A step of drawing the decoded data of the first video image in the designated playback window corresponding to the first target area for playback according to the correspondence relationship.

That is, each target area may be associated with one or more playback windows in order to reproduce the image in the target area when a trigger event occurs in the target area. The specified window may be the largest playback window on the display device and may be part of the largest playback window. The specified window may be a current existing playback window or part of an existing playback window, or may be a new pop-up playback window or a newly generated playback window. The embodiments of the present invention are not limited thereto.

The video reproduction method according to the embodiment of the present invention will be described in detail below with reference to FIGS. 4 to 12B.

In S110, optionally, the step of dividing the original reproduced image into at least two target areas has a step of dividing the original reproduced image into at least two target areas by the same division method or a free division method. ing.

Specifically, a single playback window can be pre-divided into multiple target areas on the client. The size of the target area may be the same or different, and the target area may be set as an irregular area. In addition, in the embodiment of the present invention, the correspondence between the target area and the playback window can be determined. The step of dividing the original reproduced image into the target area may be manually performed by the user or automatically configured by the client software, and this configuration is stored on the client.

The image can be divided by equal or free division methods. The specific configuration process is shown in FIGS. 4 and 5. For example, as shown in FIG. 4, a method of dividing an image into target areas by an equal division method has the following steps.
S111: Click the right-click menu or the toolbar button to display the configuration window.
S112: Set the number of target areas in the pop-up configuration window. For example, the number of target areas is set to 16.
S113: Right-click on the target area to set the playback window combined with the target area.
S114: When the trigger event occurs in the target area, the playback window is selected to play the video in the target area.

As shown in FIG. 5, a method of dividing an image into a target area by a free division method may have, for example, the following steps.
S115: Click the right-click menu or the toolbar button to pop up the configuration window.
S116: In the pop-up configuration window, drag the mouse to draw the target area. The size and shape of the target area may be the same or different.
S117: Right-click on the target area to set the playback window combined with the target area.
S118: When the trigger event occurs in the target area, the playback window is selected to play the video in the target area.

In the embodiment of the present invention, the original reproduced image divided into the target area may be the entire reproduced image in the maximum reproduction window on the display device, or a plurality of reproduced images simultaneously reproduced in the maximum reproduction window. It should be understood that it may be one or more of the images in.
The embodiments of the present invention are not limited thereto.

In S120, the video playback device determines the first target area in which the trigger event occurs in at least two target areas, and displays the image in the first target area in another playback window. This improves the display effect of image details.

In the embodiment of the present invention, the user can manually trigger an event to determine the target area, or detect an automatically generated trigger event to determine the target area. These will be described below with reference to FIGS. 6 and 7, respectively.

As shown in FIG. 6, optionally, among at least two target areas, the step of determining the first target area in which the trigger event occurs has the following steps.
S121: Determines the trigger action executed by the user on the target area in the original reproduced image.
The trigger action includes a click action, a double-click action, or an action of selecting a target area.
S122: A target area in which the trigger operation is executed as the first target area is determined.

Specifically, if the user detects the occurrence of an event when watching a video, the user can act on the client interface. For example, by performing a trigger action on the target area in the original playback image, the image in the target area where the event occurs is played in a pre-specified playback window or a separate popup. It is displayed in the playback window. When an event occurs within multiple areas of interest, the user can trigger multiple windows for display. The trigger operation is, for example, a click operation, a double-click operation, or an operation of selecting a target area. The embodiments of the present invention are not limited thereto.

FIG. 7 shows another schematic flowchart of a method of determining a target area in which a trigger event occurs according to an embodiment of the present invention. As shown in FIG. 7, as an option, the step of determining the first target area in which the trigger event occurs among at least two target areas has the following steps.
S123: Acquire the coordinate metadata of the trigger event occurrence point in the original reproduced image.
S124: The target area to which the trigger event occurrence point belongs is determined as the first target area according to the coordinate metadata.

Specifically, for example, the user can preconfigure an area that requires automatic event detection, and can configure event detection rules, such as motion detection or intelligent analysis detection. When an event occurs, the client software can determine the corresponding preconfigured target area according to the coordinate metadata of the trigger event occurrence point, so that the corresponding image is played in a pre-specified playback window. Or displayed in a separate pop-up playback window. When an event occurs in multiple target areas, the client software can launch multiple windows for display.

It is understood that within the irregular intelligent analysis area, the trigger event can cover a plurality of target areas, and at this time, the plurality of target areas can be determined as the first target area in which the trigger event occurs. It should be. Embodiments of the present invention are not limited to this.

In the embodiment of the present invention, the video playback device can determine whether or not the trigger event occurs in the target region by motion detection, intelligent analysis detection, and the like. The central server can also perform discovery to determine if a trigger event occurs within the area of interest. Then, when the trigger event is detected, the central server can feed back the coordinate metadata of the trigger event occurrence point to the video playback device, so that the video playback device generates the trigger event according to the coordinate metadata. The first target area can be determined. Embodiments of the present invention are not limited to this.

In S130, the video playback device obtains the decoded data of the first video image displayed in the first target area, so that the first video image is played back in the designated playback window.
In the embodiment of the present invention, as an option, as shown in FIG. 8, the step of acquiring the decoded data of the first video image displayed in the first target area has the following steps.
S131: Acquire the decoded data of the original reproduced image.
S132: The decoded data of the first video image is determined according to the decoded data of the original reproduced image.

Specifically, for example, the video player receives an event manually triggered by the user by clicking, double-clicking, clicking a toolbar button, or using a shortcut key. This device blocks the contents of the data belonging to the target area from the decoded YUV data of the original playback window, and reproduces a part of this contents according to the pre-configured correspondence. It can be played within the frame (or a separate playback window can be displayed to play part of it). Multiple playback windows use the same YUV data source. Therefore, the device does not need to bring in or add additional multiple video streams.

For example, assume that the resolution of the original reproduced image is Width x Height. Regarding the target area, the horizontal coordinates of the start point are StartX, the vertical coordinates of the start point are StartY, the horizontal coordinates of the end point are EndX, and the vertical coordinates of the end point are EndY. The YUV data of the original reproduced image is in the array Org [Width x Height], the YUV data of the target area is in Dst [ROIWidth x ROIHeight], and n is an arbitrary point in the target area. .. Then, the YUV data in the target region can be determined according to the following equation.
ROIWidth = EndX-StartX
ROIHeight = EndY-StartY
Dst [n] = Org [(Width × (StartY + n / ROIWidth) + StartX + n% ROIWidth)]
The division operation "/" indicates that the fraction is rounded down to the nearest integer, and the symbol "%" indicates the REM operation.

In S140, the video playback device draws the decoded data of the first video image in the designated playback window for playback.

Specifically, the video playback device plays the first video image in a pop-up window, or displays the first video image in a new playback window, or the first in the original playback window. The video image can be displayed and digital zoom can be performed on the first video image to fit the size of the playback window. That is, in the embodiment of the present invention, the designated window may be the largest playback window on the display device or may be a part of the largest playback window. The specified window may be a current existing playback window or part of an existing playback window, or it may be a new popup or a newly generated playback window. The specified window may be one window or a plurality of windows. The embodiments of the present invention are not limited thereto.

In an embodiment of the invention, optionally, the step of drawing the decoded data of the first video image in a designated playback window for playback is
It has a step of drawing the decoded data of the first video image in a designated playback window for playback in a zoomed-in manner, and the designated playback window is larger than the first target area.

In the embodiment of the present invention, for example, as shown in FIG. 9, the step of drawing the decoded data of the first video image in the designated reproduction window for reproduction has the following steps.
S142: Display an independent playback window.
S143: The decoded data of the first video image is drawn in an independent playback window for playback.

In the embodiment of the present invention, the designated playback window is an independent pop-up playback window, and the independent pop-up playback window may be larger than the first target area, so that the first video image is zoomed in. Although reproduced in a manner, it should be understood that embodiments of the present invention are not limited to this. For example, the independent playback windows may be smaller or equal to the first target area.

It should be understood that in embodiments of the present invention, "B corresponding to A" indicates that B is associated with A and that B can be determined according to A. However, it should also be understood that determining B according to A does not mean that B is determined according to A alone, but that B can be determined according to A and / or other information.

It should be understood that in embodiments of the present invention, the serial numbers of the processes described above do not indicate the order of execution. The order of execution of the processes should be determined according to the function and its inherent logic and should not impose any restrictions on the implementation of the embodiments of the present invention.

Therefore, in the video reproduction method according to the embodiment of the present invention, the original reproduced image is divided into a plurality of target areas, and the image of the target area in which the trigger event occurs is displayed separately. Thus, in one aspect, the user can observe clearer image details in the area of interest, and in another aspect, the user can track image details in multiple areas of interest at the same time. Greatly improves the user experience. In addition, in the embodiment of the present invention, the original decoded data is used to reproduce the image of the target area, but no additional video stream is added.

The video reproduction method according to the embodiment of the present invention will be described in detail below with reference to FIGS. 10 to 12B.

As shown in FIG. 10, the video reproduction method 200 can be performed by a video reproduction apparatus.
And this device is, for example, a terminal or a client. Method 200 may have the following steps:
S201: Display a graphical user interface (GUI for short) of the client.
S202: Determine whether to set the playback image division method. If it is decided to set the reproduction image division method, the process proceeds to S203. Otherwise, the process proceeds to S204.
S203: Set the playback image division method. Then, the process proceeds to S204.
S204: Determines whether the user starts playback. If the user decides to start playback, the process proceeds to S205. Otherwise, the process proceeds to S201.
S205: Enable the network port.
S206: A media stream is received, the media stream is decoded, and the decoded media stream is drawn on a display device for display.
S207: Determines whether the user manually triggers the event. If it is determined that the user manually triggers the event, the process proceeds to S208. Otherwise, the process proceeds to S209.
S208: When the user decides to manually trigger the event, the event occurrence area is displayed in the specified window by the zoom-in method. Then, the process proceeds to S206.
S209: Determines whether the device automatically triggers an event. If it is determined that the device will automatically trigger the event, the process proceeds to S210. Otherwise, the process proceeds to S211.
S210: When the device decides to automatically trigger the event, the event occurrence area is displayed in the specified window by the zoom-in method. Then, the process proceeds to S206.
S211: Determines whether or not the user finishes playback. If the user decides to end the playback, the process proceeds to S212. Otherwise, the process proceeds to S206.
S212: Determines whether the user closes the client. If the user decides to close the client, the process proceeds to S213. Otherwise, the process proceeds to S201.
S213: Clean up system resources. Then, the video playback is finished.

It should be understood that in embodiments of the present invention, the serial numbers of the processes described above do not indicate the order of execution. The order of execution of the processes should be determined according to the function and its inherent logic and should not impose any restrictions on the implementation of the embodiments of the present invention.

FIG. 11A shows a schematic flowchart of a reproduction method 300 in which a target area is manually triggered according to an embodiment of the present invention. Method 300 can be performed by a video player. And this device is, for example, a terminal or a client. As shown in FIG. 11A, method 300 has the following steps:
S301: Each frame of the video image in the original playback window is drawn and played normally.
S302: Determines whether the user manually triggers the event. If it is determined that the user manually triggers the event, the process proceeds to S303. Otherwise, the process proceeds to S301.
S303: Acquires the target area in which the user event is located.
S304: Check the playback window combined with the target area.
S305: For each frame of the video image, calculate the YUV data of the video image covered by the area of interest.
S306: For each frame of the video image, the YUV data of the target area is drawn in the designated playback window for playback. For example, as shown in FIG. 12A, the entire playback window includes an original playback image window having the same size as the original playback image window and three designated playback windows, the original playback image having 16 target areas. It is divided into. Then, the image of the target area in which the manual trigger event occurs is played back in the zoom-in method on one of the designated playback windows.
S307: Determines whether the user finishes playback. If the user decides to end the playback, the process proceeds to S308. Otherwise, the process proceeds to S305.
S308: Stop video playback. Then end the process.

FIG. 11B is a schematic flowchart of a reproduction method 400 in which a target area is automatically triggered by an event according to an embodiment of the present invention. The method 400 may have the following steps:
S401: Each frame of the video image in the original playback window is drawn and played normally.
S402: Perform intelligent analysis to determine if a trigger event occurs.
If it is determined that a trigger event will occur, the process proceeds to S403. Otherwise, the process proceeds to S401.
S403: The correspondence between the intelligent analysis area and the target area is calculated.
S404: Acquire the target area (or a plurality of target areas) covered by the analysis event.
S405: Check the playback window combined with the target area.
S406: For each frame of the video image, calculate the YUV data of the video image covered by the area of interest.
S407: For each frame of the video image, the YUV data of the target area is drawn in the designated playback window for playback. For example, as shown in FIG. 12B, the entire playback window includes an original playback image window having the same size as the original playback image window and three designated playback windows, the original playback image having 16 target areas. It is divided into. Then, the image of the target area in which the trigger event occurs is played back in the zoom-in method on one of the designated playback windows.
S408: Determines whether the user finishes playback. If the user decides to end the playback, the process proceeds to S409. Otherwise, the process proceeds to S406.
S409: Stop video playback. Then end the process.

It should be understood that in embodiments of the present invention, the serial numbers of the processes described above do not indicate the order of execution. The order of execution of the processes should be determined according to the function and its inherent logic and should not impose any restrictions on the implementation of the embodiments of the present invention.

Therefore, in the video reproduction method according to the embodiment of the present invention, the original reproduced image is divided into a plurality of target areas, and the image of the target area in which the trigger event occurs is displayed separately. Thus, in one aspect, the user can observe clearer image details in the area of interest, and in another aspect, the user can track image details in multiple areas of interest at the same time. Greatly improves the user experience.

As described above, the video reproduction method according to the embodiment of the present invention has been described in detail with reference to FIGS. 1 to 12B. Hereinafter, the video reproduction terminal and the system according to the embodiment of the present invention will be described in detail with reference to FIGS. 13 to 20.

FIG. 13 shows a schematic block diagram of the terminal 500 according to the embodiment of the present invention. As shown in FIG. 13, the terminal 500 is
A split module 510 configured to split the original playback image into at least two target areas,
Among at least two target areas selected by the split module 510, the first decision module 520 and the first decision module 520 configured to determine the first target area in which the trigger event occurs. An acquisition module 530 configured to acquire the decrypted data of the first video image displayed in the determined first target area, and
It includes a reproduction module 540 configured to draw the decoded data of the first video image acquired by the acquisition module 530 in a designated reproduction window for reproduction.

Therefore, the video reproduction terminal according to the embodiment of the present invention divides the original reproduced image into a plurality of target areas, and separately displays the image in the target area in which the trigger event occurs. Thus, in one aspect, the user can observe clearer image details in the area of interest, and in another aspect, the user can track image details in multiple areas of interest at the same time. Greatly improves the user experience.

It should be understood that in embodiments of the present invention, video playback terminals can not only play video files, but can also play real-time video streams. The embodiments of the present invention are described based on an example in which a terminal reproduces a real-time video stream, but the embodiments of the present invention are not limited thereto.

In the embodiment of the present invention, as an option, as shown in FIG. 14, the terminal 500 is
It further comprises a second determination module 550 configured to determine the correspondence between each target area in at least two target areas and the designated playback window.
The reproduction module 540 is designated to correspond the decoded data of the first video image acquired by the acquisition module 530 to the first target area for reproduction according to the correspondence determined by the second determination module 550. It is further configured to draw in the playback window.

In an embodiment of the invention, optionally, the division module 510 is further configured to divide the original reproduced image into at least two target areas by equal or free division methods.

In an embodiment of the invention, as an option, the first determination module 520, as shown in FIG.
It has a first decision unit 521 configured to determine the trigger action performed by the user on the area of interest in the original reproduced image, and the trigger action is a click action, a double click action, or. Including the operation of selecting the target area
Further, it has a second determination unit 522 configured such that the trigger operation determined by the first determination unit 521 determines the target area to be executed as the first target area.

In an embodiment of the invention, as an option, the first determination module 520, as shown in FIG.
A first acquisition unit 523 configured to acquire the coordinate metadata of the trigger event occurrence point in the original playback image, and
It has a third determination unit 524 configured to determine the target area to which the trigger event occurrence point belongs as the first target area according to the coordinate metadata acquired by the first acquisition unit 523.

In the embodiment of the present invention, as an option, as shown in FIG. 17, the acquisition module 530 is
A second acquisition unit 531 configured to acquire the decrypted data of the original reproduced image, and
It has a third determination unit 532 configured to determine the decoding data of the first video image according to the decoding data of the original reproduced image acquired by the second acquisition unit 531.

In embodiments of the present invention, optionally, the playback module is further configured and specified to draw the decoded data of the first video image in a designated playback window for playback in a zoomed-in manner. The playback window is larger than the first target area.

In the embodiment of the present invention, as an option, as shown in FIG. 18, the reproduction module 540 is
A display unit 541 configured to display an independent playback window, and
It has a reproduction unit 542 configured to draw the decoded data of the first video image in an independent reproduction window displayed by the display unit for reproduction.

The video playback terminal 500 according to the embodiment of the present invention can correspond to the video playback device according to the above-described embodiment of the present invention, and the operation and / or function of the above-mentioned and other terminal 500 joules can be seen from FIG. It should be understood that it is used to perform the corresponding processes of methods 100-400 in FIG. 12B, which are not repeated here for the sake of brevity.

Therefore, the video reproduction terminal according to the embodiment of the present invention divides the original reproduction image into a plurality of target areas, and separately displays the image of the target area in which the trigger event occurs. Thus, in one aspect, the user can observe clearer image details within the area of interest, and in another aspect, the user can track image details within a plurality of areas of interest at the same time. This can greatly improve the user experience.

FIG. 19 is a schematic block diagram of the system 600 according to an embodiment of the present invention. As shown in FIG. 19, the system 600
Terminal 610 according to the embodiment of the present invention
A video capture system 620 configured to capture a video image and generate a media stream by encoding this video image,
A server 630 configured to take a media stream generated by a video capture system and supply this media stream to terminal 620.
It includes a storage device 640 configured to store the media stream acquired by the server 630.

The terminal 610 included in the video playback system 600 according to the embodiment of the present invention can correspond to the video playback terminal 500 according to the above-described embodiment of the present invention, and the operation of the modules in the above-mentioned and other terminals 610. It should be understood that and / or functions are used to perform the corresponding processes of methods 100-400 in FIGS. 1-12B, respectively, and these are here for the sake of brevity. Do not repeat.

Therefore, the video reproduction system according to the embodiment of the present invention divides the original reproduced image into a plurality of target areas, and separately displays the image of the target area in which the trigger event occurs. Thus, in one aspect, the user can observe clearer image details within the area of interest, and in another aspect, the user can track image details within a plurality of areas of interest at the same time. This can greatly improve the user experience.

Embodiments of the present invention further provide a video playback terminal. As shown in FIG. 20, the terminal 700 includes a processor 710, a memory 720, and a bus system 730, and the processor 710 and the memory 720 are connected to each other through the bus system 730. The memory 720 is configured to store instructions, and the processor 710 is configured to execute the instructions stored in the memory 720. The processor 710 divides the original reproduced image into at least two target areas, determines the first target area in which the trigger event occurs in the at least two target areas, and displays the first target area in the first target area. It is configured to acquire the decoded data of the first video image to be generated and draw the decoded data of the first video image in a designated reproduction window for reproduction.

Therefore, the video reproduction terminal according to the embodiment of the present invention divides the original reproduction image into a plurality of target areas, and separately displays the image of the target area in which the trigger event occurs. Thus, in one aspect, the user can observe clearer image details within the area of interest, and in another aspect, the user can track image details within a plurality of areas of interest at the same time. This can greatly improve the user experience.

In an embodiment of the present invention, the processor 710 may be a central processing unit (CPU for short), and the processor 710 is another general processor, a digital signal processor (abbreviated as digital signal processor). DSP), application-specific integrated circuit (ASIC for short), field programmable gate array (FPGA for short), or other programmable logic device, independent gate or transistor logic device, It should be understood that it may be an independent hardware component or the like. The general processor may be a microprocessor, or the processor may be any common processor or the like.

Memory 720 may include read-only memory and random access memory to supply instructions and data to processor 710. A portion of the memory 720 may further include a non-volatile random access memory. For example, the memory 720 may further store device type information.

In addition to the data bus, the bus system 730 may further include a power bus, a control bus, a status signal bus, and the like. However, for clarity of explanation, all buses are shown in the figure as bus system 730.

During implementation, each step of the method described above may be performed through the hardware integrated logic in the processor 710 or in the form of instructions in the software. The steps relating to the methods disclosed in embodiments of the present invention may be performed directly by a hardware processor or by a combination of hardware and software modules within the processor. Software modules can be located in storage media mature in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, and registers. The storage medium is located in memory 720. Processor 710 reads the information in memory 720 and works with its hardware to perform the steps of the method. To avoid repetition, details are not given here again.

In one embodiment, optionally, the processor 710 is further configured to determine the correspondence between each target area in at least two target areas and the designated playback window. The processor 710 draws the decrypted data of the first video image in the designated playback window for playback, so that the decoded data of the first video image is drawn in the designated playback window for playback, according to the correspondence. Includes drawing in the specified playback window corresponding to the target area.

In one embodiment, optionally, the processor 710 divides the original reproduced image into at least two target areas, thereby dividing the original reproduced image into at least two target areas by equal or free division methods. Including doing.

In one embodiment, optionally, the processor 710 determines, among at least two target areas, the first target area in which the trigger event occurs, by the user on the target area in the original reproduced image. The trigger action includes determining the trigger action to be executed, the trigger action includes a click action, a double-click action, or an action of selecting a target area, and further, the target area in which the trigger action is executed is set as the first target area. Including deciding.

In one embodiment, optionally, the processor 710 determines the first target area in which the trigger event occurs in at least two target areas, that is, the coordinates of the trigger event occurrence point in the original reproduced image. It includes acquiring the metadata and determining the target area to which the trigger event occurrence point belongs as the first target area according to the coordinate metadata.

In one embodiment, optionally, the processor 710 obtains the decrypted data of the first video image displayed in the first target area to obtain the decrypted data of the original reproduced image. It includes determining the decoded data of the first video image according to the decoded data of the original reproduced image.

In one embodiment, optionally, the terminal 700 is further configured to draw the decoded data of the first video image in a designated playback window for playback in a zoomed-in manner, and the designated playback. The window is larger than the first target area.

In one embodiment, as an option, the terminal 700 further comprises a display 740. Drawing the decoded data of the first video image in the designated playback window for playback by the processor 710 includes displaying an independent playback window, and the display 740 displays the first video image of the first video image. The decrypted data is configured to be drawn in a separate playback window for playback.

The video playback terminal 700 according to an embodiment of the present invention may correspond to the video playback terminal 500 or the terminal 610 according to the above-described embodiment of the present invention, and the operation and / or function of the module in the above-mentioned and other terminals 700. However, it should be understood that they are used to perform the corresponding processes of methods 100-400 in FIGS. 1-12B, respectively, and these are not repeated here for the sake of brevity.

Therefore, the video reproduction terminal according to the embodiment of the present invention divides the original reproduction image into a plurality of target areas, and separately displays the image of the target area in which the trigger event occurs. Thus, in one aspect, the user can observe clearer image details within the area of interest, and in another aspect, the user can track image details within a plurality of areas of interest at the same time. This can greatly improve the user experience.

Those skilled in the art will appreciate that unit and algorithm steps can be performed by electronic hardware, computer software, or a combination thereof, in combination with the examples described in the embodiments disclosed herein. obtain. To articulate compatibility between hardware and software, the configurations and steps for each example have been outlined above according to functionality. Whether a function is performed by hardware or software depends on the design constraints of the specific application and technical solution. One of ordinary skill in the art can use different methods to perform the described functions for each particular application, but this practice should not be considered beyond the scope of the present invention.

For convenience and concise description, references can be made to the corresponding processes in the embodiment of the method for the detailed operating processes of the systems, devices and units described above, details are here again. What is not stated can be clearly understood by those skilled in the art.

It should be understood that in some embodiments presented herein, the disclosed systems, devices, and methods may be implemented in other ways. For example, the described device embodiments are merely exemplary. For example, the division of a unit is merely a division of a logical function and may be another division in actual implementation. For example, multiple units or components can be combined or incorporated into other systems, or some features can be ignored or not implemented. In addition, the indicated or stated interconnected or direct coupled or communication connections may be made through several interfaces. Indirect coupling or communication connections between devices or units can be performed electronically, mechanically, or in other ways.

Units described as separate parts may or may not be physically separate. The portion indicated as a unit may or may not be a physical unit, may be in one position, or may be distributed over a plurality of network units. Some or all of the units here may be selected according to the actual need to achieve the object of the solution of the embodiments of the present invention.

In addition, the functional units according to the embodiments of the present invention may be incorporated in one processing unit, each of the units may be physically present independently, or two or more units may be present. The units may be incorporated into one unit. The embedded unit may be implemented in the form of hardware or in the form of a software functional unit.

When the embedded unit is implemented in the form of a software functional unit and sold or used as a stand-alone product, the embedded unit may be stored on a computer-readable storage medium. Based on this understanding, the technical solutions of the present invention may be implemented in the form of software products, in essence, or in part in the prior art, or in whole or in part. .. The computer software product is stored in a storage medium and includes several instructions for instructing a computer device, which may be a personal computer, a server, a network device, etc., as described in embodiments of the present invention. Perform all or part of the steps of the method you are using. The above-mentioned storage medium is any medium that can store a program code, such as a USB flash drive, a removable hard disk, a read-only memory (ROM for short), a random access memory (RAM), and the like. Also includes magnetic disks or optical disks.

The above description is merely a specific embodiment of the present invention and is not intended to limit the scope of protection of the present invention. Any equivalent modification or substitution within the technical scope of the invention that will be immediately understood by those skilled in the art shall fall within the scope of protection of the invention. Therefore, the scope of protection of the present invention shall be in accordance with the scope of protection of the claims.

The present invention can be used for video surveillance.

500 Terminal 510 Split Module 520 First Decision Module 530 Acquisition Module 540 Playback Module 600 System 610 Terminal 620 Video Capture System 630 Server 640 Storage Device

Claims (15)

In the video playback method
The step of dividing the original playback image into at least two target areas,
Among the at least two target areas, a step of determining a first target area in which a trigger event occurs, and
The step of acquiring the decoded data of the first video image displayed in the first target area, and
A video reproduction method comprising: drawing the decoded data of the first video image in a designated reproduction window for reproduction. In the method according to claim 1,
It further comprises a step of determining the correspondence between each target area in the at least two target areas and the designated playback window.
The step of drawing the decoded data of the first video image in the designated playback window for playback is
A method characterized in that it has a step of drawing the decoded data of the first video image in a designated playback window corresponding to the first target area for playback according to the correspondence. In the method according to claim 1 or 2, the step of determining the first target area in which the trigger event occurs among the at least two target areas is
It has a step of determining a trigger action to be executed by the user on a target area in the original reproduced image, and the trigger action includes a click action, a double-click action, or an action of selecting the target area. ,
Further, a method comprising a step of determining a target area in which the trigger operation is executed as a first target area. In the method according to claim 1 or 2, the step of determining the first target area in which the trigger event occurs among the at least two target areas is
Steps to get the coordinate metadata of the trigger event occurrence point in the original playback image,
A method characterized by having a step of determining a target area to which the trigger event occurrence point belongs as a first target area according to the coordinate metadata. In the method according to any one of claims 1 to 4, the step of acquiring the decoded data of the first video image displayed in the first target area is
Steps to get the decrypted data of the original playback image,
A method comprising: determining the decoded data of the first video image according to the decoded data of the original reproduced image. In the method according to any one of claims 1 to 5, the step of drawing the decoded data of the first video image in a designated playback window for playback is a step.
It has a step of drawing the decoded data of the first video image in the designated playback window for playback by the zoom-in method, and the designated playback window is larger than the first target area. A method characterized by. In the method according to any one of claims 1 to 6, the step of drawing the decoded data of the first video image in a designated playback window for playback is a step.
Steps to display a separate playback window,
A method comprising: drawing the decoded data of a first video image in a separate playback window for playback. In a video playback terminal
A split module configured to split the original playback image into at least two target areas,
Among at least two target regions selected by the division module, a first determination module configured to determine a first target region in which a trigger event occurs, and a first determination module determined by the first determination module. An acquisition module configured to acquire the decrypted data of the first video image displayed in the first target area,
A video reproduction terminal comprising a reproduction module configured to draw the decoded data of the first video image acquired by the acquisition module in a designated reproduction window for reproduction. In the terminal according to claim 8.
It further comprises a second determination module configured to determine the correspondence between each target area in the at least two target areas and the designated playback window.
The reproduction module is designated to correspond the decoded data of the first video image acquired by the acquisition module to the first target area for reproduction according to the correspondence determined by the second determination module. A terminal characterized in that it is further configured to draw in a playback window. In the terminal according to claim 8 or 9, the first determination module is
It has a first decision unit configured to determine a trigger action performed by the user on a target area in the original reproduced image, the trigger action being a click action, a double click action, and the like. Or, including the operation of selecting the target area
Further, the terminal is characterized by having a second determination unit configured to determine the target area on which the trigger operation determined by the first determination unit is executed as the first target area. .. In the terminal according to claim 8 or 9, the first determination module is
A first acquisition unit configured to acquire the coordinate metadata of the trigger event occurrence point in the original playback image, and
Having a third determination unit configured to determine the target area to which the trigger event occurrence point belongs as the first target area according to the coordinate metadata acquired by the first acquisition unit. Characterized terminal. In the terminal according to any one of claims 8 to 11, the acquisition module is
A second acquisition unit configured to acquire the decrypted data of the original reproduced image,
It is characterized by having a third determination unit configured to determine the decoding data of the first video image according to the decoding data of the original reproduced image acquired by the second acquisition unit. Terminal to do. In the terminal according to any one of claims 8 to 12, the playback module draws the decoded data of the first video image in a designated playback window for playback by a zoom-in method. A terminal further configured in the above, wherein the designated playback window is larger than the first target area. In the terminal according to any one of claims 8 to 13, the reproduction module is
A display unit configured to display a separate playback window,
A terminal comprising a reproduction unit configured to draw decoded data of a first video image in an independent reproduction window displayed by the display unit for reproduction. In a video playback system
The terminal according to any one of claims 8 to 14, and the terminal.
With a video capture system configured to capture a video image and generate a media stream by encoding this video image,
A server configured to acquire a media stream generated by the video capture system and supply the media stream to the terminal.
A video playback system including a storage device configured to store a media stream acquired by the server.

Images