JP2019110545A - Video playback method, terminal and system - Google Patents

Abstract

To provide a video playback system making it possible to observe a clearer image in regions of interest.SOLUTION: The video playback system includes: dividing an original playback image into at least two regions of interest; determining, among the at least two regions of interest, a first region of interest where a triggering event occurs; obtaining decoded data of a first video image displayed in the first region of interest; and rendering the decoded data of the first video image to a specified playback window for playing. Using the video playback system, the original playback image is divided into multiple regions of interest, and an image in a region of interest where a triggering event occurs is displayed separately. Therefore, a user is capable of observing a clearer image in the region of interest, or tracking an image in the multiple regions of interest at the same time.SELECTED DRAWING: Figure 2

Description

  The present invention relates to the field of video surveillance, and in particular to a video playback method, terminal and system in the field of video surveillance.

  At present, high resolution video has become an important technological trend in the field of video surveillance. And cameras with 720p or 1080p resolution are more and more widely used in the field of video surveillance. With the ever-increasing increase in camera resolution, the range that a single camera can monitor becomes increasingly wider, and image details become more clear. At the same time, intelligent analysis techniques for video images are gradually being put into practice. Technical development of hardware devices has made it possible to meet the requirements for performing intelligent analysis on multiple target areas in the same image. This saves significant cost compared to manual monitoring.

  Current video surveillance clients generally play back video images from multiple cameras simultaneously. However, due to the increase in resolution of video images, the total resolution of video images from multiple cameras often exceeds the range of resolutions of client monitors. Taking a 22 inch display as an example, this display generally supports a maximum resolution of 1920 × 1080. That is, the display can only play back 1080p images from one feed. If multiple feeds of 1080p images are played simultaneously on this monitor, the images must be zoomed out. In addition to the playback window, on the interface of a typical video surveillance client, there are also several auxiliary function panels, such as a title bar, a camera list, and a pan-tilt-zoom control panel, which are also video images Reduce the display area of Thus, the image that can be played back within the playback window is much smaller than the original image.

In particular, when an event (eg, an event triggered by intelligent analysis) occurs in a video image, the area of the image in which the event occurs is even smaller. This is because the image is downsized during playback, which is inconvenient for the user to view.
When observers monitor images with the naked eye, it is difficult for observers to notice changes in details, and as a result miss important information.

  Currently, most clients provide the ability to zoom in on selected areas of the image. That is, the area of the video playback image is selected by sliding the mouse, and the selected area is zoomed in. This improves the image quality of the target area to some extent. However, digital zooming of the video image affects the quality of the image, as it causes some loss of pixel information, and also affects the effect of user viewing of image details. In addition, if the zoom function is used within the selected area, in one aspect, manual operation by the user is required, and when an event occurs suddenly, the user has no time to perform any operation, and so I miss an event. In another aspect, if an event occurs in another area of the image, it is not possible to zoom in on two areas simultaneously. Thus, the user experience is relatively poor.

  Embodiments of the present invention provide video playback methods, terminals, and systems, which can improve the user experience.

  In a first aspect, an embodiment of the present invention provides a video playback method, which comprises the steps of: dividing an original playback image into at least two target regions; and triggering in at least two target regions. The steps of: determining a first target area in which an event occurs; obtaining decoded data of a first video image displayed in the first target area; and decoding data of the first video image, Drawing on a designated reproduction window for reproduction.

  In a first possible implementation method of the first aspect, the method further comprises the step of determining the correspondence between each target area of the at least two target areas and a designated reproduction window. And the step of drawing the decoded data of the first video image in the specified reproduction window for reproduction is the first target for reproduction of the decoded data of the first video image in accordance with the correspondence relationship. It has a step of drawing in a designated reproduction window corresponding to the area.

  In relation to the first possible implementation method of the first aspect or the first aspect, in a second possible implementation method of the first aspect, a triggering event occurs in at least two regions of interest The step of determining the first target area includes the step of determining a trigger operation to be executed by the user on the target area in the original reproduced image, wherein the trigger operation is a click operation or a double click operation. Or includes an operation of selecting a target region, and further including the step of determining a target region on which a trigger operation is to be performed as a first target region.

  In relation to the first possible implementation method of the first aspect or the first aspect, in a third possible implementation method of the first aspect, a triggering event occurs in at least two regions of interest. The step of determining the first target area includes acquiring coordinate metadata of a trigger event occurrence point in the original reproduced image, and the target area to which the trigger event occurrence point belongs according to the coordinate metadata is a first target. And determining the region.

  In relation to any one of the first to third possible implementations of the first or first aspect, in the fourth possible implementation of the first aspect, the first target region The step of acquiring the decoded data of the first video image displayed in the step of acquiring the decoded data of the original reproduced image, and the decoded data of the first video image according to the decoded data of the original reproduced image And determining.

  In relation to any one of the first to fourth possible implementation methods of the first aspect or the first aspect, in the fifth possible implementation method of the first aspect, the first video image The step of drawing the decoded data in the designated reproduction window for reproduction includes the step of drawing the decoded data of the first video image in the designated reproduction window for reproduction in the zoom-in method The designated reproduction window is larger than the first target area.

  In relation to any one of the first aspect or the first to fifth possible implementation methods of the first aspect, in the sixth possible implementation method of the first aspect, the first video image The step of drawing the decoded data in the designated reproduction window for reproduction pops up the independent reproduction window, and the decoded data of the first video image is drawn in the independent reproduction window for reproduction And step.

  In a second aspect, an embodiment of the present invention provides a video reproduction terminal, which terminal is selected by a division module configured to divide an original reproduction image into at least two target areas, and the division module A first determination module configured to determine a first target region in which a trigger event occurs among at least two target regions issued, and a first target determined by the first determination module An acquisition module configured to acquire decoded data of a first video image displayed in the area, and a decoded data of the first video image acquired by the acquisition module designated for reproduction. And a playback module configured to draw in the playback window.

  In a first possible implementation method of the second aspect, the terminal is configured to determine a correspondence between each target area in at least two target areas and a designated playback window. The method further comprises a second determination module, wherein the reproduction module is configured to reproduce the decoded data of the first video image acquired by the acquisition module according to the correspondence determined by the second determination module. It is further configured to draw in a designated reproduction window corresponding to the target area of.

  In relation to the first possible implementation method of the second aspect or of the second aspect, in the second possible implementation method of the second aspect, the first determination module is configured to: Having a first determination unit configured to determine a trigger action to be performed by the user on the target area, the trigger action may be a click action, a double click action, or an action for selecting the target area And a second determination unit configured to determine, as the first target region, a target region in which the trigger operation determined by the first determination unit is to be performed.

  In relation to the first possible implementation method of the second aspect or the second aspect, in the third possible implementation method of the second aspect, the first determination module is configured to: According to the first acquisition unit configured to acquire coordinate metadata of the trigger event occurrence point, and the coordinate metadata acquired by the first acquisition unit, the target region to which the trigger event occurrence point belongs is a first target And a third determination unit configured to determine as a region.

  In relation to any one of the first to third possible implementation methods of the second aspect or the second aspect, in the fourth possible implementation method of the second aspect, the acquisition module comprises: According to the second acquisition unit configured to acquire decoded data of the reproduced image, and the decoded data of the first video image according to the decoded data of the original reproduced image acquired by the second acquisition unit And a third determination unit configured in

  In relation to any one of the first to fourth possible modes of the second aspect or the second mode, in the fifth mode of the second mode, the reproduction module comprises Is further configured to draw the decoded data of the video image of the video image in a designated playback window for playback in a zoom-in method, wherein the designated playback window is larger than the first target area.

  In relation to any one of the first to fifth possible implementations of the second aspect or the second aspect, in the sixth possible implementation of the second aspect, the regeneration module is independent A display unit configured to display the playback window; and a playback unit configured to render decoded data of the first video image in a separate playback window popped up by the display unit for playback. Have.

  In a third aspect, an embodiment of the present invention provides a video playback system, comprising: a terminal according to the second aspect of the present invention; capturing a video image and encoding the video image A video capture system configured to generate a media stream, a server configured to obtain the media stream generated by the video capture system and supply the media stream to the terminal, and the server And a storage device configured to store the media stream, wherein the terminal is selected by the division module and a division module configured to divide the original reproduced image into at least two target areas. Trigger event occurs in at least two target areas Obtaining a first determination module configured to determine one target area, and decoded data of a first video image displayed in the first target area determined by the first determination module An acquisition module configured as described above, and a reproduction module configured to draw the decoded data of the first video image acquired by the acquisition module in a designated reproduction window for reproduction.

  Based on the above technical solution, using the video reproduction method, terminal and system according to an embodiment of the present invention, an original reproduced image is divided into a plurality of target areas, and the target area in which the trigger event occurs. The image inside is displayed separately. Thus, in one aspect, the user can observe clearer image details within the region of interest, and in another aspect, the user can track image details within multiple regions of interest simultaneously. This greatly enhances the user experience.

  BRIEF DESCRIPTION OF DRAWINGS To describe the technical solutions in the embodiments of the present invention more clearly, the following briefly introduces the accompanying drawings necessary for describing the embodiments of the present invention. Apparently, the attached drawings in the following description only show some embodiments of the present invention, and those skilled in the art can further derive other drawings from these attached drawings without creative efforts. Can.

FIG. 5 is a schematic block diagram of an exemplary application scenario, in accordance with one embodiment of the present invention. FIG. 5 is a schematic flow diagram of a video playback method according to an embodiment of the present invention. FIG. 5 is another schematic flow diagram of a video playback method according to an embodiment of the present invention. FIG. 5 is a schematic flow diagram of a method of dividing an original reproduced image into target areas according to an embodiment of the present invention. FIG. 6 is another schematic flow diagram of a method of dividing an original reproduced image into target areas according to an embodiment of the present invention. FIG. 5 is a schematic flow diagram of a method of determining a target area in which a triggering event occurs, according to an embodiment of the present invention. FIG. 5 is another schematic flow diagram of a method of determining a target region in which a triggering event occurs, according to an embodiment of the present invention. FIG. 5 is a schematic flow diagram of a method for obtaining decoded data of a target area according to an embodiment of the present invention. FIG. 5 is a schematic flow diagram of a method of reproducing an image in a region of interest according to an embodiment of the present invention. FIG. 7 is a schematic flow diagram of a video playback method according to another embodiment of the present invention. FIG. 5 is another schematic flow diagram of a video playback method according to another embodiment of the present invention. FIG. 5 is another schematic flow diagram of a video playback method according to another embodiment of the present invention. FIG. 7 is a schematic view of the reproduction of a target area according to an embodiment of the present invention. FIG. 7 is a schematic view of the reproduction of a target area according to an embodiment of the present invention. FIG. 5 is a schematic block diagram of a terminal according to an embodiment of the present invention. FIG. 5 is another schematic block diagram of a terminal according to an embodiment of the present invention. FIG. 5 is a first decision module schematic block diagram according to an embodiment of the present invention. FIG. 7 is another schematic block diagram of the first determination module according to an embodiment of the present invention. FIG. 5 is a schematic block diagram of an acquisition module according to an embodiment of the present invention. FIG. 5 is a schematic block diagram of a playback module, according to one embodiment of the present invention. FIG. 1 is a system schematic block diagram according to one embodiment of the present invention. FIG. 6 is a schematic block diagram of a terminal according to another embodiment of the present invention.

  The following clearly and completely describes the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Apparently, the described embodiments are only a part rather than all of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative efforts shall fall within the protection scope of the present invention.

  FIG. 1 is a schematic block diagram of an exemplary application scenario according to one embodiment of the present invention. As shown in FIG. 1, a video surveillance system to which embodiments of the present invention can be applied includes a terminal having a video capture device, a central server, a storage device, and a client, the video capture device for capturing a video image And by encoding the video image, a media stream can be generated to transmit the video image over the network. For example, video capture devices may include devices such as, for example, network cameras, analog cameras, encoders, and digital video recorders (DVRs for short). After being connected to the central server, the client of the terminal can request the video stream, decode and display this video stream, and present the on-site video image to the user.

  The central server may include a management server and a media server. The media server may be responsible for receiving the media stream, recording and storing media stream data in storage, and transferring the media stream to the client for playback on demand. The management server may play a role of, for example, user login, authentication, and service scheduling. The central server is also accessed by multiple clients, capable of managing network connections between various video surveillance systems, etc. The storage device may be, for example, a disk array. The disk array can play a role of storing video data, and in order to store video data, network attached storage (NAS for short), storage area network (SAN for short), Or the server itself can be used.

  It should be understood that the video surveillance system shown in FIG. 1 is only an embodiment to which the method of the present invention is applicable, and is not intended to limit the purpose and function of the present invention. . The present invention should not be described as dependent on the requirements for any one or any combination of components of the video surveillance system shown in FIG. However, in order to describe the invention more clearly and in detail, embodiments of the invention are described below by taking an application scenario of a video surveillance system as an example. However, the present invention is not limited to this.

  The technical solution for video data transmission in the embodiment of the present invention is various communication networks or communication systems, for example, Global System for Mobile Communications, abbreviated as "GSM (registered trademark)" for mobile communication. “Code Division Multiple Access (abbreviated“ CDMA ”) system”, Wideband Code Division Multiple Access (abbreviated “WCDMA (registered trademark)”) system, general packet radio service ( general packet radio service (abbreviated to "GPRS") system, Long Term Evolution (abbreviated to "LTE") system, LTE frequency division duplex (abbreviated to "FDD") system, LTE time Split-duplex (time division duplex, "TDD" for short) system Use Universal Mobile Telecommunications System (abbreviated "UMTS") or Worldwide Interoperability for Microwave Access (WiMAX) communications systems It should be understood that Embodiments of the present invention are not limited to these.

FIG. 2 is a schematic flowchart of a video playback method 100 according to an embodiment of the present invention.
The method 100 may be performed by a video playback device. This device is, for example, a terminal or a client. As shown in FIG. 2, the method 100 includes the following steps.
S110: Divide the original reproduced image into at least two target areas.
S120: Among the at least two target areas, the first target area where the trigger event occurs is determined.
S130: Obtain decoded data of the first video image displayed in the first target area.
S140: Draw the decoded data of the first video image in a designated reproduction window for reproduction.

  In order not to affect the quality of the playback video and to improve the effect of user viewing on the image details, especially when multiple video images are displayed in the same window in a zoom-out manner, The video playback device can initially divide the original playback image into multiple target areas. Then, the decoded data of the video image displayed in the target area where the trigger event occurs is obtained. Thus, the video playback device can render the decoded data of the video image in an independent designated playback window for playback. In this manner, details of the image that the user is interested in may be displayed in a separate window. The effect of user viewing of image details is then improved.

  Therefore, the video playback method according to an embodiment of the present invention divides the original playback image into a plurality of target areas and separately displays the image in the target area where the trigger event occurs. Thus, in one aspect, the user can observe clearer image details within the region of interest, and in another aspect, the user can track image details in multiple regions of interest simultaneously This greatly improves the user experience.

  It should be understood that in the embodiments of the present invention, video includes not only video files, but also real-time video streams. Although embodiments of the present invention are described by taking playback of a real time video stream as an example, embodiments of the present invention are not limited thereto.

In an embodiment of the present invention, optionally, as shown in FIG. 3, the method 100 further comprises the following steps.
S150: The correspondence between each target area in at least two target areas and the designated reproduction window is determined.

The step of drawing the decoded data of the first video image in the designated reproduction window for reproduction comprises the following steps.
S141: Drawing the decoded data of the first video image in a designated reproduction window corresponding to the first target area for reproduction according to the correspondence relationship.

  That is, each region of interest may be associated with one or more playback windows to reproduce an image within the region of interest when a trigger event occurs within the region of interest. The designated window may be the largest playback window on the display device and may be part of the largest playback window. The specified window may be part of the current existing playback window or a part of the existing playback window, or may be a new pop-up playback window or a newly generated playback window. Embodiments of the present invention are not limited to these.

  Hereinafter, a video playback method according to an embodiment of the present invention will be described in detail with reference to FIGS. 4 to 12B.

  Optionally at S110, dividing the original reproduced image into at least two regions of interest comprises dividing the original reproduced image into at least two regions of interest with equal or free division method ing.

  Specifically, a single playback window may be divided into multiple target areas in advance on the client. The size of the target area may be the same or different, and the target area may be set as an irregular area. In addition, in the embodiment of the present invention, the correspondence between the target area and the reproduction window can be determined. The step of dividing the original reproduced image into the target area may be performed manually by the user or automatically by the client software, which is stored on the client.

The images may be segmented in an equal or free segmentation manner. The specific configuration process is shown in FIGS. 4 and 5. For example, as shown in FIG. 4, the method of dividing an image into target areas by an equal dividing method includes the following steps.
S111: Click the right-click menu or toolbar button to display the configuration window.
S112: In the pop-up configuration window, set the number of target areas. For example, the number of target areas is set to 16.
S113: Right-click on the target area to set a playback window combined with the target area.
S114: When the trigger event occurs in the target area, select the play window to play the video in the target area.

As shown in FIG. 5, the method of dividing an image into target areas by a free dividing method may have, for example, the following steps.
S115: Click the right click menu or toolbar button to pop up the configuration window.
S116: In the pop-up configuration window, drag the mouse to draw the target area. The size and shape of the area of interest may be the same or different.
S117: Right-click on the target area to set a playback window combined with the target area.
S118: When the trigger event occurs in the target area, select the play window to play the video in the target area.

In the embodiment of the present invention, the original reproduced image divided into the target area may be all reproduced images in the largest reproduction window on the display device, or a plurality of reproduced simultaneously in the largest partial window. It should be understood that it may be one or more of the images of.
Embodiments of the present invention are not limited to these.

  In S120, the video playback apparatus determines a first target area in which a trigger event occurs in at least two target areas, and displays an image in the first target area in another playback window. , This improves the display effect of image details.

  In embodiments of the present invention, the user may manually trigger an event to determine a target area, or may automatically detect a trigger event to determine a target area. These are described below with reference to FIGS. 6 and 7, respectively.

As shown in FIG. 6, optionally, among the at least two target areas, the step of determining the first target area in which the trigger event occurs includes the following steps.
S121: Determine a trigger action to be performed by the user on the target area in the original reproduced image.
The trigger operation includes a click operation, a double click operation, or an operation of selecting a target area.
S122: Determine a target area where the trigger operation is to be executed as a first target area.

  Specifically, when detecting the occurrence of an event when the user views a video, the user can operate on the client interface. For example, a trigger operation is performed on the target area in the original reproduced image, whereby the image in the target area where the event occurs can be reproduced in a predesignated reproduction window or an independent pop-up. Displayed in the playback window. When an event occurs in multiple target areas, the user can trigger multiple windows for display. The trigger operation is, for example, a click operation, a double click operation, or an operation of selecting a target area. Embodiments of the present invention are not limited to these.

FIG. 7 shows another schematic flowchart of a method of determining a target area where a trigger event occurs according to an embodiment of the present invention. As shown in FIG. 7, optionally, among the at least two target areas, the step of determining the first target area in which the trigger event occurs includes the following steps.
S123: Acquire coordinate metadata of trigger event occurrence point in the original reproduced image.
S124: According to the coordinate metadata, a target area to which the trigger event occurrence point belongs is determined as a first target area.

  Specifically, for example, the user can pre-configure regions that require automatic event detection, and can configure event detection rules, such as motion detection or intelligent analysis detection. When an event occurs, the client software can determine the corresponding target area configured in advance according to the coordinate metadata of the trigger event occurrence point, so that the corresponding image is reproduced in the previously specified reproduction window. Or in a separate pop-up playback window. When an event occurs in multiple target areas, client software can launch multiple windows for display.

  Within the irregular intelligent analysis area, the trigger event may cover multiple target areas, and it is understood that the multiple target areas may be determined as the first target area in which the trigger event occurs. It should be. Embodiments of the present invention are not limited to this.

  In embodiments of the present invention, the video playback device may determine whether a trigger event occurs in the target area by motion detection, intelligent analysis detection, etc. The central server can also perform detection to determine if the triggering event occurs in the area of interest. Then, when the trigger event is detected, the central server can feed back the coordinate metadata of the trigger event occurrence point to the video playback device, so the video playback device generates the trigger event according to the coordinate metadata. A first region of interest can be determined. Embodiments of the present invention are not limited to this.

At S130, the video reproduction apparatus obtains decoded data of the first video image displayed in the first target area, so that the first video image is reproduced in the designated reproduction window.
In the embodiment of the present invention, as shown in FIG. 8 as an option, the step of obtaining decoded data of the first video image displayed in the first target area includes the following steps.
S131: Acquire the decoded data of the original reproduced image.
S132: The decoded data of the first video image is determined according to the decoded data of the original reproduced image.

  Specifically, for example, the video playback device receives an event manually triggered by the user in the manner of a click, a double click, a click on a toolbar button, or a shortcut key trigger. Alternatively, after determining the first target area in which the trigger event occurs according to the coordinate metadata, this apparatus blocks the contents of data belonging to the target area from the decoded YUV data of the original reproduction window. Thus, a part of the contents can be reproduced within a reproduction frame designated in advance (or an independent reproduction window can be displayed and the part can be reproduced) in accordance with the correspondence relationship previously formed. Multiple playback windows use the same YUV data source. Thus, the device does not need to bring in or add additional video streams.

For example, it is assumed that the resolution of the original reproduction image is Width × Height. Regarding the target area, the horizontal coordinate of the start point is StartX, the vertical coordinate of the start point is StartY, the horizontal coordinate of the end point is EndX, and the vertical coordinate of the end point is EndY. The YUV data of the original reproduction image is in the array Org [Width × Height], the YUV data of the target area is in Dst [ROIWidth × ROI Height], and n is any point in the target area . Then, YUV data in the target area can be determined according to the following equation.
ROIWidth = EndX-StartX
ROIHeight = EndY-StartY
Dst [n] = Org [(Width x (Start Y + n / ROI Width) + Start X + n% ROI Width)]
The division operation "/" indicates that the fraction is rounded and rounded to the nearest integer, and the symbol "%" indicates the REM operation.

  At S140, the video playback apparatus renders the decoded data of the first video image in a designated playback window for playback.

  Specifically, the video playback device plays the first video image in the pop-up window, or displays the first video image in a new playback window, or the first in the original playback window. The video image can be displayed, and digital zoom can be performed on the first video image to fit the size of the playback window. That is, in the embodiment of the present invention, the designated window may be the largest playback window on the display device or may be part of the largest playback window. The designated window may be part of the current existing playback window or a part of the existing playback window, or may be a new pop-up or a newly generated playback window. The specified window may be a single window or multiple windows. Embodiments of the present invention are not limited to these.

In an embodiment of the present invention, optionally, the step of drawing the decoded data of the first video image in a designated reproduction window for reproduction is:
A step of drawing the decoded data of the first video image in a designated reproduction window for reproduction in a zoom-in method, wherein the designated reproduction window is larger than the first target area.

In the embodiment of the present invention, for example, as shown in FIG. 9, the step of drawing the decoded data of the first video image in the designated reproduction window for reproduction has the following steps.
S142: Display a separate playback window.
S143: Draw the decoded data of the first video image in a separate playback window for playback.

  In an embodiment of the present invention, the first video image is zoomed in because the designated playback window is an independent pop-up playback window, and this independent pop-up playback window may be larger than the first target area. Although reproduced in a method, it should be understood that embodiments of the present invention are not limited thereto. For example, the independent playback window may be smaller or equal to the first region of interest.

  In the embodiments of the present invention, “B corresponding to A” indicates that B is associated with A, and it should be understood that B may be determined according to A. However, it should also be understood that determining B according to A does not mean that B is determined according to A alone, but B may be determined according to A and / or other information.

  It should be understood that in the embodiment of the present invention, the above-mentioned process serial numbers do not indicate the execution order. The order of execution of the processes should be determined according to the functions and their inherent logic, and there should not be any limitations placed on the practice of the embodiments of the present invention.

  Therefore, the video playback method according to an embodiment of the present invention divides the original playback image into a plurality of target areas, and separately displays an image of the target area where the trigger event occurs. Thus, in one aspect, the user can observe clearer image details of the region of interest, and in another aspect, the user can simultaneously track the image details of multiple regions of interest, Significantly improve the user experience. In addition, embodiments of the present invention use the original decoded data to reproduce the image of the region of interest but do not add additional video streams.

  Hereinafter, a video playback method according to an embodiment of the present invention will be described in detail with reference to FIGS. 10 to 12B.

As shown in FIG. 10, the video playback method 200 may be performed by a video playback device.
And this apparatus is, for example, a terminal or a client. Method 200 may have the following steps.
S201: Display a graphical user interface (GUI) for the client.
S202: It is determined whether the reproduction image division method should be set. If it is determined to set the reproduction image division method, the process proceeds to S203. Otherwise, the process proceeds to S204.
S203: Set a reproduction image division method. Then, the process proceeds to S204.
S204: It is determined whether the user starts playback. If it is determined that the user starts playing, the process proceeds to S205. Otherwise, the process proceeds to S201.
S205: Enable the network port.
S206: Receive a media stream, decode the media stream, and draw the decoded media stream on a display device for display.
S207: Determine whether the user manually triggers an event. If it is determined that the user manually triggers an event, the process proceeds to S208. Otherwise, the process proceeds to S209.
S208: When the user decides to manually trigger an event, the event occurrence area is displayed in a specified window in a zoom-in manner. Then, the process proceeds to S206.
S209: Determine whether the device automatically triggers an event. If it is determined that the device automatically triggers an event, the process proceeds to S210. Otherwise, the process proceeds to S211.
S210: When the device decides to automatically trigger an event, it displays the event occurrence area in the specified window in a zoom-in manner. Then, the process proceeds to S206.
S211: It is determined whether the user finishes the reproduction. If it is determined that the user has finished playing, the process proceeds to S212. Otherwise, the process proceeds to S206.
S212: Determine whether the user closes the client. If it is determined that the user closes the client, the process proceeds to S213. Otherwise, the process proceeds to S201.
S213: Clean up system resources. Then, the video playback ends.

  It should be understood that in the embodiment of the present invention, the above-mentioned process serial numbers do not indicate the execution order. The order of execution of the processes should be determined according to the functions and their inherent logic, and there should not be any limitations placed on the practice of the embodiments of the present invention.

FIG. 11A shows a schematic flowchart of a playback method 300 in which the target area is manually triggered, according to an embodiment of the present invention. Method 300 may be performed by a video playback device. And this apparatus is, for example, a terminal or a client. As shown in FIG. 11A, method 300 includes the following steps.
S301: Draw and play each frame of the video image in the original playback window normally.
S302: Determine whether the user manually triggers an event. If it is determined that the user manually triggers an event, the process proceeds to S303. Otherwise, the process proceeds to S301.
S303: Acquire a target area in which the user event is located.
S304: Check the playback window connected to the target area.
S305: Calculate, for each frame of the video image, YUV data of the video image covered by the region of interest.
S306: For each frame of the video image, draw YUV data of the target area in a designated playback window for playback. For example, as shown in FIG. 12A, the entire playback window includes an original playback image window having the same size as the original playback image window and three designated playback windows, and the original playback image has 16 target areas. Divided into Then, the image of the target area where the manual trigger event occurs is reproduced by the zoom-in method on one of the designated reproduction windows.
S307: It is determined whether the user finishes the reproduction. If it is determined that the user has finished playing, the process proceeds to S308. Otherwise, the process proceeds to S305.
S308: Stop video playback. And end the process.

FIG. 11B is a schematic flowchart of a playback method 400 in which a region of interest is automatically triggered by an event, according to one embodiment of the present invention. The method 400 may have the following steps.
S401: Draw and play each frame of the video image in the original playback window normally.
S402: Perform intelligent analysis to determine if a trigger event occurs.
If it is determined that a trigger event occurs, the process proceeds to S403. Otherwise, the process proceeds to S401.
S403: Calculate the correspondence between the intelligent analysis area and the target area.
S404: Obtain a target area (or a plurality of target areas) covered by the analysis event.
S405: Check the playback window connected to the target area.
S406: For each frame of the video image, calculate YUV data of the video image covered by the area of interest.
S407: For each frame of the video image, draw the YUV data of the target area in the specified playback window for playback. For example, as shown in FIG. 12B, the entire playback window includes an original playback image window having the same size as the original playback image window and three designated playback windows, and the original playback image has 16 target areas. Divided into Then, the image of the target area where the trigger event occurs is reproduced by the zoom-in method on one of the designated reproduction windows.
S408: It is determined whether the user finishes the reproduction. If it is determined that the user finishes playing, the process proceeds to S409. Otherwise, the process proceeds to S406.
S409: Stop video playback. And end the process.

  It should be understood that in the embodiment of the present invention, the above-mentioned process serial numbers do not indicate the execution order. The order of execution of the processes should be determined according to the functions and their inherent logic, and there should not be any limitations placed on the practice of the embodiments of the present invention.

  Therefore, the video playback method according to an embodiment of the present invention divides the original playback image into a plurality of target areas, and separately displays an image of the target area where the trigger event occurs. Thus, in one aspect, the user can observe clearer image details of the region of interest, and in another aspect, the user can simultaneously track the image details of multiple regions of interest, Significantly improve the user experience.

  The video playback method according to the embodiment of the present invention has been described in detail with reference to FIGS. 1 to 12B. The video playback terminal and system according to embodiments of the present invention will be described in detail below with reference to FIGS.

FIG. 13 shows a schematic block diagram of a terminal 500 according to an embodiment of the present invention. As shown in FIG.
A division module 510 configured to divide the original reproduced image into at least two target areas;
Among the at least two target areas selected by the division module 510, a first determination module 520 configured to determine a first target area in which the trigger event occurs, and the first determination module 520 An acquisition module 530 configured to acquire decoded data of the first video image to be displayed in the determined first target area;
And a reproduction module 540 configured to draw the decoded data of the first video image acquired by the acquisition module 530 in a designated reproduction window for reproduction.

  Therefore, the video reproduction terminal according to the embodiment of the present invention divides the original reproduced image into a plurality of target areas and separately displays the image in the target area where the trigger event occurs. Thus, in one aspect, the user can observe clearer image details of the region of interest, and in another aspect, the user can simultaneously track the image details of multiple regions of interest, Significantly improve the user experience.

  It should be understood that in embodiments of the present invention, the video playback terminal can not only play the video file, but also can play the real time video stream. Although the embodiments of the present invention are described based on the example of the terminal playing a real-time video stream, the embodiments of the present invention are not limited thereto.

In an embodiment of the present invention, optionally, as shown in FIG.
The system further comprises a second determination module 550 configured to determine a correspondence between each of the at least two regions of interest and the designated playback window,
The reproduction module 540 specifies the decoded data of the first video image acquired by the acquisition module 530 according to the correspondence determined by the second determination module 550, corresponding to the first target area for reproduction. It is further configured to draw in the playback window.

  In an embodiment of the present invention, optionally, the division module 510 is further configured to divide the original reproduced image into at least two regions of interest in equal or free division manner.

In an embodiment of the present invention, optionally, as shown in FIG.
There is a first determination unit 521 configured to determine a trigger action to be performed by the user on a target area in the original reproduction image, the trigger action being a click action, a double click action, or Including the act of selecting the target area,
Furthermore, it comprises a second determination unit 522 configured to determine a target area in which the triggering action determined by the first determination unit 521 is performed as a first target area.

In an embodiment of the present invention, optionally, as shown in FIG.
A first acquisition unit 523 configured to acquire coordinate metadata of trigger event occurrence points in the original reproduced image;
And a third determination unit 524 configured to determine a target area to which the trigger event occurrence point belongs as a first target area according to the coordinate metadata acquired by the first acquisition unit 523.

In an embodiment of the present invention, optionally as shown in FIG.
A second acquisition unit 531 configured to acquire decoded data of the original reproduced image;
And a third determination unit 532 configured to determine decoded data of the first video image according to the decoded data of the original reproduced image acquired by the second acquisition unit 531.

  In an embodiment of the present invention, optionally, the playback module is further configured and arranged to draw the decoded data of the first video image in a zoom-in method in a designated playback window for playback. The playback window is larger than the first target area.

In an embodiment of the present invention, optionally, as shown in FIG.
A display unit 541 configured to display an independent playback window;
And a playback unit 542 configured to render the decoded data of the first video image in a separate playback window displayed by the display unit for playback.

  The video playback terminal 500 according to an embodiment of the present invention may correspond to the video playback device according to an embodiment of the present invention, and the operation and / or function of the above-mentioned and other terminals 500 joules are shown in FIGS. It should be understood that it is used to carry out the corresponding processes of methods 100 to 400 in, which are not repeated here for the sake of brevity.

  Therefore, the video reproduction terminal according to the embodiment of the present invention divides the original reproduction image into a plurality of target areas and separately displays the image of the target area where the trigger event occurs. Thus, in one aspect, the user can observe clearer image details in the region of interest, and in another aspect, the user can simultaneously track image details in multiple regions of interest This greatly improves the user experience.

FIG. 19 is a schematic block diagram of a system 600 in accordance with an embodiment of the present invention. As shown in FIG.
A terminal 610 according to an embodiment of the invention;
A video capture system 620 configured to capture a video image and generate a media stream by encoding the video image;
A server 630 configured to obtain the media stream generated by the video capture system and provide the media stream to the terminal 620;
And a storage device 640 configured to store the media stream obtained by the server 630.

  The terminal 610 included in the video playback system 600 according to an embodiment of the present invention may correspond to the video playback terminal 500 in an embodiment of the present invention, and the operation of the modules in the aforementioned and other terminals 610 and / or It is to be understood that the functions are used to carry out the corresponding processes of methods 100 to 400 in FIGS. 1 to 12B, respectively, which are not repeated here for the sake of brevity. .

  Therefore, the video playback system according to an embodiment of the present invention divides the original playback image into a plurality of target areas and separately displays the image of the target area where the trigger event occurs. Thus, in one aspect, the user can observe clearer image details in the region of interest, and in another aspect, the user can simultaneously track image details in multiple regions of interest This greatly improves the user experience.

  Embodiments of the present invention further provide a video playback terminal. As shown in FIG. 20, the terminal 700 includes a processor 710, a memory 720, and a bus system 730. The processor 710 and the memory 720 are connected to each other through the bus system 730. Memory 720 is configured to store instructions, and processor 710 is configured to execute the instructions stored in memory 720. The processor 710 divides the original reproduced image into at least two target areas, determines a first target area in which a trigger event occurs in the at least two target areas, and displays the first target area in the first target area. It is configured to obtain decoded data of the first video image to be played, and to draw the decoded data of the first video image in a designated reproduction window for reproduction.

  Therefore, the video reproduction terminal according to the embodiment of the present invention divides the original reproduction image into a plurality of target areas and separately displays the image of the target area where the trigger event occurs. Thus, in one aspect, the user can observe clearer image details in the region of interest, and in another aspect, the user can simultaneously track image details in multiple regions of interest This greatly improves the user experience.

  In the embodiment of the present invention, the processor 710 may be a central processing unit (CPU), and the processor 710 may be another common processor, a digital signal processor (abbreviated) DSP), application-specific integrated circuit (ASIC), field programmable gate array (FPGA), or other programmable logic devices, independent gate or transistor logic devices, It should be understood that it may be an independent hardware component or the like. The general processor may be a microprocessor, or the processor may be any common processor or the like.

  Memory 720, which may include read only memory and random access memory, provides instructions and data to processor 710. A portion of memory 720 may further include non-volatile random access memory. For example, memory 720 may further store device type information.

  In addition to the data bus, bus system 730 may further include a power bus, a control bus, a status signal bus, and the like. However, for the sake of clarity, all the buses are shown as bus system 730 in the figure.

  During implementation, each step of the aforementioned method may be implemented through integrated logic in hardware within processor 710 or in the form of instructions in software. The steps relating to the methods disclosed in the embodiments of the present invention may be directly implemented as being performed by a hardware processor or by a combination of hardware and software modules within the processor. The software module may be located in a storage medium mature in this technology, such as random access memory, flash memory, read only memory, programmable read only memory, electrically erasable programmable memory, and registers. A storage medium is located in memory 720. Processor 710 reads the information in memory 720 and, in conjunction with its hardware, performs the method steps. Details are not described here again to avoid repetition.

  In one embodiment, optionally, processor 710 is further configured to determine a correspondence between each of the at least two regions of interest and the designated playback window. When the processor 710 draws the decoded data of the first video image in the specified reproduction window for reproduction, the decoded data of the first video image is reproduced according to the correspondence relationship, the first for reproducing the first video image. It includes drawing in a designated reproduction window corresponding to the target area.

  In one embodiment, optionally, processor 710 dividing the original reproduced image into at least two target areas divides the original reproduced image into at least two target areas in an equal division method or a free division method. To do.

  In one embodiment, optionally, the processor 710 determines a first target area in which a trigger event occurs in at least two target areas by the user on the target area in the original reproduced image. The trigger operation includes determining a trigger operation to be performed, the trigger operation includes a click operation, a double click operation, or an operation of selecting a target region, and further, the target region where the trigger operation is to be performed is set as a first target region Including deciding.

  In one embodiment, optionally, the processor 710 determines a first target area in which a trigger event occurs in at least two target areas, the coordinates of the trigger event occurrence point in the original reproduced image. Acquiring metadata and determining a target region to which a trigger event occurrence point belongs as a first target region according to the coordinate metadata.

  In one embodiment, optionally, the processor 710 acquiring decoded data of a first video image displayed in the first target area comprises acquiring decoded data of an original reproduced image; And determining the decoded data of the first video image according to the decoded data of the original reproduced image.

  In one embodiment, as an option, the terminal 700 is further configured to draw the decoded data of the first video image in a designated playback window for playback in a zoom-in method, the designated playback The window is larger than the first target area.

  In one embodiment, optionally, terminal 700 further comprises a display 740. The processor 710 drawing the decoded data of the first video image into the designated reproduction window for reproduction includes displaying an independent reproduction window, and the display 740 displays the first video image The decoded data is configured to be drawn in a separate reproduction window for reproduction.

  The video playback terminal 700 according to embodiments of the present invention may correspond to the video playback terminal 500 or terminal 610 in embodiments of the present invention, and the operations and / or functions of the modules in the aforementioned and other terminals 700, It should be understood that it will be used to carry out the corresponding processes of methods 100 to 400 in FIGS. 1 to 12B, respectively, which are not repeated here for the sake of brevity.

  Therefore, the video reproduction terminal according to the embodiment of the present invention divides the original reproduction image into a plurality of target areas and separately displays the image of the target area where the trigger event occurs. Thus, in one aspect, the user can observe clearer image details in the region of interest, and in another aspect, the user can simultaneously track image details in multiple regions of interest This greatly improves the user experience.

  Those skilled in the art are aware that units and algorithmic steps may be implemented by electronic hardware, computer software, or a combination thereof, in combination with the examples described in the embodiments disclosed in this specification. obtain. In order to clearly describe the compatibility between hardware and software, the above has outlined the configuration and steps of each example according to function. Whether the functions are performed by hardware or software depends on the design constraints of the specific application and technical solution. The person skilled in the art can implement the described functions for each particular application using different methods, but this implementation should not be considered to be beyond the scope of the present invention.

  For convenient and concise description, reference may be made to the corresponding process in the method embodiments to the detailed operation process of the aforementioned system, apparatus and unit, the details will again be here What is not described can be clearly understood by those skilled in the art.

  It should be understood that, in the several embodiments presented in the present application, the disclosed system, apparatus and method may be implemented in other manners. For example, the described apparatus embodiments are merely exemplary. For example, the division of units is merely a division of logical functions and may be another division in actual implementation. For example, multiple units or components may be combined, or incorporated into other systems, or some features may be ignored or not performed. In addition, the shown or described mutually coupled or direct coupled or communication connections may be implemented through several interfaces. The indirect coupling or communication connection between the devices or units may be implemented electronically, mechanically or otherwise.

  The units described as separate parts may or may not be physically separate. And, a portion shown as a unit may or may not be a physical unit, may be in one position, or may be distributed over a plurality of network units. Some or all of the units here may be selected according to the actual need to achieve the purpose of the solution of the embodiments of the present invention.

  In addition, the functional units in the embodiments of the present invention may be incorporated into one processing unit, or each of the units may physically exist alone, or two or more. A unit may be incorporated into one unit. The incorporated unit may be implemented in the form of hardware or may be implemented in the form of a software functional unit.

  When the incorporated unit is implemented in the form of a software functional unit and sold or used as a separate product, the incorporated unit may be stored on a computer readable storage medium. Based on such an understanding, the technical solution of the present invention may be implemented essentially, or a part involved in the prior art, or all or part of the technical solution in the form of a software product. . The computer software product is stored in a storage medium, includes some instructions for instructing a computer device (which may be a personal computer, a server, a network device etc.) and is described in the embodiments of the present invention Perform all or part of the method steps. The aforementioned storage medium may be any medium capable of storing program code, such as USB flash drive, removable hard disk, Read-Only Memory (ROM for short), Random Access Memory (RAM), It also includes magnetic disks or optical disks.

  The above descriptions are merely specific embodiments of the present invention, and are not intended to limit the protection scope of the present invention. Any equivalent modification or substitution that is readily understood by those skilled in the art within the technical scope of the present invention shall fall within the protection scope of the present invention. Therefore, the protection scope of the present invention shall be in accordance with the protection scope of the claims.

500 terminal 510 division module 520 first determination module 530 acquisition module 540 reproduction module 600 system 610 terminal 620 video capture system 630 server 640 storage device

Claims (15)

In the video playback method,
Dividing the original reproduced image into at least two target areas;
Determining, among the at least two regions of interest, a first region of interest where a triggering event occurs;
Acquiring decoded data of a first video image to be displayed in the first target area;
And v. Drawing the decoded data of the first video image in a designated reproduction window for reproduction. In the method according to claim 1,
Determining the correspondence between each of the at least two regions of interest and the designated playback window;
Drawing the decoded data of the first video image in a designated reproduction window for reproduction;
And drawing the decoded data of the first video image in a designated reproduction window corresponding to the first target area for reproduction according to the correspondence relationship. The method according to claim 1 or 2, wherein, among the at least two target areas, the step of determining a first target area in which a trigger event occurs includes:
Determining a trigger action to be performed by the user on a target area in the original reproduction image, the trigger action includes a click action, a double click action, or an action to select a target area ,
The method may further comprise the step of determining a target area in which the trigger operation is to be performed as a first target area. The method according to claim 1 or 2, wherein, among the at least two target areas, the step of determining a first target area in which a trigger event occurs includes:
Acquiring coordinate metadata of a trigger event occurrence point in an original reproduced image;
Determining a target area to which the trigger event occurrence point belongs as a first target area according to the coordinate metadata. The method according to any one of claims 1 to 4, wherein acquiring decoded data of a first video image displayed in the first target area comprises:
Obtaining decoded data of an original reproduced image;
Determining decoded data of the first video image according to decoded data of the original reproduced image. The method according to any one of claims 1 to 5, wherein the step of drawing the decoded data of the first video image in a designated reproduction window for reproduction is:
Drawing the decoded data of the first video image in a designated reproduction window for reproduction in a zoom-in method, wherein the designated reproduction window is larger than the first target area How to feature The method according to any one of claims 1 to 6, wherein the step of drawing decoded data of the first video image in a designated reproduction window for reproduction is:
Displaying a separate playback window;
Drawing the decoded data of the first video image in a separate playback window for playback. In the video playback terminal
A division module configured to divide the original reproduction image into at least two target areas;
Among the at least two target areas selected by the division module, a first determination module configured to determine a first target area in which a trigger event occurs; and the first determination module An acquisition module configured to acquire decoded data of a first video image to be displayed in the first target region of interest;
A video reproduction terminal comprising: a reproduction module configured to draw decoded data of the first video image acquired by the acquisition module in a reproduction window designated for reproduction. In the terminal according to claim 8,
The system further comprises a second determination module configured to determine a correspondence between each of the at least two regions of interest and the designated playback window,
The reproduction module is specified according to the correspondence determined by the second determination module, the decoded data of the first video image acquired by the acquisition module corresponding to a first target area for reproduction. A terminal that is further configured to draw in a playback window. The terminal according to claim 8 or 9, wherein the first determination module
A first determination unit configured to determine a trigger action to be performed by the user on a target area in the original reproduction image, the trigger action comprising a click action, a double click action, Or including the action of selecting a target area,
Furthermore, a terminal characterized by comprising a second determination unit configured to determine, as a first target region, a target region in which a trigger operation determined by the first determination unit is performed. . The terminal according to claim 8 or 9, wherein the first determination module
A first acquisition unit configured to acquire coordinate metadata of a trigger event occurrence point in the original reproduced image;
And a third determination unit configured to determine a target area to which the trigger event occurrence point belongs as a first target area according to the coordinate metadata acquired by the first acquisition unit. A terminal to feature. The terminal according to any one of claims 8 to 11, wherein the acquisition module
A second acquisition unit configured to acquire decoded data of an original reproduced image;
And a third determination unit configured to determine decoded data of the first video image according to the decoded data of the original reproduced image acquired by the second acquisition unit. Terminal to do. The terminal according to any one of claims 8 to 12, wherein the reproduction module draws the decoded data of the first video image in a specified reproduction window for reproduction in a zoom-in method. The terminal according to claim 1, wherein the designated reproduction window is larger than the first target area. The terminal according to any one of claims 8 to 13, wherein the reproduction module comprises
A display unit configured to display an independent playback window;
A terminal comprising: a playback unit configured to render decoded data of a first video image in a separate playback window displayed by the display unit for playback. In the video playback system
The terminal according to any one of claims 8 to 14,
A video capture system configured to capture a video image and generate a media stream by encoding the video image;
A server configured to obtain a media stream generated by the video capture system and provide the media stream to the terminal;
And a storage device configured to store the media stream acquired by the server.