CN114666477A - Video data processing method, device, equipment and storage medium - Google Patents
Video data processing method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN114666477A CN114666477A CN202210295235.2A CN202210295235A CN114666477A CN 114666477 A CN114666477 A CN 114666477A CN 202210295235 A CN202210295235 A CN 202210295235A CN 114666477 A CN114666477 A CN 114666477A
- Authority
- CN
- China
- Prior art keywords
- video stream
- video
- playing
- transmission channel
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
- H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
- H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/62—Control of parameters via user interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
Abstract
The invention mainly relates to the technical field of security protection, and provides a video data processing method, which comprises the following steps: receiving a video playing request of a video stream playing end; the video playing request carries video configuration information, and the video configuration information at least comprises a video stream acquisition end identifier and a video stream transmission channel identifier; acquiring an original video acquired by a video stream acquisition end corresponding to the video stream acquisition end identifier and processing the original video to obtain a target video stream corresponding to the video stream identifier; determining a target video stream transmission channel according to the video stream transmission channel identifier; and transmitting the target video stream to a video stream playing end through the corresponding target video stream transmission channel. The method can directly and rapidly configure and process the original video stream through the video display page of the video stream playing end, and then externally transmit and display the original video stream through the corresponding video stream transmission channel; therefore, video streams with different requirements can be displayed in the same video display page, and user experience is improved.
Description
Technical Field
The invention belongs to the technical field of security protection, and particularly relates to a video data processing method, a video data processing device, video data processing equipment and a storage medium.
Background
With the development of information technology, monitoring equipment is rapidly developing towards intellectualization and humanization, and is increasingly popularized in daily life. The video preview is frequently used by a user as a common function of the user and is one of important functions of monitoring equipment. The user can watch the pictures shot by the camera in real time through the video preview function. And the acquisition of the details is roughly realized by the following method:
1. the monitoring camera is matched with a zoom lens, and the picture is enlarged and reduced through the change of the focal length;
2. carrying out regional amplification configuration on the real-time picture through a corresponding software plug-in to realize the amplification and reduction of the picture;
3. the multiple cameras are extended by the monitoring camera, for example, a panoramic camera (used for acquiring a panoramic picture) is matched with more long-focus or zooming lens cameras, so that details and a panoramic image can be acquired at the same picture at the same time.
The conventional technical scheme is limited by hardware requirements, and the device depends on the combination of a plurality of cameras and lenses, so that the device is large in size and occupies more space. The popularization cannot be realized for common scenes or families; in the technology for realizing the multiple camera lenses, the real-time interface of the detail camera needs to be adjusted in real time by manually controlling functions such as a pan-tilt and the like by a user, and meanwhile, the situation that some panoramic areas cannot be covered may exist.
Data acquired by the detail camera and panoramic scene existence data are intersected by redundant data. And such devices transmit data, requiring more bandwidth to relieve data pressure on the transmission, risking network bandwidth in certain environments.
Disclosure of Invention
In view of the above-mentioned shortcomings in the prior art, the present invention provides a video data processing method, apparatus, device and storage medium to solve at least one of the deficiencies in the prior art.
To achieve the above and other related objects, the present invention provides a video data processing method, comprising:
receiving a video playing request of a video stream playing end; the video playing request carries video configuration information corresponding to the service requirement of a user, and the video configuration information is received through a video display page of a video stream playing end; the video configuration information at least comprises video stream acquisition end identifiers and video stream transmission channel identifiers, wherein different video stream acquisition end identifiers correspond to different video stream acquisition ends, and different video stream transmission channel identifiers correspond to different video stream transmission channels;
acquiring an original video acquired by a video stream acquisition end corresponding to the video stream acquisition end identifier, and processing the original video according to the video stream transmission channel identifier to obtain a target video stream corresponding to the video stream identifier;
determining a target video streaming transmission channel according to the video streaming transmission channel identifier;
and transmitting the target video stream to the video stream playing end through a corresponding target video stream transmission channel, and playing the target video stream on a video display page of the video stream playing end.
Optionally, the target video stream includes at least one of a first video stream and a second video stream, the first video stream has a lower compression rate than the second video stream, the amount of data is greater than the second video stream, the loss of detail data is less than the second video stream, and the target video stream transmission channel includes a first video stream transmission channel for transmitting the first video stream and a second video stream transmission channel for transmitting the second video stream; if it is determined that the target video streaming channel further includes a third video streaming channel according to the video streaming channel identifier, the method further includes:
creating a virtual channel as a third video stream transmission channel through the video stream processing terminal;
intercepting a third video stream from the original video stream, the first video stream, or the second video stream;
and transmitting the third video stream to the video stream playing end through the third video stream transmission channel.
Optionally, the step of obtaining the third video stream includes:
receiving an image interception command sent by a user through a video stream playing end, wherein the image interception command comprises: intercepting a time point;
determining a certain preview picture of the first video stream, the second video stream or the original video stream at the video stream playing end according to the interception time point;
defining an image capturing area in the certain preview picture;
intercepting a video stream at an interception time point with the image interception area from the first video stream, the second video stream or the original video stream;
and converting the intercepted video stream into a third video stream.
Optionally, the step of acquiring the third video stream further includes:
amplifying the image intercepting area to obtain a target area;
and converting the video stream corresponding to the target area into a third video stream.
Optionally, the enlarging the image capture area includes:
acquiring an amplification instruction in real time in a video playing state;
and calculating to obtain a target area according to the generation position of the amplification instruction.
Optionally, the converting the video stream corresponding to the target area into a third video stream includes:
converting the video stream corresponding to the target area into a third video stream by a data interpolation method; the data interpolation method comprises the following steps:
dividing the pixel points to be interpolated of the target area into a flat area and an edge area;
interpolating the pixel points to be interpolated in the flat area by adopting a linear image interpolation algorithm;
and interpolating the pixel points to be interpolated in the edge area by adopting a self-adaptive interpolation algorithm.
Optionally, the video display page includes a first display sub-page and a second display sub-page, where the first display sub-page is used to play a first video stream, a second video stream, or an original video stream, and the second display sub-page is used to play a third video stream.
To achieve the above and other related objects, the present invention provides a video data processing apparatus, comprising:
the video request receiving module is used for receiving a video playing request of a video stream playing end; the video playing request carries video configuration information corresponding to the service requirement of a user, and the video configuration information is received through a video display page of a video stream playing end; the video configuration information at least comprises video stream acquisition end identifiers and video stream transmission channel identifiers, wherein different video stream acquisition end identifiers correspond to different video stream acquisition ends, and different video stream transmission channel identifiers correspond to different video stream transmission channels;
the target video stream acquisition module is used for acquiring an original video acquired by a video stream acquisition end corresponding to the video stream acquisition end identifier, and processing the original video according to the video stream transmission channel identifier to obtain a target video stream corresponding to the video stream identifier;
a video streaming channel determining module, configured to determine a target video streaming channel according to the video streaming channel identifier;
and the video stream transmission module is used for transmitting the target video stream to the video stream playing end through a corresponding target video stream transmission channel, and playing the target video stream on a video display page of the video stream playing end.
To achieve the above and other related objects, the present invention provides a video data processing apparatus comprising:
a memory for storing a computer program;
a processor for executing the computer program stored by the memory to cause the apparatus to perform the method.
To achieve the above and other related objects, the present invention provides a storage medium storing a computer program which, when executed by a processor, performs the method.
As described above, the video data processing method, apparatus and storage medium of the present invention have the following advantages:
the invention discloses a video data processing method, which comprises the following steps: receiving a video playing request of a video stream playing end; the video playing request carries video configuration information corresponding to the service requirement of a user, and the video configuration information is received through a video display page of a video stream playing end; the video configuration information at least comprises video stream acquisition end identifiers and video stream transmission channel identifiers, wherein different video stream acquisition end identifiers correspond to different video stream acquisition ends, and different video stream transmission channel identifiers correspond to different video stream transmission channels; acquiring an original video acquired by a video stream acquisition end corresponding to the video stream acquisition end identifier, and processing the original video according to the video stream transmission channel identifier to obtain a target video stream corresponding to the video stream identifier; determining a target video streaming transmission channel according to the video streaming transmission channel identifier; and transmitting the target video stream to the video stream playing end through a corresponding target video stream transmission channel, and playing the target video stream on a video display page of the video stream playing end. The method can be used for rapidly configuring the original video stream directly through the video display page of the video stream playing end, the configuration information is directly sent to the video stream processing end, and the video stream processing end processes the original video stream through acquiring the corresponding video configuration information and transmits and displays the processed original video stream through the corresponding video stream transmission channel. Compared with the prior art, the scheme that the cloud deck is manually adjusted and controlled or multiple cameras are adopted for obtaining the video streams corresponding to different requirements is adopted, the video streams of different requirements can be displayed in the same video display page through simple configuration, and the user experience is improved.
Drawings
FIG. 1 is a schematic block diagram of a video data processing system according to an embodiment of the present invention;
FIG. 2 is a flow chart of a video data processing method according to an embodiment of the invention;
FIG. 3 is a flowchart illustrating a method for acquiring the third video stream according to an embodiment of the invention;
FIG. 4 is a schematic block diagram of a video data processing system according to an embodiment of the present invention;
FIG. 5 is a GUI diagram representation of a detail configuration web page in one embodiment of the present invention;
FIG. 6 is a GUI diagram representation of a detail configuration web page in one embodiment of the present invention;
FIG. 7 is a web preview representation in accordance with an embodiment of the present invention;
fig. 8 is a schematic block diagram of a video data processing apparatus according to an embodiment of the present invention.
Detailed Description
The following embodiments of the present invention are provided by way of specific examples, and other advantages and effects of the present invention will be readily apparent to those skilled in the art from the disclosure herein. The invention is capable of other and different embodiments and of being practiced or of being carried out in various ways, and its several details are capable of modification in various respects, all without departing from the spirit and scope of the present invention. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.
It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present invention, and the components related to the present invention are only shown in the drawings rather than drawn according to the number, shape and size of the components in actual implementation, and the type, quantity and proportion of the components in actual implementation may be changed freely, and the layout of the components may be more complicated.
As shown in fig. 1, fig. 1 is a video data processing system, which includes: the system comprises a video stream playing terminal 100, a video stream processing terminal 101 and at least one video stream collecting terminal 102. The video stream processing terminal 101 is connected to the video stream playing terminal 100 and the at least one video stream capturing terminal 102, and it should be noted that two video stream transmission channels are provided between the video stream processing terminal and the video stream playing terminal. The video data is processed by the video data processing system to complete the playing of the target video stream.
As shown in fig. 2, an embodiment of the present application provides a video data processing method, which may be applied to the video data processing system shown in fig. 1, and the method includes the following steps:
s200, receiving a video playing request of a video stream playing end; the video playing request carries video configuration information corresponding to the service requirement of a user, and the video configuration information is received through a video display page of a video stream playing end; the video configuration information at least comprises video stream acquisition end identifiers and video stream transmission channel identifiers, wherein different video stream acquisition end identifiers correspond to different video stream acquisition ends, and different video stream transmission channel identifiers correspond to different video stream transmission channels;
s201, acquiring an original video acquired by a video stream acquisition end corresponding to the video stream acquisition end identifier, and processing the original video according to the video stream transmission channel identifier to obtain a target video stream corresponding to the video stream identifier;
s202, determining a target video streaming transmission channel according to the video streaming transmission channel identifier;
s203, the target video stream is transmitted to the video stream playing end through the corresponding target video stream transmission channel, and the target video stream is played on the video display page of the video stream playing end.
The method can be used for rapidly configuring the original video stream directly through the video display page of the video stream playing end, the configuration information is directly sent to the video stream processing end, and the video stream processing end processes the original video stream through acquiring the corresponding video configuration information and transmits and displays the processed original video stream through the corresponding video stream transmission channel. Compared with the prior art, the scheme that the cloud deck is manually adjusted and controlled or the multiple cameras are adopted for obtaining the video streams corresponding to different requirements is adopted, the video streams corresponding to different requirements can be displayed on the same video display page through simple configuration, and the user experience is improved.
The above steps will be described in detail below
In step S200, a video playing request from a video stream playing end is received; the video playing request carries video configuration information corresponding to the service requirement of a user, and the video configuration information is received through a video display page of a video stream playing end; the video configuration information at least comprises video stream acquisition end identifiers and video stream transmission channel identifiers, different video stream acquisition end identifiers correspond to different video stream acquisition ends, and different video stream transmission channel identifiers correspond to different video stream transmission channels. It should be noted that the video playing request of the video stream playing end is received through the video stream processing end. The video stream acquisition end identifier is used for indicating a specific video stream acquisition end, and the specific video stream acquisition end can be found through the video stream acquisition end identifier. For example, the at least one video stream capturing end includes a video stream capturing end 1, a video stream capturing end 2, and a video stream capturing end 3. 1-N are the identifications of the N video stream acquisition ends respectively, and the corresponding video stream acquisition end can be found through the corresponding video stream acquisition end identification. It should be noted that the video streams with different identifications have different attributes; the properties of the video stream at least comprise compression rate, data volume and detail data loss; while different video streams have different compression rates, data volumes, and loss of detail data. The video stream transmission channel end identifier is used for indicating a specific video stream transmission channel, and the specific video stream transmission channel can be found through the video stream transmission channel identifier. For example, the video streaming channels include a video streaming channel 1, a video streaming channel 2, and a video streaming channel 3. 1-N are the identifications of the N video stream transmission channels respectively, and the corresponding video stream transmission channel can be found out through the corresponding video stream transmission channel identification. It should be noted that the video streams transmitted by the video stream transmission channels with different identifications have different attributes.
Specifically, the video stream playing terminal 100 sends a video playing request to the video stream processing terminal 101. The video playing request carries video configuration information corresponding to the service requirement of the user, and the video configuration information is received through a video display page of a video stream playing end. The video stream playing end can be equipment for browsing video images logged by a user; for example, the video stream playing end may be a central management PC (Personal Computer) server, an intelligent means, a Computer, a tablet, an intelligent platform, a Web end, and the like, and is configured to acquire and play a video stream acquired by a video stream acquisition end arranged in a monitoring scene, so that a user can browse the video stream.
The video stream playing end is provided with a video display page, and the video display page is used for displaying corresponding videos and also can receive video configuration information corresponding to the service requirements of the user. The video display page is provided with a plurality of configuration frames, and a user can input corresponding video configuration information in the corresponding configuration frames according to business requirements. The video configuration information at least comprises a video stream acquisition end identifier and a video stream transmission channel identifier.
It should be noted that the target video stream includes at least one of a first video stream and a second video stream, the first video stream has a lower compression rate than the second video stream, a larger data amount than the second video stream, and a smaller loss of detail data than the second video stream, and the target video stream transmission channel includes a first video stream transmission channel for transmitting the first video stream and a second video stream transmission channel for transmitting the second video stream. In the embodiment, since the compression ratio of the first video stream is low and contains richer detail data, the second video stream has a higher compression ratio, and the detail information is less compared with that of the first channel, but the data size is better, so that the network transmission is facilitated.
In step S201, acquiring an original video acquired by a video stream acquisition end corresponding to the video stream acquisition end identifier, and processing the original video according to the video stream transmission channel identifier to obtain a target video stream corresponding to the video stream identifier;
specifically, the video stream processing terminal 101 receives the video playing request, acquires an original video acquired by the video stream acquisition terminal corresponding to the video stream acquisition terminal identifier according to the video stream acquisition terminal identifier in the video configuration information, and processes the original video according to the video stream transmission channel identifier to obtain a target video stream.
It should be noted that the video stream processing terminal may be connected to a plurality of video stream capturing terminals, and may perform data communication with each video stream capturing terminal. For example, 8 video stream capture ends may be added to the video stream processing end, or 10 video stream capture ends or other numbers of video stream capture ends may also be added to the video stream processing end, so as to implement data communication between the video stream processing end and each added video stream capture end, where each video stream capture end has an identifier, and each identifier is different, and therefore, the corresponding video stream capture end may be found through the identifier of the video stream capture end. Specifically, the number of added video stream acquisition terminals may be determined based on the self-configuration and the service requirements of the video stream processing terminal. Each video stream collecting end can collect the video stream corresponding to the monitoring scene and send the video stream to the video stream processing end, and the video stream processing end can store the video stream collected by each video stream collecting end and process the video stream collected by each video stream collecting end according to the video stream transmission channel identification to obtain the target video stream.
If the video stream transmission channel determined by the video stream transmission channel identifier is the first video stream transmission channel, processing the original video stream according to the purpose of the first video stream transmission channel for transmitting the first video stream, so that the processed video stream has a low compression ratio and contains rich detailed data; if the video stream transmission channel determined by the video stream transmission channel identifier is the second video stream transmission channel, the original video stream is processed according to the purpose of the second video stream transmission channel for transmitting the second video stream, so that the processed video stream has a high compression ratio and contains less detailed data.
In step S203, the target video stream is transmitted to the video stream playing end through the corresponding target video stream transmission channel, and the target video stream is played on the video display page of the video stream playing end.
The target video stream can be transmitted from the video stream acquisition end to the video stream processing end through the target video stream transmission channel based on the streaming media technology, and then transmitted from the video stream processing end to the video stream playing end based on the streaming media technology.
In an embodiment, if it is determined that the target video streaming channel further includes a third video streaming channel according to the video streaming channel identifier, the method further includes:
creating a virtual channel as a third video stream transmission channel through the video stream processing terminal;
intercepting a third video stream from the original video stream, the first video stream, or the second video stream;
and transmitting the third video stream to the video stream playing end through the third video stream transmission channel.
Specifically, since there are two video streaming channels between the video stream processing end and the video stream playing end in the original video data processing system, i.e. the first video streaming channel and the second video streaming channel in this embodiment, one virtual channel needs to be created as the third video streaming channel for transmitting the third video stream.
The video stream processing end judges whether a virtual channel needs to be created or not according to the video configuration information, if so, the video stream processing end creates a virtual-zoom-channel, processes and converts partial data of the original video stream, the first video stream or the second video stream into virtual channel data, and transmits the virtual-zoom-channel to the virtual channel through recoding and packaging. And the video stream processing end transfers the virtual channel data, namely the third video stream, to the video stream playing end through the virtual channel.
In one embodiment, as shown in fig. 3, the step of acquiring the third video stream includes:
s300, receiving an image interception command sent by a user through a video stream playing end, wherein the image interception command comprises: intercepting a time point;
s301, determining a certain preview picture of the first video stream, the second video stream or the original video stream at the video stream playing end according to the interception time point;
s302, an image capturing area is defined in a certain preview picture;
s303, intercepting a video stream at an interception time point from the first video stream, the second video stream, or the original video stream with the image interception region;
s304, converting the intercepted video stream into a third video stream.
In this embodiment, when the target video stream includes the third video stream, the user may intercept a partial picture area of the video presentation page at the video stream playing end according to a service requirement, and does not need to intercept the video picture of the entire video presentation page, the user may define an image interception area in the video presentation page at the video stream playing end, and then the picture outside the image interception area is not intercepted, and at this time, the user may also carry the image interception area defined by the user from the playing interface in the video interception command. The image capture command includes capture time points, i.e., the time when the captured video starts and the time when the captured video ends, and the capture time points may be considered as a time period, which may be a certain period of time in the past specified by the user, or may be real-time video monitoring. After the time point is determined, a corresponding video frame, i.e. a certain preview picture, will exist at the time point accordingly. At this time, an image capture area may be defined in the preview screen, and the image capture area may be configured in a video configuration frame of the video presentation page, and a coordinate position of the image capture area may be input in the video configuration frame, so as to determine the image capture area. Of course, a frame may be determined in the preview screen by dragging the mouse, and the frame may be used as the image capture area. If the video stream playing end has the function of a touch screen, the image capturing area can be determined in a finger sliding mode.
During the process of intercepting the third video stream, single-frame images of the target area can be sequentially extracted; creating a video playing window in a video playing area; and amplifying the single-frame image of the target area to the size of a video playing window, and sequentially displaying the single-frame image in the video playing window.
In an embodiment, if the details of the image capture area need to be played, the image capture area may be enlarged, and therefore, the step of acquiring the third video stream further includes:
amplifying the image intercepting area to obtain a target area;
and converting the video stream corresponding to the target area into a third video stream.
In an embodiment, the enlarging the image capture area includes:
acquiring an amplification instruction in real time in a video playing state;
and calculating to obtain a target area according to the generation position of the amplification instruction.
In this embodiment, taking an image capture instruction as an example of a touch instruction, the method for magnifying an image capture area includes:
acquiring a touch instruction in real time in a video playing state; the touch instruction is selectable, namely a touch gesture with a starting point of two-point touch, the motion tracks of the two touch points are basically straight lines, and the motion directions of the two touch points are basically opposite.
And calculating to obtain a target area according to the occurrence position of the touch instruction.
In an embodiment, the converting the video stream corresponding to the target area into a third video stream includes:
converting the video stream corresponding to the target area into a third video stream by a data interpolation method; the data interpolation method comprises the following steps:
dividing the pixel points to be interpolated of the target area into a flat area and an edge area;
interpolating the pixel points to be interpolated in the flat area by adopting a linear image interpolation algorithm;
and interpolating the pixel points to be interpolated in the edge area by adopting a self-adaptive interpolation algorithm.
Specifically, a 3 × 3 window is selected first, a difference between pixel values in a horizontal direction, a vertical direction, a 45 ° direction, or a 135 ° direction is calculated, and if the difference is smaller than a preset threshold value, the window is divided into a flat area, otherwise, the window is divided into an edge area; then, linear interpolation is adopted for pixel points in the flat area; and after the pixel points in the flat area complete interpolation calculation, performing edge self-adaptive interpolation on the pixel points in the edge area. The linear image interpolation algorithm may be a linear image interpolation algorithm, and the adaptive interpolation algorithm may be a covariance-based adaptive interpolation algorithm.
And obtaining a third video stream with the target resolution after interpolation processing.
In an embodiment, the video display page includes a first display sub-page and a second display sub-page, the first display sub-page is used for playing a first video stream, a second video stream or an original video stream, and the second display sub-page is used for playing a third video stream.
As shown in fig. 4, an embodiment of the present application further provides a video data processing system, which is used for a security device, and includes a processor, application software, and a service end, where the service end includes a platform end and/or a web end; a first video streaming channel and a second video streaming channel are constructed in the processor and are respectively used for transmitting a first video stream and a second video stream, namely the first video channel stream and the second video channel stream; the first channel video stream is a high-quality video stream, which is compressed to a low level and contains richer detail data. The video stream of the first channel adopts a higher compression ratio, the detail information of the video stream is less compared with that of the first channel, but the data size of the video stream is more optimal, and the video stream is more beneficial to network transmission. The first video stream and the second video stream are obtained by video coding through the processor.
Of course, if a video stream of a certain area in the first video stream, the second video stream, or the original video stream is needed, the corresponding video stream is intercepted from the first video stream, the second video stream, or the original video stream, and simultaneously the processor constructs a virtual channel as a third video stream transmission channel through which the third video stream is transmitted.
In fig. 4, a processor encodes video data captured by a video capture device (camera), and a detail region video module in the processor acquires a third video stream and then creates a virtual channel for transmitting the third video stream (detail video stream data). The streaming media module is an audio and video data management module of the security equipment, encapsulates video data according to a protocol to a certain degree, and provides video data sources for other modules such as a platform access module and the like. The Web and the platform can subscribe the first video stream, the second video stream and the third video stream through the streaming media module to acquire corresponding video data.
In fig. 5, the web end may provide a configuration page of a detail mode, and a user clicks the page to perform corresponding configuration, activate a detail area function, and whether to enable a configuration operation such as zooming. Referring specifically to the GUI diagram illustration of the detail configuration web page shown in FIG. 5. In one embodiment, the configuration page of the web end includes configuration buttons such as enable, zoom in, draw area, and the like. The user may draw the size of the target area by means of a mouse or the like, and the frame size of the area has a default size of 100 x 100. And configuring a preview interface set for the area by a lower frame, wherein the fixed size is 400 x 400.
The application software issues the user configuration determined on the configuration page to the processor, and according to the configuration area in the issued user configuration as a position coordinate, area cutting, data interpolation and the like are carried out on the original data stream to obtain and convert the original data stream into a third video stream, and then packaging is carried out according to the corresponding video coding format, and then the processor creates a third video stream transmission channel, namely a virtual channel, and transmits data to the application software.
The method comprises the steps that a streaming media module of application software subscribes virtual channel data to a processor module; when the video signal exists, the processor transmits the detail video stream data (third video stream) of the real-time video to the streaming media module; the streaming media module transmits the data to the web end again, and the web end displays the preview configuration effect in real time; at this time, the user can see more clear detail effects with larger sizes on the web page. Referring specifically to the GUI diagram illustration of the detail configuration web page shown in FIG. 6. If the user turns on the detail function, two video interfaces, one panorama and one detail, can be seen at the same time on the preview interface.
Of course, the web end may pull the data of the first video channel stream and the data of the third video channel stream (third video stream) to the streaming media module at the same time, and the user may view the panoramic detailed picture at the preview interface at the same time. With particular reference to the web preview diagram illustration shown in fig. 7.
Certainly, the platform may subscribe the virtual channel stream data to the streaming media module through the SDK, and the streaming media module pushes the virtual channel stream data to the platform, so that the platform displays the virtual channel video stream. The platform end can also subscribe the real-time stream (second video stream) and the virtual channel stream (third video stream) to the streaming media module through the SDK, and the platform can simultaneously display the virtual channel video stream and the real-time stream.
In the prior art, to acquire a panorama and a detail stream (panorama + detail), it is necessary to adjust and acquire target area data by switching a video channel and then by using a pan-tilt and the like. In this embodiment, the user may directly perform fast configuration of the target area on the original screen through the interface of the web end or the platform end. The configuration data is directly sent to the processor, the processor extracts and processes the original data by acquiring corresponding information such as position coordinates and the like, and then the original data is displayed externally through the virtual channel, and if the user does not need to control the closing through software page configuration.
Also, for some scenarios, devices typically employ high pixels. The video of the user target area is effectively extracted by the processor and packaged into a virtual channel for transmission, and the channel data is small in volume compared with the original data. With a dedicated regional data channel (the third video streaming channel), the user can configure the data more efficiently, with various combinations reducing network bandwidth pressure.
As shown in fig. 8, an embodiment of the present application provides a video data processing apparatus, including:
a video request receiving module 800, configured to receive a video playing request of a video stream playing end; the video playing request carries video configuration information corresponding to the service requirement of a user, and the video configuration information is received through a video display page of a video stream playing end; the video configuration information at least comprises video stream acquisition end identifiers and video stream transmission channel identifiers, wherein different video stream acquisition end identifiers correspond to different video stream acquisition ends, and different video stream transmission channel identifiers correspond to different video stream transmission channels;
a target video stream obtaining module 801, configured to obtain an original video collected by a video stream collecting end corresponding to the video stream collecting end identifier, and process the original video according to the video stream transmission channel identifier to obtain a target video stream corresponding to the video stream identifier;
a video streaming channel determining module 802, configured to determine a target video streaming channel according to the video streaming channel identifier;
a video stream transmission module 803, configured to transmit the target video stream to the video stream playing end through a corresponding target video stream transmission channel, and play the target video stream on a video display page of the video stream playing end.
It should be noted that, because the embodiment of the apparatus portion and the embodiment of the method portion correspond to each other, please refer to the description of the embodiment of the method portion for the content of the embodiment of the apparatus portion, which is not repeated here.
The present invention also provides a storage medium storing a computer program which, when executed by a processor, performs the aforementioned video data processing method.
The present invention also provides an apparatus comprising:
a memory for storing a computer program;
a processor for executing the computer program stored by the memory to cause the apparatus to perform the aforementioned video data processing method.
The Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory may be an internal storage unit or an external storage device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital Card (SD), a Flash memory Card (Flash Card), and the like. Further, the memory may also include both an internal storage unit and an external storage device. The memory is used for storing the computer program and other programs and data. The memory may also be used to temporarily store data that has been output or is to be output.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-mentioned division of the functional units and modules is illustrated, and in practical applications, the above-mentioned function distribution may be performed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-mentioned functions. Each functional unit and module in the embodiments may be integrated in one processing unit, or each unit may exist alone physically, or two or more units are integrated in one unit, and the integrated unit may be implemented in a form of hardware, or in a form of software functional unit. In addition, specific names of the functional units and modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working processes of the units and modules in the system may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other ways. For example, the above-described embodiments of the apparatus/terminal device are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated modules/units, if implemented in the form of software functional units and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer readable medium may comprise any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a Random Access Memory (RAM), an electrical carrier signal, a telecommunications signal, a software distribution medium, etc.
The foregoing embodiments are merely illustrative of the principles and utilities of the present invention and are not intended to limit the invention. Any person skilled in the art can modify or change the above-mentioned embodiments without departing from the spirit and scope of the present invention. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical spirit of the present invention be covered by the claims of the present invention.
Claims (10)
1. A method of video data processing, the method comprising:
receiving a video playing request of a video stream playing end; the video playing request carries video configuration information corresponding to the service requirement of a user, and the video configuration information is received through a video display page of a video stream playing end; the video configuration information at least comprises video stream acquisition end identifiers and video stream transmission channel identifiers, wherein different video stream acquisition end identifiers correspond to different video stream acquisition ends, and different video stream transmission channel identifiers correspond to different video stream transmission channels;
acquiring an original video acquired by a video stream acquisition end corresponding to the video stream acquisition end identifier, and processing the original video according to the video stream transmission channel identifier to obtain a target video stream corresponding to the video stream identifier;
determining a target video streaming transmission channel according to the video streaming transmission channel identifier;
and transmitting the target video stream to the video stream playing end through a corresponding target video stream transmission channel, and playing the target video stream on a video display page of the video stream playing end.
2. The video data processing method according to claim 1, wherein the target video stream includes at least one of a first video stream and a second video stream, the first video stream has a lower compression rate than the second video stream, has a larger data amount than the second video stream, and has a smaller loss of detail data than the second video stream, and the target video stream transmission channel includes a first video stream transmission channel for transmitting the first video stream, a second video stream transmission channel for transmitting the second video stream; if it is determined that the target video streaming channel further includes a third video streaming channel according to the video streaming channel identifier, the method further includes:
creating a virtual channel as a third video stream transmission channel through the video stream processing terminal;
intercepting a third video stream from the original video stream, the first video stream, or the second video stream;
and transmitting the third video stream to the video stream playing end through the third video stream transmission channel.
3. The video data processing method according to claim 2, wherein the step of obtaining the third video stream comprises:
receiving an image interception command sent by a user through a video stream playing end, wherein the image interception command comprises: intercepting a time point;
determining a certain preview picture of the first video stream, the second video stream or the original video stream at the video stream playing end according to the interception time point;
defining an image capturing area in the certain preview picture;
intercepting a video stream at an interception time point with the image interception area from the first video stream, the second video stream or the original video stream;
and converting the intercepted video stream into a third video stream.
4. The video data processing method according to claim 3, wherein the step of obtaining the third video stream further comprises:
amplifying the image intercepting area to obtain a target area;
and converting the video stream corresponding to the target area into a third video stream.
5. The method according to claim 4, wherein the enlarging the image capture area comprises:
acquiring an amplification instruction in real time in a video playing state;
and calculating to obtain a target area according to the generation position of the amplification instruction.
6. The method according to claim 4, wherein said converting the video stream corresponding to the target area into a third video stream comprises:
converting the video stream corresponding to the target area into a third video stream by a data interpolation method; the data interpolation method comprises the following steps:
dividing the pixel points to be interpolated of the target area into a flat area and an edge area;
interpolating the pixel points to be interpolated in the flat area by adopting a linear image interpolation algorithm;
and interpolating the pixel points to be interpolated in the edge area by adopting a self-adaptive interpolation algorithm.
7. The video data processing method according to claim 4, wherein the video presentation page comprises a first presentation sub-page and a second presentation sub-page, the first presentation sub-page is used for playing a first video stream, a second video stream or an original video stream, and the second presentation sub-page is used for playing a third video stream.
8. A video data processing apparatus, characterized in that the apparatus comprises:
the video request receiving module is used for receiving a video playing request of a video stream playing end; the video playing request carries video configuration information corresponding to the service requirement of a user, and the video configuration information is received through a video display page of a video stream playing end; the video configuration information at least comprises video stream acquisition end identifiers and video stream transmission channel identifiers, wherein different video stream acquisition end identifiers correspond to different video stream acquisition ends, and different video stream transmission channel identifiers correspond to different video stream transmission channels;
the target video stream acquisition module is used for acquiring an original video acquired by a video stream acquisition end corresponding to the video stream acquisition end identifier, and processing the original video according to the video stream transmission channel identifier to obtain a target video stream corresponding to the video stream identifier;
a video streaming channel determining module, configured to determine a target video streaming channel according to the video streaming channel identifier;
and the video stream transmission module is used for transmitting the target video stream to the video stream playing end through a corresponding target video stream transmission channel, and playing the target video stream on a video display page of the video stream playing end.
9. A video data processing apparatus, characterized by comprising:
a memory for storing a computer program;
a processor for executing the computer program stored by the memory to cause the apparatus to perform the video data processing method of any one of claims 1 to 7.
10. A storage medium storing a computer program, characterized in that the computer program, when executed by a processor, performs the video data processing method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210295235.2A CN114666477B (en) | 2022-03-24 | 2022-03-24 | Video data processing method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210295235.2A CN114666477B (en) | 2022-03-24 | 2022-03-24 | Video data processing method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114666477A true CN114666477A (en) | 2022-06-24 |
| CN114666477B CN114666477B (en) | 2023-10-13 |
Family
ID=82030687
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210295235.2A Active CN114666477B (en) | 2022-03-24 | 2022-03-24 | Video data processing method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114666477B (en) |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040161225A1 (en) * | 2003-02-19 | 2004-08-19 | Dawson Thomas P. | Method and system for preventing the unauthorized copying of video content |
| US20100239222A1 (en) * | 2009-03-20 | 2010-09-23 | International Business Machines Corporation | Digital video recorder broadcast overlays |
| CN103414883A (en) * | 2013-08-20 | 2013-11-27 | 浙江宇视科技有限公司 | Customized service method and customized playback device of video streams |
| CN106792092A (en) * | 2016-12-19 | 2017-05-31 | 广州虎牙信息科技有限公司 | Live video flow point mirror display control method and its corresponding device |
| CN110139061A (en) * | 2019-04-04 | 2019-08-16 | 视联动力信息技术股份有限公司 | A kind of video flowing split screen methods of exhibiting and device |
| CN110944186A (en) * | 2019-12-10 | 2020-03-31 | 杭州当虹科技股份有限公司 | High-quality viewing method for local area of video |
| CN111565298A (en) * | 2020-04-30 | 2020-08-21 | 腾讯科技（深圳）有限公司 | Video processing method, device, equipment and computer readable storage medium |
| CN112565693A (en) * | 2020-11-30 | 2021-03-26 | 广东荣文科技集团有限公司 | Method, system and equipment for monitoring video on demand |
| CN113259716A (en) * | 2021-07-07 | 2021-08-13 | 摩尔线程智能科技(北京)有限责任公司 | Video issuing method, video acquiring method, server, terminal and system |
| CN113301388A (en) * | 2021-05-20 | 2021-08-24 | 杭州海康威视数字技术股份有限公司 | Video stream processing system, device and method |
| CN114125400A (en) * | 2021-12-17 | 2022-03-01 | 浙江大华技术股份有限公司 | Multi-channel video analysis method and device |
| US20230156144A1 (en) * | 2020-04-22 | 2023-05-18 | Huawei Technologies Co., Ltd. | Framing Method for Multi-Channel Video Recording, Graphical User Interface, and Electronic Device |
-
2022
- 2022-03-24 CN CN202210295235.2A patent/CN114666477B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040161225A1 (en) * | 2003-02-19 | 2004-08-19 | Dawson Thomas P. | Method and system for preventing the unauthorized copying of video content |
| US20100239222A1 (en) * | 2009-03-20 | 2010-09-23 | International Business Machines Corporation | Digital video recorder broadcast overlays |
| CN103414883A (en) * | 2013-08-20 | 2013-11-27 | 浙江宇视科技有限公司 | Customized service method and customized playback device of video streams |
| CN106792092A (en) * | 2016-12-19 | 2017-05-31 | 广州虎牙信息科技有限公司 | Live video flow point mirror display control method and its corresponding device |
| CN110139061A (en) * | 2019-04-04 | 2019-08-16 | 视联动力信息技术股份有限公司 | A kind of video flowing split screen methods of exhibiting and device |
| CN110944186A (en) * | 2019-12-10 | 2020-03-31 | 杭州当虹科技股份有限公司 | High-quality viewing method for local area of video |
| US20230156144A1 (en) * | 2020-04-22 | 2023-05-18 | Huawei Technologies Co., Ltd. | Framing Method for Multi-Channel Video Recording, Graphical User Interface, and Electronic Device |
| CN111565298A (en) * | 2020-04-30 | 2020-08-21 | 腾讯科技（深圳）有限公司 | Video processing method, device, equipment and computer readable storage medium |
| CN112565693A (en) * | 2020-11-30 | 2021-03-26 | 广东荣文科技集团有限公司 | Method, system and equipment for monitoring video on demand |
| CN113301388A (en) * | 2021-05-20 | 2021-08-24 | 杭州海康威视数字技术股份有限公司 | Video stream processing system, device and method |
| CN113259716A (en) * | 2021-07-07 | 2021-08-13 | 摩尔线程智能科技(北京)有限责任公司 | Video issuing method, video acquiring method, server, terminal and system |
| CN114125400A (en) * | 2021-12-17 | 2022-03-01 | 浙江大华技术股份有限公司 | Multi-channel video analysis method and device |
Non-Patent Citations (1)
| Title |
|---|
| 周岩;高杨;刘佳;李俊艳;蔡林飞;梁正恺;: "DVI输出图像选区截取的FPGA实现", 电视技术, no. 05 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114666477B (en) | 2023-10-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2021175055A1 (en) | Video processing method and related device | |
| US6380968B1 (en) | Method and apparatus for controlling a remote video camera in a video conferencing system | |
| US11240403B2 (en) | Compensation for delay in PTZ camera system | |
| CN107040794A (en) | Video broadcasting method, server, virtual reality device and panoramic virtual reality play system | |
| CN102801963B (en) | Electronic PTZ method and device based on high-definition digital camera monitoring | |
| US10574933B2 (en) | System and method for converting live action alpha-numeric text to re-rendered and embedded pixel information for video overlay | |
| CN111970524B (en) | Control method, device, system, equipment and medium for interactive live broadcast and microphone connection | |
| CN113115110B (en) | Video synthesis method and device, storage medium and electronic equipment | |
| EP2544174A1 (en) | Pinch-to-zoom video apparatus and associated method | |
| CN105578129A (en) | Multipath multi-image video splicing device | |
| CN105554430A (en) | Video call method, system and device | |
| US10791382B2 (en) | Electronic device and method for sharing streaming video | |
| CN107580228B (en) | Monitoring video processing method, device and equipment | |
| JP2019149785A (en) | Video conversion device and program | |
| CN103716528A (en) | PTZ camera remote control system and method based on touch terminal | |
| CN114666477B (en) | Video data processing method, device, equipment and storage medium | |
| CN107318021B (en) | Data processing method and system for remote display | |
| CN202818497U (en) | Electronic PTZ device capable of monitoring based on high-definition digital camera | |
| CN112887653B (en) | Information processing method and information processing device | |
| CN106027991B (en) | Medical video image live broadcast all-in-one | |
| CN107318020B (en) | Data processing method and system for remote display | |
| CN113837937A (en) | Multimedia processing chip, electronic equipment image fusion method and image cutting method | |
| CN115134633B (en) | Remote video method and related device | |
| WO2022199594A1 (en) | Method for performing remote video, and related device | |
| KR20200091196A (en) | Method for augmented reality contents data optimization using user feedback |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |