CN114666477B - Video data processing method, device, equipment and storage medium - Google Patents
Video data processing method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN114666477B CN114666477B CN202210295235.2A CN202210295235A CN114666477B CN 114666477 B CN114666477 B CN 114666477B CN 202210295235 A CN202210295235 A CN 202210295235A CN 114666477 B CN114666477 B CN 114666477B
- Authority
- CN
- China
- Prior art keywords
- video stream
- video
- transmission channel
- target
- playing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/63—Control of cameras or camera modules by using electronic viewfinders
- H04N23/631—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
- H04N23/632—Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/62—Control of parameters via user interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
Abstract
The invention mainly relates to the technical field of security protection, and provides a video data processing method, which comprises the following steps: receiving a video playing request of a video stream playing end; the video playing request carries video configuration information, and the video configuration information at least comprises a video stream acquisition end identifier and a video stream transmission channel identifier; acquiring an original video acquired by a video stream acquisition end corresponding to the video stream acquisition end identifier, and processing the original video to obtain a target video stream corresponding to the video stream identifier; determining a target video streaming transmission channel according to the video streaming transmission channel identification; and transmitting the target video stream to a video stream playing end through a corresponding target video stream transmission channel. The invention can directly and rapidly configure and process the original video stream through the video display page of the video stream playing end, and then externally transmit and display the original video stream through the corresponding video stream transmission channel; therefore, video streams with different requirements can be displayed in the same video display page, and the user experience is improved.
Description
Technical Field
The invention belongs to the technical field of security protection, and particularly relates to a video data processing method, device, equipment and storage medium.
Background
Along with the development of information technology, the monitoring equipment also rapidly develops towards intelligence and humanization, and is also becoming more and more popular in daily life. Video previewing is often used by users as a common function of the users, and is one of important functions of the monitoring device. The user can watch the picture shot by the camera in real time through the video preview function. And for the acquisition of details, the method is realized by the following steps:
1. the monitoring camera is matched with the zoom lens, and the picture is enlarged and reduced through the change of the focal length;
2. the real-time picture is subjected to area amplification configuration through a corresponding software plug-in, so that the picture is amplified and reduced;
3. the monitoring camera is used for expanding a plurality of cameras, for example, a panoramic camera (used for acquiring panoramic pictures) is matched with a plurality of lens cameras with long focal length or zooming, so that detail and panoramic pictures can be acquired simultaneously on the same picture.
The conventional technical scheme is limited by hardware requirements, and depends on the combination of a plurality of cameras and lenses, so that the equipment is large in size and occupies more space. The popularization cannot be realized for common scenes or families; in the technology of realizing the plurality of camera lenses, the real-time interface of the detail camera needs to be adjusted in real time by manually controlling functions such as a cradle head and the like by a user, and meanwhile, the situation that certain panoramic areas cannot be covered possibly exists.
Redundant data is intersected between the data acquired by the detail camera and the panoramic scene existing data. And such devices transfer data requiring more bandwidth to relieve the data pressure on the transfer, there is a risk of network bandwidth in some circumstances.
Disclosure of Invention
In view of the above-mentioned shortcomings of the prior art, the present invention provides a video data processing method, apparatus, device and storage medium, which solve at least one of the shortcomings of the prior art.
To achieve the above and other related objects, the present invention provides a video data processing method, comprising:
receiving a video playing request of a video stream playing end; the video playing request carries video configuration information corresponding to the service requirement of a user, and the video configuration information is received through a video display page of a video stream playing end; the video configuration information at least comprises video stream acquisition end identifiers and video stream transmission channel identifiers, wherein different video stream acquisition end identifiers correspond to different video stream acquisition ends, and different video stream transmission channel identifiers correspond to different video stream transmission channels;
acquiring an original video acquired by a video stream acquisition end corresponding to the video stream acquisition end identifier, and processing the original video according to the video stream transmission channel identifier to obtain a target video stream corresponding to the video stream identifier;
Determining a target video streaming channel according to the video streaming channel identification;
and transmitting the target video stream to the video stream playing end through a corresponding target video stream transmission channel, and playing the target video stream on a video display page of the video stream playing end.
Optionally, the target video stream includes at least one of a first video stream and a second video stream, the compression rate of the first video stream is lower than that of the second video stream, the data volume is larger than that of the second video stream, and the detail data loss is smaller than that of the second video stream, and the target video stream transmission channel includes a first video stream transmission channel for transmitting the first video stream and a second video stream transmission channel for transmitting the second video stream; if it is determined that the target video streaming channel further includes a third video streaming channel according to the video streaming channel identification, the method further includes:
creating a virtual channel as a third video stream transmission channel through the video stream processing end;
intercepting a third video stream from the original video stream, the first video stream or the second video stream;
and transmitting the third video stream to the video stream playing end through the third video stream transmission channel.
Optionally, the step of obtaining the third video stream includes:
receiving an image interception command sent by a user through a video stream playing end, wherein the image interception command comprises the following steps: intercepting a time point;
determining a certain preview picture of the first video stream, the second video stream or the original video stream at the video stream playing end according to the intercepting time point;
an image interception area is defined in the certain preview picture;
intercepting an intercepted video stream from the first video stream, the second video stream or the original video stream at an intercepting time point with the image intercepting region;
and converting the intercepted video stream into a third video stream.
Optionally, the step of obtaining the third video stream further includes:
amplifying the image interception area to obtain a target area;
and converting the video stream corresponding to the target area into a third video stream.
Optionally, the amplifying the image capturing area includes:
acquiring an amplifying instruction in real time in a video playing state;
and calculating to obtain a target area according to the occurrence position of the amplifying instruction.
Optionally, the converting the video stream corresponding to the target area into the third video stream includes:
Converting the video stream corresponding to the target area into a third video stream by a data interpolation method; the data interpolation method comprises the following steps:
dividing the pixel points to be interpolated of the target area into a flat area and an edge area;
interpolation is carried out on the pixel points to be interpolated, which are positioned in the flat area, by adopting a linear image interpolation algorithm;
and interpolating the pixel points to be interpolated in the edge area by adopting an adaptive interpolation algorithm.
Optionally, the video presentation page includes a first presentation sub-page and a second presentation sub-page, where the first presentation sub-page is used to play a first video stream, a second video stream, or an original video stream, and the second presentation sub-page is used to play a third video stream.
To achieve the above and other related objects, the present invention provides a video data processing apparatus comprising:
the video request receiving module is used for receiving a video playing request of the video stream playing end; the video playing request carries video configuration information corresponding to the service requirement of a user, and the video configuration information is received through a video display page of a video stream playing end; the video configuration information at least comprises video stream acquisition end identifiers and video stream transmission channel identifiers, wherein different video stream acquisition end identifiers correspond to different video stream acquisition ends, and different video stream transmission channel identifiers correspond to different video stream transmission channels;
The target video stream acquisition module is used for acquiring an original video acquired by the video stream acquisition end corresponding to the video stream acquisition end identifier, and processing the original video according to the video stream transmission channel identifier to obtain a target video stream corresponding to the video stream identifier;
the video stream transmission channel determining module is used for determining a target video stream transmission channel according to the video stream transmission channel identification;
and the video stream transmission module is used for transmitting the target video stream to the video stream playing end through a corresponding target video stream transmission channel, and playing the target video stream on a video display page of the video stream playing end.
To achieve the above and other related objects, the present invention provides a video data processing apparatus comprising:
a memory for storing a computer program;
and a processor for executing the computer program stored in the memory to cause the device to perform the method.
To achieve the above and other related objects, the present invention provides a storage medium storing a computer program which, when executed by a processor, performs the method.
As described above, the video data processing method, apparatus and storage medium of the present invention have the following beneficial effects:
The invention relates to a video data processing method, which comprises the following steps: receiving a video playing request of a video stream playing end; the video playing request carries video configuration information corresponding to the service requirement of a user, and the video configuration information is received through a video display page of a video stream playing end; the video configuration information at least comprises video stream acquisition end identifiers and video stream transmission channel identifiers, wherein different video stream acquisition end identifiers correspond to different video stream acquisition ends, and different video stream transmission channel identifiers correspond to different video stream transmission channels; acquiring an original video acquired by a video stream acquisition end corresponding to the video stream acquisition end identifier, and processing the original video according to the video stream transmission channel identifier to obtain a target video stream corresponding to the video stream identifier; determining a target video streaming channel according to the video streaming channel identification; and transmitting the target video stream to the video stream playing end through a corresponding target video stream transmission channel, and playing the target video stream on a video display page of the video stream playing end. The invention can directly and quickly configure the original video stream through the video display page of the video stream playing end, the configuration information is directly issued to the video stream processing end, the video stream processing end processes the original video stream by acquiring the corresponding video configuration information, and the original video stream is externally transmitted and displayed through the corresponding video stream transmission channel. Compared with the prior art, in order to acquire video streams corresponding to different requirements, the invention adopts a manual adjustment control holder or a scheme of adopting multiple cameras, and can display the video streams with different requirements in the same video display page through simple configuration, thereby improving the user experience.
Drawings
FIG. 1 is a schematic block diagram of a video data processing system in accordance with one embodiment of the present invention;
FIG. 2 is a flowchart of a video data processing method according to an embodiment of the present invention;
FIG. 3 is a flowchart of a method for obtaining the third video stream according to an embodiment of the present invention;
FIG. 4 is a schematic block diagram of a video data processing system according to an embodiment of the present invention;
FIG. 5 is a GUI illustration of a detail configuration web page in one embodiment of the invention;
FIG. 6 is a GUI illustration of a detail configuration web page in one embodiment of the invention;
FIG. 7 is a schematic diagram of a web preview in an embodiment of the present invention;
fig. 8 is a schematic block diagram of a video data processing apparatus according to an embodiment of the present invention.
Detailed Description
Other advantages and effects of the present invention will become apparent to those skilled in the art from the following disclosure, which describes the embodiments of the present invention with reference to specific examples. The invention may be practiced or carried out in other embodiments that depart from the specific details, and the details of the present description may be modified or varied from the spirit and scope of the present invention. It should be noted that the following embodiments and features in the embodiments may be combined with each other without conflict.
It should be noted that the illustrations provided in the following embodiments merely illustrate the basic concept of the present application by way of illustration, and only the components related to the present application are shown in the drawings and are not drawn according to the number, shape and size of the components in actual implementation, and the form, number and proportion of the components in actual implementation may be arbitrarily changed, and the layout of the components may be more complicated.
As shown in fig. 1, fig. 1 is a video data processing system, the video stream processing system comprising: a video stream playing end 100, a video stream processing end 101 and at least one video stream collecting end 102. The video stream processing end 101 is connected to the video stream playing end 100 and at least one video stream collecting end 102, and two video stream transmission channels are provided between the video stream processing end and the video stream playing end. And processing the video data by the video data processing system so as to complete the playing of the target video stream.
As shown in fig. 2, an embodiment of the present application provides a video data processing method, which can be applied to the video data processing system shown in fig. 1, the method including the steps of:
s200, receiving a video playing request of a video stream playing end; the video playing request carries video configuration information corresponding to the service requirement of a user, and the video configuration information is received through a video display page of a video stream playing end; the video configuration information at least comprises video stream acquisition end identifiers and video stream transmission channel identifiers, wherein different video stream acquisition end identifiers correspond to different video stream acquisition ends, and different video stream transmission channel identifiers correspond to different video stream transmission channels;
S201, acquiring an original video acquired by a video stream acquisition end corresponding to the video stream acquisition end identifier, and processing the original video according to the video stream transmission channel identifier to obtain a target video stream corresponding to the video stream identifier;
s202, determining a target video streaming channel according to the video streaming channel identification;
and S203, the target video stream is transmitted to the video stream playing end through the corresponding target video stream transmission channel, and the target video stream is played on a video display page of the video stream playing end.
The application can directly and quickly configure the original video stream through the video display page of the video stream playing end, the configuration information is directly issued to the video stream processing end, the video stream processing end processes the original video stream by acquiring the corresponding video configuration information, and the original video stream is externally transmitted and displayed through the corresponding video stream transmission channel. Compared with the prior art, in order to acquire video streams corresponding to different requirements, the application adopts a manual adjustment control holder or a scheme of adopting multiple cameras, and can display the video streams with different requirements in the same video display page through simple configuration, thereby improving the user experience.
The above steps will be described in detail below
In step S200, receiving a video playing request from a video stream playing end; the video playing request carries video configuration information corresponding to the service requirement of a user, and the video configuration information is received through a video display page of a video stream playing end; the video configuration information at least comprises video stream acquisition end identifiers and video stream transmission channel identifiers, different video stream acquisition end identifiers correspond to different video stream acquisition ends, and different video stream transmission channel identifiers correspond to different video stream transmission channels. It should be noted that, the video playing request of the video stream playing end is received through the video stream processing end. The video stream acquisition end identifier is used for indicating a specific video stream acquisition end, and a specific video stream acquisition end can be found through the video stream acquisition end identifier. For example, the at least one video stream acquisition end includes a video stream acquisition end 1, a video stream acquisition end 2, a video stream acquisition end 3. And 1 to N are the identifiers of the N video stream acquisition ends respectively, and the corresponding video stream acquisition ends can be found through the corresponding video stream acquisition end identifiers. It should be noted that video streams with different identifications have different attributes; the attributes of the video stream at least comprise compression rate, data quantity and detail data loss; while different video streams have different compression rates, data amounts, and detail data losses. The video stream transmission channel end identifier is used for indicating a specific video stream transmission channel, and the specific video stream transmission channel can be found through the video stream transmission channel identifier. For example, the video streaming channels include video streaming channel 1, video streaming channel 2, video streaming channel 3. And 1 to N are identifiers of the N video stream transmission channels respectively, and the corresponding video stream transmission channels can be found through the corresponding video stream transmission channel identifiers. It should be noted that the video streams transmitted by the video stream transmission channels with different identifications have different attributes.
Specifically, the video stream playing end 100 sends a video playing request to the video stream processing end 101. The video playing request carries video configuration information corresponding to the service requirement of a user, and the video configuration information is received through a video display page of a video stream playing end. The video stream playing end can be equipment which is logged in by a user and used for browsing video images; for example, the video stream playing end may be a central management PC (Personal Computer ) server, an intelligent means, a computer, a tablet, an intelligent platform, a Web end, etc., for acquiring and playing a video stream collected by a video stream collecting end arranged in a monitoring scene for browsing by a user.
The video stream playing end is provided with a video display page which is used for displaying corresponding videos and receiving video configuration information corresponding to the service requirements of users. The video display page is provided with a plurality of configuration frames, and a user can input corresponding video configuration information in the corresponding configuration frames according to service requirements. The video configuration information at least comprises a video stream acquisition end identifier and a video stream transmission channel identifier.
It should be noted that, the target video stream includes at least one of a first video stream and a second video stream, the compression rate of the first video stream is lower than that of the second video stream, the data volume is larger than that of the second video stream, and the detail data loss is smaller than that of the second video stream, and the target video stream transmission channel includes a first video stream transmission channel for transmitting the first video stream and a second video stream transmission channel for transmitting the second video stream. In this embodiment, since the compression ratio of the first video stream is low, the first video stream contains more abundant detail data, and the second video stream has a higher compression ratio, and the detail information is less than that of the first channel, but the data size is better, which is more beneficial to network transmission.
In step S201, an original video acquired by a video stream acquisition end corresponding to the video stream acquisition end identifier is acquired, and the original video is processed according to the video stream transmission channel identifier, so as to obtain a target video stream corresponding to the video stream identifier;
specifically, the video stream processing end 101 receives the video playing request, acquires an original video acquired by a video stream acquisition end corresponding to the video stream acquisition end identifier according to the video stream acquisition end identifier in the video configuration information, and processes the original video according to the video stream transmission channel identifier to obtain a target video stream.
It should be noted that the video stream processing end may be connected to a plurality of video stream collecting ends, and may perform data communication with each video stream collecting end. For example, 8 video stream collection ends may be added to the video stream processing end, or 10 video stream collection ends, or other numbers of video stream collection ends may be added to the video stream processing end, so as to implement data communication between the video stream processing end and each added video stream collection end, where each video stream collection end has an identifier, and each identifier is different, so that the corresponding video stream collection end can be found by the identifier of the video stream collection end. Specifically, the number of added video stream acquisition ends can be determined based on the self configuration and service requirements of the video stream processing end. Each video stream acquisition end can acquire video streams corresponding to the monitoring scenes of the video streams and send the video streams to the video stream processing end, and the video stream processing end can store the video streams acquired by each video stream acquisition end and process the video streams acquired by each video stream acquisition end according to the video stream transmission channel identifiers to obtain target video streams.
If the video stream transmission channel determined by the video stream transmission channel identifier is the first video stream transmission channel, processing the original video stream according to the purpose of the first video stream transmission channel for transmitting the first video stream, so that the processed video stream has low compression ratio and contains abundant detail data; if the video stream transmission channel determined by the video stream transmission channel identifier is the second video stream transmission channel, the original video stream is processed according to the purpose of the second video stream transmission channel for transmitting the second video stream, so that the processed video stream has high compression ratio and contains less detail data.
In step S203, the target video stream is sent to the video stream playing end through the corresponding target video stream transmission channel, and the target video stream is played on the video presentation page of the video stream playing end.
The target video stream can be transmitted to the video stream processing end through the target video stream transmission channel by the video stream acquisition end based on the streaming media technology, and then transmitted to the video stream playing end by the video stream processing end based on the streaming media technology.
In an embodiment, if it is determined that the target video streaming channel further includes a third video streaming channel according to the video streaming channel identification, the method further includes:
creating a virtual channel as a third video stream transmission channel through the video stream processing end;
intercepting a third video stream from the original video stream, the first video stream or the second video stream;
and transmitting the third video stream to the video stream playing end through the third video stream transmission channel.
Specifically, since in the original video data processing system, there are two video stream transmission channels between the video stream processing end and the video stream playing end, that is, the first video stream transmission channel and the second video stream transmission channel in the present embodiment, it is necessary to create a virtual channel as the third video stream transmission channel for transmitting the third video stream.
The video stream processing end judges whether a virtual channel needs to be created according to the video configuration information, if so, the video stream processing end creates the virtual channel virtual-from-channel, processes and converts partial data of the original video stream, the first video stream or the second video stream into virtual channel data, and transmits the virtual channel virtual-from-channel into the virtual channel through recoding and packaging. The video stream processing end transmits virtual channel data, namely a third video stream, to the video stream playing end through the virtual channel.
In one embodiment, as shown in fig. 3, the step of obtaining the third video stream includes:
s300, receiving an image interception command sent by a user through a video stream playing end, wherein the image interception command comprises the following steps: intercepting a time point;
s301, determining a certain preview picture of the first video stream, the second video stream or the original video stream at the video stream playing end according to the intercepting time point;
s302, an image interception area is defined in the certain preview picture;
s303, intercepting an intercepted video stream which is at an intercepting time point with the image intercepting region from the first video stream, the second video stream or the original video stream;
s304 converts the intercepted video stream into a third video stream.
In this embodiment, when the target video stream includes the third video stream, at this time, the user may intercept a part of the picture area of the video display page at the video stream playing end according to the service requirement, and when the user does not need to intercept the video picture of the whole video display page, the user may define an image intercept area in the video display page at the video stream playing end, so that pictures outside the image intercept area are not intercepted, and at this time, the user may also carry the image intercept area defined by the user from the playing interface in the video intercept command. In the image capturing command, a capturing time point, that is, a time when a video to be captured starts and a time when the video to be captured ends, may be considered as a time period, and the time period may be a period of time designated by a user and may be real-time video monitoring. After a time point is determined, there will be a corresponding video frame, i.e. a certain preview picture, at that time point, accordingly. At this time, an image capturing area may be defined in the preview screen, and the image capturing area may be configured in a video configuration frame of the video presentation page, and a coordinate position of the image capturing area may be input in the video configuration frame, so as to determine the image capturing area. Of course, a frame can be determined in the preview screen by dragging the mouse, and the frame is taken as an image capturing area. If the video stream playing end has the function of a touch screen, an image capturing area can be determined in a finger sliding mode.
In the process of intercepting the third video stream, single-frame images of the target area can be sequentially extracted; creating a video playing window in the video playing area; and amplifying the single frame image of the target area to the size of a video playing window, and sequentially displaying the single frame image in the video playing window.
In an embodiment, if the details of the image capturing area need to be played, the image capturing area may be enlarged, so the step of obtaining the third video stream further includes:
amplifying the image interception area to obtain a target area;
and converting the video stream corresponding to the target area into a third video stream.
In an embodiment, the amplifying the image capturing area includes:
acquiring an amplifying instruction in real time in a video playing state;
and calculating to obtain a target area according to the occurrence position of the amplifying instruction.
In this embodiment, taking an image capturing instruction as an example of a touch instruction, amplifying an image capturing area includes:
acquiring a touch instruction in real time in a video playing state; the touch instruction may be a touch gesture in which a start point is two-point touch, motion trajectories of the two touch points are substantially straight lines, and motion directions of the two touch points are substantially opposite.
And calculating a target area according to the occurrence position of the touch instruction.
In an embodiment, the converting the video stream corresponding to the target area into the third video stream includes:
converting the video stream corresponding to the target area into a third video stream by a data interpolation method; the data interpolation method comprises the following steps:
dividing the pixel points to be interpolated of the target area into a flat area and an edge area;
interpolation is carried out on the pixel points to be interpolated, which are positioned in the flat area, by adopting a linear image interpolation algorithm;
and interpolating the pixel points to be interpolated in the edge area by adopting an adaptive interpolation algorithm.
Specifically, a 3×3 window is first selected, a difference between pixel values in a horizontal direction, a vertical direction, a 45 ° direction, or a 135 ° direction is calculated, and if the value is smaller than a preset threshold value, the pixel value is divided into flat areas, otherwise, the pixel value is divided into edge areas; then, linear interpolation is adopted for the pixel points of the flat area; and after the pixel points of the flat area are all subjected to interpolation calculation, carrying out edge self-adaptive interpolation on the pixel points of the edge area. The linear image interpolation algorithm may be a linear image interpolation algorithm, and the adaptive interpolation algorithm may be a covariance-based adaptive interpolation algorithm.
And obtaining a third video stream with target resolution after interpolation processing.
In an embodiment, the video presentation page includes a first presentation sub-page for playing a first video stream, a second video stream, or an original video stream, and a second presentation sub-page for playing a third video stream.
As shown in fig. 4, an embodiment of the present application further provides a video data processing system, which is used for security equipment, and includes a processor, application software, and a service end, where the service end includes a platform end and/or a web end; a first video stream transmission channel and a second video stream transmission channel are built in the processor and are used for transmitting a first video stream and a second video stream, namely a first video channel stream and a second video channel stream respectively; the first channel video stream is a high quality video stream, has a low compression ratio, and contains more abundant detail data. The first channel video stream adopts a higher compression ratio, and the detail information is less than that of the first channel, but the data size is better, so that the network transmission is facilitated. The first video stream and the second video stream are obtained by video coding through a processor.
Of course, if a video stream of a certain area in the first video stream, the second video stream, or the original video stream is required, the corresponding video stream is intercepted from the first video stream, the second video stream, or the original video stream, and the processor constructs a virtual channel as a third video stream transmission channel, and transmits the third video stream through the third video stream transmission channel.
In fig. 4, a processor acquires a third video stream by encoding video data acquired by a video acquisition device (camera), and then creates a virtual channel for transmitting the third video stream (detail video stream data). The streaming media module is an audio and video data management module of the security equipment, and can encapsulate video data to a certain extent according to a protocol and provide a video data source for other modules such as a platform access module and the like. The Web and the platform can subscribe the first video through flow, the second video flow and the third video flow through the streaming media module to acquire corresponding video data.
In fig. 5, the web side may provide a configuration page in a detail mode, and the user performs corresponding configuration by clicking on the page, activates a detail area function, and whether to enable configuration operations such as amplification. With specific reference to the GUI diagram of the detail configuration web page shown in fig. 5. In one embodiment, the configuration page of the web side includes configuration buttons for enabling, locally zooming, drawing an area, and the like. The user may draw the target area size by means of a mouse or the like, and the frame size of the area has a default size of 100×100. And the frame below the configuration is a preview interface of the region setting, and the fixed size is 400×400.
The application software transmits the user configuration determined on the configuration page to the processor, performs region clipping, data interpolation and the like on the original data stream according to the position coordinates of the configuration region in the transmitted user configuration, obtains and converts the region clipping, the data interpolation and the like into a third video stream, encapsulates the third video stream according to the corresponding video coding format, and then creates a third video stream transmission channel, namely a virtual channel, by the processor to transmit data to the application software.
The streaming media module of the application software subscribes the virtual channel data to the processor module; when a video signal exists, the processor transmits detail video stream data (third video stream) of the real-time video to the streaming media module; the streaming media module transmits the data to the web terminal again, and the web terminal displays the preview configuration effect in real time; at this point the user can see clearer, more detailed effects on the web page. With specific reference to the GUI diagram of the detail configuration web page shown in FIG. 6. If the user opens the detail function, two video interfaces, one panoramic and one detail, can be seen at the same time in the preview interface.
Of course, the web side can pull the data of the first video channel stream and the third video channel stream (third video stream) to the streaming media module at the same time, and the user can watch the panoramic and detailed picture at the preview interface at the same time. With specific reference to the web preview illustration shown in fig. 7.
Of course, the platform end can subscribe the virtual channel stream data to the streaming media module through the SDK, the streaming media module pushes the virtual channel stream data to the platform, and the platform displays the virtual channel video stream. The platform end can subscribe the real-time stream (second video stream) and the virtual channel stream (third video stream) to the streaming media module through the SDK, and the platform displays the virtual channel video stream and the real-time stream simultaneously.
In the prior art, in order to acquire panorama and detail stream (panorama+detail), it is necessary to adjust acquisition target area data by switching video channels and then by means of a cradle head or the like. In this embodiment, the user may directly perform quick configuration of the target area on the original screen through the interface of the web end or the platform end. The configuration data is directly issued to the processor, the processor extracts and processes the original data by acquiring corresponding position coordinates and other information, and then the original data is displayed externally through the virtual channel, and if the user does not need to control the closing through software page configuration.
Meanwhile, for some scenes, devices typically employ high pixels. Video of the user target area is effectively extracted by the processor and encapsulated into a virtual channel for transmission, wherein the channel data has a smaller quantity compared with the original data. With a dedicated regional data channel (third video streaming channel), the user can more efficiently configure the data, and various combinations reduce network bandwidth pressure.
As shown in fig. 8, an embodiment of the present application provides a video data processing apparatus, including:
the video request receiving module 800 is configured to receive a video playing request from a video stream playing end; the video playing request carries video configuration information corresponding to the service requirement of a user, and the video configuration information is received through a video display page of a video stream playing end; the video configuration information at least comprises video stream acquisition end identifiers and video stream transmission channel identifiers, wherein different video stream acquisition end identifiers correspond to different video stream acquisition ends, and different video stream transmission channel identifiers correspond to different video stream transmission channels;
the target video stream obtaining module 801 is configured to obtain an original video collected by a video stream collecting end corresponding to the video stream collecting end identifier, and process the original video according to the video stream transmission channel identifier to obtain a target video stream corresponding to the video stream identifier;
a video streaming channel determining module 802, configured to determine a target video streaming channel according to the video streaming channel identifier;
and the video stream transmission module 803 is configured to transmit the target video stream to the video stream playing end through a corresponding target video stream transmission channel, and play the target video stream on a video presentation page of the video stream playing end.
It should be noted that, since the embodiments of the apparatus portion and the embodiments of the method portion correspond to each other, the content of the embodiments of the apparatus portion is referred to the description of the embodiments of the method portion, which is not repeated herein.
The present invention also provides a storage medium storing a computer program which, when executed by a processor, performs the aforementioned video data processing method.
The present invention also provides an apparatus comprising:
a memory for storing a computer program;
and a processor for executing the computer program stored in the memory to cause the apparatus to execute the video data processing method.
The processor may be a central processing unit (Central Processing Unit, CPU), but may also be other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field programmable gate arrays (FieldProgrammable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory may be an internal memory unit or an external memory device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital Card (SD), a Flash Card (Flash Card), etc. Further, the memory may also include both internal storage units and external storage devices. The memory is used for storing the computer program and other programs and data. The memory may also be used to temporarily store data that has been output or is to be output.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional units and modules is illustrated, and in practical application, the above-described functional distribution may be performed by different functional units and modules according to needs, i.e. the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-described functions. The functional units and modules in the embodiment may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit, where the integrated units may be implemented in a form of hardware or a form of a software functional unit. In addition, the specific names of the functional units and modules are only for distinguishing from each other, and are not used for limiting the protection scope of the present application. The specific working process of the units and modules in the above system may refer to the corresponding process in the foregoing method embodiment, which is not described herein again.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and in part, not described or illustrated in any particular embodiment, reference is made to the related descriptions of other embodiments.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus/terminal device and method may be implemented in other manners. For example, the apparatus/terminal device embodiments described above are merely illustrative, e.g., the division of the modules or units is merely a logical function division, and there may be additional divisions in actual implementation, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection via interfaces, devices or units, which may be in electrical, mechanical or other forms.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated modules/units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the present invention may implement all or part of the flow of the method of the above embodiment, or may be implemented by a computer program to instruct related hardware, where the computer program may be stored in a computer readable storage medium, and when the computer program is executed by a processor, the computer program may implement the steps of each of the method embodiments described above. Wherein the computer program comprises computer program code which may be in source code form, object code form, executable file or some intermediate form etc. The computer readable medium may include any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory ((RAM, random Access Memory), an electrical carrier signal, a telecommunications signal, a software distribution medium, etc.
The above embodiments are merely illustrative of the principles of the present invention and its effectiveness, and are not intended to limit the invention. Modifications and variations may be made to the above-described embodiments by those skilled in the art without departing from the spirit and scope of the invention. Accordingly, it is intended that all equivalent modifications and variations of the invention be covered by the claims, which are within the ordinary skill of the art, be within the spirit and scope of the present disclosure.
Claims (9)
1. A method of video data processing, the method comprising:
receiving a video playing request of a video stream playing end; the video playing request carries video configuration information corresponding to the service requirement of a user, and the video configuration information is received through a video display page of a video stream playing end; the video configuration information at least comprises video stream acquisition end identifiers and video stream transmission channel identifiers, wherein different video stream acquisition end identifiers correspond to different video stream acquisition ends, and different video stream transmission channel identifiers correspond to different video stream transmission channels;
acquiring an original video acquired by a video stream acquisition end corresponding to the video stream acquisition end identifier, and processing the original video according to the video stream transmission channel identifier to obtain a target video stream corresponding to the video stream identifier; the target video stream comprises at least one of a first video stream and a second video stream, the compression rate of the first video stream is lower than that of the second video stream, the data volume is larger than that of the second video stream, the detail data loss is smaller than that of the second video stream, and the target video stream transmission channel comprises a first video stream transmission channel used for transmitting the first video stream and a second video stream transmission channel used for transmitting the second video stream; if it is determined that the target video streaming channel further includes a third video streaming channel according to the video streaming channel identification, the method further includes: creating a virtual channel as a third video stream transmission channel through the video stream processing end; intercepting a third video stream from the original video stream, the first video stream or the second video stream; transmitting the third video stream to the video stream playing end through the third video stream transmission channel;
Determining a target video streaming channel according to the video streaming channel identification;
and transmitting the target video stream to the video stream playing end through a corresponding target video stream transmission channel, and playing the target video stream on a video display page of the video stream playing end.
2. The video data processing method according to claim 1, wherein the step of acquiring the third video stream includes:
receiving an image interception command sent by a user through a video stream playing end, wherein the image interception command comprises the following steps: intercepting a time point;
determining a certain preview picture of the first video stream, the second video stream or the original video stream at the video stream playing end according to the intercepting time point;
an image interception area is defined in the certain preview picture;
intercepting an intercepted video stream from the first video stream, the second video stream or the original video stream at an intercepting time point with the image intercepting region;
and converting the intercepted video stream into a third video stream.
3. The video data processing method according to claim 2, wherein the step of acquiring the third video stream further comprises:
Amplifying the image interception area to obtain a target area;
and converting the video stream corresponding to the target area into a third video stream.
4. A video data processing method according to claim 3, wherein said enlarging the image capturing area comprises:
acquiring an amplifying instruction in real time in a video playing state;
and calculating to obtain a target area according to the occurrence position of the amplifying instruction.
5. The method according to claim 3, wherein converting the video stream corresponding to the target area into a third video stream comprises:
converting the video stream corresponding to the target area into a third video stream by a data interpolation method; the data interpolation method comprises the following steps:
dividing the pixel points to be interpolated of the target area into a flat area and an edge area;
interpolation is carried out on the pixel points to be interpolated, which are positioned in the flat area, by adopting a linear image interpolation algorithm;
and interpolating the pixel points to be interpolated in the edge area by adopting an adaptive interpolation algorithm.
6. A video data processing method according to claim 3, wherein the video presentation page comprises a first presentation sub-page for playing a first video stream, a second video stream or an original video stream, and a second presentation sub-page for playing a third video stream.
7. A video data processing apparatus, the apparatus comprising:
the video request receiving module is used for receiving a video playing request of the video stream playing end; the video playing request carries video configuration information corresponding to the service requirement of a user, and the video configuration information is received through a video display page of a video stream playing end; the video configuration information at least comprises video stream acquisition end identifiers and video stream transmission channel identifiers, wherein different video stream acquisition end identifiers correspond to different video stream acquisition ends, and different video stream transmission channel identifiers correspond to different video stream transmission channels;
the target video stream acquisition module is used for acquiring an original video acquired by the video stream acquisition end corresponding to the video stream acquisition end identifier, and processing the original video according to the video stream transmission channel identifier to obtain a target video stream corresponding to the video stream identifier; the target video stream comprises at least one of a first video stream and a second video stream, the compression rate of the first video stream is lower than that of the second video stream, the data volume is larger than that of the second video stream, the detail data loss is smaller than that of the second video stream, and the target video stream transmission channel comprises a first video stream transmission channel used for transmitting the first video stream and a second video stream transmission channel used for transmitting the second video stream; if it is determined that the target video streaming channel further includes a third video streaming channel according to the video streaming channel identification, the apparatus further includes: creating a virtual channel as a third video stream transmission channel through the video stream processing end; intercepting a third video stream from the original video stream, the first video stream or the second video stream; transmitting the third video stream to the video stream playing end through the third video stream transmission channel;
The video stream transmission channel determining module is used for determining a target video stream transmission channel according to the video stream transmission channel identification;
and the video stream transmission module is used for transmitting the target video stream to the video stream playing end through a corresponding target video stream transmission channel, and playing the target video stream on a video display page of the video stream playing end.
8. A video data processing apparatus, comprising:
a memory for storing a computer program;
a processor for executing the computer program stored in the memory to cause the apparatus to perform the video data processing method according to any one of claims 1 to 6.
9. A storage medium storing a computer program which, when executed by a processor, performs the video data processing method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210295235.2A CN114666477B (en) | 2022-03-24 | 2022-03-24 | Video data processing method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210295235.2A CN114666477B (en) | 2022-03-24 | 2022-03-24 | Video data processing method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114666477A CN114666477A (en) | 2022-06-24 |
| CN114666477B true CN114666477B (en) | 2023-10-13 |
Family
ID=82030687
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210295235.2A Active CN114666477B (en) | 2022-03-24 | 2022-03-24 | Video data processing method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114666477B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103414883A (en) * | 2013-08-20 | 2013-11-27 | 浙江宇视科技有限公司 | Customized service method and customized playback device of video streams |
| CN106792092A (en) * | 2016-12-19 | 2017-05-31 | 广州虎牙信息科技有限公司 | Live video flow point mirror display control method and its corresponding device |
| CN110139061A (en) * | 2019-04-04 | 2019-08-16 | 视联动力信息技术股份有限公司 | A kind of video flowing split screen methods of exhibiting and device |
| CN110944186A (en) * | 2019-12-10 | 2020-03-31 | 杭州当虹科技股份有限公司 | High-quality viewing method for local area of video |
| CN111565298A (en) * | 2020-04-30 | 2020-08-21 | 腾讯科技（深圳）有限公司 | Video processing method, device, equipment and computer readable storage medium |
| CN112565693A (en) * | 2020-11-30 | 2021-03-26 | 广东荣文科技集团有限公司 | Method, system and equipment for monitoring video on demand |
| CN113259716A (en) * | 2021-07-07 | 2021-08-13 | 摩尔线程智能科技(北京)有限责任公司 | Video issuing method, video acquiring method, server, terminal and system |
| CN113301388A (en) * | 2021-05-20 | 2021-08-24 | 杭州海康威视数字技术股份有限公司 | Video stream processing system, device and method |
| CN114125400A (en) * | 2021-12-17 | 2022-03-01 | 浙江大华技术股份有限公司 | Multi-channel video analysis method and device |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7382969B2 (en) * | 2003-02-19 | 2008-06-03 | Sony Corporation | Method and system for preventing the unauthorized copying of video content |
| US20100239222A1 (en) * | 2009-03-20 | 2010-09-23 | International Business Machines Corporation | Digital video recorder broadcast overlays |
| CN113542581A (en) * | 2020-04-22 | 2021-10-22 | 华为技术有限公司 | View finding method of multi-channel video, graphical user interface and electronic equipment |
-
2022
- 2022-03-24 CN CN202210295235.2A patent/CN114666477B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103414883A (en) * | 2013-08-20 | 2013-11-27 | 浙江宇视科技有限公司 | Customized service method and customized playback device of video streams |
| CN106792092A (en) * | 2016-12-19 | 2017-05-31 | 广州虎牙信息科技有限公司 | Live video flow point mirror display control method and its corresponding device |
| CN110139061A (en) * | 2019-04-04 | 2019-08-16 | 视联动力信息技术股份有限公司 | A kind of video flowing split screen methods of exhibiting and device |
| CN110944186A (en) * | 2019-12-10 | 2020-03-31 | 杭州当虹科技股份有限公司 | High-quality viewing method for local area of video |
| CN111565298A (en) * | 2020-04-30 | 2020-08-21 | 腾讯科技（深圳）有限公司 | Video processing method, device, equipment and computer readable storage medium |
| CN112565693A (en) * | 2020-11-30 | 2021-03-26 | 广东荣文科技集团有限公司 | Method, system and equipment for monitoring video on demand |
| CN113301388A (en) * | 2021-05-20 | 2021-08-24 | 杭州海康威视数字技术股份有限公司 | Video stream processing system, device and method |
| CN113259716A (en) * | 2021-07-07 | 2021-08-13 | 摩尔线程智能科技(北京)有限责任公司 | Video issuing method, video acquiring method, server, terminal and system |
| CN114125400A (en) * | 2021-12-17 | 2022-03-01 | 浙江大华技术股份有限公司 | Multi-channel video analysis method and device |
Non-Patent Citations (1)
| Title |
|---|
| DVI输出图像选区截取的FPGA实现;周岩;高杨;刘佳;李俊艳;蔡林飞;梁正恺;;电视技术(第05期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114666477A (en) | 2022-06-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102801963B (en) | Electronic PTZ method and device based on high-definition digital camera monitoring | |
| CA2974104C (en) | Video transmission based on independently encoded background updates | |
| US20150208103A1 (en) | System and Method for Enabling User Control of Live Video Stream(s) | |
| AU2022201303A1 (en) | Selective capture and presentation of native image portions | |
| CN107040794A (en) | Video broadcasting method, server, virtual reality device and panoramic virtual reality play system | |
| KR102511407B1 (en) | Video distribution device, video distribution system, video distribution method and video distribution program | |
| CN107211081B (en) | Video transmission based on independently coded background updates | |
| JPWO2004004363A1 (en) | Image encoding device, image transmitting device, and image photographing device | |
| CN111970524A (en) | Control method, device, system, equipment and medium for interactive live broadcast and microphone connection | |
| US20150109436A1 (en) | Smart Dual-View High-Definition Video Surveillance System | |
| CN107580228B (en) | Monitoring video processing method, device and equipment | |
| CN114666477B (en) | Video data processing method, device, equipment and storage medium | |
| JP2019149785A (en) | Video conversion device and program | |
| WO2019218147A1 (en) | Method, apparatus and device for transmitting surveillance video | |
| CN202818497U (en) | Electronic PTZ device capable of monitoring based on high-definition digital camera | |
| KR20190032670A (en) | video service providing system using multi-view camera | |
| CN113837937A (en) | Multimedia processing chip, electronic equipment image fusion method and image cutting method | |
| CN107318020B (en) | Data processing method and system for remote display | |
| CN115134633B (en) | Remote video method and related device | |
| CN117440176A (en) | Method, apparatus, device and medium for video transmission | |
| CN113840075B (en) | Electronic equipment and image fusion method based on electronic equipment | |
| WO2022199594A1 (en) | Method for performing remote video, and related device | |
| WO2024012295A1 (en) | Video transmission method, apparatus, and system, device, and medium | |
| WO2022061723A1 (en) | Image processing method, device, terminal, and storage medium | |
| WO2022252797A1 (en) | Video presentation method, electronic device, computer storage medium and program product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |