CN111970481A - Ultrahigh-definition decoding and splicing video method and system based on 5G transmission - Google Patents

Ultrahigh-definition decoding and splicing video method and system based on 5G transmission Download PDF

Info

Publication number
CN111970481A
CN111970481A CN202010647183.1A CN202010647183A CN111970481A CN 111970481 A CN111970481 A CN 111970481A CN 202010647183 A CN202010647183 A CN 202010647183A CN 111970481 A CN111970481 A CN 111970481A
Authority
CN
China
Prior art keywords
image
video
sub
global
decoding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010647183.1A
Other languages
Chinese (zh)
Inventor
晏冬
刘力
王维治
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Infinova Intelligent Technology Co Ltd
Original Assignee
Shenzhen Infinova Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Infinova Intelligent Technology Co Ltd filed Critical Shenzhen Infinova Intelligent Technology Co Ltd
Priority to CN202010647183.1A priority Critical patent/CN111970481A/en
Publication of CN111970481A publication Critical patent/CN111970481A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2624Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of whole input images, e.g. splitscreen
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265Mixing

Abstract

The invention belongs to the field of 5G video processing and transmission, and provides a method for transmitting an ultra-high definition decoding spliced video based on 5G. The method comprises the following steps: acquiring a global video and a sub-area video from a front-end camera device in real time through a 5G network; decoding the global video and the sub-region video to obtain a YUV format image; the positions of the sub-images in the global image are identified compared with the sub-region image ID and the global image, and the brightness and the chromaticity of the boundary image of the adjacent region are fused, so that the image transition between the sub-regions is smoother; and splicing and displaying each path of sub video according to the position ID of the global image. The ultrahigh-definition decoding video is transmitted through the 5G network, the global video and the sub-region video are spliced after the ultrahigh-definition decoding video is transmitted, the problems that the traditional wired installation and wiring cost is high, the bandwidth of a 4G wireless transmission mode is limited, the transmission delay is blocked, the use cost is reduced, the experience effect of customer use is improved, and the satisfaction degree is improved.

Description

Ultrahigh-definition decoding and splicing video method and system based on 5G transmission
Technical Field
The invention belongs to the field of security video processing and transmission, and particularly relates to a method, a system and a storage medium for transmitting ultra-high definition decoding spliced video based on 5G.
Background
The traditional ultra-high definition hundred million pixel camera transmits video data through a wired network, and the wiring cost is high; if the 4G wireless mode is adopted for transmission, the problems of video delay, blockage, picture loss and the like are often caused due to bandwidth limitation. The transmission scheme for solving the problems of high cost, 4G wireless bandwidth limitation and transmission delay blockage of the traditional wired installation and wiring is urgently needed, so that the use cost is reduced, the experience effect of customer use is increased, and the satisfaction is improved.
Disclosure of Invention
The technical problems to be solved by the embodiment of the invention are that the cost of wired installation and wiring is high, the bandwidth of a 4G wireless mode is limited, and the transmission delay is blocked in the prior art.
In order to solve the technical problems, the technical scheme of the invention is as follows:
the invention provides a method for transmitting an ultra-high definition decoding spliced video based on 5G, which comprises the following steps:
acquiring a global video and a sub-area video from a front-end camera device in real time through a 5G network;
decoding the global video and the sub-region video to obtain a YUV format image;
identifying the position of the sub-region image in the global image by comparing the sub-region image ID with the global image, and calibrating the identified sub-region image;
clipping the calibrated sub-images to obtain effective sub-area images within the range of the relative global image;
and splicing and displaying each path of sub video according to the position ID of the global image.
The second aspect of the present invention provides a system for transmitting super high definition decoding spliced video based on 5G, where the system includes:
the video decoding module is used for decoding the global video and the sub-region video to obtain a YUV format image;
the subarea calibration module is used for comparing the subarea image ID with the global image, identifying the position of the subimage in the global image and generating effective area coordinates for calibration;
the subregion clipping module is used for clipping the calibrated subimages to obtain an effective subregion image within a relative global image range;
the image fusion module is used for fusing the brightness and the chromaticity of the boundary image of adjacent regions so as to enable the image transition between the sub-regions to be smoother;
and the panoramic video splicing display module is used for splicing and displaying each path of sub-video according to the position ID of the global image.
Compared with the prior art, the embodiment of the invention has the advantages that: acquiring a global video and a sub-area video from a front-end camera device in real time through a 5G network; decoding the global video and the sub-region video to obtain a YUV format image; the positions of the sub-images in the global image are identified compared with the sub-region image ID and the global image, and the brightness and the chromaticity of the boundary image of the adjacent region are fused, so that the image transition between the sub-regions is smoother; and splicing and displaying each path of sub video according to the position ID of the global image. The ultrahigh-definition decoding video is transmitted through the 5G network, the global video and the sub-region video are spliced after the ultrahigh-definition decoding video is transmitted, the problems that the traditional wired installation and wiring cost is high, the bandwidth of a 4G wireless transmission mode is limited, the transmission delay is blocked, the use cost is reduced, the experience effect of customer use is improved, and the satisfaction degree is improved.
Drawings
Fig. 1 is a schematic flowchart of a method for transmitting an ultra-high-definition decoding spliced video based on 5G according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a system for transmitting super high definition decoding spliced video based on 5G;
FIG. 3 is a schematic diagram of establishing a 5G network connection and acquiring a global video and a sub-area video from a front-end camera in real time;
fig. 4 is a schematic diagram of global video and sub-region video decoding.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The invention provides a method for transmitting super-high definition decoding spliced video based on 5G, which comprises the following steps
As shown in fig. 1, the method comprises the following steps:
101. acquiring a global video and a sub-area video from a front-end camera device in real time through a 5G network; as shown in fig. 3, a 5G network connection is established, a global video and a sub-area video are obtained from a front-end camera device in real time, a splicing platform sends a request for establishing a 5G transmission connection to a designated sub-video camera (for example, 192.168.1.100), and the camera agrees and returns a response after receiving the request.
And requesting sub-video data, sending a sub-video request to a specified sub-camera by the splicing platform, and returning the sub-video data to the splicing platform after the camera receives the request.
And disconnecting, the splicing platform sends a disconnection request to the appointed sub video camera, and the camera agrees to disconnect and returns a response after receiving the request.
In the embodiment, the wiring cost is greatly saved by acquiring the global video and the super-high-definition decoded video of the sub-region video through the 5G transmission front-end camera device, the problem of 4G transmission delay is solved, and the user experience is improved.
102. Decoding the global video and the sub-region video to obtain a YUV format image;
as shown in fig. 4, decoding a video frame of the global video, a video frame timestamp; and decoding the n paths of sub video frames and the video frame time stamps, determining the global video as the sub image without executing the step of identifying the sub image when judging that n is equal to 1, and firstly decoding the global reference video frame video264_ all _ i and the video frame time stamp tv _ i to generate video yuv _ all _ i.
Then, the n sub-video frames video264_ n _ i and the video frame time stamps tv _ i are decoded to generate video yuv _ n _ i.
The global reference video is an image of an overall view, the n paths of sub-videos are local sub-images under the overall view, and the decoding processing and the identification ensure that the global reference video and the n paths of sub-videos are under the same video frame timestamp tv _ i to prepare for a later splicing step. And respectively carrying out decoding processing and identification processing on each same video frame time stamp image.
103. Identifying the position of the sub-region image in the global image by comparing the sub-region image ID with the global image, and calibrating the identified sub-region image;
firstly, comparing the sub-area image ID with the global image, identifying the position pos _ n (the coordinate of four points in the rectangular area of the global image) of the sub-image in the global image, and then generating the effective area coordinate to calibrate bd _ n (the coordinate of four points in the rectangular area of the local sub-image). For example: the position of the image ID of the A sub-area in the global image is four end points of a rectangle, the four end points are located in the coordinate range of the global image, the effective area coordinates can be screened out by the image ID of the A sub-area for calibration, and the four end points can be fused in the coordinate range of the global image.
104. Clipping the calibrated subimages to obtain effective subarea images within the range of the relative global image;
and cutting the multipath sub-images VideoYuv _ n _ i under the same timestamp tv _ i through calibration to obtain effective sub-area images VideoYuvCrop _ n _ i within a relative global image range.
105. The brightness and the chromaticity of the boundary image of the adjacent regions are fused, so that the image transition between the sub-regions is smoother;
utilizing an image fusion module to perform boundary luminance and chrominance fusion processing on images of adjacent areas, namely, video YUVCROP _ n _ i and video YUVCROP _ n +1_ i, under the same timestamp tv _ i, and reducing the difference to be less than the preset maximum chrominance difference max _ color _ diff and luminance difference max _ bright _ diff, so as to generate the fused images, namely, video YUVCROPPIX _ n _ i and video YUVCROPPIX _ n +1_ i, so that the image transition between the sub areas is smoother, for example: the image IDs of the two subregions A and B are adjacent, and the color difference and the brightness difference can occur during the splicing treatment, so that the spliced global video is not attractive, and the image transition between the subregions is required to be smoother and fused into the same state.
106. And splicing and displaying each path of sub video according to the position ID of the global image.
And utilizing a panoramic video splicing display module to display each path of sub-video under the same timestamp tv _ i one by one according to the global image position pos _ n (coordinates of four points in a rectangular region of the global image) of each path of sub-video, wherein each path of sub-video is spliced into a global video like a jigsaw, and the chrominance and the luminance are consistent.
And repeating each step to splice the sub-videos of each path under different timestamps into a global video for processing and displaying.
The specific steps also include the subdivision steps of the steps, for convenience of description, the subdivision steps belonging to the steps are numbered correspondingly, but no specific sequence exists between the subdivision steps:
1021. decoding the global video and the sub-region video comprises:
decoding video frames and video frame timestamps of the global video;
decoding the n paths of sub video frames and the video frame time stamps;
and when the judgment result n is 1, determining the global video as the sub-image without executing the step of identifying the sub-image.
1031. The step of comparing the sub-region image ID with the global image comprises the following steps:
identifying the sub-region image ID and the global image, and identifying the position pos _ n of the sub-image in the global image;
and generating an effective area of the local sub-image and calibrating coordinates.
1041. The step of clipping after the sub-image calibration comprises the following steps:
and cutting the n paths of sub-images under the same timestamp through calibration to obtain effective sub-area images within a relative global image range.
1051. The step of calibrating the sub-image and then clipping further comprises:
and fusing the effective subarea images, and fusing the boundary brightness and the chromaticity of the images of the adjacent areas under the same timestamp to reduce the difference to be below the maximum chromaticity difference and the brightness difference which are set in advance, so that the image transition between the subareas generated after the fusion is smoother.
1061. The step of calibrating the sub-image and then clipping further comprises:
and carrying out panoramic video splicing display on the calibration sub-images, and splicing and displaying each path of sub-video one by one according to the position pos _ n of the global image where each path of sub-video is located under the same timestamp to obtain the panoramic video.
The above embodiments of the subdivision steps have been explained in the previous embodiments and are not described in detail here.
As shown in fig. 2, a second aspect of the present invention provides a system for transmitting super high definition decoding spliced video based on 5G, the system comprising:
the video decoding module is used for decoding the global video and the sub-region video to obtain a YUV format image;
the subarea calibration module is used for comparing the subarea image ID with the global image, identifying the position of the subimage in the global image and generating effective area coordinates for calibration;
the subregion clipping module is used for clipping the calibrated subimages to obtain an effective subregion image within a relative global image range;
the image fusion module is used for fusing the brightness and the chromaticity of the boundary image of adjacent regions so as to enable the image transition between the sub-regions to be smoother;
and the panoramic video splicing display module is used for splicing and displaying each path of sub-video according to the position ID of the global image.
A third aspect of the invention provides a storage medium for storing a program for implementing the method or system described above.
The method for transmitting the super high definition decoding spliced video based on 5G comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the method for transmitting the super high definition decoding spliced video based on 5G as claimed in the claims.
Compared with the prior art, the embodiment of the invention has the advantages that: acquiring a global video and a sub-area video from a front-end camera device in real time through a 5G network; decoding the global video and the sub-region video to obtain a YUV format image; the positions of the sub-images in the global image are identified compared with the sub-region image ID and the global image, and the brightness and the chromaticity of the boundary image of the adjacent region are fused, so that the image transition between the sub-regions is smoother; and splicing and displaying each path of sub video according to the position ID of the global image. The ultrahigh-definition decoding video is transmitted through the 5G network, the global video and the sub-region video are spliced after the ultrahigh-definition decoding video is transmitted, the problems that the traditional wired installation and wiring cost is high, the bandwidth of a 4G wireless transmission mode is limited, the transmission delay is blocked, the use cost is reduced, the experience effect of customer use is improved, and the satisfaction degree is improved.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents and improvements made within the spirit and principle of the present invention are intended to be included within the scope of the present invention.

Claims (10)

1. A method for transmitting super high definition decoding spliced video based on 5G is characterized by comprising the following steps:
acquiring a global video and a sub-area video from a front-end camera device in real time through a 5G network;
decoding the global video and the sub-region video to obtain a YUV format image;
comparing the sub-region image ID with the global image, identifying the position of the sub-region image in the global image, and calibrating the identified sub-region image;
cutting the calibrated sub-image to obtain an effective sub-area image within a relative global image range;
and splicing and displaying each path of sub video according to the position ID of the global image.
2. The method of claim 1, wherein decoding the global video and sub-region video comprises:
decoding video frames and video frame timestamps of the global video;
decoding video frames and video frame timestamps of n paths of sub videos;
when judging that n is 1, judging that the global video is a sub-image.
3. The method of claim 1, wherein the step of comparing the subregion image IDs with the global image comprises:
identifying the sub-region image ID and the global image, and identifying the position pos _ n of the sub-image in the global image;
and generating an effective area of the local sub-area image and calibrating coordinates.
4. The method of claim 3, wherein the cropping the nominal sub-image comprises:
and cutting the n paths of sub-images under the same timestamp through calibration to obtain effective sub-area images within a relative global image range.
5. The method of claim 4, wherein the step of cropping the nominal sub-image further comprises:
and fusing the effective subarea images, and fusing the boundary brightness and the chromaticity of the images of the adjacent areas under the same timestamp to reduce the difference to be below the preset maximum chromaticity difference and brightness difference, so that the image transition between the subareas generated after the fusion is smoother.
6. The method according to claim 1, wherein the step of displaying the sub-videos according to the global image position ID comprises:
and carrying out panoramic video splicing display on the calibration sub-images, and splicing and displaying each path of sub-video one by one according to the position pos _ n of the global image where each path of sub-video is located under the same timestamp to obtain the panoramic video.
7. A system for transmitting super high definition decoding spliced video based on 5G, comprising:
the video decoding module is used for decoding the global video and the sub-region video to obtain a YUV format image; the subregion calibration module is used for comparing the subregion image ID with the global image, identifying the position of the subregion image in the global image and calibrating the identified subregion image; the sub-region cutting module is used for cutting a target stator image to obtain an effective sub-region image within a relative global image range;
and the panoramic video splicing display module is used for splicing and displaying each path of sub-video according to the position ID of the global image.
8. The system of claim 7, further comprising an image fusion module, wherein the image fusion module is configured to fuse the brightness and the chromaticity of the boundary image of the adjacent region, so that the image transition between the sub-regions is smoother.
9. A method for transmitting ultra high definition decoding spliced video based on 5G, comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the method for transmitting ultra high definition decoding spliced video based on 5G according to any one of claims 1 to 6.
10. A storage medium storing steps for implementing the method for transmitting ultra high definition decoding mosaic video according to any one of claims 1-6 based on 5G.
CN202010647183.1A 2020-07-07 2020-07-07 Ultrahigh-definition decoding and splicing video method and system based on 5G transmission Pending CN111970481A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010647183.1A CN111970481A (en) 2020-07-07 2020-07-07 Ultrahigh-definition decoding and splicing video method and system based on 5G transmission

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010647183.1A CN111970481A (en) 2020-07-07 2020-07-07 Ultrahigh-definition decoding and splicing video method and system based on 5G transmission

Publications (1)

Publication Number Publication Date
CN111970481A true CN111970481A (en) 2020-11-20

Family

ID=73360481

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010647183.1A Pending CN111970481A (en) 2020-07-07 2020-07-07 Ultrahigh-definition decoding and splicing video method and system based on 5G transmission

Country Status (1)

Country Link
CN (1) CN111970481A (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101751659A (en) * 2009-12-24 2010-06-23 北京优纳科技有限公司 Large-volume rapid image splicing method
CN102857739A (en) * 2012-08-20 2013-01-02 上海光亮光电科技有限公司 Distributed panorama monitoring system and method thereof
CN103338343A (en) * 2013-05-29 2013-10-02 山西绿色光电产业科学技术研究院(有限公司) Multi-image seamless splicing method and apparatus taking panoramic image as reference
CN104618648A (en) * 2015-01-29 2015-05-13 桂林长海发展有限责任公司 Panoramic video splicing system and splicing method
CN105205796A (en) * 2014-06-30 2015-12-30 华为技术有限公司 Wide-area image acquisition method and apparatus
CN105894449A (en) * 2015-11-11 2016-08-24 乐卡汽车智能科技(北京)有限公司 Method and system for overcoming abrupt color change in image fusion processes
CN107659774A (en) * 2017-09-30 2018-02-02 深圳市未来媒体技术研究院 A kind of video imaging system and method for processing video frequency based on multiple dimensioned camera array
CN108171735A (en) * 2017-12-27 2018-06-15 清华大学 1,000,000,000 pixel video alignment schemes and system based on deep learning
CN108234966A (en) * 2018-03-19 2018-06-29 成都杠上花信息技术有限公司 A kind of real-time panoramic video splicing system based on embedded platform
CN108399600A (en) * 2018-02-23 2018-08-14 清华-伯克利深圳学院筹备办公室 A kind of omnidirectional imaging system and method

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101751659A (en) * 2009-12-24 2010-06-23 北京优纳科技有限公司 Large-volume rapid image splicing method
CN102857739A (en) * 2012-08-20 2013-01-02 上海光亮光电科技有限公司 Distributed panorama monitoring system and method thereof
CN103338343A (en) * 2013-05-29 2013-10-02 山西绿色光电产业科学技术研究院(有限公司) Multi-image seamless splicing method and apparatus taking panoramic image as reference
CN105205796A (en) * 2014-06-30 2015-12-30 华为技术有限公司 Wide-area image acquisition method and apparatus
CN104618648A (en) * 2015-01-29 2015-05-13 桂林长海发展有限责任公司 Panoramic video splicing system and splicing method
CN105894449A (en) * 2015-11-11 2016-08-24 乐卡汽车智能科技(北京)有限公司 Method and system for overcoming abrupt color change in image fusion processes
CN107659774A (en) * 2017-09-30 2018-02-02 深圳市未来媒体技术研究院 A kind of video imaging system and method for processing video frequency based on multiple dimensioned camera array
CN108171735A (en) * 2017-12-27 2018-06-15 清华大学 1,000,000,000 pixel video alignment schemes and system based on deep learning
CN108399600A (en) * 2018-02-23 2018-08-14 清华-伯克利深圳学院筹备办公室 A kind of omnidirectional imaging system and method
CN108234966A (en) * 2018-03-19 2018-06-29 成都杠上花信息技术有限公司 A kind of real-time panoramic video splicing system based on embedded platform

Similar Documents

Publication Publication Date Title
CN101431617B (en) Method and system for combining videos for display in real-time
US8417052B2 (en) Instruction system, instruction apparatus, and computer readable medium
KR101899877B1 (en) Apparatus and method for improving quality of enlarged image
US8126202B2 (en) Digital watermark padding method, digital watermark padding device, digital watermark detecting method, digital watermark detecting device, and program
JP3849645B2 (en) Monitoring device
US11194536B2 (en) Image processing method and apparatus for displaying an image between two display screens
CN109040792B (en) Processing method for video redirection, cloud terminal and cloud desktop server
CN109429037B (en) Image processing method, device, equipment and system
US10504263B2 (en) Adaptive high dynamic range (HDR) tone mapping with overlay indication
SG185110A1 (en) Multiple-site drawn-image sharing apparatus, multiple-site drawn-image sharing system, method executed by multiple-site drawn-image sharing apparatus, program, and recording medium
WO2014142632A1 (en) Control of frequency lifting super-resolution with image features
CN113570626B (en) Image cropping method and device, computer equipment and storage medium
US20230245685A1 (en) Removing Visual Content Representing a Reflection of a Screen
US20220199120A1 (en) Image processing device, image processing method, and image processing program
JP2006516862A (en) Method and apparatus for combining video signals to produce a comprehensive video signal
CN110928509B (en) Display control method, display control device, storage medium, and communication terminal
US20180211445A1 (en) Information processing device, terminal, and remote communication system
JP2003348500A (en) Projection image adjustment method, image projection method, and projector
KR20120054746A (en) Method and apparatus for generating three dimensional image in portable communication system
CN112529778B (en) Image stitching method and device of multi-camera equipment, storage medium and terminal
CN111970481A (en) Ultrahigh-definition decoding and splicing video method and system based on 5G transmission
WO2023029252A1 (en) Multi-viewpoint video data processing method, device, and storage medium
US20060008172A1 (en) Image compensating system and method for a mobile terminal imaging device
GB2616188A (en) Method and apparatus for creating panoramic picture on basis of large screen, and intelligent terminal and medium
EP3407297A1 (en) Method and device for determining a characteristic of a display device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20201120