CN113055604A - Optimal visual angle video processing system and method based on 8K video signal and AI technology - Google Patents

Optimal visual angle video processing system and method based on 8K video signal and AI technology Download PDF

Info

Publication number
CN113055604A
CN113055604A CN202110355618.XA CN202110355618A CN113055604A CN 113055604 A CN113055604 A CN 113055604A CN 202110355618 A CN202110355618 A CN 202110355618A CN 113055604 A CN113055604 A CN 113055604A
Authority
CN
China
Prior art keywords
picture
global
frame
local
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110355618.XA
Other languages
Chinese (zh)
Inventor
宋小民
吴成志
郭超
黄代羲
谭智文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sichuan Xinshi Chuangwei Ultra High Definition Technology Co ltd
Original Assignee
Sichuan Xinshi Chuangwei Ultra High Definition Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sichuan Xinshi Chuangwei Ultra High Definition Technology Co ltd filed Critical Sichuan Xinshi Chuangwei Ultra High Definition Technology Co ltd
Priority to CN202110355618.XA priority Critical patent/CN113055604A/en
Publication of CN113055604A publication Critical patent/CN113055604A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/698Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/268Signal distribution or switching

Abstract

The invention relates to an optimal visual angle video processing system and method based on 8K video signals and AI technology, comprising the following steps: the image acquisition module is used for acquiring and outputting a global picture; one or more frames for global picture content selection, said frames outputting corresponding local pictures; the invention can obtain the global picture of a shooting area based on the 8K video picture, simulate a plurality of machine positions based on the selected frame to obtain a plurality of video pictures, and realize multi-channel output under the simulation condition by switching the output of different video pictures, namely realize the video picture switching of a plurality of cameras under the traditional mode by utilizing one camera in the same video picture.

Description

Optimal visual angle video processing system and method based on 8K video signal and AI technology
Technical Field
The invention relates to video monitoring and analysis, in particular to an optimal visual angle video processing system and method based on 8K video signals and AI technology.
Background
The optimal visual angle switching system comprises a front-end camera, a transmission cable, a video switching table, a picture monitor and the like, wherein the camera is used as a collecting unit of a front-end video image signal. The complete optimal visual angle switching system is composed of a majority of camera shooting, transmission, control, switching and display 5. The video images are transmitted to the video switching platform by the plurality of cameras through the video cables, and a control person selects a certain path of optimal lens on the video switching platform to switch and output the optimal lens to the picture monitor. Through the control host, an operator can send out an instruction to control the up-down, left-right and left-right actions of the camera on the holder and perform focusing and zooming operations on the lens.
Currently, in the entire optimal view angle switching system, a multi-camera fixed-point shooting method is also adopted, i.e. a plurality of cameras shoot different objects, output different pictures, and all multi-channel video signals are transmitted to a switching console, and the defects of the method mainly lie in the following two points:
(1) the cost of front-end equipment such as a camera is increased by a multi-machine-position installation mode;
(2) in the traditional mode, aiming at the same camera, only single-unit single-channel output can be realized, namely, only one picture can be output by one camera, and the selection of the optimal visual angle is realized by a person and a switching station.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and innovatively provides an optimal visual angle video processing system and method based on 8K video signals and AI technology.
The purpose of the invention is realized by the following technical scheme:
an optimal view video processing system based on 8K video signal and AI technique, comprising:
the image acquisition module is used for acquiring and outputting a global picture;
the AI module automatically identifies the dynamic change of the target according to preset target information, outputs the local image which is dynamically changed at present to a display for displaying, and plays the global image or dynamically switches between the global image and the local image when all targets do not act.
Different from the traditional technology, the method and the device only utilize the image acquisition module to acquire the global picture of the shooting area in the scheme, so that the method and the device are different from the method and the device that a plurality of cameras are used for acquiring pictures of different shooting areas under the traditional video shooting. And then, outputting the selected picture in the global picture by using the selection frame, namely, simulating a single camera in the traditional mode by using the selection frame, namely, outputting pictures with different visual angles by using several selection frames, thus obtaining a global picture and a plurality of local video pictures, and automatically outputting the shot picture of the target once the target action is recognized when the target appears in the shooting area so as to ensure that the output picture is always maintained at the optimal visual angle.
Further, the global picture is an 8K video picture, the size of the selection frame can be adjusted through an AI module, and the picture conversion of panorama, medium view and close-up is realized through the switching of the global picture and the local picture.
Further, the image acquisition module comprises one or more 8K cameras, and when the shooting area is large enough, a plurality of 8K cameras can be used for covering.
Further, the partial pictures output by the frame selection are different from each other in overlapping, or only partially overlapped.
Furthermore, the number of the selected frames is 16 at most, and the length-width ratio of the selected frames is 4:3 or 16: 9.
Furthermore, the local picture output by the frame selection frame is a 4K picture or an HD picture.
Furthermore, the selection frame adopts manual configuration or AI identification technology to perform positioning selection and output a local picture.
Furthermore, the 8K camera is fixedly installed by adopting a rotatable base, so that the horizontal visual angle and the pitching visual angle of the overall picture can be adjusted.
An optimal visual angle video processing method based on 8K video signals and AI technology is realized by using an optimal visual angle video processing system based on 8K video signals and AI technology, and the method comprises the following steps:
1) acquiring a global picture in the shooting area through an image acquisition module;
2) configuring a plurality of picture selecting frames for selecting different local pictures of the global picture;
3) identifying dynamic change of a target in the global picture based on intelligent identification of the AI module, so that the selection frame outputs a local picture corresponding to the dynamic change to a display;
and when all the targets in the global picture do not act, switching the global picture or the local picture for displaying through the AI module.
Furthermore, each local picture and the global picture are displayed on the same display.
The invention has the beneficial effects that: compared with the traditional video shooting, the method has the advantages that an 8K camera is used for obtaining a wide-angle picture, namely a global picture, so that the whole picture of a shooting area is displayed to a user, then a picture selecting frame is used for carrying out picture selecting output in the global picture, and equivalently, the picture output by the picture selecting frame is used for simulating the video picture shot by the camera in the traditional mode, namely, the method has the technical progress with lower cost compared with the prior art; and then, the AI module is used for automatically identifying the action of the target (or the expression of the character), and then forming a corresponding close-up shot for display, and when each target has no action, displaying a global (panoramic) or medium scene picture.
Drawings
FIG. 1 is a block diagram of the system of the present invention.
Detailed Description
The technical solution of the present invention is further described in detail with reference to the following specific examples, but the scope of the present invention is not limited to the following.
Referring to fig. 1, an optimal view video processing system based on an 8K video signal and AI technique includes:
the image capturing module 100 for capturing and outputting the global picture 200 may generally select only one image capturing module 100 for the same video shooting area, in this embodiment, the image capturing module 100 employs an 8K camera, the effective video picture of the 8K camera may generally cover about 2 km, and the traditional shooting area of about 2 km may be completely covered by at least a dozen HD cameras, so that the present invention has the advantage of lower cost compared to the prior art.
The method comprises the steps that one or more frames 300 for selecting the content of the global picture 200 are selected, the frames 300 output corresponding local pictures 400, a plurality of frames 300 are arranged in the global picture 200 for picture cutting output by utilizing a video picture cutting technology, and therefore different local pictures 400 are obtained, namely the frames 300 are utilized to simulate a video camera in a traditional mode to output video pictures. Compared to the prior art, the advantage is that the output picture quality of each frame 300 is not affected by the conventional camera, and for example, the partial picture 400 output by using the frame 300 can be maintained at 4K in 8K.
The AI module 600 is further included for controlling the output sequence of the local screen 400, the AI module 600 automatically identifies the dynamic change of the target according to the preset target information, and outputs the local screen 400 that is currently generating the dynamic change to the display 500 for displaying, and when all targets do not act, the global screen 200 is played or the local screen 400 and the global screen 200 are dynamically switched.
That is, in the present invention, different frames 300 are used to simulate multiple machine positions for outputting pictures, each picture output corresponds to one channel, and multiple local pictures 400 output by multiple frames 300 realize multiple-channel output, and then the AI module 600 or the AI algorithm is used to configure the display sequence of each local picture 400, that is, to realize multiple-channel switching, which is similar to switching different cameras under the conventional video recording system, that is, to realize optimal viewing angle recording.
Optionally, in an embodiment, in an optimal view angle video processing system based on an 8K video signal and an AI technology, the global frame 200 is an 8K video frame, and further, a 16K frame may be further used for analysis, the global frame 200 is an 8K video frame, the size of the frame 300 may be adjusted by the AI module 600, and the overall frame 200 and the local frame 400 are switched to implement frame conversion of panoramic, medium-view, and close-up. That is, the middle view output is realized with the different-sized checkboxes 300, the close-up output is realized with the smaller checkbox 300, and the global view 200 is a panoramic view.
For example, in a specific application scenario, such as recording a drama on a stage, the 8K video picture is used to output the global picture 200, then the information of each main character is written in the AI module 600, and when the corresponding character is recognized to speak, the frame 300 is controlled to output the character picture, so that the optimal view angle output is always maintained in the recording process.
Optionally, in an embodiment, in an optimal viewing angle video processing system based on an 8K video signal and an AI technology, the image capturing module 100 includes one or more 8K cameras, which may be specifically determined according to an area of a shooting area, and a diameter of the shooting area that can be covered by one 8K camera is generally about 2 km, so that corresponding 8K cameras should be reasonably added beyond the shooting area.
Optionally, in an embodiment, in an optimal view angle video processing system based on 8K video signal and AI technology, the partial frames 400 output by the frame 300 are overlapped with each other differently, or only partially. The maximum number of the checkboxes 300 is 16, and the length-width ratio of the checkbox 300 is 4:3 or 16: 9. The partial picture 400 output by the frame 300 is a 4K picture, or an HD picture.
Optionally, in an embodiment, in an optimal viewing angle video processing system based on 8K video signals and AI technology, the frame 300 is positioned and selected by using manual configuration or AI recognition technology, and outputs the partial frame 400.
Optionally, in an embodiment, in the optimal viewing angle video processing system based on the 8K video signal and the AI technology, the 8K camera is fixedly installed by using a rotatable base, so that the horizontal viewing angle and the pitch viewing angle of the global frame 200 are adjustable.
An optimal visual angle video processing method based on 8K video signals and AI technology is realized by using an optimal visual angle video processing system based on 8K video signals and AI technology, and the method comprises the following steps:
1. acquiring a global picture 200 in a shooting area through an image acquisition module 100;
2. configuring a plurality of frames 300 for selecting different local frames 400 of the global frame 200;
3. based on the intelligent recognition of the AI module 600, identifying the dynamic change of the target in the global frame 200, so that the frame 300 outputs the local frame 400 corresponding to the dynamic change to the display 500;
when all the objects in the global screen 200 do not act, the AI module 600 switches the global screen 200 or the local screen 400 to display or only displays the global screen 200.
Each of the local screen 400 and the global screen 200 is displayed on the same display 500.
The foregoing is illustrative of the preferred embodiments of this invention, and it is to be understood that the invention is not limited to the precise form disclosed herein and that various other combinations, modifications, and environments may be resorted to, falling within the scope of the concept as disclosed herein, either as described above or as apparent to those skilled in the relevant art. And that modifications and variations may be effected by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (10)

1. An optimal view video processing system based on 8K video signal and AI technique, comprising:
an image acquisition module (100) for acquiring and outputting a global picture (200);
one or more checkboxes (300) for global picture (200) content selection, the checkboxes (300) outputting corresponding local pictures (400);
the system also comprises an AI module (600) used for controlling the output sequence of the local pictures (400), wherein the AI module (600) automatically identifies the dynamic change of the target according to preset target information, outputs the local pictures (400) which are generated with dynamic change to a display (500) for displaying, and plays the global picture (200) or dynamically switches between the global picture (200) and the local pictures (400) when all targets do not act.
2. The optimal view video processing system based on 8K video signal and AI technology according to claim 1, characterized in that the global picture (200) is an 8K video picture, the size of the frame (300) can be adjusted by the AI module (600), and the full-view, medium-view and close-up picture conversion is realized by switching the global picture (200) and the local picture (400);
the global screen (200) and the local screen (400) are displayed using different displays (500).
3. The optimal perspective video processing system based on 8K video signal and AI technology according to claim 2, characterized in that the image acquisition module (100) comprises one or more 8K cameras.
4. The system of claim 3, wherein the partial frames (400) output by the frame (300) are different from each other in overlap, or only partially overlap.
5. The system of claim 4, wherein the number of the keyframes (300) is at most 16, and the ratio of the length to the width of the keyframe (300) is 4:3 or 16: 9.
6. The system of claim 5, wherein the keyframe (300) outputs a partial frame (400) that is a 4K frame or an HD frame.
7. The system of claim 6, wherein the frame (300) is positioned and selected by a human operator or an AI recognition technique to output a local frame (400).
8. The optimal perspective video processing system based on 8K video signal and AI technology according to claim 7, characterized in that the 8K camera is fixedly mounted with a rotatable stand, so that the horizontal perspective and the pitch perspective of the global view (200) are adjustable.
9. An optimal view video processing method based on 8K video signal and AI technology, which is implemented by the optimal view video processing system based on 8K video signal and AI technology according to any one of claims 1-8, characterized by the steps of:
1) acquiring a global picture (200) in a shooting area through an image acquisition module (100);
2) configuring a plurality of selection frames (300) for selecting different local frames (400) of the global frame (200);
3) identifying dynamic change of a target in the global picture (200) based on intelligent identification of the AI module (600), so that the frame selection frame (300) outputs a local picture (400) corresponding to the dynamic change to the display (500);
when all the targets in the global picture (200) do not act, the global picture (200) or the local picture (400) is switched by the AI module (600) to be displayed, or only the global picture (200) is displayed.
10. The optimal view video processing method based on 8K video signal and AI technique according to claim 9, characterized in that each local picture (400) and global picture (200) are displayed on the same display (500).
CN202110355618.XA 2021-04-01 2021-04-01 Optimal visual angle video processing system and method based on 8K video signal and AI technology Pending CN113055604A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110355618.XA CN113055604A (en) 2021-04-01 2021-04-01 Optimal visual angle video processing system and method based on 8K video signal and AI technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110355618.XA CN113055604A (en) 2021-04-01 2021-04-01 Optimal visual angle video processing system and method based on 8K video signal and AI technology

Publications (1)

Publication Number Publication Date
CN113055604A true CN113055604A (en) 2021-06-29

Family

ID=76517160

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110355618.XA Pending CN113055604A (en) 2021-04-01 2021-04-01 Optimal visual angle video processing system and method based on 8K video signal and AI technology

Country Status (1)

Country Link
CN (1) CN113055604A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114245032A (en) * 2021-12-21 2022-03-25 睿魔智能科技(深圳)有限公司 Automatic switching method and system for video framing, video player and storage medium
CN114257757A (en) * 2021-12-21 2022-03-29 睿魔智能科技(深圳)有限公司 Automatic cutting and switching method and system of video, video player and storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004214830A (en) * 2002-12-27 2004-07-29 Iwane Kenkyusho:Kk Partial real time image display
JP2005094799A (en) * 2004-11-15 2005-04-07 Chuo Electronics Co Ltd Integrated video display device
JP2006033353A (en) * 2004-07-15 2006-02-02 Seiko Epson Corp Apparatus and method of processing image, imaging apparatus, image processing program and recording medium recording image processing program
CN103093654A (en) * 2013-01-28 2013-05-08 北京航空航天大学 Double video camera interactive intelligent tracking teaching system
CN103905734A (en) * 2014-04-17 2014-07-02 苏州科达科技股份有限公司 Method and device for intelligent tracking and photographing
CN105578044A (en) * 2015-12-22 2016-05-11 杭州凡龙科技有限公司 Panoramic view adaptive teacher image analysis method
CN109873980A (en) * 2019-01-24 2019-06-11 深圳市景阳信息技术有限公司 Video monitoring method, device and terminal device
CN111343393A (en) * 2020-02-25 2020-06-26 四川新视创伟超高清科技有限公司 Ultrahigh-definition video picture cutting method

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004214830A (en) * 2002-12-27 2004-07-29 Iwane Kenkyusho:Kk Partial real time image display
JP2006033353A (en) * 2004-07-15 2006-02-02 Seiko Epson Corp Apparatus and method of processing image, imaging apparatus, image processing program and recording medium recording image processing program
JP2005094799A (en) * 2004-11-15 2005-04-07 Chuo Electronics Co Ltd Integrated video display device
CN103093654A (en) * 2013-01-28 2013-05-08 北京航空航天大学 Double video camera interactive intelligent tracking teaching system
CN103905734A (en) * 2014-04-17 2014-07-02 苏州科达科技股份有限公司 Method and device for intelligent tracking and photographing
CN105578044A (en) * 2015-12-22 2016-05-11 杭州凡龙科技有限公司 Panoramic view adaptive teacher image analysis method
CN109873980A (en) * 2019-01-24 2019-06-11 深圳市景阳信息技术有限公司 Video monitoring method, device and terminal device
CN111343393A (en) * 2020-02-25 2020-06-26 四川新视创伟超高清科技有限公司 Ultrahigh-definition video picture cutting method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114245032A (en) * 2021-12-21 2022-03-25 睿魔智能科技(深圳)有限公司 Automatic switching method and system for video framing, video player and storage medium
CN114257757A (en) * 2021-12-21 2022-03-29 睿魔智能科技(深圳)有限公司 Automatic cutting and switching method and system of video, video player and storage medium

Similar Documents

Publication Publication Date Title
JP7123523B2 (en) Method and system for automatically producing television programs
CA2949005C (en) Method and system for low cost television production
JP4153146B2 (en) Image control method for camera array and camera array
US3919475A (en) Head attached television
WO2018094443A1 (en) Multiple video camera system
US20080109729A1 (en) Method and apparatus for control and processing of video images
CN113055604A (en) Optimal visual angle video processing system and method based on 8K video signal and AI technology
US9762864B2 (en) System and method for monitoring at least one observation area
JP2009284452A (en) Hybrid video camera imaging apparatus and system
US10397474B2 (en) System and method for remote monitoring at least one observation area
JP2006295941A (en) Camera system with pip in viewfinder
CN107734212A (en) A kind of automatic recorded broadcast director system
CN211699286U (en) Full-automatic intelligent recording and broadcasting classroom
US20020130955A1 (en) Method and apparatus for determining camera movement control criteria
CN112866578B (en) Global-to-local bidirectional visualization and target tracking system and method based on 8K video picture
CN107431846A (en) Image transfer method, equipment and system based on multiple video cameras
CN112866651A (en) Super-channel super-machine-position video processing or monitoring system and method based on 8K camera
CN108234904A (en) A kind of more video fusion method, apparatus and system
CN115315939A (en) Information processing apparatus, information processing method, and program
US9241140B2 (en) Arrangement for video surveillance
CN117156258B (en) Multi-view self-switching system based on panoramic live broadcast
CN115589531B (en) Shooting method, shooting system and storage medium of target scene
JP2000152216A (en) Video output system
WO2023189079A1 (en) Image processing device, image processing method, and program
JP3201451B2 (en) Live race relay system for boat races

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination