CN112312112A - Multi-terminal control system of AR immersion type panoramic simulation system and control method thereof - Google Patents

Multi-terminal control system of AR immersion type panoramic simulation system and control method thereof Download PDF

Info

Publication number
CN112312112A
CN112312112A CN202011202741.XA CN202011202741A CN112312112A CN 112312112 A CN112312112 A CN 112312112A CN 202011202741 A CN202011202741 A CN 202011202741A CN 112312112 A CN112312112 A CN 112312112A
Authority
CN
China
Prior art keywords
server
simulation system
screen
video
studio
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011202741.XA
Other languages
Chinese (zh)
Inventor
刘祺
刘福菊
孙兴
董伟利
张旭东
李永星
贺海龙
刘星辰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Dahooo Technology Co Ltd
Original Assignee
Beijing Dahooo Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Dahooo Technology Co Ltd filed Critical Beijing Dahooo Technology Co Ltd
Priority to CN202011202741.XA priority Critical patent/CN112312112A/en
Publication of CN112312112A publication Critical patent/CN112312112A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/122Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2624Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of whole input images, e.g. splitscreen
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/268Signal distribution or switching
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/015High-definition television systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

The invention discloses a multi-terminal control system of an AR immersion type panoramic simulation system and an automatic control method thereof, wherein the multi-terminal control system comprises a master control server, a large-screen control computer, an AR rendering server, a video distributor, a high-definition switcher, a recorder/non-editing and switching table, wherein the master control server, the large-screen control computer, the AR rendering server, the video distributor, the high-definition switcher and the recorder/non-editing and switching; the system comprises a channel server, a video splicing processor, an LED display screen, a network switch, a mobile computer, an infrared camera, a camera, an AR foreground tracking server, an AR tracking server, an HDMI converter and a host return-to-watch screen, wherein the channel server, the video splicing processor, the LED display screen, the network switch, the mobile computer, the infrared camera, the AR foreground tracking server, the HDMI converter and the host return; and the mobile terminal equipment is in data connection and communication with the master control server. The invention has the beneficial effects that: when the user experiences the AR panorama simulation system, the AR panorama simulation system is completely immersed in the AR panorama environment, integrity in the using process is not disturbed, tedious and low-efficiency communication is omitted, and personnel cost is saved.

Description

Multi-terminal control system of AR immersion type panoramic simulation system and control method thereof
Technical Field
The invention belongs to the technical field of simulation, and particularly relates to a multi-terminal control system of an AR immersive panoramic simulation system and a control method thereof.
Background
The AR immersive panoramic simulation system multi-terminal control system is mature at present and has been applied to a plurality of television stations and broadcast and television media, and has gradually become one of essential systems in the broadcast and television industry. In the using process, the functions of the system are continuously updated and perfected, and feedback opinions used by users are continuously absorbed, wherein the communication problem between operators and field watchers is more prominent. The main server is located in the studio, and a sound insulation structure and sound insulation processing are usually arranged between the studio and the studio, so that direct communication cannot be achieved, and communication need to be achieved through electronic equipment such as an interphone. In the practical process, the situation that a scene or a lens is not understood differently by a worker of an operating system between a field person in charge and a director often occurs, so that a certain time is wasted, and meanwhile, the situations that communication reply is not timely, information transmission is not accurate and the like exist. The best effect of scene adjustment cannot be achieved.
Disclosure of Invention
The invention provides a multi-terminal control system of an AR immersion type panoramic simulation system and a control method thereof, which are used for solving the problems in the prior art, improving the communication efficiency and avoiding inaccurate information transfer.
The invention discloses a multi-terminal control system of an AR immersion type panoramic simulation system and a control method thereof, wherein other electronic equipment (such as mobile intelligent equipment like a smart phone and IPDA (Internet digital application) except a host server) is used for operating the system through wireless transmission, so that the labor cost in shooting, visiting and explaining can be greatly reduced, the whole system is combined with people more tightly, the operation is smoother, the technological sense is stronger, the link of intermediate communication is omitted, the error probability is greatly reduced, and the working efficiency is improved.
The invention relates to a multi-terminal control system of an AR immersion type panoramic simulation system, which comprises a master control server, a large-screen control computer, an AR rendering server, a video distributor, a high-definition switcher, a recorder/non-editing and switching table, wherein the master control server, the large-screen control computer, the AR rendering server, the video distributor, the high-definition switcher and the recorder/non-editing and switching table are arranged in a director room; the system comprises a channel server, a video splicing processor, an LED display screen, a network switch, a mobile computer, an infrared camera, a camera, an AR foreground tracking server, an AR tracking server, an HDMI converter and a host return-to-watch screen, wherein the channel server, the video splicing processor, the LED display screen, the network switch, the mobile computer, the infrared camera, the AR foreground tracking server, the HDMI converter and the host return; and the mobile terminal equipment is in data connection and communication with the master control server.
Furthermore, the multi-terminal control system of the AR immersive panoramic simulation system is characterized in that the mobile terminal device is a mobile phone or a tablet computer; the mobile terminal equipment and the master control server adopt a wireless communication technology to transmit data and instructions, and the wireless communication technology is a 5G communication technology.
Furthermore, the multi-terminal control system of the AR immersive panoramic simulation system comprises a general control server arranged in a program director room, wherein the general control server comprises a three-dimensional stitching module, a panoramic splicing module and a PBR material system.
Further, in the AR immersive panorama simulation system multi-terminal control system of the present invention, the AR rendering server installed in the director room includes a PBR material system.
Furthermore, the AR immersive panoramic simulation system multi-terminal control system comprises three sets of channel servers, wherein the channel servers are arranged in a studio and comprise three-dimensional rendering systems.
Further, the multi-terminal control system of the AR immersive panoramic simulation system is characterized in that the video splicing processor arranged in the studio is simultaneously connected with the channel server and the LED display screen, and the LED display screen comprises a left screen, a right screen and a ground screen.
Furthermore, the AR immersive panoramic simulation system multi-terminal control system is characterized in that a camera arranged in a studio is connected with a high-definition switcher in a studio, the camera comprises a positioning mark, and the camera is provided with three parts; the network switch is connected with 6 infrared cameras; the network switch is NETGEARProSafe; the P41 kinetic computer comprises the program MTV-TKR; and the video distributor in the studio is connected with the HDMI converter in the studio.
The invention discloses a control method of a multi-terminal control system of an AR immersive panoramic simulation system, which comprises the following steps:
a) the mobile terminal equipment establishes communication contact with the master control server through a 5G communication technology;
b) external video input is transmitted to the video splicing processor through the large-screen control computer through the master control server; simultaneously, external video input is transmitted to the video distributor through the AR rendering server;
c) the video splicing server receives and processes the data from the channel server, and transmits the processed data to the LED display screen.
Further, the control method of the AR immersive panorama simulation system multi-terminal control system of the present invention further includes a step of transmitting the data to the high definition switcher by the camera in the studio, and returning the data to the AR rendering server by the high definition switcher.
Further, the control method of the multi-terminal control system of the AR immersive panorama simulation system of the present invention further includes the following steps in step b:
the video distributor transmits the data to the HDMI converter and outputs the data to the host return-to-view screen through the HDMI converter;
the video distributor outputs data to a high-definition monitor, a recorder/non-editing and switching station.
The invention has the beneficial effects that:
when a user experiences the AR panoramic simulation system, the simulation system is completely immersed in an AR panoramic environment, the integrity in the using process is not disturbed, the complex and low-efficiency communication is omitted, and the personnel cost is saved; in the using process of a client, a visiting team comes to visit a company, two to three persons are needed to be matched between the guide at each time, in the explaining process, the operation that colleagues in a studio need to be told by a microphone continuously is avoided, the completeness of visiting is kept, the scientific and technological sense and the intellectualization of the existing system are all embodied, and the immersion sense is really realized.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this application, illustrate embodiments of the invention and, together with the description, serve to explain the invention and not to limit the invention. In the drawings:
fig. 1 is a topological diagram of the multi-terminal control system of the AR immersive panoramic simulation system of the present invention.
Detailed Description
The present invention will be described in detail below with reference to the embodiments with reference to the attached drawings. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
The following detailed description is exemplary in nature and is intended to provide further details of the invention. Unless otherwise defined, all technical terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of exemplary embodiments according to the invention.
Example 1
As shown in figure 1, the invention discloses a multi-terminal control system of an AR immersive panoramic simulation system and a control method thereof, wherein other electronic devices (such as mobile intelligent devices like a smart phone and IPDA) except a host server are used for operating the system through wireless transmission, so that the labor cost during shooting, visiting and explaining can be greatly reduced, the whole set of system is combined with people more tightly, the operation is smoother, the technological sense is stronger, the link of intermediate communication is omitted, the error probability is greatly reduced, and the working efficiency is improved.
The invention relates to a multi-terminal control system of an AR immersion type panoramic simulation system, which comprises a master control server, a large-screen control computer, an AR rendering server, a video distributor, a high-definition switcher, a recorder/non-editing and switching table, wherein the master control server, the large-screen control computer, the AR rendering server, the video distributor, the high-definition switcher and the recorder/non-editing and switching table are arranged in a director room; the system comprises a channel server, a video splicing processor, an LED display screen, a network switch, a mobile computer, an infrared camera, a camera, an AR foreground tracking server, an AR tracking server, an HDMI converter and a host return-to-watch screen, wherein the channel server, the video splicing processor, the LED display screen, the network switch, the mobile computer, the infrared camera, the AR foreground tracking server, the HDMI converter and the host return; and the mobile terminal equipment is in data connection and communication with the master control server.
Furthermore, the multi-terminal control system of the AR immersive panoramic simulation system is characterized in that the mobile terminal device is a mobile phone; the mobile terminal equipment and the master control server adopt a wireless communication technology to transmit data and instructions, and the wireless communication technology is a 5G communication technology.
Furthermore, the multi-terminal control system of the AR immersive panoramic simulation system comprises a general control server arranged in a program director room, wherein the general control server comprises a three-dimensional stitching module, a panoramic splicing module and a PBR material system.
Further, in the AR immersive panorama simulation system multi-terminal control system of the present invention, the AR rendering server installed in the director room includes a PBR material system.
Furthermore, the AR immersive panoramic simulation system multi-terminal control system comprises three sets of channel servers, wherein the channel servers are arranged in a studio and comprise three-dimensional rendering systems.
Further, the multi-terminal control system of the AR immersive panoramic simulation system is characterized in that the video splicing processor arranged in the studio is simultaneously connected with the channel server and the LED display screen, and the LED display screen comprises a left screen, a right screen and a ground screen.
Furthermore, the AR immersive panoramic simulation system multi-terminal control system is characterized in that a camera arranged in a studio is connected with a high-definition switcher in a studio, the camera comprises a positioning mark, and the camera is provided with three parts; the network switch is connected with 6 infrared cameras; the network switch is NETGEARProSafe; the P41 kinetic computer comprises the program MTV-TKR; and the video distributor in the studio is connected with the HDMI converter in the studio.
The invention discloses a control method of a multi-terminal control system of an AR immersive panoramic simulation system, which comprises the following steps:
a) the mobile terminal equipment establishes communication contact with the master control server through a 5G communication technology;
b) external video input is transmitted to the video splicing processor through the large-screen control computer through the master control server; simultaneously, external video input is transmitted to the video distributor through the AR rendering server;
c) the video splicing server receives and processes the data from the channel server, and transmits the processed data to the LED display screen.
Further, the control method of the AR immersive panorama simulation system multi-terminal control system of the present invention further includes a step of transmitting the data to the high definition switcher by the camera in the studio, and returning the data to the AR rendering server by the high definition switcher.
Further, the control method of the multi-terminal control system of the AR immersive panorama simulation system of the present invention further includes the following steps in step b:
the video distributor transmits the data to the HDMI converter and outputs the data to the host return-to-view screen through the HDMI converter;
the video distributor outputs data to a high-definition monitor, a recorder/non-editing and switching station.
Example 2
The AR immersive panorama simulation system multi-terminal control system described in this embodiment is different from that described in embodiment 1 in that the mobile terminal device is a tablet computer.
The invention has the beneficial effects that:
when a user experiences the AR panoramic simulation system, the simulation system is completely immersed in an AR panoramic environment, the integrity in the using process is not disturbed, the complex and low-efficiency communication is omitted, and the personnel cost is saved; in the using process of a client, a visiting team comes to visit a company, two to three persons are needed to be matched between the guide at each time, in the explaining process, the operation that colleagues in a studio need to be told by a microphone continuously is avoided, the completeness of visiting is kept, the scientific and technological sense and the intellectualization of the existing system are all embodied, and the immersion sense is really realized.
Finally, it should be noted that: although the present invention has been described in detail with reference to the above embodiments, those skilled in the art can make modifications and equivalents to the embodiments of the present invention without departing from the spirit and scope of the present invention, which is set forth in the claims of the present application.
It will be appreciated by those skilled in the art that the invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. The embodiments disclosed above are therefore to be considered in all respects as illustrative and not restrictive. All changes which come within the scope of or equivalence to the invention are intended to be embraced therein.

Claims (10)

1. A multi-terminal control system of an AR immersion type panoramic simulation system is characterized by comprising a master control server, a large-screen control computer, an AR rendering server, a video distributor, a high-definition switcher, a recorder/non-editing and switching table, wherein the master control server, the large-screen control computer, the AR rendering server, the video distributor, the high-definition switcher and the recorder/non-editing and switching table are arranged in a director room; the system comprises a channel server, a video splicing processor, an LED display screen, a network switch, a mobile computer, an infrared camera, a camera, an AR foreground tracking server, an AR tracking server, an HDMI converter and a host return-to-watch screen, wherein the channel server, the video splicing processor, the LED display screen, the network switch, the mobile computer, the infrared camera, the AR foreground tracking server, the HDMI converter and the host return; and the mobile terminal equipment is in data connection and communication with the master control server.
2. The AR immersive panoramic simulation system multi-terminal manipulation system of claim 1, wherein said mobile terminal device is a cell phone or a tablet computer; the mobile terminal equipment and the master control server adopt a wireless communication technology to transmit data and instructions, and the wireless communication technology is a 5G communication technology.
3. The AR immersive panoramic simulation system multi-terminal manipulation system of claim 1, wherein the grandmaster server disposed in the director room comprises a three-dimensional stitching module, a panoramic stitching module, and a PBR material system.
4. The AR immersive panorama simulation system multi-terminal manipulation system of claim 1, wherein an AR rendering server disposed in a podcast room comprises a PBR material system.
5. The AR immersive panorama simulation system multi-terminal manipulation system of claim 1, wherein said channel server disposed in the studio comprises a three-dimensional rendering system, said channel server being provided in sets of three.
6. The AR immersive panorama simulation system multi-terminal manipulation system of claim 1, wherein said video stitching processor disposed in the studio is simultaneously connected to the channel server and the LED display screens, said LED display screens including a left screen, a right screen and a ground screen.
7. The AR immersive panorama simulation system multi-terminal manipulation system of claim 1, wherein said camera disposed in the studio is connected to a high definition switcher in the studio, said camera including a positioning marker, said camera having three parts; the network switch is connected with 6 infrared cameras; the network switch is NETGEARProSafe; the P41 kinetic computer comprises the program MTV-TKR; and the video distributor in the studio is connected with the HDMI converter in the studio.
8. The control method of the AR immersive panorama simulation system multi-terminal manipulation system of claim 1, comprising the steps of:
a) the mobile terminal equipment establishes communication contact with the master control server through a 5G communication technology;
b) external video input is transmitted to the video splicing processor through the large-screen control computer through the master control server; simultaneously, external video input is transmitted to the video distributor through the AR rendering server;
c) the video splicing server receives and processes the data from the channel server, and transmits the processed data to the LED display screen.
9. The method for controlling the multi-terminal manipulation system of the AR immersive panorama simulation system of claim 8, further comprising the step of transmitting data to a high definition switcher by a camera in the studio, and returning the data to the AR rendering server by the high definition switcher in step b.
10. The method for controlling the multi-terminal manipulation system of the AR immersive panoramic simulation system of claim 8, further comprising the following steps in step b:
the video distributor transmits the data to the HDMI converter and outputs the data to the host return-to-view screen through the HDMI converter;
the video distributor outputs data to a high-definition monitor, a recorder/non-editing and switching station.
CN202011202741.XA 2020-11-02 2020-11-02 Multi-terminal control system of AR immersion type panoramic simulation system and control method thereof Pending CN112312112A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011202741.XA CN112312112A (en) 2020-11-02 2020-11-02 Multi-terminal control system of AR immersion type panoramic simulation system and control method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011202741.XA CN112312112A (en) 2020-11-02 2020-11-02 Multi-terminal control system of AR immersion type panoramic simulation system and control method thereof

Publications (1)

Publication Number Publication Date
CN112312112A true CN112312112A (en) 2021-02-02

Family

ID=74333573

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011202741.XA Pending CN112312112A (en) 2020-11-02 2020-11-02 Multi-terminal control system of AR immersion type panoramic simulation system and control method thereof

Country Status (1)

Country Link
CN (1) CN112312112A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106657719A (en) * 2017-01-04 2017-05-10 海南大学 Intelligent virtual studio system
WO2018014495A1 (en) * 2016-07-18 2018-01-25 范治江 Real-time panoramic live broadcast network camera and system and method
CN109639933A (en) * 2018-12-07 2019-04-16 北京美吉克科技发展有限公司 A kind of method and system of 360 degree of panorama program makings of virtual studio
CN109769082A (en) * 2018-12-11 2019-05-17 北京美吉克科技发展有限公司 A kind of virtual studio building system and method for recording based on VR tracking
CN110599603A (en) * 2019-09-20 2019-12-20 上海大学 Mechanical equipment visual interaction and equipment state monitoring system and method based on augmented reality

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018014495A1 (en) * 2016-07-18 2018-01-25 范治江 Real-time panoramic live broadcast network camera and system and method
CN106657719A (en) * 2017-01-04 2017-05-10 海南大学 Intelligent virtual studio system
CN109639933A (en) * 2018-12-07 2019-04-16 北京美吉克科技发展有限公司 A kind of method and system of 360 degree of panorama program makings of virtual studio
CN109769082A (en) * 2018-12-11 2019-05-17 北京美吉克科技发展有限公司 A kind of virtual studio building system and method for recording based on VR tracking
CN110599603A (en) * 2019-09-20 2019-12-20 上海大学 Mechanical equipment visual interaction and equipment state monitoring system and method based on augmented reality

Similar Documents

Publication Publication Date Title
US11240403B2 (en) Compensation for delay in PTZ camera system
CN102325144B (en) Method and system for interconnection between media equipment and multimedia equipment
US8893168B2 (en) Method and system for synchronization of dial testing and audience response utilizing automatic content recognition
CN109257802B (en) Method and apparatus for communication using Wi-Fi network
EP2821915A2 (en) Method and apparatus for controlling display of shared screen
WO2021189650A1 (en) Real-time video stream display method, headset, storage medium, and electronic device
KR20190047598A (en) Method and device of transmitting data
CN110475126A (en) A kind of interface adaptation method for media content sharing process
WO2015035865A1 (en) Methods and systems for controlling microphone order
CN113411621A (en) Audio data processing method and device, storage medium and electronic equipment
KR101581343B1 (en) Method and apparatus for providing user interface menu of multi-angle video service
CN108401163B (en) Method and device for realizing VR live broadcast and OTT service system
CN105578110A (en) Video call method, device and system
CN101998044A (en) Method and apparatus for live capture image
CN102540690A (en) Apparatus and method for generating three dimensional image in portable terminal
CN112770078B (en) Video conference terminal fusion method and device and readable storage medium
CN112312112A (en) Multi-terminal control system of AR immersion type panoramic simulation system and control method thereof
CN103037198A (en) System and method for monitoring videos
CN112383679A (en) Remote same-screen remote interview mode of AR immersive panoramic simulation system at different places and control method thereof
CN113259615B (en) Focal length adjusting method and device, terminal equipment and storage medium
CN111385590A (en) Live broadcast data processing method and device and terminal
US20240048465A1 (en) 3d collaborative visual command line system to visualize and manage networked endpoints
CN104769527A (en) Mixed media from multimodal sensors
US20170222919A1 (en) Communication device, communication system, and computer program product
CN110958068B (en) Video transmission method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20210202

RJ01 Rejection of invention patent application after publication