CN105657217A - Digitized audio/video integrated stage dispatching system - Google Patents

Abstract

The invention belongs to the technical field of digital communication, and relates to a digital audio and video integrated stage dispatching system. The camera device is set in a place that needs to be monitored, and the host computer is connected to the camera device for transcoding video information. The terminals are respectively connected to the host, and the host is the core of the dispatching system, which is used to deploy multimedia mobile terminal extensions, manage inter-terminal calls, and implement dispatching functions, etc. The number of multimedia mobile terminals is determined according to actual needs; its structure is simple, It is easy to operate. Through the establishment of high-performance client interconnection, the technical integration of the centralized control system and the control of digital stage effects are realized.

Description

A digital audio and video integrated stage scheduling system

Technical field:

The invention belongs to the technical field of digital communication, and relates to a digital audio and video integrated stage scheduling system.

Background technique:

The traditional stage supervision and scheduling system uses simple electronic technology to carry out rough digital correlation and real-time data recording of each stage hardware and staff under the monitoring system: the specific method is generally that all data of the monitoring system are streamed The server exchanges, and the video data collected by the camera equipment is compressed and encoded, then transmitted to the recording server through the streaming media server for collection, and finally the video data is stored with digital signals. The entire work process is extremely complicated due to the association of different hardware devices one by one. It is not conducive to the operation of system controllers and the cooperation of cast members; moreover, the series interleaving of each connection point is prone to errors, so once the central equipment fails, it will inevitably lead to the overall paralysis of the system. In addition, due to the different standards of different manufacturers of traditional stage management systems and intercom systems, users cannot choose products from different manufacturers according to their needs. If they pursue system simplicity, they often choose products of the same brand, which will lead to high cost , there is no practical opportunity for some redundant functions; if the pursuit of cost is appropriate, multiple brands will often be introduced, resulting in equipment incompatibility or system complexity, and even easily leading to the monopoly of big brands. Therefore, building a networked stage supervision and dispatching system to achieve uniform standards, compatible use of various brands and easy online system control, not only facilitates users to choose according to their own needs, but also facilitates convenient and flexible creativity for various companies. The advanced stage control method has great theoretical and practical significance for promoting the in-depth development of the stage supervision and scheduling system.

At present, some studies have proposed a rapid creative virtual-real interactive digital stage integration system database based on SOA technology architecture for the general interface design of the basic database of the digital stage system to realize the data interconnection and resource sharing between the digital stage system and its various subsystems. Its core is that the SOA system is a service-oriented architecture component model, which can connect different functional units of the application through well-defined interfaces and contracts between these services, where the interfaces are defined in a neutral way. Independent of the hardware platform, operating system and programming language for realizing the service—establish the overall framework of the general interface of the database of the digital stage integration system, define the SOA interface module to realize the data sharing and exchange between the various subsystems and the database in the whole system, but this This method does not organically combine the client terminal, a generational convenient way, with the stage control system, and cannot guarantee the popularization and convenience of the entire operation control method. The communication system and personnel deployment require regular training of professionals, which costs money. But it cannot form the standardization of the whole industry.

Invention content:

The purpose of the present invention is to overcome the shortcomings of the prior art, and seek to design a high-performance, easy-to-use digital audio-video integrated stage dispatching system, which is widely used in stage supervision and dispatching systems.

In order to achieve the above object, the main body of the present invention includes camera, terminal microphone/speaker, multimedia mobile terminal and host; It is directly connected with the camera device to transcode the video information. The encoding format of the host is H.323; the host supports dual/multi-screen, dual-stream sharing, video window switching, interactive whiteboard, remote control, raise your hand to speak, text message , file sharing, meeting appointment, email reminder and other practical functions, using 128-bit AES encryption algorithm, the master controller of the host has super authority, can set the communication password of each terminal, and supports 1080P high-definition through broadband communication over 10M optical fiber Picture quality, high-definition file sharing, high-definition voice, high-definition video real-time recording, no mosaic, no delay, no freeze; multimedia mobile terminals are connected to Wi-Fi respectively; terminal microphones/speakers and multimedia mobile terminals are connected to the host respectively, and the host acts as The core of the dispatching system is used to deploy the registration of multimedia mobile terminal extensions, the management of calls between terminals and the realization of dispatching functions, etc. The number of multimedia mobile terminals is determined according to actual needs.

The communication between the host and the multimedia mobile terminal described in the present invention can carry out online communication without interruption, multi-site and multi-directional, and supports full screen, multi-grid and monitoring display modes, and each set of host is equipped with a fixed communication number, and the host system and Multimedia mobile terminals are connected with electronic information to realize fast online and offline coordination and synchronization of the host system, and realize the transformation from simple engineering synthesis of traditional stage auditory control and visual control to integrated system integrated control of stage effects.

The digital audio-video integrated stage scheduling system of the present invention is characterized in that the multimedia mobile terminal is a smart phone or a tablet computer.

The host of the present invention includes a voice communication unit, a video communication unit and a text communication unit. The voice communication unit realizes wireless voice communication between multimedia mobile terminals according to the operation of the user. The voice communication unit and the video communication unit enable the host to simultaneously perform video Monitoring and voice communication, integrating voice communication and video monitoring, simplifying the system, and facilitating operation; and the voice communication unit can realize point-to-point, point-to-multipoint, and multi-point-to-point voice communication between the host and any designated multimedia mobile terminal The multi-point call increases the pertinence of the call and is convenient for command and dispatch; the text communication unit realizes text communication between the host computer and the multimedia mobile terminal through the wireless network through the operation of the user.

The voice communication unit of the present invention includes a call module, a call-stop module, a recording module, a broadcast module and a conference module; wherein the call module calls the multimedia mobile terminal for voice communication according to the user's operation, and selects the multimedia terminal to be called on the interface of the host computer. Click the call button on the mobile terminal to call the selected multimedia mobile terminal, and start talking after the called multimedia mobile terminal answers. If the called multimedia mobile terminal does not answer all the time, it will automatically end the call after timeout; Click the call button to call the selected multimedia mobile terminal. The called multimedia mobile terminal can connect or reject the call, and the multimedia mobile terminal cannot initiate a call to itself; For voice communication, select the multimedia mobile terminal that needs to be barred and click the bar button to ban the selected multimedia mobile terminal. The banned multimedia mobile terminal cannot dial out to other multimedia mobile terminals, nor can it be called by other multimedia mobile terminals ;The recording module stores the voice information of the host for voice communication according to the user's operation, and provides intelligent recording file retrieval function, which is convenient for the user's management and query, and provides first-hand information and materials for the command and dispatch decision-making. Affects the performance of the communication platform and facilitates the expansion of storage space. The recording module records the task assignment, information collection, and every word and deed during the entire emergency operation process, which is not only valuable experience data but also provides evidence for future investigations; the broadcast module The multimedia mobile terminal listens to the voice communication content of the host according to the user's operation; the conference module realizes the multi-party voice communication between the host and the multimedia mobile terminal according to the user's operation.

The video communication unit of the present invention includes a video output module, a video return module, and a video recording and playback module; the video output module transmits the received video information to the host computer and the multimedia mobile terminal through the operation of the user; The return module captures images according to the user's operations and converts them into video information and sends them to the host through the wireless network; the video recording and playback module stores the received video information according to the user's operations, and stores the stored video information according to the user's operations. The information is converted into video playback, and the received video can be recorded in real time, and the recorded video files can be retrieved, with multiple retrieval methods, and the recorded files can be played back at the same time, supporting pause, stop, fast forward, slow forward, and single frame Playback and other playback control functions.

The present invention can ensure the interoperability of each site through real-time video communication: it supports multi-terminal video communication, can conduct uninterrupted multi-site multi-directional online communication and supports display modes such as full screen, multi-grid, and monitoring, even if it is not in WI-FI It only consumes very little traffic in the environment; using the form of installing corresponding clients on different platform systems can reduce expensive hardware equipment funds, avoid distance and orientation restrictions, and each set of hosts is equipped with a fixed communication number, just bind The multimedia mobile terminal can be added to the communication directory at one time, and the permanent systematic terminal cooperation operation can be realized; if the system configuration of the multimedia mobile terminal needs to be adjusted, it is only necessary to modify the system communication number of the relevant terminal.

The high-communication screen demonstration of the present invention improves the convenience of stage control: multi-terminal screen sharing and demonstration can demonstrate the screen operation of a single terminal to other operation terminals, and the screen sharing function is accompanied by brush annotation, gesture demonstration, and terminal screen jump demonstration , sound adjustment and other functions, each host is equipped with a system that fits each multimedia mobile terminal, and provides corresponding multimedia mobile terminals with similar large frames for different stage control and scheduling system positions such as sound tuning, lighting, and personnel deployment, but with different detailed functions and feature settings. Terminal; the host client enters a specific management number, and the administrator, as the central control and management dispatcher, can organize and manage a single multimedia mobile terminal at each site. The administrator has the highest authority for video communication and can control the online multimedia mobile terminal Arbitrary authority management; sub-item operators at each site can perform diversified operations on their corresponding multimedia mobile terminals to achieve efficient stage control.

The present invention can remotely operate and monitor and improve the interaction and emergency mechanism of the site: while the online multimedia mobile terminals are interactively cooperating to control the stage system, the administrator or the administrator grants the site multimedia mobile terminal with remote operation shared interface authority to move the target multimedia The remote operation of the terminal is conducive to the important role of filling the vacant site location and remediating site errors.

The operation recording function of the present invention assists the process of rights protection and information preservation: supports MCU, MP4, VLC and other file formats, and has the function of selectively saving the data and screens of the whole operation or split process, which can be saved at the beginning or in progress of the operation Audio or video recording is performed during the entire operation process, which is conducive to saving specific information and data including the detailed techniques of each multimedia mobile terminal during the operation process.

Compared with the prior art, the present invention adopts audio and video integration technology, and uses a complete solution integrating software and hardware to help users realize high-definition video interconnection anytime and anywhere, and build a multi-media mobile terminal-associated internal communication system for the host to make all-round calls for the stage , Video supervision provides a pioneering approach, on the basis of the traditional stage supervision and dispatching system's idea of "using analog or digital wired and wireless communication systems to communicate with the cast and crew of various departments", the original mobile host system and multimedia The terminal is organically combined to efficiently realize fast online and offline coordination and the synchronization of the host system; realize the simple engineering synthesis from traditional stage auditory control and visual control to integrated system integrated control of stage effects, which not only greatly improves the stability of stage operation, It also provides a technical basis for the digital integration of stage performance effects, breaks through the stage design ideas based on traditional machinery and industrial control, and realizes the development direction of multi-agents based on servo control, so as to achieve high, precise and stable stage effect control. Bring reliability theory and practical basis; its structure is simple, easy to operate, through the establishment of high-performance client interconnection, carry out technical research on stage effect application of each unit and system software development based on stage effect presentation, realize centralized control The technical integration of the system and the control of the digital stage effect.

Description of drawings:

Fig. 1 is a schematic block diagram of the principle of the main structure of the present invention.

detailed description

The present invention will be described in detail below through the embodiments and in conjunction with the accompanying drawings.

Example:

The main body of the digitized audio-video integrated stage scheduling system described in this embodiment includes a camera device 1, a terminal microphone/speaker 2, a multimedia mobile terminal 3 and a host computer 4; The image of the host 4 is converted into video information for output; the host 4 is directly connected to the camera device 1 for transcoding the video information, and the encoding format of the host 4 is H.323; the host 4 supports dual/multi-screen, dual-stream sharing, video Practical functions such as window switching, interactive whiteboard, remote control, raising hands to speak, text messages, file sharing, meeting reservations, email reminders, etc., adopt 128-bit AES encryption algorithm, the master controller of host 4 has super authority, and can set the communication of each terminal Password, through broadband communication above 10M optical fiber, supports 1080P high-definition picture quality, high-definition document sharing, high-definition voice, real-time recording of high-definition video, no mosaic, no delay, no freeze; multimedia mobile terminals 3 are respectively connected to Wi- Fi; the terminal microphone/speaker 2 and the multimedia mobile terminal 3 are respectively connected to the host 4, and the host 4 is used as the core of the dispatching system for deploying the registration of the extension of the multimedia mobile terminal 3, the management of calls between terminals and the realization of dispatching functions, etc., the multimedia The number of mobile terminals 3 is determined according to actual needs.

The communication between the host 4 and the multimedia mobile terminal 3 described in this embodiment can carry out online communication without interruption, multi-site and multi-directional and supports full screen, multi-grid and monitoring display modes, and each set of host 4 is equipped with a fixed communication number, Connect the mainframe 4 system with the electronic information of the multimedia mobile terminal to realize fast online and offline coordination and the synchronization of the mainframe 4 system, and realize the transformation from simple engineering synthesis of traditional stage auditory control and visual control to integrated system integrated control of stage effect.

The multimedia mobile terminal 3 in this embodiment is a smart phone or a tablet computer.

The host 4 described in this embodiment includes a voice communication unit, a video communication unit and a text communication unit, and the voice communication unit realizes wireless voice communication between the multimedia mobile terminals 3 according to the user's operation, and the voice communication unit and the video communication unit make the host 4 Able to carry out video monitoring and voice calls at the same time, integrate voice calls and video monitoring together, simplify the system, and facilitate operation; and the voice communication unit can realize point-to-point and point-to-point voice communication between the host 4 and any designated multimedia mobile terminal 3 Multi-point and multi-point-to-multipoint calls increase the pertinence of calls and facilitate command and dispatch; the text communication unit realizes text communication between the host 4 and the multimedia mobile terminal 3 through the wireless network through the operation of the user.

The voice communication unit described in the present embodiment includes a call module, a call-stop module, a recording module, a broadcast module and a conference module; wherein the call module calls the multimedia mobile terminal 3 according to the user's operation to carry out voice communication, and selects the required function on the interface of the host computer 4. The multimedia mobile terminal 3 of calling, clicks the call button, calls the selected multimedia mobile terminal 3, and starts talking after the called multimedia mobile terminal 3 answers, if the called multimedia mobile terminal 3 does not answer always, end the conversation automatically after overtime; The selected multimedia mobile terminal 3 can also click the call button to call the selected multimedia mobile terminal 3, and the called multimedia mobile terminal 3 can connect or reject the call, and the multimedia mobile terminal 3 cannot initiate a call to itself; The module prohibits the multimedia mobile terminal 3 from performing voice communication according to the user's operation, selects the multimedia mobile terminal 3 that needs to be banned and clicks the forbidden button, and the selected multimedia mobile terminal 3 is banned, and the banned multimedia mobile terminal 3 cannot Dial out other multimedia mobile terminals 3, and can not be called by other multimedia mobile terminals 3; the recording module stores the voice information of the voice communication of the host 4 according to the user's operation, and provides an intelligent recording file retrieval function, which is convenient for the user's management and query. Provide first-hand information and materials for command and dispatch decision-making, adopt a dedicated recording server, which will not affect the performance of the communication platform, and facilitate the expansion of storage space. Words and deeds are not only valuable experience data but also provide evidence for future investigations; the broadcast module enables the multimedia mobile terminal 3 to listen to the voice communication content of the host 4 according to the user's operation; the conference module realizes the communication between the host 4 and the multimedia mobile terminal according to the user's operation 3 Carry out multi-party voice communication.

The video communication unit described in this embodiment includes a video output module, a video return module and a video recording and playback module; the video output module transmits the received video information to the host computer 4 and the multimedia mobile terminal 3 through the operation of the user; The terminal 3 takes images according to the user's operation through the video return module and converts them into video information and transmits them to the host 4 through the wireless network; The operation converts the stored video information into video playback, can record the received video in real time, and can retrieve the recorded video files, with multiple retrieval methods, and can playback recorded files at the same time, supporting pause, stop, fast forward, Slow forward, single frame playback and other playback control functions.

Claims (6)

1. A digital audio and video integrated stage scheduling system, characterized in that the main body includes a camera, a terminal microphone/speaker, a multimedia mobile terminal and a host; the camera is arranged in a place that needs to be monitored, and is used to shoot images and convert the images taken The host is directly connected to the camera device for transcoding the video information. The encoding format of the host is H.323; the host supports dual/multi-screen, dual-stream sharing, video window switching, interactive whiteboard, and remote control , Raise your hand to speak, text message, file sharing, meeting appointment, email reminder function, adopt 128-bit AES encryption algorithm, the main controller of the host has super authority, can set the communication password of each terminal, and support every minute through broadband communication over 10M optical fiber Complete 1080P high-definition picture quality, high-definition document sharing, high-definition voice, high-definition video real-time recording, no mosaic, no delay, no freeze; multimedia mobile terminals are connected to Wi-Fi respectively; terminal microphones/speakers and multimedia mobile terminals are connected to The host is connected. The host is the core of the dispatching system. It is used to deploy multimedia mobile terminal extensions, manage inter-terminal calls, and implement dispatching functions. The number of multimedia mobile terminals is determined according to actual needs. 2. according to the said digitized audio-video integrated stage dispatching system of claim 1, it is characterized in that the communication of said host computer and multimedia mobile terminal can be uninterrupted, multi-site and multi-directional carry out online communication and support the display of full screen, multi-grid and monitoring mode, and each set of host is equipped with a fixed communication number, and the host system is connected with the multimedia mobile terminal electronic information to realize fast online and offline coordination and synchronization of the host system, and realize simple engineering synthesis from traditional stage auditory control and visual control It becomes the integrated control of the stage effect integration system. 3. The digital audio-video integrated stage scheduling system according to claim 1, characterized in that the multimedia mobile terminal is a smart phone or a tablet computer. 4. according to the said digitized audio-video integrated stage scheduling system of claim 1, it is characterized in that said main frame comprises voice communication unit, video communication unit and text communication unit, and voice communication unit realizes the communication between multimedia mobile terminal according to the user's operation Wireless voice communication, the voice communication unit and the video communication unit enable the host to perform video monitoring and voice calls at the same time, integrating voice calls and video monitoring, simplifying the system, and facilitating operation; and the voice communication unit can realize the movement of the host and any designated multimedia Point-to-point, point-to-multipoint, and multipoint-to-multipoint calls for voice communication between terminals increase the pertinence of calls and facilitate command and dispatch; the text communication unit realizes the communication between the host computer and the multimedia mobile terminal through wireless communication through the operation of the user. Network for text communication. 5. according to the said digitized audio-video integrated stage dispatching system of claim 4, it is characterized in that said voice communication unit comprises calling module, forbidden talk module, recording module, broadcasting module and conference module; Wherein calling module calls out according to user's operation The multimedia mobile terminal performs voice communication, selects the multimedia mobile terminal to be called on the host interface, clicks the call button, calls the selected multimedia mobile terminal, and the called multimedia mobile terminal starts talking after answering. If you do not answer, the call will end automatically after timeout; the selected multimedia mobile terminal can also click the call button to call the selected multimedia mobile terminal, and the called multimedia mobile terminal can connect or reject the call, and the multimedia mobile terminal cannot call Initiate a call by yourself; the barring module prohibits the multimedia mobile terminal from performing voice communication according to the user's operation, select the multimedia mobile terminal that needs to be barred and click the barring button, and the selected multimedia mobile terminal is barred. It cannot dial out to other multimedia mobile terminals, nor can it be called by other multimedia mobile terminals; the recording module stores the voice information of the host for voice communication according to the user's operation, and provides intelligent recording file retrieval function, which is convenient for the user's management and query. Command and dispatch decision-making provides first-hand information and materials, adopts a dedicated recording server, which does not affect the performance of the communication platform, and facilitates the expansion of storage space. The recording module records the task assignment, information collection, and a word during the entire emergency operation process One line is not only valuable experience data but also provides evidence for future investigations; the broadcast module enables the multimedia mobile terminal to listen to the voice communication content of the host according to the user's operation; the conference module realizes the multi-party voice communication between the host and the multimedia mobile terminal according to the user's operation . 6. according to the described digitized audio-video integrated stage dispatching system of claim 4, it is characterized in that described video communication unit comprises video output module, video return module and video recording and replay module; Video output module will receive by the user's operation The received video information is transmitted to the host and the multimedia mobile terminal; the multimedia mobile terminal captures images through the video return module according to the user's operation and converts them into video information and sends them to the host through the wireless network; the video recording and playback module sends the The received video information is stored, and the stored video information is converted into video playback according to the user's operation. The received video can be recorded in real time, and the recorded video files can be retrieved. There are multiple retrieval methods, and at the same time, it can Play back recorded files, support pause, stop, fast forward, slow forward, single frame playback and playback control functions.