KR102168948B1 - Mobile video control system and and operation method thereof - Google Patents

Abstract

The present invention relates to a mobile video control system and an operating method thereof, the mobile video control system comprising: a mobile device transmitting a source data packet including at least one between a video source and a sound source through a communication network; an all-in-one server connected to the mobile device to communicate therewith through the communication network, and converting the received source data packet into a source signal including at least one between a video signal and a sound signal to output the same; a video and sound output device including at least one display device and a speaker device; and a wall controller connected to the all-in-one server to communicate therewith through a physical cable, and converting the received source signal such that the same may be outputted through the video and sound output device before transmitting the same to the video and sound output device. Therefore, according to the present invention, a mobile device such as a smartphone can be utilized as a device which can transmit video, sound, data and the like in real time to construct a control system.

Description

Mobile video control system and operation method thereof TECHNICAL FIELD

The present invention relates to a mobile video control system and a method of operation thereof, and more particularly, to a mobile video control system capable of configuring a control system by utilizing a mobile device as a device capable of transmitting images, sound, data, etc. in real time, and It relates to how it works.

In general, the control system refers to an information system for establishing a low-cost and high-efficiency operating system by remotely managing CCTV video monitoring, facility monitoring, monitoring and analysis of measurement data such as energy consumption or water quality, etc. at a central control center.

A wall system is typically used for such a control system. The wall system can display images input from various source devices on a plurality of display devices, and divide one image into a plurality of images. An image may be displayed on a plurality of display devices, respectively. By using such a wall system, it is possible to overcome the limitation of the image size that can be displayed by one display device.

However, in the case of a general wall system, in order to display images on a plurality of display devices, direct connection from another source device to the wall controller using a physical cable, or through the internal network setting, the source device is connected. must do it.

Accordingly, a general wall system cannot collect and use related images or data from the source device unless it is a source device connected to a pre-built network. In addition, in the case of a disaster site, even if the source device is installed in advance, there are cases where the source device is damaged or malfunctions, so that desired information cannot be collected.

Therefore, there is an excuse to consider a method of constructing a control system by using a mobile device such as a smartphone that is always carried as a device that can transmit an image source or sound source in real time.

Accordingly, an object of the present invention is to provide a mobile video control system capable of configuring a control system by using a mobile device as a device capable of transmitting video, sound, data, and the like in real time, and an operation method thereof.

The video control system according to the present invention for achieving the above object includes a mobile device that transmits a source data packet including at least one of an image source and an audio source through a communication network, and communicates with the mobile device through the communication network. An all-in-one server that is connected to each other and converts the received source data packet into a source signal including at least one of an image signal and an audio signal, and outputs a video and audio output device including at least one display device and a speaker device, and a physical And a wall controller that is communicatively connected to the all-in-one server through a cable and converts the received source signal to be output from the video and audio output device, and outputs the converted source signal to the video and audio output device.

The mobile device and the all-in-one server may transmit and receive data using WebRTC, and according to the data transmitted from the mobile device, the video window displayed on the video and audio output device is created, terminated, displayed, hidden, and Control of any one of the movements can be performed,

In addition, the operating method of the mobile video control system according to the present invention for achieving the above object, the step of transmitting a source data packet including at least one of an image source and a sound source through a communication network in the mobile device, the all-in-one server Converting the received source data packet into a source signal including at least one of an image signal and an audio signal by being communicatively connected to the mobile device through a communication network and outputting the converted source signal, and the wall controller through a physical cable And converting the received source signal so as to be outputable by a video/audio output device including at least one display device and a speaker device, and outputting the converted source signal to the video/audio output device.

In order to achieve the above object, the present invention provides a recording medium that can be read by a processor in which a program for executing the operation method in a processor is recorded.

According to the present invention, a control system can be constructed by utilizing a mobile device such as a smartphone, which is always carried, as a device capable of transmitting images, sounds, data, etc. in real time. By using a mobile device in this way, video, sound, data, etc. can be transmitted to the control room in real time without limitation of distance and location anytime, anywhere, enabling rapid response to disaster situations. In addition, it is possible to control images displayed in the control room through a mobile device, and related information can be transmitted through real-time video communication or chat.

1 is a block diagram illustrating a configuration of a mobile video control system according to an embodiment of the present invention.
2 is a diagram referred to for explaining the operation of the wall controller;
3 is a signal flow diagram provided for explaining a method of operating a mobile video control system according to an embodiment of the present invention, and
4 to 7 are views referenced for describing a method of operating a mobile video control system according to an embodiment of the present invention.

In the present specification, when a component is referred to as being "connected" or "connected" to another component, it may be directly connected or connected to another component to a component, but other components in the middle It should be understood that elements may exist. In addition, other expressions describing the relationship between components, such as "between" or "neighboring", and expressions such as "transmitting" a signal to another component should be interpreted as well. do.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

1 is a block diagram illustrating the configuration of a mobile video control system according to an embodiment of the present invention.

Referring to FIG. 1, the mobile video control system 100 includes first to nth mobile devices 110a to 110n, an all-in-one server 130, a wall controller 150, and a video and audio output device 170. I can. The mobile video control system 100 may additionally include a management computer 180 and a network source device 190 and the like.

When such components are implemented in an actual application, two or more components may be combined into one component, or one component may be subdivided into two or more components as necessary.

The first to nth mobile devices 110a to 110n are communicatively connected with the all-in-one server 130 through the communication network 10. The first to nth mobile devices 110a to 110n are terminals capable of transmitting images, sound, and data, and are communication networks such as a smart phone, a notebook computer, and a tablet computer. It includes all electronic devices capable of communicating with the all-in-one server 150 through (10).

The first to nth mobile devices 110a to 110n may transmit a source data packet including at least one of an image source and a sound source generated by photographing an image at a disaster site or the like through the communication network 10.

The communication network 10 refers to a network capable of communicating between the first to nth mobile devices 110a to 110n and the all-in-one server 130, such as a mobile communication network, the Internet, or a network to which they are combined.

The all-in-one server 130, the wall controller 150, and the video and audio output device 170 may be installed in the control room. The all-in-one server 130 receives a source data packet from at least one of the first to nth mobile devices 110a to 110n through the communication network 10, and transmits the received source data packet to at least one of an image signal and an audio signal. It can be converted into a source signal including a and output.

The wall controller 150 is communicatively connected to the all-in-one server 130 through a physical cable such as an HDMI cable, and converts the source signal input from the all-in-one server 130 to the format of the video and audio output device 170 Thus, it can be output to the video and audio output device 170. Since the wall controller 150 is connected to the all-in-one server 130 through a physical cable, the connection of the physical cable is cut off when necessary, and the network inside the control control room can be separated from the communication network 10.

The video and audio output device 170 may include a multi-display 173 and a speaker 175 including one or more display devices. The video and audio output device 170 may display an image signal output from the wall controller 150 on the multiple displays 173 and may output an audio signal through the speaker 175.

The management computer 180 is an administrator's computer for system management, and is used to receive video and/or sound source data packets from a wall server management program or network source device 190 for management of the wall controller 150. The source receiving program can be installed. The wall server management program controls images input to the wall controller 150, executes general programs such as powerpoint, notepad, web page, etc., and freely designates the location and size of image and/or sound sources input from the internal network. This allows the screen layout work to be performed.

The network source device 190 is a device that is communicatively connected with the wall controller 150 through an internal network to transmit an image and/or sound source data packet. The network source device 190 includes a computer or an IP camera connected through an internal network. A source transmission program for transmitting video and/or sound source data packets through the internal network may be installed in a computer connected through an internal network.

In addition, a digital/analog image source device (not shown) directly connected to the wall controller 150 using a physical cable may be further included. The digital/analog image source device is a device capable of generating a digital image signal and/or an audio signal, or an analog image signal and/or an audio signal. Digital/analog image source devices include computers such as desktop computers and notebook computers, CCTV cameras, TVs, set-top boxes, beam projectors, RGB/DVI/Video Matrix Switchers, medical equipment monitors, military aircraft radar monitors, etc. do.

With this configuration, the mobile video control system 100 receives, manages and controls video and audio data from one or more connected mobile devices 110, and transmits related data to the control control room through a P2P transmission method. have. Accordingly, images and sounds of a disaster occurrence situation in a remote location are transmitted to the control situation room through the mobile device 110 to enable a quick response.

2 is a diagram referred to for explaining the operation of the wall controller.

Referring to FIG. 2, the wall controller 150 is equipped with a source display program unit 153 and a source receiving program unit 155, and N graphics cards 157 that output an image signal and an audio signal are output. A sound card 159 may be installed.

The all-in-one server 130 can be directly connected to the wall controller 150 through a physical cable such as an HDMI cable, and can display an image in real time through a hardware image capture device that can be mounted on the wall controller 150. have. The source display program unit 153 may capture an image from a hardware capture device, or the like, and may directly display an image without image duplication or relaying of the captured image. The source display program unit 153 converts the received standard data format video according to the format of the video and audio output device 170 (NTSC, PAL, COMPOSITE, COMPNENT, HDMI, DVI, etc.), and the video and audio output device 170 Can be transferred to.

The source reception program unit 155 performs functions such as receiving data packets, parsing image and sound data, decoding image and sound, and displaying image and sound. The source receiving program unit 155 may drive one per network image and/or sound source to be received. That is, a 1:1 mapping method is used, and when a plurality of network images and sound sources are displayed, as many source receiving program units 155 as desired to be displayed may be driven. Therefore, when displaying multiple network video and/or sound sources, the wall controller 150 can drive multiple threads, and each thread parses video and/or audio data, decodes video and/or audio, and And/or a function of expressing sound.

In this way, an image or sound source may be transmitted to the wall controller 150 that controls the image and sound output device 170 through an internal network, and if necessary, the image or sound source to the wall controller 50 through a physical cable connection. Can also be transmitted. That is, the wall controller 150 adopts a hybrid method capable of providing both input methods capable of receiving an image or sound source through a physical cable or an internal network. Since the video input method through the internal network does not use a physical cable, it can be used anytime, anywhere in an environment where a network is established.

Meanwhile, the mobile video control system 100 according to the present invention may configure a system by connecting several wall controllers 150. That is, a plurality of wall controllers 150 are simultaneously connected, and the maximum number of outputs can be infinitely extended through the wall controller management program, the source transmission program unit, and the source reception program unit. In addition, the same input image can be shared among the wall controllers to be displayed without distinction on the boundary, and each wall controller can be controlled from a single management computer.

3 is a signal flow diagram provided to explain a method of operating a mobile video control system according to an embodiment of the present invention.

The mobile device 110 and the all-in-one server 130 may transmit and receive data using WebRTC (Web RealTime Communication). WebRTC is a standard designed to enable real-time video, audio, and data communication without plug-ins in web browsers or mobile applications. Recently, most web browsers support the WebRTC API standard. WebRTC includes APIs for accessing data streams such as cameras and microphones, APIs for audio or video connection, and APIs for general data P2P communication, with encryption and bandwidth management functions.

Referring to FIG. 3, the mobile device 110 and the all-in-one server 130 perform a signaling process (S200).

The signaling process is a process of enabling communication between the mobile device 110 and the web browser of the all-in-one server 130, and the following information is exchanged.

● Session Control message: Appropriate communication initialization, termination, error report

● Network Configuration: IP Address, Port exchange

● Media Capabilities: Transmission of usable codec and resolution between web browsers

When the signaling process is completed, the mobile device 110 transmits a source data packet including at least one of an image source and an audio source generated by photographing an image through the communication network 10 (S205).

The source data packet transmitted by the mobile device 110 may include a command ID for distinguishing options, a data size, and data suitable for the options.

When the all-in-one server 130 receives a data packet from the mobile device 110, it transmits a reception response message to the mobile device 110 (S210).

The all-in-one server 130 converts the source data packet into a source signal including at least one of an image signal and an audio signal and outputs it (S215).

The wall controller 150 converts the source signal received from the all-in-one server 130 into a video signal and an audio signal that can be output by the video and audio output device 170 and outputs the converted video and audio signal to the video and audio output device 170 (S220).

The video and audio output device 170 displays an image signal output from the wall controller 150 on the multiple display 173 and outputs an audio signal through the speaker 175 (S225).

Through this process, an image captured by the mobile device 110 may be displayed in real time on the video and audio output device 170 installed in the control control room.

In addition, a screen displayed on the video and audio output device 170 may be controlled by transmitting a command ID included in the data packet of the mobile device 110 and data corresponding to the command ID.

For example, in the case of generating a window in the video and audio output device 170, the mobile device 110 may indicate'command ID + data size + window position (left, top, right, bottom) + channel type + channel corresponding to window generation. Name' data packet can be transmitted. In accordance with the transmission of such data packets, a window for screen display can be created at a desired location on the screen displayed on the multiple displays 173, and in response to the transmission of this data packet, the mobile device 110 is an all-in-one server ( 130) may receive a response message indicating that the window has been created. In this case, the response message may include'ID informing that the window has been created + data size + execution result + generated window ID'.

In this way, according to the transmission of a data packet including a command ID, a data size, and data corresponding to the command ID transmitted from the mobile device 110, the channel list for image display and the channel information are imported. , Set channel ID, create window for video display, close window, get window list, move window, show or hide window, close window with matching window area, create window with border, get preset preset list , Preset execution, execution of the preset of a corresponding user, display of a message after executing the preset, and execution of a preset in a designated area can be performed. In addition, by data packet transmitted from the mobile device 110, input source changes such as cameras, schedule list import, schedule execution, schedule termination, REF server list import, REF server window is displayed on the currently connected server. , Receive server status, clear user area, switch main/sub server, change message in the corresponding ticker window, and set password.

In this way, in addition to the creation, termination, display, hiding, and movement of an image window displayed on the video and audio output device 170, various operations may be remotely controlled according to data transmitted from the mobile device 110.

4 to 7 are views referenced for describing a method of operating a mobile video control system according to an embodiment of the present invention, and FIGS. 4 to 6 are diagrams illustrating an example of a screen displayed on a mobile device. 7 shows an example of a screen displayed on the video and audio output device.

4 shows an example of a login screen.

As shown in Fig. 4, the user executes a related app or displays it on the login screen 400 through a web browser, enters an ID and password, etc. on the login screen 400, and then enters the mobile video control screen. You can enter.

5 shows an example of a mobile video control screen.

As shown in FIG. 5, the mobile video control screen 420 includes an image currently being photographed 421, a menu icon 423, a chat content 425, a video call screen 427, a menu setting icon 429, etc. Is displayed.

When the menu setting icon 429 is selected, as shown in FIG. 6, a pop-up window 430 for selecting image setting and logout is displayed. You can log out by selecting'Logout' in the pop-up window 430, and by selecting the'Video Setup' menu, the creation, termination, display, hiding, and movement of the video window displayed on the video and audio output device 170 Can be set.

Through such a mobile video control screen 400, an image and sound of a field may be photographed and transmitted, and related information may be transmitted through a real-time chat or video call.

7 shows an example of a screen displayed on a video and audio output device.

As shown in FIG. 7, a screen 460 displayed on an image output device 170 installed in a control situation room, etc. includes a screen 461 transmitted from one or more mobile devices 110, a video call screen 463, and a mobile device. A map screen 465 indicating the location of the device, chat content 467, and the like can be displayed. Also, a screen 469 transmitted from another mobile device may be simultaneously displayed on this screen 460.

In a specific mobile device 110, the image transmitted by itself may be moved to the center of the screen 460 and displayed, or may be displayed in other locations. In addition, the size of the window on which the image is displayed, opening, closing, etc. can be controlled. I can. Accordingly, even when there is no manager in the control control room, an image may be displayed at a desired location on the screen 460 displayed on the image output device 170 or other related screens may be displayed.

In this way, it is possible to quickly respond to the control room according to the screen and related information transmitted in real time from one or more mobile devices 110.

Meanwhile, the present invention is not limitedly applicable to the configuration of the embodiments described as described above, but the above-described embodiments may be configured by selectively combining all or part of each of the embodiments so that various modifications can be made. have.

In addition, the present invention can be implemented as a processor-readable code on a processor-readable recording medium. The processor-readable recording medium includes all types of recording devices that store data that can be read by the processor. Examples of processor-readable recording media include ROM, RAM, EPROM, EEPROM, registers, hard disks, removable disks, CD-ROMs, or any other type of storage medium known in the art. In addition, the processor-readable recording medium is distributed over a computer system connected through a network, so that the processor-readable code can be stored and executed in a distributed manner.

In addition, although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention claimed in the claims. In addition, various modifications are possible by those of ordinary skill in the art, and these modifications should not be individually understood from the technical spirit or prospect of the present invention.

110: mobile device 130: all-in-one server
150: wall controller 170: video sound output device
180: management computer 190: network source device

Claims (10)

Displays a mobile video control screen including at least one of a video currently being filmed, a menu icon, a chat content, a video call screen, and a menu setting icon,
At least one mobile device for transmitting a source data packet including at least one of an image source and a sound source, a command ID suitable for an option, and data corresponding to the command ID through a communication network;
An all-in-one server that performs a signaling process through the communication network to enable communication between the one or more mobile devices and a web browser, converts the received source data packet into a source signal including at least one of an image signal and an audio signal, and outputs ;
A video and audio output device including at least one display device and a speaker device; And
A wall controller that is communicatively connected to the all-in-one server through a physical cable, converts the received source signal to be output from the video and audio output device, and outputs the converted source signal to the video and audio output device, and
When at least one of a screen transmitted from the mobile device, a map screen indicating the location of the mobile device, and a chat content or a video call screen with the mobile device is displayed on the control screen displayed on the video and audio output device,
The mobile video control system, characterized in that the display of the control screen is controlled by the mobile device by transmitting a command ID and data corresponding to control of the mobile video control screen. The method of claim 1,
The mobile device and the all-in-one server transmit and receive data using WebRTC (Web RealTime Communication). delete The method of claim 1,
A mobile video control system further comprising a; management computer for managing and monitoring the wall controller. The method of claim 1,
A mobile control system further comprising a network source device that is communicatively connected to the wall controller through a network and capable of transmitting a data packet including at least one of an image source and an audio source. At least one mobile device and the all-in-one server performing a signaling process through a communication network to enable communication between the web browser;
In the one or more mobile devices, a mobile video control screen including at least one of a video currently being filmed, a menu icon, a chat content, a video call screen, and a menu setting icon is displayed, and at least one of a video source and a sound source through the communication network Transmitting a source data packet including one, a command ID suitable for an option, and data corresponding to the command ID;
Converting the source data packet received from the all-in-one server into a source signal including at least one of a video signal and an audio signal and outputting the converted source data packet;
The wall controller is communicatively connected to the all-in-one server through a physical cable, and converts the received source signal so that it can be output by a video and audio output device including at least one display device and a speaker device, and then to the video and audio output device. Outputting; And
Displaying an image corresponding to the source signal or outputting a sound in the video and audio output device; Including,
When at least one of a screen transmitted from the mobile device, a map screen indicating the location of the mobile device, and a chat content or a video call screen with the mobile device is displayed on the control screen displayed on the video and audio output device,
The operation method of the mobile video control system, characterized in that the display of the control screen is controlled by the mobile device transmitting a command ID and data corresponding to the control of the mobile video control screen. The method of claim 6,
The mobile device and the all-in-one server transmit and receive data using WebRTC (Web RealTime Communication). delete The method of claim 6,
The method of operating a mobile video control system further comprising the step of managing and monitoring the wall controller. A recording medium readable by a processor storing a program for executing the operation method of claim 6, 7 or 9 in a processor.

Images