TWI521960B - Image information method, system for image information transmission threrof - Google Patents

Description

Image transmission method, system and recording medium thereof

The present invention relates to a network image transmission system, method, and recording medium thereof, and particularly to a network image transmission system and method using network address translation traversal (NAT-T) Its recording media.

The network monitoring system transmits images through the internal Internet (Internet) and the external network for remote video monitoring. Users can connect to the Internet to access the remote monitoring system using a computer or mobile device, no matter where they are, for instant video and sound transmission. Video surveillance is widely used in many places, such as residential communities, banks, schools, hospitals, shopping malls, factories, highways, etc., because of its intuitiveness, convenience, and rich message content. In recent years, with the rapid development of computer, network and image processing and transmission technology, video surveillance technology has also made great progress.

The rapid development of the Internet and the limitation of the number of IPv4 addresses have made network address translation (NAT) devices widely used. The network address translation device allows multiple hosts that are translated after the same network address to share a common network (usually before the network address translation) Called the public network) IP address. A private network (usually a network that is translated after a network address is called a private network or an internal network) IP address communicates with other hosts on the public network through a network address translation device. The host initiates the connection by the host in the private network, and the data packet is translated to the server on the public network through the network address translation address, and the data can be transmitted in both directions after the connection is established, and the network address translation device allows the private network. The host within the host actively sends data to the host in the public network, but prohibits active transmission in the opposite direction. In video surveillance systems, hosts in different private networks need to be interconnected, so the problem of translating through network addresses must be solved.

With the development of the network, many buildings already have regional and wide area networks. The system of using existing public and private networks to carry video surveillance can be more convenient and cheaper. Therefore, how to make image data traverse the public network and private network has become an urgent problem to be solved.

The invention provides an image transmission system, a method and a recording medium thereof.

The invention provides an image transmission method, which comprises the following steps: a first network address translation traversal (NAT) by a Real Time Streaming Protocol (RTSP) client proxy module (Network address translation traversal, NAT) -T) the sub-module registers a first ID information and a first internet address information to a NAT-T signal server located at a back end of the network; and one of the RTSP server proxy modules The second NAT-T sub-module registers a second ID information and a second Internet to the NAT-T signal server. The location information of the road; the first NAT-T sub-module obtains the first internet address information from the NAT-T signal server according to the first ID information; and obtains the first internet address After the address information, an RTSP server module of an image capture device establishes an RTSP connection with a client device through a virtual RTSP client proxy sub-module and a virtual RTSP server proxy sub-module; The user equipment receives and plays image information transmitted by the image capturing device through the RTSP connection.

The invention provides an image transmission system, comprising: an image capturing device for capturing an image information, comprising: a Real Time Streaming Protocol (RTSP) server module; and an RTSP client proxy module The group has a first ID information and a first internet address information, including: a first network address translation traversal (NAT-T) sub-module; and a virtual RTSP client The proxy sub-module is coupled to the first NAT-T sub-module and the RTSP server module; a user equipment for playing the image information, including: an RTSP client module; an RTSP server The proxy module is coupled to the RTSP client module, and has a second ID information and a second Internet address information, including: a second NAT-T sub-module; and a virtual RTSP server proxy a sub-module coupled to the second NAT-T sub-module and the RTSP client module; and a network address translation traversal signal server coupled to the first NAT-T sub-network via a network Module and the above second NAT-T submodule Wherein: the RTSP client proxy module registers the first ID information and the first internet address information with the first NAT-T sub-module by using the first NAT-T sub-module, and the RTSP servo The proxy module is directed to the above by the second NAT-T submodule The NAT-T signal server registers the second ID information and the second Internet address information; the second NAT-T sub-module obtains the first information from the NAT-T signal server according to the first ID information. Internet address information; after obtaining the first Internet address information, the RTSP server module of the image capturing device is configured by the virtual RTSP client proxy submodule and the virtual RTSP server proxy The sub-module establishes an RTSP connection with the user equipment; and the user equipment receives and plays the image information transmitted by the image capturing device through the RTSP connection.

The present invention provides a recording medium for reading an image transmission method by reading an image stored in the recording medium via an electronic device, wherein the method includes the following steps: by using a Real Time Streaming Protocol (Real Time Streaming Protocol, RTSP) One of the client-side proxy modules, the first network address translation traversal (NAT-T) sub-module registers a first ID with one of the NAT-T signal servers located at the back end of a network. Information and a first Internet address information; registering a second ID information and a second Internet with the second NAT-T sub-module by one of the RTSP server proxy modules Network address information; obtaining, by the second NAT-T sub-module, the first Internet address information from the NAT-T signal server according to the first ID information; obtaining the first Internet After the address information, an RTSP server module of an image capture device establishes an RTSP connection with a client device through a virtual RTSP client proxy sub-module and a virtual RTSP server proxy sub-module; borrow Connecting the client device receives and displays the one transmitted through the RTSP image information transmitted by the image capturing means.

The above and other objects, features and advantages of the present invention will become more <RTIgt;

100‧‧‧Image transmission system

110‧‧‧Image capture device

111‧‧‧RTSP Server Module

120‧‧‧Customer device

121‧‧‧RTSP client module

130‧‧‧RTSP Client Agent Module

131‧‧‧Virtual RTSP Client Agent Submodule

132‧‧‧First NAT-T submodule

140‧‧‧RTSP Server Proxy Module

141‧‧‧Virtual RTSP Server Proxy Sub-module

142‧‧‧Second NAT-T submodule

150‧‧‧First router

160‧‧‧second router

170‧‧‧NAT-T signal server

180‧‧‧Internet

400‧‧‧ Method flow chart

S405, S410, S415, S420‧‧ steps

500‧‧‧Message Timing Chart

S502, S504, S506, S508, S510, S512, S514, S516, S518, S520, S522, S524, S526, S528, S530, S532‧‧

1 is a schematic diagram showing an image transmission system according to an embodiment of the invention.

2 is a schematic diagram showing an instant data stream communication protocol client agent module disposed in an image capturing device and an instant data stream protocol server proxy module disposed on a client device according to an embodiment of the invention.

FIG. 3 is a schematic diagram of a real-time data stream communication protocol client proxy module setting and an instant data stream protocol protocol proxy module disposed in a router according to an embodiment of the invention.

4 is a flow chart showing a method of image transmission according to an embodiment of the invention.

5A-5B are timing diagrams showing messages transmitted between the image capturing device and the client device according to an embodiment of the invention.

In order to make the objects, features, and advantages of the present invention more comprehensible, the preferred embodiments of the present invention will be described in detail with reference to the accompanying Figures 1 through 5B. The description of the present invention provides different embodiments to illustrate the technical features of various embodiments of the present invention. The arrangement of the various elements in the embodiments is for illustrative purposes and is not intended to limit the invention. And the overlapping portions of the drawings in the embodiments are for the purpose of simplifying the description, and do not mean the association between different embodiments. Sex.

1 is a schematic diagram showing an image transmission system 100 according to an embodiment of the invention. The image transmission system 100 includes at least one image capturing device 110, a client device 120, a first router 150, a second router 160, and a network address translation (NAT-T) signal server. 170. A Real Time Streaming Protocol (RTSP) client proxy module 130 and a Real Time Streaming Protocol (RTSP) server proxy module 140. It should be noted that the number of the image capturing device, the user terminal device, the router, and the like described above are not limited to the contents of the illustration and the description of the present invention.

The image capturing device 110 is configured to capture an image information and includes a Real Time Streaming Protocol (RTSP) server module 111. The image capturing device 110 can be any audio and video device or device based on a standard instant data stream protocol, such as a network camera, a surveillance camera, and the like.

The client device 120 is configured to play the video information, and includes a Real Time Streaming Protocol (RTSP) client module 121. The client device 120 can be any electronic device with network connection capability based on a standard instant data stream communication protocol. For example, a personal computer, a notebook computer, a tablet computer, a smart terminal device, or the like can be connected to the electronic device of the Internet 180.

The RTSP client proxy module 130 can include a virtual RTSP client proxy sub-module 131 and a first network address translation traversal (NAT-T) sub-module 132, wherein the virtual RTSP The client proxy sub-module 131 is coupled to the first NAT-T sub-module 132 and the RTSP server module 111 in the image capturing device 110. It should be noted that one or more client devices 120 and RTSP client agent modules 130 may be included in the image transmission system 100, and each RTSP client agent module 130 has an identity that can prove its uniqueness. Identification (ID). In this embodiment, the RTSP client proxy module 130 has a first ID information and a first internet address information.

The RTSP server proxy module 140 can include a virtual RTSP server proxy sub-module 141 and a second NAT-T sub-module 142, wherein the virtual RTSP server proxy sub-module 141 is coupled to the second NAT-T sub- Module 142 and RTSP client module 121. It should be noted that one or more image capturing devices 110 and RTSP server proxy modules 140 may be included in the image transmission system 100, and each RTSP server proxy module 140 has a uniqueness. Identification code (Identity, ID). In this embodiment, the RTSP server proxy module 140 has a second ID information and a second Internet address information.

The NAT-T signal server 170 is connected to the first router 150 and the second router 160 through an Internet 180 to provide a network address penetration service for the image capturing device 110 and the client device 120.

In an embodiment, the RTSP client proxy module 130 can be disposed in the image capture device 110, and the RTSP server proxy module 140 can be disposed in the client device 120, as shown in FIG. In this manner, the image capturing device 110 can be conveniently connected to the network used by the client device 120 without adding additional network devices. Moreover, in another embodiment, the RTSP client agent module 130 It can also be disposed in the first router 150, and the RTSP server proxy module 140 can also be disposed in the second router 160, as shown in FIG. In this way, the image capturing device 110 and the RTSP client proxy module 130 and the RTSP server proxy module 140 are installed on the client device 120, so that the client device 120 can directly capture the existing image. The device 110 performs a program for point-to-point remote access.

4 is a flow chart 400 showing a method of image transmission according to an embodiment of the invention. In step S405, the first network address translation traversal (NAT-T) sub-module is located by one of the Real Time Streaming Protocol (RTSP) client proxy modules. A network address translation traversal (NAT-T) signal server registers one of the first ID information and a first Internet address information of the RTSP client proxy module. And registering a second ID information and a second Internet address information to the NAT-T signal server by using a second NAT-T sub-module of one of the RTSP server proxy modules. Next, in step S410, the second NAT-T sub-module obtains the first Internet address information from the NAT-T signal server according to the first ID information. In step S415, after obtaining the first internet address information, the RTSP server module of one of the image capturing devices passes through a virtual RTSP client proxy sub-module and a virtual RTSP server proxy sub-module. Establish an RTSP connection with the client device. Finally, in step S420, the image information transmitted by the image capturing device is received and played by the user equipment through the RTSP connection.

5A-5B show a shadow according to an embodiment of the invention A message timing diagram 500 for transmitting images between the capture device and the client device, and referring to Figures 1 to 3. In step S502, after the RTSP server proxy module 140 is connected to the Internet, the second NAT-T sub-module 142 registers the second ID of the RTSP server proxy module 140 with the NAT-T signal server 170. Information and a second Internet address information. In step S504, after the RTSP client proxy module 130 is connected to the Internet, the first NAT-T sub-module 132 registers the first ID of the RTSP client proxy module 130 with the NAT-T signal server 170. Information and a first Internet address information. It should be noted that, in this embodiment, the sequence of operations of performing step S502 and step S504 may be arbitrarily exchanged or performed simultaneously, and is not limited to this embodiment.

In step S506, the second NAT-T sub-module 142 queries the NAT-T signal server 170 for the first Internet address information according to the first ID information of the RTSP client proxy module 130. In step S508, the NAT-T signal server 170 sends the first Internet address information of the RTSP client proxy module 130 corresponding to the first ID information to the RTSP server proxy module 140, and is configured by the second NAT. The -T sub-module 142 is responsible for receiving the first internet address information. In step S510, the RTSP client module 121 transmits an RTSP connection request packet to the virtual RTSP server proxy sub-module 141 in the instant data stream protocol proxy module 140, wherein the RTSP connection request packet includes the RTSP servo. The second internet address information of the proxy module 140. In step S512, after receiving the RTSP connection request packet, the virtual RTSP server proxy sub-module 141 forwards the RTSP connection request packet to the virtual RTSP client proxy sub-module 131 of the RTSP client proxy module 130. In step S514, after receiving the RTSP connection request packet, the virtual RTSP client proxy submodule 131 forwards the RTSP connection request packet to the RTSP server. Module 111. In step S516, after receiving the RTSP connection request packet, the RTSP server module 111 generates an RTSP connection response packet and transmits the RTSP connection response packet to the virtual RTSP client proxy submodule 131 of the RTSP client proxy module 130. Responding to the client device 120. In step S518, the virtual RTSP client proxy submodule 131 forwards the RTSP connection response packet to the RTSP servo according to the second internet address information of the RTSP server proxy module 140 obtained in the previously received RTSP connection request packet. The virtual RTSP server proxy sub-module 141 in the proxy module 140. In step S520, after receiving the RTSP connection response packet, the virtual RTSP server proxy sub-module 141 forwards the RTSP connection response packet to the RTSP client module 121. In step S522, after receiving the RTSP connection response packet, the RTSP client module 121 generates an RTSP connection confirmation packet and transmits it to the virtual RTSP server proxy submodule 141 of the RTSP server proxy module 140. After receiving the RTSP connection confirmation packet, the virtual RTSP server proxy sub-module 141 forwards the RTSP connection confirmation packet to the virtual RTSP client proxy sub-module 131 of the RTSP client proxy module 130 in step S524. After receiving the RTSP connection confirmation packet, the virtual RTSP client proxy submodule 131 transfers it to the RTSP server module 111 in step S526. After the RTSP server module 111 receives the RTSP connection confirmation packet, the RTSP connection between the RTSP client module 121 and the RTSP server module 111 is completed.

After the RTSP connection is established, in step S528, the RTSP server module 111 transmits an image information to the virtual RTSP client proxy sub-module 131 of the RTSP client proxy module 130. After the virtual RTSP client proxy sub-module 131 receives the image information, in step S530, the image information is transferred to the virtual RTSP server proxy sub-module 141 of the RTSP server proxy module 140. Finally, after the virtual RTSP server proxy sub-module 141 receives the image information, in step S532, the image information is transferred to the RTSP client module 121 for playback to the user for viewing.

The method of the present invention, or a particular type or portion thereof, can be implemented via a code. The code may be included in a physical recording medium such as a floppy disk, a compact disc, a hard disk, or any other electronic device or machine readable (eg computer readable) storage medium, or is not limited to an external form. A computer program product, wherein when the code is loaded and executed by a machine, such as a computer, the machine becomes a device or system for participating in the present invention and the method steps of the present invention can be performed. The code can also be transmitted over some transmission medium such as wire or cable, fiber optics, or any transmission type.

Therefore, the present invention can also provide a recording medium, after reading the code stored in the recording medium via an electronic device, to perform the method for image transmission, wherein the method and the steps are not described herein.

The above embodiments are described using a variety of angles. It will be apparent that the teachings herein may be presented in a variety of ways, and that any particular structure or function disclosed in the examples is merely representative. In light of the teachings herein, anyone skilled in the art will appreciate that the content presented herein can be independently rendered in various different types or in a variety of different forms. By way of example, it may be implemented by some means or by some means in any manner as mentioned in the foregoing. The implementation of one device or the execution of one mode may be implemented in any one or more of the types discussed above with any other architecture, or functionality, or architecture and functionality.

Those skilled in the art will understand that messages and signals can be presented in a variety of different technologies and techniques. For example, all the possible references are described above. The instructions, commands, messages, signals, bits, symbols, and chips may be presented in volts, current, electromagnetic waves, magnetic fields or magnetic particles, light fields or light particles, or any combination of the above.

Those skilled in the art will appreciate that various illustrative logic blocks, modules, processors, devices, circuits, and logic steps are described herein for use with the electronic hardware (eg, source coded or Digital implementation of other technical designs, analogy implementation, or a combination of both), various forms of programming or design codes linked to instructions (referred to as "software" or "software modules" for convenience in the text), or a combination of the two. To clearly illustrate the interchangeability of the hardware and software, a variety of descriptive elements, blocks, modules, circuits, and steps are generally described above in terms of functionality. Whether this feature is presented in hardware or software, it will depend on the specific application and design constraints imposed on the overall system. The person skilled in the art can implement the described functions in a variety of different ways for each particular application, but the implementation of this decision should not be interpreted as deviating from the scope disclosed herein.

In addition, various illustrative logical blocks, modules, and circuits, and various aspects disclosed herein may be implemented in an integrated circuit (IC), an access terminal, an access point, or an integrated circuit. , access terminal, access point execution. The integrated circuit can be a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or the like. Programmable logic device, discrete gate or transistor logic, discrete hardware components, electronic components, optical components, mechanical components, or any combination of the above The functions described in this document are performed; and execution codes or instructions existing in the integrated circuit, outside the integrated circuit, or both may be executed. A general purpose processor may be a microprocessor, but could be any conventional processor, controller, microcontroller, or state machine. The processor may be comprised of a combination of computer devices, such as a combination of a digital signal processor (DSP) and a microcomputer, a plurality of sets of microcomputers, a set of at most groups of microcomputers, and a digital signal processor core, or any other similar configuration.

Any specific sequence or layering of the procedures disclosed in the present invention is by way of example only. Based on design preferences, it must be understood that any specific order or hierarchy of steps in the program may be rearranged within the scope of the disclosure. The accompanying claims are intended to be illustrative of the various embodiments and the

The use of ordinal numbers such as "first", "second", "third", etc., used to modify elements in the scope of the patent application does not imply any priority, prioritization, prioritization between elements, or method. The order of the steps, and only used as an identifier to distinguish different elements having the same name (with different ordinal numbers).

While the present invention has been described in its preferred embodiments, the present invention is not intended to limit the invention, and the present invention may be modified and modified without departing from the spirit and scope of the invention. The scope of protection is subject to the definition of the scope of the patent application.

400‧‧‧ Method flow chart

S405, S410, S415, S420‧‧ steps

Claims (10)

An image transmission method includes the following steps: a first network address translation traversal (NAT-T) by a Real Time Streaming Protocol (RTSP) client proxy module The submodule registers a first ID information and a first internet address information to a NAT-T signal server located at a back end of the network; and a second NAT of the RTSP server proxy module The T sub-module registers a second ID information and a second Internet address information to the NAT-T signal server; and the second NAT-T sub-module uses the first ID information according to the first ID information to the NAT- The T signal server obtains the first Internet address information; after obtaining the first Internet address information, the RTSP server module of one of the image capturing devices transmits a virtual RTSP client proxy The module and a virtual RTSP server proxy sub-module establish an RTSP connection with a client device; and receive, by the user device, the image information transmitted by the image capturing device through the RTSP connection; Above And the step of establishing, by the image capturing device, the RTSP connection by using the virtual RTSP client proxy submodule and the virtual RTSP server proxy submodule and the client device, as the first NAT-T submodule and the foregoing After the NAT-T sub-module registers with the NAT-T signal server, the RTSP client module transmits the virtual RTSP server proxy sub-module and the virtual RTSP client proxy sub-module through the RTSP client module. The RTSP connection request packet is encapsulated into the RTSP server module, wherein the RTSP connection request packet includes the second Internet address information; after the RTSP server module receives the RTSP connection request packet, by using the virtual RTSP user The end proxy submodule and the virtual RTSP server proxy submodule forward an RTSP connection response packet to the RTSP client module; after the RTSP client module receives the RTSP connection response packet, by using the virtual RTSP The server proxy submodule and the virtual RTSP client proxy submodule forward an RTSP connection confirmation packet to the RTSP server module to complete the establishment of the RTSP connection. The image transmission method of claim 1, further comprising: connecting the image capturing device to the network by a first router; and connecting the user terminal device to the above by a second router network. The image transmission method of claim 2, wherein the RTSP server proxy module is disposed in the second router, and the RTSP client proxy module is disposed in the first router. The image transmission method according to claim 1, wherein the RTSP server proxy module is disposed in the user equipment, and the RTSP client proxy module is disposed in the image capturing device. An image transmission system includes: an image capturing device for capturing image information, including: an instant data stream communication protocol (Real Time Streaming) Protocol, RTSP) server module; an RTSP client proxy module having a first ID information and a first internet address information, including: a first network address translation traversal a NAT-T sub-module; and a virtual RTSP client proxy sub-module coupled to the first NAT-T sub-module and the RTSP server module; a user-side device for playing the image The information includes: an RTSP client module; an RTSP server proxy module coupled to the RTSP client module, having a second ID information and a second internet address information, including: a NAT-T sub-module; and a virtual RTSP server proxy sub-module coupled to the second NAT-T sub-module and the RTSP client module; and a network address translation traversal signal server And connecting to the first NAT-T sub-module and the second NAT-T sub-module through a network; wherein: the RTSP client proxy module is configured by using the first NAT-T sub-module The NAT-T signal server registers the first ID information and the first internet address And the RTSP server proxy module registers the second ID information and the second internet address information with the second NAT-T sub-module by using the second NAT-T sub-module; the second NAT The -T sub-module obtains the first Internet address information from the NAT-T signal server according to the first ID information; After obtaining the first Internet address information, the RTSP server module of the image capturing device is configured by the virtual RTSP client proxy submodule and the virtual RTSP server proxy submodule and the client end The device establishes an RTSP connection; and the user equipment receives and plays the image information transmitted by the image capturing device through the RTSP connection. The image transmission system of claim 5, further comprising: a first router coupled to the image capturing device for connecting the image capturing device to the network; and a second router And coupled to the user equipment to connect the user equipment to the network. The image transmission system of claim 6, wherein the RTSP server proxy module is disposed in the second router, and the RTSP client proxy module is disposed in the first router. The image transmission system of claim 5, wherein the RTSP server proxy module is disposed in the client device, and the RTSP client proxy module is disposed in the image capture device. The video transmission system of claim 5, wherein the image capturing device establishes the RTSP connection with the user equipment through the virtual RTSP client proxy submodule and the virtual RTSP server proxy submodule. Step: after the first NAT-T sub-module and the second NAT-T sub-module are registered with the NAT-T signal server, the RTSP client module uses the virtual RTSP server proxy submodule Group and The virtual RTSP client proxy sub-module forwards an RTSP connection request packet to the RTSP server module, wherein the RTSP connection request packet includes the second Internet address information; and the RTSP server module receives the foregoing After the RTSP connection request packet, the RTSP server proxy submodule and the virtual RTSP client proxy submodule forward an RTSP connection response packet to the RTSP client module; and receive the RTSP client module. After the RTSP connection request packet is encapsulated, the RTSP client proxy submodule and the virtual RTSP server proxy submodule forward an RTSP connection confirmation packet to the RTSP server module to establish the RTSP connection. A recording medium for reading an image transmission method by reading an image stored by the recording medium via an electronic device, wherein the method comprises the following steps: by using a Real Time Streaming Protocol (RTSP) user The first network address translation traversal (NAT-T) sub-module registers a first ID information and a NAT-T signal server located at a back end of a network. First internet address information; registering a second ID information and a second internet address to the NAT-T signal server by using a second NAT-T sub-module of one of the RTSP server proxy modules The second NAT-T sub-module obtains the first Internet address information from the NAT-T signal server according to the first ID information; and obtains the first Internet address information After an image One of the capture devices RTSP server module establishes an RTSP connection with a client device through a virtual RTSP client proxy sub-module and a virtual RTSP server proxy sub-module; and through the above-mentioned user device through the RTSP Connecting to receive and play image information transmitted by the image capturing device; wherein the image capturing device establishes the above by using the virtual RTSP client proxy submodule and the virtual RTSP server proxy submodule The RTSP connection step is performed after the first NAT-T sub-module and the second NAT-T sub-module are registered with the NAT-T signal server, and the RTSP client module transmits the virtual RTSP servo. The proxy submodule and the virtual RTSP client proxy submodule forward an RTSP connection request packet to the RTSP server module, wherein the RTSP connection request packet includes the second internet address information; After receiving the RTSP connection request packet, the server module forwards an RTSP by using the virtual RTSP client proxy submodule and the virtual RTSP server proxy submodule The connection response packet is sent to the RTSP client module; after the RTSP client module receives the RTSP connection response packet, the virtual RTSP server proxy submodule and the virtual RTSP client proxy submodule are forwarded. The RTSP connection confirms the packet to the RTSP server module to complete the establishment of the above RTSP connection.