KR20060023418A - Network camera system with real-time pan/tilt/zoom control capability using hardware mpeg4 codec and v2oip - Google Patents

Abstract

Disclosed are a hardware MPEG4 codec and a V2OIP based network camera system capable of storing and transmitting a captured image in real time and controlling pan / tilt / zoom of a camera in real time at a remote location, and a digital video recorder for surveillance using the same. A network camera system is constructed including a camera module having a pan / tilt / zoom drive unit, an audio codec, a memory unit, a hardware MPEG4 codec, a network controller, a central processing unit for controlling them, and a remote terminal device. Video input through the camera module and audio input through the audio codec are compressed in real time by the hardware MPEG4 codec. The compressed data is transmitted to a remote terminal device through the network controller through the V2OIP protocol, and is expanded and output simultaneously with the storage at the remote terminal device. The central processing unit controls the pan / tilt / zoom driver of the camera module in real time in response to a control signal for the pan / tilt / zoom driver of the camera module received from the remote terminal device.

Description

NETWORK CAMERA SYSTEM WITH REAL-TIME PAN / TILT / ZOOM CONTROL CAPABILITY USING HARDWARE MPEG4 CODEC AND V2OIP}             

1 is a block diagram of a network camera system in a stand-alone form according to the present invention.

2 is a block diagram of a PC-based network camera system according to the present invention.

3 is a block diagram of a digital video recorder system for monitoring a screen switching method according to the present invention.

4 is a block diagram of a digital video recording system for multi-screen monitoring according to the present invention.

Explanation of symbols on the main parts of the drawings

100: network camera system

105: Audio codec 106: Speaker

107: microphone 110: camera module

111: fan drive 112: tilt drive

113: zoom driver 115: video encoder

116: display device

120: memory

130: network camera central processing unit

131: program memory section

140: hardware MPEG4 codec

150: network controller 151: mass storage device

170: Internet 180: remote terminal device

The present invention relates to a network camera system and a digital video recorder for surveillance, and in particular, a network camera system capable of storing and transmitting a video in real time and even controlling pan / tilt / zoom operation of the camera in real time and a digital video for surveillance using the same. The configuration of the recorder.

A web camera or a network camera is a general name of a compact camera having a network connection function. In general, a network camera is a video system or a video security system using a small camera, and may be used as a general term for a system for monitoring and storing an image input through a camera in a network environment such as the Internet.

Network cameras can be used for applications such as closed circuit TV (CCTV) and surveillance digital video recorder (DVR) in that the camera can be remotely controlled and the input image can be viewed remotely. It is widely used. For this purpose, mass storage devices such as hard disks or rewritable optical disks may be added to store large amounts of video and audio data. Recently, as well as the use of various security systems based on the developed network and Internet technology, it is a trend that is widely used in the Internet business, such as chat, shopping malls.

One type of prior art of such a network camera is to take a still-picture and view it on a user's terminal through a network environment such as the Internet. In this case, in order to effectively utilize the limited bandwidth of the communication environment, the still image is generally compressed by a compression technique having a high compression ratio. Joint Photographic Experts Group (JPEG) is widely used as such a compression standard.

JPEG is a lossy compression method that performs a discrete cosine transform (DCT) to lose high frequency components of an image that are difficult for humans to recognize through quantization. In recent years, wavelet compression technology has been used in addition to JPEG.

In a more advanced form of the network camera, a technique of photographing a video and transmitting the captured video over the Internet is partially utilized. However, in the case of a moving picture, the amount of data required is much larger than that of the still picture, and thus, there is a difficulty in transmitting in real time using a limited bandwidth.

Therefore, in the case of moving pictures, a compression technique that performs compression on the time axis in response to the spatial compression of the still picture is mainly used. One such compression technique is the Moving Picture Experts Group (MPEG) standard.

MPEG is a standard standard for video compression and decompression algorithms based on three coding principles. It is a compression technique using entropy coding that uses the spatial correlation of JPEG, the temporal correlation, and the bias of code generation probability. to be.

The network cameras of the prior art as described above have the following problems.

In the case of using still images, there is a problem in that it is not possible to provide information about an object that changes frequently due to the limitation of still images. In particular, in order to monitor the object more closely, it is necessary to control the camera remotely, but it is difficult to control the complete camera through a still image.

The control of the camera may be a function such as pan (pan), tilt (tilt), zoom (zoom) for the camera, but it is impossible to immediately control the web camera with a still image.

On the other hand, even in the case of a network camera technology using a moving picture of the prior art, if it is impossible to transmit a real-time video with a high frame rate, it is virtually impossible to track an object by a pan / tilt / zoom operation for a web camera. Efforts have been made to solve the problem in a method of expanding the bandwidth of a limited communication network or an improvement of a video compression technology that performs video compression for real time transmission of a video.

However, the expansion of network bandwidth is difficult to achieve in the near future, especially the construction of high bandwidth network infrastructure is costly and time consuming. Even if a network infrastructure has been established, using such infrastructure is expensive.

On the other hand, in terms of improving video compression technology, it is difficult to emerge a new video compression standard that can dramatically improve the compression ratio of video at present. High compression video compression standards often require high processing power and memory capacity, and there are some trade-offs in terms of compression and cost of the system.

In order to solve the above problems, an object of the present invention is to use a hardware MPEG4 codec and V2OIP protocol to compress a video input to the camera in real time, and transmit and store the compressed video in real time at the same time. Introducing a network camera system that enables / tilt / zoom control remotely in real time.

Another object of the present invention is to use the hardware MPEG4 codec and V2OIP protocol to compress the image input to the camera in real time and to transmit and store the compressed image at the same time to control the camera pan / tilt / zoom in real time at a remote location This paper introduces a PC-based network camera system using a PCI interface.

Still another object of the present invention is to control the pan / tilt / zoom of a corresponding camera by compressing images input to a plurality of cameras in real time and storing and transmitting the compressed images in real time using a hardware MPEG4 codec and a V2OIP protocol. To introduce a digital video recorder system for surveillance using a network camera that enables remote real-time.

In order to achieve the above object, the present invention provides a network camera system including a camera module having a pan / tilt / zoom drive unit, an audio codec, a memory unit, a hardware MPEG4 codec, a network controller, a central processing unit, and a remote terminal device. do.

Here, the network controller transmits the video / audio data compressed by the hardware MPEG4 codec to the remote terminal device. The V2OIP protocol is used for transmission or reception of compressed video / audio data. In addition, a control signal for the pan / tilt / zoom driving unit of the camera module is received from the remote terminal device using the TCP / IP protocol to control the pan / tilt / zoom driving unit of the camera module by the central processing unit.

The network camera system may further include a mass storage device for backing up compressed video / audio data.

In order to achieve the above object, the present invention provides a camera module having a pan / tilt / zoom drive unit, an audio codec, a memory unit, a hardware MPEG4 codec, a PCI interface unit, a network adapter connected through a PCI interface, a central processing unit, and a remote site. Introducing a PC-based network camera system having a terminal device.

The PC-based network camera system may further include a mass storage device connected through a PCI interface for backing up the compressed video / audio data.

In order to achieve the above object, a first aspect of the present invention provides a plurality of camera modules, a video multiplexer, a plurality of microphones, a voice multiplexer, an audio codec, a memory unit, and a hardware MPEG4 codec having a pan / tilt / zoom drive unit. Introducing a surveillance digital video recorder system comprising a network controller, a central processing unit, and a remote terminal device.

Here, the video multiplexer and the audio multiplexer are output from the plurality of camera modules and the plurality of microphones in response to a video selection signal and a voice selection signal generated at a central processing unit or received from a remote terminal device at predetermined time intervals. To sequentially select the output voice of the.

In order to achieve the above object, the second aspect of the present invention provides a plurality of camera modules, a multi-screen generator, a memory unit, a hardware MPEG4 codec, a network controller, a central processing unit, and a remote terminal device having a pan / tilt / zoom drive unit. Introducing a surveillance digital video recorder system comprising a.

Here, the multi-screen generator selects an output image of all or part of the output images of the plurality of camera modules in response to the image selection signal generated at the central processing unit or received from the remote terminal apparatus at predetermined time intervals, and downscales the image. Converts to multi-screen digital image data.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

Example 1

1 is a block diagram showing a configuration example of a network camera system using a hardware MPEG4 codec and a V2OIP protocol according to the present invention.

The configuration example of the network camera system of FIG. 1 is a block diagram showing an example of the configuration in the form of an independent stand-alone.

The network camera system 100 of FIG. 1 includes an audio codec 105, a camera module 110, a memory unit 120, a hardware MPEG4 codec 140, a network controller 150, and a network for controlling them. And a program memory unit 131 including a program code executed by the camera central processing unit 130 and the network camera central processing unit.

The network camera system 100 of FIG. 1 is an optional component and is connected to a video encoder 115 and a video encoder 115 as a monitoring purpose for checking an image captured by a camera module. It may further include a display device 116 consisting of an LCD or a CRT for outputting the.

That is, the video encoder 115 receives a digital video signal according to the CCIR (601) or CCIR656 standard and outputs an analog video signal. Accordingly, the display device 116, which is an additional optional component, receives the output image signal of the video encoder 115 and serves as a monitor for outputting the image captured by the camera module 110 to the user.

The video encoder 115 and the display device 116 are optional components and may not be included when the remote terminal device 180 performs only the purpose of checking the image captured by the camera module 110. In particular, in the case of a network camera system operating on a PC-based rather than a stand-alone type, the necessity is weak because monitoring can be performed using a display device of a PC.

The camera module 110 includes at least one lens and an optical scratch element for capturing an image of a subject incident from the lens.

As the optical scratching element, a CCD or a CMOS optical scratching element may be used. The camera module 110 configured as the optical scratch element converts an image of a subject incident from a lens into digital image data.

In particular, the camera module 110 used in the network camera system 100 of the present invention has a pan driver 111 for performing a pan function by rotating the camera module left and right, and a tilt for adjusting the optical axis angle of the camera module up and down. A tilt driver 112 for performing a function and a zoom driver 113 for driving a lens to perform a zoom function are included.

The pan / tilt / zoom driving units 111, 112, and 113 of the camera module include stepping motors and a control circuit unit configured to receive a control signal and generate driving pulses for driving the stepping motors. The configuration of the stepper motor and the control circuit portion is shown by omission in FIG.

The audio codec 105 converts an analog voice signal input through the microphone 107 into digital voice data, or converts the digital voice data into an analog voice signal and outputs the analog voice signal through the speaker 106.

The digital image data input by the camera module 110 and the digital voice data input by the audio codec 105 are stored in the memory unit 120. Similarly, the digital image data to be output to the video encoder 115 and the digital audio data to be output to the audio codec 105 are output from the memory unit 120.

The memory unit 120 operates in conjunction with the hardware MPEG4 codec 140 to serve as a frame buffer required for the hardware MPEG4 codec 140 to perform MPEG4 coding and decoding.

Therefore, the memory unit 120 is configured using a high speed memory device having a large bandwidth and a memory controller. For example, an SDRAM and an SDRAM controller having 32 bits of data input and output may be included.

The hardware MPEG4 codec 140 is a component including an MPEG4 encoder and a decoder.

MPEG4, selected as the MPEG standard of the hardware MPEG4 codec 140, has many advantages over conventional MPEG1 or MPEG2. In order to reflect the demand for compatibility issues of the conventional MPEG1 and MPEG2 standards, MPEG-4 has been studied. It is a standard encoding method capable of transmitting in a low-bandwidth communication medium and implementing bidirectional multimedia. MPEG4 is widely used as a high-efficiency compression method that can transmit video even at a low bandwidth of 64 kbps.

The hardware MPEG4 codec 140 compresses the digital image data and the digital audio data read from the memory unit 120 at high speed and outputs the compressed image / audio data to the memory unit 120 again.

The network camera central processing unit 130 is connected to the above components by using suitable interfaces to control data signal transfer between the components, or to control the components.

The operation of the network camera central processing unit 130 may be performed by a real time operating system (RTOS) stored in the program memory unit 131 and a program code operating under the real time operating system. The program code of the network camera central processing unit 130 is stored in the program memory unit 131. The program memory unit 131 may use a non-volatile memory such as a flash memory that stores a program code and stores predetermined values when the power is cut off.

In particular, the network camera central processing unit 130 receives a TCP / IP control signal packet for driving the pan / tilt / zoom of the camera module 110 from the network controller 150 which will be described later. Responsible for controlling the tilt / zoom drive. In addition, the central processing unit 130 converts the compressed video / audio data into a packet conforming to the V2OIP protocol in order to transmit the video / audio data compressed by the hardware MPEG4 codec through the network controller 150 to be described later. Perform.

As an example of an interface between the components, an interface corresponding to a standard signal standard among the components may be selected as an interface for connection between the video encoder 115 and the hardware MPEG4 codec 140.

Similarly, general interfaces such as inter-IC sound (I2S) may be included for connection with the audio codec 105, and general interfaces such as an inter-IC bus (I2C) interface for controlling each component may be used. Can be. Since the camera module 110 is generally located at a relatively long distance, RS422 or RS485 is used to transmit control signals for controlling the pan driver 111, the tilt driver 112, and the zoom driver 113 of the camera module 110. May be used.

Such an interface specification is also exemplary, and in the configuration of an actual system, another interface standard capable of performing a corresponding function may be employed.

The network controller 150 is connected to the Internet network and transmits the video / audio data packet captured by the camera module 110 and compressed by the hardware MPEG4 codec 140 to the remote terminal device. In addition, it serves to receive a control signal packet for controlling the pan / tilt / zoom driving units 111, 112, and 113 of the camera module from the remote terminal device.

The network controller 150 may be connected to a LAN, a public switched telephone network (PSTN), or an internet network 170. When connected to the Internet network, the network controller performs communication with a remote terminal device using an IP protocol.

Therefore, in order to access the network camera from the remote terminal device, the network controller 150 of the network camera system is required to have a unique identifier. When the network controller 150 is connected to the Internet network, an IP address may be used as this identifier. Under the current IPv4 scheme, IP address allocation using the DHCP protocol may be required to utilize limited IP address resources. However, if an IPv6 scheme is introduced, each network controller 150 may be identified as a unique IP address.

In particular, as already mentioned, the compressed video / audio data described above is delivered using the Video & Voice over IP (V2OIP) protocol. V2OIP is an extension to the Voice over IP (VOIP) protocol, which is a protocol for transmitting voice, and transmits video and voice together in real time.

When using a standardized communication technology such as the V2OIP protocol, a stand-alone video phone compliant with the V2OIP protocol or any type of terminal device compliant with the V2OIP protocol may be transferred to the remote terminal device 180 of the network camera system of the present invention. Can be used.

In this case, the remote terminal device 180 should also include an MPEG4 decoder capable of expanding the compressed video / audio data transmitted by the network controller 150 again. If the remote terminal device 180 is a device having sufficient processing power, such as a PC, such an MPEG 4 decoder may use a software decoder, and in the case of a small device having limited processing power, a separate hardware decoder may be used. It may be.

Through this, the user may control the pan / tilt / zoom driving of the camera module 110 while checking the video transmitted from the remote controller 180 in real time from the network controller 150. As a result of the control of the operation of the camera module 110 is reflected in real time, the user can facilitate the control of the camera module 110 in the remote place.

In addition, the remote terminal device 180 may store compressed video / audio data transmitted in real time using a mass storage device prepared in the remote terminal device 180 at the same time. The stored compressed video / audio data can be checked, copied and deleted at any time.

The network camera system 100 of FIG. 1 may further include a mass storage device 151 and an interface to the mass storage device.

The mass storage device may include an HDD or a rewritable optical recording medium, and an ATA / IDE interface may be selected as an interface to the mass storage device.

Through this configuration, the network camera system 100 may store the compressed video / audio data in the mass storage device 151. This is for back-up purposes and is necessary to stably store compressed video / audio data in preparation for a communication failure that may occur between the remote terminal device 180 and the network controller 150. Do.

It is now too well known that modular systems can be constructed by combining a wide variety of different components and functions. It should be noted that in an actual implementation, portions of each component of the present invention may be mixed, and each component may exist as a group of other named components. Accordingly, the components constituting the network camera system 100 may also include a functional block in which one component performs the same function as the other components, and one component is a plurality of detailed components. Sometimes they perform the same function separately.

Indeed, in accordance with recent one-chip trends, there are semiconductor devices in which the hardware MPEG4 codec 140, the network camera central processing unit 130, and related peripheral interfaces are integrated into one. In this embodiment, the PR818 of the Protocom technology company, which consists of an ARM9 RISC CPU core, an Advanced High-performance Bus (AHB) bus, a hardware MPEG4 codec, and an SDRAM controller, may be used.

Example 2

The network camera system 100 shown in FIG. 1 illustrates a stand-alone type, but as another configuration, the network camera system is included in a personal computer (PC) using a Peripheral Component Interconnect (PCI) interface or the like. It can be implemented in a configured configuration.

Fig. 2 is a block diagram showing another configuration example of the network camera system 200 according to the present invention of the type mounted to a PC using the PCI interface.

As illustrated in FIG. 2, a network camera system board 201 implemented as a PCI board is mounted in a PCI slot 237 of a PC.

The network camera system board 201 inserted into the PCI slot 237 may be connected to the PCI bus 236 to configure the PC-based network camera system 200.

Compared to the stand-alone system type illustrated in FIG. 1, when mounted to a PC system using a PCI interface, various advantages may be provided.

When connected to the PCI bus 236 through the PCI interface unit 235, the network camera system may be configured by sharing the resources of the PC (202).

For example, a network adapter 250 and a mass storage device 251 are installed on the PCI bus 236 of the PC 202. The stand-alone type network camera system 100 illustrated in FIG. 1 should be provided with an independent network controller 150, a mass storage device 151, and an interface corresponding thereto. However, when mounted to a PC using a PCI interface, the network adapter 250 connected to the existing PCI bus and the mass storage device 251 such as an HDD or a rewritable optical recording medium can be used as it is. Has

As another example, in the case of the audio codec 205, the audio codec may be replaced with an audio codec existing in a sound device already generalized in most PC systems. 2 illustrates a case where a separate audio codec 205 is prepared on the network camera system board 201, but in an actual configuration, the audio codec of the sound device already existing on the PC 202 is shared. can do.

Many chip products currently available on the market are available, including the PCI interface, making it simple to implement the PCI interface. In addition, a PCI interface can be easily implemented when a separate PCI interface chip is installed.

In this case, the PC central processing unit 260 of the PC 202 executes a device driver for the network camera system board 201 stored in the main memory 262.

The device driver executed by the PC central processing unit 260 controls components located on the network camera system board 201 and is responsible for data input and output with the network camera system board 201.

In the main memory 262 of the PC 202, an application program for controlling the components of the network camera system board 201 in addition to the device driver to operate as the network camera system 200 integrally with the PC 202. (application programs) also exist.

The application program converts the data received from the network camera system board 201 using the device driver and transmits the data to the user, and transmits the data to the terminal device 280 at a remote location through the network adapter 250 and mass storage. It is responsible for storing on the device.

The application program receives a TCP / IP control signal packet for the camera module 210 from the remote terminal device 280 through the network adapter 250 and accordingly passes through the PCI interface unit 235 to the network camera system board 201. The network camera central processing unit 230 on) controls the pan / tilt / zoom driving of the camera module 210.

The application program converts the compressed video / audio data into the V2OIP protocol to transmit the video / audio data compressed by the hardware MPEG4 codec 240 on the remote network camera system board 201 through the network adapter 250. It also plays a role.

In the case of the PC-based network camera system 200 using the PCI interface of FIG. 2, the network camera central processing existing on the network camera system board 201 is compared with the stand-alone type network camera system 100 of FIG. 1. The role of device 230 may be configured to be reduced or omitted.

In the stand-alone form of FIG. 1, the network camera central processing unit 130 should also play a role of controlling the network controller and the mass storage device. However, the network camera central processing unit 130 on the PC-based network camera system board 201 of FIG. The existing network camera central processing unit 230 may play a minimal role or the PC central processing unit 260 may replace a role.

In this case, the network camera central processing unit 230 present on the network camera system board 201 interprets the control command transmitted by the application program on the PC through the device driver to convert the camera module 210 or other network camera system board. It will only be responsible for communicating to the components on 201. On the contrary, it only plays a role of transmitting events occurring in the camera module 210 or other components on the network camera system board 201 to the application program through the device driver.

Example 3

A digital video recorder (DVR) may be implemented using the network camera system of FIG. 1.

In this case, the configuration of the surveillance digital video recorder can be divided into a case having a plurality of camera modules and one hardware MPEG4 codec, and a case having a plurality of camera modules and a plurality of hardware MPEG4 codecs.

Composed of the plurality of camera modules and one hardware MPEG4 codec, it is divided into a case of operating a channel switching method using an image multiplexer and a case of generating a multi screen using a multi-screen generator. Can lose.

Fig. 3 is a block diagram showing an embodiment of the above-described channel switching type surveillance digital video recorder.

The surveillance digital video recorder 300 of FIG. 3 includes one audio signal among an image multiplexer 362 and a plurality of microphone inputs for selecting one digital image data among output digital image data of the plurality of camera modules 310. And a speech multiplexer 361 to select.

The voice multiplexer 361 and the image multiplexer 362 may control one of the outputs of the plurality of camera modules 310 and the microphone 307 at predetermined time intervals under the control of the network camera central processing unit 330. You can choose.

Alternatively, the TCP / IP control signal packet received from the remote terminal device 380 is converted into an image selection signal VSEL and an audio selection signal ASEL by the network camera central processing unit 330, and the image multiplexer 362 It may be input to the voice multiplexer 361.

In this case, since the plurality of camera modules 310 divide and use the frame per second of the hardware MPEG4 codec 340 used, the frame rate for each of the camera modules 310 is different. This has the disadvantage of falling. For example, if 10 camera modules are connected when a hardware MPEG4 codec having a processing capacity of 60 frames per second is used, the frame rate per camera module is limited to 6 or less. In order to prevent noise during channel switching through the image multiplexer 362 and to reduce image quality during channel switching, the actual frame rate is lower than the above numerical value.

As illustrated in FIGS. 1 and 2, the TCP / IP control signal packet for pan / tilt / zoom driving control for a plurality of camera modules is converted into a control signal CONT in the network camera central processing unit 330. The control signal demultiplexer 363 together with the camera module selection signal CSEL is input to the camera module to be selectively controlled.

Audio codec 305, video encoder 315, display device 316, memory 320, hardware MPEG4 codec 340, network controller 350, mass storage device 351 and remote terminal device 380 And the like are identical to the corresponding components already described above in FIG.

4 is a block diagram showing an embodiment of the above-described multi-screen type surveillance digital video recorder.

The multi-screen surveillance digital video recorder 400 of FIG. 4 includes a multi-screen generator 462.

The multi-screen generation unit 462 receives digital image data from a plurality of camera modules 410 and selects all or part of the multi-screen generation unit to generate a down-scaled split screen and combines the multi-screen digital data. Outputs

Accordingly, the multi-screen monitoring digital video recorder 400 of FIG. 4 has a higher resolution than the channel switching type surveillance digital video recorder 300 of FIG. 3 compared to the case of FIG. However, there is an advantage that the frame rate can be maintained as it is.

The multi-screen generation unit 462 selects all or part of the plurality of camera modules 410 at predetermined time intervals under the control of the network camera central processing unit 430. In the case of the digital video recorder 400 operating in the multi-screen method, since the voice is generally excluded, the audio codec and the voice multiplexer are excluded compared to the digital video recorder 300 shown in FIG.

Alternatively, the TCP / IP control signal packet received from the remote terminal device 480 may be converted into an image selection signal MVSEL by the network camera central processing unit 430 and input to the multi-screen generation unit 462.

As illustrated in FIGS. 1 and 2, the TCP / IP control signal packet for pan / tilt / zoom driving control for a plurality of camera modules is converted into a control signal CONT in the network camera central processing unit 430, The input to the camera module to be selectively controlled by the control signal demultiplexer 463 together with the camera module selection signal CSEL is the same as described with reference to FIG. 3.

Components such as the video encoder 415, the display device 416, the memory unit 420, the hardware MPEG4 codec 440, the network controller 450, the mass storage device 451, and the remote terminal device 480 are described above. Same as the corresponding components already described above in FIG.

As another configuration example, a surveillance digital video recorder system having a plurality of camera modules and a hardware MPEG4 codec corresponding to the number of camera modules can be configured.

In this case, unlike the case illustrated in FIG. 3 and FIG. 4, a single hardware MPEG4 codec is provided for each camera module, so that a video captured by each camera module is displayed at full frame rate and full resolution. It is possible to send and save in full resolution.

On the other hand, even if video and audio data are compressed by a hardware MPEG4 codec, the overall data amount is increased by using a plurality of codecs, which burdens transmission and storage of compressed video / audio data.

Therefore, in the configuration of the actual surveillance digital video recorder, a compromised structure in which the above three configurations are appropriately mixed according to the situation may be utilized.

Although the above has been described with reference to a preferred embodiment of the present invention, those skilled in the art will be variously modified and changed within the scope of the present invention without departing from the spirit and scope of the invention described in the claims below. I can understand that you can.

According to the present invention as described above, by using the hardware MPEG4 codec and V2OIP protocol to compress the video input to the camera and the voice input through the microphone in real time and at the same time to transmit the compressed video and audio to the remote terminal device It is possible to store at a remote terminal device. In addition, the pan / tilt / zoom control of the camera may be performed in real time in the remote terminal device in response to the image and audio transmitted in real time.

Claims (12)

A camera module having a pan / tilt / zoom driver and outputting digital image data by photographing a subject; An audio codec that receives a voice signal from a microphone and converts the voice signal into digital voice data, and receives the digital voice data into a voice signal and outputs the voice signal to a speaker; A memory unit for storing digital audio data output from the audio codec and digital image data output from the camera module; Compressing the digital audio data and the digital image data stored in the memory unit to output the compressed image / audio data to the memory unit, and expanding the compressed digital audio data and the digital image data by expanding the compressed image / audio data into the memory. Hardware MPEG4 codec for negative output; A network controller connected to a communication network to transmit the compressed voice / video data using a V2OIP protocol and to receive a control signal for a pan / tilt / zoom driver of the camera module using a TCP / IP protocol;  A network camera central processing unit connected to the camera module, a memory unit, a hardware MPEG4 codec, a network controller, and a mass storage device, and controlling the camera module, the memory unit, a hardware MPEG4 codec, a network controller, and a mass storage device; Receives and stores compressed video / audio data connected to the communication network using the V2OIP protocol, expands and outputs it to the user, and outputs a control signal for the pan / tilt / zoom driving unit of the camera module using the TCP / IP protocol. And a remote terminal device for transmitting by a network. The method of claim 1, The network camera system A video encoder for receiving the extended digital image data is converted into a video signal and output to the display device, The network camera central processing unit is further connected with the video encoder and controls the video encoder. The method of claim 1, The network camera system further includes a mass storage device for recording and reproducing the compressed video / audio data. The network camera central processing unit is further connected to the mass storage device, the network camera system, characterized in that for controlling the mass storage device. The method of claim 1, The pan / tilt / zoom driving unit of the camera module is connected to the network camera central processing unit via RS422 or RS438 and controlled by the network camera central processing unit. A camera module having a pan / tilt / zoom driver and outputting digital image data by photographing a subject; An audio codec that receives a voice signal from a microphone and converts the voice signal into digital voice data, and receives the digital voice data into a voice signal and outputs the voice signal to a speaker; A memory unit for storing digital audio data output from the audio codec and digital image data output from the camera module; Compressing the digital audio data and the digital image data stored in the memory unit to output the compressed image / audio data to the memory unit, and expanding the compressed digital audio data and the digital image data by expanding the compressed image / audio data into the memory. Hardware MPEG4 codec for negative output; A PCI interface unit connected to a PCI bus to transmit or receive the compressed video / audio data and to receive a control signal for a pan / tilt / zoom driver of the camera module; A network camera central processing unit connected to the camera module, the audio codec, the memory unit, the hardware MPEG4 codec and the PCI interface unit, and controlling the camera module, the audio codec, the memory unit, the hardware MPEG4 codec and the PCI interface unit; Located on a host bus connected to the PCI bus connected to the PCI interface unit, converts the compressed video / audio data into a video / audio data packet according to V2OIP, TCP / IP to the pan / tilt / zoom driver of the camera module A host central processing unit for converting a control signal packet according to the control signal into a control signal for a pan / tilt / zoom driving unit of the camera module; It is connected to the PCI bus connected to the PCI interface unit, and receives the video / audio data packet according to the V2OIP from the host central processing unit to transmit to the communication network, TCP / IP to the pan / tilt / zoom driver of the camera module A network controller configured to receive a quasi control signal packet from a communication network and transmit the same to the host central processing unit; And It is connected to the communication network and receives and stores the compressed video / audio data using the V2OIP protocol, expands and outputs the same to the user, and transmits a control signal for the pan / tilt / zoom driver of the camera module to the TCP / IP protocol. PC-based network camera system comprising a remote terminal device for transmitting by using. The method of claim 5, wherein The PC-based network camera system A mass storage device connected to a PCI bus connected to the PCI interface unit to record and reproduce the compressed video / audio data; The host CPU is connected to the mass storage device and controls the mass storage device. A plurality of camera modules including a pan / tilt / zoom driver and outputting digital image data by photographing a subject; An image multiplexer which receives digital image data of the plurality of camera modules and selects and outputs one digital image data in response to an image selection signal; A plurality of microphones for receiving a voice and outputting a voice signal; A voice multiplexer which receives output voice signals of the plurality of microphones and selects and outputs one voice signal in response to a voice selection signal; An audio codec for converting a voice signal output by the voice multiplexer into digital voice data and receiving the digital voice data and outputting the voice signal to a speaker; A memory unit for storing digital audio data output by the audio codec and digital video data output by the image multiplexer; Compressing the digital audio data and the digital image data stored in the memory unit to output the compressed image / audio data to the memory unit, and expanding the compressed digital audio data and the digital image data by expanding the compressed image / audio data into the memory. Hardware MPEG4 codec for negative output; A network controller connected to a communication network to transmit the compressed voice / video data using a V2OIP protocol and to receive a control signal for a pan / tilt / zoom driver of the camera module using a TCP / IP protocol;  The camera module, the image multiplexer, the audio multiplexer, the memory unit, the hardware MPEG4 codec, and a network controller are connected, and the camera module, the image multiplexer, the voice multiplexer, the memory unit, the hardware MPEG4 codec and the network controller are controlled. A network camera central processing unit; And It is connected to the communication network and receives and stores the compressed video / audio data using the V2OIP protocol, expands and outputs the same to the user, and transmits a control signal for the pan / tilt / zoom driver of the camera module to the TCP / IP protocol. A digital video recorder system for monitoring, comprising a remote terminal device for transmitting by using a remote terminal device. The method of claim 7, wherein The image processing signal and the audio selection signal are the central processing to select one digital image data and one audio signal among the plurality of digital image data and the plurality of audio signals in a predetermined order at predetermined time intervals. Surveillance digital video recorder system, characterized by being generated by a device. The method of claim 7, wherein The network controller receives the video selection signal and the audio selection signal from the communication network through TCP / IP, and transmits them to the network camera central processing unit. And the network camera central processing unit controls the video multiplexer and the audio multiplexer using the video selection signal and the audio selection signal. A plurality of camera modules including a pan / tilt / zoom driver and outputting digital image data by photographing a subject; Multi-screen generation that receives the digital image data of the plurality of camera modules, selects all or a portion of the digital image data among the plurality of digital image data received in response to the image selection signal, and down-scales the image data into multi-screen digital image data. part; A memory unit for storing digital image data output by the multi-screen generator; A hardware MPEG4 codec which compresses the digital image data stored in the memory unit and outputs the compressed image data to the memory unit, and expands the compressed image data to output the decompressed digital image data to the memory unit; A network controller connected to a communication network to transmit the compressed image data using a V2OIP protocol and to receive a control signal for a pan / tilt / zoom driver of the camera module using a TCP / IP protocol;  A network camera central processing unit connected to the camera module, the multi-screen generation unit, the memory unit, the hardware MPEG codec and the network controller, and controls the camera module, the multi-screen generation unit, the memory unit, the hardware MPEG codec and the network controller. ; And It is connected to the communication network to receive and store the compressed image data using the V2OIP protocol and to expand and output the same to the user. The control signal for the pan / tilt / zoom driving unit of the camera module is transmitted using the TCP / IP protocol. A digital video recorder system for monitoring, comprising a remote terminal device for transmitting. The method of claim 10, The image selection signal is generated by the network camera central processing unit to select and downscale all or part of the plurality of digital image data of the plurality of digital image data in a predetermined order at predetermined time intervals. Surveillance digital video recorder system. The method of claim 10, The network controller receives the image selection signal from the communication network through TCP / IP and transmits the image selection signal to the network camera central processing unit. The network camera central processing unit controls the multi-screen generating unit using the image selection signal.

Images