KR100655573B1 - Multimedia mail service system and method using motion detection - Google Patents

Abstract

1. TECHNICAL FIELD OF THE INVENTION

The present invention relates to a multimedia mail service system using a motion detection function and a method thereof.

2. The technical problem to be solved by the invention

The present invention provides a multimedia mail service system and method and method for realizing the image quality by minimizing the burden on the system by compressing and transmitting a corresponding video by detecting a motion of an input image using a motion detection function. Its purpose is to provide a computer-readable recording medium that records the program.

3. Summary of Solution to Invention

The present invention, image acquisition means for obtaining an image; Motion detection means for detecting an operation of an image acquired by the image acquisition means using a motion detection function and compressing and encoding a corresponding video into a bitstream; Transmitting terminal means for receiving the compression-encoded bitstream from the motion detecting means and transmitting the compressed bitstream through a communication network; And a multimedia mail for receiving and storing the multimedia mail transmitted from the transmitting terminal means, notifying that the multimedia mail has arrived at the receiving terminal means, and transmitting the multimedia mail to the receiving terminal means at the request of the receiving terminal means. Ring means.                 

4. Important uses of the invention

The present invention is used for multimedia mail service.

Motion Detection, Multimedia Mail, Compression Coding, Multimedia Mail Server

Description

Multimedia mail service system and method using motion detection function {Multimedia mail service system and method using motion detection}             

1 is a block diagram of an embodiment of a multimedia mail service system using a motion detection function according to the present invention;

2 is a diagram illustrating an embodiment of an MPEG-2 video encoder with a motion detection function according to the present invention.

3 is a detailed block diagram of an embodiment of an MPEG-2 video encoder having a motion detection function according to the present invention.

4 is a timing diagram of an embodiment of the output of motion information according to the present invention;

5 is a diagram illustrating an embodiment of a screen configuration of a multiplexed video input signal according to the present invention.

6 is a detailed configuration diagram of an embodiment of a motion detection unit according to the present invention.

7 is a flowchart illustrating an embodiment of a multimedia mail service method using a motion detection function according to the present invention.

* Explanation of symbols for the main parts of the drawings                 

11,15,18,21: Camera

12,16,19,22: MPEG-2 Video Encoder with Motion Detection

13,25: personal computer 14: communication network

17: public telephone 20: sticker vending machine

23,26: next generation wireless communication terminal 24: multimedia mail server

The present invention relates to a multimedia mail service system and a method thereof, and a computer-readable recording medium recording a program for realizing the method. More particularly, the present invention relates to a multimedia mail service system using a motion detection function, a method thereof, and a method thereof. The present invention relates to a computer-readable recording medium having recorded thereon a program for realizing this.

In the conventional voice mail system, the subscriber connection unit that matches the public or telephone network and the analog signal are digitized, and at the same time, the digitized voice data is converted into an actual analog voice, and the general voice data is compressed to reduce or reduce the amount of information. A voice processing unit for reproducing the voice information, a central processing unit for controlling the system, a program for controlling the central processing unit, a memory for storing voice information, a hard disk unit for storing the processed voice data, And a disk controller for generating a control signal for writing or reading data to the hard disk unit according to the command of the central processing unit.

However, in such a voice mail system or a text mail system providing a text mail service, there is a limit in processing a large amount of video mail (or multimedia mail). This is because a large amount of video data is included in the multimedia mail information.

Therefore, MPEG-4 (Moving Picture Experts Group-4) compression method can be used for a moving picture captured by a solid-state imaging device (CCD) camera installed on a transmitting side or a moving image input through a TV (TV) receiving card. After compressing the data, attach the compressed video file to the existing mail transmission method and transmit it through an integrated information communication network (ISDN) or an asymmetric digital subscriber line (ASDL) network. Video mail systems are being developed that store and notify the recipient.

However, these video mail systems compress and transmit all the images taken by the camera and still have a large amount of data, whereas an ISDN or ASDL network cannot support such a large amount of data in real time. Since the transmission speed is low, there is a problem that the quality of the receiving side is lowered.

In addition, the conventional video mail system has a problem that the sender's personal computer takes a lot of load because the input image is MPEG-4 encoded, compressed, stored, and transmitted by the sender's personal computer.

The present invention has been made to solve the above problems, by using a motion detection function to detect the motion of the input video and transmit the compressed video, the multimedia mail service system that can maximize the image quality while minimizing the burden on the system And a computer-readable recording medium having recorded thereon a method and a program for realizing the method.

A system of the present invention for achieving the above object is a multimedia mail service system using a motion detection function, comprising: image acquisition means for acquiring an image; Motion detection means for detecting an operation of an image acquired by the image acquisition means using a motion detection function and compressing and encoding a corresponding video into a bitstream; Transmitting terminal means for receiving the compression-encoded bitstream from the motion detecting means and transmitting the same through the communication network; And a multimedia mail for receiving and storing the multimedia mail transmitted from the transmitting terminal means, notifying that the multimedia mail has arrived at the receiving terminal means, and transmitting the multimedia mail to the receiving terminal means at the request of the receiving terminal means. It characterized in that it comprises a ring means.

Meanwhile, the method of the present invention is a multimedia mail service method applied to a multimedia mail service system using a motion detection function, wherein the motion detection function detects motion of an image and compresses and encodes the video into a bitstream. Receiving a first message from the sender by the multimedia mail server; And a second step of storing, by the multimedia mail server, the multimedia mail transmitted from the sending side, notifying that the multimedia mail has arrived at the receiving side, and transmitting the multimedia mail to the receiving side at the request of the receiving side. It is characterized by.

On the other hand, the present invention, in order to provide a multimedia mail service by detecting and compressing the motion of the image using the motion detection function, the multimedia mail service system having a large processor, the motion of the image using the motion detection function A first function of receiving a multimedia mail obtained by detecting and compressing and encoding a corresponding video into a bitstream from a transmitting side of the multimedia mail server; And the multimedia mail server stores a multimedia mail transmitted from the sending side, notifies that the multimedia mail has arrived to the receiving side, and implements a second function of transmitting the multimedia mail to the receiving side upon request of the receiving side. A computer readable recording medium having recorded thereon a program is provided.

The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a configuration diagram of a multimedia mail service system using a motion detection function according to the present invention.                     

As shown in FIG. 1, the multimedia mail service system using a motion detection function according to the present invention includes a camera 11, 15, 18, 21, such as a web camera for acquiring an image, the camera 11, 15, MPEG-2 video encoders 12, 16, 19, and 22 for detecting the motion of the image obtained by using the motion detection function by using the motion detection function and compressing and encoding the corresponding video into an MPEG-2 bitstream. The personal computer 13 and the public telephone 17 for adding voice data and mail functions to the bitstream transmitted by compression encoding by the MPEG-2 video encoders 12, 16, 19, and 22 and transmitting them through the communication network 14. ), A receiving terminal such as a sticker vending machine 20, a next generation wireless communication (IMT-2000) terminal 23, a wireless communication (PCS / cellular) terminal, and the like, and receives and stores the multimedia mail transmitted from the transmitting terminal. Multimedia to recipient Notifies that the mail has arrived, the multimedia mail server 24 for transmitting the multimedia mail to the recipient according to the request of the recipient, and is notified that the mail has arrived from the multimedia mail server 24, and the user is displayed. And a receiving terminal such as a personal computer 25, a next-generation wireless communication terminal 26, etc. for requesting and displaying the transmission of the corresponding multimedia mail according to the multimedia mail selection signal.

In this case, when the sticker vending machine 20 is used as the transmitting terminal, the MPEG-2 video encoder 19 having a motion detection function at the rear end of the camera 18 while utilizing the camera 18 already installed. Equipped with a more easily implemented, and if the public phone is built in the sticker vending machine 20, the public phone is added directly to the public use the mail function, and if the public phone is not installed more public phone having a mail function To utilize. Therefore, when the sticker vending machine 20 is used, the camera 20 and the facility equipment are already installed, so that the multimedia mail service can be provided in the shortest time at low cost.

Next, a detailed configuration and operation of the MPEG-2 video encoder 12, 16, 19, and 22 having a motion detection function, which is an important component of the present invention, will be described in detail with reference to FIGS. 2 to 6.

2 is a diagram illustrating an embodiment of an MPEG-2 video encoder having a motion detection function according to the present invention.

As shown in FIG. 2, when the MPEG-2 encoder having a motion detection function is viewed at the system level, the video input signal 200 input from the camera is multiplexed from at least one channel to up to four channels so that one video input is performed. It is input as a signal 200. After receiving the multiplexed video signal 200, the MPEG-2 video encoder 201 having a motion detection function detects a motion and simultaneously encodes and compresses a video signal, and then compresses the MPEG-2 bit as compressed image data. The stream 202 and the motion detection signal 203 corresponding to each channel are output.

3 is a configuration diagram of an embodiment of an MPEG-2 video encoder having a motion detection function according to the present invention.

As shown in FIG. 3, the MPEG-2 video encoder according to the present invention includes an IP offset unit 312 for comparing the video input 320, a frame memory 309 for storing IP offset data, A memory 313 for storing data necessary for the MPEG-2 video encoder, a motion estimation and compensation unit (ME / MC) 303 for removing temporal redundancy, and a clock for generating various clocks used in the MPEG-2 video encoder A motion detector for detecting a motion by receiving a motion vector 321 output from the generator 311, the motion estimation and compensation unit ME / MC 303, and a clock 322 output from the clock generator 311. 304, a mode control unit 302 for controlling a data signal required for an MPEG-2 video encoder, a discrete cosine transform coder 300 for removing spatial redundancy of an image, and the discrete cosine transform coder 300 Variable length of the generated data A variable length coder 301 for encoding a PDU, a host interface 310 for receiving a data signal and an address signal, and outputting a signal required for an MPEG-2 video encoder, and a motion compensator MC 305 for compensating for motion. And a 420 filter 306 for filtering data, a rate / stuff controller 307 for controlling the rate and stuff required for the MPEG-2 video encoder, and a channel controller 308 for controlling the channel of the MPEG-2 video encoder. do.

On the other hand, each of the components except for the motion detection unit 304 of the respective components is already known technology, it will not be described herein any further.

The process of detecting motion in the MPEG-2 video encoder having a motion detection function according to the present invention configured as described above is as follows.

When the motion estimation and compensation unit (ME / MC) 303 encodes the current video frame, the motion estimation and compensation unit (ME / MC) finds an image most similar to the video input for the current encoding from the previous frame and extracts the position information, that is, the motion vector (mot_vec, 321). To compress the image. The motion vectors mot_vec 321 are input to the motion detector 304. The motion detector 304 receives a clock 322 for motion estimation and compensation and the motion vectors mot_vec 321 and outputs a motion detection signal ACT_CH 323 when motion is detected. In other words, if there is no motion in the input image, the value of the motion vector (mot-vec, 221) is 0, but if there is motion in the input image, the value of the motion vector (mot_vec, 221) will be greater than 0, so that the motion information Will be obtained. Then, the position information of the macroblock currently being encoded is obtained to detect which part of the current screen there is motion.

4 is a timing diagram of an embodiment of an output of motion information according to the present invention.

In general, when a video encoder is configured in hardware, a clock indicating a reference time point of a field or frame, a picture constituting the field or frame, a macro block constituting the picture, or the like is required.

As shown in FIG. 4, the clock used in the motion detection unit according to the present invention includes a picture clock 401 and a macroblock clock mbck 402 constituting the clock. In particular, the macroblock clocks mbck and 402 are clocks used for the clocks 404 for motion estimation and compensation. The macroblock clocks mbck and 402 are clocks of the motion vectors mot_vec 321 of the motion estimation and compensation unit 303. The clock is kept synchronized. The reset signal 403 is a signal for resetting the counter used in the motion detection unit, and the motion vectors mot_vec and 405 output from the motion estimation and compensation unit 303 are clocks 404 for motion estimation and compensation. Is valid for at least 256 clocks (27 MHz). For reference, when an NTSC (720x480) format image is input, valid data is a macroblock (16 × 16) including 1350 pieces corresponding to 45 × 30 per picture.

5 is a configuration diagram of an embodiment of a screen configuration of a multiplexed video input signal according to the present invention.

As shown in FIG. 5, when data is input by multiplexing to one input line from up to four channels, the screen is configured as shown in FIG. 5.

A method of extracting the position of the macroblock in which motion is detected and outputting the information based on the operation timing as shown in FIG. 4 also has the screen configuration as shown in FIG. If only one channel is used, occupy the entire screen. In addition, one channel having a size of 1/4 of the National Television System Committee (NTSC) can be displayed in the middle of the screen by using the offset function.

6 is a detailed configuration diagram of an embodiment of the motion detection unit 304 according to the present invention.

As shown in FIG. 6, the motion detection unit 304 according to the present invention includes a horizontal counter 605 and a horizontal comparator 606 for obtaining a horizontal position in a macro block, and a vertical in a macro block. The motion detection signal 602 is output by detecting a motion by using a vertical counter 607 for calculating a position, a vertical comparator 608, and a magnitude 601 of a motion vector output from the motion estimation and compensator 303. A first logical sum gate 611, an output signal by the horizontal counter 605 and a horizontal comparator 606, an output signal by the vertical counter 607 and a vertical comparator 608, and the first AND gate Logically multiplying the motion detection signal by 611 to logically detect the motion of each channel, and logically OR the output signals of the logical AND processing unit 609 to perform motion on all channels. To detect A second AND gate 610 is included.

Looking at the operation of the motion detection unit according to the present invention configured as described above are as follows.

First, when a value greater than 0 is input as the value of the motion vector 601, since motion is detected, a motion detection signal _ motion_detected 602 is input to the logical product processing unit 609, and at the same time, perpendicular to the horizontal counter 605. The coefficients calculated by the counter 607 are compared in each of the horizontal comparator 606 and the vertical comparator 608 to determine the position where the motion is detected. In other words, the position of the macroblock where the motion is detected is detected by dividing the entire screen into four sections. That is, in the 45x30 macroblocks, horizontally 0-21 means the left part of the entire screen, 23-44 means the right part, and the 22nd means the middle part of the left and right screens. In addition, vertically, 0 to 14 correspond to the upper screen and 15 to 29 correspond to the lower screen among 30 macroblocks.

Accordingly, when the horizontal position is determined by the horizontal counter 605 and the coefficient is compared by the horizontal comparator 606, the horizontal position moves to the left, right, or middle of the entire screen only. You can detect if there was. In addition, the vertical position is determined by the vertical comparator 608 to determine where the coefficient corresponds to the vertical counter 607, and determines whether the movement is detected up or down. Accordingly, since the signal detecting the horizontal and vertical positions and the motion detection signal 602 are logically multiplied by each other, the motion of the screen corresponding to each channel can be independently detected and output. .

In addition, as shown in FIG. 6, the screen or the channel where the motion is detected is the operation channel [1] 612 when the motion is detected in the first quadrant, and the operation channel [2] when the motion is detected in the second quadrant ( 613), if an operation is detected in the third quadrant, an operation signal [3] 614 is output; if an operation is detected in the fourth quadrant, a warning signal of the operation channel [4] 615 is outputted; Since all signals from 609 enter the input of the second OR gate 610, when an operation is detected in any channel, a warning signal of the operation channel [0] 616 is output.

7 is a flowchart illustrating a multimedia mail service method using a motion detection function according to the present invention.

First, after acquiring an image using a camera or the like (701), the MPEG-2 video encoder having a motion detection function detects the motion of the acquired image using the motion detection function (702) to detect the corresponding video in MPEG-2. The compression is coded into a bitstream and transmitted to the transmitting terminal (703).

Thereafter, the transmitting terminal adds voice data and a mail function to the compressed and encoded bitstream, and transmits the multimedia mail to the multimedia mail server through the communication network 14 (704).

Next, the multimedia mail server receives and stores the multimedia mail, notifies the corresponding recipient (receiving terminal) that the multimedia mail has arrived (705), and transmits the multimedia mail to the recipient according to the request of the recipient. The receiving terminal receives and displays the multimedia mail (707).

Meanwhile, in the above example, an example in which voice data is added to image data and then transmitted by mail is described. However, only the image data may be transmitted by mail or only voice data may be transmitted by mail. It can also be implemented to select which data to send to the user.

As described above, the method of the present invention may be implemented as a program and stored in a recording medium (CD-ROM, RAM, ROM, floppy disk, hard disk, magneto-optical disk, etc.) in a computer-readable form.

The present invention described above is not limited to the above-described embodiments and the accompanying drawings, and various substitutions, modifications, and changes are possible in the art without departing from the technical spirit of the present invention. It will be clear to those of ordinary knowledge.

The present invention as described above, by using the motion detection function to detect the motion of the input image and transmit the compressed video, it is possible to minimize the burden on the system such as a transmission device / computer / network and at the same time maximize the image quality have.                     

In addition, in the present invention, by using a sticker vending machine or the like, the service can be performed by utilizing equipment such as a camera that is already installed, and the MPEG-2 compression method can be used to perform services without additional equipment on the receiving side. The service can be directly received by using the MPEG-2 decoding function and the mail function included in the OS.

Claims (9)

In a multimedia mail service system using a motion detection function, Image acquisition means for acquiring an image; Motion detection means for detecting an operation of an image acquired by the image acquisition means using a motion detection function and compressing and encoding a corresponding video into a bitstream; Transmitting terminal means for receiving the compression-encoded bitstream from the motion detecting means and transmitting the compressed bitstream through a communication network; And Multimedia mailing for receiving and storing the multimedia mail transmitted from the transmitting terminal means, notifying that the multimedia mail has arrived to the receiving terminal means, and transmitting the multimedia mail to the receiving terminal means at the request of the receiving terminal means. Way Multimedia mail service system using a motion detection function comprising a. The method of claim 1, The motion detection means, Storage means for storing the input video data; Motion estimation and compensation means for removing temporal redundancy of the stored data; Clock generation means for generating various clocks; Motion detection means for detecting motion by receiving a motion vector output from the motion estimation and compensation means and a clock required for motion detection output from the clock generation means; And Control and encoding means for controlling and encoding the video data Multimedia mail service system using a motion detection function comprising a. The method of claim 2, The motion detecting means, And detecting a motion position by using a magnitude of a motion vector output from the motion estimation and compensation means, and detecting a motion position by using position information of a macroblock. The method of claim 2, The motion detecting means, A motion detector for detecting a motion by using the magnitude of the motion vector output from the motion estimation and compensation means and outputting a motion detection signal; A horizontal position detector for obtaining a horizontal position in one macro block; A vertical position detector for obtaining a vertical position in one macro block; A first sensing unit for independently detecting a motion of each channel by ANDing the output signals of the motion detecting unit, the horizontal position detecting unit, and the vertical position detecting unit; And A second sensing unit for sensing motion of all channels by ORing each output signal of the first sensing unit Multimedia mail service system using a motion detection function comprising a. The method according to any one of claims 1 to 4, The transmitting terminal means, And a voice data and a mail function are added to the bitstream encoded by the motion detection means and transmitted to the multimedia mailing means through the communication network. The method according to any one of claims 1 to 4, The transmitting terminal means, Multimedia mail service system using a motion detection function comprising a sticker vending machine or a payphone. In the multimedia mail service method applied to a multimedia mail service system using a motion detection function, A first step of receiving, by a multimedia mail server, a multimedia mail obtained by detecting a motion of an image using a motion detection function and compressing and encoding the corresponding video into a bitstream from a transmitting side; And A second step of the multimedia mail server storing the multimedia mail transmitted from the sender, notifying that the multimedia mail has arrived at the receiver, and transmitting the multimedia mail to the receiver at the request of the receiver; Multimedia mail service method using a motion detection function comprising a. The method of claim 7, wherein The process of detecting the motion of the image using the motion detection function, A third step of obtaining a magnitude of a motion vector output from the motion estimation and compensation unit; A fourth step of checking whether the magnitude of the obtained motion vector is larger than a predetermined threshold; A fifth step of obtaining a horizontal position of the movement by comparing the counter coefficients of the horizontal counter, and obtaining a vertical position of the movement by comparing the counter coefficients of the vertical counter; And Sixth step of detecting and outputting motion independently for each channel Multimedia mail service method using a motion detection function comprising a. In order to provide a multimedia mail service by detecting and compressing the motion of an image using a motion detection function, a multimedia mail service system having a large capacity processor, A first function of receiving, by a multimedia mail server, a multimedia mail obtained by detecting a motion of an image using a motion detection function and compressing and encoding the corresponding video into a bitstream from a transmitting side; And A second function of storing, by the multimedia mail server, the multimedia mail transmitted from the sending side, notifying that the multimedia mail has arrived at the receiving side, and transmitting the multimedia mail to the receiving side at the request of the receiving side; A computer-readable recording medium having recorded thereon a program for realizing this.

Images