WO2005109749A1 - Methods and systems of monitoring images using mobile communication terminals - Google Patents

Methods and systems of monitoring images using mobile communication terminals Download PDF

Info

Publication number
WO2005109749A1
WO2005109749A1 PCT/KR2005/001372 KR2005001372W WO2005109749A1 WO 2005109749 A1 WO2005109749 A1 WO 2005109749A1 KR 2005001372 W KR2005001372 W KR 2005001372W WO 2005109749 A1 WO2005109749 A1 WO 2005109749A1
Authority
WO
WIPO (PCT)
Prior art keywords
images
mobile communication
motion
module
communication terminals
Prior art date
Application number
PCT/KR2005/001372
Other languages
French (fr)
Inventor
Changho Lee
Original Assignee
Multivia Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Multivia Co., Ltd. filed Critical Multivia Co., Ltd.
Publication of WO2005109749A1 publication Critical patent/WO2005109749A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19654—Details concerning communication with a camera
    • G08B13/19658—Telephone systems used to communicate with a camera, e.g. PSTN, GSM, POTS
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B13/00—Burglar, theft or intruder alarms
    • G08B13/18—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength
    • G08B13/189—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems
    • G08B13/194—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems
    • G08B13/196—Actuation by interference with heat, light, or radiation of shorter wavelength; Actuation by intruding sources of heat, light, or radiation of shorter wavelength using passive radiation detection systems using image scanning and comparing systems using television cameras
    • G08B13/19602—Image analysis to detect motion of the intruder, e.g. by frame subtraction
    • G08B13/19608—Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/16—Analogue secrecy systems; Analogue subscription systems
    • H04N7/173—Analogue secrecy systems; Analogue subscription systems with two-way working, e.g. subscriber sending a programme selection signal
    • H04N7/17309—Transmission or handling of upstream communications
    • H04N7/17318—Direct or substantially direct transmission and handling of requests
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W88/00—Devices specially adapted for wireless communication networks, e.g. terminals, base stations or access point devices
    • H04W88/02—Terminal devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W92/00—Interfaces specially adapted for wireless communication networks
    • H04W92/16—Interfaces between hierarchically similar devices
    • H04W92/18—Interfaces between hierarchically similar devices between terminal devices

Definitions

  • the present invention relates to methods and systems of monitoring images using mobile communication terminals. More particularly, the present invention relates to methods and systems of monitoring images using mobile communication terminals capable of monitoring images in real time without separate streaming server, by using peer to peer (P to P) method for transmitting images between a network camera and mobile communication terminals instead of streaming method.
  • P to P peer to peer
  • Methods including a method of monitoring images using mobile communication terminals are suggested as methods and systems of monitoring images recently developed more, but the methods require streaming servers respectively allotted to each group consisting of a certain number of users because the methods employ the streaming service method based on Wireless Application Protocol (WAP) as a method of transmitting images.
  • WAP Wireless Application Protocol
  • the methods might have problems such as denial of simultaneous access and network overload, etc.
  • FIG. 1 briefly illustrates a system of monitoring images using mobile communication terminals in the related art.
  • a camera 1 is provided in a place needed to be monitored and images obtained by the camera are transmitted through the wired or wireless internet 3, the camera being connected to the wired or wireless internet 3.
  • the conventional system of monitoring images is implemented to receive images of JPEG or MPEG camera, recompress the images by using codec and transmit the images to mobile communication terminals, so that operation of the streaming server is necessary.
  • codec is a codec for still pictures compressing whole area of every image without regard to degree of motion happening, so that continuous compressibility decreases.
  • the codec is a codec for simple images such as graphic or simple animation, so that it is not appropriate for the codec to compress the real picture images.
  • size of the compressed images is from 4 to 8 kilobytes, so that it is unavoidable for mobile communication terminal user to spend extremely large amount of money in receiving the images.
  • the present invention is to solve the above-mentioned problems.
  • the objects of the present invention are to implement methods and systems of monitoring images using mobile communication terminals which efficiently compresses images inputted by network cameras and transmits the images to user's mobile communication terminals in real time by using peer to peer (P to P) method instead of streaming method.
  • P to P peer to peer
  • a system of monitoring images using mobile communication terminals comprises: network cameras and mobile communication terminals, wherein the network camera comprises: an input module for receiving real picture images as input; an encoding module for performing inter-coding process that determines whether motion happened or not in the real picture image's pixel blocks of certain size, without obtaining motion vectors from the pixel blocks, performs encoding of motion blocks based on results of determining whether motion happened or not, and encodes predicted frame (P-frame) based on previously existing intra frame (I-frame) as reference frame; an alarm module for selectively notifying outside that motion happened in case that motion happening is detected by the encoding module; and a transmission module for transmitting the image encoded by the encoding module to outside, and wherein the mobile communication terminal comprises: a receiving module for receiving the encoded images from the transmission module; a decoding module for performing decoding of the encoded images by receiving the encoded images from the receiving module; and a display module for displaying decoded images by the decoding module.
  • the network camera comprises: an input module
  • the encoded images may be transmitted by peer to peer (P to P) method instead of streaming method, the encoded images being transmitted from the network cameras to the mobile communication terminals.
  • P to P peer to peer
  • the encoding module may be provided in the network cameras and the encoding module may transmit the encoded images directly to the mobile communication terminals via wired or wireless internet, without any separate re- compression process in a streaming server.
  • the decoding module may be implemented by software and the decoding module may be downloaded directly through the internet or can be received by means of short messages, etc.
  • the display module may display the decoded images as moving pictures.
  • the alarm module may notify of the motion happening, by means of sounds, lights or vibrations etc. in a place where the network camera is located, or by means of short messages to the mobile communication terminals.
  • the network camera may further comprise a storage module for storing the encoded images.
  • the mobile communication terminal may selectively receive the images encoded by the encoding module in real time or receive the images stored in the storage module.
  • the images stored in the storage module may be encoded still pictures, and the images may be stored respectively with a unit of a certain number of images corresponding to each event, the still pictures being inputted continuously with a certain interval.
  • the system may further comprise: a server for storing the encoded images taken before and after the alarm, and user information of the mobile communication terminal users.
  • a method of monitoring images using mobile communication terminals comprises: the act (a) of performing coding process by receiving real picture images as input through network camera, determining whether motion happened or not in the real picture image's pixel blocks of certain size, without obtaining motion vectors from the pixel blocks, performing encoding of the motion blocks based on results of determining whether motion happened or not, and encoding predicted frame (P-frame) based on previously existing intra frame (I-frame) as reference frame; the act (b) of notifying outside that motion happened in case that motion happening is detected during the act (a); and the act (c) of transmitting the image encoded by the act (a) directly to mobile communication terminal via wired or wireless internet, without any separate re-compression process in a streaming server.
  • the notification in the act (b) may be to notify that the motion happened, by means of sounds, lights or vibrations etc. in a place where the network camera is located, or by means of short messages to the mobile communication terminals.
  • the act (c) may be to transmit the compressed images to the mobile communication terminal in real time.
  • the act (c) may be to store the compressed images in the network camera and to transmit the stored images to the mobile communication terminals.
  • FIG. 1 briefly illustrates the related art system of monitoring images using mobile communication terminals.
  • FIG. 2 illustrates a system of monitoring images using mobile communication terminals according to the present invention.
  • FIG. 3 illustrates flow of the method of compressing moving pictures using mobile communication terminals used in the present invention.
  • FIG. 4 illustrates the method of monitoring images using mobile communication terminals according to the present invention.
  • FIG. 2 illustrates a system of monitoring images using mobile communication terminals according to the present invention.
  • the network camera 11 of the present invention is connected to the mobile communication terminal through the wired or wireless internet 13. And, the network camera 11 can be implemented with unique encoding module embedded.
  • the encoding module efficiently compresses images inputted by the network camera 11 and transmits the images through the wired or wireless internet 13, so that it does not need a streaming server for storing the compressed images therein.
  • the encoding module receives real picture images and compresses the real picture images as moving pictures. Size of moving pictures encoded by the encoding module according to the present invention is approximately from 0.5 to 2 kilobytes per one frame, a size of from a quarter to one eighth of conventional compressed images' size. Further, the encoding module may encode inputted images and store the encoded images in the network camera as still pictures. For instance, it is possible to store images of 10 seconds with 2 frames per one second. In other words, it means that it is possible to store continuous still pictures of 20 frames in one event. The number of events is not limited to one time. In case that the number of events exceeds a predetermined number of events, it is possible to store the images corresponding to the exceeded events by writing the images over the still pictures corresponding to first event.
  • Storage of the still pictures may be performed in a storage module embodied by flash memory.
  • the point of time when images were inputted through the input module of the network camera may be marked in the still pictures.
  • the mobile communication terminal has also unique decoding module according to the present invention. It is not necessary that the decoding module is provided in the mobile communication terminal. Because the decoding module is implemented in a shape of software, it is possible to download the decoding module through the wired or wireless internet or to receive the decoding module by means of short message received through the mobile communication terminal.
  • Figure 3 illustrates a method of compressing moving pictures used for the present invention.
  • a method of compressing moving pictures used for the present invention comprise an intra-coding process that still pictures are reconstructed with as many colors as it is determined depending on each still picture, object of compression, and that the reconstructed still pictures are compressed.
  • (R, G, B) values of all pixels in the still pictures are checked and arrayed in the order of frequency of existence (e.g. refer to following table 1).
  • the palette 22 consists of representative (R, G, B) values extracted from (R, G, B) values of the still pictures.
  • the index values 23 become index of each (R, G, B) value forming the palette 22.
  • pixels can be expressed with the index values 23 replacing the (R, G, B) values, and palette 22 corresponding to the index values is constructed.
  • the palette 22 is stored as it is to be used as color information of still pictures to be decompressed when decoding is performed.
  • RGB images that are compressed to be used as still pictures are almost simple still pictures and it is general that simple still pictures consists of pixels of same data values continuously, so that it is possible to compress still pictures more effectively.
  • This can be utilized in a process of obtaining sample values 25 and first map information values 24 from the index values 23.
  • the sample values 25 are generated when current index value is different from previous index value, and have the same values as the current index values.
  • the first map information values 24 indicate whether the current index value is identical with the previous index value after comparing the current index value and the previous index value.
  • the first map information values 24 can be expressed by using 1 bit.
  • the first map information value 24 can be designated as 1 in a case where the current index value is identical with the previous index value, otherwise the first map information value 24 can be designated as 0. Conversely, the first map information values 24 can be designated as "1" in a case where the current index value is identical with the previous index value, otherwise the first map information value 24 is designated as "0".
  • sample values 25 and the first map information values 24 from the index values 23 are classified into low bit sample values 27 and high bit sample values 26 to be compressed effectively.
  • Sample values that can be expressed by using less than certain number of bits are designated as "low bit sample values” and sample values that requires more than the certain number of bits are designated as "high bit sample values.”
  • the low bit sample values and the high bit sample values are separately arrayed and compressed.
  • second map in- formation values 28 are designated and used to indicate whether the sample values are the low bit sample values 27 or the high bit sample values 26.
  • the second map information values 28 are used for effective performance of compression and decompression.
  • the Table 3 gives examples of first map information values, sample values, low bit sample values, high bit sample values and second map information values depending on change on index values.
  • sample values that can be expressed by using less than 2 bits are designated as low bit sample values and sample values that can not be expressed by using 2 bits are designated as high bit sample values.
  • the second map information value for low bit sample values is designated as "0" and the second map information value for high bit sample values is designated as "1.”
  • Specific second map information values for low bit sample values and high bit sample values can be freely designated.
  • the second map information value for low bit sample values can be designated as "1" and the second map information value for high bit sample values can be designated as "0.”
  • sample values are classified, depending on whether sample values can be expressed by using less than certain number of bits, into high bit sample values and low bit sample values. Then, according to the classification, high bit sample values and low bit sample values are separately compressed.
  • sample values that can be expressed by using less than 2 bits are low bit sample values and sample values that can not be expressed by using 2 bits are high bit sample values.
  • 4 low bit sample values can be expressed by using 1 byte.
  • just 2 or 3 high bit sample values can be expressed by using 1 byte.
  • 2 bytes are needed to express 3 high bit sample values.
  • motion estimation can be performed for certain size of pixel blocks (e.g. pixel blocks of 4 * 4 pixels). Size of the pixel blocks is not limited and is changeable. The changeable size of pixel blocks distinguishes the present invention from the related art method of compressing moving pictures that performs motion estimation based on a macro block due to DCT transform.
  • the method according to the present invention only determines whether motion happened, without obtaining motion vectors from the pixel blocks, and indicates results of the determination with a third map information value 30. At this time, whether motion happened or not is checked for pixel blocks of same position.
  • the third map information values can be expressed with "0" and "1.”
  • the third map information value can be designated as "0” for pixel blocks where motions happened, otherwise the third map information value can be designated as "1.”
  • the third map information value can be designated as "1" for pixel blocks where motions happened, otherwise the third map information value can be designated as "0.”
  • the third map information value can be stored with a unit of 1 byte because it is effective to store the third map information value with a unit of 1 byte for rapid restoration.
  • motion block A process of encoding the motion block is not significantly different from a process of coding still pictures.
  • sample values of the motion blocks are obtained, and whether the sample values can be expressed with less than 2 bits or not is determined. Then, the sample values are classified into low bit sample value in a case where the sample value can be expressed with less than 2bits, and into high bit sample value in a case where the sample value can not be expressed with less than 2 bits.
  • the motion blocks are classified into low bit motion block in a case most sample values of the motion blocks are low bit sample values and, into high bit motion block in a case most sample values of the motion blocks are high bit sample values.
  • the low bit motion blocks 33 and high bit motion blocks 34 can be indicated with a fourth map information values 32.
  • the fourth map information value can be designated as "0" in a case of low bit motion blocks and the fourth map information value can be designated as "1" in a case of high bit motion blocks.
  • the method of compressing moving pictures used for the present invention for encoding one frame, motion estimation is performed continuously for all pixel blocks of the frame, and a process of encoding the frame is performed for all p ixel blocks of the frame all at once after performing the motion estimation. It is made possible to perform inter-coding efficiently with the third map information value and the fourth map information value.
  • the third map information value distinguishes motion blocks from pixel blocks where no motion happened.
  • the fourth map in- formation value distinguishes the low bit motion blocks whose most motion blocks are low bit sample values from the high bit motion blocks whose most motion blocks are high bit sample values.
  • Figure 4 illustrates a method of monitoring images using mobile communication terminal according to the present invention.
  • Images inputted by a network camera are encoded by the compression method described with reference to Figure 3 (S41). If any motion happening is detected during the encoding step, the motion happening is notified by means of sounds, lights or vibrations etc. in a place where the network camera is located, and by means of short message to the mobile communication terminal (S42).
  • the encoded image is transmitted to the mobile communication terminal through wired or wireless internet network without separate streaming server (S43).
  • the image encoded by the network camera can be transmitted to the mobile communication terminal in real time or after storing the image in a certain storage means in the network camera.
  • the systems of monitoring images using mobile communication terminals according to the present invention utilizes real time image transmission method using peer to peer (P to P) method instead of streaming method, so that it is possible to reduce expenses for system construction because the systems according to the present invention does not require any separate streaming server. Further, according to the present invention, it is possible to support network efficiently because the present invention uses the unique method of compressing moving pictures which can efficiently compress moving pictures.
  • P to P peer to peer

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The present invention relates to methods and systems of monitoring images using mobile communication terminals. More particularly, the present invention relates to methods and systems of monitoring images using mobile communication terminals capable of monitoring images in real time without separate streaming server, by using peer to peer (P to P) method for transmitting images between a network camera and mobile communication terminals instead of streaming method. A method of monitoring images using mobile communication terminal according to the present invention comprises the acts of: performing coding process by receiving real picture images as input through network camera, determining whether motion happened or not in the real picture image's pixel blocks of certain size, without obtaining motion vectors from the pixel blocks, performing encoding of the motion blocks based on results of determining whether motion happened or not, and encoding predicted frame (P-frame) based on previously existing intra frame (I-frame) as reference frame; notifying outside that motion happened in case that motion happening is detected by the act of performing; and transmitting the images encoded by the act of performing directly to mobile communication terminal via wired or wireless internet, without any separate re-compression process in a streaming server.

Description

Description
METHODS AND SYSTEMS OF MONITORING IMAGES USING MOBILE COMMUNICATION TERMINALS Technical Field
[1] The present invention relates to methods and systems of monitoring images using mobile communication terminals. More particularly, the present invention relates to methods and systems of monitoring images using mobile communication terminals capable of monitoring images in real time without separate streaming server, by using peer to peer (P to P) method for transmitting images between a network camera and mobile communication terminals instead of streaming method. Background Art
[2] The related art image monitoring is possible only through monitors of computers provided in a place equipped with the wired internet, so that there are limitations in the related art image monitoring, although usages of various kinds of mobile devices are increased.
[3] Methods including a method of monitoring images using mobile communication terminals are suggested as methods and systems of monitoring images recently developed more, but the methods require streaming servers respectively allotted to each group consisting of a certain number of users because the methods employ the streaming service method based on Wireless Application Protocol (WAP) as a method of transmitting images. Thus, the methods might have problems such as denial of simultaneous access and network overload, etc.
[4] FIG. 1 briefly illustrates a system of monitoring images using mobile communication terminals in the related art. First, a camera 1 is provided in a place needed to be monitored and images obtained by the camera are transmitted through the wired or wireless internet 3, the camera being connected to the wired or wireless internet 3.
[5] At this time, the conventional system of monitoring images is implemented to receive images of JPEG or MPEG camera, recompress the images by using codec and transmit the images to mobile communication terminals, so that operation of the streaming server is necessary. At this time, widely used codec is a codec for still pictures compressing whole area of every image without regard to degree of motion happening, so that continuous compressibility decreases. Further, the codec is a codec for simple images such as graphic or simple animation, so that it is not appropriate for the codec to compress the real picture images. Further, size of the compressed images is from 4 to 8 kilobytes, so that it is unavoidable for mobile communication terminal user to spend extremely large amount of money in receiving the images. [6] Disclosure of Invention Technical Problem
[7] The present invention is to solve the above-mentioned problems. The objects of the present invention are to implement methods and systems of monitoring images using mobile communication terminals which efficiently compresses images inputted by network cameras and transmits the images to user's mobile communication terminals in real time by using peer to peer (P to P) method instead of streaming method.
[8] Technical Solution
[9] A system of monitoring images using mobile communication terminals according to the present invention comprises: network cameras and mobile communication terminals, wherein the network camera comprises: an input module for receiving real picture images as input; an encoding module for performing inter-coding process that determines whether motion happened or not in the real picture image's pixel blocks of certain size, without obtaining motion vectors from the pixel blocks, performs encoding of motion blocks based on results of determining whether motion happened or not, and encodes predicted frame (P-frame) based on previously existing intra frame (I-frame) as reference frame; an alarm module for selectively notifying outside that motion happened in case that motion happening is detected by the encoding module; and a transmission module for transmitting the image encoded by the encoding module to outside, and wherein the mobile communication terminal comprises: a receiving module for receiving the encoded images from the transmission module; a decoding module for performing decoding of the encoded images by receiving the encoded images from the receiving module; and a display module for displaying decoded images by the decoding module.
[10] Preferably, the encoded images may be transmitted by peer to peer (P to P) method instead of streaming method, the encoded images being transmitted from the network cameras to the mobile communication terminals.
[11] Preferably, the encoding module may be provided in the network cameras and the encoding module may transmit the encoded images directly to the mobile communication terminals via wired or wireless internet, without any separate re- compression process in a streaming server.
[12] Preferably, the decoding module may be implemented by software and the decoding module may be downloaded directly through the internet or can be received by means of short messages, etc.
[13] Preferably, the display module may display the decoded images as moving pictures. [14] Preferably, the alarm module may notify of the motion happening, by means of sounds, lights or vibrations etc. in a place where the network camera is located, or by means of short messages to the mobile communication terminals.
[15] Preferably, the network camera may further comprise a storage module for storing the encoded images.
[16] Preferably, the mobile communication terminal may selectively receive the images encoded by the encoding module in real time or receive the images stored in the storage module.
[17] Preferably, the images stored in the storage module may be encoded still pictures, and the images may be stored respectively with a unit of a certain number of images corresponding to each event, the still pictures being inputted continuously with a certain interval.
[18] Preferably, the system may further comprise: a server for storing the encoded images taken before and after the alarm, and user information of the mobile communication terminal users.
[19] Differently, a method of monitoring images using mobile communication terminals comprises: the act (a) of performing coding process by receiving real picture images as input through network camera, determining whether motion happened or not in the real picture image's pixel blocks of certain size, without obtaining motion vectors from the pixel blocks, performing encoding of the motion blocks based on results of determining whether motion happened or not, and encoding predicted frame (P-frame) based on previously existing intra frame (I-frame) as reference frame; the act (b) of notifying outside that motion happened in case that motion happening is detected during the act (a); and the act (c) of transmitting the image encoded by the act (a) directly to mobile communication terminal via wired or wireless internet, without any separate re-compression process in a streaming server.
[20] Preferably, the notification in the act (b) may be to notify that the motion happened, by means of sounds, lights or vibrations etc. in a place where the network camera is located, or by means of short messages to the mobile communication terminals.
[21] Preferably, the act (c) may be to transmit the compressed images to the mobile communication terminal in real time. Preferably, the act (c) may be to store the compressed images in the network camera and to transmit the stored images to the mobile communication terminals.
[22] Brief Description of the Drawings
[23] FIG. 1 briefly illustrates the related art system of monitoring images using mobile communication terminals. [24] FIG. 2 illustrates a system of monitoring images using mobile communication terminals according to the present invention.
[25] FIG. 3 illustrates flow of the method of compressing moving pictures using mobile communication terminals used in the present invention.
[26] FIG. 4 illustrates the method of monitoring images using mobile communication terminals according to the present invention.
[27] Best Mode for Carrying Out the Invention
[28] FIG. 2 illustrates a system of monitoring images using mobile communication terminals according to the present invention.
[29] The network camera 11 of the present invention is connected to the mobile communication terminal through the wired or wireless internet 13. And, the network camera 11 can be implemented with unique encoding module embedded.
[30] The encoding module efficiently compresses images inputted by the network camera 11 and transmits the images through the wired or wireless internet 13, so that it does not need a streaming server for storing the compressed images therein.
[31] The encoding module receives real picture images and compresses the real picture images as moving pictures. Size of moving pictures encoded by the encoding module according to the present invention is approximately from 0.5 to 2 kilobytes per one frame, a size of from a quarter to one eighth of conventional compressed images' size. Further, the encoding module may encode inputted images and store the encoded images in the network camera as still pictures. For instance, it is possible to store images of 10 seconds with 2 frames per one second. In other words, it means that it is possible to store continuous still pictures of 20 frames in one event. The number of events is not limited to one time. In case that the number of events exceeds a predetermined number of events, it is possible to store the images corresponding to the exceeded events by writing the images over the still pictures corresponding to first event.
[32] Storage of the still pictures may be performed in a storage module embodied by flash memory. The point of time when images were inputted through the input module of the network camera may be marked in the still pictures.
[33] At this time, it is possible for mobile communication terminal user to monitor images compressed by the network camera in real time as moving pictures and to monitor images by searching still pictures stored in the storage module corresponding to each event.
[34] Meanwhile, the mobile communication terminal has also unique decoding module according to the present invention. It is not necessary that the decoding module is provided in the mobile communication terminal. Because the decoding module is implemented in a shape of software, it is possible to download the decoding module through the wired or wireless internet or to receive the decoding module by means of short message received through the mobile communication terminal.
[35] Hereinafter, a detailed description on a method of compressing moving pictures used for the present invention will be made with reference to Figure 3. [36] Figure 3 illustrates a method of compressing moving pictures used for the present invention. [37] A method of compressing moving pictures used for the present invention comprise an intra-coding process that still pictures are reconstructed with as many colors as it is determined depending on each still picture, object of compression, and that the reconstructed still pictures are compressed.
[38] For reconstruction of the still pictures, (R, G, B) values of all pixels in the still pictures are checked and arrayed in the order of frequency of existence (e.g. refer to following table 1).
[39] Table 1
Figure imgf000006_0001
[40] Then, as many (R, G, B) values as it is predetermined for reconstruction of the still pictures are arrayed. For example, to reconstruct still pictures having (R, G, B) values arrangement like the Table 1 with 128 colors, 128 (R, G, B) values from the most frequent (R, G, B) value (100, 110, 120) are arranged. Index value 23 and palette 22 are determined using the 128 (R, G, B) values. For example, index value and palette are determined like following Table 2.
[41] Table 2
Figure imgf000007_0001
[42] The palette 22 consists of representative (R, G, B) values extracted from (R, G, B) values of the still pictures. The index values 23 become index of each (R, G, B) value forming the palette 22. Through the above processes, pixels can be expressed with the index values 23 replacing the (R, G, B) values, and palette 22 corresponding to the index values is constructed. The palette 22 is stored as it is to be used as color information of still pictures to be decompressed when decoding is performed.
[43] On the other hand, RGB images that are compressed to be used as still pictures are almost simple still pictures and it is general that simple still pictures consists of pixels of same data values continuously, so that it is possible to compress still pictures more effectively. This can be utilized in a process of obtaining sample values 25 and first map information values 24 from the index values 23. The sample values 25 are generated when current index value is different from previous index value, and have the same values as the current index values. The first map information values 24 indicate whether the current index value is identical with the previous index value after comparing the current index value and the previous index value. The first map information values 24 can be expressed by using 1 bit. For example, the first map information value 24 can be designated as 1 in a case where the current index value is identical with the previous index value, otherwise the first map information value 24 can be designated as 0. Conversely, the first map information values 24 can be designated as "1" in a case where the current index value is identical with the previous index value, otherwise the first map information value 24 is designated as "0".
[44] After obtaining the sample values 25 and the first map information values 24 from the index values 23, the sample values 25 are classified into low bit sample values 27 and high bit sample values 26 to be compressed effectively. Sample values that can be expressed by using less than certain number of bits are designated as "low bit sample values" and sample values that requires more than the certain number of bits are designated as "high bit sample values." At this time, the low bit sample values and the high bit sample values are separately arrayed and compressed. Further, second map in- formation values 28 are designated and used to indicate whether the sample values are the low bit sample values 27 or the high bit sample values 26. The second map information values 28 are used for effective performance of compression and decompression.
[45] Table 3
Figure imgf000008_0001
[46] The Table 3 gives examples of first map information values, sample values, low bit sample values, high bit sample values and second map information values depending on change on index values. In the Table 3, sample values that can be expressed by using less than 2 bits are designated as low bit sample values and sample values that can not be expressed by using 2 bits are designated as high bit sample values. The second map information value for low bit sample values is designated as "0" and the second map information value for high bit sample values is designated as "1." Specific second map information values for low bit sample values and high bit sample values can be freely designated. Thus, conversely, the second map information value for low bit sample values can be designated as "1" and the second map information value for high bit sample values can be designated as "0."
[47] As described above, sample values are classified, depending on whether sample values can be expressed by using less than certain number of bits, into high bit sample values and low bit sample values. Then, according to the classification, high bit sample values and low bit sample values are separately compressed.
[48] For example, let us suppose that sample values that can be expressed by using less than 2 bits are low bit sample values and sample values that can not be expressed by using 2 bits are high bit sample values. In this case, 4 low bit sample values can be expressed by using 1 byte. However, just 2 or 3 high bit sample values can be expressed by using 1 byte. Sometimes, 2 bytes are needed to express 3 high bit sample values.
[49] According to a method of compressing moving pictures used for the present invention, motion estimation can be performed for certain size of pixel blocks (e.g. pixel blocks of 4 * 4 pixels). Size of the pixel blocks is not limited and is changeable. The changeable size of pixel blocks distinguishes the present invention from the related art method of compressing moving pictures that performs motion estimation based on a macro block due to DCT transform.
[50] Further, the method according to the present invention only determines whether motion happened, without obtaining motion vectors from the pixel blocks, and indicates results of the determination with a third map information value 30. At this time, whether motion happened or not is checked for pixel blocks of same position. The third map information values can be expressed with "0" and "1." The third map information value can be designated as "0" for pixel blocks where motions happened, otherwise the third map information value can be designated as "1." Conversely, the third map information value can be designated as "1" for pixel blocks where motions happened, otherwise the third map information value can be designated as "0." Further, the third map information value can be stored with a unit of 1 byte because it is effective to store the third map information value with a unit of 1 byte for rapid restoration.
[51] Hereinafter, the pixel blocks where motions happened will be termed as motion block. A process of encoding the motion block is not significantly different from a process of coding still pictures. According to the process of encoding the motion block, sample values of the motion blocks are obtained, and whether the sample values can be expressed with less than 2 bits or not is determined. Then, the sample values are classified into low bit sample value in a case where the sample value can be expressed with less than 2bits, and into high bit sample value in a case where the sample value can not be expressed with less than 2 bits.
[52] Also, the motion blocks are classified into low bit motion block in a case most sample values of the motion blocks are low bit sample values and, into high bit motion block in a case most sample values of the motion blocks are high bit sample values.
[53] At this time, the low bit motion blocks 33 and high bit motion blocks 34 can be indicated with a fourth map information values 32. For example, the fourth map information value can be designated as "0" in a case of low bit motion blocks and the fourth map information value can be designated as "1" in a case of high bit motion blocks.
[54] According to the method of compressing moving pictures used for the present invention, for encoding one frame, motion estimation is performed continuously for all pixel blocks of the frame, and a process of encoding the frame is performed for all p ixel blocks of the frame all at once after performing the motion estimation. It is made possible to perform inter-coding efficiently with the third map information value and the fourth map information value. The third map information value distinguishes motion blocks from pixel blocks where no motion happened. The fourth map in- formation value distinguishes the low bit motion blocks whose most motion blocks are low bit sample values from the high bit motion blocks whose most motion blocks are high bit sample values.
[55] In other words, it is made possible to efficiently encode one frame by arranging and encoding high bit motion blocks and low bit motion blocks separately.
[56] Figure 4 illustrates a method of monitoring images using mobile communication terminal according to the present invention.
[57] Images inputted by a network camera are encoded by the compression method described with reference to Figure 3 (S41). If any motion happening is detected during the encoding step, the motion happening is notified by means of sounds, lights or vibrations etc. in a place where the network camera is located, and by means of short message to the mobile communication terminal (S42).
[58] Thereafter, the encoded image is transmitted to the mobile communication terminal through wired or wireless internet network without separate streaming server (S43).
[59] At this time, the image encoded by the network camera can be transmitted to the mobile communication terminal in real time or after storing the image in a certain storage means in the network camera.
[60] The above-described methods and systems of monitoring images using mobile communication terminals are nothing more than preferred embodiments. The methods and systems of monitoring images using mobile communication terminals are not limited by the above description. Those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope and spirit of the invention as disclosed in the accompanying claims.
[61] Industrial Applicability
[62] The systems of monitoring images using mobile communication terminals according to the present invention utilizes real time image transmission method using peer to peer (P to P) method instead of streaming method, so that it is possible to reduce expenses for system construction because the systems according to the present invention does not require any separate streaming server. Further, according to the present invention, it is possible to support network efficiently because the present invention uses the unique method of compressing moving pictures which can efficiently compress moving pictures.
[63]

Claims

Claims
[1] A system of monitoring images using mobile communication terminals comprises: network cameras and mobile communication terminals, wherein the network camera comprises: an input module for receiving real picture images as input; an encoding module for performing inter-coding process that determines whether motion happened or not in the real picture image's pixel blocks of certain size, without obtaining motion vectors from the pixel blocks, performs encoding of motion blocks based on results of determining whether motion happened or not, and encodes predicted frame (P-frame) based on previously existing intra frame (I-frame) as reference frame; an alarm module for selectively notifying outside that motion happened in case that motion happening is detected by the encoding module; and a transmission module for transmitting the image encoded by the encoding module to outside, and wherein the mobile communication terminal comprises: a receiving module for receiving the encoded images from the transmission module; a decoding module for performing decoding of the encoded images by receiving the encoded images from the receiving module; and a display module for displaying decoded images by the decoding module.
[2] The system of claim 1, wherein the encoded images are transmitted by peer to peer (P to P) method instead of streaming method, the encoded images being transmitted from the network cameras to the mobile communication terminals.
[3] The system of claim 1, wherein the encoding module is provided in the network cameras and the encoding module transmits the encoded images directly to the mobile communication terminals via wired or wireless internet, without any separate re-compression process in a streaming server.
[4] The system of claim 1, wherein the decoding module is implemented by software and the decoding module is downloaded directly through the internet or can be received by means of short messages, etc.
[5] The system of claim 1, wherein the display module displays the decoded images as moving pictures.
[6] The system of claim 1, wherein the alarm module notifies of the motion happening, by means of sounds, lights or vibrations etc. in a place where the network camera is located, or by means of short messages to the mobile communication terminals.
[7] The system of claim 1, wherein the network camera further comprises a storage module for storing the encoded images.
[8] The system of claim 7, wherein the mobile communication terminal selectively receives the images encoded by the encoding module in real time or receives the images stored in the storage module.
[9] The system of claim 8, wherein the images stored in the storage module are encoded still pictures, and the images are stored respectively with a unit of a certain number of images corresponding to each event, the still pictures being inputted continuously with a certain interval.
[10] The system of any one of claim 1 through claim 9, further comprising: a server for storing the encoded images taken before and after the alarm, and user information of the mobile communication terminal users.
[11] A method of monitoring images using mobile communication terminals comprising: the act (a) of performing coding process by receiving real picture images as input through network camera, determining whether motion happened or not in the real picture image's pixel blocks of certain size, without obtaining motion vectors from the pixel blocks, performing encoding of the motion blocks based on results of determining whether motion happened or not, and encoding predicted frame (P-frame) based on previously existing intra frame (I-frame) as reference frame; the act (b) of notifying outside that motion happened in case that motion happening is detected during the act (a); and the act (c) of transmitting the images encoded by the act (a) directly to mobile communication terminal via wired or wireless internet, without any separate re- compression process in a streaming server.
[12] The method of claim 11, wherein the notification in the act (b) is to notify that the motion happened, by means of sounds, lights or vibrations etc. in a place where the network camera is located, or by means of short messages to the mobile communication terminals.
[13] The method of claim 11, wherein the act (c) is to transmit the compressed images to the mobile communication terminal in real time.
[14] The method of claim 11, wherein the act (c) is to store the compressed images in the network camera and to transmit the stored images to the mobile communication terminals.
PCT/KR2005/001372 2004-05-12 2005-05-11 Methods and systems of monitoring images using mobile communication terminals WO2005109749A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2004-0033369 2004-05-12
KR20040033369A KR100612083B1 (en) 2004-05-12 2004-05-12 Methods and Systems of Monitoring Images Using Mobile Communication Terminals

Publications (1)

Publication Number Publication Date
WO2005109749A1 true WO2005109749A1 (en) 2005-11-17

Family

ID=35320556

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2005/001372 WO2005109749A1 (en) 2004-05-12 2005-05-11 Methods and systems of monitoring images using mobile communication terminals

Country Status (2)

Country Link
KR (1) KR100612083B1 (en)
WO (1) WO2005109749A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101263669B1 (en) * 2011-02-16 2013-05-22 에스케이플래닛 주식회사 Image processing system of image change adaptation
KR102268596B1 (en) * 2014-12-08 2021-06-23 한화테크윈 주식회사 Apparatus for changing transmission condition of video data based on metedata and method thereof

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0917355A1 (en) * 1997-11-14 1999-05-19 Sony International (Europe) GmbH Distribution of MPEG-2 transport streams on the IEEE 1394-based home network
US20010017910A1 (en) * 2000-02-12 2001-08-30 Jong-Seog Koh Real time remote monitoring system and method using ADSL modem in reverse direction
US20020109779A1 (en) * 2001-02-15 2002-08-15 Nikon Corporation Electronic camera and image processing program
US20030097458A1 (en) * 2000-10-02 2003-05-22 Mikael Bourges-Sevenier Method and apparatus for encoding, transmitting and decoding an audiovisual stream data
US20030112327A1 (en) * 2001-12-17 2003-06-19 Jeong Se Yoon Camera information coding/decoding method for synthesizing stereoscopic real video and a computer graphic image

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0917355A1 (en) * 1997-11-14 1999-05-19 Sony International (Europe) GmbH Distribution of MPEG-2 transport streams on the IEEE 1394-based home network
US20010017910A1 (en) * 2000-02-12 2001-08-30 Jong-Seog Koh Real time remote monitoring system and method using ADSL modem in reverse direction
US20030097458A1 (en) * 2000-10-02 2003-05-22 Mikael Bourges-Sevenier Method and apparatus for encoding, transmitting and decoding an audiovisual stream data
US20020109779A1 (en) * 2001-02-15 2002-08-15 Nikon Corporation Electronic camera and image processing program
US20030112327A1 (en) * 2001-12-17 2003-06-19 Jeong Se Yoon Camera information coding/decoding method for synthesizing stereoscopic real video and a computer graphic image

Also Published As

Publication number Publication date
KR100612083B1 (en) 2006-08-14
KR20050108554A (en) 2005-11-17

Similar Documents

Publication Publication Date Title
US8665943B2 (en) Encoding device, encoding method, encoding program, decoding device, decoding method, and decoding program
US9414086B2 (en) Partial frame utilization in video codecs
US8254707B2 (en) Encoding device, encoding method, encoding program, decoding device, decoding method, and decoding program in interlace scanning
US11558631B2 (en) Super-resolution loop restoration
US20020154331A1 (en) Image data transmission apparatus and image data receiving apparatus
US20110299605A1 (en) Method and apparatus for video resolution adaptation
JP2001507880A (en) Video image transmission method
CN111464811A (en) Image processing method, device and system
CN111447442B (en) Intra-frame encoding method, intra-frame decoding method, device, and medium
US20050195901A1 (en) Video compression method optimized for low-power decompression platforms
WO2005109749A1 (en) Methods and systems of monitoring images using mobile communication terminals
CN110636293B (en) Video encoding and decoding methods and devices, storage medium and electronic device
CN101841704B (en) Method and device for compressing and decompressing video bit stream
CN108933945B (en) GIF picture compression method, device and storage medium
CN112351282A (en) Image data transmission method and device, nonvolatile storage medium and processor
CN111491166A (en) Dynamic compression system and method based on content analysis
CN111212288A (en) Video data encoding and decoding method and device, computer equipment and storage medium
JPH11187383A (en) Video monitor system and video monitor method
KR101251879B1 (en) Apparatus and method for displaying advertisement images in accordance with screen changing in multimedia cloud system
US20070081731A1 (en) Method of compressing moving pictures for mobile devices
Fitzek et al. VideoMeter tool for YUV bitstreams
CN114286098A (en) Video encoding and decoding method, system, device and storage medium
WO2020181540A1 (en) Video processing method and device, encoding apparatus, and decoding apparatus
CN114071144A (en) Video coding and decoding method and device based on quality grading
JPH10285565A (en) Image transfer device

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KP KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Country of ref document: DE

122 Ep: pct application non-entry in european phase