WO2002041255A1 - Systeme de recadrage de deux images et procede d'utilisation dans le domaine de l'impression numerique et de la surveillance - Google Patents

Systeme de recadrage de deux images et procede d'utilisation dans le domaine de l'impression numerique et de la surveillance Download PDF

Info

Publication number
WO2002041255A1
WO2002041255A1 PCT/EP2000/011508 EP0011508W WO0241255A1 WO 2002041255 A1 WO2002041255 A1 WO 2002041255A1 EP 0011508 W EP0011508 W EP 0011508W WO 0241255 A1 WO0241255 A1 WO 0241255A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
video
camera
background
images
Prior art date
Application number
PCT/EP2000/011508
Other languages
English (en)
Inventor
Ico Thieme
Original Assignee
Orlean Holding N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Orlean Holding N.V. filed Critical Orlean Holding N.V.
Priority to AU2001215223A priority Critical patent/AU2001215223A1/en
Priority to PCT/EP2000/011508 priority patent/WO2002041255A1/fr
Priority to US09/834,920 priority patent/US20010055414A1/en
Publication of WO2002041255A1 publication Critical patent/WO2002041255A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/60—Editing figures and text; Combining figures or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion

Definitions

  • the present invention relates to improvements in and/or related to a two-image cropping system and method and the application thereof to the digital printing and surveillance field, accordmg to the preambles of claims 1, 2 and 7,8, respectively.
  • the novel two-image cropping technique disclosed thereby has been used for digitally printing a composite image, for example a card, with the face of a user and/or other alternative printed products incorporated therein, such as m visiting/business cards or bills with photographs, greeting cards with photographs, stickers and so on.
  • the inventor has found, after a lot of tests under very different conditions, that such a two-image cropping system and method, and the related software, could be, on one side, improved, and that, on the other side, after the application of said improvements, the two-image cropping technique could be used in fields different from the digital printing field, for example in the spatial surveillance or safety system field.
  • the inventor has found that, by arranging the system in crowded places, upon a continuous movement of persons inside and outside of the video camera surveillance field, the presence sensor, operating based on the microwave technology, sensed the continuous displacements of the persons, even if they were outside of the video camera shooting field, thereby preventing a "clean" reference background from being taken.
  • the difference of the microwave technology used in the presence sensor, and which is based on the presence of a mass, such as the physical body of a person, and the "visual perception" of the system, based on the detection of the images by the video camera, as for the human vision, cold affect the reliability of the two-image cropping system in the mentioned system installation condition, i.e. in crowded spaces continuously traversed by persons passing through the video camera shooting field and/or the adjoining regions.
  • the outside presence sensor which constitutes per se a physical component, or a hardware component of the system, must substantially meet two requirements, and more specifically: 1) it must respect and functionally occupy, as far as possible, the video camera overshooting field, and 2) it must discriminate the same situations seen by the video camera.
  • a parallax problem related to the video camera optical overshooting field occurred, with a consequent impossibility of "focalizing" the sensitivity lobe of the microwave sensor with respect to the taking field of the video camera.
  • a first object of the present invention is to provide a novel technique or method for detecting a presence of intruding persons or bodies, without using prior presence microwave sensors, which novel detecting technique or method can be carried out by a program module or software and by using the system disclosed in the previous application.
  • a further object of the invention is to simultaneously use the software program of said technique or method, to also simplify and speed up the prior managing software, by eliminating therefrom the prior provided Backlni.exe and BackBuilkd.exe programs.
  • Another object of the present invention is to suggest firther application fields for said software and tlie system for the accomplishment thereof, optionally hi an advantageously simplified fonn.
  • Yet another object of the present invention is to allow the improved software to be also used for broadenmg tlie printed article types to be obtained by both the system accordmg to the previous application and the system according to tlie present invention.
  • the optical detection of intruder presence by software which can be autonomously performed by the system, allows to fully eliminate both the prior detector, per se, i.e. made as a hardware component, and the drawbacks related to the operation thereof.
  • Another important advantage is that the provision of the above mentioned novel algorithm has allowed an indirect and immediate development of the software in fields different from the digital printing of a composite image, for example in the spatial surveillance and safety field.
  • the BackGenerator.exe program module according to the present invention fully replaces the two Backlni.exe and BackBuild.exe modules, since the functions carried out by these two programs have been embedded or incorporated in the novel BackGenerator.exe software module.
  • Figure 1 illustrates a typical sensitivity lobe of a microwave sensor
  • Figure 2 illustrates the system video camera overshooting field, as tending to infinite
  • Figure 3 illustrates the parallax phenomenon related to the use of the mixed detection technique provided in PCT/EP 00/ 03389;
  • Figure 4 illustrates the background updating or refreshment at the moment of the BackGenerator, and the building of a "virtual reference background" (16B1);
  • Figure 5 illustrates as a detail the composition of the "virtual background" (16B1)
  • Figure 6 illustrates the new cycle for eliminating the backgrounds (16B1)
  • Figure 7 is a schematic general block diagram of a simplified surveillance and safety or security system according to the present invention
  • Figure 8 illustrates the inside of a store being surveilled or monitored by the surveillance and safety or security system according to the present invention
  • Figure 9 illustrates a monitoring and surveilling room of the store shown in figure 8, according to the prior art
  • Figure 10 illustrates a "sample image" which can be stored in the system as a “reference background” or as a “first image”;
  • Figure 11 illustrates an image as cyclically provided by the video-camera, or "second image” and which is automatically compared with the reference image or "first image” of figure 10;
  • Figure 12 illustrates a result of an analysis between the "second image” and "first image", which, after having performed the cropping, shows the presence of remaining areas indicating a presence of an intruder;
  • Figure 13 shows a color changing of the surveillance monitor screen and the displaying thereon of the remaining or residual areas after the cropping, or of the intruder;
  • Figure 14 shows a flow chart illustrating the operation mode of the surveillance and safety system and method according to the present invention.
  • Figure 15 is a schematic general block diagram of the system, shown by a dash and double-dots frame and including a first electronic component assembly, known per se, shown by a dash and single-point frame, and an additional electronic component assembly, shown by a dashed frame;
  • Figures 16A to 16E schematically illustrate, by way of an example, a "panorama" and tlie operating steps for making a composite card by the system and method according to PCT/EP 00/03389 reference;
  • Figure 17 conceptually illustrates the files provided for forming the time "queue” of the scratchpad at the starting of the system, corresponding to the "overshoot background";
  • Figure 18 schematically illustrates tl e background back slipping principle to carry out the self-updating step of the "reference background"
  • Figure 19 illustrates, by way of an example, the background interpolation function principle as applied to a "twin" image, of the "background with subject” image, to update the “reference background” as the "background with subject” image is taken, as well as to eliminate any transient noises from the "overshoot backgrounds”.
  • the BackGenerator.exe program operates as follows: For verifying that no disturbing persons or elements are arranged before the apparatus or system, two overshootings or images are remotely taken, for example, at 1 second from one another, by using the same video camera 18 of the system.
  • the two images are chromatically compared with respect to their pixels, i.e. each individual pixel of the first overshooting or image is measured and compared with the pixel at the same position of the second overshooting or image. If the chromatic difference would be less than a preset given tolerance, then said pixel would be judged as the same, otlierwise said pixel being marked as different.
  • the different pixels are less than a given tolerance (for example 200, with reference to a total pixel number of over 442,000 of the whole image), then it will be judged that no variations of the two images have occurred and that, accordingly, before the video camera no person is arranged (who could not remain absolutely static), and that any disturbing elements, such as casted shadows (i.e. persons who are directly arranged hi tlie visual field of the video camera optics system but provide light interferences), or light reflections either of a direct or of a mirror or polished element reflected type are present.
  • a given tolerance for example 200, with reference to a total pixel number of over 442,000 of the whole image
  • the system will switch the illm ⁇ inath g system on and will take two other overshootings, spaced by 1 second from one another. These two images too are analyzed by tlie same technique to verify that, in the meanwhile, no disturbing element has entered the visual field of the video camera lens.
  • the system will continue to take overshootings or images, at a distance of 1 second from one another, while performing a comparing thereof so as to found a pair of overshootings or images, without a difference greater than the provided tolerance (for example 200).
  • the system will provide a signal, such as an acoustic signal or warning signal, and open a window on the monitor including a short message asking the persons near the video-camera to move away, while informing said persons that their moving away would be necessary to perform a periodic self maintenance operation, or allow the system to properly operate.
  • a signal such as an acoustic signal or warning signal
  • the virtual reference background, figure 16B1 is now caused to backward slip or slide by two positions (figure 6), together with all the old backgrounds, with the exception of the Back5 background, which is now affected only by the BackGenerator.exe module, and accordingly by updated images, figure 6, which operation occurred, in the shown example, at 16.00 hours.
  • a subject overshooting operation for forming a card is performed.
  • the image taken by the video camera is stored in the BackO background, and the background interpolation 0 function is started for summarily eliminating the subject areas, and then replacing them by those areas arranged at the same position, coming from the background.
  • a reference virtual background, figure 16B1 is formed, in which the image portion not covered by the subject is updated at the overshooting time, whereas the portion "masked" by the subject must be recovered from a previous information (Backl ⁇ Back4).
  • This virtual reference background constitutes the image which will be used by the cropping algorithm in order to discriminate the "subject" areas from the "background” areas.
  • Two are the innovations introduced into the software module representing the interface to the client, i.e. into the TheMask.exe module.
  • the first allows to take decisions related to the "card” and “greetings bill” products, as novel printed forms/patterns.
  • the cards were printed by the so called “live printing” method, in which the image occupied tl e overall surface on the card.
  • the user is now provided with the possibility of choosing the end product according to three patterns, for example: 1) with the prior live printed pattern or 2) with a frame shaped perimetrical edge or 3) with a frame shaped perimetrical edge and a caption at the bottom portion of the card, greetings bill or the like.
  • the second innovation is related to the so-called "stickers” and "visiting bills or cards”, in which, according to the invention, it is now possible to select if tlie photo pagination must be vertical (a commercial form) or horizontal, thereby admitting the presence of two persons simultaneously, for example a husband-wife pair, a friend set and so on.
  • the two-image cropping technique has as the main principle of performing a comparative analysis of two images in order to establish their differences.
  • figure 16C By the above disclosed operation set, it is possible to identify different areas within an image being analyzed, figure 16C, with respect to a reference image, fig. 16B.
  • this identifying mechanism related to the analyzed image variations can be used in principle, according to tlie invention, in all the fields in which it would be necessary to perform an image automatic analysis for different purposes.
  • an area 40 such as the inside area of a goods store, monitored by one or more video-cameras, such as four video-cameras, not shown, figure 8, in which the case or box 42 number herein provided and the video-camera number, and related monitors 43, figures 9, make difficult for a monitoring operator 44 to safely control the overall area 40, will be hereinafter disclosed.
  • a possible intruder could not be easily dete ⁇ tqek . as he/she moves through the large boxes 42 by concealing therebehind. If the surveillance operator does not observe the related monitor at the intruder movement instant, then the surveillance operator will not be able of detecting the presence of the intruder who could operate in a rather free manner.
  • the surveillance and safety system accordmg to the invention is simplified in comparison to the system of the previous application and is adapted to analyze the image supplied by one or more video cameras and detect the moving intruder bodies, independently from the image complexity or the presence of objects through the area being monitored, such as frirniture pieces, vehicles and the like.
  • the simplified surveillance and safety system comprises a PC 13, a video acquisition board 16, a monitor 17 and one or more video camera 18, for example of the type described in the previous application.
  • a “sample image” is at first overshoot or “captured”, for example at the safety system energizing moment, and this "sample image” is stored in the system as a "reference background", figure 10, for example as shown for a safe box 45 in a room 46.
  • control monitor 43 (a single monitor being advantageously provided) of the video camera/video cameras, will provide the normal image taken through the environment 46, figure
  • the image is stored, figure 12, together with the event hour and its place, for example the room access door area.
  • the surveilling operator 44 can immediately display, in the control room, the image of the intruder 47.
  • the time for taking or "capturing" the reference image having the best safety characteristics is the alarm actuating or energizing time.
  • an image storing cycle would be provided, to operate as a "reference image" for the cropped pattern, figure 10, with a typical time which can vary, for example, from 30 to 600 seconds, depending on the environment variation degree, and the area variation analysis will be performed on a "reference background", figure 10, related to few minutes before the video- camera overshooting or taking time.
  • a typical time which can vary, for example, from 30 to 600 seconds, depending on the environment variation degree, and the area variation analysis will be performed on a "reference background", figure 10, related to few minutes before the video- camera overshooting or taking time.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

L'invention concerne un système perfectionné de recadrage de deux images et son procédé d'utilisation dans le domaine de l'impression numérique, par exemple pour l'élaboration et l'édition numérique d'une image composite, par exemple une carte à photo, dans laquelle est intégré le visage d'un utilisateur, utilisant un détecteur de présence sous forme de logiciel exploité à l'aide de la caméra vidéo (18) du système. Le détecteur de présence commandé par logiciel optique peut également être utilisé dans un système de recadrage de deux images simplifié utilisé dans le domaine de la surveillance et de la sécurité.
PCT/EP2000/011508 2000-04-14 2000-11-20 Systeme de recadrage de deux images et procede d'utilisation dans le domaine de l'impression numerique et de la surveillance WO2002041255A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
AU2001215223A AU2001215223A1 (en) 2000-11-20 2000-11-20 Improved two-image cropping system and method and the use thereof in the digitalprinting and surveillance field
PCT/EP2000/011508 WO2002041255A1 (fr) 2000-11-20 2000-11-20 Systeme de recadrage de deux images et procede d'utilisation dans le domaine de l'impression numerique et de la surveillance
US09/834,920 US20010055414A1 (en) 2000-04-14 2001-04-16 System and method for digitally editing a composite image, e.g. a card with the face of a user inserted therein and for surveillance purposes

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/EP2000/011508 WO2002041255A1 (fr) 2000-11-20 2000-11-20 Systeme de recadrage de deux images et procede d'utilisation dans le domaine de l'impression numerique et de la surveillance

Publications (1)

Publication Number Publication Date
WO2002041255A1 true WO2002041255A1 (fr) 2002-05-23

Family

ID=8164166

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2000/011508 WO2002041255A1 (fr) 2000-04-14 2000-11-20 Systeme de recadrage de deux images et procede d'utilisation dans le domaine de l'impression numerique et de la surveillance

Country Status (2)

Country Link
AU (1) AU2001215223A1 (fr)
WO (1) WO2002041255A1 (fr)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4891660A (en) * 1988-11-29 1990-01-02 Pvi, Inc. Automatic photographic system and frame dispenser
GB2235347A (en) * 1989-08-21 1991-02-27 Pamela L Barber Making electronically-produced postcards
EP0635983A2 (fr) * 1993-07-19 1995-01-25 AT&T Corp. Méthode et moyen pour détecter des personnes dans des séquences d'images
US5668605A (en) * 1994-10-25 1997-09-16 R. T. Set Object keying in video images based on distance from camera
EP0805405A2 (fr) * 1996-02-05 1997-11-05 Texas Instruments Incorporated Détection d'événements de mouvement pour l'indexation de vidéos
US5764306A (en) * 1997-03-18 1998-06-09 The Metaphor Group Real-time method of digitally altering a video data stream to remove portions of the original image and substitute elements to create a new image
WO1999055995A1 (fr) * 1998-04-29 1999-11-04 Malcolm William Thomas Systeme de commande d'acces

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4891660A (en) * 1988-11-29 1990-01-02 Pvi, Inc. Automatic photographic system and frame dispenser
GB2235347A (en) * 1989-08-21 1991-02-27 Pamela L Barber Making electronically-produced postcards
EP0635983A2 (fr) * 1993-07-19 1995-01-25 AT&T Corp. Méthode et moyen pour détecter des personnes dans des séquences d'images
US5668605A (en) * 1994-10-25 1997-09-16 R. T. Set Object keying in video images based on distance from camera
EP0805405A2 (fr) * 1996-02-05 1997-11-05 Texas Instruments Incorporated Détection d'événements de mouvement pour l'indexation de vidéos
US5764306A (en) * 1997-03-18 1998-06-09 The Metaphor Group Real-time method of digitally altering a video data stream to remove portions of the original image and substitute elements to create a new image
WO1999055995A1 (fr) * 1998-04-29 1999-11-04 Malcolm William Thomas Systeme de commande d'acces

Also Published As

Publication number Publication date
AU2001215223A1 (en) 2002-05-27

Similar Documents

Publication Publication Date Title
US20010055414A1 (en) System and method for digitally editing a composite image, e.g. a card with the face of a user inserted therein and for surveillance purposes
US6937743B2 (en) Process and device for detecting fires based on image analysis
US20220292944A9 (en) Fire monitoring system
JP3221883B2 (ja) 多重データ源を印刷文書上に結合するための装置
US4999614A (en) Monitoring system using infrared image processing
AU2005241466B2 (en) ATM security system
US6469734B1 (en) Video safety detector with shadow elimination
US8004575B2 (en) Methods and systems for detecting bright objects and/or adaptively modifying video camera exposure
CN107664705A (zh) 乘客运输机的速度检测系统及其速度检测方法
US20120038775A1 (en) Automated teller machine comprising at least one camera that produces image data to detect manipulation attempts
US6819353B2 (en) Multiple backgrounds
KR101625538B1 (ko) 도시방범이 가능한 다차선 자동차 번호판 인식시스템
CN106770313A (zh) 一种汽车扶手的检测系统
JP5042177B2 (ja) 画像センサ
CN101764999A (zh) 分镜头视频捕获设备
KR20170012874A (ko) 표시 화면 내 화상 처리 방법 및 프로그램
JP5393086B2 (ja) 画像センサ
JP4692437B2 (ja) 監視カメラ装置
WO2002041255A1 (fr) Systeme de recadrage de deux images et procede d'utilisation dans le domaine de l'impression numerique et de la surveillance
EP1245004B1 (fr) Procede, dispositif et programme informatique permettant de surveiller une zone
JP2847597B2 (ja) 赤外線監視システム
CN109074714B (zh) 用于探测事件的探测装置、方法和存储介质
JP5771955B2 (ja) 対象識別装置及び対象識別方法
JP2010118039A (ja) 移動体検出装置
JP7328778B2 (ja) 画像処理装置及び画像処理プログラム

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 09834920

Country of ref document: US

AK Designated states

Kind code of ref document: A1

Designated state(s): AE AL AU BA BG BR CA CN CZ DZ EE HR HU IL IN IS JP KR LT LV MA MD MK MX NO NZ PL RO RU SG SI SK TR UA US VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase