WO2004102957A1 - Systeme d'imagerie combinee - Google Patents

Systeme d'imagerie combinee Download PDF

Info

Publication number
WO2004102957A1
WO2004102957A1 PCT/SG2004/000083 SG2004000083W WO2004102957A1 WO 2004102957 A1 WO2004102957 A1 WO 2004102957A1 SG 2004000083 W SG2004000083 W SG 2004000083W WO 2004102957 A1 WO2004102957 A1 WO 2004102957A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
person
camera
temperature
view
Prior art date
Application number
PCT/SG2004/000083
Other languages
English (en)
Inventor
Kevin Ng
Hai Seng Michael Liew
Woei Ling Leow
Mingpo Tham
Original Assignee
Honeywell International Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honeywell International Inc. filed Critical Honeywell International Inc.
Priority to EP04726360A priority Critical patent/EP1627525A4/fr
Priority to JP2006532241A priority patent/JP2006528474A/ja
Publication of WO2004102957A1 publication Critical patent/WO2004102957A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2624—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of whole input images, e.g. splitscreen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H04N23/11—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths for generating image signals from visible and infrared light wavelengths
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/30—Transforming light or analogous information into electric information
    • H04N5/33—Transforming infrared radiation

Definitions

  • the present invention relates to a combined imaging system and refers particularly, though not exclusively, to a combined imaging system wherein a plurality of different forms of image of a person may be simultaneously displayed and recorded.
  • Security systems quite often take real-time video images of the face of a person for facial, recognition purposes when the person is in locations such as, for example, controlled environments. Similarly, thermal images of people are taken to determine thermal characteristics of those people for detecting high or low body temperature and thus the likelihood of that person having an infectious disease, be under high stress, or for security purposes.
  • Controlled environments include locations such as, for example, airports, ship terminals, train stations, hospitals, office buildings, military bases, factories, commercial installation, and the like. These are locations where security may be an issue. Security includes not only weapons detection, identifying suspect persons, and the like, but also detection of those who may have a contagious disease.
  • apparatus for producing combined images of a person including: a first camera for producing a first image of the person and a second camera for producing a second image of the person.
  • the second image is of a different category to the first image.
  • the first camera has a first field of view and the second camera has a second field of view.
  • the second field of view at least in part overlaps with the first field of view. Preferably, it is coincident with and not greater than the first field of view.
  • the second field of view is coincident with and not greater than the first field of view.
  • the images may be for real-time display on a screen of a monitor in an adjacent relationship.
  • the first camera may be a colour video camera and the first image may be a colour video image; and the second camera may be a thermal imaging camera and the second image may be a thermal image.
  • the thermal image may include a colour/temperature scale.
  • the first camera and the second camera capture the first image and the second image respectively simultaneously and continuously when the person is within the second field of view and the first field of view.
  • the first image is preferably of a face of the person.
  • a thermal imaging processing system for determining if a temperature of the person is above a predetermined maximum temperature and for generating an event if the temperature of the person is above the predetermined maximum temperature.
  • the thermal imaging processing system may be for determining if the temperature of the person is below a predetermined minimum temperature and for generating an event if the temperature of the person is below the predetermined minimum temperature.
  • the thermal imaging processing system may also be for determining if the temperature of the person is outside a predetermined temperature range and for generating an event if the temperature of the person is outside the predetermined temperature range.
  • the predetermined temperature range may be from a predetermined minimum temperature to a predetermined maximum temperature.
  • the generating and event may be raising an alarm, raising an alert, and so forth.
  • the recording may be in colour.
  • the first image and the second image may be stored separately or together.
  • recording data such as, start date and time, first date and time, and location may also be recorded.
  • Image may include a still image, continuous images at a predetermined number of frames per second, and image data.
  • apparatus for producing combined images of a person in a field of view, the apparatus including a digital video camera for producing a colour video image of the person, and a thermal imaging camera for producing a colour thermal image of the person, the colour video image and the colour thermal image being for adjacent real-time display on a screen of a monitor; and a recording system for recording in real time the colour video image, the colour thermal image, and recording data.
  • Figure 1 is an illustration of the overall system architecture
  • Figure 2 is a flow chart of a first form of process
  • Figure 3 is a flow chart of a second form of process
  • Figure 4 is a flow chart of a third form of process
  • Figure 5 is a flow chart of the image processing system; and Figure 6 is a flow chart of the image recording system. Description of the Preferred Embodiments
  • the cameras 10, 20 may be selected from any category of known cameras such as, for example, video, thermal imaging, rear infrared, ultra violet, x-ray, and so forth.
  • the first camera 10 for providing a first form of image of a person.
  • the first form of image is preferably a colour video image and the first camera 10 is preferably a video camera for producing colour video.
  • the first camera 10 may be a digital video camera.
  • identifying features of the person may be able to be captured. Identifying features may include hair colour, eye colour, clothing details, and so forth.
  • the first camera 10 has a lens 11 that is focused on a first field of view 12 in which a person whose image is to be captured will be located at the time their image is captured.
  • First image data from first camera 10 is passed along first line 13 to a first video server 14.
  • First line 13 may be a wireless link, if required or desired.
  • First video server 14 is connected to a central video server 30 by line 15.
  • Line 15 may be a wireless link, over a LAN, WAN, the Internet, or other network.
  • the network is a TCP/IP Ethernet network.
  • Central server 30 is operatively connected to a monitor 31. Monitor 31 has display screen 32.
  • the second camera 20 for providing a second form of image of the person.
  • the second form of image is preferably a thermal image and the second camera 20 is preferably a thermal imaging camera such as, for example, a thermal imaging camera as supplied by Mikron Infrared, Inc of Oakland, N.J., USA. Being a thermal image it will inherently be in colour.
  • the second camera 20 has a lens 21 that is focused on a second field of view 22 in which the person whose image is to be captured will be located when this image is captured.
  • the second field of view 22 at least overlaps with the first field of view
  • the second field of view 22 is coincident with and located within the first field of view 12.
  • Second field of view 22 is more preferably of a size not greater than the size of the first field of view 12. In this way the two images align and, when displayed, are of the same general view of the same person. This allows an operator to more accurately determine they are of the same person. It also allows mapping of the subject in view from the first view to the second view, and from the second view to the first view. This may assist confirming they are of the same person.
  • Second image data from second camera 20 is passed along second line 23 to a second video server 24.
  • Second line 23 may be a wireless link if required or desired.
  • Second video server 24 is also connected to central video server 30, preferably by line 15.
  • Cameras 10, 20 may be in separate housings or may be contained within the one housing. It is preferred they be relatively close to minimise parallax error.
  • Cameras 10, 20 capture their images simultaneously and preferably continuously when a person is in the second field of view 22, and thus the first field of view 12.
  • cameras 10, 20 capture images at about 25 frames per second.
  • the capturing of images may be at different intervals such as, for example, twenty four frames per second, ten frames per second, four frames per second, one frame per second and so forth.
  • the images captured may be still images.
  • the capturing of images should continue while the person is within the second field of view 22.
  • the initialisation of the capturing of images may be by an operator, or may be by known motion sensing technology.
  • the ceasing of the capturing of images may be operator determined, or by known motion sensing technology.
  • Controlled environments include locations such as, for example, airports, ship terminals, train stations, hospitals, office buildings, military bases, factories, commercial installation, and the like. These are locations where security may be an issue. Security includes not only weapons detection, identifying suspect persons, and the like, but also detection of those who may have a contagious disease.
  • Cameras 10, 20 capture (41) at least facial images of the person. The face of the person should be captured by both cameras 10, 20. Second camera 20 may capture more than the face, including the upper body, trunk , and so forth as required.
  • the first and second images captured by cameras 10, 20 respectively are passed on a frame-by frame basis (70) as digital image data to, and are processed by, servers 14, 24 respectively.
  • the digital image data is then passed to central video server 30 and are displayed in real time on screen 32 of monitor 31.
  • the first and second images are displayed in an adjacent relationship such as, for example, side-by-side, one above the other, and so forth.
  • an operator at central video server 30 can view screen 32 and identify the person by virtue of first image 33 as displayed on screen 32, and adjacent second image 34 as displayed on screen 32.
  • the operator can input x, y co-ordinates (71) to specify a region of interest for either or both images. This can assist mapping of the image of the person from one view to the other, and to assist confirmation the two views are of the same person.
  • Second image 34 being a thermal image, does not identify the person.
  • First image 33 being a video image, enables the operator to identify the person whose image has been captured by cameras 10, 20.
  • First image 33 may be analysed by known image recognition technology for security purposes, if desired.
  • second image 34 has a colour ⁇ emperature chart 35 displayed as part of the image.
  • the predetermined maximum temperature maybe, for example 37.5°C. However, it may be any other possible temperature above normal body temperature (36.4°C) such as, for example, 37°C, 38°C, 38.5°C, and so forth.
  • the system may also check for an abnormally low temperature - a temperature below a predetermined minimum.
  • This is shown in Figure 3.
  • the procedure here is exactly the same as for Figure 2 and thus like processes have like reference numerals but with the prefix number 5 rather than 4.
  • the operator checks to see if the colour ⁇ emperature chart 35 indicates a colour for a temperature, thus indicating the presence of a non-heat-generating article on the person. That may be, for example, an explosive device.
  • the predetermined minimum temperature may be, for example, 36°C, 35.5°C, 35°C or the like. If part of the person is below the predetermined minimum temperature (52) there may be an explosive device or the like attached to or worn by the person. The operator alerts the guard (53) and the person is taken to a checkpoint for further processing (54).
  • the embodiment of Figure 2 may be combined with the embodiment of Figure 3 so that the operator checks for a maximum predetermined temperature, and a minimum predetermined temperature. That is, the check is for an acceptable range of temperatures from the minimum predetermined temperature to the maximum predetermined temperature. Any temperature outside that range is unacceptable and the guard alerted.
  • Figure 4 shows a third embodiment where a decision support system is included. Again, like processes use like reference numerals with a prefix number of 6 rather than 4 or 5.
  • the differences are in process steps 63 and 63.
  • the image data for second image 34 is analysed by a thermal image processing system that determines if the temperature is greater that the predetermined maximum temperature and/or if the temperature is less than the predetermined minimum temperature - i.e. is outside the allowable temperate range. If, yes, an alarm is sounded and the person directed to a checkpoint for further checks (63). If no, the person is allowed to proceed (65).
  • the image processing system conducts its determination on a frame-by-frame basis (72). If the temperature is not outside the predetermined maximum and/or minimum, the image processing system moves to the next frame. If a yes result is achieved, an event is generated (73). The event may be an alert, alarm or the like.
  • the system also enables central server 30 to record all first images 33 and second images 34 and to store the recorded images 33, 34 as image data. This is shown in Figure 6. Recording is preferably on a frame-by-frame basis.
  • the image data is preferably date, time and location stamped before storage. This may be as a result of a prompt for an operator to input recording data (76). Storage should be for at least a predetermined time. The predetermined time will depend on the circumstances. For disease control the predetermined time should be greater than the incubation time of the disease; for an airport, it should be greater that the anticipated flight time; and so forth.
  • the screen display includes a number (preferably three) interfaces to enable an operator to control recording.
  • the interfaces may to control the start of recording, end of recording, and playback function all by mouse click.
  • the interfaces are displayed.
  • the record data is required to be entered.
  • the record data may include operator ID, location, date and time. Location may be, for example, an airport departure gate, building entrance, and so forth.
  • the recording commences (77) and continues until the operator selects 'stop' (78).
  • the end record data may then be entered (79).
  • the end record data may be for example, operator ID and time.
  • the person may be required to produce some form of identity at the same time as the image data is captured by cameras 10, 20.
  • the identity may be a security pass, airline boarding pass, access code, identity card, passport, or the like.
  • the data pertaining to the identity may be captured by the system. It may also be displayed on screen 32 with the images 33, 34; and may also be recorded and stored with the image data for images 33, 34.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Studio Devices (AREA)
  • Cameras In General (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

Dispositif servant à produire des images combinées d'une personne et comprenant une caméra vidéo servant à produire une image vidéo de la personne, ainsi qu'une caméra d'imagerie thermique servant à produire une image thermique de cette personne. La caméra vidéo possède un premier champ de vision et la caméra d'imagerie thermique possède un deuxième champ de vision venant recouvrir au moins le premier champ de vision. Les images vidéo et thermiques sont conçues pour être affichées en temps réel sur l'écran d'un moniteur en position contiguë. L'invention concerne également un procédé servant à saisir ces images.
PCT/SG2004/000083 2003-05-13 2004-04-07 Systeme d'imagerie combinee WO2004102957A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP04726360A EP1627525A4 (fr) 2003-05-13 2004-04-07 Systeme d'imagerie combinee
JP2006532241A JP2006528474A (ja) 2003-05-13 2004-04-07 複合イメージングシステム

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
SG200302771-1 2003-05-13
SG200302771-1A SG138442A1 (en) 2003-05-13 2003-05-13 Combined imaging system

Publications (1)

Publication Number Publication Date
WO2004102957A1 true WO2004102957A1 (fr) 2004-11-25

Family

ID=33448804

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SG2004/000083 WO2004102957A1 (fr) 2003-05-13 2004-04-07 Systeme d'imagerie combinee

Country Status (5)

Country Link
EP (1) EP1627525A4 (fr)
JP (1) JP2006528474A (fr)
CN (1) CN1820497A (fr)
SG (1) SG138442A1 (fr)
WO (1) WO2004102957A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017082471A1 (fr) * 2015-11-12 2017-05-18 대구보건대학교산학협력단 Procédé et dispositif de diagnostic d'une maladie du sein

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2608713A4 (fr) * 2010-08-27 2014-01-08 Milwaukee Electric Tool Corp Systèmes, procédés et dispositifs de détection thermique
CN107843044B (zh) * 2016-09-21 2020-05-22 比亚迪股份有限公司 冰箱内物体检测系统、车辆和冰箱内物体检测方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4679068A (en) 1985-07-25 1987-07-07 General Electric Company Composite visible/thermal-infrared imaging system
US5532737A (en) * 1993-05-03 1996-07-02 Bell Communications Research, Inc. Camera arrangement with wide field of view
GB2373943A (en) * 2001-03-28 2002-10-02 Hewlett Packard Co Visible and infrared imaging camera
US6522787B1 (en) * 1995-07-10 2003-02-18 Sarnoff Corporation Method and system for rendering and combining images to form a synthesized view of a scene containing image information from a second image

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4608599A (en) * 1983-07-28 1986-08-26 Matsushita Electric Industrial Co., Ltd. Infrared image pickup image
JPH01268284A (ja) * 1988-04-19 1989-10-25 Fujitsu Ltd 画像合成装置
WO1990005426A1 (fr) * 1988-11-03 1990-05-17 Pearpoint Limited Camera de surveillance tv
FR2650929B1 (fr) * 1989-08-08 1995-07-21 Thomson Csf Systeme de prise de vues bispectrales et de visualisation en fausses couleurs
DE3930363A1 (de) * 1989-09-12 1991-03-21 Draegerwerk Ag Verfahren zur steuerung der betriebsparameter eines inkubators
US5637871A (en) * 1993-06-07 1997-06-10 Computational Systems, Inc. Portable digital infrared thermography system
DE4400190C2 (de) * 1994-01-05 1996-07-11 Bernd Poley Sicherheitsschleuse und Verfahren zum Aufspüren von durch Personen in eine Sicherheitsschleuse eingebrachten Gegenständen
US5497430A (en) * 1994-11-07 1996-03-05 Physical Optics Corporation Method and apparatus for image recognition using invariant feature signals
JPH0921704A (ja) * 1995-07-10 1997-01-21 Nippon Avionics Co Ltd 擬似カラー熱画像をアラーム表示に用いた温度監視方法及び装置
US6173068B1 (en) * 1996-07-29 2001-01-09 Mikos, Ltd. Method and apparatus for recognizing and classifying individuals based on minutiae
JP3807721B2 (ja) * 2000-02-21 2006-08-09 シャープ株式会社 画像合成装置
JP2002202202A (ja) * 2000-12-27 2002-07-19 Nikon Corp 測温計及び赤外線カメラ
WO2003028376A1 (fr) * 2001-09-14 2003-04-03 Vislog Technology Pte Ltd Systeme d'enregistrement de point de controle/comptoir de service client avec capture, indexation et recherche d'image/video et fonction de correspondance avec une liste noire

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4679068A (en) 1985-07-25 1987-07-07 General Electric Company Composite visible/thermal-infrared imaging system
US5532737A (en) * 1993-05-03 1996-07-02 Bell Communications Research, Inc. Camera arrangement with wide field of view
US6522787B1 (en) * 1995-07-10 2003-02-18 Sarnoff Corporation Method and system for rendering and combining images to form a synthesized view of a scene containing image information from a second image
GB2373943A (en) * 2001-03-28 2002-10-02 Hewlett Packard Co Visible and infrared imaging camera

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP1627525A4

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017082471A1 (fr) * 2015-11-12 2017-05-18 대구보건대학교산학협력단 Procédé et dispositif de diagnostic d'une maladie du sein
US10524749B2 (en) 2015-11-12 2020-01-07 Industrial Education Cooperation Organization, Daegu Health College Method and device for diagnosis of breast disease

Also Published As

Publication number Publication date
EP1627525A4 (fr) 2009-09-16
JP2006528474A (ja) 2006-12-14
CN1820497A (zh) 2006-08-16
EP1627525A1 (fr) 2006-02-22
SG138442A1 (en) 2008-01-28

Similar Documents

Publication Publication Date Title
US11288495B2 (en) Object tracking and best shot detection system
KR102021999B1 (ko) 인체 감시 발열 경보 장치
KR101729327B1 (ko) 듀얼 카메라를 이용한 체온 추적 모니터링 시스템
US20230043342A1 (en) Non-contact temperature measurement in thermal imaging systems and methods
JP6253311B2 (ja) 画像処理装置、画像処理方法
Kleinberg et al. Failure of anthropometry as a facial identification technique using high‐quality photographs
KR101990803B1 (ko) IoT를 이용한 취약계층 보호관리 시스템
JP2018093283A (ja) 監視情報収集システム
US20040161133A1 (en) System and method for video content analysis-based detection, surveillance and alarm management
US10887553B2 (en) Monitoring system and monitoring method
JP2020120323A (ja) 情報処理装置および照合方法
JP2014067383A (ja) 行動監視通報システム
JP2008009689A (ja) 顔登録装置、顔認証装置および顔登録方法
JP2007312271A (ja) 監視システム
JP2020145595A (ja) 看視又は監視システム、又はプログラム
JP2017054229A (ja) 人物判別システム
WO2004102957A1 (fr) Systeme d'imagerie combinee
JP5580683B2 (ja) 通報装置
JPH0410099A (ja) 挙動不審者検知装置
JP2004126711A (ja) 人物捜索システム
US11106895B1 (en) Video alert and secondary verification system and method
KR101926510B1 (ko) 광각카메라를 이용한 안면인식 기반의 광역 감시 시스템
JP5580686B2 (ja) 通報装置
JP7446806B2 (ja) 情報処理装置、方法及びプログラム
RU2737138C1 (ru) Система и способ контроля температуры тела людей по видеоданным

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200480019639.9

Country of ref document: CN

AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): BW GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DPEN Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed from 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2004726360

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2006532241

Country of ref document: JP

WWP Wipo information: published in national office

Ref document number: 2004726360

Country of ref document: EP