WO2005112461A1 - Dispositif de création d’image et méthode d’affichage d’image créée - Google Patents

Dispositif de création d’image et méthode d’affichage d’image créée Download PDF

Info

Publication number
WO2005112461A1
WO2005112461A1 PCT/JP2005/008753 JP2005008753W WO2005112461A1 WO 2005112461 A1 WO2005112461 A1 WO 2005112461A1 JP 2005008753 W JP2005008753 W JP 2005008753W WO 2005112461 A1 WO2005112461 A1 WO 2005112461A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
unit
request signal
abnormality
terminal device
Prior art date
Application number
PCT/JP2005/008753
Other languages
English (en)
Japanese (ja)
Inventor
Mitsue Ito
Wataru Ito
Original Assignee
Hitachi Kokusai Electric Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2004144517A external-priority patent/JP2005328333A/ja
Priority claimed from JP2004208875A external-priority patent/JP2006033380A/ja
Application filed by Hitachi Kokusai Electric Inc. filed Critical Hitachi Kokusai Electric Inc.
Publication of WO2005112461A1 publication Critical patent/WO2005112461A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/254—Analysis of motion involving subtraction of images

Definitions

  • the present invention relates to a system for capturing an image of a region to be imaged (imaging target region) and an image display method in a terminal device thereof, and more particularly, to effectively monitoring an imaged region.
  • a system for capturing an image of a region to be imaged imaging target region
  • an image display method in a terminal device thereof and more particularly, to effectively monitoring an imaged region.
  • surveillance devices that use imaging devices such as CCD (Charge Coupled Device) and CMOS (Complementary Metal-Oxide Semiconductor)! / ! / Puru.
  • CCD Charge Coupled Device
  • CMOS Complementary Metal-Oxide Semiconductor
  • an observer In manned surveillance in a surveillance system using such a surveillance device, an observer (operator, user, etc.) detects the detection of abnormalities such as a suspicious person, an intruder, an object, or a fire entering the monitored area. This is performed while viewing the image displayed on the monitor.
  • an observer there is a difference in the monitoring ability depending on the level of skill and health condition of the observer, and in some cases, the observer may overlook an abnormality such as a suspicious person.
  • the conventional manned surveillance system has a function to automatically detect abnormalities such as suspicious persons and obtain predetermined notifications and alarms based on the image input from the image input unit such as a camera.
  • Many additional systems have been proposed.
  • the system compares an input image obtained by a camera with a previously created reference background image, that is, an image in which an object to be detected is not reflected, and obtains a difference in luminance value for each pixel, thereby obtaining an input image.
  • a region in which the luminance value is changed is detected.
  • the system Detect abnormalities such as suspicious persons in the target area.
  • the process of detecting an area where the luminance value in the input image is changing in this way is generally called a difference method, and is more widely used than before.
  • a function of operating a zoom lens or a pan head (electric swivel base) of the camera and the type of the suspicious person's face are provided.
  • Function here, called the first function
  • function to get high quality (high definition) image from the camera here, called the second function
  • the first function is, for example, a function capable of detecting the movement of a target object using template matching and controlling a camera platform according to the movement of the target object.
  • the second function is, for example, to detect a change in the input image, to obtain a high-quality still image when a change is detected, and to obtain a low-quality moving image when no change is detected. This is a function that can be performed.
  • Patent Document 1 Japanese Patent Application Laid-Open No. 2000-105835
  • Patent Document 2 Japanese Patent Application Laid-Open No. 2000-175177
  • Patent Document 3 JP 2001-60263 A
  • Patent Document 4 JP 2003-219402 A
  • the present invention has been made in view of such conventional circumstances, and provides an image display method in a terminal device of an image system capable of effectively monitoring an area to be imaged.
  • the purpose is to do.
  • an image at a position designated by an operator with respect to two or more imaging target objects related to an abnormality such as a suspicious person without operating a zoom lens or a camera platform of a camera. Can be displayed in an enlarged scale.
  • an image generation device that captures an image of an area to be captured, and a terminal that displays an image captured by the image generation device The following processing is performed in the terminal device of the image system having the device.
  • the terminal device receives an image transmitted from the image generation device, and displays an image of two or more portions included in the received image in an enlarged manner on the same screen.
  • an image system includes an image generation device that captures an image of a region to be monitored (a monitoring target region), and a terminal device that displays an image captured by the image generation device. The following processing is performed.
  • the image capturing unit captures an image of the area to be monitored, and the image transmitting unit transmits the image captured by the image capturing unit to the monitoring terminal device.
  • the image of the two or more portions included in the image captured by the image generation device is enlarged and displayed on the same screen on the terminal device, so that the area to be monitored can be effectively monitored. it can. For example, it is possible for an observer to enlarge and display an image at a position specified by an operator on two or more monitored objects related to an abnormality, such as a suspicious person, without operating a camera zoom lens or pan head. Make it possible.
  • the image generation device and the terminal device may be configured separately and connected by a wired or wireless line, or may be configured integrally.
  • the image capturing unit can be configured using, for example, a camera.
  • Various images may be used, for example, a still image may be used, or a moving image may be used.
  • the number of images of a portion to be enlarged and displayed by the enlarged image display unit two or more various numbers may be used.
  • various modes may be used as a mode in which the images of two or more portions are enlarged and displayed on the same screen by the enlarged image display unit.
  • the terminal device displays frames indicating each of the two or more portions included in the received image, and enlarges and displays the images of the portions indicated by the displayed frames on different frames. The correspondence between the displayed frames and the respective frames is displayed.
  • the image system according to the present invention has the following configuration. That is, in the terminal device, the image partial frame display unit displays frames indicating each of two or more portions included in the image received by the image receiving unit. Also, in the terminal device, the enlarged image display unit enlarges and displays the images of the parts indicated by the respective frames displayed by the image partial frame display unit in different frames. Further, in the monitoring terminal device, the image part correspondence display unit (visually) displays the correspondence between each frame displayed by the image part frame display unit and each frame described above.
  • frames indicating each of two or more portions included in a certain image are displayed in, for example, an image showing the whole or a part of the image.
  • various modes may be used to display the correspondence between each frame and each frame (visually) .
  • a mode using characters or colors may be used. Specifically, it is possible to use a mode in which the same characters and the same color are added to the corresponding frames and frames.
  • the terminal device displays a frame indicating each of the two or more portions included in the received image, and enlarges and displays the image of the portion indicated by each of the displayed frames into a different frame. Then, the designation of the image portion by each of the displayed frames is released according to the operation by the user.
  • the image system according to the present invention has the following configuration. That is, in the terminal device, the image partial frame display unit displays frames indicating each of two or more parts included in the image received by the image receiving unit. In the terminal device, the enlarged image display unit enlarges and displays the images of the parts indicated by the respective frames displayed by the image partial frame display unit in different frames. Further, in the terminal device, the image partial frame designation canceling unit cancels the designation of the image portion by each frame displayed by the image partial frame display unit in response to an operation by the user.
  • the user cancels the designation of the image part with an arbitrary frame and cancels the cancellation. It is possible to specify another image portion using the frame, whereby the user can freely change the specified image portion and perform effective monitoring.
  • various operations such as a keyboard and a mouse may be used.
  • a mode is used in which various buttons are displayed on the screen, and the user specifies each button by operating the keyboard or mouse and clicking each button on the screen. be able to.
  • an operation for individually canceling the specification of the image portion by each frame may be provided, or the image portion may be specified by all the frames. Operation may be provided at once, or Both of these operations may be provided.
  • the terminal device initially sets the position of the image to be enlarged and displayed, moves the position of the set image, and sets the magnification of the image to be enlarged and displayed. Then, the terminal device enlarges and displays the image at the position determined by the initial setting and movement of the position of the image to be enlarged and displayed at the set magnification ratio.
  • the image system according to the present invention has the following configuration. That is, the terminal device includes an image part position initial setting unit, an image part position moving unit, and an image part enlargement ratio setting unit.
  • the image part position initial setting unit initially sets the position of the image to be enlarged and displayed by the enlarged image display unit.
  • the image part position moving unit moves the position of the image set by the image part position initial setting unit.
  • the image partial enlargement ratio setting unit sets an enlargement ratio of an image to be enlarged and displayed by the enlarged image display unit.
  • the enlarged image display unit displays the image at the position determined by the image part position initial setting unit and the image part position moving unit at the enlargement ratio set by the image part enlargement ratio setting unit. Enlarge and display.
  • the image system according to the present invention can be used to initially set the positions of the images of two or more parts, to move the positions of the initially set images, It is possible to set the magnification of the image of each part initially or by changing it.
  • the image system according to the present invention can perform effective monitoring with various settings.
  • the setting by the image part position initial setting unit, the movement by the image part position moving unit, and the setting by the image part enlargement ratio setting unit may be performed, for example, in response to an operation by a person. Alternatively, it may be performed automatically based on predetermined conditions preset in a monitoring device or a monitoring terminal device.
  • the setting by the image part position initial setting unit, the movement by the image part position moving unit, and the setting by the image part enlargement ratio setting unit include, for example, May be performed individually for each of the images, or may be performed collectively for all or some of the images!
  • the terminal device receives images of a plurality of types of image quality transmitted from the monitoring device, and designates two or more portions of the images of the plurality of types of image quality by using an image of any image quality. Accepts and enlarges and displays the specified two or more part images using images of the same quality or images of different quality.
  • the image system according to the present invention has the following configuration. That is, the image capturing unit of the image device captures images of a plurality of types of image quality.
  • the enlarged image display unit of the terminal device receives designation of two or more portions by using an image of one of the image qualities of the plurality of types of image qualities, and receives an image of the same image qualities or the same.
  • the images of the two or more parts specified above are enlarged and displayed using images of different qualities.
  • the image system according to the present invention can specify an image portion or display an enlarged image portion using one or more images of a plurality of types of image quality.
  • the image part In order to specify the image part by referring to an image of valid image quality, or to add an image of valid image quality to magnify the image part, it is possible to enlarge the image part. It can be set to take place, which allows for effective monitoring.
  • images having various image qualities may be used as the image having the image quality used for accepting the designation of the image portion and the image having the image quality used for enlarging and displaying the image portion.
  • images with the same image quality may be used, or images with different image quality may be used.
  • an aspect in which both of the image portion designation and the enlarged display of the image portion are performed using one of the image qualities is performed.
  • the designation of the image portion may be received, for example, in response to an operation by a user, or may be (automatically) received in response to a processing result by an image processing function or a detection result by various detection functions. You can.
  • the image system includes an image generation device that captures an image of a region to be monitored (a monitoring target region), and a monitoring terminal device that displays an image captured by the image generation device.
  • the image generation device transmits an image to the image generation terminal device in response to the request signal of the terminal device power.
  • the image capturing unit captures an image of the area to be monitored.
  • the request signal receiving unit receives a request signal transmitted from the terminal device.
  • the first image transmitting unit transmits an image of the first image quality, which is an image captured by the image capturing unit. Transmit to the terminal device.
  • the second image transmitting unit transmits the second image, which is an image captured by the image capturing unit and has a higher image quality than the first image quality. Send to terminal.
  • the image receiving unit receives an image transmitted from the monitoring device.
  • the image display unit displays the image received by the image receiving unit.
  • the request signal transmission instruction receiving unit receives an instruction to transmit a request signal from the user.
  • Request signal transmitting unit Outputs a request signal to the image generating apparatus when an instruction to transmit the request signal is received by the request signal transmission instruction receiving unit.
  • the terminal device also receives an instruction to transmit a request signal from the user.
  • a first image of relatively low image quality is transmitted to the monitoring device and displayed, and in the absence of the instruction, the image of relatively high image quality is displayed.
  • the image of the second image quality is transmitted to the monitoring device and the monitoring terminal device and displayed.
  • various signals may be used as the request signal.
  • Various modes may be used to discriminate the state in which the request signal is not received from the state in which the request signal is received.
  • Various timings may be used as the timing for shifting to the received state and the timing for shifting from the state where the request signal is received to the state where the request signal is not received.
  • images of various image qualities may be used.
  • the image of the first image quality has lower image quality than the image of the second image quality
  • the image of the second image quality has higher image quality than the image of the first image quality.
  • first image quality image and the second image quality image for example, an image having the same image quality as the image captured by the image capturing unit may be used, or An image obtained by converting the image quality of the image captured by the image capturing unit may be used.
  • image of the first image quality and the image of the second image quality for example, an image captured by the image capturing unit may be used as it is, or an image captured by the image capturing unit may be used. For example, an image on which a process such as encoding is performed may be used.
  • an image of a different image quality may be captured, image processed, transmitted / received, displayed, or the like.
  • the image processing using the image may be performed.
  • the user's power can be configured using, for example, a keyboard or a mouse operated by the user.
  • the abnormality detection unit detects the abnormality based on the image captured by the image capturing unit.
  • the abnormal image storage unit stores the image of the second image quality and information related to the abnormality detected by the abnormality detection unit in association with each other.
  • the second image transmission unit of the monitoring device transmits information on the abnormality detected by the abnormality detection unit to the monitoring terminal device.
  • the image receiving unit of the monitoring terminal device receives the information regarding the abnormality transmitted from the monitoring device. I believe.
  • the abnormality information storage unit stores information on the abnormality received by the image receiving unit.
  • the abnormality information output unit outputs information on the abnormality stored in the abnormality information storage unit.
  • the request signal transmission instruction receiving unit of the monitoring terminal device receives, from a user's hand, the designation of information regarding the abnormality.
  • the request signal transmitting unit of the monitoring terminal device transmits to the monitoring device a request signal including information on the abnormality whose specification has been received by the request signal transmission instruction receiving unit.
  • the second image transmission unit of the monitoring device reads out the second image quality image associated with the abnormality information included in the request signal received by the request signal reception unit from the abnormal image storage unit, and Send to
  • the monitoring device notifies the monitoring terminal device of the information on the detected abnormality with respect to the image, and the monitoring terminal device outputs the information on the abnormality and accepts the designation by the user.
  • the corresponding image of the second image quality is transmitted from the monitoring device to the monitoring terminal device and displayed.
  • the configuration example according to the present invention can effectively monitor the area to be monitored. Also, for example, only when there is a request signal from the monitoring terminal device to the monitoring device, the monitoring device transmits the corresponding high-quality second quality image to the monitoring terminal device, so that the transmission is performed. It is possible to reduce the data amount of the image to be processed.
  • an image to be referred to for detecting an abnormality by the abnormality detection unit for example, an image of the first image quality may be used, or an image of the second image quality may be used. Images of other qualities may be used, or images of two or more different qualities may be used.
  • various methods may be used as a method of detecting an abnormality by the abnormality detection unit.
  • a method of performing image processing by a difference method or the like to detect an abnormality or a method of detecting an abnormality by various sensors may be used.
  • a method of detecting an abnormality based on the abnormality can be used.
  • various information may be used as the information regarding the abnormality.
  • Information that uniquely identifies these abnormalities, or additional information that does not uniquely identify them, can be used.
  • Specific examples include information that identifies the time when the abnormality was detected and information that identifies the abnormality. For example, information for specifying a position (image portion) in the image can be used.
  • various modes may be used as the mode for outputting the information related to the abnormality.
  • a mode in which information is displayed on a screen or a mode in which information is printed out on paper may be used.
  • a method for storing images and information for example, it can be configured using a storage device such as a memory.
  • the image display unit of the terminal device enlarges and displays an area for displaying the image of the first image quality, an area for displaying the image of the second image quality, and a part of the image of the second image quality.
  • the image is displayed on a screen having an area on the same screen.
  • the area to be monitored can be effectively set. Can be monitored. For example, even when an abnormality is detected, it is possible to view the entire area to be monitored by using the image of the first image quality or the image of the second image quality. It is possible to see in detail the image part where the abnormality is detected by enlarging the image part in the image of the image quality.
  • the area for displaying the image of the first image quality, the area for displaying the image of the second image quality, and the area for enlarging and displaying the image portion in the image of the second image quality are variously different.
  • Various regions may be used, for example, the size and number of each region may be used.
  • the image of the second image quality can be displayed as it is, or the image of the second image quality can be thinned out (size Can be displayed).
  • the image capturing unit of the image generating device has a function of capturing an image of a first image quality and a function of capturing an image of a second image quality.
  • the image capturing section of the image generating apparatus captures a moving image of the first image quality in a state where the request signal is not received by the request signal receiving section, and the request signal is received by the request signal receiving section. In this state, a still image of the second image quality is captured.
  • the first image transmission unit of the image generation device transmits a moving image of the first image quality to the monitoring terminal device in real time.
  • the second image transmission unit of the image generation device transmits a still image of the second image quality to the terminal device at least for an image portion in which an abnormality is detected by the abnormality detection unit.
  • the image capturing unit of the image generating device captures an image of the second image quality when the abnormality is detected by the abnormality detection unit.
  • the second image transmission unit of the image generation device transmits an image of the second image quality only to the image part in which the abnormality is detected by the abnormality detection unit to the monitoring terminal device.
  • the second image transmitting unit of the image generating apparatus compresses the image part in which the abnormality is detected by the abnormality detection unit at a low compression rate and compresses the other image parts at a high compression rate.
  • the transmitted image is transmitted to the monitoring terminal device as an image of the second image quality.
  • the request signal receiving unit when the request signal is received by the request signal receiving unit in a state where the request signal is not received by the request signal receiving unit, the request signal receiving unit receives one frame of the image. As a result, the request signal is received, and then the request signal receiving unit returns to a state in which the request signal is not received.
  • the image capturing unit of the image generating device has a function of capturing both an image of the first image quality and an image of the second image quality simultaneously.
  • the first image transmission unit of the image generation device transmits an image of the first quality captured by the image capturing unit to the terminal device even in a state where the request signal is received by the request signal reception unit. Send to.
  • the image of the first image quality and the image of the second image quality One or more aspects such as the number of tones per element, the compression ratio, and the encoding method are different.
  • the image capturing unit of the image generating device always captures an image of the second image quality, for example.
  • the first image transmitting unit of the monitoring device converts the image of the second image quality captured by the image capturing unit into an image of the first image quality and transmits the image to the terminal device.
  • the second image transmission unit of the monitoring device transmits, to the monitoring terminal device, information regarding an abnormality detected by the abnormality detection unit with respect to the image together with the image of the second image quality.
  • the image receiving unit of the monitoring terminal device receives the image transmitted from the monitoring device and the information regarding the abnormality detected with respect to the image.
  • the abnormality information output unit of the monitoring terminal device displays information on the abnormality stored in the abnormality information storage unit in a list, for example, in a list.
  • information for identifying an image portion in which an abnormality is detected in an image is used as the information about the abnormality, and the image display unit of the monitoring terminal device displays the second image quality based on the information about the abnormality.
  • the image part where the abnormality is detected in the image of is enlarged and displayed.
  • the terminal device receives an instruction to specify an image portion to be enlarged and displayed with respect to the image of the second image quality displayed by the image display unit.
  • the image display unit of the terminal device enlarges and displays the image part specified by the instruction received by the enlarged display image part specification instruction receiving unit.
  • the image generation device captures an image of the area to be monitored, transmits the image to the terminal device,
  • the terminal device receives the image transmitted from the image generation device and enlarges and displays the images of two or more parts included in the received image on the same screen.
  • one configuration example according to the present invention enlarges an image at a position designated by an operator with respect to two or more monitored objects related to an abnormality such as a suspicious person without operating a zoom lens or a camera platform of a camera. It can be displayed.
  • the terminal device displays frames indicating each of two or more portions included in the received image, and displays the portions indicated by the respective frames.
  • the images were enlarged and displayed in different frames, and the correspondence between each frame and each frame was visually displayed.
  • the terminal device displays frames indicating each of two or more portions included in the received image, and displays the portions indicated by the respective frames.
  • the image is enlarged and displayed in different frames, and the designation of the image part by each frame is released according to the operation by the user.For example, the user can freely change the image part designated by each frame. Thus, effective monitoring can be performed.
  • the terminal device can initially set the position of the image to be enlarged and displayed, move the set image position, It is possible to set an enlargement ratio of an image to be enlarged and displayed. Initially, an image at a position determined by the movement or is enlarged and displayed at the set enlargement ratio.
  • the image system according to the present invention can perform effective monitoring with various settings, for example.
  • the image generating device captures an image of a plurality of types of image quality, and the terminal device selects one of the images of the plurality of types of image quality.
  • the specification of two or more parts is accepted using the image of the image quality, and the image of the specified two or more parts is enlarged and displayed using the image of the same image quality or the image of the different image quality.
  • the image system according to the present invention can be used, for example, for setting so that an image having an effective image quality is specified to specify an image portion and specifying the image portion, and for enlarging and displaying the image portion. It is possible to set so that an image of effective image quality is processed and the image portion is enlarged and displayed, whereby effective monitoring can be performed.
  • the monitoring system according to the first example and the monitoring system according to the second example will be described, and then the processing related to the enlarged display performed in these monitoring systems will be described.
  • FIG. 1 shows a configuration example of the monitoring system of the present example.
  • the monitoring system of this example includes a monitoring device 1, a monitoring terminal device 2, a network 3, a line (access line) 4 connecting the monitoring device 1 and the network 3, a monitoring terminal device 2, and a network 3. (Access line) 5 that connects
  • the network 3 various types may be used.For example, an analog telephone network, an integrated services digital network (ISDN) network, a digital private line network, the Internet, or the like may be used.
  • ISDN integrated services digital network
  • Monkey Monkey
  • the monitoring device 1 includes, as hardware configuration examples, an imaging device 11 configured as a camera such as a television camera, a video switching unit 12 configured as a camera such as a switching switch, and a standard image encoding unit 13.
  • an imaging device 11 configured as a camera such as a television camera
  • a video switching unit 12 configured as a camera such as a switching switch
  • a standard image encoding unit 13 configured as a camera such as a switching switch
  • a high-definition image encoding unit 14 an abnormality detection unit 15, a communication unit 16, and an imaging device control unit 17.
  • the imaging device 11 images a region to be monitored (monitoring target region) and outputs a signal of an image (video) obtained by the imaging to the video switching unit 12.
  • the imaging device 11 selects one of a standard image mode for capturing a standard image and a high-definition image mode for capturing a high-definition image according to a control signal input from the imaging device control unit 17. Can be switched.
  • a standard image mode for capturing a standard image
  • a high-definition image mode for capturing a high-definition image according to a control signal input from the imaging device control unit 17.
  • Can be switched an image of 640 horizontal pixels x 480 pixels high and 30 frames per second is used as a standard image
  • an image of 1280 horizontal pixels x 960 pixels high and 7.5 frames per second is used as a high-resolution image, for example. Is used.
  • the video switching unit 12 switches an input destination of an image signal output from the imaging device 11 according to a control signal input from the video device control unit 17.
  • the video switching unit 12 connects the output terminal of the imaging device 11 to the standard image.
  • the signal path is switched so that the input terminal of the image encoding unit 13 and the input terminal of the abnormality detection unit 15 are connected.
  • the output terminal of the imaging device 11 The signal path is switched so that the signal is connected to the input terminal of the high-definition image encoding unit 14.
  • the imaging device 11 when the imaging device 11 has captured a standard image, the standard image output from the imaging device 11 is supplied to the standard image encoding unit 13 and the abnormality detection unit 15, and the imaging device 11 captures a high-definition image.
  • the high definition image output from the imaging device 11 is supplied to the high definition image encoding unit 14.
  • the standard image encoding unit 13 encodes an image signal of a standard image input from the imaging device 11 via the video switching unit 12 according to a predetermined moving image encoding method, and communicates the encoded data. Output to section 16.
  • a predetermined moving image encoding method various methods may be used.
  • MPEG-1, MPEG-2, MPEG-4, motion JPEG, etc. can be used as the moving picture coding method.
  • the abnormality detection unit 15 processes the image signal of the standard image input from the imaging device 11 via the video switching unit 12 by, for example, a difference method, and detects an abnormality such as a suspicious person in the monitoring target area.
  • FIG. 2 shows an example of a process in which the abnormality detection unit 15 detects a region of a standard image sequentially input from the imaging device 11 in which the luminance value has changed by the difference method.
  • a difference between two images a standard image (input image) 21 sequentially input from the imaging device 11 and an image (reference background image) 22 prepared in advance that does not include a target object to be detected, is shown.
  • the device 31 calculates the difference between the luminance values for each pixel, and obtains the difference image 23.
  • the binarizer 32 to which the difference image 23 has been input performs threshold processing on each pixel of the difference image 23 at a predetermined threshold th, and performs processing on pixels whose value (difference value) is smaller than the threshold th.
  • the pixel value is set to “0” value, and the pixel value of the pixel whose value (difference value) is equal to or more than the threshold th is set to “255”, and the process of acquiring the binary image 24 is performed.
  • the pixel value of one pixel is calculated with 8 bits, and one pixel has a value from “0” to “255”.
  • the human-shaped object 41 reflected in the input image 21 is calculated as an area 42 where the difference is generated by the differentiator 31 (an area where the luminance of the input image 21 changes). Sa This is detected by the binarizer 32 as an image portion 43 having a pixel value of “255”.
  • FIG. 3 shows an example of a procedure of a process performed by a monitoring method to which the difference method is applied.
  • Step Sl external devices, variables, image memory, etc. are initialized as initialization processing for executing the monitoring method by the difference method (Step Sl).
  • the abnormality detection unit 15 inputs the standard image from the imaging device 11 (step S2), and calculates the difference between the luminance value of each pixel between the input image 21 and the previously created reference background image 22.
  • the difference image 23 is obtained by calculation (step S3), and the pixel value of the pixel whose difference image 23 has a pixel value (difference value) less than a predetermined threshold th is set to “0”, and The pixel value is set to "255" to obtain the binary image 24 (step S4).
  • the abnormality detecting section 15 detects a cluster of pixels having a pixel value of “255” (the image section 43 serving as a change area) in the obtained binary image 24 and assigns a number to each of them. So that they can be distinguished (by labeling) (step S5).
  • the abnormality detecting unit 15 determines, for each of the numbered change regions, the respective change regions based on predetermined detection conditions regarding the size, area, speed, detection position, and the like. It is determined whether or not they match (step S6). If the detection conditions are met, it is considered that there is an object to be detected. If they do not match the detection conditions, it is considered that there is no object to be detected.
  • an alarm or a display of detection information is performed by the abnormality detection unit 15 or another processing unit.
  • a monitoring monitor, a warning light, a warning buzzer, etc. Using one or more of a monitoring monitor, a warning light, a warning buzzer, etc., a visual, auditory, olfactory, tactile, or taste stimulus is conveyed to the observer (step S7). Thereafter, or when it is determined that there is no object to be detected, the processes after the image input process are repeated (steps S2 to S7).
  • the abnormality detection unit 15 detects that as an abnormality such as a suspicious person.
  • the abnormality detection unit 15 When detecting an abnormality, transmits (outputs) a request signal for acquiring a high-definition image to the imaging device control unit 17 and outputs an abnormality such as a detected suspicious person. In order to notify the monitoring terminal device 2 of the presence of an error, information on the location where an abnormality such as a suspicious person exists, information on the detection time, information on the number related to the detection, etc. Transmits (outputs) the abnormality detection result to the communication unit 16. Further, the abnormality detection unit 15 transmits (outputs) information specifying an image range in which an abnormality such as a suspicious person detected exists to the high-definition image encoding unit 14.
  • the image range in which an abnormality such as a suspicious person exists is calculated based on, for example, the image portion 43 which is a changing region in the binary image 24 shown in FIG. Specifically, first, a process of calculating a circumscribed rectangle 44 of the change area is performed on the image section 43 serving as the change area. Next, a process of acquiring an image range 45 in which the upper, lower, left, and right sides of the circumscribed rectangle 44 are expanded by a predetermined number of pixels is performed, and an image range in which an abnormality such as a suspicious person exists is calculated.
  • the predetermined number of pixels to be spread vertically and horizontally for example, 30 pixels are used.
  • the reason for expanding the predetermined number of pixels for the circumscribed rectangle 44 in this way is to include not only the image where the abnormality such as a suspicious person exists, but also the surrounding image, so that the abnormality such as the suspicious person This is to make it easier to visually understand what has been detected and what it looks like when viewed more broadly.
  • the configuration in which the range in which an abnormality such as a suspicious person exists is determined based on the detection result of the process by the difference method, but other various configurations may be used. .
  • the detection range can be determined as a range in which an abnormality such as a suspicious person exists.
  • the abnormality detection unit 15 transmits (outputs) a request signal for acquiring a high-definition image to the imaging device control unit 17 when an abnormality is detected based on an input from an external sensor.
  • the high-definition image encoding unit 14 receives the high-definition image input from the imaging device 11 via the video switching unit 12.
  • the image signal of the fine image is encoded by a predetermined still image encoding method, and the encoded data is output to the communication unit 16.
  • the still image encoding method various methods may be used, for example, JPEG, JPEG2000, etc. may be used. It is also possible to cut out a partial image in an image range in which an abnormality such as a suspicious person exists and to encode only the partial image and output the partial image to the communication unit 16.
  • the image range notified from the abnormality detection unit 15 is used as the image range.
  • the high-definition image encoding unit 14 sets a plurality of image ranges corresponding to each of the plurality of image ranges. It is also possible to cut out these partial images, encode these multiple partial images, and output them to the communication unit 16.
  • the high-definition image encoding unit 14 records the information of the detection result of the abnormality input from the abnormality detecting unit 15 in the header area of the encoded data and outputs the information to the communication unit 16.
  • JPEG Joint Photographic Experts Group
  • Exif which is a recording standard of the JPEG header area can be used as information to be recorded in the header area.
  • JPEG2000 is used as the encoding system, for example, by using the ROI (Region Of Interest) function of JPEG2000, a range in which an abnormality such as a suspicious person exists is compressed at a low compression ratio, and the other range is compressed. By compressing at a compression rate, the data amount of a high-definition image can be efficiently reduced.
  • ROI Region Of Interest
  • the compression ratio at the time of encoding is changed based on the size of the change region detected as abnormal.
  • the compression ratio is changed.
  • the compression ratio is increased when the change area is small.
  • the change area is large, detailed information is often not needed to see the entire change area. It is considered that there are many.
  • the communication unit 16 is connected to the network 3 via the access line 4, and can communicate with the monitoring terminal device 2 via these and the access line 5.
  • the communication unit 16 outputs moving image encoded data output from the standard image encoding unit 13, still image encoded data output from the high-definition image encoding unit 14, and output from the abnormality detection unit 15.
  • a request signal for obtaining a high-definition image is transmitted from the monitoring terminal device 2 to the network 3 via the access line 5 to the monitoring device 1.
  • the communication unit 16 receives and inputs the request signal from the network 3 via the access line 4, and transmits (outputs) the received and input request signal to the imaging device control unit 17.
  • the imaging device 11 is controlled by a control signal to set a high-definition image mode for capturing a high-definition image, and the video switching unit 12 is controlled by a control signal to switch to the high-definition image encoding unit 14. Accordingly, when the abnormality detection unit 15 detects an abnormality such as a suspicious person in the input image or receives a request signal for acquiring a high-definition image from the monitoring terminal device 2, the imaging device 11 A high-definition image can be picked up and output to the high-definition image encoding unit 14.
  • the imaging device controller 17 controls the imaging device 11 with a control signal to set a standard image mode for capturing a standard image, and controls the video switching unit 12 with a control signal. Switch to the standard image encoding unit 13 and abnormality detection unit 15 side.
  • the monitoring terminal device 2 is configured using, for example, a personal computer (PC), and performs processing for displaying an input image captured and transmitted by the imaging device 11 of the monitoring device 1 and the monitoring terminal device. Performs processing corresponding to the operations performed by the observer (operator) who operates 2.
  • PC personal computer
  • FIG. 4 shows an example of the display of the operation screen 51 of the monitoring terminal device 2.
  • the operation screen 51 in this example includes a standard image display section 61, a high-definition image display section 62, one or more (three in this example) high-definition image display sections 63, 64, 65, and a shirt screen.
  • Button 71 and It has large display selection buttons 72, 73, 74, four enlarged display position move buttons 75, 76, 77, 78 corresponding to up, down, left and right, and an enlargement ratio change button 79!
  • the various buttons 71 to 79 can be operated by the observer.
  • the standard image display section 61 displays an image in which encoded data of a standard image obtained from the monitoring device 1 via the network 3 is reproduced (decoded).
  • the high-definition image display unit 62 displays an image obtained by reproducing (decoding) the encoded data of the high-definition image obtained from the monitoring device 1 via the network 3 by, for example, thinning out image pixels to reduce the size. ,indicate. In this example, the high-definition image display unit 62 displays a reduced still image of the high-definition image.
  • the imaging region of the standard image transmitted from the monitoring device 1 to the monitoring terminal device 2 and the imaging region of the high-definition image are the same, and the standard image display on the operation screen 51 of the monitoring terminal device 2 is performed.
  • the target area of the standard image displayed on the section 61 and the target area of the high definition image displayed on the high definition image display section 62 are the same.
  • Each of the high-definition image enlarged display sections 63 to 65 enlarges a partial image of an image obtained by reproducing (decoding) encoded data of a high-definition image obtained from the monitoring device 1 via the network 3. To display.
  • the position in the image of the partial image to be enlarged and displayed on the high-definition image enlarged display sections 63 to 65 is, for example, displayed on the high-definition image display section 62 using a pointing device such as a PC mouse or a joystick. It is possible to specify by specifying the position.
  • the partial image of the high-definition image corresponding to the designated position is displayed on the high-definition image enlarged display units 63 to 65.
  • three display frames 82, 83, and 84 are shown on the high-definition image display unit 62, and the partial images inside the respective display frames 82, 83, and 84 are displayed at the respective heights. These are displayed on the magnified image display sections 63, 64 and 65.
  • the high-definition image display unit 62 displays the reduced high-definition image in a high-resolution image.
  • the high-definition image has a higher original pixel density than the standard image. Even when displayed on the enlarged display sections 63 to 65, it is possible to display a finer image than the standard image.
  • a plurality of high-definition image enlarged display sections 63, 64, and 65 are provided.
  • the same number of enlarged display selection buttons 72, 73, 74 are provided corresponding to the respective high-definition image enlarged display sections 63, 64, 65.
  • the operator or the like operates one of the enlarged display selection buttons 72, 73, and 74 to select the high-resolution image enlarged display sections 63, 64, and 65, the high-resolution image to be enlarged and displayed there is selected. Make sure to specify the location.
  • the position of the high-definition image to be enlarged and displayed (the position of each of the display frames 82, 83, and 84) can be finely adjusted in the up, down, left, and right directions by operating the enlarged display position move buttons 75 to 78. It is possible to adjust.
  • the enlargement ratio of the high-definition image to be enlarged and displayed can be changed by operating the enlargement ratio change button 79.
  • the correspondence between the respective enlarged display selection buttons 72, 73, 74, the respective high-resolution image enlarged display sections 63, 64, 65, and the respective display frames 82, 83, 84 is operated.
  • Identification information that can be visually grasped is displayed on the composition screen 51. Specifically, using the numbers “1”, “2”, and “3", Information with the same number is displayed. Note that, as such identification information, various other information such as “A”, “B”, “C”, etc. may be used! /.
  • the shirt button 71 is a button for transmitting a request signal for acquiring a high-definition image to the monitoring device 1.
  • a request signal for acquiring a high-definition image is transmitted from the monitoring terminal device 2 to the monitoring device 1, thereby acquiring a high-definition image.
  • Processing manual imaging processing
  • a message (notification message) 81 for notifying the occurrence of the abnormality is displayed on the standard image display section 61.
  • a process of acquiring a high-definition image when an abnormality is detected can be performed.
  • FIG. 5 shows an example of an operation performed by the monitoring device 1 and the monitoring terminal device 2 during manual imaging.
  • FIG. 5 conceptually shows an example of the operation performed by the monitoring device 1 and the monitoring terminal device 2 from time tO to time (tO + 4), conceptually in time sequence.
  • monitoring device 1 captures a standard image.
  • the captured standard image is subjected to moving image encoding, and image data obtained is transmitted to the monitoring terminal device 2 via the network 3 by a transmission signal 91, and the monitoring terminal device 2 displays an image 101 of the standard image on the operation screen. It is displayed on the 51 standard image display section 61.
  • monitoring device 1 captures a standard image.
  • the captured standard image is subjected to moving image coding, and image data obtained is transmitted to the monitoring terminal device 2 via the network 3 by the transmission signal 92, and the monitoring terminal device 2 generates the image 102 of the standard image. It is displayed on the standard image display section 61 of the operation screen 51.
  • monitoring device 1 similarly captures a standard image.
  • Image data obtained by moving the encoded standard image into a moving image is transmitted to the monitoring terminal device 2 via the network 3 by the transmission signal 93, and the monitoring terminal device 2 operates the image 103 of the standard image. It is displayed on the standard image display section 61 of the screen 51.
  • a high-definition image is acquired.
  • the request signal is transmitted as the transmission signal 94 from the monitoring terminal device 2 to the monitoring device 1 via the network 3.
  • the request signal reaches the imaging device control unit 17 via the communication unit 16, the high definition image mode is set accordingly, and the imaging device 11 captures a high definition image.
  • the high-definition image captured by the imaging device 11 by the video switching unit 12 is input to the high-definition image encoding unit 14.
  • the high-definition image input by the high-definition image encoding unit 14 is subjected to still image encoding, and the encoded image data is transmitted and output to the network 3 via the communication unit 16.
  • the encoded data of the high-definition image transmitted and output from the monitoring device 1 in response to the request signal as described above is transmitted by the transmission signal 95 via the network 3 to the operation terminal device.
  • the received high-definition image 104 is displayed on the high-definition image display unit 62 of the operation screen 51 in the operation terminal device 2. Obtained in this way For high-definition images, for example, by using a pointing device such as a PC joystick or mouse, any position can be freely enlarged and displayed on the high-definition image enlarged display sections 63 to 65. .
  • the mode shifts to the standard image monitoring mode again, and the monitoring apparatus 1 captures the standard image, and the captured standard image is obtained by encoding the moving image.
  • the data is transmitted to the monitoring terminal device 2 via the network 3 by the transmission signal 96, and the image 105 of the standard image is displayed on the standard image display section 61 of the operation screen 51 in the monitoring terminal device 2.
  • the monitoring device 1 when the monitoring device 1 receives a request signal for manual imaging from the monitoring terminal device 2, the monitoring device 1 shifts to the high-definition image mode under the control of the imaging device control unit 17. When one high-definition image of one frame is captured by the device 11, the mode shifts to the standard image mode again, and the image capturing device 11 returns to a state of capturing a standard image.
  • the entire monitoring target area is always displayed as a standard image as a moving image using images with different degrees of definition, and abnormalities are detected.
  • One or more specific locations, such as those that occurred, can be partially enlarged with high-definition images and displayed as still images, and these can be displayed simultaneously on the same screen.
  • a moving image of the entire monitoring target area is always displayed in real time by the standard image display unit 61, and at the same time, a high-definition image display unit 62 displays the moving image of the entire monitoring target area at a certain point in time.
  • the high-resolution still images are thinned out and displayed, and further, one or more partial images in the high-definition still images are electronically enlarged and displayed by the high-resolution enlarged display units 63 to 65.
  • the entire monitoring target area is always displayed in real time by the standard image of the standard image display unit 61, it is possible to prevent an abnormality from being overlooked. The image is clearly visible even when magnified.
  • the control of devices such as a camera zoom lens and a camera platform is not performed as in the related art, and the image of the entire monitoring target area is further displayed.
  • the standard image display section 61 which solves the problem of blind spots that occur when monitoring the suspicious person or other abnormalities by operating the camera's zoom lens head as in the past. Can be turned off.
  • a partial image of a high-definition image is cut out and displayed in an enlarged manner, a plurality of partial images can be cut out so that a plurality of places can be simultaneously displayed in an enlarged manner.
  • the monitoring terminal device 2 uses the information on the detection result of the abnormality recorded in the header area of the encoded data of the high-definition image received from the monitoring device 1 to display the high-definition image on the operation screen 51, for example.
  • One or more image ranges in which an abnormality has been detected can be used as the initial positions of the display frames 82, 83, and 84 on the unit 62.
  • the partially enlarged image is initially displayed on the high-definition image enlarged display sections 63 to 65 based on the detection result of the abnormality.
  • the user's observer operates the enlarged display selection buttons 72 to 74, the enlarged display position move buttons 75 to 78, and the magnification ratio change button 79 to change the image area to be partially enlarged to any desired location. Can be changed to
  • a configuration in which the monitoring device 1 on the camera side includes the abnormality detection unit 15 is shown.
  • a configuration in which the monitoring terminal device 2 on the client side has the function of the abnormality detection unit It is also possible to adopt a configuration in which both the monitoring terminal device 2 and the monitoring terminal device 2 have the function of the abnormality detection unit.
  • a request signal generated by the function of the abnormality detection unit of the monitoring terminal device 2 may be transmitted to the monitoring device 1 via the network 3. it can.
  • the abnormality detection unit 15 of the monitoring device 1 it is possible to reduce the amount of image data in an area where no abnormality such as a suspicious person exists based on the detection result by the abnormality detection unit 15 of the monitoring device 1 and transmit the image data.
  • the definition, image quality, number of pixels, One or more characteristics such as the number of gradations, the compression ratio, and the encoding method are excellent. Even when transmitting a high-quality image, the data amount of the image can be reduced. It is possible to avoid things like becoming larger than the standard image. Wear.
  • the image captured by the imaging device 11 is coded at a high compression rate and transmitted, while if an abnormality such as a suspicious person is detected, the imaging device is detected. It is also possible to perform encoding by changing the compression ratio in two or more stages according to the result of detection of the abnormality, such that the image captured by 11 is encoded and transmitted at a low compression ratio. Further, as another embodiment, the same effect can be obtained in a configuration other than the compression ratio, for example, by changing the number of gradations per pixel of an image in two or more stages and performing encoding. Can be.
  • a high-definition partial image of only a specific portion is transmitted based on information on an abnormality detection result, or only a specific portion is encoded at a low compression rate. It is possible to transmit a high-definition whole image.
  • the data amount of high-definition images transmitted from the monitoring device 1 to the monitoring terminal device 2 can be reduced.
  • the video switching unit 12 determines whether to capture a standard image or a high-definition image.
  • the imaging device 11 always captures a high-definition image, and the signal of the high-definition image is supplied to both the standard image encoding unit 13 and the high-definition image encoding unit 14, and the standard image encoding unit 13 Downconverts the quality (definition) of the input high-definition image to standard quality It is also possible to adopt a configuration that generates a moving image of the above. In such a configuration, for example,
  • an imaging device 11 that captures an image of a monitoring target region, an abnormality detection unit 15 that detects a region of interest in which an abnormality has occurred in the monitoring target region, and an image that is captured based on a detection result by the abnormality detection unit 15
  • An image processing function for processing one or more images of at least two types of image quality obtained by the device 11 (in this example, a standard image encoding unit 13 and a high-definition image encoding unit 14) is used. Accordingly, based on the detection result by the abnormality detection unit 15, the data amount of the image portion other than the attention area of the image captured by the abnormality can be reduced.
  • the imaging device 11 that captures an image of the monitoring target region
  • the abnormality detection unit 15 that detects the attention area related to the abnormality in the monitoring target region
  • An image processing unit (in this example, standard image coding) that processes at least one of images of at least two types of image quality obtained by the imaging device 11 based on the detection result by the abnormality detection unit 15 Unit 13 and high-definition image encoding unit 14)
  • an image output unit (in this example, communication unit 16) that outputs the image processed by the image processing unit. Is detected, and the abnormality can be monitored.
  • the abnormality detection unit 15 detects the attention region in the monitoring target region based on at least one of the images of at least two types of image quality obtained by the imaging device 11.
  • a sensor for detecting the presence or absence of a predetermined change in the monitoring target area is provided, and the abnormality detecting unit 15 detects the attention in the monitoring target area based on the detection result by the sensor.
  • a configuration for detecting an area may also be employed.
  • an image processing unit determines a range of an image to be processed based on a detection result of the abnormality detection unit 15 to thereby determine a code. It is possible to reduce the data amount of the image that has been shaded.
  • an image processing unit for example, a high-definition image encoding unit 14
  • the definition of the image to be processed the image quality, the number of pixels, 1 Determine at least one of the number of gradations per pixel, compression ratio, encoding method, etc.
  • the data amount of the encoded image can be reduced.
  • the display unit that inputs the content of the operation by the observer (operator) and displays the image input from the monitoring device 1 in response to the operation
  • an operation screen 51 is provided, and based on the operation of the observer, the image input from the monitoring device 1 and its partial image are displayed on the display unit. Even without operation, it is possible to monitor abnormalities such as suspicious persons in the monitoring target area.
  • a display unit for displaying at least one image is provided, and at least one input from the monitoring device 1 is input based on the operation of the monitor.
  • the display unit displays partial images of the two images.
  • a display unit for displaying at least one image is provided, and based on the operation of the monitor, the image of the image input from the monitoring device 1 is provided.
  • the display unit displays at least one partial image.
  • an appropriate image can be obtained by controlling the imaging device 11 in accordance with the abnormality detected by the monitoring device 1. Further, in the monitoring system of the present example, for example, it is possible to perform enlarged display of a monitoring target object related to an abnormality such as a suspicious person without operating a camera zoom lens or a camera platform with a high-quality image. High-quality images can be selectively transmitted to remote locations, and V / systems that minimize the oversight of abnormalities such as suspicious individuals and systems that suppress an increase in the amount of data to be transmitted can be realized.
  • an image capturing unit is configured by the function of the imaging device 11
  • a request signal receiving unit is configured by the function of the communication unit 16
  • the standard image encoding unit 13 is configured.
  • the first image transmission unit is configured by the functions of the communication unit 16, the function of the video switching unit 12, and the function of the imaging device control unit 17, and the functions of the high-definition image encoding unit 14 and the communication unit 16.
  • the function, the function of the video switching unit 12, and the function of the imaging device control unit 17 constitute a second image transmission unit
  • the function of the abnormality detection unit 15 constitutes an abnormality detection unit.
  • the image is received by the function of receiving the image from the monitoring device 1.
  • An image receiving unit is configured, and an image display unit is configured by a function of displaying an image on the operation screen 51 as shown in FIG. 4, and a request signal transmission instruction receiving unit is configured by a function of the shutter button 71.
  • a request signal transmission unit is configured by a function of transmitting a request signal.
  • the function of the enlarged display selection buttons 72 to 74 on the operation screen 51 as shown in FIG. 4 and the enlarged display position moving button are provided.
  • the function of 75 to 78 constitutes an enlarged display image part specification instruction receiving unit.
  • an area for displaying an image of the first image quality is configured by the standard image display unit 61, and the area is displayed by the high-definition image display unit 62.
  • An area for displaying an image of the second image quality is configured, and an area for enlarging and displaying an image portion in the image of the second image quality is configured by the high-definition image enlarged display units 63 to 65.
  • the first image having a relatively low image quality is constituted by the standard image
  • the second image having the relatively high image quality is constituted by the high-definition image. ing.
  • FIG. 6 shows a configuration example of the monitoring system of this example.
  • the monitoring system of this example includes a monitoring device 111, a monitoring terminal device 112, a network 113, a line (access line) 114 connecting the monitoring device 111 and the network 113, and a monitoring terminal device 112 and a network 113. It has a line (access line) 115 to be connected.
  • the monitoring device 111 includes, as hardware configuration examples, an imaging device 121 also configured with a power such as a television camera, a video switching unit 122 configured with a camera such as a switching switch, a standard image encoding unit 123, It includes a high-definition image encoding unit 124, an abnormality detection unit 125, a communication unit 126, an imaging device control unit 127, an image recording unit 128, and a read control unit 129.
  • an imaging device 121 also configured with a power such as a television camera
  • a video switching unit 122 configured with a camera such as a switching switch
  • a standard image encoding unit 123 It includes a high-definition image encoding unit 124, an abnormality detection unit 125, a communication unit 126, an imaging device control unit 127, an image recording unit 128, and a read control unit 129.
  • the monitoring system of the present example has a configuration in which, for example, the monitoring device 111 having the configuration shown in FIG. 1 further includes an image recording unit 128 and a readout control unit 129.
  • the configuration and operation of the other processing units 121 to 127 provided in the monitoring device 111 are roughly the same as the configuration and operation of the corresponding processing units 11 to 17 provided in the monitoring device 1 shown in FIG. Is the same.
  • An example of an operation performed by the monitoring device 111 of the present example will be described. The description of the same operation as that performed by the monitoring device 1 shown in FIG. 1 is omitted.
  • the high-definition image encoding unit 124 outputs data obtained by encoding the high-definition image to the image recording unit 128, and the communication unit 126 receives the encoded data from the image recording unit 128.
  • the communication unit 126 reads out a request signal received from the monitoring terminal device 112 via the network 113 and outputs the request signal to the control unit 129.
  • the image recording unit 128 is composed of, for example, a memory, and inputs and records the data of the high-definition image encoded by the high-definition image encoding unit 124. At this time, the image recording unit 128 records the information on the abnormality detection result including the abnormality detection time obtained by the abnormality detection unit 125 in association with the image data.
  • the read control unit 129 inputs a request signal obtained from the monitoring terminal device 112 via the network 113 from the communication unit 126, controls the image recording unit 128 based on the request signal, and controls the image recording unit 128 based on the request signal.
  • the encoded data of the high-definition image recorded in the image recording unit 128 is read and output to the communication unit 126.
  • the encoded data of the high-definition image is transmitted by the communication unit 126 to the monitoring terminal device 112 via the network 113.
  • FIG. 7 shows an example of an operation performed by the monitoring device 111 or the monitoring terminal device 112 during automatic imaging.
  • the monitoring terminal device 112 of the present example displays an image using the same operation screen 51 as shown in FIG.
  • FIG. 7 conceptually shows an example of an operation performed by the monitoring device 111 or the monitoring terminal device 112 over time from time tl to time (tl + 4).
  • the images 131, 132, 133, 134, and 135 in ljtl, (tl + l), (tl + 2), (tl + 3), and (tl + 4) are output by the monitoring device 111 at each time.
  • FIG. 7 shows a plurality of image pickup devices 121, a plurality of standard image coding units 123, a high-definition image coding unit 124, a plurality of abnormality detection units 125, and an image recording unit 128. These represent processing units provided in the monitoring device 111 of this example.
  • the imaging device 121 captures the image 131 in the standard image mode, and the captured image is input to the standard image encoding unit 123 and the abnormality detection unit 125.
  • Standard image mark The encoding unit 123 encodes the input image, and transmits the encoded image to the monitoring terminal device 112 via the communication unit 126 and the network 113.
  • the image is displayed on the standard image display of the monitoring terminal device 112.
  • the image is displayed in the section 61 as shown in the image 141.
  • the abnormality detection unit 125 detects an abnormality such as a suspicious person in the monitoring target area by a technique such as a difference method.
  • the abnormality detecting unit 125 does not detect an abnormality such as a suspicious person.
  • the imaging device 121 captures the image 132 in the standard image mode, and the captured image is input to the standard image encoding unit 123 and the abnormality detection unit 125.
  • the standard image encoding unit 123 encodes the input image, and transmits the encoded image to the monitoring terminal device 112 via the communication unit 126 and the network 113.
  • the image is transmitted to the standard image display unit of the monitoring terminal device 112. It is displayed as image 142 on 61.
  • the abnormality detection unit 125 detects the presence of the suspicious person in the monitoring target area as an abnormality, and responds via the imaging device control unit 127 accordingly.
  • the abnormality detection unit 125 outputs information on the detection result including the detection position and the detection time of the abnormality such as the suspicious person to the high-definition image encoding unit 124. Further, information relating to the result of the detection of the abnormality by the abnormality detection unit 125 is transmitted to the monitoring terminal device 112 via the communication unit 126 and the network 113 by the transmission signal 151. Then, in the monitoring terminal device 112, the notification message 81 is displayed in the standard image display section 61 of the operation screen 51 in response to receiving the information notifying the occurrence of the abnormality from the monitoring device 111.
  • the imaging device 121 captures the image 133 in the high-definition image mode according to the detection result by the abnormality detection unit 125 at time (tl + 1), and Is input to the high-definition image encoding unit 124.
  • the high-definition image encoding unit 124 encodes the input high-definition image, and the encoded image is recorded in the image recording unit 128 together with the detection result information from the abnormality detection unit 125.
  • encoding of the image for example, encoding of a partial image of a high-definition image may be performed based on a result of detecting an abnormality, or partial encoding such as the ROI function of JPEG2000.
  • the encoding may be performed by a method that changes the compression ratio. Also, a resource for acquiring a high-definition image from the monitoring terminal device 112 is displayed.
  • the quest signal 152 is transmitted and reaches the read control unit 129 of the monitoring device 111
  • the high-definition image recorded in the image recording unit 128 is read based on the request signal and read by the control unit 129 to perform communication.
  • the transmission signal 153 is transmitted to the monitoring terminal device 112 via the unit 126 and the network 113.
  • the high-definition image is displayed on the monitoring terminal device 2 on the high-definition image display unit 62 of the operation screen 51.
  • the request signal transmitted from the monitoring terminal device 112 includes information for specifying the time (time specifying information). This corresponds to the time when the abnormality is detected.
  • Read control unit 129 compares the time specifying information included in the input request signal, and information specifying the detection time attached to the image recorded on the image recording unit i 28, contained in the request signal Then, an image whose detection time coincides with the time specified by the time information to be detected or the latest time is read from the image recording unit 128 and output to the communication unit 126. As a result, even when a plurality of high-definition images are recorded in the image recording unit 128, the readout control unit 129 can read out a desired high-definition image based on the request signal.
  • information regarding the result of detection of an abnormality received from the monitoring device 111 is stored in a memory, and a time of detection of a past abnormality is specified based on the information.
  • Information can be displayed in a list or the like.
  • the monitoring terminal selects an arbitrary detection time from the abnormality detection times displayed in this way, and the monitoring terminal device 112 transmits information to the monitoring device 111 with the information specifying the detection time included in the request signal. be able to.
  • the monitoring terminal device 112 of the present example receives the information specifying the detection time of the abnormality from the monitor, or receives both the time specification information and the press of the shirt button 71.
  • a request signal including the received time specifying information is transmitted to the monitoring device 111.
  • a configuration may be used in which a request signal for acquiring a high-definition image relating to the latest abnormality is transmitted. is there.
  • the imaging device 121 captures the image 134 in the standard image mode, and the captured image is input to the standard image encoding unit 123 and the abnormality detection unit 125.
  • the image encoding unit 123 encodes the input image, and transmits the encoded image to the monitoring terminal device 112 via the communication unit 126 and the network 113.
  • the image is displayed as the image 143 on the standard image display section 61 of the monitoring terminal device 112.
  • the abnormality detection unit 125 detects an abnormality such as a suspicious person in the monitoring target area by a method such as a difference method.
  • the abnormality detection unit 125 does not detect an abnormality such as a suspicious person.
  • the captured image 135 does not have any abnormality such as a suspicious person. Therefore, only the encoded standard image is transmitted to the monitoring terminal device 2, and the image Will be displayed.
  • the imaging device control unit 127 when the imaging device control unit 127 receives the request signal output from the abnormality detection unit 125, the monitoring device 111 performs high-definition control under the control of the imaging device control unit 127.
  • the mode shifts to the image mode and the imaging device 121 captures a high-definition image for one frame, the mode shifts again to the standard image mode and the imaging device 121 returns to a state where a standard image is captured.
  • the latest image is always transmitted from the monitoring device 111 to the monitoring terminal device 112 as the standard image, and the detection time of the abnormality such as a suspicious person included in the request signal is shown as the high-definition image.
  • the information can be selectively read from the image recording unit 128 based on the information and received by the monitoring terminal device 2. For this reason, a high-definition image can be selectively transmitted to a remote place, and an increase in the amount of data transmitted when transmitting a high-definition image can be suppressed.
  • the image recording unit 128 that records the image encoded by the image encoding function (in this example, the high-definition image encoding unit 124).
  • a display unit in this example, in which the content of the operation by the monitor (operator) is input and the image input from the monitoring device 111 is displayed according to the operation. Operation screen 51) is provided.
  • a display unit for displaying at least one image is provided, and at least one image recorded on the image recording unit 128 of the monitoring device 111 based on the operation of the observer.
  • a partial image of the image is displayed on the display unit.
  • a display unit for displaying at least one image is provided, and at least one of the images recorded in the image recording unit 128 of the monitoring device 111 is provided based on the operation of the observer.
  • the two partial images are displayed by the display unit.
  • the image recording unit 128 of the monitoring device 111 records one or more images with predetermined information (in this example, time information) specifying the image.
  • the monitoring terminal device 112 has, for example, a list display function for displaying a list of information specifying images recorded in the image recording unit 128 of the monitoring device 111. Then, information (image specifying information) for specifying the selected image is transmitted to the monitoring device 111.
  • the monitoring device 111 reads an image corresponding to the image specifying information input from the monitoring terminal device 112 from the images recorded in the image recording unit 128 and transmits the read image to the monitoring terminal device 112. It is received by 112 and displayed on the display unit.
  • the monitoring device 111 records the image processed by the image processing unit (in this example, the high-definition image encoding unit 124) by the image recording unit 128, and the monitoring terminal device 112
  • the zoom lens of the camera can be monitored without operating the camera platform. It is possible to monitor suspicious persons and other abnormalities within the building.
  • the configuration in which the monitoring device 111 on the camera side is provided with the abnormality detection unit 125 is shown.
  • the monitoring terminal device 112 on the client side detects the abnormality.
  • a request signal generated by the function of the abnormality detection unit of the monitoring terminal device 112 can be transmitted to the monitoring device 111 via the network 113.
  • an observer on the client side A request signal for a high-definition image can be automatically transmitted from the monitoring terminal device 112 on the client side to the monitoring device 111 on the camera side without pressing the button 71.
  • the monitoring force of the client side is pushed by the observer of the monitoring terminal device 112 on the client side by pressing the shirt button 71, etc.
  • a request signal is transmitted to.
  • the automatic imaging processing is executed in the monitoring device 111 on the camera side. In this case, even if there is no request signal of the client side, the automatic imaging processing is performed from the camera side.
  • the acquired high-definition image is not transmitted to the client, but the transmission of the high-definition image is based solely on the client-side request.
  • the amount of data to be transmitted is increased by transmitting a high-definition image from the monitoring device 111 only when requested by the client. It is possible to suppress. It should be noted that it is also possible to adopt a configuration in which a high-definition image is automatically transmitted from the monitoring device 111 to the monitoring terminal device 112 during automatic imaging.
  • a list such as the date and time when the abnormality is detected is displayed on the monitoring terminal device 112 on the client side, and the user can specify the date and time desired to be referred from the list. Done.
  • an automatic recording image acquisition button is prepared separately from the shirt button 71 for manual imaging, and the automatic recording image acquisition button is pressed by the user. Then, a configuration is used in which a process for acquiring an image recorded in the image recording unit 128 of the monitoring device 111 is performed.
  • a high-definition image obtained by automatic imaging can be acquired from the monitoring device 111 in response to a request signal issued (here, referred to as a request signal A).
  • a request signal issued here, referred to as a request signal A
  • the image at the latest abnormality detection date when the shirt button 71 is pressed is transmitted from the monitoring device 111 to the monitoring terminal device 112.
  • the latest high-definition image is temporarily stored in the high-definition image encoding unit 14.
  • the request signal A is received from the monitoring terminal device 2
  • the latest high-definition image in the high-definition image encoding unit 14 is read out and distributed to the monitoring terminal device 2. Can be used.
  • an abnormal image storage unit is configured by the function of the image recording unit 128, and the second image transmission unit is configured by the function of the communication unit 126 and the function of the readout control unit 129. It is configured.
  • an abnormality information storage unit is configured by a function of storing information specifying the date and time related to the abnormality received from the monitoring device 111, and a function of displaying such information in a list is provided.
  • An abnormality information output unit is configured.
  • the high-definition image display unit 62 displays display frames 82 to 84 indicating the positions of the reduced high-definition still image and the partial image to be enlarged and displayed.
  • the respective partial images shown by these display frames 82 to 84 are enlarged and displayed on the respective high-resolution image enlarged display sections 63 to 65.
  • the respective display frames 82 and 83 are displayed.
  • , 84 correspond to the respective enlarged display selection buttons 72, 73, 74! /,
  • each enlarged display selection button 72, 73 inside or outside the display frame 82, 83, 84 , 74 (for example, numbers and symbols) to explicitly indicate that they correspond to each other.
  • each of the display frames 82, 83, 84 corresponds to each of the high-resolution image enlarged display sections 63, 64, 65.
  • the colors of the display frames 82, 83, and 84 are changed to the colors of the outer frame of the respective enlarged display selection buttons 72, 73, and 74.
  • the correspondence may be explicitly specified by matching the colors of the frames of the high-resolution image enlarged display sections 63, 64, and 65.
  • set the color of the display frame 82 to blue, set the color of the outer frame of the enlarged display selection button 72 and the outer frame of the high-resolution image Set the color of the outer frame of the enlarged display selection button 73 and the high-resolution image enlarged display section 64 to yellow, and set the color of the display frame 84 to green and set the enlarged display selection button 74 Set the color of the outer frame and the color of the outer frame of the high-resolution image enlarged display section 65 to green.
  • the high-definition image is reduced and displayed on the high-definition image display unit 62.
  • the definition, the image quality, the number of pixels, and the number of gradations per pixel are lower than those of the standard image with low image quality. Since one or more of the compression ratios and the like are excellent, even when displayed on the high-resolution image enlarged display sections 63 to 65, a finer image than the standard image can be displayed.
  • the operator or the like selects one of the enlarged display selection buttons 72, 73, 74 by clicking (for example, pressing and releasing the left mouse button) to select the position of the partial image to be enlarged.
  • the corresponding one of the display frames 82, 83 and 84 shown is enabled.
  • the activated display frame can be distinguished from the display frame, for example, by changing the color of the display frame from the normal state (when not selected) so that it is enabled. You.
  • the operator or the like clicks the enlarged display selection button 72
  • the corresponding display frame 82 turns red, and the display frame 82 can be operated by the operator.
  • the operator cannot operate the display frames 83 and 84 of other colors (for example, black).
  • the display frame that was valid is displayed.
  • the valid state of 82 is released, and the display frame 82 becomes another color (for example, black), and cannot be operated by the operator.
  • the display frames 82, 83, and 84 are moved by operating the enlarged display position movement buttons 75 to 78 corresponding to up, down, left, and right. Clicking the zoom-in position move button 75 corresponding to the upper direction Clicks the zoom-in position move button 76 corresponding to the upper direction and the downward direction Click the zoom display position move button 78 corresponding to the left or right direction to select it to the right.
  • the displayed display frame moves by one dot, and if each button is kept pressed, the display frame moves continuously in each direction.
  • buttons 75 to 78 can be configured to be interlocked with up, down, left, and right keys of a keyboard, for example.
  • the outer frame of the high-definition image enlarged display section 63 is outlined in red, and the partial image displayed on the high-definition image enlarged display section 63 is displayed.
  • the position can be finely adjusted.
  • the position of the partial image displayed on the other high-resolution image enlarged display sections 64 and 65 cannot be fine-tuned, and if one of the enlarged display selection buttons is selected, Will be released.
  • the selection is made.
  • the state is released, the border of the outer frame of the high-definition image enlarged display section 63 is erased, and the fine adjustment of the position of the partial image displayed on the high-definition image enlarged display section 63 becomes impossible.
  • the fine adjustment of the position of the partial image is performed by operating the enlarged display position movement buttons 75 to 78.
  • the enlarged display position move button 75 moves upward
  • the enlarged display position move button 76 moves down
  • the enlarged display position move button 77 moves left
  • the enlarged display position move button 78 The image moves one dot to the right with, and the position of the partial image moves continuously by holding down the button.
  • FIG. 8 shows another configuration example of a button (enlarged display position move button) 161 for moving an enlarged display position as an example of operation buttons provided on the monitoring terminal devices 2 and 112. It is. Note that in FIG. 8, only one of the eight-direction buttons is denoted by reference numeral 161 and the other is omitted.
  • the display frame can be moved diagonally by providing a total of eight directions, up, down, left, right, and diagonal, as the enlarged display position move button for changing the position of the partial image. It can also be.
  • the clicked position is displayed in high definition. It is also possible to display the image on the image display unit 62 or to update the images displayed on the high-definition image enlarged display units 63 to 65 so that the clicked position becomes the center.
  • the mouse when the mouse is dragged (for example, the operation of moving the mouse while pressing the left button of the mouse), the position of the partial image to be enlarged and displayed on the high-definition image according to the movement of the mouse. It may be configured to move continuously.
  • the enlargement ratio of the partial image is changed by operating the enlargement ratio change button 79 on the operation screen 51 shown in FIG.
  • the magnification of the selected image can be changed. is there.
  • FIG. 9 shows an example of the enlargement ratio change button 171 (in this example, the enlargement ratio change button 79 shown in FIG. 4) and an example of a list of enlargement ratios.
  • the center point of the image is left as it is, and it is selected!
  • the size of the display frame 82 to 84 of the image and the selected high-resolution image Enlarged display The range of the partial image of the high definition image displayed in the sections 63 to 65 is changed.
  • affine transformation As a method for enlarging and compressing an image, a method called affine transformation has been widely used.
  • the affine transformation is represented by Equation 1, and means that a certain pixel (xl, yl) is transformed into a pixel (x2, y2) by a transformation operation.
  • Sx and Sy represent the enlargement ratio in the X and y directions, respectively. If Sx or Sy is 1.0 or more, enlargement is performed.If Sx or Sy is less than 1.0, reduction is performed. Become.
  • FIG. 10 shows an example of the enlargement ratio change pop-up menu 181 and an example of the pointer 182.
  • the enlargement ratio change pop-up menu 181 of this example displays all the values of the enlargement ratio prepared in advance. By selecting one magnification value, the selected magnification value Selected according to! The display frames 82 to 84 and the range of the partial image are updated, and the updated partial image is enlarged and displayed on the selected high-definition image enlarged display section 63 to 65.
  • the range of the partial image is updated.
  • the display frame 82 to 84 and the range of the partial image that is selected to the value of the enlargement ratio by one step smaller than the current enlargement value and 1 Are updated, and the updated partial image is enlarged and displayed on the selected high-definition image enlarged display sections 63 to 65.
  • a configuration in which the value of the enlargement ratio is changed according to the rotation amount of the mouse wheel may be adopted.
  • the minimum rotation angle of the wheel for example, 15 degrees (°;)
  • the magnification is changed by 5 percent (%) per step.
  • the wheel is rotated 6 steps (90 degrees) forward, the magnification is increased by 30%, and if the wheel is rotated 10 steps (150 degrees) backward, the magnification is 50%. cut back.
  • each of the display frames 82, 83, and 84 is used.
  • the size should be changed by expanding or contracting the mouse by dragging the mouse, and the value of the magnification should be changed according to the change in the size of each display frame 82, 83, 84.
  • the operation screen 51 of this example three high-definition image enlarged display sections 63 to 65, three enlarged display selection buttons 72 to 74, and three display frames 82 to 84 are provided. There is. For this reason, in this example, when three partial areas are already specified using the three display frames 82 to 84 by a user operation or the like, the user further specifies another partial area. In this case, the user selects the display frame corresponding to the partial area that does not need to be enlarged and displayed from the already specified display frames 82 to 84, cancels the specification, and performs a new specification. Specifically, the three enlarged display selection buttons 72 to 74 also correspond to the partial areas (display frames 82 to 84) for which the enlarged display is not required! With this, the designation of the display frame corresponding to the button is released. Thereafter, the user moves the released display frame to the position of the newly designated partial area, and designates a new partial area.
  • each of the enlarged display selection buttons 72 to 74 is used by the user to release each of the display frames 82 to 84 for designating a partial area of an image to be displayed in each of the high-resolution image enlarged display sections 63 to 65.
  • FIG. 11 shows an example of the operation screen 51 of the monitoring terminal devices 2 and 112.
  • the displayed image is different from that shown in FIG. 4, and the same reference numerals are given to the respective parts.
  • the respective partial images indicated by the display frames 82, 83 and 84 in the high-definition image display section 62 are enlarged and displayed on the high-definition image enlarged display sections 63, 64 and 65.
  • the high-definition image magnified display section 63 displays an image of the entire vehicle
  • the high-definition image magnified display section 64 displays an image of a person's burst shot
  • the high-definition image magnified display section 65 displays.
  • An image of a bust shot of a person different from the above is displayed.
  • an optimal enlarged image can be obtained for each object to be monitored. .
  • FIG. 12 shows another example of the operation screen 51 of the monitoring terminal devices 2 and 112.
  • the displayed image is different from that shown in FIG. 4, and the same reference numerals are given to the respective parts.
  • the high-resolution image enlarged display section 63 displays an image of the entire person
  • the high-resolution image enlarged display section 64 displays an image of the bust shot of the person. Displays an image of a close-up shot of the person. In this way, by displaying one target object at different magnifications, it becomes possible to accurately capture the target object.
  • the monitoring terminal device 112 automatically displays a reduced high-resolution still image of the captured image on the high-definition image display unit 62.
  • display frames 82 to 84 indicating the position of the partial image to be enlarged and displayed are automatically displayed based on the detection result from the abnormality detection unit 125, and the respective partial images indicated by the display frames 82 to 84 are displayed. Is automatically displayed on each of the high-resolution image enlarged display sections 63 to 65.
  • the partial image enlarged and displayed in each of the high-resolution image enlarged display sections 63 to 65 can be selected by the enlarged display selection buttons 72 to 74, and the enlarged display position The position can be moved with the move buttons 75 to 78, and the magnification can be changed with the magnification change button 79.
  • the standard image (moving image) 192 or ⁇ having a width of 640 pixels by a height of 480 pixels is formed by the imaging device 191 (the imaging device 11 according to the first example and the imaging device 121 according to the second example).
  • a high-resolution image (still image) 193 of 1280 pixels X height 960 pixels is acquired.
  • an image portion 194 to be enlarged is selected by the display frames 82 to 84.
  • the acquired standard image 192 is displayed in the display area of the standard image display unit 61 of 640 pixels wide by 480 pixels high with the same number of pixels, and the acquired high-definition image 193 is subjected to pixel thinning or the like.
  • the image is reduced and displayed in the display area of the high-definition image display unit 62 of 480 pixels wide by 360 pixels high.
  • An image portion 194 corresponding to a part of the high-definition image 193 is cut out and electronically enlarged, and a high-definition image enlarged display section 63 of 320 pixels wide by 240 pixels in height (or a high-resolution image enlarged display section 64) , 65) in the display area.
  • the operation screen 51 includes a standard image display unit 61, which is a display area of a moving image based on the standard image.
  • a high-definition image display 62 which is a display area for still images (thinned-out whole images) based on high-definition images, and a still image enlarged based on a high-definition image (enlarged partial image)
  • high-definition image enlarged display sections 63 to 65 which are display areas. Specify a partial area in the high-resolution image display area 62. Display frames 82 to 84 are displayed.
  • a display frame (similar to the display frames 82 to 84) is displayed on the standard image display unit 61, and a partial area is designated on the standard image (for example, a moving image) by the display frame. Then, the image of the partial region corresponding to the display frame can be cut out from the high-definition image and enlarged and displayed on the high-definition image enlargement display units 63 to 65.
  • a display frame (similar to the display frames 82 to 84) is displayed on the standard image display section 61, and the display frame is used to specify a partial area on a standard image (for example, a moving image). Then, the image of the partial region corresponding to the display frame can be cut out from the standard image and enlarged and displayed on the high-definition image enlarged display sections 63 to 65.
  • a configuration in which various high-definition images are acquired such as the ability to acquire 7.5-second high-definition images, for example, 30 frames per second, may be used.
  • each display frame is manually set by the user
  • an object detection by image processing may be used.
  • the position of each display frame is automatically determined based on the result, and the display is enlarged and displayed on each of the high-definition image enlarged display sections 63 to 65, or automatically based on the result of detection by an external sensor.
  • a mode may be used in which the position of the display frame is determined and enlarged and displayed on each of the high-definition image enlarged display sections 63 to 65.
  • the monitoring devices 1 and 111 having the imaging devices 11 and 121 for capturing images of the monitoring target area, and the monitoring terminal devices 2 and 112 having the display devices for displaying images.
  • an image enlargement function for enlarging an image obtained by the imaging devices 11 and 121 of the monitoring devices 1 and 111 at a predetermined enlargement ratio, and the display device displays two or more enlarged images.
  • the monitoring system of the present example is provided with an image selection function for selecting two or more images among the images input from the imaging devices 11 and 121 of the monitoring devices 1 and 11 based on an operation by an operator, and
  • the enlargement function enlarges the selected image at a predetermined enlargement ratio.
  • the surveillance system according to the present example is configured such that a suspicious person or the like in the surveillance target area has an error. You can always monitor.
  • the monitoring system of the present example is provided with an image enlargement setting function for determining at least one of an image position and an enlargement ratio based on an operation by an operator.
  • the image is enlarged based on the position and the enlargement ratio of the image determined by the enlargement setting function, so that it is possible to monitor abnormalities such as a suspicious person in the monitoring target area.
  • a detection function for detecting the presence or absence of a predetermined change in the monitoring target area includes the monitoring devices 1 and 111 and the monitoring terminal devices 2 and 112.
  • the image selection function enlarges the image based on the position and enlargement ratio of the image determined (detected) by the detection function.
  • the monitoring system of this example can monitor abnormalities such as suspicious persons in the monitoring target area.
  • the image selection function selects two or more images from the images detected by the detection function based on an operation by the operator.
  • the image enlargement setting function determines the position and the enlargement ratio of the image based on at least the deviation of the detection result by the detection function or the operation by the operator. I do.
  • the monitoring system of the present example can monitor an abnormality such as a suspicious person in the monitoring target area by using the enlarged image displayed at an appropriate position and an enlargement ratio.
  • the image enlargement setting function determines the value of the enlargement ratio for the pop-up menu force based on the operation by the operator.
  • the monitoring system of the present example can monitor an abnormality of a suspicious person or the like in the monitoring target area by using an image displayed at an appropriate magnification.
  • the image enlargement setting function determines the value of the enlargement ratio from the pull-down menu based on the operation by the operator.
  • the monitoring system of the present example can monitor an abnormality of a suspicious person or the like in the monitoring target area by using an image displayed at an appropriate magnification.
  • the image enlargement setting function determines the position of the image to be enlarged and displayed by a button operation based on an operation by the operator.
  • the monitoring system of this example can monitor an abnormality of a suspicious person or the like in the monitoring target area by using an image at an appropriate position.
  • the image enlargement setting function determines the position of the image to be enlarged and displayed directly by the mouse based on the operation by the operator.
  • the monitoring system of this example can monitor an abnormality such as a suspicious person in the monitoring target area using the image at the appropriate position.
  • the partial images at two or more positions can be enlarged and displayed on the same screen, and the imaging devices 11 and 121 are controlled according to the detected abnormality.
  • Obtaining an appropriate image displaying an image at the position specified by the operator on two or more monitored objects on a magnified screen, and capturing two or more monitored objects using captured high-definition images It is possible to enlarge the object at an appropriate position and magnification.
  • an image receiving unit is configured by a function of receiving images transmitted from the monitoring devices 1 and 111, as shown in FIGS. 4, 11, and 12.
  • An enlarged image display unit is configured by a function of enlarging and displaying images of a plurality of portions included in a received image on the same screen, and a frame indicating the image portion (display frame in this example) 82 to 84
  • the image partial frame display section is constituted by the function of displaying the images, and the corresponding relationship between each of the frames 82 to 84 and the frame of each image (high-resolution image enlarged display section in this example) 63 to 65 is visually checked.
  • the image partial correspondence display section is configured by the The image part position initial setting section is configured with the function to initially set the position (frame) 82 to 84 of the image to be enlarged and displayed, and the image is enlarged using the enlarged display position move buttons 75 to 78, 161, etc.
  • the position of the image to be displayed (frame) 82 to 84 constitutes the image part position moving part, and the image to be enlarged and displayed by the zoom ratio change buttons 79 and 171 and the pop-up menu 181 are displayed.
  • the image part enlargement ratio setting unit is configured by the function of setting the value of the enlargement ratio. Is configured.
  • the configurations of the monitoring system, the monitoring device, the monitoring terminal device, and the like according to the present invention are not necessarily limited to those described above, and various configurations may be used.
  • the present invention can be provided, for example, as a method or a method for executing the processing according to the present invention, a program for realizing the method or the method, a recording medium for recording the program, and the like. Also, it can be provided as various devices and systems.
  • the application field of the present invention is not necessarily limited to the above-described fields, and the present invention can be applied to various fields.
  • the present invention in addition to the purpose of monitoring, can also be realized as a system for the purpose of watching sports such as athletic meet in kindergarten and baseball.
  • various processes performed by the monitoring system, the monitoring device, the monitoring terminal device, and the like according to the present invention include, for example, a processor (ROM) in a hardware resource including a processor and a memory.
  • ROM read-only memory
  • a configuration controlled by executing the control program stored in ()) may be used.
  • each functional unit for executing the processing may be configured as an independent hardware circuit. .
  • the present invention can be understood as a computer-readable recording medium such as a floppy (registered trademark) disk or a CD (Compact Disc) ROM storing the above-mentioned control program or the program (the program itself).
  • the processing according to the present invention can be performed by inputting the program into the recording medium computer and causing the processor to execute the program.
  • the present invention can be used in the field of capturing a specific area, distributing the captured image, and receiving the captured image.
  • FIG. 1 is a diagram showing a configuration example of a monitoring system according to a first example of the present invention.
  • FIG. 2 is a diagram for explaining an example of a procedure of processing by a difference method.
  • FIG. 3 is a diagram showing an example of a procedure of processing by a monitoring method using a difference method.
  • FIG. 4 is a diagram showing an example of a display of an operation screen of the monitoring terminal device.
  • FIG. 5 is a diagram illustrating an example of an operation in manual imaging.
  • FIG. 6 is a diagram showing a configuration example of a monitoring system according to a second example of the present invention.
  • FIG. 7 is a diagram for explaining an example of an operation in automatic imaging.
  • FIG. 8 is a diagram showing an example of an operation button (an enlarged display position move button) in the monitoring terminal device.
  • FIG. 9 is a diagram showing an example of an operation button (enlargement ratio change button) on the monitoring terminal device.
  • FIG. 10 is a diagram showing an example of an operation button (enlargement ratio change pop-up menu) in the monitoring terminal device.
  • FIG. 11 is a diagram showing an example of a display of an operation screen of the monitoring terminal device.
  • FIG. 12 is a diagram showing an example of a display of an operation screen of the monitoring terminal device.
  • FIG. 13 is a diagram showing an example of the correspondence between the number of pixels between an image acquired by imaging and the display unit.

Abstract

Système d’image pour surveiller une zone à mettre efficacement en image. Dans un moniteur (1), une unité d’imagerie (11) capture une image de la zone à surveiller, une unité de communication (16) transmet l’image capturée à un terminal, un terminal de surveillance (2) reçoit les images et une unité d’affichage d’image agrandie affiche au moins deux images agrandies inclues dans l’image reçue sur un écran. Le moniteur (1) transmet une image codée par une unité de codage d’image standard (13) au terminal de surveillance (2) si le moniteur (1) ne reçoit pas de signal de requête du terminal de surveillance (2) et transmet une image codée par une unité de codage d’image haute définition (14) au terminal de surveillance (2) si le moniteur (1) reçoit un signal de requête. En outre, le moniteur (1) sort des informations sur une anomalie. Si le moniteur (1) reçoit un signal de requête du terminal de surveillance (2) en réaction aux informations, le moniteur (1) transmet une image codée par l’unité de codage d’image haute définition (14) au terminal de surveillance (2).
PCT/JP2005/008753 2004-05-14 2005-05-13 Dispositif de création d’image et méthode d’affichage d’image créée WO2005112461A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2004-144517 2004-05-14
JP2004144517A JP2005328333A (ja) 2004-05-14 2004-05-14 監視システム
JP2004-208875 2004-07-15
JP2004208875A JP2006033380A (ja) 2004-07-15 2004-07-15 監視システム

Publications (1)

Publication Number Publication Date
WO2005112461A1 true WO2005112461A1 (fr) 2005-11-24

Family

ID=35394531

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2005/008753 WO2005112461A1 (fr) 2004-05-14 2005-05-13 Dispositif de création d’image et méthode d’affichage d’image créée

Country Status (1)

Country Link
WO (1) WO2005112461A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1155649A (ja) * 1997-07-31 1999-02-26 Canon Inc 画像通信方法及び装置
JP2000059758A (ja) * 1998-08-05 2000-02-25 Matsushita Electric Ind Co Ltd 監視カメラ装置、監視装置、及びこれらを用いた遠隔監視システム
JP2004015517A (ja) * 2002-06-07 2004-01-15 Chuo Electronics Co Ltd 映像集約表示装置
JP2004104274A (ja) * 2002-09-06 2004-04-02 Hitachi Ltd 監視システム
JP2004105746A (ja) * 2003-10-14 2004-04-08 Toshiba Medical System Co Ltd マンモグラフィ装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1155649A (ja) * 1997-07-31 1999-02-26 Canon Inc 画像通信方法及び装置
JP2000059758A (ja) * 1998-08-05 2000-02-25 Matsushita Electric Ind Co Ltd 監視カメラ装置、監視装置、及びこれらを用いた遠隔監視システム
JP2004015517A (ja) * 2002-06-07 2004-01-15 Chuo Electronics Co Ltd 映像集約表示装置
JP2004104274A (ja) * 2002-09-06 2004-04-02 Hitachi Ltd 監視システム
JP2004105746A (ja) * 2003-10-14 2004-04-08 Toshiba Medical System Co Ltd マンモグラフィ装置

Similar Documents

Publication Publication Date Title
US9131122B2 (en) Apparatus, method, system, and storage medium causing a display to display a graph indicating a degree of change of part of a captured image
JP3870124B2 (ja) 画像処理装置及びその方法、並びにコンピュータプログラム及びコンピュータ可読記憶媒体
US20060087520A1 (en) Image display program and storage medium containing same
KR100986228B1 (ko) 카메라 장치 및 화상 기록 재생 방법
US20090040238A1 (en) Image display program and storage medium containing same
JP2006245746A (ja) 監視システム
JP4514185B2 (ja) カメラサーバ装置及びその制御方法、並びにコンピュータプログラム
JP5312256B2 (ja) 撮像装置および撮像システム
CN102348063B (zh) 相机设备、相机系统、控制设备
JP2006033380A (ja) 監視システム
JP2007043386A (ja) 電子撮像装置、電子撮像装置の制御方法及び画像処理装置
JP2007020092A (ja) 画像表示装置、画像表示方法および画像表示システム
JP2008252331A (ja) デジタル監視システム
JP5877329B2 (ja) 撮像装置および画像処理装置
JP2005073218A (ja) 画像処理装置
KR101280443B1 (ko) 영역 영상을 처리하는 장치 및 그 제어방법
US20230129908A1 (en) Method and system for transmitting a video stream
JP2005328333A (ja) 監視システム
KR102009988B1 (ko) 초광각 카메라를 이용한 렌즈 왜곡 영상 보정 카메라 시스템의 영상 보정 방법 및 그가 적용된 tvi 장치
WO2005112461A1 (fr) Dispositif de création d’image et méthode d’affichage d’image créée
JP2019032448A (ja) 制御装置、制御方法、及びプログラム
CN111078085B (zh) 信息处理设备、信息处理设备的控制方法及存储介质
JP2003324728A (ja) 撮影装置
JP2006238124A (ja) リモートカメラ
JP2006109359A (ja) 撮像装置

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS KE KG KM KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DPEN Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed from 20040101)
NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Country of ref document: DE

122 Ep: pct application non-entry in european phase