WO2005112461A1

WO2005112461A1 - Image creating device and created image displaying method

Info

Publication number: WO2005112461A1
Application number: PCT/JP2005/008753
Authority: WO
Inventors: Mitsue Ito; Wataru Ito
Original assignee: Hitachi Kokusai Electric Inc.
Priority date: 2004-05-14
Filing date: 2005-05-13
Publication date: 2005-11-24

Abstract

An image system for monitoring an area to be imaged effectively. In a monitor (1), an imaging unit (11) captures an image of the area to be monitored, a communication unit (16) transmits the captured image to a terminal, a monitoring terminal (2) receives the images, and an enlarged image display unit displays at least two enlarged images included in the received image on one screen. The monitor (1) transmits an image coded by a standard image encoding unit (13) to the monitoring terminal (2) if the monitor (1) receives no request signal from the monitoring terminal (2) and transmits an image coded by a high-definition image encoding unit (14) to the monitoring terminal (2) if the monitor (1) receives a request signal. Further the monitor (1) outputs information on abnormality. If the monitor (1) receives a request signal from the monitoring terminal (2) in response to the information, the monitor (1) transmits an image coded by the high-definition encoding unit (14) to the monitoring terminal (2).

Description

Specification

Image generating apparatus and method of displaying generated image

Import by reference

[0001] This application claims the priority of Japanese Patent Application No. 2004-144517 filed on May 14, 2004 and Japanese Patent Application No. 2004-208875 filed on July 15, 2004. , Incorporated herein by reference.

Technical field

The present invention relates to a system for capturing an image of a region to be imaged (imaging target region) and an image display method in a terminal device thereof, and more particularly, to effectively monitoring an imaged region. -Related image system and image display method in a terminal device thereof

[0003] For example, surveillance devices that use imaging devices such as CCD (Charge Coupled Device) and CMOS (Complementary Metal-Oxide Semiconductor)! / ! / Puru.

In manned surveillance in a surveillance system using such a surveillance device, an observer (operator, user, etc.) detects the detection of abnormalities such as a suspicious person, an intruder, an object, or a fire entering the monitored area. This is performed while viewing the image displayed on the monitor. In such manned surveillance, there is a difference in the monitoring ability depending on the level of skill and health condition of the observer, and in some cases, the observer may overlook an abnormality such as a suspicious person.

Therefore, the conventional manned surveillance system has a function to automatically detect abnormalities such as suspicious persons and obtain predetermined notifications and alarms based on the image input from the image input unit such as a camera. Many additional systems have been proposed.

As an example, the system compares an input image obtained by a camera with a previously created reference background image, that is, an image in which an object to be detected is not reflected, and obtains a difference in luminance value for each pixel, thereby obtaining an input image. A region in which the luminance value is changed is detected. By determining the position change of the detected change area for each processing frame, the system Detect abnormalities such as suspicious persons in the target area. The process of detecting an area where the luminance value in the input image is changing in this way is generally called a difference method, and is more widely used than before.

[0004] Further, in such a monitoring system, when a malfunction of a suspicious person or the like is detected, a function of operating a zoom lens or a pan head (electric swivel base) of the camera and the type of the suspicious person's face are provided. Function (here, called the first function) and function to get high quality (high definition) image from the camera (here, called the second function) It is considered that

The first function is, for example, a function capable of detecting the movement of a target object using template matching and controlling a camera platform according to the movement of the target object. The second function is, for example, to detect a change in the input image, to obtain a high-quality still image when a change is detected, and to obtain a low-quality moving image when no change is detected. This is a function that can be performed.

Patent Document 1: Japanese Patent Application Laid-Open No. 2000-105835

Patent Document 2: Japanese Patent Application Laid-Open No. 2000-175177

Patent Document 3: JP 2001-60263 A

Patent Document 4: JP 2003-219402 A

Disclosure of the invention

Problems to be solved by the invention

[0006] However, in a conventional monitoring system, for example, in a method of operating a camera zoom lens or a camera platform when an abnormality such as a suspicious person is detected, only a partial area of the monitoring target area is used. There was a problem that the area could not be monitored and other areas would be blind spots. In addition, when monitoring a plurality of locations by zooming in, the conventional method requires a plurality of operations of a camera zoom lens and a camera platform to be repeated a number of times, which makes the operation extremely complicated and increases the number of targets. The problem is that it is not possible to confirm at the same time.

The present invention has been made in view of such conventional circumstances, and provides an image display method in a terminal device of an image system capable of effectively monitoring an area to be imaged. The purpose is to do.

More specifically, in the present invention, for example, an image at a position designated by an operator with respect to two or more imaging target objects related to an abnormality such as a suspicious person without operating a zoom lens or a camera platform of a camera. Can be displayed in an enlarged scale.

Means for solving the problem

[0008] In order to achieve the above object, in an image display method in a terminal device according to the present invention, an image generation device that captures an image of an area to be captured, and a terminal that displays an image captured by the image generation device The following processing is performed in the terminal device of the image system having the device.

That is, the terminal device receives an image transmitted from the image generation device, and displays an image of two or more portions included in the received image in an enlarged manner on the same screen.

As one configuration example, an image system according to the present invention includes an image generation device that captures an image of a region to be monitored (a monitoring target region), and a terminal device that displays an image captured by the image generation device. The following processing is performed.

That is, in the image generating device, the image capturing unit captures an image of the area to be monitored, and the image transmitting unit transmits the image captured by the image capturing unit to the monitoring terminal device. Receives the image transmitted from the image generating device, and the enlarged image display unit enlarges and displays the images of two or more portions included in the image received by the image receiving unit on the same screen.

Therefore, the image of the two or more portions included in the image captured by the image generation device is enlarged and displayed on the same screen on the terminal device, so that the area to be monitored can be effectively monitored. it can. For example, it is possible for an observer to enlarge and display an image at a position specified by an operator on two or more monitored objects related to an abnormality, such as a suspicious person, without operating a camera zoom lens or pan head. Make it possible.

Here, for example, the image generation device and the terminal device may be configured separately and connected by a wired or wireless line, or may be configured integrally.

Various regions may be used as the region to be imaged. The image capturing unit can be configured using, for example, a camera.

Various images may be used, for example, a still image may be used, or a moving image may be used.

Further, as the number of images of a portion to be enlarged and displayed by the enlarged image display unit, two or more various numbers may be used.

In addition, various modes may be used as a mode in which the images of two or more portions are enlarged and displayed on the same screen by the enlarged image display unit.

[0010] In the image display method in the terminal device according to the present invention, the following processing is performed as an example of the aspect.

That is, the terminal device displays frames indicating each of the two or more portions included in the received image, and enlarges and displays the images of the portions indicated by the displayed frames on different frames. The correspondence between the displayed frames and the respective frames is displayed.

As one configuration example, the image system according to the present invention has the following configuration. That is, in the terminal device, the image partial frame display unit displays frames indicating each of two or more portions included in the image received by the image receiving unit. Also, in the terminal device, the enlarged image display unit enlarges and displays the images of the parts indicated by the respective frames displayed by the image partial frame display unit in different frames. Further, in the monitoring terminal device, the image part correspondence display unit (visually) displays the correspondence between each frame displayed by the image part frame display unit and each frame described above.

Therefore, since the correspondence between the frame indicating each part and the frame displaying the image of each part is visually displayed, the person who performs monitoring, etc. It is easy to visually grasp the correspondence between the image and the image of each part, and the efficiency of the monitoring operation can be improved.

[0011] Here, regarding the images of two or more parts, various forms may be used as the shape and size of each part and the shape and size of the frame indicating each part. .

In addition, frames indicating each of two or more portions included in a certain image are displayed in, for example, an image showing the whole or a part of the image. In addition, various modes may be used to display the correspondence between each frame and each frame (visually) .For example, a mode using characters or colors may be used. Specifically, it is possible to use a mode in which the same characters and the same color are added to the corresponding frames and frames.

In the image display method in the terminal device according to the present invention, the following processing is performed as an example of the aspect.

That is, the terminal device displays a frame indicating each of the two or more portions included in the received image, and enlarges and displays the image of the portion indicated by each of the displayed frames into a different frame. Then, the designation of the image portion by each of the displayed frames is released according to the operation by the user.

As one configuration example, the image system according to the present invention has the following configuration. That is, in the terminal device, the image partial frame display unit displays frames indicating each of two or more parts included in the image received by the image receiving unit. In the terminal device, the enlarged image display unit enlarges and displays the images of the parts indicated by the respective frames displayed by the image partial frame display unit in different frames. Further, in the terminal device, the image partial frame designation canceling unit cancels the designation of the image portion by each frame displayed by the image partial frame display unit in response to an operation by the user.

Therefore, even if the number of frames for designating the image part to be enlarged and displayed is limited, such as three or four, the user cancels the designation of the image part with an arbitrary frame and cancels the cancellation. It is possible to specify another image portion using the frame, whereby the user can freely change the specified image portion and perform effective monitoring.

Here, as the operation by the user, for example, various operations such as a keyboard and a mouse may be used. As an example, a mode is used in which various buttons are displayed on the screen, and the user specifies each button by operating the keyboard or mouse and clicking each button on the screen. be able to.

When an image portion is specified by each of a plurality of frames, for example, an operation for individually canceling the specification of the image portion by each frame may be provided, or the image portion may be specified by all the frames. Operation may be provided at once, or Both of these operations may be provided.

That is, the terminal device initially sets the position of the image to be enlarged and displayed, moves the position of the set image, and sets the magnification of the image to be enlarged and displayed. Then, the terminal device enlarges and displays the image at the position determined by the initial setting and movement of the position of the image to be enlarged and displayed at the set magnification ratio.

As one configuration example, the image system according to the present invention has the following configuration. That is, the terminal device includes an image part position initial setting unit, an image part position moving unit, and an image part enlargement ratio setting unit. The image part position initial setting unit initially sets the position of the image to be enlarged and displayed by the enlarged image display unit. The image part position moving unit moves the position of the image set by the image part position initial setting unit. The image partial enlargement ratio setting unit sets an enlargement ratio of an image to be enlarged and displayed by the enlarged image display unit.

Further, in the monitoring terminal device, the enlarged image display unit displays the image at the position determined by the image part position initial setting unit and the image part position moving unit at the enlargement ratio set by the image part enlargement ratio setting unit. Enlarge and display.

Therefore, the image system according to the present invention can be used to initially set the positions of the images of two or more parts, to move the positions of the initially set images, It is possible to set the magnification of the image of each part initially or by changing it. Thus, the image system according to the present invention can perform effective monitoring with various settings.

Here, the setting by the image part position initial setting unit, the movement by the image part position moving unit, and the setting by the image part enlargement ratio setting unit may be performed, for example, in response to an operation by a person. Alternatively, it may be performed automatically based on predetermined conditions preset in a monitoring device or a monitoring terminal device.

The setting by the image part position initial setting unit, the movement by the image part position moving unit, and the setting by the image part enlargement ratio setting unit include, for example, May be performed individually for each of the images, or may be performed collectively for all or some of the images!

That is, the terminal device receives images of a plurality of types of image quality transmitted from the monitoring device, and designates two or more portions of the images of the plurality of types of image quality by using an image of any image quality. Accepts and enlarges and displays the specified two or more part images using images of the same quality or images of different quality.

As one configuration example, the image system according to the present invention has the following configuration. That is, the image capturing unit of the image device captures images of a plurality of types of image quality. In addition, the enlarged image display unit of the terminal device receives designation of two or more portions by using an image of one of the image qualities of the plurality of types of image qualities, and receives an image of the same image qualities or the same. The images of the two or more parts specified above are enlarged and displayed using images of different qualities.

Therefore, the image system according to the present invention can specify an image portion or display an enlarged image portion using one or more images of a plurality of types of image quality. In order to specify the image part by referring to an image of valid image quality, or to add an image of valid image quality to magnify the image part, it is possible to enlarge the image part. It can be set to take place, which allows for effective monitoring.

[0017] Here, as the image having the image quality used for accepting the designation of the image portion and the image having the image quality used for enlarging and displaying the image portion, images having various image qualities may be used. For example, images with the same image quality may be used, or images with different image quality may be used. For example, when a relatively low-quality image and a high-quality image are obtained, an aspect in which both of the image portion designation and the enlarged display of the image portion are performed using one of the image qualities is performed. Alternatively, it is possible to use a mode in which the image portion is designated using one of the image qualities and the designated image portion is enlarged and displayed using the other image qualities. . The designation of the image portion may be received, for example, in response to an operation by a user, or may be (automatically) received in response to a processing result by an image processing function or a detection result by various detection functions. You can.

Hereinafter, various configuration examples regarding the image system will be described.

As an example of the configuration, the image system includes an image generation device that captures an image of a region to be monitored (a monitoring target region), and a monitoring terminal device that displays an image captured by the image generation device. In this way, the image generation device transmits an image to the image generation terminal device in response to the request signal of the terminal device power.

That is, in the image generation device, the image capturing unit captures an image of the area to be monitored. The request signal receiving unit receives a request signal transmitted from the terminal device. In a state where the request signal is not received by the request signal receiving unit (that is, in a state where the request signal is not received), the first image transmitting unit transmits an image of the first image quality, which is an image captured by the image capturing unit. Transmit to the terminal device. When the request signal is received by the request signal receiving unit, the second image transmitting unit transmits the second image, which is an image captured by the image capturing unit and has a higher image quality than the first image quality. Send to terminal.

In the terminal device, the image receiving unit receives an image transmitted from the monitoring device. The image display unit displays the image received by the image receiving unit. The request signal transmission instruction receiving unit receives an instruction to transmit a request signal from the user. Request signal transmitting unit Outputs a request signal to the image generating apparatus when an instruction to transmit the request signal is received by the request signal transmission instruction receiving unit.

Therefore, the terminal device also receives an instruction to transmit a request signal from the user. In the absence of the instruction, a first image of relatively low image quality is transmitted to the monitoring device and displayed, and in the absence of the instruction, the image of relatively high image quality is displayed. The image of the second image quality is transmitted to the monitoring device and the monitoring terminal device and displayed. Thereby, the system according to the present invention can effectively monitor the area to be monitored. Also, for example, by transmitting a high quality second quality image only when there is a request signal to the terminal device image generation device, the data amount of the image to be transmitted is reduced. It is possible to

[0020] Here, various signals may be used as the request signal.

Various modes may be used to discriminate the state in which the request signal is not received from the state in which the request signal is received. Various timings may be used as the timing for shifting to the received state and the timing for shifting from the state where the request signal is received to the state where the request signal is not received.

Further, as the image of the first image quality and the image of the second image quality, images of various image qualities may be used. The image of the first image quality has lower image quality than the image of the second image quality, and the image of the second image quality has higher image quality than the image of the first image quality.

Further, as the first image quality image and the second image quality image, for example, an image having the same image quality as the image captured by the image capturing unit may be used, or An image obtained by converting the image quality of the image captured by the image capturing unit may be used. Further, as the image of the first image quality and the image of the second image quality, for example, an image captured by the image capturing unit may be used as it is, or an image captured by the image capturing unit may be used. For example, an image on which a process such as encoding is performed may be used.

Further, for example, in addition to the image of the first image quality and the image of the second image quality, an image of a different image quality may be captured, image processed, transmitted / received, displayed, or the like. The image processing using the image may be performed.

In addition, as a method of receiving an instruction, information, or the like, the user's power can be configured using, for example, a keyboard or a mouse operated by the user.

[0022] As one configuration example, the following configuration is adopted.

That is, in the monitoring device, the abnormality detection unit detects the abnormality based on the image captured by the image capturing unit. The abnormal image storage unit stores the image of the second image quality and information related to the abnormality detected by the abnormality detection unit in association with each other.

The second image transmission unit of the monitoring device transmits information on the abnormality detected by the abnormality detection unit to the monitoring terminal device.

The image receiving unit of the monitoring terminal device receives the information regarding the abnormality transmitted from the monitoring device. I believe.

In the monitoring terminal device, the abnormality information storage unit stores information on the abnormality received by the image receiving unit. The abnormality information output unit outputs information on the abnormality stored in the abnormality information storage unit.

The request signal transmission instruction receiving unit of the monitoring terminal device receives, from a user's hand, the designation of information regarding the abnormality.

The request signal transmitting unit of the monitoring terminal device transmits to the monitoring device a request signal including information on the abnormality whose specification has been received by the request signal transmission instruction receiving unit.

The second image transmission unit of the monitoring device reads out the second image quality image associated with the abnormality information included in the request signal received by the request signal reception unit from the abnormal image storage unit, and Send to

[0023] Therefore, the monitoring device notifies the monitoring terminal device of the information on the detected abnormality with respect to the image, and the monitoring terminal device outputs the information on the abnormality and accepts the designation by the user. The corresponding image of the second image quality is transmitted from the monitoring device to the monitoring terminal device and displayed. Thereby, the configuration example according to the present invention can effectively monitor the area to be monitored. Also, for example, only when there is a request signal from the monitoring terminal device to the monitoring device, the monitoring device transmits the corresponding high-quality second quality image to the monitoring terminal device, so that the transmission is performed. It is possible to reduce the data amount of the image to be processed.

Here, as an image to be referred to for detecting an abnormality by the abnormality detection unit, for example, an image of the first image quality may be used, or an image of the second image quality may be used. Images of other qualities may be used, or images of two or more different qualities may be used.

In addition, various methods may be used as a method of detecting an abnormality by the abnormality detection unit. For example, a method of performing image processing by a difference method or the like to detect an abnormality or a method of detecting an abnormality by various sensors may be used. For example, a method of detecting an abnormality based on the abnormality can be used. Also, various information may be used as the information regarding the abnormality. Information that uniquely identifies these abnormalities, or additional information that does not uniquely identify them, can be used.Specific examples include information that identifies the time when the abnormality was detected and information that identifies the abnormality. For example, information for specifying a position (image portion) in the image can be used.

In addition, various modes may be used as the mode for outputting the information related to the abnormality.For example, a mode in which information is displayed on a screen or a mode in which information is printed out on paper may be used. Can be.

In addition, as a method for storing images and information, for example, it can be configured using a storage device such as a memory.

[0025] As one configuration example, the following configuration is adopted.

That is, the image display unit of the terminal device enlarges and displays an area for displaying the image of the first image quality, an area for displaying the image of the second image quality, and a part of the image of the second image quality. The image is displayed on a screen having an area on the same screen.

Therefore, by displaying an image of the first image quality, an image of the second image quality, and a partially enlarged image of the image of the second image quality on the same screen, the area to be monitored can be effectively set. Can be monitored. For example, even when an abnormality is detected, it is possible to view the entire area to be monitored by using the image of the first image quality or the image of the second image quality. It is possible to see in detail the image part where the abnormality is detected by enlarging the image part in the image of the image quality.

Here, the area for displaying the image of the first image quality, the area for displaying the image of the second image quality, and the area for enlarging and displaying the image portion in the image of the second image quality are variously different. Various regions may be used, for example, the size and number of each region may be used.

Various modes can be used to display the image of the second image quality.For example, the image of the second image quality can be displayed as it is, or the image of the second image quality can be thinned out (size Can be displayed).

As one configuration example, the image capturing unit of the image generating device has a function of capturing an image of a first image quality and a function of capturing an image of a second image quality. As one configuration example, the image capturing section of the image generating apparatus captures a moving image of the first image quality in a state where the request signal is not received by the request signal receiving section, and the request signal is received by the request signal receiving section. In this state, a still image of the second image quality is captured.

As one configuration example, the first image transmission unit of the image generation device transmits a moving image of the first image quality to the monitoring terminal device in real time.

As one configuration example, the second image transmission unit of the image generation device transmits a still image of the second image quality to the terminal device at least for an image portion in which an abnormality is detected by the abnormality detection unit.

[0027] As one configuration example, the image capturing unit of the image generating device captures an image of the second image quality when the abnormality is detected by the abnormality detection unit.

As one configuration example, the second image transmission unit of the image generation device transmits an image of the second image quality only to the image part in which the abnormality is detected by the abnormality detection unit to the monitoring terminal device.

As an example of the configuration, the second image transmitting unit of the image generating apparatus compresses the image part in which the abnormality is detected by the abnormality detection unit at a low compression rate and compresses the other image parts at a high compression rate. The transmitted image is transmitted to the monitoring terminal device as an image of the second image quality.

As one configuration example, in the monitoring device, when the request signal is received by the request signal receiving unit in a state where the request signal is not received by the request signal receiving unit, the request signal receiving unit receives one frame of the image. As a result, the request signal is received, and then the request signal receiving unit returns to a state in which the request signal is not received.

[0028] As one configuration example, the image capturing unit of the image generating device has a function of capturing both an image of the first image quality and an image of the second image quality simultaneously.

As an example of the configuration, the first image transmission unit of the image generation device transmits an image of the first quality captured by the image capturing unit to the terminal device even in a state where the request signal is received by the request signal reception unit. Send to.

As an example of the configuration, the image of the first image quality and the image of the second image quality One or more aspects such as the number of tones per element, the compression ratio, and the encoding method are different.

As an example of the configuration, the image capturing unit of the image generating device always captures an image of the second image quality, for example. The first image transmitting unit of the monitoring device converts the image of the second image quality captured by the image capturing unit into an image of the first image quality and transmits the image to the terminal device.

[0029] As one configuration example, the second image transmission unit of the monitoring device transmits, to the monitoring terminal device, information regarding an abnormality detected by the abnormality detection unit with respect to the image together with the image of the second image quality. . The image receiving unit of the monitoring terminal device receives the image transmitted from the monitoring device and the information regarding the abnormality detected with respect to the image.

As an example of the configuration, the abnormality information output unit of the monitoring terminal device displays information on the abnormality stored in the abnormality information storage unit in a list, for example, in a list.

As one configuration example, information for identifying an image portion in which an abnormality is detected in an image is used as the information about the abnormality, and the image display unit of the monitoring terminal device displays the second image quality based on the information about the abnormality. The image part where the abnormality is detected in the image of is enlarged and displayed.

As an example of the configuration, the terminal device receives an instruction to specify an image portion to be enlarged and displayed with respect to the image of the second image quality displayed by the image display unit. The image display unit of the terminal device enlarges and displays the image part specified by the instruction received by the enlarged display image part specification instruction receiving unit.

The invention's effect

As described above, according to the image display method in the terminal device of the image system according to the present invention, the image generation device captures an image of the area to be monitored, transmits the image to the terminal device, The terminal device receives the image transmitted from the image generation device and enlarges and displays the images of two or more parts included in the received image on the same screen. Can be monitored effectively. For example, one configuration example according to the present invention enlarges an image at a position designated by an operator with respect to two or more monitored objects related to an abnormality such as a suspicious person without operating a zoom lens or a camera platform of a camera. It can be displayed. According to the image display method in the terminal device of the image system according to the present invention, the terminal device displays frames indicating each of two or more portions included in the received image, and displays the portions indicated by the respective frames. The images were enlarged and displayed in different frames, and the correspondence between each frame and each frame was visually displayed. As a result, for example, a person who performs monitoring can easily grasp the correspondence between each part and the image of each part easily, thereby improving the efficiency of the monitoring work. it can.

According to the image display method in the terminal device of the image system according to the present invention, the terminal device displays frames indicating each of two or more portions included in the received image, and displays the portions indicated by the respective frames. The image is enlarged and displayed in different frames, and the designation of the image part by each frame is released according to the operation by the user.For example, the user can freely change the image part designated by each frame. Thus, effective monitoring can be performed.

Further, according to the image display method in the terminal device of the image system according to the present invention, the terminal device can initially set the position of the image to be enlarged and displayed, move the set image position, It is possible to set an enlargement ratio of an image to be enlarged and displayed. Initially, an image at a position determined by the movement or is enlarged and displayed at the set enlargement ratio. Thereby, the image system according to the present invention can perform effective monitoring with various settings, for example.

Further, according to the image display method in the terminal device of the image system according to the present invention, the image generating device captures an image of a plurality of types of image quality, and the terminal device selects one of the images of the plurality of types of image quality. The specification of two or more parts is accepted using the image of the image quality, and the image of the specified two or more parts is enlarged and displayed using the image of the same image quality or the image of the different image quality. did. Accordingly, the image system according to the present invention can be used, for example, for setting so that an image having an effective image quality is specified to specify an image portion and specifying the image portion, and for enlarging and displaying the image portion. It is possible to set so that an image of effective image quality is processed and the image portion is enlarged and displayed, whereby effective monitoring can be performed. BEST MODE FOR CARRYING OUT THE INVENTION

An embodiment according to the present invention will be described with reference to the drawings.

In the present embodiment, first, the monitoring system according to the first example and the monitoring system according to the second example will be described, and then the processing related to the enlarged display performed in these monitoring systems will be described.

A monitoring system according to a first example of the present invention will be described.

FIG. 1 shows a configuration example of the monitoring system of the present example.

The monitoring system of this example includes a monitoring device 1, a monitoring terminal device 2, a network 3, a line (access line) 4 connecting the monitoring device 1 and the network 3, a monitoring terminal device 2, and a network 3. (Access line) 5 that connects Here, as the network 3, various types may be used.For example, an analog telephone network, an integrated services digital network (ISDN) network, a digital private line network, the Internet, or the like may be used. Monkey

The monitoring device 1 includes, as hardware configuration examples, an imaging device 11 configured as a camera such as a television camera, a video switching unit 12 configured as a camera such as a switching switch, and a standard image encoding unit 13. A high-definition image encoding unit 14, an abnormality detection unit 15, a communication unit 16, and an imaging device control unit 17.

[0033] An example of an operation performed by the monitoring device 1 of the present example will be described.

The imaging device 11 images a region to be monitored (monitoring target region) and outputs a signal of an image (video) obtained by the imaging to the video switching unit 12.

At this time, the imaging device 11 selects one of a standard image mode for capturing a standard image and a high-definition image mode for capturing a high-definition image according to a control signal input from the imaging device control unit 17. Can be switched. In this example, an image of 640 horizontal pixels x 480 pixels high and 30 frames per second is used as a standard image, and an image of 1280 horizontal pixels x 960 pixels high and 7.5 frames per second is used as a high-resolution image, for example. Is used.

The video switching unit 12 switches an input destination of an image signal output from the imaging device 11 according to a control signal input from the video device control unit 17. In this example, when the standard image mode is set for the imaging device 11, the video switching unit 12 connects the output terminal of the imaging device 11 to the standard image. The signal path is switched so that the input terminal of the image encoding unit 13 and the input terminal of the abnormality detection unit 15 are connected. When the high-definition image mode is set in the imaging device 11, the output terminal of the imaging device 11 The signal path is switched so that the signal is connected to the input terminal of the high-definition image encoding unit 14. Accordingly, when the imaging device 11 has captured a standard image, the standard image output from the imaging device 11 is supplied to the standard image encoding unit 13 and the abnormality detection unit 15, and the imaging device 11 captures a high-definition image. In this case, the high definition image output from the imaging device 11 is supplied to the high definition image encoding unit 14.

[0035] The standard image encoding unit 13 encodes an image signal of a standard image input from the imaging device 11 via the video switching unit 12 according to a predetermined moving image encoding method, and communicates the encoded data. Output to section 16. Here, as the moving picture coding method, various methods may be used. For example, MPEG-1, MPEG-2, MPEG-4, motion JPEG, etc. can be used. The abnormality detection unit 15 processes the image signal of the standard image input from the imaging device 11 via the video switching unit 12 by, for example, a difference method, and detects an abnormality such as a suspicious person in the monitoring target area.

Here, an example of processing using the difference method will be described with reference to FIGS. 2 and 3.

FIG. 2 shows an example of a process in which the abnormality detection unit 15 detects a region of a standard image sequentially input from the imaging device 11 in which the luminance value has changed by the difference method.

First, a difference between two images, a standard image (input image) 21 sequentially input from the imaging device 11 and an image (reference background image) 22 prepared in advance that does not include a target object to be detected, is shown. The device 31 calculates the difference between the luminance values for each pixel, and obtains the difference image 23. Next, the binarizer 32 to which the difference image 23 has been input performs threshold processing on each pixel of the difference image 23 at a predetermined threshold th, and performs processing on pixels whose value (difference value) is smaller than the threshold th. The pixel value is set to “0” value, and the pixel value of the pixel whose value (difference value) is equal to or more than the threshold th is set to “255”, and the process of acquiring the binary image 24 is performed. Note that the threshold th is determined experimentally, for example, and th = 20 is set as an example. In this example, the pixel value of one pixel is calculated with 8 bits, and one pixel has a value from “0” to “255”.

In the example of FIG. 2, in the binary image 24, the human-shaped object 41 reflected in the input image 21 is calculated as an area 42 where the difference is generated by the differentiator 31 (an area where the luminance of the input image 21 changes). Sa This is detected by the binarizer 32 as an image portion 43 having a pixel value of “255”.

FIG. 3 shows an example of a procedure of a process performed by a monitoring method to which the difference method is applied.

First, external devices, variables, image memory, etc. are initialized as initialization processing for executing the monitoring method by the difference method (Step Sl). Next, the abnormality detection unit 15 inputs the standard image from the imaging device 11 (step S2), and calculates the difference between the luminance value of each pixel between the input image 21 and the previously created reference background image 22. The difference image 23 is obtained by calculation (step S3), and the pixel value of the pixel whose difference image 23 has a pixel value (difference value) less than a predetermined threshold th is set to “0”, and The pixel value is set to "255" to obtain the binary image 24 (step S4). Next, the abnormality detecting section 15 detects a cluster of pixels having a pixel value of “255” (the image section 43 serving as a change area) in the obtained binary image 24 and assigns a number to each of them. So that they can be distinguished (by labeling) (step S5). Next, the abnormality detecting unit 15 determines, for each of the numbered change regions, the respective change regions based on predetermined detection conditions regarding the size, area, speed, detection position, and the like. It is determined whether or not they match (step S6). If the detection conditions are met, it is considered that there is an object to be detected. If they do not match the detection conditions, it is considered that there is no object to be detected. If it is determined that there is an object to be detected, an alarm or a display of detection information is performed by the abnormality detection unit 15 or another processing unit. Using one or more of a monitoring monitor, a warning light, a warning buzzer, etc., a visual, auditory, olfactory, tactile, or taste stimulus is conveyed to the observer (step S7). Thereafter, or when it is determined that there is no object to be detected, the processes after the image input process are repeated (steps S2 to S7).

In the present example, when it is determined that an object to be detected exists by a difference method or the like, the abnormality detection unit 15 detects that as an abnormality such as a suspicious person.

When detecting an abnormality, the abnormality detection unit 15 transmits (outputs) a request signal for acquiring a high-definition image to the imaging device control unit 17 and outputs an abnormality such as a detected suspicious person. In order to notify the monitoring terminal device 2 of the presence of an error, information on the location where an abnormality such as a suspicious person exists, information on the detection time, information on the number related to the detection, etc. Transmits (outputs) the abnormality detection result to the communication unit 16. Further, the abnormality detection unit 15 transmits (outputs) information specifying an image range in which an abnormality such as a suspicious person detected exists to the high-definition image encoding unit 14.

Here, the image range in which an abnormality such as a suspicious person exists is calculated based on, for example, the image portion 43 which is a changing region in the binary image 24 shown in FIG. Specifically, first, a process of calculating a circumscribed rectangle 44 of the change area is performed on the image section 43 serving as the change area. Next, a process of acquiring an image range 45 in which the upper, lower, left, and right sides of the circumscribed rectangle 44 are expanded by a predetermined number of pixels is performed, and an image range in which an abnormality such as a suspicious person exists is calculated.

Further, as the predetermined number of pixels to be spread vertically and horizontally, for example, 30 pixels are used. The reason for expanding the predetermined number of pixels for the circumscribed rectangle 44 in this way is to include not only the image where the abnormality such as a suspicious person exists, but also the surrounding image, so that the abnormality such as the suspicious person This is to make it easier to visually understand what has been detected and what it looks like when viewed more broadly.

[0040] In this example, the configuration in which the range in which an abnormality such as a suspicious person exists is determined based on the detection result of the process by the difference method, but other various configurations may be used. .

As an example, based on the input of external sensors such as a magnetic sensor, an infrared sensor, a pressure sensor, a heat sensor, and a vibration sensor installed in the monitoring target area, detection by the external sensor on the image By specifying a range, the detection range can be determined as a range in which an abnormality such as a suspicious person exists. In this case, the abnormality detection unit 15 transmits (outputs) a request signal for acquiring a high-definition image to the imaging device control unit 17 when an abnormality is detected based on an input from an external sensor. Information on the location where the suspicious individual or the like exists, the information on the time when the suspicious individual or the like exists, and the number of the detection. Transmitting (outputting) the detection result of the abnormality together with the information of the abnormality to the communication unit 16 and specifying the image range in which the abnormality such as a suspicious person detected by the high-definition image encoding unit 14 exists. It transmits (outputs) information.

[0041] The high-definition image encoding unit 14 receives the high-definition image input from the imaging device 11 via the video switching unit 12. The image signal of the fine image is encoded by a predetermined still image encoding method, and the encoded data is output to the communication unit 16. Here, as the still image encoding method, various methods may be used, for example, JPEG, JPEG2000, etc. may be used. It is also possible to cut out a partial image in an image range in which an abnormality such as a suspicious person exists and to encode only the partial image and output the partial image to the communication unit 16. Here, in this example, the image range notified from the abnormality detection unit 15 is used as the image range. When a plurality of image ranges in which an abnormality such as a suspicious person exists are detected and notified by the abnormality detection unit 15, the high-definition image encoding unit 14 sets a plurality of image ranges corresponding to each of the plurality of image ranges. It is also possible to cut out these partial images, encode these multiple partial images, and output them to the communication unit 16.

Further, the high-definition image encoding unit 14 records the information of the detection result of the abnormality input from the abnormality detecting unit 15 in the header area of the encoded data and outputs the information to the communication unit 16.

Here, when JPEG is used as the encoding method, information according to Exif which is a recording standard of the JPEG header area can be used as information to be recorded in the header area. In addition, when JPEG2000 is used as the encoding system, for example, by using the ROI (Region Of Interest) function of JPEG2000, a range in which an abnormality such as a suspicious person exists is compressed at a low compression ratio, and the other range is compressed. By compressing at a compression rate, the data amount of a high-definition image can be efficiently reduced.

It is also possible to adopt a configuration in which the compression ratio at the time of encoding is changed based on the size of the change region detected as abnormal. In this case, for example, when the change region is large, the compression ratio is changed. The compression ratio is increased when the change area is small. When the change area is large, detailed information is often not needed to see the entire change area. It is considered that there are many.

The communication unit 16 is connected to the network 3 via the access line 4, and can communicate with the monitoring terminal device 2 via these and the access line 5. The communication unit 16 outputs moving image encoded data output from the standard image encoding unit 13, still image encoded data output from the high-definition image encoding unit 14, and output from the abnormality detection unit 15. Inputs information (detection result data) on the detection results of abnormalities such as suspicious persons, and sends these data to the monitoring terminal device 2 via the access line 4 to the network 3 for output.

Further, in this example, a request signal for obtaining a high-definition image is transmitted from the monitoring terminal device 2 to the network 3 via the access line 5 to the monitoring device 1. The communication unit 16 receives and inputs the request signal from the network 3 via the access line 4, and transmits (outputs) the received and input request signal to the imaging device control unit 17.

When the request signal for acquiring the high-definition image is input from the abnormality detection unit 15 or when the request signal for obtaining the high-definition image is input from the monitoring terminal device 2 via the communication unit 16, The imaging device 11 is controlled by a control signal to set a high-definition image mode for capturing a high-definition image, and the video switching unit 12 is controlled by a control signal to switch to the high-definition image encoding unit 14. Accordingly, when the abnormality detection unit 15 detects an abnormality such as a suspicious person in the input image or receives a request signal for acquiring a high-definition image from the monitoring terminal device 2, the imaging device 11 A high-definition image can be picked up and output to the high-definition image encoding unit 14.

In other cases, the imaging device controller 17 controls the imaging device 11 with a control signal to set a standard image mode for capturing a standard image, and controls the video switching unit 12 with a control signal. Switch to the standard image encoding unit 13 and abnormality detection unit 15 side.

Next, an example of processing performed in the monitoring terminal device 2 on the client terminal side will be described.

The monitoring terminal device 2 is configured using, for example, a personal computer (PC), and performs processing for displaying an input image captured and transmitted by the imaging device 11 of the monitoring device 1 and the monitoring terminal device. Performs processing corresponding to the operations performed by the observer (operator) who operates 2.

FIG. 4 shows an example of the display of the operation screen 51 of the monitoring terminal device 2.

The operation screen 51 in this example includes a standard image display section 61, a high-definition image display section 62, one or more (three in this example) high-definition image display sections 63, 64, 65, and a shirt screen. Button 71 and It has large display selection buttons 72, 73, 74, four enlarged display position move buttons 75, 76, 77, 78 corresponding to up, down, left and right, and an enlargement ratio change button 79! The various buttons 71 to 79 can be operated by the observer.

The standard image display section 61 displays an image in which encoded data of a standard image obtained from the monitoring device 1 via the network 3 is reproduced (decoded). In this example, the standard image display section 6

In 1, a moving image of a standard image is displayed.

The high-definition image display unit 62 displays an image obtained by reproducing (decoding) the encoded data of the high-definition image obtained from the monitoring device 1 via the network 3 by, for example, thinning out image pixels to reduce the size. ,indicate. In this example, the high-definition image display unit 62 displays a reduced still image of the high-definition image.

In this example, the imaging region of the standard image transmitted from the monitoring device 1 to the monitoring terminal device 2 and the imaging region of the high-definition image are the same, and the standard image display on the operation screen 51 of the monitoring terminal device 2 is performed. The target area of the standard image displayed on the section 61 and the target area of the high definition image displayed on the high definition image display section 62 are the same.

Each of the high-definition image enlarged display sections 63 to 65 enlarges a partial image of an image obtained by reproducing (decoding) encoded data of a high-definition image obtained from the monitoring device 1 via the network 3. To display.

Here, the position in the image of the partial image to be enlarged and displayed on the high-definition image enlarged display sections 63 to 65 is, for example, displayed on the high-definition image display section 62 using a pointing device such as a PC mouse or a joystick. It is possible to specify by specifying the position. The partial image of the high-definition image corresponding to the designated position is displayed on the high-definition image enlarged display units 63 to 65. In the example of FIG. 4, three display frames 82, 83, and 84 are shown on the high-definition image display unit 62, and the partial images inside the respective display frames 82, 83, and 84 are displayed at the respective heights. These are displayed on the magnified image display sections 63, 64 and 65.

In this example, the high-definition image display unit 62 displays the reduced high-definition image in a high-resolution image. The high-definition image has a higher original pixel density than the standard image. Even when displayed on the enlarged display sections 63 to 65, it is possible to display a finer image than the standard image. In this example, a plurality of high-definition image enlarged display sections 63, 64, and 65 are provided. The same number of enlarged display selection buttons 72, 73, 74 are provided corresponding to the respective high-definition image enlarged display sections 63, 64, 65. Then, after the operator or the like operates one of the enlarged display selection buttons 72, 73, and 74 to select the high-resolution image enlarged display sections 63, 64, and 65, the high-resolution image to be enlarged and displayed there is selected. Make sure to specify the location.

In this example, the position of the high-definition image to be enlarged and displayed (the position of each of the display frames 82, 83, and 84) can be finely adjusted in the up, down, left, and right directions by operating the enlarged display position move buttons 75 to 78. It is possible to adjust.

In this example, the enlargement ratio of the high-definition image to be enlarged and displayed can be changed by operating the enlargement ratio change button 79.

In this example, the correspondence between the respective enlarged display selection buttons 72, 73, 74, the respective high-resolution image enlarged display sections 63, 64, 65, and the respective display frames 82, 83, 84 is operated. Identification information that can be visually grasped is displayed on the composition screen 51. Specifically, using the numbers "1", "2", and "3", Information with the same number is displayed. Note that, as such identification information, various other information such as “A”, “B”, “C”, etc. may be used! /.

[0050] The shirt button 71 is a button for transmitting a request signal for acquiring a high-definition image to the monitoring device 1. In this example, when the shirt button 71 is pressed at an arbitrary time (timing), a request signal for acquiring a high-definition image is transmitted from the monitoring terminal device 2 to the monitoring device 1, thereby acquiring a high-definition image. Processing (manual imaging processing).

Further, in this example, when the abnormality detection unit 15 of the monitoring device 1 detects an abnormality such as a suspicious person, information on the detection result of the abnormality transmitted from the monitoring device 1 via the network 3 is transmitted to the monitoring terminal device. In response to the message 2 received, a message (notification message) 81 for notifying the occurrence of the abnormality is displayed on the standard image display section 61. When such a notification message 81 is displayed, for example, a process of acquiring a high-definition image when an abnormality is detected (automatic imaging process) can be performed.

Next, FIG. 5 shows an example of an operation performed by the monitoring device 1 and the monitoring terminal device 2 during manual imaging. FIG. 5 conceptually shows an example of the operation performed by the monitoring device 1 and the monitoring terminal device 2 from time tO to time (tO + 4), conceptually in time sequence.

First, at time tO, monitoring device 1 captures a standard image. The captured standard image is subjected to moving image encoding, and image data obtained is transmitted to the monitoring terminal device 2 via the network 3 by a transmission signal 91, and the monitoring terminal device 2 displays an image 101 of the standard image on the operation screen. It is displayed on the 51 standard image display section 61.

Similarly, at time (tO + 1), monitoring device 1 captures a standard image. The captured standard image is subjected to moving image coding, and image data obtained is transmitted to the monitoring terminal device 2 via the network 3 by the transmission signal 92, and the monitoring terminal device 2 generates the image 102 of the standard image. It is displayed on the standard image display section 61 of the operation screen 51.

Next, at time (tO + 2), monitoring device 1 similarly captures a standard image. Image data obtained by moving the encoded standard image into a moving image is transmitted to the monitoring terminal device 2 via the network 3 by the transmission signal 93, and the monitoring terminal device 2 operates the image 103 of the standard image. It is displayed on the standard image display section 61 of the screen 51.

At this time, if there is a suspicious person in the monitoring target area, and if the observer presses the shirt button 71 on the operation screen 51 to enlarge the suspicious person, a high-definition image is acquired. The request signal is transmitted as the transmission signal 94 from the monitoring terminal device 2 to the monitoring device 1 via the network 3. In this case, in the monitoring device 1, the request signal reaches the imaging device control unit 17 via the communication unit 16, the high definition image mode is set accordingly, and the imaging device 11 captures a high definition image. At the same time, the high-definition image captured by the imaging device 11 by the video switching unit 12 is input to the high-definition image encoding unit 14. Then, the high-definition image input by the high-definition image encoding unit 14 is subjected to still image encoding, and the encoded image data is transmitted and output to the network 3 via the communication unit 16.

At time (tO + 3), the encoded data of the high-definition image transmitted and output from the monitoring device 1 in response to the request signal as described above is transmitted by the transmission signal 95 via the network 3 to the operation terminal device. Received at 2. The received high-definition image 104 is displayed on the high-definition image display unit 62 of the operation screen 51 in the operation terminal device 2. Obtained in this way For high-definition images, for example, by using a pointing device such as a PC joystick or mouse, any position can be freely enlarged and displayed on the high-definition image enlarged display sections 63 to 65. .

Then, at the next time (tO + 4), the mode shifts to the standard image monitoring mode again, and the monitoring apparatus 1 captures the standard image, and the captured standard image is obtained by encoding the moving image. The data is transmitted to the monitoring terminal device 2 via the network 3 by the transmission signal 96, and the image 105 of the standard image is displayed on the standard image display section 61 of the operation screen 51 in the monitoring terminal device 2.

In this example, when the monitoring device 1 receives a request signal for manual imaging from the monitoring terminal device 2, the monitoring device 1 shifts to the high-definition image mode under the control of the imaging device control unit 17. When one high-definition image of one frame is captured by the device 11, the mode shifts to the standard image mode again, and the image capturing device 11 returns to a state of capturing a standard image.

As described above, in the present example, as in the operation screen 51 shown in FIG. 5, the entire monitoring target area is always displayed as a standard image as a moving image using images with different degrees of definition, and abnormalities are detected. One or more specific locations, such as those that occurred, can be partially enlarged with high-definition images and displayed as still images, and these can be displayed simultaneously on the same screen. More specifically, on the operation screen 51, a moving image of the entire monitoring target area is always displayed in real time by the standard image display unit 61, and at the same time, a high-definition image display unit 62 displays the moving image of the entire monitoring target area at a certain point in time. The high-resolution still images are thinned out and displayed, and further, one or more partial images in the high-definition still images are electronically enlarged and displayed by the high-resolution enlarged display units 63 to 65. In this example, since the entire monitoring target area is always displayed in real time by the standard image of the standard image display unit 61, it is possible to prevent an abnormality from being overlooked. The image is clearly visible even when magnified.

Here, in the enlarged display by the high-definition image enlarged display section 63 of this example, for example, the control of devices such as a camera zoom lens and a camera platform is not performed as in the related art, and the image of the entire monitoring target area is further displayed. Is displayed on the standard image display section 61, which solves the problem of blind spots that occur when monitoring the suspicious person or other abnormalities by operating the camera's zoom lens head as in the past. Can be turned off. Further, since a partial image of a high-definition image is cut out and displayed in an enlarged manner, a plurality of partial images can be cut out so that a plurality of places can be simultaneously displayed in an enlarged manner.

Further, the monitoring terminal device 2 uses the information on the detection result of the abnormality recorded in the header area of the encoded data of the high-definition image received from the monitoring device 1 to display the high-definition image on the operation screen 51, for example. One or more image ranges in which an abnormality has been detected can be used as the initial positions of the display frames 82, 83, and 84 on the unit 62. In this case, the partially enlarged image is initially displayed on the high-definition image enlarged display sections 63 to 65 based on the detection result of the abnormality. After that, the user's observer operates the enlarged display selection buttons 72 to 74, the enlarged display position move buttons 75 to 78, and the magnification ratio change button 79 to change the image area to be partially enlarged to any desired location. Can be changed to

In this example, a configuration in which data of an image captured by the monitoring device 1 is transmitted to the monitoring terminal device 2 via the network 3 has been described. However, as another configuration example, a serial device such as USB or IEEE1394 is used. It is also possible to configure using a communication function, and a similar effect can be obtained.

Also, in this example, a configuration in which the monitoring device 1 on the camera side includes the abnormality detection unit 15 is shown. For example, a configuration in which the monitoring terminal device 2 on the client side has the function of the abnormality detection unit, It is also possible to adopt a configuration in which both the monitoring terminal device 2 and the monitoring terminal device 2 have the function of the abnormality detection unit. When the monitoring terminal device 2 is provided with the function of the abnormality detection unit, for example, a request signal generated by the function of the abnormality detection unit of the monitoring terminal device 2 may be transmitted to the monitoring device 1 via the network 3. it can.

Further, as one configuration example, it is possible to reduce the amount of image data in an area where no abnormality such as a suspicious person exists based on the detection result by the abnormality detection unit 15 of the monitoring device 1 and transmit the image data. In this configuration example, for example, when an abnormality such as a suspicious person is detected, in order to monitor the abnormality in detail, the definition, image quality, number of pixels, One or more characteristics such as the number of gradations, the compression ratio, and the encoding method are excellent. Even when transmitting a high-quality image, the data amount of the image can be reduced. It is possible to avoid things like becoming larger than the standard image. Wear.

Specifically, in this example, as an example of power monitoring in which two types of images (standard image and high-definition image) having different degrees of definition were switched and monitored, for example, without performing such switching, If an abnormality such as a suspicious person is detected, the image captured by the imaging device 11 is coded at a high compression rate and transmitted, while if an abnormality such as a suspicious person is detected, the imaging device is detected. It is also possible to perform encoding by changing the compression ratio in two or more stages according to the result of detection of the abnormality, such that the image captured by 11 is encoded and transmitted at a low compression ratio. Further, as another embodiment, the same effect can be obtained in a configuration other than the compression ratio, for example, by changing the number of gradations per pixel of an image in two or more stages and performing encoding. Can be.

Further, as another embodiment, for example, a high-definition partial image of only a specific portion is transmitted based on information on an abnormality detection result, or only a specific portion is encoded at a low compression rate. It is possible to transmit a high-definition whole image.

As an example, it is possible to transmit a high-definition partial image obtained by cutting out only a specific part of the photographing area from the monitoring device 1 to the monitoring terminal device 2 using image recognition and detection results obtained by an external sensor. is there. As another example, using a result of image recognition or detection by an external sensor, only a specific part of the photographing area is encoded at a low compression rate, and other areas are encoded at a high compression rate. It is possible to transmit the entire image obtained from the monitoring device 1 to the monitoring terminal device 2. In these configuration examples, the data amount of high-definition images transmitted from the monitoring device 1 to the monitoring terminal device 2 can be reduced.

Further, as another embodiment, when an abnormality such as a suspicious person is present, it is possible to simultaneously transmit a high-definition image with good image quality and a standard image with inferior image quality. is there.

[0059] In this example, at the stage when the imaging device 11 captures an image, the video switching unit 12 determines whether to capture a standard image or a high-definition image. The imaging device 11 always captures a high-definition image, and the signal of the high-definition image is supplied to both the standard image encoding unit 13 and the high-definition image encoding unit 14, and the standard image encoding unit 13 Downconverts the quality (definition) of the input high-definition image to standard quality It is also possible to adopt a configuration that generates a moving image of the above. In such a configuration, for example,

At any time including the time (tO + 3) shown in FIG. 5, it is possible to simultaneously output a captured image as both a still image and a moving image.

[0060] As an example of the configuration, an imaging device 11 that captures an image of a monitoring target region, an abnormality detection unit 15 that detects a region of interest in which an abnormality has occurred in the monitoring target region, and an image that is captured based on a detection result by the abnormality detection unit 15 An image processing function for processing one or more images of at least two types of image quality obtained by the device 11 (in this example, a standard image encoding unit 13 and a high-definition image encoding unit 14) is used. Accordingly, based on the detection result by the abnormality detection unit 15, the data amount of the image portion other than the attention area of the image captured by the abnormality can be reduced.

As described above, in the monitoring device 1 in the monitoring system of the present example, the imaging device 11 that captures an image of the monitoring target region, the abnormality detection unit 15 that detects the attention area related to the abnormality in the monitoring target region, An image processing unit (in this example, standard image coding) that processes at least one of images of at least two types of image quality obtained by the imaging device 11 based on the detection result by the abnormality detection unit 15 Unit 13 and high-definition image encoding unit 14), and an image output unit (in this example, communication unit 16) that outputs the image processed by the image processing unit. Is detected, and the abnormality can be monitored.

Further, in the monitoring device 1 of the present example, the abnormality detection unit 15 detects the attention region in the monitoring target region based on at least one of the images of at least two types of image quality obtained by the imaging device 11.

Further, as another embodiment, for example, a sensor for detecting the presence or absence of a predetermined change in the monitoring target area is provided, and the abnormality detecting unit 15 detects the attention in the monitoring target area based on the detection result by the sensor. A configuration for detecting an area may also be employed.

As another embodiment, for example, an image processing unit (for example, a high-definition image encoding unit 14) determines a range of an image to be processed based on a detection result of the abnormality detection unit 15 to thereby determine a code. It is possible to reduce the data amount of the image that has been shaded.

As another embodiment, for example, in an image processing unit (for example, a high-definition image encoding unit 14), based on the detection result of the abnormality detection unit 15, the definition of the image to be processed, the image quality, the number of pixels, 1 Determine at least one of the number of gradations per pixel, compression ratio, encoding method, etc. Thus, the data amount of the encoded image can be reduced.

In the monitoring terminal device 2 in the monitoring system according to the present embodiment, the display unit that inputs the content of the operation by the observer (operator) and displays the image input from the monitoring device 1 in response to the operation In this example, an operation screen 51) is provided, and based on the operation of the observer, the image input from the monitoring device 1 and its partial image are displayed on the display unit. Even without operation, it is possible to monitor abnormalities such as suspicious persons in the monitoring target area.

As another embodiment, for example, in the monitoring terminal device 2 of the present example, a display unit for displaying at least one image is provided, and at least one input from the monitoring device 1 is input based on the operation of the monitor. The display unit displays partial images of the two images.

Further, as another embodiment, for example, in the monitoring terminal device 2 of the present example, a display unit for displaying at least one image is provided, and based on the operation of the monitor, the image of the image input from the monitoring device 1 is provided. The display unit displays at least one partial image.

Therefore, in the monitoring system of the present example, an appropriate image can be obtained by controlling the imaging device 11 in accordance with the abnormality detected by the monitoring device 1. Further, in the monitoring system of the present example, for example, it is possible to perform enlarged display of a monitoring target object related to an abnormality such as a suspicious person without operating a camera zoom lens or a camera platform with a high-quality image. High-quality images can be selectively transmitted to remote locations, and V / systems that minimize the oversight of abnormalities such as suspicious individuals and systems that suppress an increase in the amount of data to be transmitted can be realized.

In the monitoring device 1 of the present example, an image capturing unit is configured by the function of the imaging device 11, a request signal receiving unit is configured by the function of the communication unit 16, and the standard image encoding unit 13 is configured. The first image transmission unit is configured by the functions of the communication unit 16, the function of the video switching unit 12, and the function of the imaging device control unit 17, and the functions of the high-definition image encoding unit 14 and the communication unit 16. The function, the function of the video switching unit 12, and the function of the imaging device control unit 17 constitute a second image transmission unit, and the function of the abnormality detection unit 15 constitutes an abnormality detection unit.

In the monitoring terminal device 2 of this example, the image is received by the function of receiving the image from the monitoring device 1. An image receiving unit is configured, and an image display unit is configured by a function of displaying an image on the operation screen 51 as shown in FIG. 4, and a request signal transmission instruction receiving unit is configured by a function of the shutter button 71. A request signal transmission unit is configured by a function of transmitting a request signal.The function of the enlarged display selection buttons 72 to 74 on the operation screen 51 as shown in FIG. 4 and the enlarged display position moving button are provided. The function of 75 to 78 constitutes an enlarged display image part specification instruction receiving unit.

In the operation screen 51 displayed by the monitoring terminal device 2 of the present example, an area for displaying an image of the first image quality is configured by the standard image display unit 61, and the area is displayed by the high-definition image display unit 62. An area for displaying an image of the second image quality is configured, and an area for enlarging and displaying an image portion in the image of the second image quality is configured by the high-definition image enlarged display units 63 to 65.

Further, in the monitoring system of this example, the first image having a relatively low image quality is constituted by the standard image, and the second image having the relatively high image quality is constituted by the high-definition image. ing.

[0067] A monitoring system according to a second example of the present invention will be described.

FIG. 6 shows a configuration example of the monitoring system of this example.

The monitoring system of this example includes a monitoring device 111, a monitoring terminal device 112, a network 113, a line (access line) 114 connecting the monitoring device 111 and the network 113, and a monitoring terminal device 112 and a network 113. It has a line (access line) 115 to be connected. The monitoring device 111 includes, as hardware configuration examples, an imaging device 121 also configured with a power such as a television camera, a video switching unit 122 configured with a camera such as a switching switch, a standard image encoding unit 123, It includes a high-definition image encoding unit 124, an abnormality detection unit 125, a communication unit 126, an imaging device control unit 127, an image recording unit 128, and a read control unit 129.

Here, the monitoring system of the present example has a configuration in which, for example, the monitoring device 111 having the configuration shown in FIG. 1 further includes an image recording unit 128 and a readout control unit 129. The configuration and operation of the other processing units 121 to 127 provided in the monitoring device 111 are roughly the same as the configuration and operation of the corresponding processing units 11 to 17 provided in the monitoring device 1 shown in FIG. Is the same. [0068] An example of an operation performed by the monitoring device 111 of the present example will be described. The description of the same operation as that performed by the monitoring device 1 shown in FIG. 1 is omitted. In this example, the high-definition image encoding unit 124 outputs data obtained by encoding the high-definition image to the image recording unit 128, and the communication unit 126 receives the encoded data from the image recording unit 128. In this example, the communication unit 126 reads out a request signal received from the monitoring terminal device 112 via the network 113 and outputs the request signal to the control unit 129.

The image recording unit 128 is composed of, for example, a memory, and inputs and records the data of the high-definition image encoded by the high-definition image encoding unit 124. At this time, the image recording unit 128 records the information on the abnormality detection result including the abnormality detection time obtained by the abnormality detection unit 125 in association with the image data.

The read control unit 129 inputs a request signal obtained from the monitoring terminal device 112 via the network 113 from the communication unit 126, controls the image recording unit 128 based on the request signal, and controls the image recording unit 128 based on the request signal. The encoded data of the high-definition image recorded in the image recording unit 128 is read and output to the communication unit 126. The encoded data of the high-definition image is transmitted by the communication unit 126 to the monitoring terminal device 112 via the network 113.

Next, FIG. 7 shows an example of an operation performed by the monitoring device 111 or the monitoring terminal device 112 during automatic imaging. The monitoring terminal device 112 of the present example displays an image using the same operation screen 51 as shown in FIG.

FIG. 7 conceptually shows an example of an operation performed by the monitoring device 111 or the monitoring terminal device 112 over time from time tl to time (tl + 4). At each time, the images 131, 132, 133, 134, and 135 in ljtl, (tl + l), (tl + 2), (tl + 3), and (tl + 4) are output by the monitoring device 111 at each time. Of the monitoring target area at each time. FIG. 7 shows a plurality of image pickup devices 121, a plurality of standard image coding units 123, a high-definition image coding unit 124, a plurality of abnormality detection units 125, and an image recording unit 128. These represent processing units provided in the monitoring device 111 of this example.

First, at time tl, the imaging device 121 captures the image 131 in the standard image mode, and the captured image is input to the standard image encoding unit 123 and the abnormality detection unit 125. Standard image mark The encoding unit 123 encodes the input image, and transmits the encoded image to the monitoring terminal device 112 via the communication unit 126 and the network 113. The image is displayed on the standard image display of the monitoring terminal device 112. The image is displayed in the section 61 as shown in the image 141. Further, the abnormality detection unit 125 detects an abnormality such as a suspicious person in the monitoring target area by a technique such as a difference method. Here, since an abnormality such as a suspicious person does not exist in the image 141, the abnormality detecting unit 125 does not detect an abnormality such as a suspicious person.

Next, at time (tl + 1), the imaging device 121 captures the image 132 in the standard image mode, and the captured image is input to the standard image encoding unit 123 and the abnormality detection unit 125. The standard image encoding unit 123 encodes the input image, and transmits the encoded image to the monitoring terminal device 112 via the communication unit 126 and the network 113. The image is transmitted to the standard image display unit of the monitoring terminal device 112. It is displayed as image 142 on 61. Further, since the suspicious person is reflected in the image 142, the abnormality detection unit 125 detects the presence of the suspicious person in the monitoring target area as an abnormality, and responds via the imaging device control unit 127 accordingly. Control so that the imaging device 121 acquires a high-definition image. Further, the abnormality detection unit 125 outputs information on the detection result including the detection position and the detection time of the abnormality such as the suspicious person to the high-definition image encoding unit 124. Further, information relating to the result of the detection of the abnormality by the abnormality detection unit 125 is transmitted to the monitoring terminal device 112 via the communication unit 126 and the network 113 by the transmission signal 151. Then, in the monitoring terminal device 112, the notification message 81 is displayed in the standard image display section 61 of the operation screen 51 in response to receiving the information notifying the occurrence of the abnormality from the monitoring device 111.

Next, at time (tl + 1), the imaging device 121 captures the image 133 in the high-definition image mode according to the detection result by the abnormality detection unit 125 at time (tl + 1), and Is input to the high-definition image encoding unit 124. The high-definition image encoding unit 124 encodes the input high-definition image, and the encoded image is recorded in the image recording unit 128 together with the detection result information from the abnormality detection unit 125. Here, as the encoding of the image, for example, encoding of a partial image of a high-definition image may be performed based on a result of detecting an abnormality, or partial encoding such as the ROI function of JPEG2000. The encoding may be performed by a method that changes the compression ratio. Also, a resource for acquiring a high-definition image from the monitoring terminal device 112 is displayed. When the quest signal 152 is transmitted and reaches the read control unit 129 of the monitoring device 111, the high-definition image recorded in the image recording unit 128 is read based on the request signal and read by the control unit 129 to perform communication. The transmission signal 153 is transmitted to the monitoring terminal device 112 via the unit 126 and the network 113. The high-definition image is displayed on the monitoring terminal device 2 on the high-definition image display unit 62 of the operation screen 51.

Here, in the present example, the request signal transmitted from the monitoring terminal device 112 includes information for specifying the time (time specifying information). This corresponds to the time when the abnormality is detected. Read control unit 129 compares the time specifying information included in the input request signal, and information specifying the detection time attached to the image recorded on the image recording unit i _28, contained in the request signal Then, an image whose detection time coincides with the time specified by the time information to be detected or the latest time is read from the image recording unit 128 and output to the communication unit 126. As a result, even when a plurality of high-definition images are recorded in the image recording unit 128, the readout control unit 129 can read out a desired high-definition image based on the request signal.

Further, in the monitoring terminal device 112 of this example, information regarding the result of detection of an abnormality received from the monitoring device 111 is stored in a memory, and a time of detection of a past abnormality is specified based on the information. Information can be displayed in a list or the like. The monitoring terminal selects an arbitrary detection time from the abnormality detection times displayed in this way, and the monitoring terminal device 112 transmits information to the monitoring device 111 with the information specifying the detection time included in the request signal. be able to.

In addition, the monitoring terminal device 112 of the present example receives the information specifying the detection time of the abnormality from the monitor, or receives both the time specification information and the press of the shirt button 71. For example, a request signal including the received time specifying information is transmitted to the monitoring device 111. Note that, for example, when the shutter button 71 is pressed without receiving the time specifying information, a configuration may be used in which a request signal for acquiring a high-definition image relating to the latest abnormality is transmitted. is there.

Next, at time (tl + 3), the imaging device 121 captures the image 134 in the standard image mode, and the captured image is input to the standard image encoding unit 123 and the abnormality detection unit 125. standard The image encoding unit 123 encodes the input image, and transmits the encoded image to the monitoring terminal device 112 via the communication unit 126 and the network 113. The image is displayed as the image 143 on the standard image display section 61 of the monitoring terminal device 112. Further, the abnormality detection unit 125 detects an abnormality such as a suspicious person in the monitoring target area by a method such as a difference method. Here, since an abnormality such as a suspicious person does not exist in the image 143, the abnormality detection unit 125 does not detect an abnormality such as a suspicious person.

Similarly, at time (tl + 4), the captured image 135 does not have any abnormality such as a suspicious person. Therefore, only the encoded standard image is transmitted to the monitoring terminal device 2, and the image Will be displayed.

In this example, when the imaging device control unit 127 receives the request signal output from the abnormality detection unit 125, the monitoring device 111 performs high-definition control under the control of the imaging device control unit 127. When the mode shifts to the image mode and the imaging device 121 captures a high-definition image for one frame, the mode shifts again to the standard image mode and the imaging device 121 returns to a state where a standard image is captured.

In this example, the latest image is always transmitted from the monitoring device 111 to the monitoring terminal device 112 as the standard image, and the detection time of the abnormality such as a suspicious person included in the request signal is shown as the high-definition image. The information can be selectively read from the image recording unit 128 based on the information and received by the monitoring terminal device 2. For this reason, a high-definition image can be selectively transmitted to a remote place, and an increase in the amount of data transmitted when transmitting a high-definition image can be suppressed.

As described above, in the monitoring device 111 in the monitoring system of the present example, the image recording unit 128 that records the image encoded by the image encoding function (in this example, the high-definition image encoding unit 124). With.

In the monitoring terminal device 112 in the monitoring system of the present example, a display unit (in this example, in which the content of the operation by the monitor (operator) is input and the image input from the monitoring device 111 is displayed according to the operation. Operation screen 51) is provided. By displaying the image recorded in the image recording unit 128 of the monitoring device 111 and its partial image on the display unit based on the operation of the observer, the monitoring can be performed without operating the zoom lens or camera platform of the camera, for example. Within the target area Abnormalities such as suspicious persons can be monitored.

For example, in the monitoring terminal device 112 of the present example, a display unit for displaying at least one image is provided, and at least one image recorded on the image recording unit 128 of the monitoring device 111 based on the operation of the observer. A partial image of the image is displayed on the display unit.

Further, for example, in the monitoring terminal device 112 of this example, a display unit for displaying at least one image is provided, and at least one of the images recorded in the image recording unit 128 of the monitoring device 111 is provided based on the operation of the observer. The two partial images are displayed by the display unit.

Further, in this example, the image recording unit 128 of the monitoring device 111 records one or more images with predetermined information (in this example, time information) specifying the image. Further, the monitoring terminal device 112 has, for example, a list display function for displaying a list of information specifying images recorded in the image recording unit 128 of the monitoring device 111. Then, information (image specifying information) for specifying the selected image is transmitted to the monitoring device 111. The monitoring device 111 reads an image corresponding to the image specifying information input from the monitoring terminal device 112 from the images recorded in the image recording unit 128 and transmits the read image to the monitoring terminal device 112. It is received by 112 and displayed on the display unit. As described above, in this example, the monitoring device 111 records the image processed by the image processing unit (in this example, the high-definition image encoding unit 124) by the image recording unit 128, and the monitoring terminal device 112 By inputting an operation and displaying the image recorded in the image recording unit 128 of the monitoring device 111 or a partial image thereof based on the operation, for example, the zoom lens of the camera can be monitored without operating the camera platform. It is possible to monitor suspicious persons and other abnormalities within the building.

Here, in the present embodiment, the configuration in which the monitoring device 111 on the camera side is provided with the abnormality detection unit 125 is shown. However, as another embodiment, for example, the monitoring terminal device 112 on the client side detects the abnormality. It is also possible to adopt a configuration having the function of the abnormality detecting unit, or a configuration having the function of the abnormality detecting unit in both the monitoring device 111 and the monitoring terminal device 112. When the monitoring terminal device 112 is provided with the function of the abnormality detection unit, for example, a request signal generated by the function of the abnormality detection unit of the monitoring terminal device 112 can be transmitted to the monitoring device 111 via the network 113. As an example, at the time of automatic imaging, an observer on the client side A request signal for a high-definition image can be automatically transmitted from the monitoring terminal device 112 on the client side to the monitoring device 111 on the camera side without pressing the button 71.

Also, in this example, when the automatic imaging is performed, the monitoring force of the client side is pushed by the observer of the monitoring terminal device 112 on the client side by pressing the shirt button 71, etc. A request signal is transmitted to. In this example, the automatic imaging processing is executed in the monitoring device 111 on the camera side. In this case, even if there is no request signal of the client side, the automatic imaging processing is performed from the camera side. The acquired high-definition image is not transmitted to the client, but the transmission of the high-definition image is based solely on the client-side request. Thus, for example, not only in the case of manual imaging, but also in the case of automatic imaging, the amount of data to be transmitted is increased by transmitting a high-definition image from the monitoring device 111 only when requested by the client. It is possible to suppress. It should be noted that it is also possible to adopt a configuration in which a high-definition image is automatically transmitted from the monitoring device 111 to the monitoring terminal device 112 during automatic imaging.

In this example, a list such as the date and time when the abnormality is detected is displayed on the monitoring terminal device 112 on the client side, and the user can specify the date and time desired to be referred from the list. Done. In this case, for example, on the operation screen 51 as shown in FIG. 4, an automatic recording image acquisition button is prepared separately from the shirt button 71 for manual imaging, and the automatic recording image acquisition button is pressed by the user. Then, a configuration is used in which a process for acquiring an image recorded in the image recording unit 128 of the monitoring device 111 is performed.

Further, for example, when the user presses the shirt button 71 while the notification message 81 indicating that an abnormality has been detected is displayed on the standard image display unit 61 on the operation screen 51 shown in FIG. A high-definition image obtained by automatic imaging can be acquired from the monitoring device 111 in response to a request signal issued (here, referred to as a request signal A). In this case, for example, the image at the latest abnormality detection date when the shirt button 71 is pressed is transmitted from the monitoring device 111 to the monitoring terminal device 112. Note that such image acquisition is also possible in a monitoring system as shown in FIG. 1, for example. As an example, in the monitoring device 1, the latest high-definition image is temporarily stored in the high-definition image encoding unit 14. When the request signal A is received from the monitoring terminal device 2, the latest high-definition image in the high-definition image encoding unit 14 is read out and distributed to the monitoring terminal device 2. Can be used.

In the monitoring device 111 of the present example, an abnormal image storage unit is configured by the function of the image recording unit 128, and the second image transmission unit is configured by the function of the communication unit 126 and the function of the readout control unit 129. It is configured.

Further, in the monitoring terminal device 112 of the present example, an abnormality information storage unit is configured by a function of storing information specifying the date and time related to the abnormality received from the monitoring device 111, and a function of displaying such information in a list is provided. An abnormality information output unit is configured.

Next, the processing related to the enlarged display performed in the monitoring system as in the first example and the second example described above will be described in detail.

With reference to the operation screen 51 of the monitoring terminal devices 2 and 112 shown in FIG. 4, an example of an operation related to enlargement of a partial image will be described.

The high-definition image display unit 62 displays display frames 82 to 84 indicating the positions of the reduced high-definition still image and the partial image to be enlarged and displayed. The respective partial images shown by these display frames 82 to 84 are enlarged and displayed on the respective high-resolution image enlarged display sections 63 to 65. Here, as in this example, the respective display frames 82 and 83 are displayed. , 84 correspond to the respective enlarged display selection buttons 72, 73, 74! /, Depending on that, each enlarged display selection button 72, 73 inside or outside the display frame 82, 83, 84 , 74 (for example, numbers and symbols) to explicitly indicate that they correspond to each other. Similarly, as in this example, it may be explicitly indicated that each of the display frames 82, 83, 84 corresponds to each of the high-resolution image enlarged display sections 63, 64, 65.

[0086] In addition to writing characters to explicitly indicate the correspondence, the colors of the display frames 82, 83, and 84 are changed to the colors of the outer frame of the respective enlarged display selection buttons 72, 73, and 74. Alternatively, the correspondence may be explicitly specified by matching the colors of the frames of the high-resolution image enlarged display sections 63, 64, and 65. For example, set the color of the display frame 82 to blue, set the color of the outer frame of the enlarged display selection button 72 and the outer frame of the high-resolution image Set the color of the outer frame of the enlarged display selection button 73 and the high-resolution image enlarged display section 64 to yellow, and set the color of the display frame 84 to green and set the enlarged display selection button 74 Set the color of the outer frame and the color of the outer frame of the high-resolution image enlarged display section 65 to green.

In this example, the high-definition image is reduced and displayed on the high-definition image display unit 62. However, the definition, the image quality, the number of pixels, and the number of gradations per pixel are lower than those of the standard image with low image quality. Since one or more of the compression ratios and the like are excellent, even when displayed on the high-resolution image enlarged display sections 63 to 65, a finer image than the standard image can be displayed.

An example of a method of changing the position of a partial image to be enlarged and displayed on the high-definition image enlarged display sections 63 to 65 will be described.

First, the operator or the like selects one of the enlarged display selection buttons 72, 73, 74 by clicking (for example, pressing and releasing the left mouse button) to select the position of the partial image to be enlarged. The corresponding one of the display frames 82, 83 and 84 shown is enabled.

Subsequent operations by the operator are performed on the activated display frame. The activated display frame can be distinguished from the display frame, for example, by changing the color of the display frame from the normal state (when not selected) so that it is enabled. You.

As an example, when the operator or the like clicks the enlarged display selection button 72, the corresponding display frame 82 turns red, and the display frame 82 can be operated by the operator. At this time, the operator cannot operate the display frames 83 and 84 of other colors (for example, black). In addition, when the enlarged display selection button 72 is clicked again while the enlarged display selection button 72 is selected, and when the other enlarged display selection buttons 73 and 74 are clicked, the display frame that was valid is displayed. The valid state of 82 is released, and the display frame 82 becomes another color (for example, black), and cannot be operated by the operator.

The display frames 82, 83, and 84 are moved by operating the enlarged display position movement buttons 75 to 78 corresponding to up, down, left, and right. Clicking the zoom-in position move button 75 corresponding to the upper direction Clicks the zoom-in position move button 76 corresponding to the upper direction and the downward direction Click the zoom display position move button 78 corresponding to the left or right direction to select it to the right. The displayed display frame moves by one dot, and if each button is kept pressed, the display frame moves continuously in each direction.

Also, the enlarged display position move buttons 75 to 78 can be configured to be interlocked with up, down, left, and right keys of a keyboard, for example.

When the display frames 82 to 84 are moved, the partial images displayed on the high-definition image enlarged display units 63 to 65 are updated in accordance with the movement.

Next, the fine adjustment of the position of the partial image displayed on the high definition image enlarged display sections 63 to 65 will be described.

By clicking and selecting any one of the high-resolution image enlarged display sections 63, 64, and 65, fine adjustment of the position of the partial image displayed on the selected high-resolution image enlarged display section becomes effective.

For example, when the user clicks on any part of the high-definition image enlarged display section 63, the outer frame of the high-definition image enlarged display section 63 is outlined in red, and the partial image displayed on the high-definition image enlarged display section 63 is displayed. The position can be finely adjusted. At this time, the position of the partial image displayed on the other high-resolution image enlarged display sections 64 and 65 cannot be fine-tuned, and if one of the enlarged display selection buttons is selected, Will be released.

Further, for example, when the high-definition image enlarged display section 63 is selected and a place other than the high-definition image enlarged display section 63 and the enlarged display selection buttons 72 to 74 is clicked, the selection is made. The state is released, the border of the outer frame of the high-definition image enlarged display section 63 is erased, and the fine adjustment of the position of the partial image displayed on the high-definition image enlarged display section 63 becomes impossible.

The fine adjustment of the position of the partial image is performed by operating the enlarged display position movement buttons 75 to 78. When the operator clicks the button, the enlarged display position move button 75 moves upward, the enlarged display position move button 76 moves down, the enlarged display position move button 77 moves left, and the enlarged display position move button 78 The image moves one dot to the right with, and the position of the partial image moves continuously by holding down the button.

FIG. 8 shows another configuration example of a button (enlarged display position move button) 161 for moving an enlarged display position as an example of operation buttons provided on the monitoring terminal devices 2 and 112. It is. Note that in FIG. 8, only one of the eight-direction buttons is denoted by reference numeral 161 and the other is omitted.

As shown in Fig. 8, the display frame can be moved diagonally by providing a total of eight directions, up, down, left, right, and diagonal, as the enlarged display position move button for changing the position of the partial image. It can also be.

As another configuration example, by clicking the high-definition image display section 62 or the high-definition image enlargement display sections 63 to 65 with a mouse without providing an enlarged display position moving button, the clicked position is displayed in high definition. It is also possible to display the image on the image display unit 62 or to update the images displayed on the high-definition image enlarged display units 63 to 65 so that the clicked position becomes the center.

As another configuration example, when the mouse is dragged (for example, the operation of moving the mouse while pressing the left button of the mouse), the position of the partial image to be enlarged and displayed on the high-definition image according to the movement of the mouse. It may be configured to move continuously.

Next, an example of a method for changing the enlargement ratio of a partial image to be enlarged and displayed will be described.

The enlargement ratio of the partial image is changed by operating the enlargement ratio change button 79 on the operation screen 51 shown in FIG.

When one of the display frames 82, 83, 84 or the high-resolution image enlarged display section 63, 64, 65 is selected, the magnification of the selected image can be changed. is there.

In this example, when the inverted triangle button to the right of the enlargement ratio change button 79 is clicked on the operation screen 51, a list of enlargement ratios is displayed as shown in FIG. You can select and make changes.

FIG. 9 shows an example of the enlargement ratio change button 171 (in this example, the enlargement ratio change button 79 shown in FIG. 4) and an example of a list of enlargement ratios.

When the enlargement ratio is changed with the enlargement ratio change button 79, the center point of the image is left as it is, and it is selected! The size of the display frame 82 to 84 of the image and the selected high-resolution image Enlarged display The range of the partial image of the high definition image displayed in the sections 63 to 65 is changed.

[0093] Here, a method of enlarging and compressing an image will be described. As a method for enlarging and compressing an image, a method called affine transformation has been widely used. The affine transformation is represented by Equation 1, and means that a certain pixel (xl, yl) is transformed into a pixel (x2, y2) by a transformation operation.

In addition, enlargement and reduction are realized under the condition as shown in Expression 2. Here, Sx and Sy represent the enlargement ratio in the X and y directions, respectively.If Sx or Sy is 1.0 or more, enlargement is performed.If Sx or Sy is less than 1.0, reduction is performed. Become.

[0094] [Number 1]

(Equation 1)

[0095] [number 2]

An example of another method for changing the enlargement ratio of the partial image to be enlarged and displayed will be described. When one of the display frames 82, 83, or 84 is selected and the mouse is right-clicked in the high-resolution image display area 62, or when any of the high-resolution image enlargement display areas 63, 64, or 65 is selected When the mouse is right-clicked in the selected high-resolution image enlarged display area 63, 64, 65, an enlargement ratio change pop-up menu is displayed.

FIG. 10 shows an example of the enlargement ratio change pop-up menu 181 and an example of the pointer 182.

The enlargement ratio change pop-up menu 181 of this example displays all the values of the enlargement ratio prepared in advance. By selecting one magnification value, the selected magnification value Selected according to! The display frames 82 to 84 and the range of the partial image are updated, and the updated partial image is enlarged and displayed on the selected high-definition image enlarged display section 63 to 65.

[0097] An example of another method for changing the enlargement ratio of a partial image to be enlarged and displayed will be described.

When one of the display frames 82, 83, and 84 is selected and the mouse wheel is rotated in the high-resolution image display area 62, or when one of the high-resolution image enlargement display areas 63, 64, and 65 is selected When the mouse wheel is rotated in the selected high-resolution image enlarged display section 63, 64, 65, the enlargement ratio is changed. For example, a plurality of magnification values are prepared in advance, and when the wheel is rotated in the forward direction, the value of the current magnification is increased by one step to the value of the magnification! And the range of the partial image is updated.When the wheel is rotated in the backward direction, the display frame 82 to 84 and the range of the partial image that is selected to the value of the enlargement ratio by one step smaller than the current enlargement value and 1 Are updated, and the updated partial image is enlarged and displayed on the selected high-definition image enlarged display sections 63 to 65.

[0098] In addition to the method of preparing a plurality of values of the enlargement ratio in advance as described above, a configuration in which the value of the enlargement ratio is changed according to the rotation amount of the mouse wheel may be adopted. . In this case, for example, the minimum rotation angle of the wheel (for example, 15 degrees (°;)) is taken as one step, and the magnification is changed by 5 percent (%) per step. As an example, if the wheel is rotated 6 steps (90 degrees) forward, the magnification is increased by 30%, and if the wheel is rotated 10 steps (150 degrees) backward, the magnification is 50%. cut back.

In addition to the method of preparing a plurality of enlargement ratio values in advance and allowing the operator to select the enlargement ratio value as described above, as another embodiment, each of the display frames 82, 83, and 84 is used. The size should be changed by expanding or contracting the mouse by dragging the mouse, and the value of the magnification should be changed according to the change in the size of each display frame 82, 83, 84. Can also

[0099] In the operation screen 51 of this example, three high-definition image enlarged display sections 63 to 65, three enlarged display selection buttons 72 to 74, and three display frames 82 to 84 are provided. There is. For this reason, in this example, when three partial areas are already specified using the three display frames 82 to 84 by a user operation or the like, the user further specifies another partial area. In this case, the user selects the display frame corresponding to the partial area that does not need to be enlarged and displayed from the already specified display frames 82 to 84, cancels the specification, and performs a new specification. Specifically, the three enlarged display selection buttons 72 to 74 also correspond to the partial areas (display frames 82 to 84) for which the enlarged display is not required! With this, the designation of the display frame corresponding to the button is released. Thereafter, the user moves the released display frame to the position of the newly designated partial area, and designates a new partial area.

As described above, in this example, each of the enlarged display selection buttons 72 to 74 is used by the user to release each of the display frames 82 to 84 for designating a partial area of an image to be displayed in each of the high-resolution image enlarged display sections 63 to 65. Has a function that can be arbitrarily performed by designating.

FIG. 11 shows an example of the operation screen 51 of the monitoring terminal devices 2 and 112.

In the operation screen 51 of the present example, for example, the displayed image is different from that shown in FIG. 4, and the same reference numerals are given to the respective parts.

The respective partial images indicated by the display frames 82, 83 and 84 in the high-definition image display section 62 are enlarged and displayed on the high-definition image enlarged display sections 63, 64 and 65. The high-definition image magnified display section 63 displays an image of the entire vehicle, the high-definition image magnified display section 64 displays an image of a person's burst shot, and the high-definition image magnified display section 65 displays. An image of a bust shot of a person different from the above is displayed. As described above, by changing the enlargement ratio for each image in each of the display frames 82 to 84 (each of the high-definition image enlarged display sections 63 to 65), an optimal enlarged image can be obtained for each object to be monitored. .

FIG. 12 shows another example of the operation screen 51 of the monitoring terminal devices 2 and 112.

The high-resolution image enlarged display section 63 displays an image of the entire person, and the high-resolution image enlarged display section 64 displays an image of the bust shot of the person. Displays an image of a close-up shot of the person. In this way, by displaying one target object at different magnifications, it becomes possible to accurately capture the target object. Next, an example of the operation of the monitoring terminal device 112 in automatic imaging will be described with reference to the operation screen 51 of the monitoring terminal device 112 shown in FIG.

When the automatic imaging is performed, the monitoring terminal device 112 automatically displays a reduced high-resolution still image of the captured image on the high-definition image display unit 62. At this time, display frames 82 to 84 indicating the position of the partial image to be enlarged and displayed are automatically displayed based on the detection result from the abnormality detection unit 125, and the respective partial images indicated by the display frames 82 to 84 are displayed. Is automatically displayed on each of the high-resolution image enlarged display sections 63 to 65.

After the image is displayed in this manner, the partial image enlarged and displayed in each of the high-resolution image enlarged display sections 63 to 65 can be selected by the enlarged display selection buttons 72 to 74, and the enlarged display position The position can be moved with the move buttons 75 to 78, and the magnification can be changed with the magnification change button 79.

Next, with reference to FIG. 13, an example of the correspondence of the number of pixels between the image acquired by imaging and the images displayed by the display units 61 to 65 on the operation screen 51 will be described.

In this example, the standard image (moving image) 192 or ヽ having a width of 640 pixels by a height of 480 pixels is formed by the imaging device 191 (the imaging device 11 according to the first example and the imaging device 121 according to the second example). A high-resolution image (still image) 193 of 1280 pixels X height 960 pixels is acquired. In the high definition image 193, an image portion 194 to be enlarged is selected by the display frames 82 to 84.

Then, the acquired standard image 192 is displayed in the display area of the standard image display unit 61 of 640 pixels wide by 480 pixels high with the same number of pixels, and the acquired high-definition image 193 is subjected to pixel thinning or the like. The image is reduced and displayed in the display area of the high-definition image display unit 62 of 480 pixels wide by 360 pixels high. An image portion 194 corresponding to a part of the high-definition image 193 is cut out and electronically enlarged, and a high-definition image enlarged display section 63 of 320 pixels wide by 240 pixels in height (or a high-resolution image enlarged display section 64) , 65) in the display area.

Here, in this example, as shown in FIG. 4, FIG. 11, and FIG. 12, the operation screen 51 includes a standard image display unit 61, which is a display area of a moving image based on the standard image. A high-definition image display 62, which is a display area for still images (thinned-out whole images) based on high-definition images, and a still image enlarged based on a high-definition image (enlarged partial image) There are provided high-definition image enlarged display sections 63 to 65, which are display areas. Specify a partial area in the high-resolution image display area 62. Display frames 82 to 84 are displayed.

Regarding this, another configuration example will be described.

[0105] As another configuration example, a display frame (similar to the display frames 82 to 84) is displayed on the standard image display unit 61, and a partial area is designated on the standard image (for example, a moving image) by the display frame. Then, the image of the partial region corresponding to the display frame can be cut out from the high-definition image and enlarged and displayed on the high-definition image enlargement display units 63 to 65.

As another configuration example, a display frame (similar to the display frames 82 to 84) is displayed on the standard image display section 61, and the display frame is used to specify a partial area on a standard image (for example, a moving image). Then, the image of the partial region corresponding to the display frame can be cut out from the standard image and enlarged and displayed on the high-definition image enlarged display sections 63 to 65. Note that, in this example, a configuration in which various high-definition images are acquired, such as the ability to acquire 7.5-second high-definition images, for example, 30 frames per second, may be used.

As the setting of the display frame (similar to the display frames 82 to 84), for example, a mode in which each display frame is manually set by the user may be used, or an object detection by image processing may be used. The position of each display frame is automatically determined based on the result, and the display is enlarged and displayed on each of the high-definition image enlarged display sections 63 to 65, or automatically based on the result of detection by an external sensor. A mode may be used in which the position of the display frame is determined and enlarged and displayed on each of the high-definition image enlarged display sections 63 to 65.

As described above, in the monitoring system of the present example, the monitoring devices 1 and 111 having the imaging devices 11 and 121 for capturing images of the monitoring target area, and the monitoring terminal devices 2 and 112 having the display devices for displaying images. And an image enlargement function for enlarging an image obtained by the imaging devices 11 and 121 of the monitoring devices 1 and 111 at a predetermined enlargement ratio, and the display device displays two or more enlarged images. Thus, it is possible to monitor abnormalities such as suspicious persons in the monitoring target area.

Further, the monitoring system of the present example is provided with an image selection function for selecting two or more images among the images input from the imaging devices 11 and 121 of the monitoring devices 1 and 11 based on an operation by an operator, and The enlargement function enlarges the selected image at a predetermined enlargement ratio. As a result, the surveillance system according to the present example is configured such that a suspicious person or the like in the surveillance target area has an error. You can always monitor.

[0107] Further, the monitoring system of the present example is provided with an image enlargement setting function for determining at least one of an image position and an enlargement ratio based on an operation by an operator. The image is enlarged based on the position and the enlargement ratio of the image determined by the enlargement setting function, so that it is possible to monitor abnormalities such as a suspicious person in the monitoring target area.

Further, in the monitoring system of this example, a detection function (in this example, abnormality detection units 15 and 125) for detecting the presence or absence of a predetermined change in the monitoring target area includes the monitoring devices 1 and 111 and the monitoring terminal devices 2 and 112. And the image selection function enlarges the image based on the position and enlargement ratio of the image determined (detected) by the detection function. As a result, the monitoring system of this example can monitor abnormalities such as suspicious persons in the monitoring target area. Further, in the monitoring system of the present example, the image selection function selects two or more images from the images detected by the detection function based on an operation by the operator.

Further, in the monitoring system of the present example, the image enlargement setting function determines the position and the enlargement ratio of the image based on at least the deviation of the detection result by the detection function or the operation by the operator. I do. Thus, the monitoring system of the present example can monitor an abnormality such as a suspicious person in the monitoring target area by using the enlarged image displayed at an appropriate position and an enlargement ratio.

Further, in the monitoring system of the present example, the image enlargement setting function determines the value of the enlargement ratio for the pop-up menu force based on the operation by the operator. Thus, the monitoring system of the present example can monitor an abnormality of a suspicious person or the like in the monitoring target area by using an image displayed at an appropriate magnification.

In the monitoring system of the present example, the image enlargement setting function determines the value of the enlargement ratio from the pull-down menu based on the operation by the operator. Thus, the monitoring system of the present example can monitor an abnormality of a suspicious person or the like in the monitoring target area by using an image displayed at an appropriate magnification.

Further, in the monitoring system of the present example, the image enlargement setting function determines the position of the image to be enlarged and displayed by a button operation based on an operation by the operator. This In addition, the monitoring system of this example can monitor an abnormality of a suspicious person or the like in the monitoring target area by using an image at an appropriate position.

Further, in the monitoring system of the present example, the image enlargement setting function determines the position of the image to be enlarged and displayed directly by the mouse based on the operation by the operator. Thus, the monitoring system of this example can monitor an abnormality such as a suspicious person in the monitoring target area using the image at the appropriate position.

[0110] Therefore, conventionally, there is a problem of blind spots that occur when an operator monitors a suspicious person or the like by operating a zoom lens or a camera platform, and a complicated camera platform operation for zooming up a plurality of locations. There was a problem. However, in the surveillance system of the present example, for example, the operator can operate and detect functions using a high-quality image without operating the zoom lens of the camera and the camera platform (in this example, the abnormality detection units 15, 125 ), Two or more objects to be monitored can be enlarged and displayed at an appropriate position and at an appropriate magnification, and monitoring of suspicious persons and other abnormalities is minimized!

As described above, in the monitoring system of the present example, the partial images at two or more positions can be enlarged and displayed on the same screen, and the imaging devices 11 and 121 are controlled according to the detected abnormality. Obtaining an appropriate image, displaying an image at the position specified by the operator on two or more monitored objects on a magnified screen, and capturing two or more monitored objects using captured high-definition images It is possible to enlarge the object at an appropriate position and magnification.

In the monitoring devices 1 and 111 of the present example, the functions of the imaging devices 11 and 121 configure an image capturing unit, and the functions of the communication units 16 and 126 configure an image transmitting unit. Further, in the monitoring terminal devices 2 and 112 of the present example, an image receiving unit is configured by a function of receiving images transmitted from the monitoring devices 1 and 111, as shown in FIGS. 4, 11, and 12. An enlarged image display unit is configured by a function of enlarging and displaying images of a plurality of portions included in a received image on the same screen, and a frame indicating the image portion (display frame in this example) 82 to 84 The image partial frame display section is constituted by the function of displaying the images, and the corresponding relationship between each of the frames 82 to 84 and the frame of each image (high-resolution image enlarged display section in this example) 63 to 65 is visually checked. The image partial correspondence display section is configured by the The image part position initial setting section is configured with the function to initially set the position (frame) 82 to 84 of the image to be enlarged and displayed, and the image is enlarged using the enlarged display position move buttons 75 to 78, 161, etc. The position of the image to be displayed (frame) 82 to 84 constitutes the image part position moving part, and the image to be enlarged and displayed by the zoom ratio change buttons 79 and 171 and the pop-up menu 181 are displayed. The image part enlargement ratio setting unit is configured by the function of setting the value of the enlargement ratio. Is configured.

Here, the configurations of the monitoring system, the monitoring device, the monitoring terminal device, and the like according to the present invention are not necessarily limited to those described above, and various configurations may be used. Further, the present invention can be provided, for example, as a method or a method for executing the processing according to the present invention, a program for realizing the method or the method, a recording medium for recording the program, and the like. Also, it can be provided as various devices and systems.

Further, the application field of the present invention is not necessarily limited to the above-described fields, and the present invention can be applied to various fields. As an application example, in addition to the purpose of monitoring, the present invention can also be realized as a system for the purpose of watching sports such as athletic meet in kindergarten and baseball.

In addition, various processes performed by the monitoring system, the monitoring device, the monitoring terminal device, and the like according to the present invention include, for example, a processor (ROM) in a hardware resource including a processor and a memory. A configuration controlled by executing the control program stored in ()) may be used.For example, each functional unit for executing the processing may be configured as an independent hardware circuit. .

Further, the present invention can be understood as a computer-readable recording medium such as a floppy (registered trademark) disk or a CD (Compact Disc) ROM storing the above-mentioned control program or the program (the program itself). The processing according to the present invention can be performed by inputting the program into the recording medium computer and causing the processor to execute the program. Industrial applicability

[0113] The present invention can be used in the field of capturing a specific area, distributing the captured image, and receiving the captured image.

Brief Description of Drawings

FIG. 1 is a diagram showing a configuration example of a monitoring system according to a first example of the present invention.

FIG. 2 is a diagram for explaining an example of a procedure of processing by a difference method.

FIG. 3 is a diagram showing an example of a procedure of processing by a monitoring method using a difference method.

FIG. 4 is a diagram showing an example of a display of an operation screen of the monitoring terminal device.

FIG. 5 is a diagram illustrating an example of an operation in manual imaging.

FIG. 6 is a diagram showing a configuration example of a monitoring system according to a second example of the present invention.

FIG. 7 is a diagram for explaining an example of an operation in automatic imaging.

FIG. 8 is a diagram showing an example of an operation button (an enlarged display position move button) in the monitoring terminal device.

FIG. 9 is a diagram showing an example of an operation button (enlargement ratio change button) on the monitoring terminal device.

FIG. 10 is a diagram showing an example of an operation button (enlargement ratio change pop-up menu) in the monitoring terminal device.

FIG. 11 is a diagram showing an example of a display of an operation screen of the monitoring terminal device.

FIG. 12 is a diagram showing an example of a display of an operation screen of the monitoring terminal device.

FIG. 13 is a diagram showing an example of the correspondence between the number of pixels between an image acquired by imaging and the display unit.

Claims

The scope of the claims

[1] An image generation device that captures an image of a region to be captured and a terminal device that displays an image captured by the image generation device, wherein the image generation device responds to a request signal from the terminal device An image system for transmitting an image to the terminal device in response to the request, wherein the image generation device includes:

An image capturing unit that captures an image of the region to be captured,

A request signal receiving unit that receives the request signal transmitted by the terminal device; and a state in which the request signal is not received by the request signal receiving unit; an image captured by the image capturing unit; A first image transmission unit for transmitting an image of high quality to the terminal device;

In a state where the request signal is received by the request signal receiving unit, an image of a second image quality, which is an image captured by the image capturing unit and is higher in quality than the first image quality, is transmitted to the terminal device. And a second image transmission unit that transmits to the terminal device,

An image receiving unit that receives an image transmitted from the image generation device,

An image display unit that displays an image received by the image reception unit,

A request signal transmission instruction receiving unit that also receives an instruction to transmit the request signal from the user,

A request signal transmission unit that transmits the request signal to the image generation device when an instruction to transmit the request signal is received by the request signal transmission instruction reception unit.

An imaging system, characterized in that:

[2] The imaging system according to claim 1,

An abnormality detection unit configured to detect abnormality based on an image captured by the image capturing unit;

An abnormal image storage unit that stores the image of the second image quality and information about the abnormality detected by the abnormality detection unit in association with each other, The second image transmission unit of the image generation device transmits information related to the abnormality detected by the abnormality detection unit to the terminal device;

The image receiving unit of the terminal device receives information on the abnormality transmitted from the image generation device,

An abnormality information storage unit configured to store information regarding the abnormality received by the image receiving unit;

An abnormality information output unit that outputs information related to the abnormality stored in the abnormality information storage unit.

The request signal transmission instruction receiving unit of the terminal device also receives designation of the information on the abnormality by a user.

The request signal transmission unit of the terminal device transmits the request signal including information on the abnormality, the designation of which has been received by the request signal transmission instruction reception unit, to the image generation device,

The second image transmission unit of the image generation device is configured to display the second image quality image associated with the abnormality information included in the request signal received by the request signal reception unit as the abnormal image. Reading from the storage unit and transmitting to the terminal device;

An imaging system, characterized in that:

[3] In the image system according to claim 1 or claim 2,

The image display unit of the terminal device enlarges an area for displaying the image of the first image quality, an area for displaying the image of the second image quality, and an image portion in the image of the second image quality. Displaying an image on a screen having an area to be displayed on the same screen,

An imaging system, characterized in that:

[4] An image transmitting apparatus for transmitting an image input from an image capturing apparatus that captures an image of an area to be imaged to the terminal apparatus in response to a request signal from the terminal apparatus, the image transmitting apparatus comprising: In a state where the request signal is not received by the request signal receiving unit that receives the request signal, A first image transmitting unit that transmits an image of a first image quality, which is an image captured by the image capturing device, to the terminal device;

In a state where the request signal is received by the request signal receiving unit, an image of a second image quality, which is an image captured by the image capturing apparatus and has a higher image quality than the first image quality, is transmitted to the terminal device. An image transmission device, comprising: a second image transmission unit configured to transmit the image to the image transmission device.

[5] The image transmitting device according to claim 4,

Further, an abnormality detection unit that detects an abnormality based on an image captured by the image capturing device,

An abnormal image storage unit that stores the image of the second image quality and information about the abnormality detected by the abnormality detection unit in association with each other,

The second image transmission unit transmits information on the abnormality detected by the abnormality detection unit to the terminal device,

The request signal receiving unit receives the request signal including information on the abnormality specified by a user of the terminal device,

The second image transmitting unit reads the image of the second image quality associated with the information on the abnormality included in the request signal received by the request signal receiving unit from the abnormal image storage unit, Transmitting to the terminal device,

An image transmitting device characterized by the above-mentioned.

[6] An image display method in an image display device that displays an image received from an image transmission device that transmits an image of an area to be imaged,

Displaying an enlarged image of two or more portions included in the received image on the same screen,

An image display method in an image display device, characterized in that:

[7] In the image display method in the image display device according to claim 6,

Displaying a frame indicating each of the two or more portions included in the received image; displaying the image of the portion indicated by each of the displayed frames in a different frame; An image display method for an image display device, comprising: displaying a correspondence between each of the displayed frames and each of the frames.

[8] In the image display method in the image display device according to claim 6,

Displaying a frame indicating each of the two or more portions included in the received image; displaying the image of the portion indicated by each of the displayed frames in a different frame;

Canceling the designation of the image portion by each of the displayed frames according to a user operation;

An image display method in an image display device, characterized in that:

[9] In the image display method in the image display device according to claim 6,

Initially setting the position of the image to be enlarged and displayed, moving the position of the set image, setting the magnification of the image to be enlarged and displayed,

The image at the position determined by the initial setting and movement of the position of the image to be enlarged and displayed is enlarged and displayed at the set magnification.

An image display method in an image display device, characterized in that:

[10] The image display method in the image display device according to claim 6,

Receiving a plurality of types of image quality images transmitted from the image transmission device,

Of the plurality of types of image quality, the specification of two or more portions is received using an image of any one of the image qualities, and the image is specified using an image of the same image quality or an image of a different image quality. Enlarge and display two or more parts of the image,

An image display method in an image display device, characterized in that:

[11] A program to be executed by a computer constituting an image display device for displaying an image received from an image transmission device for transmitting an image of an area to be imaged,

The computer realizes a function of enlarging and displaying an image of two or more portions included in the received image on the same screen,

A program characterized by that.

[12] In the program according to claim 11,

A function to display frames indicating each of two or more parts included in the received image When,

A function of enlarging and displaying the image of the portion indicated by each displayed frame in a different frame,

A function of displaying the correspondence between the displayed frames and the respective frames is realized by the computer.

A program characterized by that.

[13] In the program according to claim 11,

A function of displaying a frame indicating each of two or more parts included in the received image,

A function of canceling the designation of the image portion by each of the displayed frames according to an operation by a user is realized by the computer.

A program characterized by that.

[14] In the program according to claim 11,

A function of initially setting the position of the image to be enlarged and displayed, moving the position of the set image, and setting an enlargement ratio of the image to be enlarged and displayed;

The computer realizes a function of enlarging and displaying the image at the position determined by the initial setting and movement of the position of the image to be enlarged and displayed at the set magnification ratio by the computer.

A program characterized by that.

[15] In the program according to claim 11,

A function of receiving images of a plurality of types of image quality transmitted from the image transmitting device; and accepting designation of two or more portions using an image of any image quality among the plurality of types of image quality, The function of enlarging and displaying the image of the two or more parts specified above using an image of the same image quality or an image of a different image quality is realized by the computer.

A program characterized by the following.