JPH1185445A - Image display device and method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image display device which is superior in operability and can ensure pleasant operation, by changing the number of image display areas in a window in response to the change of the window size. SOLUTION: This image display device includes a display control means, which displays the images on the image areas included in a window shot on a monitor and a window size changing means, which can instruct for the change of the window size. The display control means changes the number of image display areas in the window in response to the window size. Therefore, the flexible arrangement of windows is secured between a map and the image display areas 2002, 2004, 2006 and 2008 respectively, so that the overlapping display is prevented between the map and image display windows. Thus, it's possible to flexibly deal with the arrangement request of a user. In addition, the number of areas 2002 to 2008 can be increased in a simple operation when the images more than its steady number are temporarily and simultaneously monitored.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image display device and an image display method for displaying image information input from an external device. For example, the present invention relates to a method for displaying image data from a remote communication device connected via a communication network. And an image display method for receiving and displaying the same.

[0002]

2. Description of the Related Art In recent years, with the improvement of communication technology and computer performance, an image communication system for receiving and displaying image data and the like from a remote communication device connected via a communication network has been used. In such a system, a device that transmits image data includes, for example,
Equipped with a plurality of video cameras, a synthesizer that synthesizes the images captured by those video cameras in analog form, and a device called a switcher that can select any of the images, used in a relatively small building It is called a local monitoring system. In addition to this local monitoring system, a remote monitoring system that uses a digital communication network such as a so-called LAN or ISDN instead of an analog cable for a video transmission path and is capable of greatly extending the transmission path is being developed.

[0003] In a remote monitoring system, an IBM-PC compatible machine (PC) or the like is used as a monitoring device.
physical User Interface (GU
Techniques for realizing video display and system control according to I) have also been proposed. The use of a computer GUI for the monitoring device has the advantage that an unskilled user can easily operate the monitoring device.

[0004]

However, in such a system, the map display area and the video display area on the monitor of the monitoring device are displayed in an overlapping manner, and the advantage of operability is impaired. Sometimes.

[0005] Further, the position when displaying on the monitor is
In some cases, such measures are fixedly assigned to specific positions in the video display area of the monitoring device or the number of images that can be displayed is limited, but this impairs the operability of a user who is a monitor. .

Accordingly, an object of the present invention is to provide an image display device and an image display method which are excellent in operability and can be operated comfortably.

[0007]

In order to achieve the above object, an image display device according to the present invention has the following features.

That is, display control means for displaying image information input from an external device in an image display area of a window displayed on a monitor for each external device, and a window capable of instructing a change in the size of the window. A size changing unit, wherein the display control unit changes the number of image display areas in the window according to a change in the size of the window by the window size changing unit.

Also, for example, the display control means reduces the number of image display areas displayed in the window when the size of the window is changed to a small size by the window size changing means.

Preferably, the apparatus further comprises communication means for communicating with the external device according to the number of image display areas to be displayed in the window.

Further, for example, the display control means displays the image display area reduced by the size change in another window on the monitor different from the window.

Alternatively, in order to achieve the above object, an image display method according to the present invention has the following configuration.

That is, a display control step of displaying image information input from an external device for each of the external devices in an image display area in a window displayed on a monitor is provided. When the size change is changed, the number of image display areas in the window is changed according to the change in the size of the window.

Further, for example, in the display control step, when the size of the window is changed to a small size, the number of image display areas displayed in the window is reduced.

Preferably, the method further includes a communication step of performing communication with the external device according to the number of image display areas displayed in the window.

Also, for example, in the display control step, the image display area reduced by the size change is displayed in another window on the monitor different from the window.

[0017]

BEST MODE FOR CARRYING OUT THE INVENTION

[First Embodiment] Hereinafter, an embodiment of an image communication system according to the present invention will be described in detail with reference to the drawings.

FIG. 1 is a block diagram showing an overall outline of a communication system including an image communication system as a first embodiment of the present invention.

In FIG. 1, reference numeral 10 denotes a video camera as a device for generating a video signal based on a captured image. 2
Reference numeral 0 denotes a workstation (WS) or a personal computer that transmits an image signal from the video camera 10 to the monitoring device 60 as an image display device and receives a control signal for controlling the video camera 10 from the monitoring device 60. It is a video transmission device. Reference numeral 60 denotes a monitoring device such as a workstation (WS) or a personal computer that receives an image signal from the video transmission device 20 and transmits a control signal for controlling the video camera 10 to the video transmission device 20.

A plurality of video transmitting devices 20 and monitoring devices 60
Can communicate with each other via a network 100. Preferably, the video transmitting device 20
The image signal from 0 is subjected to analog / digital (A / D) conversion, and the obtained digital image data is compressed and transmitted to the monitoring device 60 via the network 100.

Reference numeral 12 denotes a camera control circuit that controls operations of the video camera 10 such as pan, tilt, zoom, focus adjustment, and aperture in accordance with a control signal (control code) from the video transmission device 20. This control signal is transmitted from the input / output interface 32 of the video
Input to the camera control circuit 12 based on a standard such as -232C.

When the video camera 10 does not perform operations such as panning and tilting, the camera control circuit 12 is not always necessary. However, it is preferable that the power of the video camera 10 be controlled to be turned on and off. .

<Video Transmitting Apparatus 20> Next, the configuration of the video transmitting apparatus 20 will be described. 24 is the main memory, 26
Is a storage device such as a hard disk. Reference numeral 28 denotes a mouse as a pointing device, but is not limited to a mouse, and may be another device such as a touch panel on the display 35. Reference numeral 30 denotes a keyboard as input means. 25 is a floppy disk, CD-
This is an external storage device from which a storage medium such as a ROM can be removed. Reference numeral 32 denotes an input / output (I / O) interface for connecting the camera control circuit 12 and transmitting and receiving control signals for the video camera 10. Reference numeral 34 denotes a video capture board that captures a video output signal VD of the video camera 10. The video output signal may be an analog signal such as general NTSC or a digital signal. In the case of an analog signal, the video output signal needs to have a function of performing A / D conversion. Reference numeral 36 denotes a video board that acquires the video captured by the capture board 36 via the bus 39 and displays the video at an arbitrary position on the bitmap display 35. A network interface 38 communicates with the monitoring device 60 via the network 100. These devices are interconnected by a system bus 39, and the CPU 22 controls the entire video transmission device 20 according to software stored in a storage medium or storage device 26 or software obtained via the network 100. And the display of the bitmap display 35 is controlled.

If the video capture board 34 does not have a data compression function, software for realizing the function may be prepared, and the CPU 22 may perform data compression processing.

The image data taken by the video camera 10 is transmitted to the remote monitoring device 60 via the network 100 by the video transmitting device 20 having the above configuration. Further, the video camera 10 is controlled according to a control code received from the monitoring device 60.

<Monitoring Device 60> Next, the device configuration of the monitoring device 60 will be described. The description of the same device as the video transmission device 20 in the configuration of the monitoring device 60 is omitted, but the network interface 138 receives the compressed image data from the video transmission device 20. Then, the CPU 122 demodulates the received data (encoded data) by the video compression decoder 33,
A video board 13 based on the demodulated image data
6 controls the bitmap display 1
An image captured by the video camera 10 and a state of the video camera 10 are displayed on 35. In addition, the CPU 122 allows the user of the monitoring device 60 to operate the keyboard 130 or the mouse 128.
And transmits a control code for controlling the video camera 10 to the video transmission device 20 in accordance with the input data.

Next, the video transmitting apparatus 2 in the present embodiment
0 and the software of the monitoring device 60 will be described.
It goes without saying that the software described below is executed by the hardware of the video transmission device 20 or the monitoring device 60 described with reference to FIG.

FIG. 2 is a diagram for explaining the main software configuration of the video transmitting device 20 and the monitoring device 60 according to the first embodiment of the present invention.

First, the software executed by the monitoring device 60 will be described. 411 is the video transmission device 20
Is camera control client software for remotely controlling the video camera 10 connected to the camera. Reference numeral 412 denotes video reception software for demodulating and displaying the compressed image data transmitted from the video transmission device 20 in the form of a packet.
The video receiving software 412 is connected to the network 10
0 is software that manages image data received from all the video transmission devices 20 (video cameras 10) connected to the camera 0, the camera ID of each camera, and the host ID of the video transmission device 20 to which the camera is connected. , Pan / tilt, zoom, etc., camera operation status, information on whether the camera is controllable, etc., and current camera information, such as which camera is currently being controlled and which camera image is being displayed. It has a function of storing information indicating a state in the monitoring device 60. Note that the camera control client software 411 and the map management software 413 also share such information, and are used for changing the display of the camera symbol and the like. A GUI 413 graphically displays the position of the video camera 10, pan and zoom, and controls the operation of the video camera 10 using a map, camera symbols, and a scope display shown in FIG.
(Graphical user interface) This is map management software having a function. The monitoring device 60 has these software installed in the storage device 26 in advance.

Next, the software executed by the video transmission device 20 will be described. 421 controls the operation state of the video camera 10 connected to the video transmission device 20, such as pan / tilt, zoom, and white balance 422, and transmits image data output from the video camera to the video transmission device 20. Camera control server software for importing to the camera. Reference numeral 422 denotes video transmission software that operates in conjunction with the camera control server software and transmits video to the monitoring device 60 that is currently controlling the video camera 10. In the video transmission device 20, these softwares are installed in the storage device 126 in advance.

In addition to the above software, bidirectional communication via the network 100 and storage devices 26 and 1
Needless to say, it has software for controlling the external storage devices 26 and the external storage devices 25 and 125.

<User Interface> Next, a user interface according to the present embodiment, that is, a screen displayed on the bitmap display 135 will be described.

FIGS. 3 and 4 are diagrams showing examples of display of the monitoring device according to the first embodiment of the present invention.
It is an example of a screen displayed on a 0 bitmap display 135. In FIG. 3, reference numeral 500 denotes a map window on which a map is displayed. In this embodiment, a plurality of maps 520, 530, 540,... Showing layouts of offices, stores, and warehouses are managed. Each map is tagged with a mouse.
By clicking on, the map with the tag is displayed in the front row (map display area 502). At this time, a camera symbol is also displayed on the map.

FIG. 3 shows a state in which a map 520 of the maps 510 to 540 is displayed in the map display area 502. Camera symbols 521, 522, and 523 as icons arranged on the map 520 are shown. ... is displayed. At this time, if a tag on the map 530 is clicked, FIG. 4 is displayed.

As shown in FIG. 4, a map 530 is displayed in the map display area 502, and camera symbols 531 and 532 are displayed on the map 530.

FIG. 5 is a view showing a display example of a window for displaying an image from a video camera according to the first embodiment of the present invention. As shown in the figure, in a window 600 for displaying an image of the video camera 10, images captured by the video cameras 10 are displayed in a plurality of video display areas 610 to 620, respectively. Reference numeral 632 denotes a trash can icon for deleting a displayed image from the video display area. Reference numeral 640 denotes a video camera control panel, which includes various camera control buttons of the video camera 10 and can control pan / tilt and zoom of the selected camera.

In the present embodiment, six regions are shown as an example, but the present invention is not limited to this. Also,
It may be displayed on the same screen as the window shown in FIG. 3 or FIG.

Next, a graphical user interface GUI according to the image communication system of the present embodiment will be described with reference to FIGS. In the present embodiment, the camera icons on the maps 520, 530,... Are dragged to any video display area in the video display window.
By performing an & drop operation (hereinafter referred to as D & D), a moving image from the video camera corresponding to the drag & drop icon is displayed in the dropped video display area.

FIG. 6 is a diagram showing a state in which display is performed by a D & D operation according to the first embodiment of the present invention.
It is a state when it did. FIG. 7 is a diagram illustrating a mouse cursor of the video camera during a D & D operation according to the first embodiment of the present invention. FIG. 8 is a diagram showing a state when the display area is changed by the D & D operation according to the first embodiment of the present invention. FIG. 9 is a diagram illustrating a camera icon indicating that a captured image is being displayed according to the first embodiment of the present invention. FIG. 10 is a diagram showing a state of an operation for stopping display by a D & D operation according to the first embodiment of the present invention.

In this embodiment, during the D & D operation, the shape of the mouse cursor changes to the shape of the camera shown in FIG.
The user can confirm that the drag and drop operation is being performed. At this time, the map management software 413 searches the ID information of the dragged camera from the position information of the dragged camera, notifies the video receiving software 412 of the ID of the D & D camera, and the video receiving software uses the ID from the ID. The pan / tilt of the camera, the name of the camera, and the host name to which the camera is connected are searched, and the information is retrieved from the camera control client software 41.
1. Notify the map management software 413.

Camera control client software 41
1 is the video camera 10 according to the notified information.
A connection is established by communication with the camera control server software 421 of the video transmission device 20 connected to the video transmission device 20 via the network 100. Thereafter, the operation control of the video camera 10 connected to the video transmission device 20 is performed between the camera control client software 411 of the monitoring device 60 and the camera control server software 421 of the video transmission device 20. Information such as pan / tilt is notified from the camera control client software 411 to the video receiving software 412 at predetermined time intervals.

The map management software 413 updates the map stored in the video board 136 to change the orientation of the camera icon so as to correspond to the actual orientation of the video camera 10 or to update the map shown in FIG. Draws the scope 910 indicating that the image captured by the video camera 10 is being displayed as shown in FIG.
In 0, a control pointer 920 for controlling the pan / tilt and zoom of the camera is drawn.

Further, the map management software 413 includes:
Information such as pan / tilt of the camera is notified from the video receiving software 413 at predetermined time intervals. When the state of the camera such as pan / tilt and zoom is changed by the camera control panel 640, the change is performed by the camera icon. 521,5
., 532, 533,...

The transmission of the actual image data from the video transmission device 20 is performed by the video reception software 412 of the monitoring device 60.
Done by request from Video receiving software 4
12 is connected to the video transmission software 422 of the video transmission device 20 to which the camera 10 is connected.
A command for requesting transmission of data for one frame is transmitted via the “0”. Video transmission software 422
Receives the request command, divides the latest captured frame data into packets, and transmits the packets to the video reception software 412. Video receiving software 412
Reconstructs an image frame from the packet, displays the frame in the video display area, and transmits a video transmission request command again. By performing this repetition at a high speed, a remote image is transmitted and displayed via the network 100. As a result, an image captured by the video camera 10 installed at a remote location is displayed on the bitmap display 135 of the monitoring device 60.

When displaying the imaging screens of a plurality of video cameras 10, a video transmission request command is issued to the video transmission software of the video transmission device 20 to which each video camera is connected, and the captured video is displayed. Compression, packet division, network transmission, packet reception,
This is realized by repeating the processes of frame reconstruction, compression / decompression, and display in order.

The movement of the display position of the video image of the video camera can be realized by performing a D & D operation on the image display area to be moved, as shown in FIG. FIG. 8 shows a state in which the video of the video camera 523 displayed in the video display area 614 has been moved to 612. At this time, the video receiving software 412 clears the video display area and changes the internal parameters as a D & D operation destination as an area for displaying the video of the video camera 10. Thereafter, the video of the video camera 10 is displayed on the D & D operation destination. This operation does not disconnect the logical network connection. That is, the communication network once connected is
As will be described later, the video display area in which the image is displayed is not disconnected until the D & D operation is performed on the trash can icon 632.

When the display of the video camera image is to be stopped, as shown in FIG.
By performing a D & D operation on the image display area in which the image 0 is displayed on the trash can icon 632 in the image display window, the display of the image can be stopped.
FIG. 10 shows a state after the display of the video of the video camera 523 displayed in the video display area 614 is stopped. At this time, the video reception software 412 clears the video display area and stops issuing the video transmission request command to the video transmission software 412 of the video transmission device 20 that has been connected so far. Further, the video receiving software 412 notifies the camera control client software 411 and the map management software 413 that the display has been stopped.

The camera control client 411 receives the notification of the display suspension, disconnects the network connection with the video transmitting apparatus 20, and clears the video display area.
The map management software 413 removes the scope display from the camera icon 523 of the camera and updates the map.

According to the system of the present embodiment described above, (1) the camera symbol on the map is displayed in the video display area by D & D
By moving by operation, a logical network connection between the monitoring device 60 and the video transmission device 20 can be established. (2) The video display area where the video camera video is displayed can be moved to another arbitrary video display area by a D & D operation. (3) The logical network connection can be disconnected by moving the video display area where the video camera video is displayed to the display stop symbol by a D & D operation. Thereby, the display position when displaying the image captured by the video camera 10 on the monitoring device 60 can be easily arranged at a position desired by the user, or the bitmap display 1
35, it is possible to select the video of the video camera to be displayed at the same time, so that the user can easily operate the system.

<Description of Software> Next, software for realizing the operation of the above-described embodiment will be described.

(Overall Overview of Software) FIGS. 11 to 13 are flowcharts showing the overall operation of the monitoring apparatus according to the first embodiment of the present invention, which is performed by the CPU 122 of the monitoring apparatus 60. Hereinafter, FIGS. 11 to 1
Step 3 will be described.

Step S100: The map window 500 shown in FIG. 3, for example, is displayed on the bitmap display 135 by the map management software 413.

Step S102: An image window 600 shown in FIG. 5, for example, is displayed on the display 135 by the image receiving software 412.

Step S104: The camera control panel 640 shown in FIG. 6 is displayed on the display 135 by the camera control client software 411.

Step S106: It is determined whether or not any of the camera icons displayed on the map window shown in FIG. 3 has been clicked. If so, the process proceeds to step S108; if not, the process proceeds to step S108. Proceed to S112.

In the above description, step S100,
Steps S102 and S104 are executed separately, but step S100 may call and execute the routine of steps S102 and S104.

Step S108: The focus of the map window corresponding to the clicked camera icon is switched. That is, the selected camera is determined.

Step S110: A map display processing routine to be described later is started (details will be described with reference to FIG. 14).

Step S112: It is determined whether or not a desired image has been clicked among the images displayed in the image window 600 shown in FIG. If clicked, the process proceeds to step S114. If not clicked, the process proceeds to step S120.

Step S114: When an image is clicked, it is determined whether or not the position of the camera that generates the clicked image signal is displayed in the map window shown in FIG. If the map is not displayed, an instruction is given to the map management software 413 to switch the map so that the map including the camera is displayed in the window shown in FIG.

Step S116: Similar to step S108, the focus of the camera corresponding to the clicked image is switched.

Step S118: A display movement stop processing routine is started (the details will be described later with reference to FIG. 16).

Step S120: It is determined whether or not the camera control panel 640 shown in FIG. 3 has been clicked. When clicked, the flow branches to step S122.

Step S122: Camera control panel 64
The command designated from 0 is transmitted via the network 100 to the actual video camera 10 corresponding to the clicked camera icon.

Step S124: It is determined whether any of the tags 510 to 540 in the map shown in FIG. 3 has been clicked. If clicked, step S126
Proceed to. If not clicked, the process proceeds to step S128.

Step S126: Tag 510 in Map
An instruction is sent to the map management software 413 so as to display a map corresponding to the map clicked on any one of 540 to 540.

Step S128: It is determined whether or not there is an image specified by D & D as an image to be displayed on the map displayed on the bit map display 135. If there is a designated video, the process proceeds to step S130; if not, the process proceeds to step S13.
Proceed to 6.

Step S130: If there is an image specified in step S128, a packet including an image request command is sequentially transmitted to the video camera 10 (image transmitting device 20) corresponding to the image, and The requested video transmitted from the video transmission device 20 is displayed on the bitmap display 135.

Step S132: Grouping button 65
It is determined whether 0 has been clicked. If it is clicked, the process proceeds to 134. If not clicked C (Fig. 1
Proceed to 4).

Step S134: The video cameras 10 transmitting the camera images on the bitmap display 135 are grouped and a group icon is formed.

Step S136: It is determined whether or not the group icon has been clicked. If the group icon has been clicked, the process proceeds to step S138. If not, the process returns to B (FIG. 11).

Step S138: As soon as the group icon is clicked in step S136, the clicked group icon is highlighted.

Step S140: It is determined whether or not a display of a group icon has been instructed. If it is displayed, the flow proceeds to the group display processing of step S142. This group display processing will be described later with reference to FIG. On the other hand, if the display instruction has not been issued in step S140,
Proceed to step S144.

Step S144: Delete group button 6
It is determined whether or not 51 has been clicked. When clicked, the process proceeds to step S144. If not, the process returns to B in FIG.

Step S146: Delete the specified group.

(Map Display Processing Routine) FIGS. 14 and 1
FIG. 5 is a flowchart showing the processing of a map display processing routine according to the first embodiment of the present invention.
4 is a flowchart illustrating details of processing in 110. As shown in FIG. 14 and FIG. 15, the map display process
The three types of software included in the monitoring device 60, namely, camera control client software 411, video reception software 412, and map management software 41
3 is realized by exchanging data with each other.

Step S150: First, it is determined whether or not the displayed camera icon has been dragged.
Incidentally, in this flow, in step S10 in FIG.
If the camera icon has been continuously clicked by the user from step 6 to this step, the process proceeds to step S151. On the other hand, if the click has been released by the user, this step ends and returns to the original routine.

Step S152: It is determined from the state of the click button of the mouse 128 whether or not the camera icon (FIG. 7) has been dropped. It is determined whether or not the dropped camera icon has been dropped on any of the video display areas 610 to 620 shown in FIG. In this determination, the map management software 413 determines whether the video display area 61
The respective areas 0 to 620 are compared with the coordinates where the camera icon is dropped. If the mouse cursor is dropped inside the area, the process branches to step S154. If the mouse cursor is dropped outside the area, the process branches to step S168, and the mouse cursor is restored. That is, the state returns to the state before the camera icon was dragged in step S150.

Step S154: The map management software 412 determines whether or not the dropped area is displaying an image. Map management software 412
Manages which of the above-described video display areas 610 to 620 is displayed by which camera from which image is displayed in the table memory at predetermined time intervals. If it is being displayed, the process proceeds to step S156. On the other hand, if it is not being displayed, the process branches to step S158.

Step S156: If the dropped area is already displaying an image, the display of the displayed image is stopped.

Step S158: ID (identification information) of the camera D & D performed by the video receiving software 412 in FIG.
Notify.

Step S159: The video receiving software 412 determines the network address, host name, camera name,
A parameter indicating the state of the camera is acquired from the main storage device 124. This parameter includes focal length information,
Includes white balance and shooting direction data.
The main storage device 124 stores parameters indicating the network addresses, host names, camera names, and camera statuses of all the video transmission devices 20 constituting the system.

Step S160: The data acquired in step S159 is output to the map management software 413 and the camera control client software 411.

Step S162: Based on the data obtained in step S160, for example, the scope display 580 of the video camera (FIG. 6), that is, the angle of view taken by the camera is the direction in which the information camera of the focal length faces. Is displayed on the map.

Step S164: The camera control client software 411 communicates with the camera control server software 421.

Step S166: In order to receive a video signal from the selected video camera 10, a command is issued to the video reception software 412 to transmit a video request command to the selected video camera 10. After transmitting the video request command to the selected camera, the video reception software 412 repeatedly issues the video request command at a predetermined cycle until the transmission of the video signal is stopped in step S178 described later. As a result, the video signal of the repeated frame is output from the video camera 10, and the moving image can be reproduced on the bitmap display 135.

Step S168: The mouse cursor moved by the D & D operation is returned to the original position.

(Display Movement Cancel Processing Routine) Next, FIG.
The display movement stop processing routine shown in Step S118 of FIG. 1 will be described with reference to FIGS.

FIGS. 16 to 18 are flowcharts showing a display movement stop processing routine according to the first embodiment of the present invention. Also in this case, the three types of software included in the monitoring device 60, that is, the camera control client software 411, the video reception software 412, and the map management software 413, are realized by exchanging data with each other.

Step S170: It is determined whether or not the image clicked in step S112 is still being clicked. If the click has been continued, the process proceeds to step S172, and if the click has already been released, this routine ends.

Step S172: The mouse cursor is changed to the shape of the camera icon shown in FIG. 7, for example, as in step S151.

Step S174: It is determined whether or not the image dragged with the mouse cursor is dropped on the trash can icon 632. If the icon is dropped on the trash icon 632, the process proceeds to step S176. On the other hand, if it is not dropped on the recycle bin icon 632, the process proceeds to step S
Proceed to 182.

Step S176: Recycle bin icon 632
When the image is dropped on the image display area, the image display area on which the D & D operation has been performed is cleared and nothing is displayed, or the display is changed to a blue screen.

Step S178: The issuance of the video transmission request command to the video transmission device 20 (video camera 10) which has transmitted the video cleared in step S176 to the video reception software 412 is stopped. Thereby, the video transmission device 20 stops the communication of the video signal.

Step S180: Map management software 413, camera control client software 411
Is notified that the display on the bitmap display 135 is stopped, and the process proceeds to step S192.

Step S182: If the camera image has not been dropped on the trash can icon 632 in step S174, the camera image is displayed in the image display area 610-610.
620 is determined.

Step S184: Step S1 described above
The same processing as 52 is performed.

Step S186: Step S1 described above
The same processing as 54 is performed.

Step S188: The video signal of the video camera 10 operated for D & D is displayed at the dropped video display position.

Step S190: The video signal in the area where the video signal of the camera was displayed before is cleared.

Step S192: The scope display of the camera displayed in step S162 is deleted.

Step S194: The camera control client software 411 stops communication with the camera control server software 421 in the video transmission device 20.

Step S196: Step S1 described above
The same processing as 68 is performed.

For example, when the display of the video at 523 in FIG. 6 is stopped, the video reception software 412 clears the video display area and issues a video transmission request command to the video transmission software 412 of the corresponding video transmission device 20. Stop issuing. Further, it notifies the camera control client 411 and the map management software 413 that the display has been stopped.

Upon receiving this notification, the camera control client 411 disconnects the network connection with the camera control server software 421 and clears the video display area. Further, the map management software 413 removes the scope display from the camera icon 523 of the camera,
Update the map.

<Process for Changing Number of Video Display Areas>
Means for changing the number of video display areas in the present embodiment will be described.

The number of video display areas is changed in accordance with a change in the size of the video display window (hereinafter, resizing). The resizing of the video display window can be realized by the same resizing operation as in a normal window system.

FIG. 19 is a view showing an example of a window displayed on the bitmap display 135 according to the first embodiment of the present invention. In FIG.
Reference numerals 02, 2004, 2006, and 2008 denote areas for resizing the map display window in the up, down, left, and right directions, respectively, and the area can be resized in each direction by performing a D & D operation. Needless to say, resizing may be performed by other means.

[0109] The resizing is performed for 200 pixels in the video display area.
2, 2004, 2006, and 2008 are performed in the smallest unit. If the resize displacement is smaller than the video display area, no resize is performed.

FIG. 26 is a flowchart for explaining a resizing processing procedure according to the first embodiment of the present invention.

In the figure, first, when a request for resizing the video display window is issued (step S270).
1), current window sizes X0 and Y0 (X0 is the size of the window in the X direction, Y0 is the size of the window in the Y direction), and resize request sizes X1 and Y1 (X1 is the size of the window in the X direction; Calculate differences Xd and Yd from Y1 (the size of the window in the Y direction) (step S2).
702).

Next, the ratio between the difference Xd, Yd and the size Xv, Yv of the image display area is determined for both XY axes, and the fractional part is truncated. Resizing is performed by an amount obtained by multiplying these values by Xv and Yv, respectively (step S2703). In other words, if the difference between the resize request size and the current window size is less than the size of the video display area,
The size of the window is not changed regardless of the resize request.

In this way, resizing in units of the size of the video display area can be realized. When resizing, the size of the window may be reduced. From step S2704 to step S2007,
The image obtained from the video camera 10 that outputs the image displayed in the deleted area by deleting the video display area where the video is being displayed by resizing the image,
This is a process performed when data is erased from the bitmap display 135. That is, in steps S2705 and S2707, the logical network connection between the video transmitting apparatus 20 transmitting the video and the monitoring apparatus 60 is disconnected.

FIG. 20 shows the displacement of the size of the video window when the video display window having 2 × 3 = 6 video display areas is resized to be large as the first embodiment of the present invention. It is an example. In this example,
The user changed the size of the image display window using the pointing device 128 to change the size of the image display window 2100 to the size 2102. In step S2703 in FIG. As a result, a part of the size difference is discarded, and as a result, the image is resized to a 2104 3 × 3 = 9 video display window having a video display area.

FIG. 21 shows an example of the first embodiment of the present invention in which a video display window having 2 × 3 = 6 video display areas is resized to be small. In this example, initially, an attempt was made to change the size of the video display window of 2200 to the size of 2202, but the displacement was truncated to make the size of the video display area the minimum unit, resulting in 2204. As shown in the figure, the size is changed to the size video display window having the video display area of 2 × 3 = 6 which is the same as the first time.

In this embodiment, since the image display window is rectangular, x = 1, 2,..., Y = 1, 2,.
Can be resized to a size having a video display area of a number corresponding to an arbitrary result of X and Y represented by.

The maximum number of displayable video display areas is m
× n. m and n are not particularly limited as long as each is a natural number of 1 or more. However, in reality, the number of video display areas that can be displayed is limited depending on the resolution of the bitmap display 135 of the monitoring device 60, and the values of m and n are determined accordingly.

[Second Embodiment] The second embodiment is a modified example of the method of rounding the displacement at the time of resizing in the first embodiment. In the first embodiment, the resizing of the image display window is performed in such a manner that the displacement in the X and Y axes directions is rounded down to the minimum unit, that is, the portion less than the size of the image display area. Do. For this reason, in the present embodiment, in step S2703, int ((xd / xv) × Xv
+1) and int ((xd / xv) × Xv + 1).

FIG. 22 shows an example of resizing a video display window having 2 × 3 = 6 video display areas according to the second embodiment of the present invention. In the present embodiment, it is shown that by performing the round-up process in the same manner, the image is resized to a video display window having a video display area of 4 × 3 = 12, such as 2304. Other processes are the same as in the first embodiment, and a description thereof will not be repeated.

[Third Embodiment] In the third embodiment, the first embodiment and the second embodiment are combined, and the processing for large resizing and the processing for small resizing are changed. When resizing large, a round-up process as shown in FIG. 22 is performed, and when resizing small, a round-down process as shown in FIG. 21 is performed.
Other processes are the same as in the first embodiment, and a description thereof will not be repeated.

[Fourth Embodiment] In the fourth embodiment, the first embodiment and the second embodiment are combined, and the processing for large resizing and the processing for small resizing are changed. When resizing large, a round-down process as shown in FIG. 20 is performed, and when resizing small, a round-up process as shown in FIG. 23 is performed.

FIG. 23 shows an example of resizing a video display window having 2 × 3 = 6 video display areas as a fourth embodiment of the present invention. In the present embodiment, it is shown that the image is resized to an image display window having an image display area of 1 × 3 = 3, such as 2304, by performing a round-up process when the image is resized smaller. Other processes are the same as in the first embodiment,
Description is omitted.

[Fifth Embodiment] FIG. 24 is a diagram showing an input window for the number of video display areas according to a fifth embodiment of the present invention. This embodiment is an example in which the number of video display areas is directly input. This is determined by inputting the respective numbers of X and Y in the dialog box shown in FIG. Other processes are the same as in the first embodiment, and a description thereof will not be repeated.

[Sixth Embodiment] The sixth embodiment is an example in which the video display area is handled in a manner exceeding the limit depending on the resolution of the bitmap display 135 of the monitoring device 60 in the first embodiment. .

More specifically, the video display window is provided with scroll bars in both the X and Y axes to eliminate the restrictions on m and n.

FIG. 25 is a diagram showing a sixth embodiment of the present invention when resizing in an environment where m, n = 4, 4, x, y = 2.2. In the figure, assuming that all the video display areas are displaying video, the video transmission device 20 that is in charge of the video in the area other than the actually displayed areas 2520, 2521, and 2525 transmits the video. It is useless. That is, the communication traffic with the video transmitting apparatus 20 that transmits the video of the video camera 10 that cannot be displayed on the bitmap display 135 not only wastes the network 100 and the common resources of the present system but also flows on the network. Since the amount of image data increases, it may be difficult to transmit necessary information over a network. Also, the CPU 12 of the monitoring device 60
2, the smooth processing is prevented and the user's monitoring behavior is hindered.

However, if the logical network connection with the video transmitting device 20 in charge of the video in the video display area is disconnected, the disconnection processing, the reconnection processing, and the like when scrolling are increased. . The measures of this embodiment for preventing such a problem will be described with reference to FIG.

FIG. 27 is a flowchart showing scroll processing of a video window according to the sixth embodiment of the present invention. As shown in the figure, when the image display area during image display is scrolled (step S2801)
Determines whether the video display area is no longer displayed (scrolled out) (step S280)
2).

If the user scrolls out in step S2802, the logical network connection is continued, and the issuance of the video transmission request command from the monitoring device 60 to the video transmission device 20 is interrupted (step S2803). And
When those image display areas are displayed again by the scroll processing (step S28).
04), the monitoring device 60 resumes issuing the video transmission request command to the video transmission device 20 (step S28).
05). Then, scroll processing is performed in the direction specified by the user, and the image display area is displayed accordingly (step S2807).

By performing the above processing, it is possible to reduce communication traffic on the network and to reduce the load on the monitoring device 60, and it is possible to handle the GUI smoothly and comfortably. Furthermore, when the video of the video camera 10 that has been cleared by the scrolling process of the video display area is displayed again, the necessary video of the video camera can be immediately displayed. Other processes are the same as in the first embodiment, and a description thereof will not be repeated.

[Seventh Embodiment] Next, in a seventh embodiment, a description will be given of handling of a video display area which is deleted when the video display window is resized in the first embodiment.

More specifically, when the video display window is resized to a smaller size and the video display area being displayed is deleted, another video display window is newly displayed on the bitmap display 135, and the display window is displayed. The deleted video display area is displayed in the window.

FIG. 31 is a flowchart illustrating a processing procedure when resizing is performed according to the seventh embodiment of the present invention.

In the figure, first, when the size of the video display window having m × n video display areas is reduced to x × y (step S3110), first, the values of m and x are compared. (Step S3111). At this time, if x is smaller than m, it means that the size of the window is (mx) columns smaller than the size of the initial window, and therefore, the number of image display areas is reduced (mx) × n. Display a new window. Then, the video in the deleted video display area is continuously displayed in a new window without disconnecting the network connection with the video transmission device 20 (step S3112). When x and m have the same value, the above resizing process is not performed.

Next, the values of n and y are compared (step S3).
113) If y is smaller than n, it means that the size of the window is (ny) rows smaller than the size of the initial window, so that the window having the reduced x × (ny) image display areas Is newly displayed. Then, the video in the deleted video display area is continuously displayed in a new window without disconnecting the network connection with the video transmission device 20 (3114). If y and n have the same value, the resizing process is not performed.

FIG. 28 shows display windows of m, n = 3, 3 according to the seventh embodiment of the present invention, and x, y = 2, 3
FIG. 3 is a diagram showing a state where the image is resized. In FIG. 28, the video display area (281
2, 2815 and 2818) are respectively displayed in the newly displayed window. The newly displayed window has a size of (mx), n = 1,3.

FIG. 29 shows a display window of m, n = 3, 3 according to the seventh embodiment of the present invention, where x, y = 3, 2
FIG. 3 is a diagram showing a state where the image is resized. In FIG. 29, the image display area (291
6, 1917 and 2918) are respectively displayed in the newly displayed windows. The newly displayed window has a size of m, (ny) = 3,1.

FIG. 30 shows a display window of m, n = 3, 3 according to the seventh embodiment of the present invention, where x, y = 2, 2
FIG. 3 is a diagram showing a state where the image is resized. In FIG. 30, the image display area (301) deleted by resizing
2, 3015, 3016, 3017 and 3018)
Each is displayed in a newly displayed window. The two newly displayed windows have the sizes of (mx), n = 1, 3, x, (ny) = 2, 1, respectively.

<Effects of Each Embodiment> According to each of the above-described embodiments, the means for resizing the video display window and changing the arrangement and number of the video display areas as in the first embodiment is provided. It is possible to flexibly arrange the image display area and the map in a window, and to prevent the map window and the image display window from being displayed in an overlapping manner. become. For example, in the case of a horizontally long map, the image display area is set to 4 × 1, and the image display window is arranged at the upper or lower part of the screen. By arranging the image display windows on the left or right of the screen, it is possible to display the same number of images even if the shape of the map is different.

Furthermore, since the minimum unit of the resize is set to the size of the image display area unit, the image displayed on the bitmap display 135 always displays the entire image display area, so that clipping processing is performed. There is no need, and the load on the monitoring device 60 can be reduced.

When it is desired to perform monitoring simultaneously and temporarily beyond the number of stationary images, the number of image display areas can be added by a simple operation.

In the resizing process of the video display window, if the user wants to always change the number of video display areas when performing resizing, the user may perform the first truncation process.
Use in the embodiment. For such a user, the operability is improved by using the second embodiment in which the number of video display areas is always changed when the resizing process is performed.

When the size of the video display area is large, the first
In the embodiment, when performing resizing, the drag distance of the mouse becomes longer. The fifth embodiment is effective for a user who is inconvenient in such a point.

In the first to fifth embodiments, when the video display window is reduced and the number of video display areas is reduced,
The logical network connection with the video transmitting device 20 that has transmitted the video is cut off for the video display area in which the video is being displayed that has been deleted from the bitmap display 135. Thereby, the communication traffic of the network 100 and the load on the CPU 122 of the monitoring device 60 can be reduced.

In the sixth embodiment, the limitation on the display area that can be handled by using the scroll bar is removed.

The number of video display areas to be handled is
There is an advantage that the size of the video display window can be fixed and reduced without exceeding the limit imposed by the resolution of the bitmap display 135 of 0. This is advantageous when dealing with large maps.

Further, only the issuance of the transmission request command is interrupted without disconnecting the logical network connection with the video transmission device 20 that transmits the video that is no longer displayed in the video display window by the scroll process. And
Since the control for restarting the issuance of the transmission request command is performed when the display is resumed by the user's scroll processing, the reconnection processing of the logical network accompanying the scroll processing is unnecessary, and the network 1
00 can be reduced, and the load on the CPU 122 of the monitoring device 60 can be reduced. Thereby, it is possible to provide a GUI that allows more comfortable operation.

In the seventh embodiment, the bit map display 135 is reduced by reducing the size of the video display window.
The video display area deleted from above is newly displayed as another video display window. Thereby, the video transmission device 2 that transmits the video whose video display area has been deleted once
It is possible to resize the display window without disconnecting the network connection to 0. Such a configuration is effective for a user who feels inconvenience that the video display area is deleted due to resizing of the display window.

[Other Embodiments] The present invention relates to a plurality of devices (for example, a host computer, an interface device,
The present invention may be applied to a system including a reader, a printer, or the like, or may be applied to an apparatus (for example, a copying machine, a facsimile machine, or the like) including one device.

Further, an object of the present invention is to supply a storage medium storing a program code of software for realizing the functions of the above-described embodiments to a system or an apparatus, and to provide a computer (or CPU) of the system or the apparatus.
And MPU) read and execute the program code stored in the storage medium.

In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention.

As a storage medium for supplying the program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD
-R, magnetic tape, non-volatile memory card, ROM, etc. can be used.

When the computer executes the readout program code, not only the functions of the above-described embodiments are realized, but also the OS (Operating System) running on the computer based on the instructions of the program code. ) And the like perform part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

Further, after the program code read from the storage medium is written into the memory provided on the function expansion board inserted into the computer or the function expansion unit connected to the computer, based on the instructions of the program code, It goes without saying that a CPU or the like provided in the function expansion board or the function expansion unit performs a part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

[0155]

As described above, according to the present invention,
It is possible to provide an image display device and an image display method which are excellent in operability and can perform a comfortable operation.

[0156]

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating an overall outline of a communication system including an image communication system according to a first embodiment of the present invention.

FIG. 2 is a diagram illustrating a configuration of main software of a video transmission device 20 and a monitoring device 60 according to the first embodiment of the present invention.

FIG. 3 is a diagram illustrating a display example of the monitoring device according to the first embodiment of the present invention.

FIG. 4 is a diagram illustrating a display example of the monitoring device according to the first embodiment of the present invention.

FIG. 5 is a diagram showing a display example of a window for displaying an image from a video camera as the first embodiment of the present invention.

FIG. 6 is a diagram illustrating a state when a display is performed by a D & D operation according to the first embodiment of the present invention.

FIG. 7 is a diagram illustrating a mouse cursor of the video camera during a D & D operation according to the first embodiment of the present invention.

FIG. 8 is a diagram illustrating a state when a display area is changed by a D & D operation according to the first embodiment of the present invention.

FIG. 9 is a diagram illustrating a camera icon indicating that a captured image is being displayed according to the first embodiment of the present invention.

FIG. 10 is a diagram illustrating a state of an operation for stopping display by a D & D operation according to the first embodiment of the present invention.

FIG. 11 is a flowchart showing the overall operation of the monitoring device according to the first embodiment of the present invention.

FIG. 12 is a flowchart illustrating an overall operation of the monitoring device according to the first embodiment of the present invention.

FIG. 13 is a flowchart illustrating an overall operation of the monitoring device according to the first embodiment of the present invention.

FIG. 14 is a flowchart showing the processing of a map display processing routine as the first embodiment of the present invention.

FIG. 15 is a flowchart showing the processing of a map display processing routine as the first embodiment of the present invention.

FIG. 16 is a flowchart illustrating a display movement stop processing routine according to the first embodiment of the present invention.

FIG. 17 is a flowchart illustrating a display movement stop processing routine according to the first embodiment of the present invention.

FIG. 18 is a flowchart illustrating a display movement stop processing routine according to the first embodiment of the present invention.

FIG. 19 is a diagram illustrating an example of a window displayed on the bitmap display 135 according to the first embodiment of the present invention.

FIG. 20 shows 2 × 3 = 6 as the first embodiment of the present invention.
It is an example showing displacement of the size of a video window when resizing so that a video display window having a plurality of video display areas becomes large.

FIG. 21 shows 2 × 3 = 6 as the first embodiment of the present invention.
This is an example when resizing so that a video display window having a number of video display areas becomes smaller.

FIG. 22 shows 2 × 3 = 6 according to the second embodiment of the present invention.
This is an example of resizing a video display window having video display areas to a smaller size.

FIG. 23 shows 2 × 3 = 6 as the fourth embodiment of the present invention.
This is an example of resizing a video display window having video display areas to a smaller size.

FIG. 24 is a diagram showing an input window for the number of video display areas according to the fifth embodiment of the present invention.

FIG. 25: m and n = as the sixth embodiment of the present invention.
FIG. 4 is a diagram illustrating a case where resizing is performed in an environment of 4, 4, x, y = 2, 2;

FIG. 26 is a flowchart illustrating a resize processing procedure according to the first embodiment of the present invention.

FIG. 27 is a flowchart showing a video window scrolling process according to a sixth embodiment of the present invention.

FIG. 28 is a diagram illustrating a seventh embodiment of the present invention in which m and n =
FIG. 9 is a diagram showing a state where display windows of 3, 3 are resized to x, y = 2, 3.

FIG. 29 is a diagram showing a seventh embodiment of the present invention in which m and n =
It is a figure showing signs that the display window of 3,3 was resized to x, y = 3,2.

FIG. 30 is a diagram showing a seventh embodiment of the present invention in which m and n =
FIG. 11 is a diagram illustrating a state where display windows 3 and 3 are resized to x and y = 2 and 2;

FIG. 31 is a flowchart illustrating a processing procedure when resizing is performed according to a seventh embodiment of the present invention.

[Explanation of symbols]

 Reference Signs List 10 video camera 12 camera control device 20 video transmission device 22, 122 CPU 24, 124 main memory 25, 125 external storage device 26, 126 storage device 28, 128 mouse 30, 130 keyboard 32 input / output interface 33 video compression decoder 34 capture board 35, 135 Bitmap display 36 Video board 38 Network interface 60 Monitoring device 100 Network 411 Camera control client software 412 Video reception software 413 Map management software 421 Camera control server software 422 Video transmission software 500 Map display window 510, 520, 530, 540 Map 511, 521, etc. Camera icon 600 Video display window 610, 612 , 614, etc. Image display area 632 Recycle bin icon 640 Camera control panel 650 Grouping button 651 Delete group button 910 Scope showing image being displayed 920 Control pointer for camera control

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁶ Identification code FI G09G 5/34 G09G 5/34 Z

Claims (19)

[Claims] 1. A display control means for displaying image information input from an external device in an image display area in a window displayed on a monitor for each external device, and a window capable of instructing a change in the size of the window. An image display device, comprising: a size changing unit; wherein the display control unit changes the number of image display areas in the window according to a change in the size of the window by the window size changing unit. 2. The image processing apparatus according to claim 1, wherein said display control means reduces the number of image display areas to be displayed in said window when said window size is changed by said window size changing means. Image display device. 3. The image display device according to claim 1, further comprising communication means for communicating with the external device according to the number of image display areas to be displayed in the window. . 4. The image display device according to claim 2, wherein the display control means displays the image display area reduced by the size change in another window on the monitor different from the window. . 5. The communication unit includes: a communication line connection unit that connects a communication line with the external device; and a command transmission unit that transmits a command to request the external device to transmit image information. When the number of image display areas to be displayed in the window is reduced by the display control means, the command transmission unit interrupts a command request to an external device corresponding to the image displayed in the reduced image display area. The image display device according to claim 3, wherein: 6. The display control means includes scroll means capable of instructing scrolling of an image display area displayed in the window, and the window whose size has been reduced by the window size changing means is scrolled by the scroll means. Thus, when the display control means redisplays the image display area excluded from the window, the command transmission means responds to the image displayed in the redisplayed image display area. 6. The image display device according to claim 5, wherein the transmission of the command to an external device to be restarted is restarted. 7. The display control unit further includes a transmission source information display unit that displays a symbol indicating an arrangement state of the transmission source of the image information and a map indicating the arrangement location. 2. The image display device according to 1. 8. The display control means further includes pointing means capable of moving the symbol on the monitor, and when the symbol is moved to an image display area of the window by the pointing means, the communication means. 4. The image display device according to claim 3, wherein said device starts communication. 9. The display control device according to claim 1, wherein when changing the number of image display areas in the window, the display control means changes the size of the window after the change in units of the image display area. The image display device as described in the above. 10. The image display device according to claim 4, wherein said display control means arranges the image display area reduced by said size change in a matrix in said another window. 11. Image information input from an external device is
Each of the external devices has a display control step of displaying an image in an image display area in a window displayed on a monitor. In the display control step, when the size change of the window is changed, the size of the window is changed. And changing the number of image display areas in the window according to the image display method. 12. The image display method according to claim 11, wherein, in the display control step, when the size of the window is changed to a small size, the number of image display areas displayed in the window is reduced. 13. The image display method according to claim 11, further comprising a communication step of performing communication with the external device according to the number of image display areas displayed in the window. . 14. The image display method according to claim 12, wherein, in the display control step, the image display area reduced by the size change is displayed in another window on the monitor different from the window. . 15. In the communication step, in a case where a communication line is connected to the external device and a command is transmitted to request the external device to transmit image information, the communication step is performed by the display control step. 14. The method according to claim 13, wherein when the number of image display areas displayed in the window decreases, a request for a command to an external device corresponding to the image displayed in the reduced image display area is interrupted. Image display method. 16. The display control step is capable of instructing scrolling of an image display area to be displayed in the window, and is excluded from the window whose size has been changed to a small size by scrolling the window. When the image display area is displayed again by the display control step, transmission of the command to an external device corresponding to the image displayed in the image display area displayed again is restarted. 15. The image display method according to 15. 17. A computer-readable storage medium storing an image display program for displaying image information input from an external device, the storage medium comprising:
Operating the computer as display control means for displaying the image information in an image display area in a window displayed on a monitor for each external device, and window size changing means capable of instructing a change in the size of the window; A storage medium, wherein the display means changes the number of image display areas in the window in accordance with a change in the size of the window by the window size changing means. 18. The method according to claim 18, wherein the display control means operates to reduce the number of image display areas displayed in the window when the size of the window is reduced by the window size changing means. The storage medium according to claim 17. 19. The display control device according to claim 18, wherein the display control means operates to display the image display area reduced by the size change in another window on the monitor different from the window. Storage media.