JP2001333418A - Image display device and method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image display method that can realize an image configuration at a low cost suitable for applications by allowing a general end user to simply revise the image configuration. SOLUTION: The image display method that selects an optional image pickup device among connected image pickup devices adopting different image pickup methods and displays a video image obtained from the selected image pickup device, has an image configuration step where a question is sequentially raised, the configuration of an image display menu suitable for an application is decided based on the reply, and the menu configuration information is outputted, and an image generating step where the display image is generated based on the menu configuration information.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an image display apparatus and a method capable of displaying an image by selecting an arbitrary camera from a plurality of connected cameras.

[0002]

2. Description of the Related Art Surveillance systems using video cameras are:
A monitoring terminal with an optimal layout is required depending on the application and the number of cameras.

In this type of surveillance system, in the past, an analog video signal of a camera was displayed on a video monitor as it was, so that the video was determined by the physical arrangement of the monitor. The layout of the operation panel for performing various operations on the camera is determined by the physical arrangement of the switches at the time of manufacture.

In recent years, in a monitoring system using a GUI (Graphical User Interface) of a computer, an operation panel and a video monitor are graphically drawn on a computer screen and operated by a pointing device such as a mouse. Therefore, the screen configuration such as the video display style and the layout of the operation panel can be changed by modifying the program or script.

[0005]

However, in this type of conventional image display device, it is necessary for a specialized program engineer to modify a program, a script, or a page description in order to change the screen configuration. Ordinary end users could not easily change the screen configuration.

For this reason, in order to introduce a monitoring system having a screen configuration suitable for the application, there has been a cost for requesting a specialized program engineer to perform the operation.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned problems, and an image display apparatus which enables a general end user to easily change a screen configuration, realizes a screen configuration suitable for use at low cost, and The aim is to provide a method.

[0008]

In order to achieve the above object, an arbitrary imaging device is selected from one or more connected imaging methods, and an image obtained from the selected imaging device is displayed. The image display method according to the present invention sequentially presents a question, determines a configuration of an image display screen suitable for a purpose based on a response thereof, and outputs a screen configuration information to the screen configuration step. And a screen generating step of generating a display screen based on the screen.

The image display apparatus according to the present invention, which selects an arbitrary imaging apparatus from one or more connected imaging apparatuses and displays an image obtained from the selected imaging apparatus, sequentially presents questions. And, based on the response, determine the configuration of the image display screen suitable for the application, screen configuration means for outputting the screen configuration information, and screen generation means for generating a display screen based on the screen configuration information Have.

[0010] According to a preferred aspect of the present invention, the screen configuration step includes a style selection step of selecting a style to be used from a plurality of styles stored in advance by the question; An attribute information selecting step of selecting a changeable attribute of the selected style; a generating step of generating screen configuration information by associating the style selected by the style selecting step with the attribute selected by the attribute information selecting step And a process. Further, the image display device further includes a style holding unit that holds a plurality of styles of a screen configuration, wherein the screen configuration unit selects a style to be used from the plurality of styles based on the question. Attribute information selecting means for selecting a changeable attribute of the selected style according to the question; associating the style selected by the style selecting means with the attribute selected by the attribute information selecting means. Generating means for generating screen configuration information.

According to a preferred aspect of the present invention, the screen composition step further includes an attribute editing step of editing a changeable attribute of the selected style, and the screen composition means includes: There is further provided an attribute editing means for editing a changeable attribute of the selected style.

Further, according to a preferred aspect of the present invention, there is further provided a screen configuration information storing step of storing the screen configuration information output in the screen configuration step, and the screen configuration output by the screen configuration means. There is further provided screen configuration information storage means for storing information.

According to a preferred aspect of the present invention, the image pickup apparatus can control a function of an image pickup method including at least one of pan, tilt, zoom, and image quality. Includes an operation display style for controlling the function.

According to a preferred aspect of the present invention, the screen configuration information includes a map display indicating an arrangement of the imaging device.

According to a preferred aspect of the present invention, the imaging device is connected via a network.

Preferably, the imaging device is connected by network connection means having a network device automatic detection step, wherein the screen configuration step further includes a network device automatic detection step, and the screen configuration means includes a network device automatic detection step. The apparatus further includes a device automatic detection unit.

[0017]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Preferred embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

FIG. 1 is a configuration diagram of a remote monitoring system according to the present embodiment.

Reference numeral 1 denotes a camera capable of controlling pan, tilt, and zoom, and reference numeral 2 denotes a network camera adapter for digitizing an image input from the camera 1, compressing the image into a Motion-JPEG format, and transmitting the compressed image to a network. Conversely, the network camera adapter 2 controls the camera 1 by serial communication based on a control command received from the network. Reference numeral 3 denotes a network through an Internet protocol such as Ethernet (registered trademark). A set of a camera 1 and a network camera adapter 2 (called a “camera station”) is a network 3
Are connected in plural sets. Different types of cameras 1 and network adapters 2 may be mixed.

The network adapter 2 is a Universal
l It is desirable to support a network device automatic detection protocol such as Plug and Play (UPnP).

Reference numeral 4 denotes a monitoring station using a personal computer. The monitoring station 4 receives, decodes, and displays the video from the network camera adapter 2 via the network 3. Further, the monitoring station 4 transmits camera control commands such as pan, tilt, and zoom to the network camera adapter 2 in response to operations of a mouse, a joystick, a keyboard, and the like. A plurality of monitoring stations 4 are also connected to the network 3.

Reference numeral 5 denotes a management station using a personal computer, and reference numeral 6 denotes a server using a personal computer. The management station 5 manages information such as the name, network address, and type of the camera station connected to the network 3 and stores the management data in X.
The data is stored in the server 6 in the ML format. Further, the management station 5 designs a monitoring screen to be displayed on the monitoring station 4, and saves screen style data in the XSL format and data such as video layout and camera layout diagram (camera map) data in the server 6 in the XML format. I do. Note that these data structures will be described later in detail with reference to FIG.

The server 6 may be a Web server or a file server.

Further, any combination or all of the monitoring station 4, the management station 5, and the server 6 may be constituted by a single personal computer.

FIG. 2 is a diagram showing an example of a screen (monitoring screen) of the monitoring station 4 in the present embodiment. 21 is a video viewer for displaying camera images, 22 is a map viewer for displaying camera maps,
Reference numerals 23, 24, and 25 denote scroll bars for controlling pan, tilt, and zoom of the camera, respectively. 26 and 28 are camera icons indicating cameras on the camera map,
Reference numerals 27 and 29 denote scope icons indicating a shooting direction and a shooting range of the camera. By switching the camera by clicking the camera icon 26 or 28, an image obtained from a desired camera can be displayed. The camera can also be controlled to pan, tilt, and zoom by operating the scope icon 27 with a mouse.

In addition to these operation buttons, operation units such as backlight correction, preset selection, snapshot (still image capture instruction), and panorama display can be provided.

FIG. 3 is a configuration diagram of a general personal computer used for a monitoring station, a management station, and a server.

Reference numeral 31 denotes a CPU for overall control, 32 a main storage unit (RAM), 33 a removable external storage device such as a floppy (registered trademark) disk and CD-ROM, and 34 a secondary storage such as a hard disk. Device, 3
5 is a mouse that functions as a pointing device, 3
6 is a keyboard, 37 is a network interface,
38 is a video board, and 39 is a monitor.

FIG. 4 is a configuration diagram of software and data used in the monitoring station 4. As described above, data is generated and updated by the management station 5 and stored in the server 6.

A Web 41 can display a style sheet file described in the style specification language XSL by applying the style sheet file to a data file described in the data description language XML.
Browser. The Web browser 41 also uses Java.
And ActiveX plug-in programs and ECM
A script program in an ASCII format can be executed.

Reference numeral 42 denotes a main style sheet file describing the display style and operation response of the entire monitoring screen, 43 denotes a map viewer style sheet file describing the display style and operation response of the map viewer 22 in XSL format and ECMAScript format, and 44 denotes This is a video viewer style sheet file that describes the display style and operation response of the video viewer 21. Several style sheet files are prepared for each monitoring purpose and usage business mode.

Reference numeral 45 denotes a main data file in which display option data of the entire monitoring screen is described.
6 is a map data file describing camera arrangement data for the map viewer 22, 47 is a video viewer data file describing display option data of the video viewer, and 48 is camera list data describing management data and link data of all camera stations. File.

49 is an ActiveX format or a Java format.
a applet format video display program component, 41
0 is a bitmap image data file drawn on the camera map.

In the main data file 45, the style of the main style sheet file 42 is specified by a link. In addition, a link specification for using the map data file 46 as map data and a link specification for using the camera list data file 48 as camera list data are described.

In the map data file 46, a map viewer style sheet file 43 is specified as a style by a link. Also, the main data file 4
Reference designation for referring to the data of the camera list data file 48 designated by the link 5 is described.

The camera list data file 48 describes management data such as the name, network address, and type of a camera station for each camera connected to the network 3 and specifies a link to the video viewer style sheet file 44 to be used. Have been.

Video viewer style sheet file 44
Describes the link designation of the video display program component 49 to be used.

FIG. 5 is a flowchart showing a process in which the Web browser 41 generates a monitoring screen.

First, the Web browser 41 acquires and reads the main data file 45 from the server 6 (step S51).

Next, the main style sheet file 42 whose style is specified by the link is acquired from the server 6 and read (step S52). Next, the main style sheet file 42 is analyzed, the main data file 45 is analyzed in accordance with the conversion specification described in the XSL format, and generation of the monitoring screen is started (step S).
54).

In this generation process, first, the camera list data file 48 specified by the link is acquired from the server 6 and read (step S55).

Next, the map data file 46 to which the link is specified is first obtained and read from the server 6 to be displayed as a camera map (step S56). Next, the map viewer style sheet file 43 whose style is specified by the link in the map data file 46
Is acquired from the server 6 and read (step S57).
Next, the map viewer style sheet file 43 is analyzed, and according to the conversion specification described in the XSL format,
The map data file 46 is analyzed to start generating a map viewer screen (step S58).

In this process, first, the map data file 4
Based on the link designation of the background bitmap file described in 6 and the designation of the display position of the camera icon, the bitmap file 410 is acquired and read from the server 6 as necessary, and the basic drawing of the map is performed (step S5).
9). Next, a camera name or the like corresponding to the camera ID described in the map data file 46 is retrieved from the data of the camera list data file 48 designated and referred to, and displayed on the map (step S510).

FIG. 6 is a flowchart showing a process in which the Web browser 41 generates the video viewer 21.

When the user clicks the camera icon 26 or 28 on the map viewer 22 with the mouse, the script function calculation of the corresponding camera described in the map viewer style sheet file 43 is executed (step S61). Further, a script function operation described in the main style sheet file 42 is executed (step S62).

In this process, first, a link designation of the video viewer style sheet file 44 suitable for the camera corresponding to the camera ID of the clicked camera icon is searched from the data of the camera list data file 48, and the video viewer style sheet file is searched. 44 is acquired and read from the server 6 (step S63). Next, the video viewer data file 47 is obtained and read from the server 6 (step S64). Next, the video viewer style sheet file 44 is analyzed, the video viewer data file 47 is analyzed according to the conversion specification described in the XSL format, and the generation of the video viewer screen is started (step S65).

Then, in accordance with the link specification described in the video viewer style sheet file 44, the video display program component 49 is obtained from the server 6 and read (step S66). Next, connection information corresponding to the camera ID of the camera to be displayed, such as a TCP / IP address, is searched from the data in the camera list data file 48 (step S67). Next, the execution of the video display program component is started by designating the retrieved connection information (step S68). In this process, the image display program component establishes a TCP / IP connection with the camera station, acquires and displays the image of the camera (step S69).

As described above, in the present embodiment, the Web browser 41 is used based on various style sheet files and data files stored on the server 6.
Generates and displays a monitoring screen at startup or dynamically in response to an operation.

Therefore, the display style of the monitoring screen can be changed only by exchanging the style sheet file, for example. Further, by simply changing the data file, a monitoring screen of the same display style can be generated for different camera arrangements and configurations.

Next, generation and update of data in the management station 5 shown in FIG. 4 will be described.

FIG. 7 is a configuration diagram of software and data of the management station 5.

Reference numeral 71 denotes a camera management tool for managing a list of information such as the names, identification numbers, network addresses (connection information), and types of camera stations connected to the network 3. The camera management tool 71 writes the information to the camera list data file 48 and
To save.

Reference numeral 72 denotes a map editor for editing a camera map. The map editor 72 edits the position of the camera icon on the map and the background bitmap, writes the information to the map data file 46, and stores the information in the server 6.

Reference numeral 73 denotes a monitoring wizard which automatically presents questions in a wizard manner to automatically compose a monitoring screen. The monitoring wizard 73 writes the configuration result to the main data file 45 and the video viewer data file 47, and stores it in the server 6.

FIG. 8 is a view showing an execution screen of the camera management tool 71.

In FIG. 8, reference numeral 81 denotes a list display section for displaying a list of registered camera station information;
82 is a new button for newly registering camera station information, 83 is a name change button for changing the name of a camera station, 84 is a delete button for deleting the registration of a camera station, 85 is a Universal Plug
An automatic detection button for automatically detecting a camera station connected to the network by a network device automatic detection protocol such as and Play (UPnP).

If the camera station is automatically detected by pressing the automatic detection button 85, the camera management tool 71 acquires an XML-format device information file from the camera station. Then, the link information to the video viewer style sheet file 44 to be used for the camera station described in the device information file is transcribed to the camera list data file 48.

Reference numeral 88 denotes a property dialog for inputting information of the camera station; 86, an address field for inputting a network address of the camera station;
Reference numeral 87 denotes a type component box for specifying the type of camera station.

FIG. 9 is a diagram showing an example of a question screen of the monitoring wizard.

A "next" button 91 for proceeding to the next question, 9
2 is a "return" button for returning to the previous question, 93 is a cancel button for canceling the monitoring wizard, and 94 is an option button for selecting one of the questions from the options.

FIG. 10 is a diagram showing an example of a question flow of the monitoring wizard.

In the first screen, it is asked whether a new monitoring screen is created or an existing screen is edited (step S10).
1). In the case of editing an existing screen, the process shifts to editing of the existing screen from step S109. In the case of new creation, a basic style of the monitoring screen is inquired to obtain a basic style (step S102). Next, a question is asked as to which camera to use from among the cameras registered in the camera management tool, and the camera to be used is specified (step S10).
3). Next, it is asked whether the basic style uses the camera map (step S104), and if it is of the type to be used (YES in step S104), the display style of the camera map is asked to obtain the display style (step S104).
105). This dialog also has a button for starting the map editor and editing the camera map. When no camera map is used (step S104)
NO), and directly proceeds to step S106.

Next, in step S106, it is asked whether the basic style is the fixed display type or the table-of-contents screen type. In the case of the table-of-contents type, the display position of the camera is inquired to obtain the display position (step S107). In the case of the fixed display type, since the display position is fixed, the process directly proceeds to step S108. Finally, the user inquires about the setting of the image quality and frame rate of the display image, and obtains the image quality and frame rate (step S108).

When editing an existing screen, step S10
In step 9, a screen to be edited is selected from existing screens. When adding a camera (YES in step S110), a camera to be added is selected in step S111. If the camera is to be deleted (YES in step S112), step S
In step 113, a camera to be deleted is selected. Step S114
It is determined whether or not the style used in the step uses the camera map. If the style is used, the process proceeds to step S115.
Confirm if you want to change the map style with. If it is to be changed (YES in step S115), the display style is obtained by inquiring about the display style of the camera map in step S116. This dialog also has a button for starting the map editor and editing the camera map. In step S117, it is asked whether the style used is the fixed display type or the table of contents screen type. In the case of the table of contents screen type, in step S118, it is asked whether to change the display position of the camera. Step S11
At 9, the display position is obtained. Finally, the user is asked whether to change the image quality and frame rate of the display image, and if so, the image quality and frame rate are obtained in step S121.

When the above-mentioned questions are answered and the completion button is pressed, the monitoring wizard 73 generates the main data file 45, the video viewer data file 47, and the map data file 46 as necessary, and
To save. At this time, a link to the main style sheet file 42 corresponding to the basic style selected in step 102 is written in the main data file 45 as a style designation.

FIG. 11 shows a case where the selection is made in step S102.
It is a figure showing an example of a choice of a basic style of a monitoring screen.

Reference numeral 111 denotes a floor type camera map + video type style shown in FIG. 2, 112 denotes a wide area type camera map + video type style, 113 denotes a camera list + video type style, and 114 denotes a floor map + four video fixed. Display style 115, 4 video fixed display style 1
Reference numeral 16 denotes a 6-image fixed display style, 117 denotes a 1-image full screen style, and 118 denotes a table of contents screen + video style. The present invention is not limited to the style shown in FIG. 11, and it goes without saying that various styles are possible.

In the above embodiment, the display position, image quality and frame rate of the camera can be changed. However, the present invention is not limited to these, and various display attributes can be changed by different display styles. It is possible to

[0069]

Another object of the present invention is to supply a storage medium (or a recording medium) on which a program code of software for realizing the functions of the above-described embodiments is recorded to a system or apparatus, and to provide the system or apparatus. It is needless to say that the present invention can also be achieved by a computer (or CPU or MPU) reading and executing the program code stored in the storage medium. In this case, the program code itself read from the storage medium implements the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention. When the computer executes the readout program codes, not only the functions of the above-described embodiments are realized, but also an operating system (OS) running on the computer based on the instructions of the program codes. It goes without saying that a case where some or all of the actual processing is performed and the functions of the above-described embodiments are realized by the processing is also included.

Further, after the program code read from the storage medium is written into the memory provided in the function expansion card inserted into the computer or the function expansion unit connected to the computer, the program code is read based on the instruction of the program code. , The CPU provided in the function expansion card or the function expansion unit performs part or all of the actual processing,
It goes without saying that a case where the function of the above-described embodiment is realized by the processing is also included.

When the present invention is applied to the above-mentioned storage medium, the storage medium includes the above-described FIG. 5 and FIG.
Alternatively, a program code corresponding to the flowchart shown in FIG. 10 is stored.

[0072]

As described above, according to the present invention, a general end user can easily change the screen configuration, thereby realizing a screen configuration suitable for use at low cost.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of a remote monitoring system according to an embodiment of the present invention.

FIG. 2 is a diagram illustrating an example of a screen of a monitoring station (monitoring screen).

FIG. 3 is a block diagram illustrating a configuration of a personal computer.

FIG. 4 is a configuration diagram of software and data used in the monitoring station according to the embodiment of the present invention.

FIG. 5 is a flowchart illustrating a process in which a Web browser generates a monitoring screen according to the embodiment of the present invention.

FIG. 6 is a flowchart illustrating a process of generating a video viewer by a Web browser according to the embodiment of the present invention.

FIG. 7 is a configuration diagram of software and data used in the management station according to the embodiment of the present invention.

FIG. 8 is a diagram showing an execution screen of a camera management tool according to the embodiment of the present invention.

FIG. 9 is a diagram illustrating an example of a question screen of the monitoring wizard according to the embodiment of the present invention.

FIG. 10 is a flowchart illustrating an example of a question flow of the monitoring wizard according to the embodiment of the present invention.

FIG. 11 is a diagram showing an example of basic style options on the monitoring screen according to the embodiment of the present invention.

[Explanation of symbols]

 1 Camera 2 Network Adapter 3 Network 4 Monitoring Station 5 Management Station 6 Server

Continued on the front page F-term (reference) 5C054 AA02 AA05 CA04 CC02 CD03 CG02 CH01 DA08 EA01 EA05 EB00 EG01 EH01 FA00 FC12 FE02 FE16 FE17 FE19 FE23 FF02 GB01 HA18 5C082 AA12 AA13 AA27 AA42 BA20 BB01 BB01

Claims (18)

[Claims] 1. An image display method for selecting an arbitrary imaging device from one or more connected imaging methods and displaying a video obtained from the selected imaging device, wherein questions are sequentially presented. Determining a configuration of an image display screen suitable for the application based on the response, and outputting the screen configuration information; and a screen generation step of generating a display screen based on the screen configuration information. An image display method characterized by the following. 2. The screen configuration step includes: a style selection step of selecting a style to be used from a plurality of styles stored in advance according to the question; and a changeable attribute of the selected style according to the question. An attribute information selecting step of selecting a style, and a generating step of generating screen configuration information by associating the style selected in the style selecting step with the attribute selected in the attribute information selecting step. The image display method according to claim 1. 3. The image display method according to claim 2, wherein the screen configuration step further includes an attribute editing step of editing a changeable attribute of the selected style. 4. The image display method according to claim 1, further comprising a screen configuration information storing step of storing the screen configuration information output in the screen configuration step. 5. The image capturing apparatus can control a function of an image capturing method including at least one of pan, tilt, zoom, and image quality, and the screen configuration information includes an operation display for controlling the function. The image display method according to claim 1, further comprising: 6. The image display method according to claim 1, wherein the screen configuration information includes a map display indicating an arrangement of the imaging device. 7. The image display method according to claim 1, wherein the imaging device is connected via a network. 8. The apparatus according to claim 7, wherein the imaging device is connected by network connection means having a network device automatic detection step, and the screen configuration step further includes a network device automatic detection step. Image display method. 9. An image display device for selecting an arbitrary imaging device from among one or more connected imaging devices and displaying a video obtained from the selected imaging device, wherein questions are sequentially presented. A screen configuration unit that determines a configuration of an image display screen suitable for a use based on the response, and outputs the screen configuration information; and a screen generation unit that generates a display screen based on the screen configuration information. An image display device characterized by the above-mentioned. 10. A style holding unit for holding a plurality of styles of a screen configuration, wherein the screen configuration unit selects a style to be used from the plurality of styles according to the question; Attribute information selecting means for selecting a changeable attribute of the selected style in response to the question; a screen configuration in which the style selected by the style selecting means is associated with the attribute selected by the attribute information selecting means The image display device according to claim 9, further comprising: a generation unit configured to generate information. 11. The image display device according to claim 10, wherein the screen configuration unit further includes an attribute editing unit that edits a changeable attribute of the selected style. 12. The image display device according to claim 9, further comprising a screen configuration information storage unit that stores the screen configuration information output by said screen configuration unit. 13. The image pickup apparatus can control a function of the image pickup apparatus including at least one of pan, tilt, zoom, and image quality, and the screen configuration information includes an operation display for controlling the function. 13. The style according to claim 9, further comprising:
The image display device according to any one of the above. 14. The image display device according to claim 9, wherein the screen configuration information includes a map display indicating an arrangement of the imaging device. 15. The image display device according to claim 9, wherein the imaging device and the image display device are connected via a network. 16. The apparatus according to claim 15, wherein the image pickup apparatus is connected by a network connection unit having a network device automatic detection unit, and the screen configuration unit further includes a network device automatic detection unit. Image display device. 17. A storage medium for holding a program code for realizing the image display method according to claim 1. 18. A storage medium storing a program that can be executed by a computer device, wherein the computer device executing the program causes the computer device to function as the image display device according to claim 9. Storage medium.