KR100966783B1 - Information processing apparatus, control method of information processing apparatus and storage medium - Google Patents

Abstract

An information processing apparatus for receiving data from a plurality of external apparatuses connected via a network and displaying an operation screen based on the contents of the data, includes: a receiving unit for receiving a plurality of data transmitted from the plurality of external apparatuses And an analysis for analyzing each of the data received by the receiving unit, and analyzing a first component part common to each of the data and a second component part not included in the first component part. A unit, and a display unit for displaying information included in the first component part in a common display area of the operation screen, and displaying information included in the second component part in a separate display area of the operation screen. .

Information processing device, external device, storage medium, network, operation screen

Description

TECHNICAL PROCESSING APPARATUS, CONTROL METHOD OF INFORMATION PROCESSING APPARATUS AND STORAGE MEDIUM

The present invention relates to an information processing technique for processing data received from an external device via a network.

Conventionally, there has been a system capable of remotely operating an external device from a personal computer (PC) or the like via a network. For example, in a network camera system that can be used for remote monitoring purposes, it is possible to connect a PC and a camera via a network and operate the camera from the PC. Generally, in a network camera system, an image / video, operation button information, etc. are transmitted from a camera to a PC, and the PC displays the received image / video, operation buttons, etc. on a web browser or a dedicated application. Moreover, the information which the operator operated in the PC is sent to a camera, and it is possible to change a camera direction and a zoom magnification.

Some remote control systems allow you to operate multiple external devices from a single device. In the display part of the apparatus which can operate a some external apparatus, there exist several methods as the display structure.

In the first method, a selection screen of an external device as shown in FIG. 17 is displayed, and when an operator selects one of a plurality of devices (cameras 1, 2, 3, 4), an operation screen of the selected device is displayed. . That is, when the operator selects one of the plurality of apparatuses (cameras 1, 2, 3, 4) by some method, one screen is displayed.

As shown in Fig. 16, the second method involves simultaneously displaying operation screens of a plurality of external devices on one screen. For example, in a system in which an external device can be operated from a web browser, when a plurality of web browsers are started on a PC, the operation screen shown in FIG. 16 can be configured. It is also possible to realize such display with dedicated application software.

In systems that operate external devices from a web browser, languages such as Java (registered trademark) and JavaScript can often be used. When using these languages, there is a restriction due to security, and it is generally impossible to control a plurality of external devices from one web browser screen. Therefore, in order to operate while listing a plurality of external devices, it is necessary to start a plurality of web browsers and configure a screen as shown in FIG.

In the third method, there is also a surveillance camera control system which arranges operation buttons as one common button for each external device and displays a plurality of images received from each external device. See Japanese Patent Application Laid-Open No. 2003-046994).

However, in the first method described above, there is a problem that the operation screens of a plurality of external devices cannot be displayed at once, and in order to display the operation screens of other external devices, the selection screen of the external device must be displayed again. There is operational trouble to say.

In the second method described above, the operation screens of a plurality of devices can be displayed simultaneously, but there is a problem that the operation screens of individual devices are small. In addition, when simultaneously displaying operation screens of similar devices, many of the same operation buttons are displayed on the screen, which may cause confusion when the operator operates. There is also redundancy in processing for displaying many of the same operation buttons on the screen. In a system using a web browser, there is an operational inconvenience in that a plurality of web browsers must be started.

In the third method described above, a dedicated application that takes into consideration the operation buttons of the connected external device is required. For example, when an external device is replaced and a new operation button is needed, updating of a dedicated application is also required, and a flexible response cannot be made to the function of the external device.

An object of the present invention is to provide an information processing technique capable of listing a plurality of external devices and displaying individual operation screens as large as possible.

Moreover, an object of this invention is to provide the information processing technique which can prevent the same drawing process from repeating and can perform an efficient drawing process.

Moreover, an object of the present invention is to provide an information processing technology capable of flexibly responding to differences in an operation method of an external device.

According to an aspect of the present invention, an information processing apparatus for receiving structured document data from a plurality of external devices connected through a network, and displaying an operation screen based on configuration information included in the structured document data

A structure including first configuration information indicating an operation instruction screen for controlling the plurality of external devices transmitted from each of the plurality of external devices and second configuration information specifying an image picked up by the plurality of external devices Receiving means for receiving document data,

Analysis means for analyzing configuration information in each of said structured document data received by said receiving means, and identifying said first configuration information and said second configuration information common to each of said structured document data;

An operation instruction screen for controlling the plurality of external devices indicated by the first configuration information is displayed in a common display area of the operation screen, and the plurality of external devices specified by the second configuration information are captured. And display means for displaying an image in an individual display area of the operation screen.

According to still another aspect of the present invention, a control method of an information processing apparatus for receiving structured document data from a plurality of external devices connected through a network, and displaying an operation screen based on configuration information included in the structured document data ,

First configuration information indicating an operation instruction screen for controlling the plurality of external devices and second configuration information for specifying images picked up by the plurality of external devices, transmitted from each of the plurality of external devices. A receiving process for receiving the structured document data;

An analysis step of analyzing configuration information in each of the structured document data received by the receiving step, identifying the first configuration information and the second configuration information common to each of the structured document data;

An operation instruction screen for controlling the plurality of external devices indicated by the first configuration information is displayed on a common display area of the operation screen, and the plurality of external devices specified by the second configuration information are picked up. And a display step of displaying an image on an individual display area of the operation screen.

Industrial Applicability According to the present invention, it is possible to provide an information processing technique capable of listing a plurality of external devices and displaying an individual operation screen as large as possible. That is, in the system for displaying the operation screens of a plurality of external devices, it becomes possible to provide an information processing technology for realizing a user interface that is easy for the operator to operate.

Moreover, it becomes possible to provide the information processing technique which can prevent the same drawing process from repeating and can perform an efficient drawing process.

In addition, it becomes possible to provide an information processing technique which can flexibly cope with the difference in the operation method of an external device.

Other features of the present invention will be apparent from the following description of exemplary embodiments (with reference to the attached drawings).

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the drawings. However, the components described in this embodiment are only examples, and the technical scope of the present invention is determined by the claims, and is not limited by the following individual embodiments.

<First Embodiment>

In this embodiment, a computer device is described as an example of a structured document processing apparatus (information processing apparatus) according to the present invention. The structure of the computer device of this embodiment is demonstrated with reference to the block diagram of FIG.

In Fig. 1, the CPU 101 functions as a system control unit and controls the entire apparatus. The ROM 102 is a read-only memory for storing the control program of the CPU 101 and various fixed data. The RAM 103 is a rewritable memory composed of SRAM, DRAM, and the like, for storing program control variables and the like. Various setting parameters, various work buffers, and the like are also stored in the RAM 103. The hard disk 104 is for storing various files such as an XML file. The operation unit 106 is composed of a hard keyboard, a pointing device, and the like, for the operator to perform various input operations. The display unit 105 is for notifying the operator by display using an LCD or the like. Reference numeral 107 denotes a system bus that connects units 101 to 106 to communicate with each other.

2 is a block diagram showing an outline of a system including a computer device according to an embodiment of the present invention.

In Fig. 2, the computer device 201 and the cameras 1, 2, 3, and 4 are connected to the LAN 202 and can communicate with each other. The computer device 201 has a function of interpreting XML data. In FIG. 2, the apparatus connected to the LAN 202 is a computer apparatus 201 and four cameras. Other apparatuses may be connected to the LAN 202, and the cameras connected to the LAN 202 are not limited to four but can be rented. You may also

The computer device 201 according to the embodiment of the present invention displays an image (eg, including an operation image or a still image) captured by cameras 1 to 4 connected to the LAN 202 on the display unit 105. It is possible to do It is also possible to control the operations of the cameras 1 to 4 from the computer device 201.

3 is an example of XML data transmitted to the computer device 201 from cameras 1, 2, 3, and 4 connected to the LAN 202. The computer device 201 performs processing on the XML data shown in FIG.

As shown in FIG. 3, in the system of the present embodiment, data in SVG (Scalable Vector Graphics) format is used as XML data transmitted from the camera to the computer device 201. In the XML data of FIG. 3, for example, it is possible to use the value of the id attribute as identification information. The g element whose id attribute has a value of "Keys" mainly contains information about an operation button, and the g element whose id attribute has a value of "Movie" mainly contains information about a captured image. In the XML data of FIG. 3, the drawing information of the up, down, left, right cursor buttons, and enlargement / reduction buttons are described as operation buttons. In addition, a URL reference of the image information is described. In the example of Fig. 3, "http://192.168.0.10/view.mpg" is described as the URL reference, but "192.168.0.10" means the IP address of the camera, and is for each camera connected to the LAN 202. different. On the other hand, among the XML data transmitted from each camera, all g elements whose id attribute has a value of "Keys" are the same. The CPU 101 of the computer device 201 analyzes the XML data received from the camera and displays the information on the display unit 105. The CPU 101 analyzes each of the received data, and divides the component part (first component part) of the data common to the respective data and the second component part not included in the first component part part. It is possible to identify.

4 is a diagram illustrating display of an operation screen on a PC in a network camera system. In this system, data described in HTML format is transmitted from the camera to the PC, and the PC is supposed to display the HTML received from the camera using a web browser. As shown in Fig. 4, an operation button is arranged on the left side of the operation screen on the PC, and an image captured by the camera is displayed on the right side. These operation buttons and images are included in the HTML, and are received by the PC from the camera.

In the screen of Fig. 4, when an operator clicks an operation button using a mouse, the information is transmitted from the PC to the camera, and the camera changes the direction and zoom magnification of the camera based on the received operation information.

In addition to network cameras, there are peripheral devices such as printers and routers that can perform operations and change setting contents from a PC via a network. Also in these apparatuses, the operator uses a web browser or a dedicated application on the PC to change the operation and setting contents.

4 is an example showing a state where the XML data of FIG. 3 is displayed on the display unit 105 of the computer device 201. In the example shown in FIG. 4, XML data transmitted from one camera is displayed. As shown in FIG. 4, when displaying the XML data received from one camera, the computer device 201 displays an operation button on the left side of the display unit 105 and an image on the right side. Here, the video portion photographed with the camera is indicated by diagonal lines. In this example, the operation buttons include cursor buttons on the top, bottom, left and right, and an enlargement / reduction button.

5 is a schematic diagram showing the definition of an area in the display unit 105 of the computer device 201. The common display area 501 is an area for displaying operation buttons and the like. The individual display area 502 is an area for displaying an image or the like.

The CPU 101 interprets the data transmitted from the camera, displays the information included in the first component part in the common display area of the operation screen, and displays the information included in the second component part in the individual display area of the operation screen. You can control what is displayed on the screen.

6 is an example showing a state in which XML data received from four cameras is displayed on the display unit 105 of the computer device 201. As shown in FIG. 6, operation buttons are displayed in the common display area as shown in FIG. 5, and images received from four cameras are displayed in respective display areas. Here, the individual display areas are divided into four in order to display the images from the four cameras. In order to display images from five or more cameras, the individual display areas may be further divided, or the computer device 201 may be configured to scroll the individual display areas.

The information about the operation button arrange | positioned at the left side of the screen shown in FIG. 6 is previously provided in the operation terminal side, and is displayed by the software installed in the operation terminal. In addition, the information arrange | positioned at the right side of FIG. 6 is moving picture information in the case of a surveillance camera control system, and is transmitted from an external apparatus.

FIG. 7 is a flowchart showing processing when the computer device 201 displays the screen of FIG. 6 on the display unit 105. In the present embodiment, the processing is performed by the CPU 101 reading out and executing the program code stored in the hard disk 104 of the computer device 201.

As shown in FIG. 7, the computer device 201 first receives XML data constituting drawing information from each camera, and analyzes the data to convert the data into internal data (S701). The internal data referred to here is data for facilitating processing performed using a program, for example, data in a form in which each element and attribute of XML is assigned to a structure defined in a programming language. This internal data is stored in the RAM 103 of the computer device 201. Here, although the received XML data is converted into internal data, the received XML data may be stored in the RAM 103 without changing. In the process of S701, the number of divisions of the individual display areas of the display unit 105 is determined according to the number of cameras connected to the LAN 202.

In S702, the XML data received from the first camera is drawn on the screen. In the present embodiment, a plurality of cameras communicating with the computer device 201 are given numbers in advance, and processing is performed in that order. In the drawing process of S702, the data data-formed in S701 is processed, and the information regarding an operation button and the information about a video are analyzed and displayed among the received XML data.

Subsequently, in S703, among the XML data received from the second and subsequent cameras, the information contained in the g element whose id attribute has a value of "Movie" is drawn in the individual display area. Here, the information contained in the g element whose id attribute has the value of "Keys" is not drawn. The part of XML data concerning an operation button is common to the XML data transmitted from each camera, and this part is already drawn in S702, and is not drawn in S703. In S703, a drawing process of only the video portion is performed. In the present embodiment, four cameras are connected to the LAN 202, so in step S703, XML data received from the second to fourth cameras is processed sequentially.

Finally, in S704, additional information other than the information included in the received XML data is drawn and displayed on the display unit 105. Here, the drawn additional information is provided around each video string of "Camera 1", "Camera 2", "Camera 3", and "Camera 4" in the drawing example shown in FIG. Represents a thick line frame. Each character string represents a name of each camera, and a thick line frame is used to indicate an operator whose camera is selected. This information is stored in advance in the RAM 103 of the computer device 201, and at S704, these information are drawn at a predetermined position.

Among the processing shown in the flowchart of FIG. 7, the processing of S702 and S703 involves drawing to each area (common display area 501 and individual display area 502) shown in FIG. 5 based on the received XML data. The received XML data is SVG data, and the drawing position of each object is previously described as a coordinate value. When drawing these objects in the common display area 501 or the individual display area 502, coordinate change processing is performed with respect to the coordinate value acquired from XML data. For example, when displaying information about an operation button in the common display area 501, all operations are performed in the common display area 501 assuming a coordinate space with the upper left corner of the common display area 501 as the origin. In order to make a button enter, a primary conversion process is performed on the coordinate values contained in the XML data. In particular, since the SVG data is composed of vector graphics, such coordinate change processing can be performed by a relatively simple calculation, and the drawing quality of the operation button does not deteriorate even if the enlargement or reduction is performed.

During the processing shown in the flowchart of FIG. 7, the information displayed in S704 is stored in advance in the RAM 103 of the computer device 201. The computer device 201 is provided with software having a function of inputting a name of an external device and a function of selecting one of the external devices. The information displayed in S704 is input by the operator using the software and stored in the RAM 103. The software may be downloaded and executed from one of the external devices, or may be implemented as plug-in software of a web browser, rather than being pre-installed in the computer device 201. This software is described in JavaScript or the like, and may be transmitted from one of the external devices together with the XML data shown in FIG. 3 or executed by a computer device.

FIG. 8 is a flowchart specifically showing a process of S702 among the processes shown in the flowchart of FIG. 7. This process is executed under the control of the CPU 101. When processing each element of XML data in the process of S702, the process shown in FIG. 8 is performed.

First, it is determined whether the element to be drawn relates to the operation button. That is, in S801, it is determined whether or not the id attribute is included in the g element having the value of "Keys".

If it is determined in S801 that the element to be drawn relates to the operation button (S801: YES), the element is drawn in the common display area in S802. If it is determined that the element to be drawn is not related to the operation button (S801: NO), the element is drawn in the individual display area in S803.

By performing the processing shown in the flowcharts of FIGS. 7 and 8, the screen shown in FIG. 6 can be displayed on the display unit 105 of the computer device 201.

By displaying as shown in FIG. 6, the operation button which is a common part can be displayed large, and the video from a some camera can be read simultaneously, and the operation screen which a user can use is realizable.

When the operator performs the operation of the computer device 201, after selecting a desired camera screen in the individual display area with a pointing device such as a mouse, the operation button can be selected. The computer device 201 transmits a command corresponding to the selected operation button to the camera selected by the operator. In this case, the CPU 101 of the computer device 201 executes transmission control for transmitting the information input through the operation button on the operation screen to at least one of the plurality of external devices.

The processing in response to the operation by such an operator is executed by software mounted on the computer device 201. In the present embodiment, it is possible to store, for example, a computer program that performs such processing on the hard disk 104 of the computer device 201 in advance. You may download and run a computer program from one of the external devices. A computer program may be mounted as the plug-in software of the web browser. In this case, it is also possible to display the operation screens of a plurality of external devices without starting up the plurality of web browsers.

This software is described in JavaScript or the like, and may be transmitted from one of the external devices together with the XML data shown in FIG. 3 to be executed by the computer device.

In particular, in the case of JavaScript, in general, due to security restrictions, only one external device can communicate with one JavaScript code. In this case, JavaScript code executed according to an operator's operation may be converted to communicate with a plurality of devices.

According to the present embodiment, it becomes possible to provide an information processing technique capable of listing a plurality of external devices and displaying each operation screen as large as possible. That is, in the system for displaying the operation screens of a plurality of external devices, it becomes possible to provide an information processing technique for realizing a user interface that is easy for the operator to operate.

Further, according to the present embodiment, it becomes possible to provide an information processing technique capable of preventing the same drawing process from being repeated and performing an efficient drawing process.

Second Embodiment

In the first embodiment, the processing in the premise system that the contents of the g element whose id attribute has the value of "Keys" in the XML data transmitted from each camera is all explained. In this embodiment, processing in a system in which the content of the g element whose id attribute has a value of "Keys" is different will be described. The block diagram of FIG. 1 and the system configuration diagram of FIG. 2 are the same as those of the first embodiment.

3 and 9 are examples of XML data transmitted to the computer device 201 from the cameras 203, 204, 205, and 206 connected to the LAN 202. In the XML data shown in FIG. 3 and FIG. 9, the description of the operation button is different. Although the XML data of FIG. 3 includes information of zoom in and zoom out buttons, there is no zoom in and zoom out buttons in FIG. 9. That is, XML data as shown in FIG. 9 is transmitted from the camera which does not have an enlargement / reduction function, and XML data as shown in FIG. 3 is transmitted from a camera having an enlargement / reduction function. In this embodiment, the cameras 1 and 2 have a zoom function, and the cameras 3 and 4 do not have a zoom function.

6 and 11 show examples of screen display of the display unit 105 in the present embodiment. Also in this embodiment, like the first embodiment, the display unit 105 can display the common display area 501 and the individual display area 502 shown in the schematic diagram of FIG. 5.

10 is a flowchart showing processing when the computer device 201 performs display on the display unit 105 in the present embodiment. This process is executed under the control of the CPU 101. In the computer device 201, first, in S1001, XML data constituting drawing information is received from each camera, and the data is analyzed and converted into internal data.

Next, in S1002, the number N of the camera currently selected is acquired. The computer device 201 internally assigns a unique number to the camera in order to manage the camera connected via the LAN 202. The computer device 201 is configured such that an operator can select a camera through the operation unit 106, and the number of the currently selected camera is stored in the RAM 103. In S1002, the number N of the camera currently selected is read from the RAM 103.

Subsequently, in S1003, among the drawing information of the Nth camera, the information contained in the g element whose id attribute has a value of "Keys" is drawn in the common display area 501. That is, the operation button of the currently selected camera is drawn in the common display area 501.

Subsequent to the process of S1003, in S1004, among the drawing information of each camera, the information contained in the g element whose id attribute has the value of "Movie" is drawn in the individual display area 502, respectively. After that, in S1005, additional information is drawn.

By performing the processing using the above procedure, for example, when the camera 1 is selected, the screen shown in Fig. 6 can be displayed on the display unit 105, and when the camera 3 is selected, the screen shown in Fig. 11 is displayed. It is possible to do

Each time the operator selects another camera via the operation unit 106, the process shown in the flowchart of FIG. 10 is performed, and the common display area is switched to the operation button of the camera. In this case, the CPU 101 and the operation unit 106 function as a display area selection unit configured to select any one of the plurality of display areas displayed on the individual display areas.

In the present embodiment, the XML data transmitted from each camera includes the information about the operation button of the camera, and the display screen is created by processing this information separately. Therefore, even when the camera which has an operation button which does not exist in another camera connected already is newly connected, the display screen corresponding to the camera can be comprised.

According to the present embodiment, it becomes possible to provide an information processing technology which can flexibly cope with the difference in the operation method of an external device.

Third Embodiment

In the first and second embodiments, a method of determining a drawing area using the value of the id attribute of XML data transmitted from each camera has been described. In this embodiment, a method of performing processing without using an id attribute will be described.

The block diagram of FIG. 1 and the system configuration diagram of FIG. 2 are the same as those of the first embodiment.

Also in this embodiment, the XML data illustrated in FIGS. 3 and 9 is transmitted to the computer device 201 from cameras 1, 2, 3, and 4 connected to the LAN 202. 6 and 11 show examples of screen display of the display unit 105 in the present embodiment. Also in the present embodiment, like the first and second embodiments, the display unit 105 can display the common display area 501 and the individual display area 502 shown in the schematic diagram of FIG. 5.

12 is a flowchart showing processing when the computer device 201 performs display on the display unit 105 in the present embodiment. This process is executed under overall control of the CPU 101.

In the computer device 201, first, in S1201, XML data constituting drawing information is received from each camera, and the data is analyzed and converted into internal data.

Next, in S1202, the common part and the non-common part of the drawing information of each camera are discriminated. That is, the total four drawing information received from each camera is analyzed, and the part common to all the drawing information and the part which is not common are discriminated. The determination of the common part and the non-common part involves comparing the description of XML data element by element to determine whether they are the same or not. In the case of the XML data shown in Figs. 3 and 9, since the descriptions of the up, down, left, and right cursors are the same, they are regarded as common parts.

Subsequently, in S1203, the portion determined as the common portion in the previous step S1202 is drawn in the common display area 501 of the display unit 105. In S1204, the part judged as a non-common part in previous step S1202 is drawn in the individual display area 502. As shown in FIG. Since the non-common part is included in the drawing information of each camera, respectively, it processes and draws sequentially. Finally, in S1205, additional information is drawn, and the process of the flowchart of FIG. 12 is complete | finished.

FIG. 13 shows an example of the display of the display unit 105 when the processing is performed along the flowchart of FIG. 12. As shown in Fig. 13, in the present embodiment, the drawing information of the camera 1 and the camera 2 includes the description of the enlargement button and the reduction button. It is drawn. On the other hand, since the drawing information of the cameras 3 and 4 does not have a description of an enlarged button or a reduced button, these buttons are not drawn in the display areas of the cameras 3 and 4 among the individual display areas. Since the up, down, left, and right cursor buttons are included in the drawing information of all the cameras, they are drawn in the common display area 501.

According to the present embodiment, it becomes possible to provide an information processing technology which can flexibly cope with the difference in the operation method of an external device.

Fourth Embodiment

In the first to third embodiments, an operation button is mainly displayed in a common display area, and an example of mainly displaying video information in an individual display area is shown. In this embodiment, an operation button is displayed in an individual display area, and an example in which video information is displayed in a common display area is shown. The block diagram of FIG. 1 and the system configuration diagram of FIG. 2 are the same as those of the first embodiment.

Also in this embodiment, the XML data illustrated in FIGS. 3 and 9 is transmitted to the computer device 201 from cameras 1, 2, 3, and 4 connected to the LAN 202.

In the present embodiment, the display unit 105 can display the region shown in the schematic diagram of FIG. 5, but unlike the first to third embodiments, the region indicated by the broken line 501 of FIG. 5 functions as an individual display region. The area shown by the broken line 502 in FIG. 5 functions as a common display area.

In the present embodiment, similarly to the first and second embodiments, the computer device 201 determines whether to draw in the common display area or the individual display area by using the id attribute of the XML data. In the first and second embodiments, an example has been described in which the contents of the g element whose id attribute has a value of "Keys" are drawn in the common display area. In this embodiment, a configuration is described in which the content of the g element whose id attribute has a value of "Keys" is drawn in a separate display area, and the content of the g element whose id attribute has a value of "Movie" in a common display area. Explain.

14 is a flowchart showing processing when the computer device 201 performs display on the display unit 105 in the present embodiment. This process executes the process under overall control of the CPU 101.

The flow of the process shown in the flowchart of FIG. 14 is almost the same as the flow of the flowchart of FIG. 10 shown in the second embodiment, but the value of the id attribute of the process in S1403 and S1404 is different from each other.

Since S1401, S1402, and S1405 are the same as S1001, S1002, and S1005, respectively, description thereof is omitted.

In S1403, among the drawing information of the Nth camera, the information described in the g element whose id attribute has the value of "Movie" is drawn in the area 1502 (FIG. 15) which functions as a common display area. That is, the video information of the camera currently selected is drawn in the area 1502 (FIG. 15) which functions as a common display area.

Among the drawing information of each camera, the information described in the g element whose id attribute has the value of "Keys" is drawn in the area 1501 (FIG. 15) which functions as an individual display area (S1404).

FIG. 15 shows an example of the display of the display portion 105 when the processing is performed in accordance with the flowchart of FIG. 14. As shown in Fig. 15, an area 1501 serving as an individual display area on the left side of the screen is divided according to the number of cameras, and operation buttons of individual cameras are displayed. In an area 1502 serving as a common display area on the right side of the screen, a video transmitted from the camera currently selected is displayed.

In the screen of FIG. 15, when an operator selects another camera through the operation part 106, the process shown in the flowchart of FIG. 14 is performed again, and a common display area is switched to the image from the camera.

In the method of this embodiment, it is possible to enlarge the video display portion, thereby improving the visibility of the video. Since the operation panels of the connected external devices can be listed, there is an advantage that it is easy for the operator to know what function each external device has.

<Fifth Embodiment>

In the first to fourth embodiments, examples of mainly the display method and the display processing are shown. In the present embodiment, an example of a process in the case of performing an operation by an operator in the apparatus for performing the display method shown in the first or third embodiment is shown.

The block diagram of FIG. 1 and the system configuration diagram of FIG. 2 are the same as those of the first embodiment.

Also in this embodiment, the XML data illustrated in FIGS. 3 and 9 is transmitted to the computer device 201 from the cameras 203, 204, 205, and 206 connected to the LAN 202.

18 shows an example of the display state of the display unit 105 when a plurality of cameras is selected. As shown in Fig. 18, a thick frame is displayed on the video portions of the cameras 2 and 3 so that the operator can recognize the selection state.

In the present embodiment, one or a plurality of cameras can be selected by a pointing device such as a mouse. When the operator has operated a button in the common display area, a command corresponding to the button is sent to the selected camera, and the camera receiving the command performs an operation according to the command. When an operator performs a button operation of a common display area in the state which is selected by the some camera, the command is transmitted to all the selected cameras.

19 is a flowchart showing the processing of the apparatus when the operator performs a button operation in the common display area.

As shown in FIG. 19, when an operator operates the button in a common display area, the list of the camera screen of an individual display area which is in a selection state is acquired first (S1701). This list is for internal management. For example, when cameras 2 and 3 are selected, the ID number indicating camera 2 is stored in the 0th of the list, and the ID number indicating camera 3 in the first of the list. Is stored. If there are two cameras selected, only the 0th and 1st of the list exist. In other words, there is no second or later in the list.

After the processing of S1701, the variable N indicating the index number of the list is set to 0 (S1702).

Next, it is judged whether the Nth of the list acquired in S1701 exists or not (S1703). If it is determined in S1703 that the Nth of the list exists, the command is transmitted to the camera corresponding to the ID number stored in the Nth of the list (S1704). The command transmitted here corresponds to the button operated by the operator. It is also possible to change the type of command and the transmission method according to the camera to which the command is transmitted.

After the process of S1704, 1 is added to the variable N (S1705), and the process returns to S1703.

In S1703, if it is determined that the Nth of the list does not exist, the process ends.

As described above, using the method shown in the present embodiment, it is possible to transmit a command to a plurality of external devices having the same button by one operation, thereby improving the convenience of the operator.

As mentioned above, although five embodiment was described, the method of providing all these embodiments and switching a process form according to a situation may be used. In the five embodiments, the form in which the display portion 105 is divided into two regions as illustrated in FIG. 5 has been described, but there may be more than two regions. For example, the display unit 105 may be divided into three regions composed of one common display region and two individual display regions. For example, when there are a plurality of individual display areas, the computer device 201 determines which individual display area to display on the basis of the value of the id attribute or the like.

In this embodiment, a system for remotely controlling a network-connected camera has been described as an example, but needless to say, the gist of the present invention is not limited to the camera. The present invention is applicable to a remote operation system of any device that can be connected to a network, for example, a printer, a router, a scanner, a copier, a facsimile device, and the like. In addition, "remote operation" includes not only mechanically moving the external device but also changing setting information of a software program included in the external device.

The object of the present invention can also be achieved by supplying a system or apparatus with a recording medium on which a computer program for realizing the functions of the above-described embodiments is provided. It is needless to say that the object of the present invention is also achieved by a computer (or CPU or MPU) of a system or apparatus reading out and executing a computer program stored in a storage medium. In this case, the actual computer program read from the computer readable storage medium realizes the functions of the above-described embodiments, and the computer readable storage medium storing the computer program constitutes the present invention.

As a storage medium which can be used for supplying a computer program, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, or the like can be used. As the storage medium, CD-ROM, CD-R, magnetic tape, nonvolatile memory card, ROM, DVD and the like can be used.

In addition, by executing the computer program read by the computer, the functions of the above-described embodiments are realized. In addition, based on the instructions of the computer program, an operating system (OS) or the like running on the computer executes part or all of the actual processing. In addition, it goes without saying that even if the function of the above-mentioned embodiment is implemented by the process, it is included in an embodiment.

Furthermore, the computer program read from the storage medium may be recorded in a memory provided in a function expansion board inserted in the computer or a function expansion unit connected to the computer. Thereafter, based on the instruction of the computer program, the CPU or the like provided in the function expansion board or the function expansion unit executes part or all of the actual processing. Needless to say, what is included in the embodiment of the present invention even when the function of the above-described embodiment is realized by the processing.

While the invention has been described with reference to exemplary embodiments, it will be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.

1 is a block diagram showing the configuration of a computer device 201 according to an embodiment of the present invention.

2 is a diagram illustrating a configuration of a network including a computer device 201 according to an embodiment of the present invention.

3 is a diagram showing an example of description of XML data processed by the computer device 201.

4 is a diagram illustrating a state in which an operation screen of an external device is displayed on the display unit 105 of the computer device 201.

5 is a diagram illustrating a definition of an area in the display portion 105 of the computer device 201.

FIG. 6 is a diagram illustrating a state in which XML data received from a plurality of cameras is displayed on the display unit 105 of the computer device 201.

7 is a flowchart for describing processing when the computer device 201 performs display on the display unit 105.

FIG. 8 is a flowchart specifically describing a process of S702 among the processes shown in the flowchart of FIG. 7.

FIG. 9 is a diagram showing an example of description of XML data, different from FIG. 3, processed by the computer device 201.

FIG. 10 is a flowchart for describing processing when the computer device 201 performs display on the display unit 105.

11 is a diagram illustrating a state in which XML data received from a plurality of cameras is displayed on the display unit 105 of the computer device 201.

12 is a flowchart showing processing when the computer device 201 performs display on the display unit 105.

FIG. 13 is a diagram illustrating display of the display unit 105 of the computer device 201 when the processing is performed in accordance with the flowchart of FIG. 12.

14 is a flowchart for describing processing when the computer device 201 performs display on the display unit 105.

FIG. 15 is a diagram illustrating display on the display unit 105 when the processing is performed in accordance with the flowchart of FIG. 14.

Fig. 16 is a diagram showing an example in which an operation screen of an external device is displayed by starting a plurality of web browsers on a PC.

17 is a diagram illustrating a selection screen of an external device.

18 is an example of the display of the display portion 105 of the computer device 201.

19 is a flowchart showing processing of the computer device 201.

Claims (19)

An information processing apparatus for receiving structured document data from a plurality of external devices connected through a network, and displaying an operation screen based on the configuration information included in the structured document data. A structure including first configuration information indicating an operation instruction screen for controlling the plurality of external devices transmitted from each of the plurality of external devices and second configuration information specifying an image picked up by the plurality of external devices Receiving means for receiving document data, Analysis means for analyzing configuration information in each of said structured document data received by said receiving means, and identifying said first configuration information and said second configuration information common to each of said structured document data; An operation instruction screen for controlling the plurality of external devices indicated by the first configuration information is displayed on a common display area of the operation screen, and the plurality of external devices specified by the second configuration information are picked up. And means for displaying an image in a separate display area of the operation screen. delete The method of claim 1, And selecting means for selecting one external device among the plurality of external devices, When the first configuration information different according to the external device is specified by the analysis by the analysis means, the display means is represented by the first configuration information of the external device selected by the selection means. An information processing apparatus characterized by displaying an operation instruction screen on a common display area of the operation screen. delete delete The method of claim 1, And transmitting means for transmitting information input based on the operation instruction screen of the operation screen to at least one of the plurality of external devices. delete The method of claim 1, And an image selecting means for selecting any one of a plurality of images displayed in said individual display area. The method of claim 8, And the transmitting means transmits the information input based on the operation instruction screen to an external device corresponding to the image selected by the image selecting means. The method of claim 1, The display means displays the operation instruction screen of the common first configuration information of each of the structured document data so as not to be repeated in the common display area of the operation screen, so that the second configuration information of each of the structured document data is displayed. An information processing apparatus characterized by displaying a specified image individually on an individual display area of the operation screen. The method of claim 1, Selecting means for selecting one of the plurality of external devices; And transmitting means for transmitting a command generated by the user's instruction to the information displayed in the common display area, to the external device selected by the selecting means. The method of claim 1, The image specified in the second configuration information is specified by a reference URL described in the second configuration information. A control method of an information processing apparatus for receiving structured document data from a plurality of external devices connected through a network, and displaying an operation screen based on configuration information included in the structured document data. First configuration information indicating an operation instruction screen for controlling the plurality of external devices and second configuration information for specifying images picked up by the plurality of external devices, transmitted from each of the plurality of external devices. A receiving process for receiving the structured document data; An analysis step of analyzing configuration information in each of the structured document data received by the receiving step, identifying the first configuration information and the second configuration information common to each of the structured document data; An operation instruction screen for controlling the plurality of external devices indicated by the first configuration information is displayed on a common display area of the operation screen, and the plurality of external devices specified by the second configuration information are picked up. And a display step of displaying an image on an individual display area of the operation screen. A computer-readable storage medium storing a computer program for causing a computer to function as the means of claim 1. delete delete delete delete delete

Images