JP2007156886A - Image display system, sub display control device for image display system, image display method, and computer program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To efficiently and effectively display a plurality of screens on a single screen. <P>SOLUTION: An image display system 10 comprises PCs 100 and 200 corresponding to respective shared screens W1 and W2 to be shared, and a controller 300 corresponding to a sharing screen X1 where the shared screens are positioned, and is contained in a network 11 that is a LAN network. Each PC supplies data on the shared screen to the controller 300. The controller 300 generates data for displaying the sharing screen X1 according to the supplied data, and displays the sharing screen X1 where the shared screens W1 and W2 are positioned on a display device 301. When a mouse or the like is operated on each PC to move a pointing image such as a pointer out of the shared screen, the pointer on the shared screen adjoining in the direction can be operated on the sharing screen X1. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a technical field of an image display system, a secondary display control device for an image display system, an image display method, and a computer program that are suitable when, for example, screens related to a plurality of display devices are displayed on the same screen.

  As this type of system, one sharing an application has been proposed (for example, see Patent Document 1). According to the application sharing system disclosed in Patent Document 1 (hereinafter referred to as “conventional technology”), bitmap image data of a sharing target application is transferred to a guest. At this time, the guest displays the bitmap image on the own window and transfers the mouse operation information and the keyboard operation information performed on the own window via the network to the host, thereby sharing the application among a plurality of computers. It is said that it is possible.

  In addition, in a single multi-display environment, a technique for enabling input from digitizers attached to all display devices has also been proposed (see, for example, Patent Document 2).

JP-A-9-91228 JP 2002-63107 A

  In the conventional technology, it is possible to share applications between a host and a plurality of guests, but only applications are shared. For example, the own window in each of a plurality of guests is displayed on the screen of the host, for example. It is difficult to aggregate and display.

  On the other hand, for example, it is possible to connect a plurality of computer devices to the host device in hardware and display a plurality of screens on the screen of the host device, but in this case, the number of connectable devices is Limited by the physical conditions of the host device. Due to such restrictions, for example, when adding a device to be displayed, the efficiency may be significantly reduced without switching physical connections. That is, the conventional technique has a technical problem that it is difficult to display a screen related to a plurality of devices on one screen.

  The present invention has been made in view of the above-described problems, and an image display system, an image display system sub-display control apparatus, an image display method, and a computer capable of efficiently and effectively displaying a plurality of screens on one screen. The challenge is to provide a program.

  In order to solve the above-described problem, an image display system according to a first aspect of the present invention includes a plurality of main display control devices that control each of a plurality of main display devices and a sub display control device that controls the sub display devices. Each of the main display control devices includes main control means for controlling the main display device so that the main screen is displayed, and main data for generating main display data for displaying the main screen on the sub display device. Display data generating means, and main communication means for transmitting the main display data to the sub display control apparatus via the network, wherein the sub display control apparatus transmits the main display data to be transmitted. Sub-display data generating means for generating sub-display data for displaying a predetermined type of sub-screen including at least a part of the plurality of main screens corresponding to each of the sub-screens, and the sub-display data generating means Characterized by comprising a sub-control means for controlling the sub-display device as the sub screen is displayed in accordance with 示用 data.

  In order to solve the above-described problem, the secondary display control device for an image display system according to claim 6 is accommodated in a network, and (ii) controls a plurality of main display devices and (ii) displays a main screen. Main control means for controlling the main display device, main display data generating means for generating main display data for displaying the main screen, and main communication means for transmitting the main display data via the network An image display system sub-display control device provided in an image display system including a plurality of main display control devices, each corresponding to each of the plurality of main display control devices based on the transmitted main display data Sub-display data generating means for generating sub-display data for displaying a predetermined type of sub-screen including at least a part of the plurality of main screens, and the sub-display data The sub-screen is characterized by comprising a sub-control means for controlling the sub-display unit to be displayed I.

  In order to solve the above-described problems, an image display method according to a seventh aspect includes a plurality of main display control devices that are accommodated in a network and respectively control a plurality of main display devices and a sub display control device that controls the sub display devices. An image display method in an image display system, wherein each main display control device controls a main display device so that a main screen is displayed, and displays the main screen on the sub display device. A main display data generation step for generating main display data for the main display, and a main transmission step for transmitting the main display data to the sub display control device via the network. The sub-table for displaying a predetermined type of sub-screen including at least a part of the plurality of main screens corresponding to each of the main-display data based on the transmitted main display data And a sub display data generating step of generating a use data, characterized by comprising a sub-control step of controlling the sub-display device as the sub screen is displayed the following sub display data.

  In order to solve the above-described problem, a computer program according to an eighth aspect causes a computer system to function as the main display control device according to any one of the first to fifth aspects.

  In order to solve the above-described problem, a computer program according to a ninth aspect causes a computer system to function as the sub-display control device according to any one of the first to fifth aspects.

<Embodiment of Image Display System>

  Embodiments according to the image display system of the present invention include a plurality of main display control devices that are housed in a network and respectively control a plurality of main display devices, and a sub display control device that controls the sub display devices. Each of the devices includes main control means for controlling the main display device so that the main screen is displayed, and main display data generation means for generating main display data for displaying the main screen on the sub display device. And main communication means for transmitting the main display data to the sub display control device via the network, the sub display control device based on the transmitted main display data, Sub-display data generating means for generating sub-display data for displaying a predetermined type of sub-screen including at least a part of the plurality of main screens corresponding to each of the sub-display data; The sub screen; and a sub-control means for controlling the sub-display unit to be displayed Te.

  In the present invention, the “network” preferably includes a relatively limited communication network such as a WAN (Wide Area Network) network or a LAN (Local Area Network) network, and further includes a wide area communication network such as the Internet. It is a comprehensive concept.

  According to the embodiment of the image display system of the present invention, during the operation, the main display device is controlled so that the main screen is displayed in each of the plurality of main display control devices. Here, the “main screen” according to the present invention is a screen having contents specific to each of the main display control devices, and refers to a screen displayed in a display area in the main display device corresponding to each of the screens. For example, the main screen is an OS (Operating System) screen under a computer system environment such as a personal computer (hereinafter referred to as “PC” as appropriate), various application software screens operating on the OS, or various windows. Or a multi-window screen that occupies an area on the OS screen. Alternatively, the “main screen” may be various windows developed on various OSs. That is, the main screen may be a part of the display area of the main display device. The main display device may have any mode as long as the main screen can be displayed. For example, a liquid crystal display device, a plasma display device, a CRT (Cathode Ray Tube) display device, You may have forms, such as a liquid crystal projector.

  The main display control device according to the present invention may be configured integrally with the main display device such as a notebook PC, or may be a main display such as various display devices configured independently of each other. You may have forms, such as various controllers for controlling a display apparatus.

  In each of the plurality of main display control devices, main display data is generated by the main display data generating means. The main display data is data such as RGB signals for displaying the main screen on the sub display device, and may be the data itself for displaying the main screen on the main display device, or the sub display. It may be data that has been corrected to match the characteristics of the device, or data that has been appropriately compressed into a format suitable for transmission over a network. The main display data generated in each of these main display control devices is transmitted to the sub display control device via the network by the main communication means.

  On the other hand, on the secondary display control device side, secondary display data for displaying the secondary screen is generated based on the primary display data individually transmitted from each primary display control device. The sub-control means controls the sub-display device so that the sub-screen is displayed according to the sub-display data.

  Here, the “sub-screen” is a concept that includes a screen including at least a part of a plurality of main screens corresponding to each of the main display control devices. For example, the main display control device that has transmitted main display data May be a screen in which all the main screens corresponding to are arranged on the display area evenly, or only the main screen selected from among the plurality of main screens according to some predetermined criteria is arranged It may be a screen. Such determination criteria are determined in advance so that the main screen to be displayed on the sub-screen can be selected with an objective reason experimentally, empirically, or based on simulation. May be.

  Note that the display mode of the main screen on the sub-screen is not limited at all, and the main screen may be displayed as a window or the like based on various OSs, for example. In this case, it becomes possible for the user to freely set the arrangement mode of the main screen on the sub-screen. For example, at least a part of the main screen related to the main display device is arranged on the sub-screen so as to overlap each other. It is also possible to easily change the size.

  Further, the main screen to be included in the sub-screen and its individual arrangement mode may be changed in real time each time depending on the usage environment of the image display system, for example, the progress of the conference.

  As described above, according to the embodiment of the image display system of the present invention, at least a part of each of the main screens displayed on the corresponding main display devices by the plurality of main display control devices is one. It is displayed on the secondary display device as a secondary screen. At this time, the sub display device is controlled by sub display control means for controlling the display content of the sub screen, and the sub display control means and each main display control means are accommodated in a network such as a LAN, for example. . Therefore, for example, compared with the case where each of the main display control device and the sub display control device are connected to each other via a video signal supply line such as an RGB cable, the main display control that the sub display control device can handle. The quantity of devices can increase dramatically. In addition, the main display control device that can dramatically increase, that is, the display mode of each sub screen of the main screen is determined efficiently by the sub display control device that manages them centrally. is there. That is, according to the embodiment of the image display system of the present invention, a plurality of screens can be efficiently and effectively displayed as one screen.

  In one aspect of the embodiment of the image display system of the present invention, the sub display control device is based on at least one of (i) quantity and (ii) priority of the main screen included in the sub screen. Arrangement mode determining means for determining an arrangement mode of the main screen included in the sub-screen is further provided, and the sub-display data generating unit is configured such that the main screen included in the sub-screen is determined in the sub-screen. The sub display data is generated so as to be arranged according to the above.

  According to this aspect, since the arrangement mode determining unit determines the arrangement mode of the main screen included in the sub screen based on at least one of the quantity and priority of the main screen included in the sub screen, it is efficient and effective. Thus, a plurality of screens can be displayed as one screen.

  The “quantity of the main screen included in the sub screen” is, for example, set in advance so that all the main screens related to the main display control device accommodated in the network are included in the sub screen. It may be equivalent to the quantity of display control devices. In addition, “priority” is a concept that includes judgment criteria for ranking main screens, and may be given in advance or may be specified individually according to the usage status of the image display system each time. It may be granted. Further, the priority may be specified from each main display control device, or may be specified on the sub display control device side. For example, the priority may be set higher in the order of connection to the network, or higher on the main screen on which some work (for example, instruction or input work with a mouse, a keyboard, or the like) is performed on the main display control device side A priority may be given.

In another aspect of the embodiment of the image display system of the present invention, each of the storage units is configured to be detachable from each of the storage units, and stores authentication information for authenticating the sub display device;
Authentication means for performing mutual authentication processing with the secondary display device based on the authentication information in a state where the storage means is mounted, and the secondary display data generating means The sub-display data is generated based on the main display data transmitted from the main display control apparatus that has been authenticated.

  According to this aspect, the main display control device includes the detachable storage unit, and authentication information for authenticating the sub display device is stored in the storage unit. Here, the “authentication information” is information for identifying whether the secondary display device is of a preset type, for example, ID information given to each secondary display device or the secondary display device. Different ID information for each type. Alternatively, it may be key information including a public key and a secret key set in advance with the sub display device.

  The authenticating unit mutually performs an authentication process with the sub display device based on the authentication information. Such authentication processing may have various forms depending on the mode of authentication information. For example, when the authentication information is the above-described key information, a known key authentication algorithm or the like is employed. Also good. Alternatively, as a relatively simple form, mutual authentication may be performed depending on whether or not the ID information individually given to the sub display device and the ID information stored as authentication information in the storage unit match each other. In this case, the storage means may be associated with the secondary display device (or all display devices that can be the secondary display device) in a one-to-one, one-to-many, many-to-one, or many-to-many manner, so that mutual authentication can be performed relatively easily Can be done.

  On the other hand, the sub display data generating means generates sub display data based on the main display data transmitted from the mutually authenticated main display control devices. Therefore, according to this aspect, the qualification to participate in the image display system can be easily given, and the quality and security of the image display system are improved.

  In view of the fact that the authentication information is information for identifying the secondary display device, the storage means includes, in addition to the authentication information, the resolution of the secondary display device to which the authentication information corresponds and the size of the display area. Information defining various display characteristics such as the size may be further stored. In this case, it is possible to easily generate main display data suitable for display on the sub display device.

  Further, when mutual authentication is performed through the removable storage unit in this manner, for example, the authentication process may be performed automatically or semi-automatically when the storage unit is mounted on the main display control device. . Furthermore, transmission of the main display data may be automatically or semi-automatically performed depending on the result of the authentication process. Similarly, transmission of the main display data may be stopped when the storage unit is removed from the main display control device. That is, the attaching / detaching action of the storage device itself may be used as a signal for executing the authentication process or transmitting or stopping the main display data. In this case, a clear operational feeling can be given to the user, and complicated work on the user side is not necessary, which is efficient.

  In another aspect of the embodiment of the image display system of the present invention, the main screen includes an instruction image for indicating a position on the main screen, and each of the images displays the instruction image on the screen of the main screen. Virtual position specifying means for specifying the virtual position of the instruction image outside the screen when an input indicating that the user should move to the outside is made; and virtual position data generating means for generating virtual position data corresponding to the virtual position; The main communication means transmits the virtual position data to the sub display control device via the network, and the sub display control device is represented by the transmitted virtual position data. Real position specifying means for specifying the actual position of the instruction image on the sub-screen, and on the main screen to which the actual position belongs among the main screens included in the sub-screen based on the actual position; Display position determining means for determining the display position of the instruction image, display position data generating means for generating display position data representing the determined display position, and the main display control corresponding to the main screen to which the actual position belongs. Sub-communication means for transmitting the display position data to the apparatus via the network, wherein the main control means in the main display control apparatus corresponding to the main screen belonging to the actual position is the transmitted display The arrangement of the instruction information on the main screen is controlled based on the position data.

  The “instruction image” according to the present invention is a concept that includes an image for instructing a position on the main screen. Preferably, for example, pointers and keyboards of various pointing devices such as a mouse, a trackball, or a touch pad are used. Point to the cursor.

  Here, when an input indicating that the instruction image should be moved outside the screen of the main screen is made, the virtual position of the instruction image outside the screen is specified by the virtual position specifying unit, and further, the virtual position data generating unit , Virtual position data corresponding to the virtual position is generated. The virtual position data is transmitted to the sub display control means. In addition, the aspect which specifies a virtual position is not limited as long as a virtual position can be specified, For example, it is set freely based on the display aspect etc. of an instruction | indication image. For example, a virtual movement amount of the pointer may be calculated based on an electric signal representing an operation amount of a mouse or the like, and the virtual position may be specified from the coordinate position of the pointer at that time. Further, the virtual position may not be clearly expressed as coordinates, and may be, for example, the operation amount of the mouse or the like described above or the movement amount of the pointer or the like.

  Here, the “input” is, for example, a signal generated in accordance with various operations that are artificially performed by the user via a predetermined input means. Such various operations include, for example, a mouse operation by the user, Refers to keyboard operations. Therefore, such input means includes various modes such as a mouse, a keyboard, a trackball, a touch pad, a scroll button, or a touch panel device. That is, the “input to move the image” described here means, for example, that the pointer is moved from the upper end (the same applies to the lower end, the left end or the right end) of the main screen to the upper side (also the lower side, the left side or the right side). This refers to the case where an operation for moving toward (good) is performed.

  On the other hand, in the secondary display control device, the actual position on the secondary screen is specified based on the virtual position data. Based on the actual position, the display position determining means displays the instruction image on the main screen to which the actual position belongs (at least other than the main screen corresponding to the main display control device to which the instruction image should be moved). Determine the position. Here, the “display position” refers to, for example, coordinates representing the absolute position on the corresponding main screen. The display position is transmitted to the main display control device corresponding to the corresponding main screen as display position data.

  Here, in the main display control device corresponding to the corresponding main screen, the main control means controls the arrangement of the instruction image based on the display position data. Accordingly, on the corresponding main screen, the position of the instruction information is operated in accordance with an input operation from another main display control device accommodated in the network. That is, according to this aspect, each main display control apparatus accommodated in the network can point to a desired position on the main screen arranged on the sub screen, which is effective and efficient.

  When the main screen is displayed as a window or the like on the sub-screen as described above, the main screens may be overlapped with each other or may be spaced apart from each other. However, in this case, the boundary between the overlapping or separated main screens is discontinuous. Therefore, the coordinates of the display position determined by the display position determining means do not necessarily have to be continuous before and after the input indicating that the display position should be moved is made. In addition, if the main screens overlap on the sub-screen, the main screen that is the current operation target (for example, movement when the instruction image should be moved off the screen on one main screen) The overlap mode may be changed so that the preceding main screen) is arranged in the front row.

  In another aspect of the embodiment of the image display control system of the present invention, the sub display control device further includes a drawing unit that draws an image different from the main screen on the sub screen according to a predetermined input. To do.

  According to this aspect, the sub-display control device is provided with the drawing unit, and an image different from the main screen can be drawn on the sub-screen in accordance with a predetermined input, which is further effective. The form of the drawing means is not limited as long as the drawn image and the sub-screen are viewed overlapping each other. For example, when a drawing panel is arranged overlapping the display panel portion of the sub display device that displays the sub screen, the drawing means draws an image on the drawing panel, so that the sub screen is displayed. It can be viewed as if the image was drawn.

In view of the fact that data relating to the main screen once passes through the sub display control device, the sub display control device may further control the drawing means in accordance with a predetermined drawing input made on each main screen. In this case, for example, the display color or the like may be changed as appropriate so that it can be visually discriminated from which main display control device the input is.
<Embodiment of Sub Display Control Device for Image Display System>

  Embodiments according to the sub-display control apparatus for an image display system of the present invention are accommodated in a network, and (i) control each of a plurality of main display apparatuses and (ii) display the main screen so that the main screen is displayed. A plurality of main control means for controlling the main display, main display data generating means for generating main display data for displaying the main screen, and main communication means for transmitting the main display data via the network. An image display system sub-display control device provided in an image display system including a main display control device, wherein the plurality of main display control devices corresponding to each of the plurality of main display control devices based on the transmitted main display data Sub-display data generating means for generating sub-display data for displaying a predetermined type of sub-screen including at least a part of the screen, and the sub-screen according to the sub-display data ; And a sub-control means for controlling the sub-display unit to be displayed.

According to the embodiment of the sub display control apparatus for an image display system of the present invention, the same effect as the sub display control apparatus in the embodiment of the image display system of the present invention described above can be obtained.
<Embodiment of Image Display Method>

  An embodiment of the image display method of the present invention is an image in an image display system that includes a plurality of main display control devices that control each of a plurality of main display devices and a sub display control device that controls the sub display devices. A display method comprising: a main control process for controlling the main display device such that a main screen is displayed in each of the main display control devices; and a main display for displaying the main screen on the sub display device A main display data generating step for generating data; and a main transmission step for transmitting the main display data to the sub display control device via the network, wherein the transmission is performed in the sub display control device. Generating sub-display data for displaying a predetermined type of sub-screen including at least a part of the plurality of main screens corresponding to each of the main display data. And a sub display data generating step that, the said sub-screen in accordance with the sub-display data; and a sub-control step of controlling the sub-display unit to be displayed.

According to the embodiment of the image display method of the present invention, the same effects as those of the embodiment of the image display system of the present invention can be obtained by the operations in the various steps equivalent to the embodiment of the image display system of the present invention described above. Realized.
<First Embodiment of Computer System>

  The first embodiment according to the computer system of the present invention causes the computer system to function as the main display control device according to any one of the above.

  According to the first embodiment of the computer program of the present invention, it can be attached to and detached from a computer system such as a ROM, a CD-ROM, a DVD-ROM, a hard disk or other recording medium storing a computer program or a USB (Universal Serial Bus) memory. If the computer program is read into a computer system from a solid-state storage device and executed, or if the computer program is downloaded to the computer system via, for example, communication means, the computer program is executed as described above. The main display control device in the embodiment according to the image display system of the present invention can be realized relatively easily.

Incidentally, in response to the various aspects in the embodiments of the image display system of the present invention described above, the first embodiment of the computer program of the present invention can also adopt various aspects.
<Second Embodiment of Computer System>

  The second embodiment according to the computer system of the present invention causes the computer system to function as the sub-display control device described in any one of the above.

  According to the second embodiment of the computer program of the present invention, it is detachable from a computer system such as a ROM, a CD-ROM, a DVD-ROM, a hard disk or other recording medium storing a computer program or a USB (Universal Serial Bus) memory. If the computer program is read into a computer system from a solid-state storage device and executed, or if the computer program is downloaded to the computer system via, for example, communication means, the computer program is executed as described above. The secondary display control device in the embodiment according to the image display system of the present invention can be realized relatively easily.

  Incidentally, in response to the various aspects in the embodiments of the image display system of the present invention described above, the second embodiment of the computer program of the present invention can also adopt various aspects.

  As described above, according to the embodiment of the image display system of the present invention, since the main display control device and the sub display control device are provided, a plurality of screens can be efficiently and effectively displayed on one screen. Is possible.

  As described above, according to the embodiment of the image display system sub-display control apparatus of the present invention, the image display system according to the embodiment of the present invention includes the sub-display data generation means and the sub-control means. A sub-display control device can be suitably realized.

  As described above, according to the embodiment of the image display method of the present invention, a plurality of screens can be efficiently and effectively integrated by the operation in each process equivalent to each means in the embodiment of the image display system. It can be displayed on the screen.

  As described above, according to the first embodiment of the computer program of the present invention, the computer system is caused to function as the main display control device in the embodiment of the image display system of the present invention. It is possible to display on one screen efficiently and effectively.

  As described above, according to the second embodiment of the computer program of the present invention, the computer system functions as the sub display control means in the embodiment of the image display system of the present invention. It is possible to display on one screen efficiently and effectively.

  These effects and other advantages of the present invention will become apparent from the embodiments described below.

Preferred embodiments of the present invention will be described below with reference to the drawings as appropriate.
<First embodiment>
<Configuration of Example>
First, the configuration of the image display system according to the first embodiment of the present invention will be described with reference to FIG. FIG. 1 is a conceptual diagram of the image display system 10.

  1, an image display system 10 includes a personal computer 100 (hereinafter referred to as “PC 100” as appropriate), a personal computer 200 (hereinafter referred to as “PC 200” as appropriate), and a display controller 300 (hereinafter referred to as “controller 300” as appropriate). Is an example of an “image display system” according to the present invention, which is accommodated in the network 11 which is a LAN network.

  A display device 101 and a display device 201 are connected to the PC 100 and the PC 200, respectively. The display devices 101 and 201 are each an example of a “main display device” according to the present invention, which is configured as a liquid crystal display device and includes screen units 102 and 202 which are information display areas. Each of the PC 100 and the PC 200 is an example of a “main display control device” according to the present invention.

  On the other hand, a display device 301 is connected to the controller 300. The display device 301 is a plasma display device, and is an example of the “sub-display device” according to the present invention, which includes a screen portion 302 larger than the screen portions 102 and 202 described above as an information display area. The controller 300 is an example of the “sub display control device” and “image display system sub display control device” according to the present invention.

  Next, a detailed configuration of the PC 100 will be described with reference to FIG. FIG. 2 is a block diagram of the PC 100. In the figure, the same reference numerals are given to the same portions as those in FIG. 1, and the description thereof will be omitted as appropriate. Also, the PC 100 and the PC 200 have the same hardware configuration, and the PC 200 will be described at the same time as the description of the PC 100.

  2, the PC 100 includes a control unit 110, an input unit 120, a position detection unit 130, a USB memory 140, a display control unit 150, and a communication unit 160.

  The control unit 110 includes, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like, and is a control unit that controls the entire operation of the PC 100. ”,“ Main display data generating means ”,“ authentication means ”, and“ virtual position data generating means ”.

  The input unit 120 is a general input device including a mouse, a keyboard, and the like, and a user (not shown) can appropriately input various types of information to the PC 100 via the input unit 120.

  The position detection unit 130 is a position detection unit that detects a display position of a pointer or cursor (that is, an example of an “instruction image” according to the present invention) that represents an input position via the input unit 120. It is configured to function as an example of “virtual position specifying means”.

  The USB memory 140 is an example of the “storage unit” according to the present invention, and is a storage device configured to be detachable from the PC 100. The USB memory 140 is configured to be able to execute data communication based on the USB standard with the PC 100 when the USB memory 140 is attached to the PC 100. The USB memory 140 stores an application program that supports image sharing processing, which will be described later, and authentication information related to the display device 301.

  The display control unit 150 is a display control unit that controls the display device 101 so that the shared screen W1 (that is, an example of the “main screen” according to the present invention) is displayed on the screen unit 102 of the display device 101. It is comprised so that it may function as an example of the "main control apparatus" concerning this invention with the control part 110. FIG.

  The communication unit 160 is a communication interface for executing data communication with the controller 300 via the network 11 and is an example of a “main communication unit” according to the present invention.

  The PC 200 includes a control unit 210, an input unit 220, a position detection unit 230, a USB memory 240, a display control unit 250, and a communication unit 260 (all not shown) corresponding to the respective units of the PC 100 described above. It shall be provided. In addition, it is assumed that the shared screen W2 (that is, another example of the “main screen” according to the present invention) is displayed on the screen unit 202 of the display device 201 by the display control unit 250 of the PC 200.

  Next, a detailed configuration of the controller 300 will be described with reference to FIG. FIG. 3 is a block diagram of the controller 300. In the figure, the same reference numerals are given to the same portions as those in FIG. 1, and the description thereof will be omitted as appropriate.

  In FIG. 3, the controller 300 includes a control unit 310, a display control unit 320, and a communication unit 330.

  The control unit 310 includes, for example, a CPU, a ROM, a RAM, and the like, and is a control unit that controls the entire operation of the controller 300. The “sub control unit”, “sub display data generation unit”, and “arrangement mode” according to the present invention. Each of the “determination unit”, “real position specifying unit”, “display position determination unit”, and “display position data generation unit” functions as an example. The ROM of the control unit 310 stores an application program related to the image sharing process, and the control unit 310 can execute the image sharing process by executing the application program.

  The display control unit 320 is a display control unit that controls the display device 301 so that the shared screen X1 (that is, an example of the “sub screen” according to the present invention) is displayed on the screen unit 302 of the display device 301. The unit 310 is configured to function as an example of the “sub control device” according to the present invention.

  The communication unit 330 is a communication interface for executing data communication with the PCs 100 and 200 via the network 11, and is an example of the “sub communication unit” according to the present invention.

<Operation of Example>
<Display of shared screen on each PC>
In the PC 100 and the PC 200, the shared screens W1 and W2 are displayed on the corresponding display devices, respectively. The display flow of the shared screen will be described below. Since the processing flow is the same for each PC, the processing in the PC 100 will be described here.

  In the PC 100, the control unit 110 controls the display control unit 150 in a higher level, and displays various display data including, for example, display data for the OS screen of the PC 100, display data for windows related to various applications, and the like. 150, the shared screen W1 is displayed on the screen unit 102. Further, an operation amount of a cursor and a pointer (that is, an example of an “instruction image” according to the present invention) representing an operation position of the input unit 120 is detected as an electrical signal by the position detection unit 130 and is converted into position data by the control unit 110. Converted. The control unit 110 supplies the position data to the display control unit 150 to display a pointer and a cursor at a display position corresponding to the operation amount of the input unit 120. In this way, the non-shared screen is displayed on the screen portion of each display device under each PC environment.

<Details of image sharing process>
In the image display system 10, when the controller 300 executes image sharing processing, it is possible to arrange a shared screen associated with each PC in the shared screen X1 and display it in a single screen. Here, the details of the image sharing process will be described with reference to FIG. FIG. 4 is a flowchart of the image sharing process.

  As a pre-stage of the image sharing process, the control unit in each PC executes an authentication process with the controller 300 (or the display device 301) using the authentication information stored in the USB memory. When the authentication is not successful, the controller 300 prohibits the shared screen related to the PC from being placed on the shared screen X1. Since the authentication process is well known, the illustration is omitted for the purpose of preventing the figure from becoming complicated.

  In FIG. 4, the control unit 310 first confirms the number of inputs (step A10). The number of inputs in the present embodiment is the total number of screens to be arranged on the shared screen X1, and in this embodiment corresponds to the screen to be arranged on the shared screens W1 and W2, and thus is “2”. However, since the controller 300 and each PC are connected via the network 11 which is a LAN network, there is substantially no upper limit to the number of inputs, and a large number of PCs can be connected. Accordingly, according to the image sharing processing according to the present embodiment, it is possible to easily arrange a larger number of screens on the shared screen X1.

  When the number of inputs is confirmed, the control unit 310 arranges each shared screen on the shared screen X1 (step A11). Here, the details of the shared screen X1 on which the shared screen is arranged will be described with reference to FIG. FIG. 5 is a schematic diagram of screen display in the image display system 10. In the figure, the same reference numerals are given to the same portions as those in FIG. 1, and the description thereof will be omitted as appropriate.

  In FIG. 5, the shared screen X <b> 1 is displayed on the display device 301. In the shared screen X1, the shared screens W1 and W2 are arranged in an equal size, and as shown, the shared screen W2 corresponding to the PC 200 on the left side corresponds to the PC 100 on the right side. A shared screen W1 is arranged.

  The arrangement mode of the shared screen on the shared screen X1 is not limited at all. Here, the arrangement of the shared screen will be described with reference to FIG. FIG. 6 is a schematic diagram showing a variation of the arrangement of the shared screen on the shared screen X1. In the figure, the same reference numerals are given to the same portions as those in FIG. 5, and the description thereof will be omitted as appropriate.

  In FIG. 6, when the number of inputs is “3”, the shared screens W1, W2, and W3 may be arranged in parallel in the horizontal direction of the screen on the shared screen X1 (see FIG. 3A). ). When the number of inputs is “4”, the shared screens W1, W2, W2, W3, and W4 may be equally arranged vertically and horizontally on the shared screen X1 (see FIG. 3B). Alternatively, for example, in a part of a PC included in the image display system 10, when the resolution of the corresponding display device is different from that of the display device 301, the shared screen is not necessarily arranged evenly in the shared screen X 1. Good (see FIG. 6C).

  In addition to the example shown in FIG. 6, the arrangement mode of the shared screens in the shared screen X1 as an example of the “sub-screen” according to the present invention may be determined individually and specifically, for example, It does not necessarily have to be equally arranged. Alternatively, it is not always necessary to include all of the input shared screens (for example, the screen W1 and the screen W2) in the shared screen X1. Such an arrangement mode of each screen to be shared in the shared screen X1 may be appropriately determined by the control unit 310 in the controller 300.

  Returning to FIG. 4, when the shared screens W1 and W2 are arranged on the shared screen X1, the control unit 310 determines whether or not the pointer (or cursor or the like) protrudes from the respective screens in the shared screen W1 or W2. It discriminate | determines (step A12).

  In each PC, based on the operation amount of the input unit 120 (or 220) detected by the position detection unit 130 (or 230) and the display position of the pointer, it is determined whether or not the pointer protrudes from the screen. . When the pointer protrudes outside the screen, the control unit 110 (or 210) calculates the virtual display position of the pointer outside the shared screen based on the detected operation amount and the like, and determines the virtual display position. Data representing it is transmitted to the controller 300. The controller 300 determines that the pointer protrudes from the screen when the data representing the virtual display position is acquired (step A14: YES). When the pointer is moved within each shared screen (step A12: NO), the controller 300 repeats the process related to step A12 and controls the process to a standby state. In this case, the display of the shared screen X1 is always controlled based on the display data regarding the shared screen.

  When there is a shared screen in which the pointer protrudes outside the screen (that is, when an input indicating that the instruction image should be moved to the outside of the screen is made), the control unit 310 displays the destination of the pointer beyond the shared screen. A shared screen (hereinafter referred to as “target screen” as appropriate) is identified, and pointer position information on the target screen is generated (step A13).

  When the position information of the pointer on the target screen is generated, the control unit 310 transmits data representing the position information to the PC corresponding to the target screen (step A14). Accordingly, in the PC corresponding to the target screen, the display control unit is controlled to display the pointer at a position corresponding to the position information. As a result, in the PC corresponding to the target screen, the pointer position is forcibly moved in accordance with an input from another PC. Along with this, the display content of the shared screen X1 inevitably changes. When the process related to step A14 ends, the process returns to step A12, and the display of the shared screen X1 is continued.

  Here, with reference to FIG. 7, the operation right delegation of the pointer will be described. FIG. 7 is a schematic diagram relating to delegation of the operation right of the pointer. In the figure, the same reference numerals are given to the same portions as those in FIG. 5, and the description thereof will be omitted as appropriate.

  In FIG. 7, pointers are displayed in the vicinity of the center of each of the shared screens W1 and W2. As a result, the shared screen X1 is also arranged in parallel, and a pointer is displayed near the center of each of them (see FIG. 7A).

  Next, it is assumed that, on the shared screen W1, the pointer is moved in the left direction in the figure, and an input indicating that the pointer should be moved out of the screen is made. In this case, also on the shared screen X1, the pointer moves to the left in the area of the shared screen W1 on the right side (see FIG. 7B).

  Here, the shared screen W2 is arranged on the left side of the shared screen W1, and when it is instructed that the pointer should move outside the screen by moving the pointer in the illustrated direction, the target screen is shared. The screen W2 is displayed. Therefore, first, the right to operate the pointer on the shared screen W2 is transferred from the PC 200 (or the user who uses the PC 200) to the PC 100 (or the user who uses the PC 100) (see FIG. 7C).

  At the same time, the display position of the pointer in the shared screen W2 is determined based on the amount of pointer movement on the shared screen W1. Finally, the pointer operation on the shared screen W1 that is originally under the control of the PC 200 is forcibly moved by the pointer operation performed on the shared screen W1 by the PC 100 to which the operation right has been delegated (FIG. 7D). )reference).

  As described above, according to the image display system 10 according to the first embodiment, since a plurality of PCs that want to share screens are connected to the controller 300 via the network 11, the number of screens that can be shared is substantially reduced. There is no specific limitation. In addition, since input from each of a plurality of PCs that want to share screens always passes through the controller 300, it is possible to easily optimize various display modes such as the layout of shared screens on the shared screen X1. . Further, since the display content of the shared screen X1 is controlled through the controller 300 in this way, by inputting that the pointer protrudes from the respective PCs to the outside of the screen, the objects to be adjacent to each other on the shared screen X1. It is also possible to share a pointer operation right between shared screens. In other words, according to the image sharing system of the present embodiment, it is possible to display a plurality of screens on one screen efficiently and effectively.

  In consideration of practical usage conditions of the image sharing system, there may be a situation in which it is not desired to share the operation right of the pointing image such as the pointer with other PCs. In preparation for such a case, it may be configured in advance that whether to share the operation right of the pointer can be appropriately set on each PC side.

  Here, with reference to FIG. 8, it supplements about the display aspect of the to-be-shared screen in the shared screen X1. FIG. 8 is a schematic diagram showing a display mode of the shared screen on the shared screen X1. In the figure, the same reference numerals are given to the same portions as those in FIG. 6, and the description thereof is omitted as appropriate.

  In FIG. 8, three types of shared screens W1, W2, and W3 are arranged on the shared screen X1. These shared screens are all displayed as windows that can be enlarged / reduced and moved. These shared screens can be easily arranged so as to overlap each other. For example, the shared screens W1, W2, and W3 can be arranged in this order from the near side to the far side (see FIG. 8 (a)).

  When the operation right is transferred as described above, the window corresponding to the screen to be shared that is the operation target at the present time may be promptly displayed in the front row. For example, when the pointer moves from the shared screen W1 to the shared screen W3, the shared screen W3 may be displayed in the front row (see FIG. 8B). In addition, the initial display position of the pointer when the pointer is moved between windows that overlap each other in this way may be determined so as to be continuous with each other between the shared screens. It may be determined discontinuously by displaying a pointer at the edge of the previous window.

<Second embodiment>
Next, a second embodiment of the present invention, which is a further development of the first embodiment, will be described. First, the configuration of the image display system according to the second embodiment of the present invention will be described with reference to FIG. FIG. 9 is a block diagram of the controller 303 according to the second embodiment of the present invention. In the figure, the same reference numerals are given to the same portions as those in FIG. 3, and the description thereof will be omitted as appropriate.

  In FIG. 9, the controller 303 further includes a drawing control unit 400 and an input unit 500 in addition to the configuration of the controller 300 according to the first embodiment.

  The drawing control unit 400 is a drawing processing unit for drawing an arbitrary image on the shared screen X1. The drawing control unit 400 includes a drawing panel (not shown), and the drawing panel is disposed so as to overlap the screen unit 302 in the display device 301. The drawing panel is configured to be able to freely draw an erasable image on a corresponding portion by applying a physical pressure (for example, a pressure by a pen operation or a touch operation).

  The input unit 500 is an input unit configured to be able to draw an image on the screen unit 302 in conjunction with the drawing control unit 400.

  Next, the operation of the second embodiment will be described with reference to FIG. FIG. 10 is a schematic diagram of the shared screen X1. In the figure, the same reference numerals are given to the same portions as those in FIG. 5, and the description thereof will be omitted as appropriate.

  In FIG. 10, on the shared screen X1, an insertion image 600 is drawn in an area corresponding to the shared screen W2. The inserted image 600 is an image drawn by the drawing control unit 400 in response to an input operation from the input unit 500.

  As described above, according to the controller 303 according to the second embodiment, by providing the input unit 500 and the drawing control unit 400, an image can be freely drawn on the shared screen X1 as shown in the first embodiment. be able to. Therefore, when the image display system is used for a meeting or the like, various effects such as smooth communication and emphasizing a certain part on the screen can be expected.

<Modification>
The following can be considered as modifications of the second embodiment. Here, a modification of the second embodiment will be described with reference to FIG. FIG. 11 is another schematic diagram of the shared screen X1. In the figure, the same reference numerals are given to the same parts as those in FIG. 10, and the description thereof will be omitted as appropriate.

  In FIG. 11, in addition to the insertion image 600 described above, insertion images 610 and 620 are further drawn on the shared screen X1. The inserted images 610 and 620 are images input from the PCs 100 and 200 via the input units 120 and 220, respectively.

  That is, the control unit 310 acquires the position where the input operation from each PC is performed, and transmits a drawing request to the drawing control unit 400 in the same manner as the input from the input unit 500. Accordingly, the drawing control unit 400 draws the insertion image input from each PC on the shared screen X1. For this reason, it is more effective. In addition, in order to identify each PC, you may change the display color of an insertion image for every PC. In this case, the visibility is improved, which is more effective.

  The present invention is not limited to the above-described embodiments, and can be appropriately changed without departing from the spirit or idea of the invention that can be read from the claims and the entire specification. An image display system with such a change, An image display system sub-display control apparatus, an image display method, and a computer program are also included in the technical scope of the present invention.

1 is a conceptual diagram of an image display system according to a first embodiment of the present invention. It is a block diagram of the personal computer in the image display system of FIG. It is a block diagram of the display controller in the image display system of FIG. It is a flowchart of an image sharing process. 4 is a schematic diagram of screen display in the image display system 10. FIG. It is a schematic diagram showing the variation of arrangement | positioning of the to-be-shared screen in a shared screen. It is a schematic diagram regarding the forced operation of a pointer. It is a schematic diagram showing the display mode of the screen to be shared in the shared screen. It is a block diagram of the display controller which concerns on 2nd Example of this invention. It is a schematic diagram of the shared screen which concerns on 2nd Example. It is a schematic diagram of the shared screen which concerns on the modification of 2nd Example.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Image display system, 11 ... Network, 100 ... PC, 101 ... Display apparatus, 102 ... Screen part, 110 ... Control part, 120 ... Input part, 130 ... Position detection part, 140 ... USB memory, 150 ... Display control part , 160 ... communication unit, 200 ... PC, 300 ... display controller, 301 ... display device, 302 ... screen unit, 303 ... display controller, 310 ... control unit, 320 ... display control unit, 330 ... communication unit, 400 ... drawing control Part, 500... Input part.

Claims (9)

A plurality of main display control devices that are housed in the network and control a plurality of main display devices, respectively, and a sub display control device that controls the sub display devices;
Each of the main display control devices
Main control means for controlling the main display device such that a main screen is displayed;
Main display data generating means for generating main display data for displaying the main screen on the sub display device;
Main communication means for transmitting the main display data to the sub-display control device via the network,
The sub-display control device
Sub display data for generating sub display data for displaying a predetermined type of sub screen including at least a part of the plurality of main screens corresponding to each of the main display data, based on the transmitted main display data Generating means;
An image display system comprising: sub control means for controlling the sub display device so that the sub screen is displayed according to the sub display data. The sub-display control device
Further comprising arrangement mode determining means for determining an arrangement mode of the main screen included in the sub-screen based on at least one of (i) quantity and (ii) priority of the main screen included in the sub-screen,
2. The sub-display data generation unit generates the sub-display data so that a main screen included in the sub-screen is arranged in the sub-screen according to the determined arrangement mode. The image display system described in 1. Each of the above
Storage means configured to be detachable for each of the above, and storing authentication information for authenticating the secondary display device;
Authentication means for performing mutual authentication processing with the secondary display device based on the authentication information in a state in which the storage means is mounted,
The sub-display data generation means generates the sub-display data based on the main display data transmitted from the main display control device that has been authenticated as a result of the authentication process. 3. The image display system according to 1 or 2. The main screen includes an instruction image for indicating a position on the main screen,
Each of the above
Virtual position specifying means for specifying a virtual position of the instruction image outside the screen when an input indicating that the instruction image should be moved out of the main screen is made;
Virtual position data generating means for generating virtual position data corresponding to the virtual position, and
The main communication means transmits the virtual position data to the sub display control device via the network,
The sub-display control device
Real position specifying means for specifying the real position of the instruction image on the sub-screen represented by the transmitted virtual position data;
Display position determining means for determining the display position of the instruction image on the main screen to which the actual position belongs among the main screens included in the sub-screen, based on the actual position;
Display position data generating means for generating display position data representing the determined display position;
Sub communication means for transmitting the display position data via the network to the main display control device corresponding to the main screen to which the real position belongs,
The main control means in the main display control device corresponding to the main screen belonging to the actual position controls the arrangement of the instruction information on the main screen based on the transmitted display position data. The image display system according to any one of claims 1 to 3. The said sub display control apparatus is further equipped with the drawing means which draws the image different from the said main screen on the said sub screen according to predetermined | prescribed input. The claim 1 characterized by the above-mentioned. The image drawing system described. And (ii) main control means for controlling the main display device so that the main screen is displayed, and (i) main control means for displaying the main screen. A sub-display for an image display system provided in an image display system comprising a plurality of main display control devices comprising a main display data generating means for generating data and a main communication means for transmitting the main display data via the network A control device,
Based on the transmitted main display data, sub-display data for displaying a predetermined type of sub-screen including at least a part of the plurality of main screens corresponding to each of the plurality of main display control devices. Sub-display data generation means for generating;
A sub-display control device for an image display system, comprising: sub-control means for controlling the sub-display device so that the sub-screen is displayed according to the sub-display data. An image display method in an image display system including a plurality of main display control devices and a sub display control device for controlling a sub display device, each of which is accommodated in a network and controls a plurality of main display devices,
In each of the main display control devices,
A main control step of controlling the main display device such that a main screen is displayed;
A main display data generation step for generating main display data for displaying the main screen on the sub-display device;
A main transmission step of transmitting the main display data to the sub-display control device via the network, and
In the sub-display control device,
Sub display data for generating sub display data for displaying a predetermined type of sub screen including at least a part of the plurality of main screens corresponding to each of the main display data, based on the transmitted main display data Generation process;
And a sub-control step of controlling the sub-display device so that the sub-screen is displayed according to the sub-display data.   A computer program for causing a computer system to function as the main display control device according to any one of claims 1 to 5.   A computer program for causing a computer system to function as the sub-display control device according to any one of claims 1 to 5.

Images