JP2011128710A - Display device, display system, display control method and display control program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To display an image not displayed in the outside. <P>SOLUTION: The display device includes: a data reception part (S31, S32) receiving, from the outside, a display screen table having a window record including a position in a screen of a first window, a file name of image data displayed in the first window, and information indicating an overlap state when the first window overlaps another first window in each of one or more first windows included in a screen, and one or more pieces of the image data displayed in the one or more first windows, respectively; and a display image generation part generating a display image by combining one or more second windows for displaying the received one or more pieces of the image data according to the display screen table (S40, S42, S43), and displaying the generated display image on electronic paper (S44). <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a display device, a display system, a display control method, and a display control program, and more particularly, to a display device that can display a plurality of images simultaneously, a display system, a display control method that is executed by the display device, and a display control program. .

  When a presenter outputs an image stored in a personal computer to a projector or the like and displays it at a meeting or the like, it is convenient to display the image output by the personal computer on a display device used by a participant. The display device in this case does not need to be highly functional, and for example, electronic paper can be used.

  Japanese Patent Laid-Open No. 2008-287614 discloses a process in which an information processing apparatus transmits a request for specification information of a display device connected to a terminal to the terminal via a network, and the terminal is connected to the terminal. Display from the terminal based on the process of receiving the specification information of the display device via the network and the screen output setting value for each display device specification stored in the display device specification information and the screen output setting value management table Determine the screen output setting value suitable for the device specifications, set the screen output setting value file, receive the terminal input information, and generate screen information based on the input information and screen output setting value A thin client type information processing system is described that executes a process for transmitting and a process for transmitting the generated screen information to a terminal via a network.

However, the display device can display the screen information transmitted from the information processing device, but cannot display the screen information when the connection with the information processing device is disconnected. If a memory is mounted on the display device and screen information transmitted from the information processing device is stored in the memory, it can be displayed even after being disconnected from the information processing device. In the case where the screen information includes a multi-window in which a plurality of windows are overlapped, there is a problem that the image of the window that overlaps below another window cannot be displayed in order to store the entire screen image. .
JP 2008-287614 A

  The present invention has been made to solve the above-mentioned problems, and one of the objects of the present invention is to provide a display device capable of displaying an image not displayed externally.

  Another object of the present invention is to provide a display system capable of causing a display device to display an image that is not displayed on an information processing device.

  Still another object of the present invention is to provide a display control method capable of displaying an image not displayed externally.

  Still another object of the present invention is to provide a display control program capable of displaying an image not displayed externally.

  The present invention has been made to solve the above-described problems, and according to one aspect of the present invention, the display device is provided in the screen of the first window for each of one or more first windows included in the screen. A display screen table having a window record including the position of the image data, the file name of the image data displayed in the first window, and information indicating the overlapping state when the first window overlaps another first window; Data receiving means for receiving one or more image data respectively displayed in one or more first windows from the outside, and one or more first data for displaying each of the received one or more image data according to a display screen table Display image generating means for generating a display image by combining two windows, and display means for displaying the generated display image. Obtain.

  According to this aspect, one or more display screen tables and one or more image data respectively displayed in one or more first windows are received from the outside, and one or more image data are displayed according to the display screen table. By combining the second windows, a display image is generated, and the display image is displayed. Since the display image is generated according to the display screen table, the same screen as the screen displayed externally can be displayed. In addition, since one or more image data respectively displayed in one or more first windows is received, an image hidden below can be displayed when a plurality of second windows overlap. As a result, it is possible to provide a display device that can display an image that is not displayed externally.

  Preferably, the storage means for storing the received display screen table and one or more image data, the operation reception means for receiving a user operation, and the display image generation means are stored in the storage means by the operation reception means. In response to accepting an operation for designating the display screen table, a display image is generated in accordance with the designated display screen table.

  Preferably, when an operation for indicating a position in the display image displayed by the operation receiving means is received, a window specifying means for specifying the second window including the indicated position, and a display screen generating means, In response to accepting an operation to change the second window specified by the operation accepting means, a display image is generated according to the accepted operation.

  According to this aspect, when an operation for indicating a position in the display image is received, a second window including the specified position is specified, and an operation for changing the specified second window is received. In response, a display image is generated in accordance with the accepted operation. For this reason, the user can change the image displayed for each second window included in the display image.

  Preferably, the data receiving means further receives the related image data related to the image data, and when the operation indicating the position in the display image displayed by the operation receiving means is received, the data receiving means includes the indicated position. Window specifying means for specifying the second window, and the display image generating means includes a window record including the file name of the image data displayed in the specified second window as the file name of the related image data. When an operation for displaying a related image is received by the operation receiving means, a display image is generated by further combining a new second window for displaying the related image data.

  According to this aspect, related image data related to the image data is received, and a display image including a new second window that displays the related image data related to the image data displayed in the second window is generated. Therefore, related image data can be displayed.

  Preferably, when an operation for indicating a position in the display image displayed by the operation receiving unit is received, a handwritten image detecting unit for detecting a handwritten image based on the instructed position, and the detected handwritten image, An association means for associating with the image data displayed in the second window including the position detected by the indicated position detection means, wherein the display image generating means is associated with a handwritten image in the image data Then, a second window for displaying an image on which a handwritten image associated with the image data is superimposed is generated.

  According to this aspect, the handwritten image is detected based on the position instructed by the user, and the detected handwritten image is associated with the image data displayed in the second window including the instructed position. For this reason, image data and a handwritten image can be associated.

  According to another aspect of the present invention, the display system is a display system including a display device and an information processing device, and the information processing device displays a screen including one or more first windows; For each of the one or more first windows included in the displayed screen, the position of the first window in the screen, the file name of the image data displayed in the first window, and the first window are different. Table generating means for generating a display screen table having a window record including information indicating an overlapping state when overlapping with the first window, the generated display screen table, and the one or more first windows are respectively displayed. Transmitting means for transmitting one or more image data, and the transmitting means includes a display screen table after change each time the displayed screen is changed, The one or more image data is transmitted, and the display device displays the one or more image data according to the display screen table and data receiving means for receiving the display screen table and the one or more image data from the information processing device. Display image generating means for generating a display image by synthesizing one or more second windows, and display means for displaying the generated display image.

  According to this aspect, it is possible to provide a display system that can display an image that is not displayed on the information processing device on the display device.

  Preferably, the information processing apparatus further includes an acquisition unit that acquires the related data when the data that is the basis of the image data displayed in each of the one or more first windows includes link information that refers to the related data, The table generation means adds the file name of the related image data as an image of the related data acquired to the window record including the file name of the image data including the link information, and the transmission means further transmits the related image data for display. The data receiving means included in the apparatus further receives related image data, and the display device further includes an operation accepting means for accepting a user operation, and an operation for indicating a position in the display image displayed by the operation accepting means. When received, image specifying means for specifying the image data displayed in the second window including the instructed position When the window record including the file name of the specified image data includes the file name of the related image data, the display image generating unit receives the operation for displaying the related image by the operation receiving unit. A display image is generated by further combining the second window for displaying the related image data.

  According to still another aspect of the present invention, the display control method includes, for each of one or more first windows included in the screen, the position of the first window in the screen and the image displayed in the first window. A display screen table having a window record including a file name of data and information indicating an overlapping state when the first window overlaps with another first window, and 1 displayed on one or more first windows, respectively. Receiving the above image data from the outside, generating a display image by synthesizing one or more second windows that respectively display the received one or more image data according to the display screen table; Displaying the generated display image.

  If this aspect is followed, the display control method which can display the image which is not displayed outside can be provided.

  According to still another aspect of the present invention, the display control program stores, for each of one or more first windows included in the screen, the position of the first window in the screen and the image displayed in the first window. A display screen table having a window record including a file name of data and information indicating an overlapping state when the first window overlaps with another first window, and 1 displayed on one or more first windows, respectively. Receiving the above image data from the outside, generating a display image by synthesizing one or more second windows that respectively display the received one or more image data according to the display screen table; Causing the computer to execute a step of displaying the generated display image.

  If this aspect is followed, the display control program which can display the image which is not displayed outside can be provided.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same members are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

  FIG. 1 is a diagram showing an overall outline of a display system according to one embodiment of the present invention. Referring to FIG. 1, display system 1 includes a personal computer (hereinafter referred to as “PC”) 200 and five display devices 100, 100A, 100B, 100C, and 100D, each connected to a network 300. .

  The PC 200 is a general computer. The network 300 is a local area network (LAN). In place of the LAN, a wide area network, a public telephone line, the Internet, or the like may be used. Furthermore, the network 300 is not limited to a wired line but may be wireless. In addition, although an example in which the PC 200 and the display devices 100 and 100A to 100D are connected via the network 300 is shown here, they may be connected by serial communication or parallel communication.

  Although the display system 1 shows an example including five display devices 100, 100A to 100D, the number is not limited to this, and one or more may be sufficient. Since the five display devices 100 and 100A to 100D have the same configuration and function, the display device 100 will be described as an example unless otherwise specified.

  The display system 1 according to the present embodiment is used in a meeting or the like in which a plurality of people view the same image at the same time, and the presenter operates the PC 200 and the participants operate the display devices 100 and 100A to 100D. explain. The presenter stores image data, which is electronic data of an image for presentation, in the PC 200, transmits the image data from the PC 200 to the display devices 100, 100A to 100D, and the display devices 100, 100A to 100D are received. By displaying the image data, the presenter and the participant simultaneously view the same image.

  FIG. 2 is a block diagram illustrating an example of a hardware configuration of the PC. Referring to FIG. 2, a PC 200 is connected to a bus 221, and a central processing unit (CPU) 201 that controls the entire PC 200 and a ROM (Read Only Memory) for storing programs executed by the CPU 201. ) 203, a RAM (Random Access Memory) 205 used as a work area of the CPU 201, a liquid crystal display device (LCD 207), a hard disk drive (HDD) 209 as a mass storage device, and an operation unit 211 for accepting user operations. A communication interface (I / F) 213 for connecting the PC 200 to an external device, an external storage device 215, and a network I / F 217 for connecting the PC 200 to the network 300.

  The operation unit 211 includes a pointing device such as a keyboard or a mouse, and accepts an operation input by the user.

  A CD-ROM (Compact Disc-ROM) 215A is detachably attached to the external storage device 215. The CPU 201 can access the CD-ROM 215 </ b> A via the external storage device 215. In this example, the program executed by the CPU 201 is stored in the ROM 203, but the CPU 201 may load the program stored in the CD-ROM 215A into the RAM 205 and execute it. The medium for storing the program executed by the CPU 201 is not limited to the CD-ROM 215A, but an optical disc (MO (Magnetic Optical Disc / MD (Mini Disc) / DVD (Digital Versatile Disc)), IC card, optical card, mask A semiconductor memory such as a ROM, an EPROM (Erasable Programmable ROM), or an EEPROM (Electronically EPROM) may be used.

  Further, the CPU 201 may load a program stored in the HDD 209 into the RAM 205 and execute it. In this case, another computer connected to the network 300 may rewrite the program stored in the HDD 209 of the PC 200, or may write a new program. Further, the PC 200 may download a program from another computer connected to the network 300 and store the program in the HDD 209. The program here includes not only a program directly executable by the CPU 201 but also a source program, a compressed program, an encrypted program, and the like.

  FIG. 3 is a plan view of a display device according to one embodiment of the present invention. Referring to FIG. 3, display device 100 includes electronic paper 19, a touch panel 21B, and a power key 21A provided on the upper surface thereof.

  As long as the device displays an image, a liquid crystal display (LCD), an organic ELD (Electroluminescence Display), or the like may be used instead of the electronic paper 19.

  The touch panel 21 </ b> B is made of a transparent member and is provided so as to be superimposed on the display surface of the electronic paper 19. When the user designates the display surface of the electronic paper 19, the coordinates of the designated position on the display surface are output. Note that the touch panel 21 </ b> B may be provided on the back surface of the electronic paper 19. In this case, it is not necessary to be a transparent member.

  FIG. 4 is a block diagram illustrating an example of a hardware configuration of the display device. Referring to FIG. 4, display device 100 is connected to bus 31 to control CPU 11 as a whole, ROM 13 to store programs executed by CPU 11, and the like as a work area for CPU 11. RAM 15, EEPROM (Electronic Erasable and Programmable ROM) 17 that stores data in a nonvolatile manner, electronic paper 19, operation unit 21 that receives user operations, communication I / F 23 for connecting display device 100 to the network, and external Includes I / F25.

  The electronic paper 19 is controlled by the CPU 11 to display an image. The ROM 13 stores a program executed by the CPU 11 or data necessary for executing the program. The RAM 15 is used as a work area when the CPU 11 executes a program. The EEPROM 17 stores programs or data in a nonvolatile manner.

  The operation unit 21 includes a plurality of keys including a power key 21 </ b> A and a touch panel 21 </ b> B provided on the upper surface of the electronic paper 19. Various operations are received by combining the electronic paper 19 and the touch panel 21B.

  The communication I / F 23 is an interface for connecting the display device 100 to the network 300. CPU11 communicates with PC200 via communication I / F23, and transmits / receives data. The communication I / F 23 can communicate with a computer connected to the Internet via a network.

  The external I / F 25 is an interface for communicating with an external device. Here, the external I / F 25 performs serial communication with a connected external device. When a card reader is connected as an external device to the external I / F 25, the CPU 11 can access the memory card 25A attached to the card reader via the external I / F 25. Although an example in which the program executed by the CPU 11 is stored in the ROM 13 is shown here, the CPU 11 may load the program stored in the memory card 25A into the RAM 15 and execute it. The medium for storing the program executed by the CPU 11 is not limited to the memory card 25A, but an optical disc (MO (Magnetic Optical Disc / MD (Mini Disc) / DVD (Digital Versatile Disc)), IC card, optical card, mask. A semiconductor memory such as a ROM, an EPROM (Erasable Programmable ROM), or an EEPROM (Electronically EPROM) may be used.

  Further, the CPU 11 may load a program stored in the EEPROM 17 into the RAM 15 and execute it. In this case, another computer connected to the network 300 may rewrite the program stored in the EEPROM 17 of the display device 100, or may write a new program. Further, the display device 100 may download a program from another computer connected to the network 300 and store the program in the EEPROM 17. The program here includes not only a program directly executable by the CPU 11 but also a source program, a compressed program, an encrypted program, and the like.

  FIG. 5 is a functional block diagram showing an example of functions of the CPU included in the PC together with data stored in the HDD. The functions of the CPU 201 shown in FIG. 5 are formed in the CPU 201 when the CPU 201 executes a display control program stored in the ROM 203, the CD-ROM 215A, or the HDD 209. Referring to FIG. 5, CPU 201 provided in PC 200 generates an operation receiving unit 231 that receives an operation by a user, an application execution unit 233 that executes an application program, and a window that includes an image output by application execution unit 233. A window control unit 235 that displays a display screen including the window on the LCD 207, a display screen table management unit 237 that manages a display screen table, an image data generation unit 239 that generates image data, and related information that acquires related information The acquisition part 241 and the transmission part 243 which transmits a display screen table, image data, and related information to the display apparatuses 100 and 100A-100D are included.

  The operation reception unit 231 receives an operation input by the user to the operation unit 211, and outputs the received operation to the application execution unit 233 or the window control unit 235.

  The application execution unit 233 executes an application program stored in the HDD 209 in accordance with a user operation. The application execution unit 233 can execute a plurality of application programs at the same time. The application execution unit 233 outputs image data including a display image to the window control unit 235 as a result of executing the application program. The application program is not particularly limited, and is a program that outputs an image for display at a meeting, for example, an image display program for displaying an image, a document editing program, a spreadsheet program, and an animation. A program for reproducing, a program for reproducing moving images, a program for reproducing still images, and the like are included.

  The window control unit 235 generates a window for displaying the image data output by the application execution unit 233 for each application program executed by the application execution unit 233. Accordingly, the window control unit 235 generates the same number of first windows as the number of application programs executed by the application execution unit 233. Then, the window control unit 235 generates a display image including the generated first window and displays it on the LCD 207.

  The window control unit 235 arranges the first window at the default position and size in the display image, but the user inputs an operation for designating the first window and an operation for changing the position or size to the operation unit 211. For example, in accordance with the input operation, the position or size of the designated first window is changed, and a display image including the changed first window is generated and displayed on the LCD 207. When the user inputs an operation and a command for designating the first window to the operation unit 211, the window control unit 235 executes the command corresponding to the application thin program corresponding to the designated first window. Output to the unit 233. When the command is input, the application execution unit 233 executes processing in accordance with the command and outputs image data including an image as an execution result to the window control unit 235. Therefore, the window control unit 235 is configured as described above. Similarly, the first window corresponding to the application program is updated, and a new display image is displayed on the LCD 207. When all or some of the plurality of first windows overlap each other, the window control unit 235 generates a display image that preferentially displays the first overlapping window. Here, the first window specified later by the user overlaps further upward.

  Each time the display image is generated or updated, the window control unit 235 displays information related to the display image and one or more image data respectively corresponding to one or more first windows included in the display image. The data is output to the table management unit 237.

  The display screen table management unit 237 generates a display image based on information regarding the display image input from the window control unit 235. The information related to the display image includes, for each first window included in the display image, a window name for identifying the first window, the position and size of the first window, and the image included in the first window. The display state and display order of the first window, and link information when the image data included in the first window includes link information.

  The position and size of the first window are indicated by the coordinates in the display image of the upper left vertex (start point) of the first window and the coordinates in the display image of the lower right vertex (end point). The display screen table management unit 237 generates a window record for each first window, generates a display screen table including one or more window records, and stores it in the HDD 209.

  FIG. 6 is a diagram illustrating an example of the display screen table. Referring to FIG. 6, the display screen table includes a window record. One window record corresponds to one first window. Here, the display screen table includes three window records respectively corresponding to the three first windows. The window record includes an item in which a window name for identifying the first window is set (first window name), an item in which the coordinates of the start point of the first window are set (start point coordinates), and the end point of the first window. The item for which the coordinates of the image (end point coordinates) are set, the item for setting the file name for identifying the image data displayed in the first window (image data file name), and the display state of the first window are set Items to be displayed (display state), items to set the display order of the first window (display order), and items to set the file name of the related image data (related image data file name).

  The display state indicates whether at least a part of the first window is displayed on the display image or whether the first window is minimized and a mark in place of the first window is displayed on the display image. When at least a part of the first window is displayed on the display image, “display” is set in the display state item, the first window is minimized, and a mark replacing the first window is displayed on the display image. Is set to “Minimize” in the display state item.

  The display order is set when at least a part of the first window overlaps with another first window. In the case of overlapping on the top, “frontmost” is set in the display order item, and “first”, “second”,... If at least part of the first window does not overlap with another first window, “-” is set in the item of display order.

  In the item whose item name is related image data file name, the file name of the related image data including the image of the related information related to the image data is set. The related information is information that is acquired by a related information acquisition unit 241 described later and specified by link information included in the image data.

  Returning to FIG. 5, the display screen table management unit 237 sets a set of the window name and the image displayed in the first window for each of the one or more first windows included in the display image. When the image displayed on the first window includes link information, the combination of the window name of the first window and the link information is output to the related information acquisition unit 241.

  When the combination of the window name and the image is input from the display screen table management unit 237, the image data generation unit 239 associates them and stores them in the HDD 209. As a result, the image data 253 is stored in the HDD 209. Since the window control unit 235 updates the first window each time the image output by the application execution unit 233 is changed, the image data generation unit 239 has a plurality of sets of different images with the same window name. It may be entered in order. In this case, every time a window name and an image are input, the image data generation unit 239 adds the image to the image data 253 stored in the HDD 209 and stores it. In this case, the image data 253 stored in the HDD 209 includes a plurality of pages of images with page numbers assigned in the order in which the images are stored. The image data generation unit 239 sets the file name given to the image data 253 stored in the HDD 209 in the item of the image data file name of the window record included in the display screen table 251 stored in the HDD 209. The window record is a window in which the window name paired with the image stored in addition to the image data 253 is set as the first window name item among the window records included in the display screen table 251 stored in the HDD 209. It is a record.

  As described above, the image data generation unit 239 stores the image data output from the window control unit 235 in the HDD 209 for each window name of the first window. Therefore, the image data 253 stored in the HDD 253 includes an image displayed on the LCD 207 in accordance with a user operation. Note that the image data generation unit 239 may cause the application execution unit 233 to output all of the image data and store it in the HDD 253. In this case, the image data 253 stored in the HDD 209 includes an image of a page that has not been displayed in addition to an image displayed on the LCD 207 in accordance with a user operation. For example, even when the document execution program is executed by the application execution unit 233 and the first to third pages are displayed among the five pages of document data, the images of the first to fifth pages are displayed. The application execution unit 233 outputs the image data including the acquired first to fifth page images to the HDD 209.

  The image data stored in the HDD 209 is preferably in a predetermined format so that it can be processed by the display devices 100 and 100A to 100D. The format of the image data is, for example, an image data format such as JPEG (Joint Photographic Experts Group), TIFF (Tagged Image File Format), GIF (Graphic Interchange Format), PDF (Portable Format), etc. Format may be used. Here, image data in the PDF format is stored. When each of the display devices 100 and 100A to 100D executes an application program, a format for the application program executed by each of the display devices 100 and 100A to 100D can be used.

  When the combination of the window name of the first window and the link information is input from the display screen table management unit 237, the related information acquisition unit 241 acquires the related information specified by the link information, and the related information of the acquired related information The related image data as an image is stored in the HDD 209. As a result, the related image data is stored in the HDD 209. The link information is, for example, a folder name and file name for specifying related information stored in the HDD 209, or a URL (Uniform Resource Locator) assigned to related information stored in a computer connected to the network 300. It is.

  Further, the related information acquisition unit 241 sets the file name assigned to the related image data stored in the HDD 209 in the item of the related image data file name of the window record included in the display screen table stored in the HDD 209. . The window record is a window record in which a window name paired with link information is set as the first window name item among the window records included in the display screen table 251 stored in the HDD 209.

  When the display screen table 251 is stored or updated, the transmission unit 243 transmits the display screen table 251, the image data 253, and the related image data 255 to the display devices 100, 100A to 100D via the network I / F 217. Send. The transmission unit 243 stores the transmitted display screen table 251, image data 253, and related image data 255, and at the time of next transmission, the previously transmitted display screen table 251, image data 253, and related image data. Only the difference from the image data 255 may be transmitted. Thereby, the amount of data to be transmitted can be reduced and the load on the network 300 can be reduced.

  FIG. 7A, FIG. 7B, FIG. 8A, and FIG. 8B are diagrams showing examples of screens displayed on the PC. FIG. 7A and FIG. 7B show an example of a screen when two windows A and B overlap. FIG. 7A shows a screen in a state where window A overlaps window B. FIG. 7B shows a screen in a state where window B overlaps window A. If the user points to window B on the screen shown in FIG. 7A, the screen shown in FIG. 7B is displayed. In this case, since the display screen table 251 is updated when the screen shown in FIG. 7A is switched to the screen shown in FIG. 7B, the display screen table 251, image data 253, related image data 255, Is transmitted to the display devices 100, 100A to 100D. Conversely, if the user points to window A on the screen shown in FIG. 7B, the screen shown in FIG. 7A is displayed. In this case, when the screen shown in FIG. 7B is switched to the screen shown in FIG. 7A, the display screen table 251 is updated. Therefore, the display screen table 251, image data 253, and related image data 255 are updated. Is transmitted to the display devices 100, 100A to 100D.

  FIG. 8A and FIG. 8B are diagrams for explaining window minimization. FIG. 8A shows a screen before the window C is minimized, and FIG. 8B shows a screen after the window C is minimized. A mark 401 illustrated in FIG. 8B includes the window name of the window C. Here, the window name is the file name of the image data corresponding to the image displayed in window C. If the user indicates minimization of window C on the screen shown in FIG. 8A, the screen shown in FIG. 8B is displayed. In this case, since the display screen table 251 is updated when the screen shown in FIG. 8A is switched to the screen shown in FIG. 8B, the display screen table 251, image data 253, and related image data 255 are updated. Is transmitted to the display devices 100, 100A to 100D. Conversely, if the user points to 401 on the screen shown in FIG. 8B, the screen shown in FIG. 8A is displayed. In this case, when the screen shown in FIG. 8B is switched to the screen shown in FIG. 8A, the display screen table 251 is updated. Therefore, the display screen table 251, image data 253, and related image data 255 are updated. Is transmitted to the display devices 100, 100A to 100D.

  FIG. 9 is a functional block diagram showing an example of functions of the CPU included in the display device, together with data stored in the EEPROM. The functions of the CPU 11 shown in FIG. 9 are formed in the CPU 11 when the CPU 11 executes a display control program stored in the ROM 13, the EEPROM 17, or the memory card 25A. Referring to FIG. 9, CPU 11 included in display device 100 includes a data receiving unit 51 that receives data from PC 200, an operation receiving unit 53 that receives an operation by a user, and a display image generating unit 55 that generates a display image. A window specifying unit 57, a display screen table changing unit 59, and a handwritten image detecting unit 61 for detecting a handwritten image.

  The data receiving unit 51 controls the communication I / F 23. When the communication I / F 23 receives the display screen table 251, the image data 253, and the related image data 255 from the PC 200, the data receiving unit 51 receives them and stores them in the EEPROM 17. Thus, the received display screen table 251 is stored in the EEPROM 17 as the display screen table 81, the received image data 253 is stored as the image data 83, and the related image data 255 is stored as the related image data 85, respectively. Whenever the communication I / F 23 receives the display screen table 251, image data 253, and related image data 255 from the PC 200, the data receiving unit 51 stores them in the EEPROM 17. To do. In other words, the display screen table 251 received from the PC 200, the image data 253, and the related image data 255 are received when any of them is updated, but the display screen table 251 received last is the display screen. The last received image data 253 stored as the table 81 is stored as the image data 83, and the last related image data 255 received is stored in the EEPROM 17 as the related image data 85. For this reason, the storage area of the EEPROM 17 can be used effectively. Each time the display screen table 251, the image data 253, and the related image data 255 are received, the file names may be stored differently. Thereby, it is possible to store a history of changing the display image. When a difference is received from the PC, the display screen table 81, the image data 83, and the related image data 85 stored in the EEPROM 17 may be updated based on the difference.

  The operation accepting unit 53 accepts an operation input by the user to the operation unit 21, and gives a predetermined command for the accepted operation to the display image generating unit 55, the window specifying unit 57, the display screen table changing unit 59, and It outputs to the handwritten image detection part 61. FIG.

  When a command for specifying the display screen table 81 is input from the operation receiving unit 53, the display image generation unit 55 displays one or more first image data 83 according to the specified display screen table 81. A display image is generated by combining two windows. Specifically, the file name of the display screen table 81 stored in the EEPROM 17 is displayed on the electronic paper 19 so as to be selectable. If a plurality of display screen tables 81 are stored, a plurality of file names are displayed so as to be selectable. If the user designates one of a plurality of file names displayed to be selectable on the operation unit 21, the operation accepting unit 53 accepts an operation for designating the file name, and a generation command including the designated file name Is output to the display image generation unit 55. The display image generation unit 55 reads the display screen table 81 with the file name included in the input generation command, and generates a display image. The display screen table 81 includes one or more window records. Here, a case where the display screen table 81 shown in FIG. 6 is read will be described as an example. In this case, the display screen table 81 includes three window records.

  The display image generation unit 55 stores, from the EEPROM 17, the image data 83 having the file name set in the image data file name item for each of one or more window records included in the display screen table 81, here three window records. Setting is performed so that the image of the read image data is displayed in the second window. Here, since the display screen table 81 includes three window records, three second windows are generated. As described above, the image data 83 may include a plurality of pages of images. Therefore, the display image generation unit 55 sets the image of the first page among the plurality of pages included in the image data 83 as the second window. If the display screen table includes the page number of the page to be displayed among the plurality of pages included in the image data, the image of that page can be set in the second window.

  Next, the three generated second windows are arranged in the display image. First, a second window in which “minimize” is set in the display state item of the window record is arranged, and a mark including a name for identifying the second window is arranged below the display image. Here, the name for identifying the second window is the file name set in the item of the image data file name. Next, with respect to the second window in which “display” is set in the display state item of the window record, the display order items are arranged in the display image in order from the one in which the lower display order is set. The position where the second window is arranged is determined by the two coordinates set in the item of the start point coordinate and the item of the end point coordinate of the window record, respectively, and the second window is arranged in a rectangular area whose diagonal is the two coordinates. To do. Since the display order items are arranged in the display image in the order from the lowest to the highest, when two or more second windows overlap, the upper second window is arranged after the lower second window. The For this reason, the second window with the higher display order is preferentially displayed. For example, the display order of the window records with the first window name “window A” is “second”, and the display order of the window records with the first window name “window B” is “frontmost”. Therefore, the second window including the image data image with the image data file name “A.bmp” and the second window including the image data file name “B.jpg” have the start point coordinates ( 100, 100) and a rectangular area having end point coordinates (200, 200). Therefore, in the overlapping area, the second window including the image with the image data file name “B.jpg” is displayed. The display image generating unit 55 outputs the generated display image to the window specifying unit 57 and displays it on the electronic paper 19.

  The window specifying unit 57 specifies the one specified by the user among the plurality of second windows included in the display image. Specifically, when the user designates an arbitrary position in the display image using a pointing device such as the touch panel 21 </ b> B included in the operation unit 21, the operation reception unit 53 detects the coordinates of the designated position. The The operation receiving unit 53 outputs an instruction command including the detected coordinates to the window specifying unit 57. When the instruction command is input, the window specifying unit 57 specifies the second window including the coordinates included in the instruction command among the plurality of second windows included in the display image. When a plurality of second windows including coordinates included in the instruction command are overlapped, the foremost second window is specified. The window specifying unit 57 outputs window identification information for identifying the specified second window to the display image generating unit 55 and the display screen table changing unit 59. Here, the window identification information of the second window is the same as the window identification information of the first window. Therefore, the window identification information of the second window is the window name of the first window.

  When the window name is input as the window identification information from the window specifying unit 57, the display image generating unit 55 selects the second window identified by the window identification information in the display image displayed on the electronic paper 19. If not, the display image is changed by placing the second window in the foreground. At this time, when the window name is input as the window identification information from the window specifying unit 57, the display screen table changing unit 59 converts the input window name of the window records included in the display screen table 81 into the window name item. The display screen table 81 is updated by changing the display order item of the window records included in the item “frontmost” and lowering the display order of the other window records by one.

  The operations accepted by the operation accepting unit 53 include a page switching operation for switching an image included in the second window, a size changing operation for changing the size of the second window, a moving operation for moving the position of the second window, and related images. This includes an operation for displaying data and an operation for setting the display device 100 to the handwriting mode. When the operation accepting unit 53 accepts an operation by the user, the operation accepting unit 53 outputs a command corresponding to the accepted operation to the display image generating unit 55 and the display screen table changing unit 59.

  When a command corresponding to the page switching operation is input, the display image generation unit 55 updates the second window by switching the image included in the previously specified second window to the image of the next page. The display image after updating the second window is displayed on the electronic paper 19. Further, when a command corresponding to the size change operation is input, the display image generation unit 55 changes the size of the second window specified earlier, and the display image after the size of the second window is changed. Is displayed on the electronic paper 19. On the other hand, when a command corresponding to the size change operation is input, the display screen table changing unit 59 is a window in which the same window name as that of the previously specified second window is set as the first window name item. The record is extracted from the display screen table 81, and the item of the start point coordinate or the end point coordinate of the extracted window record is updated with the start point coordinate or the end point coordinate of the second window of the changing unit.

  In addition, when a command corresponding to the moving operation is input, the display image generation unit 55 moves the position in the display image of the second window specified earlier, and displays the display after moving the second window. The image for use is displayed on the electronic paper 19. On the other hand, when a command corresponding to the moving operation is input, the display screen table changing unit 59 has a window record in which the same window name as that of the previously specified second window is set as the first window name item. Are extracted from the display screen table 81, and the item of the start point coordinate or end point coordinate of the extracted window record is updated with the start point coordinate or end point coordinate of the second window after the change.

  When a command corresponding to an operation for displaying the related image data is input, the display image generation unit 55 sets the same window name as the window name of the second window specified previously as the first window name item. The window record is extracted from the display screen table 81, and the related image data specified by the file name set in the item of the related image data file name of the extracted window record is read from the EEPROM 17. Then, a new second window including an image of the read related image data is generated, and the generated new second window is combined with the default position of the display image to be arranged in the display image. Then, the display image combined with the new second window is displayed on the electronic paper 19.

  If the user operates the operation unit 21 and sets the display device 100 to the handwriting mode, and points to an arbitrary position in the display image using a pointing device such as a mouse included in the operation unit 21, the operation is accepted. The unit 53 detects the position and outputs the coordinates of the instructed position in the display image to the handwritten image detection unit 61. The handwritten image detection unit 61 detects the handwritten image by connecting the coordinates continuously input from the operation receiving unit 53. Further, the second window including the coordinates input from the operation receiving unit 53 is specified. Then, a set of the window name for identifying the specified second window and the handwritten image is output to the display image generating unit 55 and the display screen table changing unit 59.

  When the set of the window name and the handwritten image is input from the handwritten image detecting unit 61, the display image generating unit 55 superimposes the handwritten image on the image included in the second window having the window name. Then, the display image generation unit 55 displays the display image including the second window on which the handwritten image is superimposed on the electronic paper 19. Further, when the combination of the window name and the handwritten image is input from the handwritten image detecting unit 61, the display screen table changing unit 59 extracts the window record including the window name from the display screen table 81, and the extracted window record Associate handwritten images with. Specifically, a new handwritten image item is added to the window record, and the handwritten image is set in the handwritten image item. The handwritten image may be stored in the EEPROM 17 and the file name of the handwritten image may be set in the item of the handwritten image.

  FIG. 10 is a diagram illustrating an example of the display screen table after associating the handwritten image. Referring to FIG. 10, the difference from display screen table 81 shown in FIG. 6 is that a handwritten image item is added. Here, in the window record in which “Window A” is set in the item of the first window name, the image data of the handwritten image is set in the item of the handwritten image. Here, the image data of the handwritten image is indicated by the file name “HA.bmp”.

  The window records included in the display screen table 81 include those in which a handwritten image is set in the item of the handwritten image and those in which the handwritten image is not set. For this reason, when the display image generation unit 55 next generates a display image according to the display screen table 81, the second window corresponding to the window record in which the handwritten image is set in the item of the handwritten image, An image in which the handwritten image is superimposed on the image of the image data is set, and the second window corresponding to the window record in which the handwritten image is not set in the item of the handwritten image has no image data superimposed on the second window. Only the image is set.

  Here, an example in which the display device 100 generates a display image according to the display screen table 81 and displays the display image on the electronic paper 19 will be described. However, the display screen table 81, the image data 83, and the related image data 85 are stored in the display device 100. The display image may be generated and displayed on the PC 200 by being transmitted to another computer, for example, the PC 20. Even in this case, the display image displayed on the computer is the same as the display image displayed by the display device 100.

  FIG. 11 is a diagram illustrating an example of a display image in which a handwritten image is superimposed on the second window. In FIG. 11, the solid line rectangle including the characters of window A indicates window A, and the description of the image data image is omitted. An image of the image data is actually displayed in the solid line rectangle including the characters of the window A. Moreover, although the area | region of the handwritten image is shown by the dotted-line rectangle surrounding the character of the handwritten image, the handwritten image is actually displayed in the dotted-line rectangle. Referring to FIG. 11, a state where a handwritten image is superimposed on window A is shown, and a handwritten image is not superimposed on window B. Thus, by associating the handwritten image for each second window by the display screen table 81, the image of the image data displayed in the second window and the handwritten image can be displayed in association with each other.

  FIG. 12 is a flowchart illustrating an example of the flow of the first display control process executed on the PC. The first display control process shown in FIG. 12 is a process executed by the CPU 201 when the CPU 201 included in the PC 200 executes a display control program. Referring to FIG. 12, CPU 201 determines whether or not data designation by the user has been accepted. If an operation for designating data is input by the user, the process proceeds to step S05; otherwise, the process proceeds to step S02. In step S02, it is determined whether or not an operation for starting an application program by the user has been accepted. If an operation for starting the application program is input by the user, the application program specified by the operation is specified, and the process proceeds to step S05; otherwise, the process proceeds to step S03.

  In step S05, an application program is activated. If the process proceeds from step S01, a predetermined application program is activated for the data designated in step S01. If the process proceeds from step S02, the application instructed to be activated in step S02. Start the program.

  In step S06, a first window is generated, and the generated first window is displayed on LCD 207. The size of the first window is a default size, and the position where the first window is arranged on the display screen of the LCD 207 is the default position. In the next step S07, a window record corresponding to the first window displayed in step S06 is generated. Here, it is included in the display screen table shown in FIG. An example in which a window record is generated is shown. At this stage, a window record in which an item for the first window name, an item for the start point coordinate, and an item for the end point coordinate are set is generated.

  In the next step S08, image data is added to the window record. More specifically, if the process proceeds from step S01, the image of the data designated in step S01, and if the process proceeds from step S02, the image output first by the started application program is stored in HDD 209 as image data. The file name of the image data is set in the item of the image data file name of the window record. If an image displayed in the same first window is already stored in the HDD 209 as image data, the image data is additionally stored as an image of a page after the image stored so far.

  In step S09, the window record generated in step S08 is added to the display screen table. Next, in step S10, it is determined whether or not the image displayed in the first window includes link information. If the link information is included, the process proceeds to step S11; otherwise, the process proceeds to step S14. In step S11, related information specified by the link information is acquired. Here, the link information is a URL, and the related information is data to which the URL is assigned. In the next step S <b> 12, related image data corresponding to the acquired image of the related information is generated and stored in the HDD 209. When the related information includes a plurality of pages, the related image data includes a plurality of pages of images. Then, the window record is updated. The window record updated here is the window record added to the display screen table in step S09. In updating the window record, the file name of the related image data stored in the HDD 209 is set in the item of the related image data file name of the window record.

  In the next step S14, the display screen table 251 stored in the HDD 209 is transmitted to the display devices 100, 100A to 100D. In the next step S15, the image data 253 stored in the HDD 209 in step S08 is transmitted to the display devices 100, 100A to 100D. In the next step S16, it is determined whether related image data is stored in the HDD 209 or not. If the related image data is stored, the process proceeds to step S17. If not, step S17 is skipped and the process returns to step S01. In the next step S17, the related image data 255 stored in the HDD 209 is transmitted to the display devices 100, 100A to 100D, and the process returns to step S01.

  On the other hand, in step S03, it is determined whether an operation for the first window has been accepted. The operations for the first window are a page switching operation for switching images included in the first window, a size changing operation for changing the size of the first window, a moving operation for moving the position of the first window, and displaying related image data. Includes operations. If an operation for the first window is accepted, the process proceeds to step S18; otherwise, the process proceeds to step S04. In step S04, it is determined whether an operation for instructing termination has been accepted. If an operation for instructing termination is accepted, the process ends. If not, the process returns to step S01.

  In step S18, in step S03, the first window is changed according to the accepted operation, and the changed first window is displayed on LCD 207. Specifically, when a page switching operation is accepted, the image included in the first window is switched to the next page image or the previous page image. When the size change operation is accepted, the size of the first window is changed to the size designated by the user. When the moving operation is accepted, the position of the first window is moved to the position designated by the user.

  In step S19, in order to reflect the change of the changed first window in the display screen table, the window record in which the window name of the first window is set to the item of the first window name is extracted, and the start point coordinates are set. Of the item, the end point coordinate item, the display state item, and the display order item, the item corresponding to the changed value is updated with the changed value.

  In the next step S20, the display screen table after the window record is changed is transmitted to the display devices 100, 100A to 100D, and the process returns to step S01. In the first display control process, step S01 may be executed a plurality of times to specify a plurality of data, and step S02 may be executed a plurality of times to start a plurality of application programs. A number of first windows corresponding to the specified number of data and the number of applications started are displayed. In addition, when a plurality of first windows are generated, it is determined in step S03 which of the plurality of first windows is operated. In this case, any one of the plurality of first windows is determined. One is specified, and the processing of step S18 to step S20 is executed as an operation for the specified first window.

  13 and 14 are flowcharts illustrating an example of the flow of the second display control process executed by the display device. The second display control process shown in FIGS. 13 and 14 is a process executed by the CPU 11 when the CPU 11 included in each of the display devices 100 and 100A to 100D executes the display control program. Here, the process which CPU11 with which the display apparatus 100 is provided performs is demonstrated.

  Referring to FIG. 13, CPU 11 determines whether a display screen table has been received from PC 200 (step S31). If the display screen table is received from PC 200, the process proceeds to step S32. If not, the process proceeds to step S36. In step S32, the image data transmitted by PC 200 is received, and the process proceeds to step S33. In step S33, the display screen table received in step S31 and the image data received in step S32 are stored in the EEPROM 17. When a plurality of image data is received in step S32, each of the plurality of image data is stored in the EEPROM 17.

  In step S34, it is determined whether or not related image data has been received from PC 200. If the related image data is received, the process proceeds to step S35. If not, step S35 is skipped and the process proceeds to step S36. In step S35, the received related image data is stored in EEPROM 17, and the process proceeds to step S36. When receiving a plurality of related image data, each of the plurality of related image data is stored in the EEPROM 17.

  In step S36, it is stored in the EEPROM 17. It is determined whether an operation for designating the display screen table 81 has been accepted. If an operation for designating display screen table 81 is accepted, the process proceeds to step S37; otherwise, the process proceeds to step S45. In step S37, the designated display screen table 81 is read from the EEPROM 17. Then, the window record included in the read display screen table is analyzed (step S38). Specifically, the item of the start point coordinate, the item of the end point coordinate, the item of the display state, and the item of the display order of the window record are referred to, whether or not the second window to be generated is minimized and the other second Determine if it overlaps the window.

  In step S39, it is determined whether or not the first window overlaps as a result of analyzing the window record. In step S37, it is included in the read display screen table. It is determined whether or not there are a plurality of overlapping first windows among the plurality of window records. If there is an overlapping first window, the process proceeds to step S40; otherwise, the process proceeds to step S43.

  In step S40, the image of the first window with the lowest display order is set as the second window, and the second window is combined with the display image. Specifically, the window record in which the display order item is set to the lowest is extracted from the display screen table, and the image specified by the file name set in the image data file name item of the extracted window record Data is read from the HDD 209, and the first page image of the read image data is set in the second window. Then, the second window is combined with the display image. The size of the second window and the position in the display image are determined by the two coordinates set in the item of the start point coordinate and the item of the end point coordinate of the extracted window record.

  In the next step S41, it is determined whether or not there is a first window whose display order is one higher. If such a first window exists, the process proceeds to step S42; otherwise, the process proceeds to step S43. Specifically, among the plurality of window records included in the display screen table, the display order that is one higher in the display order than the value set in the display order item of the window record that has been processed until then is the display order. It is determined whether there is a window record set in the item. If such a window record exists, it is determined that there is an upper first window, but if no such window record exists, it is determined that there is no upper first window.

  In step S42, the image of the first window that is one order higher in the display order is set as the second window, the second window is combined with the display image, and the process returns to step S41. Specifically, from the display screen table, the window record in which the value one higher than the display order of the window record that has been processed until then is set in the display order item is extracted, and the image data of the extracted window record The image data specified by the file name set in the file name item is read from the HDD 209, and the first page image of the read image data is set in the second window. Then, the second window is combined with the display image. The size of the second window and the position in the display image are determined by the two coordinates set in the item of the start point coordinate and the item of the end point coordinate of the extracted window record.

  Since the upper second window is combined with the display image after the lower second window, when the lower second window and the upper second window overlap, the lower second window is displayed in the upper second window in the overlapping region. The window is overwritten.

  In step S43, the image of the first window that does not overlap is set as the second window, and the second window is combined with the display image. When there are a plurality of first windows that do not overlap, the same number of second windows as the number of first windows that do not overlap is generated. The first window that does not overlap includes the first window corresponding to the window record in which “minimize” is set in the item of the display state of the window record. When there is a window record for which “Minimize” is set in the display state item of the window record, a mark including the file name of the image data set in the image data file name item is displayed below the display image. To place.

  Steps S41 and S42 are repeatedly executed until there is no first window having the highest display order (frontmost), and second windows corresponding to all the first windows that do not overlap are generated in step S43. . For this reason, when the display screen table includes a plurality of window records, the second windows corresponding to the number of window records are combined with the display image.

  In step S44, the generated display image is displayed on electronic paper 19, and the process proceeds to step S45.

  Referring to FIG. 14, in step S45, it is performed by the user. It is determined whether or not an operation has been accepted. If an operation is accepted, the process proceeds to step S46; otherwise, the process returns to step S31. In step S46, the second window that is the target of the operation accepted in step S45 is specified. Specifically, the second window including the coordinates of the position designated by the user in the display image is specified.

  In the next step S47, it is determined whether or not the operation accepted in step S45 is an operation for changing the size or position of the second window. If the operation is to change the size or position of the second window, the process proceeds to step S48; otherwise, the process proceeds to step S49. In step S48, the size or position of the second window specified in step S46 is changed according to the operation accepted in step S45, and the process returns to step S31. Since the size or position of the second window is changed, the display image in which the size or position of the second window designated by the user is changed is displayed on the electronic paper 19.

  In step S49, it is determined whether or not the operation accepted in step S45 is an operation for displaying related information. Whether or not the operation is to display related information is, for example, whether or not the position in the display image designated by the user with a pointing device such as a mouse is the position to which link information is assigned in the second window identified in step S46. Judgment by If it is an operation for displaying related information, the process proceeds to step S50; otherwise, the process proceeds to step S52. In step S50, the window record including the window name of the second window specified in step S46 is extracted from the display screen table 81 stored in the EEPROM 17, and the item of the related image data file name of the extracted window record is extracted. The related image data specified by the file name set in is read. In the next step S51, a second window including an image of the related image data is newly generated and combined with the display image. Thus, a new second window including the related image data image is arranged in the display image, and the related image data image is displayed on the electronic paper 19.

  In step S52, it is determined whether or not the operation accepted in step S45 is a handwriting operation. If so, the process proceeds to step S53; otherwise, the process proceeds to step S56. Whether the handwriting operation is performed or not is determined, for example, by detecting an operation for designating an arbitrary position of the display image by the user after the display device 100 is set to the handwriting mode by the user. In step S53, a handwritten image is detected. For example, when a user performs an operation of drawing a character using a pointing device or the like, an image of a handwritten character is detected by detecting continuous coordinates in the display image. Then, the detected handwritten image is combined with the second window specified in step S46, and the process proceeds to step S55. Thereby, the image of the character handwritten by the user with a pointing device or the like is displayed in the second window.

  In the next step S55, the handwritten image detected in step S53 is added to the display screen table, and the process returns to step S31. Specifically, the window record including the window name of the second window specified in step S46 is extracted from the display screen table 81, and the handwritten image detected in step S53 is added to the item of the handwritten image of the extracted window record. Set the image data.

  On the other hand, in step S56, it is determined whether or not the operation accepted in step S45 is an operation for instructing termination. If it is an operation for instructing termination, the process is terminated; otherwise, the process returns to step S31.

  As described above, the display device 100 according to the present embodiment receives the display screen table and one or more image data respectively displayed in the one or more first windows from the pc 200, and according to the display screen table, A display image is generated and displayed by synthesizing one or more second windows each displaying one or more received image data. The display screen table includes, for each of one or more first windows included in the screen, the position of the first window in the screen, the file name of the image data displayed in the first window, and the first window And information indicating an overlapping state when overlapping with another first window. For this reason, since the display image is generated according to the display screen table, the same display image as that displayed on the PC 200 can be displayed. Further, the display device 100 receives one or more image data respectively displayed in one or more first windows from the PC 200, and therefore displays an image hidden below when a plurality of second windows overlap. Can do.

  In addition, the received display screen table and one or more image data are stored, and when an operation by the user specifying the stored display screen table is accepted, the display screen table is displayed according to the specified display screen table. Generate an image. For this reason, when a plurality of display screen tables are stored, the user can select a desired display screen table.

  In addition, when the display device 100 receives an operation for designating a position in the display image, the display device 100 performs an operation for identifying the second window including the designated position and changing the image displayed on the identified second window. In response to being accepted, a display image is generated and displayed according to the accepted operation. For this reason, the user can change the image displayed for each second window included in the display image.

  Further, when the display device 100 further receives related image data related to the image data and receives an operation for indicating a position in the displayed display image, the display device 100 specifies a second window including the indicated position. When the window record including the file name of the image data displayed in the specified second window includes the file name of the related image data, when an operation for displaying the related image by the user is accepted, the related image data A display image is generated by further combining the new second window for displaying and displayed. For this reason, related image data can be displayed.

  Further, when an operation by the user that indicates a position in the displayed display image is received, the display device 100 detects a handwritten image based on the instructed position, and the detected handwritten image is detected. When the handwritten image is associated with the image data displayed in the second window including the position and the image data displayed in the second window is displayed, the second image is displayed by superimposing the handwritten image on the image of the image data. Create a window. For this reason, since the handwritten image is displayed superimposed on the image of the image data, it is possible to confirm the characters and the like that were noted while viewing the image of the image data together with the image of the image data. If the user inputs what he / she noticed during the meeting by handwriting, he / she can view it simultaneously with the browsing of the image data, so he / she can remember that he / she noticed during the meeting.

  In the above-described embodiment, the display system 1 and the display device 100 have been described. However, the display control method for executing the second display control process shown in FIGS. Needless to say, the invention can be understood as a display control program to be executed by the CPU 11.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

It is a figure which shows the whole outline | summary of the display system in one of the embodiments of this invention. It is a block diagram which shows an example of the hardware constitutions of PC. It is a top view of the display apparatus in one of the embodiments of the invention. It is a block diagram which shows an example of the hardware constitutions of a display apparatus. It is a functional block diagram which shows an example of the function which CPU with which PC is provided with the data memorize | stored in HDD. It is a figure which shows an example of a display screen table. It is a figure which shows an example of a screen when two windows overlap. It is a figure for demonstrating the minimization of a window. It is a functional block diagram which shows an example of the function which CPU with which a display apparatus is provided with the data memorize | stored in EEPROM. It is a figure which shows an example of the display screen table after associating a handwritten image. It is a figure which shows an example of the image for a display which superimposed the handwritten image on the 2nd window. It is a flowchart which shows an example of the flow of the 1st display control process performed with PC. It is a 1st flowchart which shows an example of the flow of the 2nd display control process performed with a display apparatus. It is a 2nd flowchart which shows an example of the flow of the 2nd display control process performed with a display apparatus.

1 Display system, 100, 100A, 100B, 100C, 100D Display device, 11 CPU, 13 ROM, 15 RAM, 17 EEPROM, 19 Electronic paper, 21 Operation unit, 21A Power key, 21B Touch panel, 23 Communication I / F, 25 External I / F, 25A memory card, 31 bus, 51 data receiving section, 53 operation receiving section, 55 display image generating section, 57 window specifying section, 59 display screen table changing section, 61 image detecting section, 81 display screen table, 83 image data, 85 related image data, 200 PC, 201 CPU, 211 operation unit, 231 operation reception unit, 233 application execution unit, 235 window control unit, 237 display screen table management unit, 239 image data generation unit, 241 related information Acquisition unit, 243 transmission unit, 251 display Face table 253 image data 255 related image data.

Claims (9)

For each of one or more first windows included in the screen, the position of the first window in the screen, the file name of the image data displayed in the first window, and the first window is a different first A data receiving means for receiving, from the outside, a display screen table having a window record including information indicating an overlapping state when overlapping with a window, and one or more image data respectively displayed in the one or more first windows; ,
Display image generating means for generating a display image by combining one or more second windows that respectively display the received one or more image data according to the display screen table;
Display means for displaying the generated display image. Storage means for storing the received display screen table and the one or more image data;
Operation accepting means for accepting a user operation;
The display image generating unit generates the display image according to the designated display screen table in response to an operation for designating the display screen table stored in the storage unit being accepted by the operation accepting unit. The display device according to claim 1. A window specifying means for specifying a second window including the indicated position when an operation indicating the position in the displayed display image is received by the operation receiving means;
The display screen generating unit generates the display image according to the received operation in response to an operation of changing the specified second window being received by the operation receiving unit. The display device described. The data receiving means further receives related image data related to the image data,
A window specifying means for specifying the second window including the indicated position when an operation indicating the position in the displayed display image is received by the operation receiving means;
When the window record including the file name of the image data displayed in the specified second window includes the file name of the related image data, the display image generating unit displays the related image by the operation receiving unit. The display device according to claim 2, wherein when a display operation is received, a display image is generated by further combining a new second window for displaying the related image data. A handwritten image detecting means for detecting a handwritten image based on the indicated position when an operation for indicating a position in the displayed display image is received by the operation receiving means;
Association means for associating the detected handwritten image with image data displayed in the second window including the position detected by the indicated position detection means;
The display image generation unit generates a second window for displaying an image in which the associated handwritten image is superimposed on the image data when the handwritten image is associated with the image data. 5. The display device according to any one of 4. A display system including a display device and an information processing device,
The information processing apparatus includes:
Display means for displaying a screen including one or more first windows;
For each of the one or more first windows included in the displayed screen, the position of the first window in the screen, the file name of the image data displayed in the first window, and the first window Table generating means for generating a display screen table having a window record including information indicating an overlapping state when overlapping with another first window;
Transmitting means for transmitting the generated display screen table and one or more image data respectively displayed in the one or more first windows;
The transmission means transmits the display screen table after the change and the one or more image data every time the displayed screen is changed,
The display device
Data receiving means for receiving the display screen table and the one or more image data from the information processing apparatus;
Display image generating means for generating a display image by combining one or more second windows that respectively display the one or more image data according to the display screen table;
Display means for displaying the generated display image. The information processing apparatus further includes an acquisition unit that acquires the related data when the data that is the basis of the image data displayed in each of the one or more first windows includes link information that refers to the related data,
The table generating means adds a file name of related image data as an image of the acquired related data to a window record including a file name of image data including the link information,
The transmission means further transmits the related image data,
The data receiving means included in the display device further receives the related image data,
The display device further includes operation accepting means for accepting a user operation;
An image specifying means for specifying the image data displayed in the second window including the indicated position when an operation indicating the position in the displayed display image is received by the operation receiving means; With
When the window image including the file name of the specified image data includes the file name of the related image data, the display image generating unit receives an operation for displaying the related image by the operation receiving unit. The display system according to claim 6, wherein a display image is generated by further combining the second window for displaying the related image data. For each of one or more first windows included in the screen, the position of the first window in the screen, the file name of the image data displayed in the first window, and the first window is a different first Receiving a display screen table having a window record including information indicating an overlapping state when overlapping with a window, and one or more image data respectively displayed on the one or more first windows;
Generating a display image by combining one or more second windows that respectively display the received one or more image data according to the display screen table;
Displaying the generated display image. A display control method comprising: For each of one or more first windows included in the screen, the position of the first window in the screen, the file name of the image data displayed in the first window, and the first window is a different first Receiving a display screen table having a window record including information indicating an overlapping state when overlapping with a window, and one or more image data respectively displayed on the one or more first windows;
Generating a display image by combining one or more second windows that respectively display the received one or more image data according to the display screen table;
A display control program for causing a computer to execute the step of displaying the generated display image.

Images