JP4973553B2 - Display system and display system program - Google Patents

Description

  The present invention relates to a display system including a plurality of display units, and in particular, suitably performs cursor movement between display screens of the plurality of display units even when a tablet device is used as an operation input unit. The present invention relates to a display system that can be used.

  2. Description of the Related Art Conventionally, as a display device, a projector that inputs image information from a computer device or the like, displays the image on a liquid crystal display element, irradiates light on the liquid crystal display element, and projects the enlarged image on a projection screen has been widely used. Yes. This projector is often used in conferences and the like where a plurality of people participate, and by using such a projector, a plurality of participants can simultaneously discuss while viewing a single enlarged image. Can do.

  Furthermore, in recent years, a display system has been devised that can project an image or cursor in a virtual display area adjacent to the display area of the display unit of the terminal device onto the projected image area of the projector (for example, Patent Documents). 1).

By using such a display system, the user of the terminal device, for example, projects and displays only an image for presentation on the projection image area of the projector, and conversely, only the user of the terminal device references during the presentation. Information can be displayed in the display area of the terminal device, so that the presentation can be performed more smoothly.
JP 2007-101852 A

  However, when a so-called tablet device is used as an operation means of the terminal device instead of a pointing device that is generally used at present, it is easy to move the cursor between the display screen of the terminal device and the virtual display area. It wasn't.

  That is, a pointing device such as a mouse or a trackball detects how much the operation position has moved relative to the current coordinates in response to a user's operation. Even when it is located at the edge of the display area, it is possible to easily move the cursor to the outside of the area.

  However, the tablet device outputs coordinate position data in accordance with the operation position of an operation element such as a stylus pen, and the tablet apparatus accepts input of coordinates and an operation element defined on the display area of the terminal device. Since the coordinates defined on the operation area have a one-to-one correspondence, the outside of the display area of the terminal device cannot be designated as the movement destination of the cursor.

  Therefore, the present invention suitably performs cursor movement between display screens of a plurality of display units even in the case where a tablet device is used as an operation input unit in a display system having a plurality of display units. It is an object of the present invention to provide a display system that can be used.

In order to solve the above-mentioned problem, the invention described in claim 1 includes a first display unit that displays an image on a display screen, and a second display unit that includes a display screen adjacent to the display screen of the first display unit; In a display system including a tablet unit that outputs data of a coordinate position according to an operation position by an operation element, an operation position on the tablet unit of the operation element is displayed on the first display unit corresponding to the operation position. Conversion processing means for executing a first process for converting to a coordinate position on a display screen, wherein the conversion processing means satisfies an operation position of the operator satisfying a first position condition in a predetermined region on the tablet unit; If it is determined that there, characterized in that to start the operation position on the tablet portion of the operator, the execution of the second process of converting into a coordinate position on the display screen of the second display unit corresponding to the actuated position To.

  According to a second aspect of the present invention, in the first aspect of the invention, the conversion processing unit is configured such that the operation position of the manipulator is the position when the manipulator is positioned in an edge region of the tablet unit. It is determined to be in a predetermined area on the tablet unit.

  Further, the invention according to claim 3 is the invention according to claim 1 or 2, wherein the conversion processing means is configured such that the operation position of the operation element is a second position condition in a predetermined region on the tablet unit. After satisfying the above, until the first position condition is satisfied, the operation position on the tablet unit of the operator is sequentially changed from the coordinate position on the display screen of the first display unit corresponding to the operation position. A third process of converting to a coordinate position moved toward the coordinate position on the display screen of the second display unit corresponding to the operation position is performed.

  According to a fourth aspect of the present invention, in the invention according to any one of the first to third aspects, the conversion processing means is configured such that the operation position of the operation element is first in a predetermined region on the tablet unit. It is determined that the first position condition is satisfied when the camera is stationary for a period of time.

  According to a fifth aspect of the present invention, in the invention according to the third aspect, the conversion processing unit is configured such that the operation position of the operation element satisfies a second position condition in a predetermined area on the tablet unit. When the operation position of the manipulator does not satisfy the first position condition before the first position condition is satisfied, the execution of the third process is stopped and the execution of the first process is started. It is characterized by doing.

According to a sixth aspect of the present invention, in the third aspect of the present invention, the conversion processing unit is configured such that the operation position of the operation element is shorter than the first period in a predetermined region on the tablet unit. It is determined that the second position condition is satisfied when the vehicle is stationary for two periods.

  The invention according to claim 7 is the invention according to any one of claims 1 to 6, wherein the conversion processing unit is configured to execute the second process when the operator is in a state of executing the second process. When it is determined that the operation position satisfies the third position condition in the predetermined area on the tablet unit, the execution of the second process is stopped and the execution of the first process is started.

The invention according to claim 8 is the invention according to claim 7 , wherein when the conversion processing unit is in a state of executing the second process, the operation position of the operation element is on the tablet unit. In the predetermined region, it is determined that the third position condition is satisfied when the vehicle is stationary for the first period.

  The invention according to claim 9 is the invention according to any one of claims 1 to 8, wherein the conversion processing means is configured such that the coordinate size of the operation position coordinates of the tablet unit is the first display unit or When different from the screen size of the display screen of the second display unit, correction according to the size difference is performed at the time of conversion to the coordinate position of the display screen having a different image size.

  According to the present invention, even when a tablet device is used as the operation input unit, the cursor can be moved between the display screen of the first display unit and the display screen of the second display unit. In addition, since the coordinate position on the display screen of the second display unit after the coordinate conversion corresponds to the operation position of the operator on the tablet unit, the user can continue the operation without any sense of incongruity after the coordinate conversion. it can.

[1. Overview of the display system]
Hereinafter, a display system according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a schematic diagram illustrating an overall system configuration of a display system according to the present embodiment, FIG. 2 is a schematic configuration diagram of a terminal device according to the present embodiment, and FIG. 3 is a schematic configuration diagram of a projector according to the present embodiment. FIG. 4 is a diagram showing an example of operations by the first process and the second process of the conversion processing unit in the present embodiment.

  As shown in FIG. 1, the display system S according to this embodiment includes a terminal device 1 and a projector 2 connected to the terminal device 1 via a communication path 4. Among the images generated by the application program (hereinafter, also simply referred to as “application”) executed in, the image data of the image 30b in the virtual display area 45 of the terminal device 1 is displayed as a display device such as the projector 2. It is a system that displays.

  In the display system S according to the present embodiment, the terminal device 1 includes a tablet unit 14 as an operation input unit, and the display screen of the terminal device 1 is operated by operating the operator 13 on the tablet unit 14. The cursor 5 on the terminal 40 can be operated, and the cursor is moved between the display screen 40 of the terminal device 1 and the display screen 60 of the projector 2 in accordance with the operation on the tablet unit 14. Is.

  In the display system S according to the present embodiment, as illustrated in FIG. 2, the terminal device 1 includes a first display unit 10, a virtual display area setting unit 11, a transmission processing unit 12, an operator 13, and a tablet unit. 14 and conversion processing means 15. Further, as shown in FIG. 3, the projector 2 includes a second display unit 20, a reception processing unit 21, and an image generation unit 22.

  In other words, in the display system S according to the present embodiment, the virtual display area 45 appears to be adjacent to the display screen 40 of the first display section 10 of the terminal device 1 by the virtual display area setting unit 11 of the terminal device 1. In addition, in the virtual display area 45 and the display screen 60 of the projector 2, a coordinate area having a size corresponding to the size of the screen is defined with the upper left corner of each area as the origin. When the cursor 5 or the image in the virtual display area 45 is synthesized, first, the terminal device 1 uses the transmission processing unit 12 to display the image data of the image in the virtual display area 45, the position coordinates of the cursor 5, and the virtual The size of the display area 45 is transmitted to the projector 2 via the communication path 4, and the projector 2 receives the transmitted information via the communication path 4 by the reception processing unit 21.

  Then, the projector 2 displays the cursor 5 and image data on the display screen of the projector 2 corresponding to the coordinate position on the virtual display area 45 based on the information acquired by the reception processing unit 21 by the image generation unit 22. The display image data is generated by arranging and synthesizing at the coordinate positions on 60, and the second display unit 20 further generates an image based on the display image data (hereinafter referred to as “display image”). In other words, the cursor 5 and image data in the virtual display area 45 of the terminal device 1 are combined and displayed on the display screen 60 of the projector 2.

  The tablet unit 14 provided in the terminal device 1 is an input device for operating the cursor 5 on the display screen 40 of the terminal device 1 using a pen-type operator 13 typified by a stylus pen. Then, by bringing the tip of the operating element 13 into contact with the operation area 17 of the tablet unit 14, data on the coordinate position corresponding to the operating position on the operating area 17 by the operating element 13 is output. The terminal device 1 then sets the operation position on the operation area 17 of the tablet unit 14 of the operator 13 on the display screen 40 of the terminal device 1 corresponding to the operation position based on the output coordinate position data. A first process of converting to a coordinate position is executed. Accordingly, the cursor 5 on the display screen 40 of the terminal device 1 can be operated in accordance with the operation on the tablet unit 14 of the operator 13. This first processing is performed by the conversion processing means 15.

  Here, “the coordinate position on the display screen 40 corresponding to the operation position on the operation area 17” means the coordinate size defined in the operation area 17 of the tablet unit 14 and the screen of the display screen 40 of the first display unit 10. When the size is the same, the coordinate position same as the operation position on the operation area 17 is indicated, and the coordinate size of the operation area 17 of the tablet unit 14 and the screen size of the display screen 40 of the first display unit 10 are displayed. Are different from each other, they indicate the same coordinate position when these sizes are set to the same scale.

  That is, as with the display screen 40 of the terminal device 1 and the display screen 60 of the projector 2, a coordinate area is defined on the tablet unit 14 with the upper left corner of the tablet unit 14 as the origin. For example, FIG. When the coordinate size of the operation area 17 on the tablet unit 14 and the screen size of the display screen 40 of the first display unit 10 are the same as shown in FIG. When the coordinates are (X, Y) = (600, 500), the conversion processing unit 15 serves as the first processing unit to set the operation position to the same coordinate position on the display screen 40 as the coordinates of the operation position ( X, Y) = (600,500). As a result, the cursor 5 is displayed on the display screen 40 of the first display unit 10 at a position corresponding to the operation of the operator 13 on the tablet unit 14.

  Furthermore, in the display system S according to the present embodiment, when the conversion processing unit 15 determines that the operation position of the operation element 13 satisfies the first position condition in a predetermined region on the tablet unit 14, the operation element 13. The second process of converting the operation position on the tablet unit 14 to the coordinate position on the display screen 60 of the projector 2 corresponding to the operation position is started.

  That is, in the present embodiment, the predetermined area is the edge area 18 of the tablet part 14, and for example, as shown in FIG. 4B, the operation position on the tablet part 14 by the operator 13 is within this edge area 18. In a certain state, when the operation position is stationary for a predetermined time as a first position condition, the conversion processing unit 15 performs operation processing (X, Y) = (1150) on the tablet unit 14 as a second process. , 600) is converted into a coordinate position (X, Y) = (1150, 600) on the display screen 60 of the projector 2 having the same value as the coordinates of the operation position. The converted coordinate position data is transmitted to the projector 2 via the communication path 4 by the transmission processing unit 12 of the terminal device 1, and the projector 2 that has received the data receives the data by the image generation unit 22. Display data is generated based on the data, and an image based on the display data is displayed on the second display unit 20. Thereby, as shown in FIG. 4B, the cursor 5 is displayed on the display screen 40 of the second display unit 20 at the same coordinate position as the coordinate position where the cursor 5 was displayed on the display screen 40. Will be.

  As described above, the display system S according to the present embodiment has a cursor between the display screen 40 of the terminal device 1 and the display screen 60 of the projector 2 even when the tablet unit 14 is used as the operation input unit. 5 can be easily performed. Moreover, when the cursor 5 is moved from the display screen 40 of the terminal device 1 to the display screen 60 of the projector 2 by the second processing of the conversion processing means 15, the cursor 5 is operated on the tablet unit 14 by the operator 13. Since it moves to the coordinate position on the display screen 60 of the projector 2 which is the same position as the position, the user of the terminal device 1 can perform the subsequent operation using the tablet unit 14 without a sense of incongruity. .

  Hereinafter, an example of a more specific configuration and operation of the above-described display system will be specifically described with reference to the drawings.

[2. Specific configuration of display system]
(Regarding the configuration of the terminal device 1)
First, the configuration of the terminal device 1 will be described. FIG. 5 is a configuration diagram of the terminal device 1 according to the present embodiment, and FIGS. 6 to 9 are diagrams illustrating each process performed by the conversion processing unit according to the present embodiment.

  The terminal device 1 according to the present embodiment can be a general personal computer or a dedicated terminal. As shown in FIG. 5, the terminal device 1 is a transmissive liquid crystal panel 100 (hereinafter referred to as “LCD 100”) as a first display unit. ), A graphics controller 101 for driving the LCD 100, a hard disk device 102 for storing various data, an interface 103 for communicating with the projector 2 via the communication path 4, a USB device and data A USB bus controller 104 for inputting / outputting a signal, a USB connector 105 as a connection port connected to the USB bus controller 104, and a tablet as a tablet unit for outputting data of coordinate positions according to an operation position by a stylus pen 107 as an operator Control for controlling device 106 and terminal device 1 as a whole And 108 are configured with, these various elements are connected to each other via a first bus 109, a second bus 110. In the figure, reference numeral 111 denotes a bus controller for transferring data between the first bus 109 and the second bus 110.

  The hard disk device 102 functions as a storage unit. The hard disk device 102 includes an operating system (OS) program, document creation software, presentation software, spreadsheet software, and graphic creation software for the terminal device 1. In addition to various application programs such as the above, data files created by this application program are stored. In addition to the application program, an image sharing program is stored as a processing program for the display system S in the present embodiment.

  The image sharing program may be downloaded from a server (not shown) connected to the communication path 4 to the hard disk device 102 of the control unit 108 via the interface 203, or may be a CD. It may be recorded in a recording medium such as a ROM (Compact Disc Read Only Memory) and then read into the hard disk device 102 of the control unit 108 via a recording medium drive (not shown).

  The interface 103 is a USB interface that can communicate with an external device, and is used by the control unit 108 when acquiring an image operation command or the like from the projector 2 or communicating with an external computer device. The interface 103 may be a wireless or wired LAN interface instead of the USB interface.

  The control unit 108 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like, and the CPU reads and executes an image sharing program stored in the hard disk device 102. Thus, the terminal device 1 is caused to function as a transmission processing unit, a virtual display area setting unit, and the like.

  Further, the control unit 108 reads out and executes various application programs stored in the hard disk device 102 by the CPU, thereby causing them to function as conversion processing means and the like.

  The control unit 108 functions as a transmission processing unit together with the interface 103 so that the image data of the image 30 in the virtual display area 45, the position coordinates of the cursor 5, and the size of the virtual display area 45 are transmitted via the communication path 4. Transmit to the projector 2.

  Further, the control unit 108 functions as a transmission processing unit, and when a predetermined operation is performed on the tablet device 106 by the stylus pen 107 when the cursor 5 is positioned in the virtual display area 45, the operation is performed. An image operation command corresponding to the is transmitted to the projector 2. Here, “operation” refers to a command for editing a data file being executed by an application of the terminal device, or a cursor 5 indicating a display image projected and projected by the projector 2 or its movement. Is an instruction for.

  The virtual display area 45 is set by the CPU of the control unit 108 executing an image sharing program stored in the hard disk device 102 and functioning as a virtual display area setting unit.

  In addition, the control unit 108 functions as a conversion processing unit, thereby performing a first process of converting the operation position on the tablet device 106 of the stylus pen 107 into a coordinate position on the display screen of the LCD 100 corresponding to the operation position. Execute. Hereinafter, the first process will be described with reference to FIG. FIG. 6 is a diagram illustrating a state in which the operation position on the tablet unit of the operator is converted into the coordinate position on the display screen 40 of the terminal device 1 corresponding to the operation position in the display system S according to the present embodiment. is there.

  As shown in FIG. 6, the operation area 112 of the tablet device 106 and the display screen 40 of the LCD 100 each have a coordinate area whose origin is the upper left vertex, for example, as shown in FIG. As described above, when a certain position on the operation area 112 of the tablet device 106 is instructed by the stylus pen 107, the tablet device 106 has coordinate position data (X, Y) = (700, 500) and the control unit 108 as a first process, based on the data of the coordinate position, the coordinate position (X, Y) = (700,500) on the display screen 40 of the LCD 100 corresponding to the operation position. ), The cursor 5 is displayed at this coordinate position.

  In the present embodiment, in addition to displaying the cursor 5 at the coordinate position on the display screen 40 according to the operation position of the stylus pen 107, for example, the tip of the stylus pen 107 is displayed on the operation area 112 of the tablet device 106. The operation similar to the click operation of the mouse can be performed by performing an operation such as stroking, and the operation of tracing the operation area 112 while the tip of the stylus pen 107 is in contact with the operation area 112 is performed. Thus, it is possible to perform the same operation as the mouse drag operation.

  When the control unit 108 functions as a conversion processing unit and determines that the operation position of the stylus pen 107 satisfies the first position condition in a predetermined region on the operation region 112 of the tablet device 106, the control unit 108 operates as a stylus pen. The execution of the second process of converting the operation position on the tablet device 106 of 107 into the coordinate position on the display screen 60 of the projector 2 corresponding to the operation position is started. Hereinafter, the second process will be described with reference to FIG. FIG. 7 shows how the operation position on the tablet device 106 of the stylus pen 107 is converted to the coordinate position on the display screen 60 of the projector 2 corresponding to the operation position in the display system S according to the present embodiment. FIG.

  That is, in the present embodiment, the first position condition is “when the operation position by the stylus pen 107 is stationary for a predetermined time in a predetermined region of the tablet device 106”, and more specifically, on the right side of the tablet device 106 In the edge region 113 (region of (X, Y) = (1100, 0) to (1200, 1000)), the operation position by the stylus pen 107 is stationary for 2 seconds (corresponding to “first period”). In such a case, the control unit 108 determines that the first position condition is satisfied and starts executing the second process by the conversion processing unit.

  For example, as shown in FIG. 7, when the operation position by the stylus pen 107 is at the coordinate position (X, Y) = (1150, 100) in the right edge region 113 of the tablet device 106, the stylus pen 107 When the control unit 108 remains stationary at the coordinate position for 2 seconds, as the second process by the conversion processing unit 15, the control unit 108 displays the operation position on the tablet device 106 of the stylus pen 107 on the virtual display area 45 corresponding to the operation position. To the coordinate position (X, Y) = (1150, 100).

  The control unit 108 functions as a transmission processing unit, thereby transmitting the position coordinates of the cursor 5 in the virtual display area 45 to the projector 2 via the communication path 4 and receiving the position coordinates of the cursor 5. 2 arranges the image data of the cursor 5 on the coordinate position on the display screen 60 of the projector 2 corresponding to the coordinate position on the virtual display area 45 based on the information, and synthesizes the display image data. Generate and project and display a display image based on the display image data. As a result, the cursor 5 on the display screen 40 of the LCD 100 moves to the display screen 60 of the projector 2, and thereafter, according to the operation on the tablet device 106 of the stylus pen 107 by this second processing. Thus, the operation input on the display screen 60 of the projector 2 is possible.

  As described above, when the control unit 108 functions as the conversion processing unit and determines that the operation position of the stylus pen 107 satisfies the first position condition in a predetermined area on the operation area 112 of the tablet device 106, the stylus. Since the second processing for converting the operation position of the pen 107 on the tablet device 106 to the coordinate position on the display screen 60 of the projector 2 corresponding to the operation position is started, the tablet device 106 is used as an operation input unit. Even in the case of using the cursor 5, the cursor 5 can be easily moved between the display screen 40 of the LCD 100 and the display screen 60 of the projector 2. In addition, since the coordinate position on the display screen 60 of the projector 2 after conversion corresponds to the position of the stylus pen 107 on the operation area 112 of the tablet device 106, the user of the terminal device 1 operates without feeling uncomfortable after conversion. Can continue.

  Here, the conversion processing unit determines that the operation position of the stylus pen 107 is in a predetermined region on the operation region 112 of the tablet device 106 when the stylus pen 107 is positioned in the edge region 113 of the tablet device 106. That is, the predetermined area in the present embodiment is an edge area 113 of the tablet device 106 as shown in FIG. In FIG. 7, reference numeral 42 denotes an edge area on the display screen 40 of the LCD 100 corresponding to the right edge area 113 of the tablet device 106, and the area is (X, Y) = (1100, 0) to The range is (1200, 1000).

  With this configuration, it is possible for the user of the terminal device to easily recognize that the display screen 40 of the terminal device 1 and the display screen 60 of the projector 2 are virtually connected.

  Further, the control unit 108 functions as a conversion processing unit, so that the operation position of the stylus pen 107 satisfies the first position condition after the second position condition is satisfied in the edge region on the tablet device 106. Meanwhile, the operation position of the stylus pen 107 on the tablet device 106 is sequentially moved from the coordinate position on the display screen of the LCD 100 corresponding to the operation position toward the coordinate position on the display screen of the projector 2 corresponding to the operation position. A third process for converting to the coordinate position is executed. Hereinafter, the third process will be described with reference to FIG. FIG. 8 is a diagram showing how the cursor 5 moves from the left end to the right end of the display screen 60 of the projector 2 by the third process.

  That is, when the operation position of the stylus pen 107 is at the coordinate position (X, Y) = (1150, 100) in the edge region 113 on the tablet device 106, the operation position is the edge region 113 as the second position condition. If the control unit 108 is stationary for 1 second (corresponding to “second period”), the control unit 108 sets the first position condition (the operation position is stationary for 2 seconds in the edge region 18). The third process is executed until it is satisfied. Thus, in the present embodiment, the first period is 2 seconds, and the second period is 1 second shorter than the first period.

  Then, when the control unit 108 executes the third process, first, the coordinate position on the display screen 40 of the LCD 100 corresponding to the operation position on the tablet device 106 of the stylus pen 107 is converted into a virtual display area corresponding to the operation position. 45 is converted to the leftmost coordinate position. That is, among the coordinate positions (X, Y) = (0, 0) to (0, 1000) at the left end of the virtual display area 45, the coordinate position having the same value as the Y coordinate at the coordinate position on the display screen 40 of the LCD 100. Convert to (X, Y) = (0, 100). Thereby, as shown in FIG. 8A, the cursor 5 on the display screen 40 of the terminal device 1 moves to the left end of the display screen 60 of the projector 2.

  Further, the control unit 108 changes the operation position from the converted coordinate position on the virtual display area 45 to the coordinate position (X, Y) = (1150, 100) on the virtual display area 45 corresponding to the operation position. Convert sequentially. Thus, for example, when 1.3 seconds have elapsed since the operation position of the stylus pen 107 was positioned at the coordinate position (X, Y) = (1150, 100) in the edge region 113 on the tablet device 106, the cursor 5 As shown in FIG. 8B, when the coordinate position (X, Y) = (400, 100) on the display screen 60 of the projector 2 is moved to 1.7 seconds and 1.7 seconds have passed, FIG. As shown in c), it moves to the coordinate position (X, Y) = (800, 100) on the display screen 60 of the projector 2. Then, when two seconds have elapsed since the operation position of the stylus pen 107 was positioned at the coordinate position (X, Y) = (1150, 100) in the edge region 113 on the tablet device 106, that is, the first position condition When the condition is satisfied, the cursor 5 is positioned at the rightmost coordinate position (X, Y) = (1200, 100) on the display screen 60 as shown in FIG.

  Thus, until the second process is executed, as the third process, the process of converting the coordinates of the operation position so that the cursor 5 moves from the left end to the right end of the projector 2 is executed. Therefore, when the second process by the conversion processing unit of the control unit 108 is executed, the position of the cursor 5 suddenly changes from the display screen 40 of the LCD 100 to the display screen 60 of the projector 2, whereby the user of the terminal device 1 moves the cursor. The situation of losing 5 can be prevented.

  Further, the control unit 108 functions as a conversion processing unit, so that the operation position of the stylus pen 107 satisfies the first position condition after the second position condition is satisfied in the edge region on the tablet device 106. Meanwhile, when the operation position of the stylus pen 107 does not satisfy the first position condition, the execution of the third process is stopped and the execution of the first process is started.

  That is, for example, when the stylus pen 107 moves away from the operation area 112 of the tablet device 106 during the execution of the third process, the control unit 108 stops the execution of the third process and starts the execution of the first process. . Accordingly, as shown in FIG. 9A, the cursor 5 that has moved from the left end to the right end of the display screen 60 of the projector 2 by the third process has reached the right end of the display screen 60 before reaching the right end. The coordinate position on the display screen 40 of the LCD 100 corresponding to the operation position on the tablet device 106 is returned.

  With this configuration, for example, when the third process is executed against the intention of the user of the terminal device 1, the execution of the third process is immediately stopped and the operation target is displayed on the display screen of the projector 2. The display screen 40 of the terminal device 1 can be returned from 60.

  Further, the control unit 108 functions as a conversion processing unit, so that the operation position of the stylus pen 107 satisfies the third position condition in the edge region on the tablet device 106 when the second process is executed. If it is determined that the second process is executed, the execution of the second process is stopped and the execution of the first process is started.

  That is, the control unit 108 converts the operation position on the tablet device 106 of the stylus pen 107 into the coordinate position on the display screen 60 of the projector 2 corresponding to the operation position by the second process of the conversion processing unit. When in the state (that is, the state in which the display screen 60 of the projector 2 can be operated by the stylus pen 107 and the tablet device 106), as shown in FIG. When the stylus pen 107 is stationary for 2 seconds (corresponding to “third position condition”) as the edge region 114 (corresponding to “predetermined region”), the execution of the second process is stopped and the stylus pen 107 The operation position on the tablet device 106 is converted into a coordinate position on the display screen 40 of the LCD 100 corresponding to the operation position. To perform one processing. As a result, the operation position on the tablet device 106 of the stylus pen 107 is converted into the coordinate position on the display screen 40 of the LCD 100 corresponding to the operation position, and as shown in FIG. The display screen 60 of the projector 2 moves to the display screen 40 of the terminal device 1.

  As described above, in this embodiment, when the second process is executed, the operation position of the operator 13 is stationary for 2 seconds as the first period in the predetermined area on the tablet unit 14. It is determined that the third position condition is satisfied.

  With this configuration, the user of the terminal device 1 can use the terminal 2 from the display screen 60 of the projector 2 by the same operation as when the cursor 5 is moved from the display screen 40 of the terminal device 1 to the display screen 60 of the projector 2. It can be moved to the display screen 40 of the device 1. Moreover, since the coordinate position on the display screen 40 of the terminal device 1 after the coordinate conversion corresponds to the position of the stylus pen 107 on the operation area 112 of the tablet device 106, the user of the terminal device 1 can perform the coordinate conversion after the coordinate conversion. The operation can be continued without any discomfort.

  Further, the control unit 108 functions as a conversion processing unit, so that when the coordinate size of the operation position coordinates of the tablet device 106 is different from the screen size of the display screen of the LCD 100 or the projector 2, the coordinates of the display screens having different image sizes are displayed. Correction according to the size difference is performed at the time of conversion to a position.

  That is, for example, when the coordinate size of the operation area 112 of the tablet device 106 is (X, Y) = (0, 0) to (1200, 1000), the screen size of the display screen 60 of the projector 2 is (X, Y). When Y) = (0, 0) to (2400, 2000), the control unit 108 displays the operation position of the stylus pen 107 on the tablet device 106 by the second process on the projector 2 corresponding to the operation position. When converting to a coordinate position on the screen 60, the coordinate of the operation position is converted to a coordinate position obtained by doubling the X coordinate and the Y coordinate.

  With this configuration, even if the coordinate size of the operation position coordinates of the tablet device 106 is different from the screen size of the display screens 40 and 60 of the terminal device 1 or the projector 2, the stylus pen 107 on the tablet device 106 is used. The operation position can be converted into the coordinate position on the display screen 40 or the display screen 60 corresponding to the operation position, and the user of the terminal device 1 can continue the operation without feeling uncomfortable after the conversion.

(About the configuration of the projector 2)
Next, the configuration of the projector 2 will be described. FIG. 11 is a configuration diagram of the projector 2 in the present embodiment, FIG. 12 is a diagram illustrating an example of an image attribute information management table stored in the projector 2 in the present embodiment, and FIG. 13 is a diagram of the projector 2 in the present embodiment. It is an example of the connection information management table memorize | stored in FIG.

  As shown in FIG. 11, the projector 2 communicates with the terminal device 1, an operation panel 201 for performing various operations, a storage unit 202 that is a non-volatile memory for holding setting information, data files, and the like. Interface 204, a video signal input circuit 205 for inputting a video signal from the outside, and a video signal input via the video signal input circuit 205 and image processing for performing predetermined processing on the image data acquired via the interface 204 A circuit 206; an image projection unit 207 as a second display unit that projects and displays an image based on an image signal output from the image processing circuit 206; and a control unit 208 that controls the entire projector 2. These are built into the housing.

  The operation panel 201 includes buttons for performing various operations, a display unit (for example, an LCD), and the like. When the user operates the operation panel 201 in the projector 2, control according to the operation content is controlled. This is executed by the unit 208.

  The storage unit 202 includes a flash memory or the like, and stores information on resolution set in the projector 2, image data of the cursor, and image data of the image in the virtual display area 45 of the terminal device 1. An image attribute information storage area 210 that stores an image attribute information management table that manages position information, size information, and the like of the image; and a cursor information storage area 211 that stores a cursor information management table that manages cursor position information and the like. .

  The interface 204 is a USB interface that can communicate with an external device, and is acquired by the control unit 208 when acquiring image data, an image operation command, or the like from the terminal device 1 or communicating with an external computer device. Used. The interface 204 may be a wireless or wired LAN interface instead of the USB interface.

  The video signal input circuit 205 inputs video signals such as composite video signals (for example, NTSC video signals) and component video signals (for example, RGB signals).

  The image processing circuit 206 performs processing such as synthesis of a plurality of image data on the video signal input to the video signal input circuit 205 or the image data acquired via the interface 204 based on control by the control unit 208. Do. The image signal processed and generated in this way is input to the image projection unit 207.

  The image projection unit 207 includes a lamp driving circuit 220, a light source 221, an illumination optical system 222, an LCD 223, an imaging optical system 224, an LCD driving circuit 225, and a focus adjustment circuit 226.

  The light source 221 is composed of a lamp or the like, and is driven to turn on and emit light based on a signal output from the lamp driving circuit 220 controlled by the control unit 208. The light emitted from the light source 221 is irradiated on the LCD 223 as illumination light by the illumination optical system 222.

  The LCD 223 is driven by the LCD drive circuit 225 and displays an image on its display surface. The video displayed in this way is irradiated with illumination light emitted from the light source 221 via the illumination optical system 222, thereby generating image light. Subsequently, the image light is projected onto a screen (projection surface) through the imaging optical system 224 and a projection opening (not shown) of the housing. As described above, the image displayed on the LCD 223 is projected onto the screen. The focus adjustment circuit 226 can adjust the focus of the image projected on the screen.

  The control unit 208 includes a CPU, a ROM, a RAM, and the like, and the CPU 2 reads and executes a program stored in advance in the ROM, thereby causing the projector 2 to operate as a reception processing unit, an image generation unit, and an operation command processing unit. And so on.

  As a reception processing unit, the control unit 208 receives the image data of the image in the virtual display area 45 of the terminal device 1, the position coordinates of the cursor 5, the size of the virtual display area 45, or an image operation command via the interface 204 and the communication path 4. Receive.

  In addition, the control unit 208 functions as an image generation unit to synthesize the image data of the cursor 5 and the image 30 in the virtual display area 45 of each terminal device 1. The composition of the image data by the image generation unit is executed based on the image attribute information management table stored in the storage unit 202.

  Here, the image attribute information management table will be described with reference to FIG.

  As shown in FIG. 12, in the image attribute information management table, the name of the terminal device 1 (owner PC) that has transmitted the image in the virtual display area 45 of the terminal device 1, the size of the image, and this image should be displayed. Information for identifying the image is information relating to the position, information relating to the file name of the image data, and information relating to the order (layer level) in which the image data is superimposed when the image generating unit synthesizes the plurality of image data. It is stored in association with (Window ID).

  Further, as an image generation unit, the control unit 108 displays the image of the cursor 5 at a position based on the operation information transmitted by the transmission processing unit of the terminal device 1 in the virtual display area 45 of the terminal device 1. Are combined with the image data. Here, the composition of the image of the cursor 5 is executed based on the information in the cursor information management table.

  As shown in FIG. 13, the cursor information management table includes the image file name of the cursor image assigned to the terminal device 1 connected to the projector 2, the coordinate position of the cursor image on the display screen 60 projected by the projector 2 (X , Y) is stored in association with the name of the terminal device 1.

(Specific operation of terminal device)
Next, an example of a specific operation of the terminal device 1 will be described with reference to FIG. FIG. 14 is a main process flowchart of the terminal device 1 in the present embodiment. The following processes are executed by the control unit 108 of the terminal device 1 functioning as the above-described units.

  As shown in FIG. 14, when a power switch (not shown) of the terminal device 1 is pressed, the control unit 108 of the terminal device 1 performs a connection process (step S100). This connection process is a process for connecting to the projector 2 via the communication path 4. That is, the control unit 108 transmits a connection request signal including information on the IP address of the own terminal device to the projector 2 and ends the connection process when receiving a connection completion notification from the projector 2.

  When the connection process in step S100 ends, the control unit 108 starts executing the first process (step S101). As described above with reference to FIG. 6, the first process is to convert the operation position of the stylus pen 107 on the tablet device 106 onto the display screen 40 of the LCD 100 corresponding to the operation position. With this first processing, the cursor 5 is displayed on the display screen 40 of the LCD 100 at a position corresponding to the operation position on the tablet device 106 of the stylus pen 107, as shown in FIG.

  When the process of step S101 ends, the control unit 108 determines whether or not an operation with the stylus pen 107 has been performed (step S102). This determination is made based on whether or not the coordinate position data corresponding to the operation position by the stylus pen 107 is output from the tablet device 106. If it is determined in this determination that the operation with the stylus pen 107 has been performed (step S102: Yes), the control unit 108 starts cursor movement processing (step S103). This cursor movement process is a process from step S200 to step S209 in FIG. 15, and will be described later.

  Next, the control unit 108 determines whether or not an operation input has been performed on the image projected and displayed by the projector 2 (step S104). If it is determined in this process that an operation input has been made (step S104: Yes), the control unit 108 proceeds to step S105.

  In step S105, the control unit 108 determines whether the image attribute information has been updated (step S105). This determination is based on whether or not an operation for moving the image 30 on the display screen 40 of the LCD 100 to the virtual display area 45 is performed by an operation with the stylus pen 107 and the tablet device 106 (the image 30 is newly displayed in the virtual display area 45). Whether or not the image 30 in the virtual display area 45 has been moved or deleted, or whether the position or size of the image 30 in the virtual display area 45 has been changed. In this determination, when it is determined that the image attribute information has been updated (step S105: Yes), the control unit 108 generates image attribute information based on the updated information, and the image attribute information is transmitted to the projector via the communication path 4. 2 (step S106).

  That is, when a new image is added to the virtual display area 45, among the image attribute information of the added image, the window ID of the image, position information, size information, information on the file name of the image data, and the image Image attribute information notification data including additional flag data of attribute information is created and transmitted to the projector 2. When an image in the virtual display area 45 is moved out of the virtual display area 45 or deleted, an image including the window ID of the moved or deleted image and deletion flag data of the image attribute information is displayed. Attribute information notification data is created and transmitted to the projector 2. When the position or size of the image 30 in the virtual display area 45 is changed, image attribute information notification data including the image attribute information of the changed image 30 is generated and transmitted to the projector 2.

  Next, the control unit 108 acquires operation input information based on this operation input and position information of the cursor 5, and creates an image operation command based on these information (step S107). Then, the control unit 108 transmits the created image operation command to the projector 2 via the communication path 4 (step S108).

  When the process of step S108 is completed, or when the operation with the stylus pen 107 is not performed in step S102 (step S102: No), or when the operation input is not performed in step S104 (step S104: No) In step S105, when the image attribute information has not been updated (step S105: No), the control unit 108 determines whether or not the projector 2 has requested transmission of image data of the image in the virtual display area 45. (Step S109). This determination is made based on whether or not an image data transmission request signal has been received from the projector 2. In this process, if it is determined that there is a request for transmission of image data (step S109: Yes), the control unit 108 transmits the image data of the image in the virtual display area 45 to the projector 2 based on the received image data transmission request. Then, the data is transmitted via the communication path 4 (step S110).

  When the process of step S110 ends, or when there is no transmission request for image data of the image in the virtual display area 45 from the projector 2 in step S109 (step S109: No), the control unit 108 receives an image from the projector 2. It is determined whether an operation command has been received (step S111). In this process, when it is determined that an image operation command has been received from the projector 2 (step S111: Yes), the control unit 108 reproduces the received image operation command, whereby an application corresponding to the data file to be operated is obtained. The program is caused to execute an editing operation based on the image operation command (step S112).

  When the process of step S112 is completed, or when an image operation command is not received from the projector 2 in step S111 (step S111: No), the control unit 108 determines whether or not the connection state with the projector 2 has been released. Is determined (step S113). If it is determined in this process that the connection state with the projector 2 has not been released (step S113: No), the control unit 108 proceeds to step S102. On the other hand, if it determines with the connection state with the projector 2 having been cancelled | released (step S113: Yes), the control part 108 will complete | finish a main process.

  Next, the cursor movement process in step S103 will be specifically described with reference to FIG. FIG. 15 is a flowchart of the cursor movement process of the terminal device 1 in the present embodiment.

  As shown in FIG. 15, when the cursor movement process is started, the control unit 108 determines whether or not the current state is a state in which the first process is executed by the conversion processing unit (step S200). In this process, when it is determined that the current state is a state for executing the first process (step S200: Yes), the control unit 108 shifts the process to step S201.

  In step S <b> 201, the control unit 108 determines whether or not the operation position on the tablet device 106 of the stylus pen 107 satisfies the second position condition in the right edge region 113 of the tablet device 106. In this determination, the coordinate position data output from the tablet device 106 is within the coordinate range of the right edge region 42 of the display screen 40 of the LCD 100 corresponding to the right edge region 113 of the tablet device 106, and The stylus pen 107 is determined based on whether or not the stylus pen 107 has been stationary for 1 second at the operation position.

  In this process, when it is determined that the operation position of the stylus pen 107 on the tablet device 106 satisfies the second position condition in the right edge region 113 of the tablet device 106 (step S201: Yes), the control unit 108 Execution of the third process is started (step S202). As described above with reference to FIG. 8, the third process is performed after the operation position of the stylus pen 107 satisfies the second position condition in the right edge region 113 on the tablet device 106. Until the condition is satisfied, the operation position on the tablet device 106 of the stylus pen 107 is sequentially displayed on the display screen 60 of the projector 2 corresponding to the operation position from the coordinate position on the display screen 40 of the LCD 100 corresponding to the operation position. It is converted into a coordinate position moved toward the coordinate position. Then, the control unit 108 transmits the converted coordinate position data as cursor information to the projector 2 via the communication path 4.

  On the other hand, when the current state is not a state for executing the first process (step S200: No), the control unit 108 determines whether or not the current state is a state for executing the third process (step S203). . In this process, when it is determined that the current state is a state for executing the third process (step S203: Yes), the control unit 108 shifts the process to step S204.

  In step S204, the control unit 108 determines whether or not the stylus pen 107 has left the tablet device 106 (step S204). This determination is made based on whether or not coordinate position data is no longer output from the tablet device 106. In this process, when it is determined that the stylus pen 107 is separated from the tablet device 106 (step S204: Yes), the control unit 108 interrupts the execution of the third process and starts the execution of the first process (that is, the process is performed). Return to step S101.) (Step S205).

  On the other hand, when the stylus pen 107 is not separated from the tablet device 106 in step S204 (step S204: No), the control unit 108 determines that the operation position of the stylus pen 107 is first in the right edge region 113 of the tablet device 106. It is determined whether or not the position condition is satisfied (step S206). This determination is made based on whether or not the stylus pen 107 has been stationary for 2 seconds in the right edge region 113 on the tablet device 106. In this process, when it is determined that the operation position of the stylus pen 107 satisfies the first position condition in the right edge region 113 of the tablet device 106 (step S206: Yes), the control unit 108 executes the second process. Start (step S207). In the third process, as described above with reference to FIG. 7, the operation position on the tablet device 106 of the stylus pen 107 is converted onto the display screen 60 of the projector 2 corresponding to the operation position. . Then, the control unit 108 transmits the converted coordinate position data as cursor information to the projector 2 via the communication path 4.

  On the other hand, in step S203, when the current state is not a state for executing the third process (step S203: No), that is, when the current state is a state for executing the second process, the control unit 108 performs the stylus. It is determined whether or not the operation position of the pen 107 satisfies the third position condition in the left edge region 114 of the tablet device 106 (step S208). This determination is made based on whether or not the stylus pen 107 has been stationary for 2 seconds in the left edge region 114 on the tablet device 106. In this process, when it is determined that the operation position of the stylus pen 107 satisfies the third position condition in the left edge region 114 of the tablet device 106 (step S208: Yes), the control unit 108 executes the second process. The process is interrupted and the execution of the first process is started (that is, the process returns to step S101) (step S209).

  When the processing of steps S202, S205, S207, and S209 is completed, or when the operation position of the stylus pen 107 does not satisfy the second position condition in the right edge region 113 of the tablet device 106 in step S201 (step S201). If the operation position of the stylus pen 107 does not satisfy the first position condition in the right edge region 113 of the tablet device 106 in step S206 (step S206: No), the stylus pen 107 is moved in step S208. When the operation position does not satisfy the third position condition in the left edge region 114 of the tablet device 106 (step S208: No), the control unit 108 ends the cursor movement processing means.

(Specific operation of the projector)
Next, an example of a specific operation of the projector 2 will be described with reference to FIG. FIG. 16 is a main process flowchart of the projector 2 in the present embodiment. The following processes are executed by the control unit 208 of the projector 2 functioning as the above-described units and the like.

  As shown in FIG. 16, when a power switch (not shown) of the projector 2 is pressed, the control unit 208 of the projector 2 performs a connection process (step S500).

  This connection process is a process for the projector 2 to connect to the terminal device 1 via the communication path 4. Specifically, when the control unit 208 of the projector 2 first receives a connection request signal transmitted from the terminal device 1, the control unit 208 updates the connection information management table. That is, the control unit 208 newly provides a column of the terminal device 1 newly connected to the projector 2 in the connection information management table, and sets information regarding the IP address and connection state of the terminal device 1 as the name of the terminal device 1. Store it in association. Next, the control unit 208 updates the cursor information management table. That is, the control unit 208 newly provides a column of the terminal device 1 newly connected to the projector 2 in the cursor information management table, and the image file name of the cursor image assigned to the terminal device 1 and the position information of the cursor image. Is stored in association with the name of the terminal device 1. Then, the control unit 208 notifies the terminal device 1 that the connection process is completed, and ends the connection process.

  When the connection process in step S500 ends, the control unit 208 performs an image projection process (step S501). This image projection processing updates the image attribute information management table and the cursor information management table according to the information transmitted from the terminal device 1, and based on the information in these tables, the image data acquired from the terminal device 1, and A cursor image is synthesized and an image is projected based on the synthesized image data. This image projection processing is processing from step S600 to step S610 in FIG. 17, and will be described later.

  When the image projection processing in step S501 is completed, the control unit 208 determines whether an image operation command has been received from the terminal device 1 (step S502). In this process, when it is determined that an image operation command has been received from the terminal device 1 (step S502: Yes), the control unit 208 performs an operation command distribution process (step S503). In this operation command distribution process, this image operation command is transmitted to the terminal device 1 that has transmitted the image data of the image to be operated by the image operation command received from the terminal device 1.

  When the process of step S503 is completed, or when an image operation command is not received from the terminal device 1 in step S502 (step S502: No), the control unit 208 determines whether the power is turned off ( Step S504) When the power is not turned off (Step S504: No), the process proceeds to Step S500. On the other hand, if it determines with the power supply having been turned off (step S504: Yes), the control part 208 will complete | finish a main process.

  Next, the image attribute information update processing in step S501 will be specifically described with reference to FIG. FIG. 17 is a flowchart of the image attribute information update process of the projector 2 in the present embodiment.

  As shown in FIG. 17, when the image projection process is started, the control unit 208 determines whether or not image attribute information has been received from the terminal device 1 (step S600). In this process, when it is determined that the image attribute information has been received from the terminal device 1 (step S600: Yes), the control unit 208 updates the image attribute information management table based on the received image attribute information (step S601). ). For example, when the received image attribute information is transmitted when a new image is added to the display screen 60, the control unit 208 displays the image of the image newly located in the virtual display area 45. The attribute information is newly added to the image attribute information management table, and a storage area for the image data of the image is secured. Further, the control unit 208 updates the hierarchical level information of each image managed in the image attribute information management table. That is, the control unit 208 sets the hierarchy level of the newly added image to the virtual display area 45 to “1”, and sequentially lowers the other images to a hierarchy one level lower than the currently assigned hierarchy level. (For example, an image whose hierarchical level is set to “2” is updated to “3”).

  When the received image attribute information is transmitted by deleting the image from the display screen 60, the control unit 208 displays the image attribute information of the image to be deleted from the image attribute information management table. Delete and update the hierarchy level of other images.

  When the process of step S601 ends, the control unit 208 transmits an image data request signal requesting transmission of image data of the image 30 to the terminal device 1 (step S602).

  Next, the control unit 208 determines whether image data has been received from the terminal device 1 (step S603). In this process, if it is determined that the image data is received from the terminal device 1 (step S603: Yes), the control unit 108 decompresses the received image data (step S604). This is because the image data transmitted from the terminal device 1 is transmitted in a compressed state, as will be described later.

  Next, the control unit 208 stores the received image data in the image data storage area secured in the image attribute information update process (step S605), and pastes the image data in the designated display area (step S606). . Next, the control unit 208 determines whether or not all of the image data of the image in the virtual display area 45 of each terminal device 1 has been pasted (step S607). If it is determined in this process that all of the image data has been pasted (step S607: Yes), the control unit 208 proceeds to step S611, and when the image data has not been pasted (step S611). S607: No), the process proceeds to step S602.

  On the other hand, when image attribute information is not received in step S600 (step S600: No), the control unit 208 determines whether cursor information has been received from the terminal device 1 (step S608). If it is determined in this determination that the cursor information has been received from the terminal device 1 (step S608: Yes), the control unit 208 updates the information in the cursor information management table based on the received cursor information (step S609). Then, the control unit 208 combines the image data of the cursor 5 with the image data of the image projected on the display screen 60 of the projector 2 based on the information stored in the cursor information management table (step S610), and performs processing. The process proceeds to step S611.

  In step S611, the control unit 208 projects an image based on the combined image data (display image data) from the image projection unit 207. When this process ends, the control unit 208 ends the image projection process.

  By the way, the display system S according to the present embodiment can change various settings. For example, in the above, the first position condition is that the operator 13 is stationary for 2 seconds in the edge region 18 on the tablet unit 14. Instead, for example, as shown in FIG. In addition, a special operation such as reciprocating the operating element 13 on the edge region 18 may be performed. In addition, the special operation may be, for example, an operation of placing the operation element 13 against the edge region 18 on the tablet unit 14 a predetermined number of times.

  As mentioned above, some of the embodiments of the present invention have been described in detail with reference to the drawings. However, these are merely examples, and the present invention is variously modified and improved based on the knowledge of those skilled in the art. It is possible to carry out the invention.

  For example, the display system S according to the present embodiment includes the terminal device 1 and the projector 2, and the terminal device 1 has a first display unit and the projector 2 has a second display unit. As shown in FIG. 19, instead of the projector 2, the second display unit may include a display device 6 such as an LCD. In such a case, the terminal device 1 and the display device 6 are connected by the cable 7, and the image 30 b and the image data of the cursor 5 generated in the terminal device 1 are transmitted by the graphics controller 101 via the cable 7. The image is displayed on the display device 6 as an image based on the image data. In the figure, reference numeral 41 denotes a display screen of the display device 6.

It is a figure which shows the whole system configuration | structure of the display system in this embodiment. It is a schematic block diagram of the terminal device in this embodiment. It is a schematic block diagram of the projector in this embodiment. It is the figure which showed an example of the operation | movement by the 1st process of the conversion process means in this embodiment, and a 2nd process. It is a block diagram of the terminal device in this embodiment. It is the figure which showed a mode that the operation position on the tablet part of an operation element was converted into the coordinate position on the display screen of a 1st display part corresponding to the said operation position. It is the figure which showed a mode that the operation position on the tablet part of an operation element was converted into the coordinate position on the display screen of the 2nd display part corresponding to the said operation position. The operation position on the tablet unit of the operator is sequentially shifted from the coordinate position on the display screen of the first display unit corresponding to the operation position to the coordinate position on the display screen of the second display unit corresponding to the operation position. It is the figure which showed a mode that it converted into the coordinate position moved toward. After the operation position of the operation element satisfies the second position condition in the predetermined area on the tablet unit, the operation position of the operation element satisfies the first position condition until the first position condition is satisfied. It is the figure which showed the mode when it disappeared. It is the figure which showed a mode that the operation position on the tablet part of an operation element was converted from the coordinate position on the display screen of a 2nd display part corresponding to the said operation position to the coordinate position on the display screen of a 1st display part. . It is a block diagram of the projector in this embodiment. It is an example of the image attribute information management table memorize | stored in the projector in this embodiment. It is an example of the cursor information management table memorize | stored in the projector in this embodiment. It is a main process flowchart of the terminal device in this embodiment. It is a cursor movement process flowchart of the terminal device in this embodiment. It is a main process flowchart of the projector in this embodiment. It is an image projection process flowchart of the projector in this embodiment. It is the figure which showed an example of the operation | movement for satisfy | filling the 1st position conditions for starting execution of the 2nd process by a conversion process means. It is the schematic which shows the whole system structure at the time of using display apparatuses, such as LCD, instead of a projector as a display apparatus.

Explanation of symbols

S display system 1 terminal device 2 projector 4 communication path 13 operator 14 tablet unit 17 operation area

Claims (10)

A first display unit that displays an image on the display screen, a second display unit that has a display screen adjacent to the display screen of the first display unit, and a tablet unit that outputs data of coordinate positions according to the operation position by the operator In a display system comprising
Conversion processing means for executing a first process of converting an operation position on the tablet unit of the operator to a coordinate position on the display screen of the first display unit corresponding to the operation position;
When the conversion processing unit determines that the operation position of the operation element satisfies a first position condition in a predetermined region on the tablet unit, the conversion processing unit determines the operation position of the operation element on the tablet unit as the operation position. And starting the execution of the second process of converting to the coordinate position on the display screen of the second display unit corresponding to . The conversion processing means determines that the operation position of the operation element is in a predetermined area on the tablet unit when the operation element is positioned in an edge region of the tablet unit. Display system described. After the operation position of the operation element satisfies the second position condition in a predetermined region on the tablet unit, the conversion processing unit is on the tablet unit of the operation element until the first position condition is satisfied. The operation position is sequentially moved from the coordinate position on the display screen of the first display unit corresponding to the operation position toward the coordinate position on the display screen of the second display unit corresponding to the operation position. The display system according to claim 1, wherein a third process of converting to a position is executed. The conversion processing means determines that the first position condition is satisfied when the operation position of the operator is stationary for a first period in a predetermined region on the tablet unit. The display system according to any one of 1 to 3. After the operation position of the operation element satisfies the second position condition in the predetermined area on the tablet unit, the conversion processing means determines that the operation position of the operation element is between the time when the operation position of the operation element is satisfied. The display system according to claim 3, wherein when the first position condition is not satisfied, the execution of the third process is stopped and the execution of the first process is started. The conversion processing unit determines that the second position condition is satisfied when the operation position of the operation element is stationary for a second period shorter than the first period in a predetermined region on the tablet unit. The display system according to claim 3. When the conversion processing unit determines that the operation position of the operation element satisfies a third position condition in a predetermined region on the tablet unit in a state in which the second process is executed, the second process is performed. The display system according to claim 1, wherein execution of the process is stopped and execution of the first process is started. The conversion processing means is configured to execute the second process when the operation position of the operation element is stationary in the predetermined area on the tablet unit during the first period. The display system according to claim 7, wherein it is determined that the position condition is satisfied. When the coordinate size of the operation position coordinates of the tablet unit is different from the screen size of the display screen of the first display unit or the second display unit, the conversion processing means converts the coordinate size of the display screen to a different display screen. The display system according to claim 1, wherein correction according to the size difference is sometimes performed. A first display unit that displays an image on the display screen, a second display unit that has a display screen adjacent to the display screen of the first display unit, and a tablet unit that outputs data of coordinate positions according to the operation position by the operator A display system program comprising:
On the computer,
A first process of converting an operation position on the tablet unit of the operator to a coordinate position on the display screen of the first display unit corresponding to the operation position;
When it is determined that the operation position of the operation element satisfies a first position condition in a predetermined region on the tablet unit, the operation position of the operation element on the tablet unit is set to the second corresponding to the operation position. A second process for converting to a coordinate position on the display screen of the display unit;
A program for a display system, characterized in that