JP2003069767A - Display system and display program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To fetch display contents desired to display without missing information and to display the contents on another display screen while maintaining presence without depending on the application to be used. SOLUTION: A display system 100 is provided with a software processing part 1403 for processing various kinds of software on the basis of coordinate information outputted by a coordinate information output part 1401, a plurality of display parts 1402 for displaying the executed result of the software processing part 1403, a capture instruction input part 1404 for inputting the capture instruction of display contents, an erasure complementing part 1405 for complementing the background by erasing the display part of software to capture, a capturing part 1406 for capturing the display contents complemented by the erasure complementing part 1405, and a capture content output part for outputting the display contents captured by the capture part 1406 to a display part 1409.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a display system and a display program, and more particularly to a display system and a display program using a plurality of display devices.

[0002]

2. Description of the Related Art Conventionally, Windows 98, Windows
ws2000 (all are Microsoft Corpo
It is possible to easily set a PC (Personal Computer) into a multi-monitor environment at an OS level such as a registered trademark of “Ration” and a MAC OS (registered trademark of Apple Computer, Inc.). That is, a plurality of display devices (CRT (Cahod) can be installed on one PC.
e Ray Tube) and LCD (Liquid Cr)
ystal Display), PDP (Plasma)
By connecting a display panel, a projector, or the like), it is possible to form one screen and expand the display area of various applications or software. Due to the multi-monitor environment, each application can be moved between display devices, and windows can be operated across the display devices.

Further, in recent years, a display-integrated coordinate input device in which an operation surface and a display surface are integrated is being used in lectures and lectures. The display-integrated coordinate input device is used by connecting to a PC or has a built-in PC, and touches the display surface with a finger or an input pen instead of a mouse to display the processing results of various software again. It is a device that displays on the surface. By using the display-integrated coordinate input device, for example, a presentation can be smoothly performed with a high sense of realism.

In particular, at an educational site, the weight (is it easy to move) and the display area (is the size easy to touch)?
From the viewpoint of depth and depth (whether the installation location is limited), a display-integrated coordinate input device using a display device having a diagonal of about 70 inches to 100 inches is used. on the other hand,
In the field of education, there is a need to increase the screen area, in other words, there is a need to increase the amount of information to be displayed without making characters and the like smaller. Therefore, a multi-monitor environment is constructed by combining a plurality of display-integrated coordinate input devices, and has been used as a system that is highly convenient not only for speakers but also for students.

[0005]

However, the conventional techniques have the following problems. That is, the conventional multi-monitor environment is an extension of the original single monitor, and only the display is enlarged, and the convenience is not necessarily guaranteed to be improved.
Especially when using a multi-monitor environment in educational settings, important display contents such as lectures and lectures (small summary of each chapter,
There is a need to separately display important statistical data, the process of deriving mathematical formulas, etc.) each time. For example,
If there are two display screens, you want to continue the lecture using the first display screen and display the contents separately on the second display screen after the important display contents have been explained. There is a need to.

However, when the application side is requested to have such a function, the demand is low, but the development man-hour is usually enormous. Therefore, there are virtually no applications that have functions such as displaying different pages between display devices, and there is a problem in that the scope of application selection is extremely narrow.

Further, even if each application alone is compatible with a multi-monitor environment, there are the following problems in a lecture / lecture using a display-integrated coordinate input device. That is, the display-integrated coordinate input device has a handwriting input function using so-called electronic blackboard software.
The handwriting input function is a function in which a locus traced on the display surface is directly displayed on the display surface. In order to emphasize important points at educational sites and various presentations,
In order to reflect the students' questions, in addition to the displayed contents, handwritten characters and diagrams are often overwritten.

However, in such a case, even if the application is capable of displaying the contents of the first display surface on the second display surface, since the individual applications are independent, the second display surface is not displayed. , Only display contents without handwritten characters / diagrams or display contents with only handwritten characters / diagrams are displayed. Therefore, there is a problem in that the sense of presence is impaired and the display content becomes incomplete.

On the other hand, it is also possible to consider a method in which all the display contents on the first display surface are selected or an image on the display surface is captured and displayed on the second display surface. However, in such a method, it is indispensable to operate a plurality of applications, and it takes time to start and operate the applications, which impairs the sense of presence. In addition, there is a problem that an error may occur due to lack of memory when using a plurality of applications. In addition, when importing or displaying, the windows of the application required for processing will be imported or displayed, so unnecessary information (for example, the window frame in which the toolbar is displayed) may be displayed or blocked by windows. There is also a problem that necessary information that should be originally displayed is hidden.

The present invention has been made in view of the above, and an object of the present invention is not to depend on an application to be used, but to take in a display content desired to be displayed without any information, and display it on another display surface while maintaining a sense of reality. And

[0011]

In order to achieve the above object, a display system according to claim 1 is a display system having a display-integrated coordinate input device, a display device, and a control device. The display-integrated coordinate input device outputs, to the control device, a display surface for displaying execution results of various software output by the software processing means, and information regarding coordinates input to the display surface. Coordinate information output means, and the control device inputs software processing means for executing processing of various software based on the coordinate information output by the coordinate information output means, and a capture instruction of the display content of the display surface. The capture instruction input means and the capture displayed on the display surface when a capture instruction is given by the capture instruction input means. Erase completion means for erasing the display portion of the software that performs processing and complementing the background, capture means for capturing the display content of the display surface after the completion by the erase completion means, and the display content captured by the capture means. Capture content output means for outputting to the display device, and the display device includes display means for displaying the display content output by the capture content output means.

That is, according to the first aspect of the invention, the display of the software that performs the capture process is erased, and then the screen is captured.

The display system according to claim 2 is
The display system according to claim 1, wherein the display device is a display-integrated coordinate input device, and the control device is
When an instruction to capture the display content of the display surface of one display-integrated coordinate input device is input, control is performed to display the display content according to the capture instruction on the display surface of another display-integrated coordinate input device. Is characterized by.

That is, the invention according to claim 2 improves the degree of freedom in selection of the screen to be used by the speaker and enables the construction of an efficient display system.

The display system according to claim 3 is
The display system according to claim 2, wherein the control device includes display surface coupling means for processing the plurality of display surfaces as one display surface.

That is, in the invention according to claim 3, the execution result of the software processing means can be displayed on another display surface, and the display screen can be increased in a superimposed manner.

The display system according to claim 4 is
The display system according to claim 2 or 3, wherein the control device includes output destination instruction input means for inputting an instruction as to which display surface the output destination of the capture content output means is. The means outputs the display content captured by the capture means on a display surface according to the instruction input by the output destination instruction input means.

That is, the invention according to claim 4 can display the display content desired to be displayed on a desired screen, and improves the convenience particularly when there are three or more display surfaces.

The display system according to claim 5 is
The display system according to claim 2, 3 or 4,
The control device inputs an erase destination instruction input means for inputting an instruction as to which display surface of the display surface on which the display content is displayed to be erased, and an instruction by the erase destination instruction input means. Of the displayed contents on the displayed surface,
Captured content erasing complementing means for erasing the display content displayed by the display means and complementing the background.

That is, the invention according to claim 5 erases the pasted capture screen.

A display program according to a sixth aspect of the present invention outputs, to the control device, a display surface for displaying execution results of various software by a computer and information about coordinates input to the display surface. A display program applied to a display system configured by a plurality of display-integrated coordinate input devices, comprising coordinate information output means, wherein the various types of information are output to the computer based on the coordinate information output by the coordinate information output means. When there is a software processing procedure for executing software processing, a capture instruction input procedure for inputting a capture instruction of a display content of one of the plurality of display surfaces, and a capture instruction by the capture instruction input procedure. And a display unit of software related to the capture process displayed on the one display surface. Erase completion procedure for erasing and complementing the background, a capture procedure for capturing the display content of the one display surface after completion by the erase completion procedure, and an output destination of the display content captured by the capture procedure. To execute an output destination instruction procedure for inputting an instruction as to whether to use the display surface and a capture content output procedure for outputting the display content captured by the capture procedure to the display surface instructed by the output destination instruction procedure. Is characterized by.

That is, the invention according to claim 6 erases the display of the software that performs the capture process, and then captures the screen.

[0023]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described in detail below with reference to the drawings. In this embodiment, 2
A display system having one display-integrated coordinate input device and a control device (PC) will be mainly described. First, an overview of the display system will be outlined, and then a display-integrated coordinate input device and a control device will be described in this order.

(Schematic Configuration of Display System 100) FIG.
FIG. 3 is an external configuration diagram of the display system of the present embodiment.
The display system 100 includes a display-integrated coordinate input device 101.
A display-integrated coordinate input device 102 and a control device 103
Have and. Here, a usage mode in which the speaker P gives a lecture using the display-integrated coordinate input device 101 and causes the display-integrated coordinate input device 102 to display the display content as necessary will be described. It should be noted that in the lecture, the lecture material is displayed by a predetermined display software (for example, presentation software), and necessary writing is appropriately performed by the handwriting input function of the electronic blackboard software. However, these two software are assumed to be separate and independent software.

(Contents of Display-Integrated Coordinate Input Device 101)
Next, the contents of the display-integrated coordinate input device 101 will be described. Since the display-integrated coordinate input device 102 has the same configuration as the display-integrated coordinate input device 101, its description is omitted. Hereinafter, the display-integrated coordinate input device will be simply referred to as a coordinate input device for convenience.

FIG. 2 is a schematic configuration diagram showing an example of the configuration of the coordinate input device 101. The coordinate input device 101 includes a rectangular coordinate input surface 201 for inputting coordinates (position A in the figure) with a finger, an input pen, or the like, and irradiation light that spreads in a fan shape along the coordinate input surface 201. An optical unit 202 that receives reflected light traveling along 201 (the left optical unit is 202L and the right optical unit is 202R), and a coordinate input surface 20
A reflection portion 203 which is arranged at the outer edge of 1 and recursively reflects the irradiation light emitted by the optical unit 202 in the incident direction;
Have.

The coordinate input device 101 includes a coordinate input surface 201.
The coordinate point is detected based on the blocking direction of the finger or the input pen and the distance between the optical units 202 input to the optical unit 202. In addition,
The coordinate input surface 201 is also a display surface (or a light surface swept on the immediate upper surface thereof) for displaying the execution results of various software, but here it is expressed as the coordinate input surface 201 from the viewpoint of a surface for inputting coordinates. I shall. Note that, hereinafter, the coordinate input surface 201 may be appropriately referred to as the display surface 201. In addition, the display surface 201 of the coordinate input device 101
Will be referred to as a monitor 1, and the display surface 201 of the coordinate input device 102 will be referred to as a monitor 2.

Next, each part constituting the coordinate input device 101 will be described in detail. (Coordinate Input Device 101: Contents of Reflector 203) Reflector 2
The surface of 03 is covered with a member that recursively reflects light. An example is a corner cube reflector. FIG. 3 is a diagram showing a corner cube reflector. FIG. 3A is a perspective view. FIG. 3B is a sectional view taken along a straight line passing through the apex and the center of the circle on the bottom surface. The corner cube reflector has a conical shape and its inner surface is vapor-deposited with aluminum to improve the reflection efficiency. As illustrated, the corner cube reflector recursively reflects incident light because the cone angle is 90 degrees.

The corner cube reflector must have an incident angle with respect to the conical surface of less than 45 °, as is apparent from FIG. Therefore, the optical units 202R and 502L may be oriented and installed on the basis of the position where the corner cube reflector is arranged on the reflecting section 203.

Depending on the mode of use, the reflecting portion 20
3 may have a structure in which a powdery diffuse reflection agent is applied.
The optical unit 202 is configured to detect the light blocking direction, and if the light reflected recursively even when the outgoing light is diffusely reflected is detected most strongly, a unit capable of specifying the light blocking direction is constructed. Because you can.

(Coordinate Input Device 101: Contents of Light Emitting Section 401) Next, the light emitting section of the optical unit 202 will be described in detail. FIG. 4 is a schematic configuration diagram showing the internal structure of the light emitting portion of the optical unit 202. Of these, Figure 4 (a)
4B is a view of the light emitting unit viewed from a direction (y-axis direction in the drawing) orthogonal to the traveling direction of the irradiation light in a plane parallel to the coordinate input surface 201, and FIG. FIG. 6 is a view as seen from the traveling direction (from the x-axis direction in the figure).

The light emitting section 401 includes a light emitting element 402 which emits irradiation light, cylindrical lenses 403a to 403c which deflect the irradiation light emitted by the light emitting element 402 in a predetermined direction, and a slit 404. The half mirror 405 is a semi-transmissive mirror that reflects the irradiation light passing through the slit 404 toward the reflecting portion 203. By using the half mirror 405, the light emitting unit 4
01 and the light receiving section 501 described later can be easily configured as one optical unit.

The light emitting element 402 is, for example, a laser diode or a pinpoint LED. The wavelength of the light emitted from the light emitting element 402 is not limited, but a wavelength in the infrared region is preferable. This is because in the far infrared, the optical unit tends to have heat, which causes various distortions of the lens and the like, which makes it difficult to correct the distortion. Also, at wavelengths in the ultraviolet region, energy is high and handling is difficult. In addition, as described above, the coordinate input surface 201
Is also a display surface (screen) for displaying execution results of various applications processed by the control device 103 and the like,
A wavelength other than the wavelength used on this screen, that is, a wavelength other than the wavelength of the light used on the display surface may be used. By using different wavelengths, noise can be reduced and erroneous detection can be prevented.

The irradiation light emitted from the light emitting element 402 is narrowed down by the cylindrical lens 403a and becomes light parallel to the z axis (see FIG. 4A). Subsequently, the irradiation light passes through the two cylindrical lenses 403b and 403c, is narrowed down in the y-axis direction, and is condensed at the position of the slit 404 (see FIG. 4B). That is, by using the cylindrical lenses 403a to 403c, the light emitted from the light emitting element 402 can be converged / diffused in a predetermined direction, and a combination thereof can be adjusted to a desired shape.

The slit 404 is an elongated slit parallel to the x-axis, and the irradiation light passes through the slit 404 and spreads in a fan shape in the y-axis direction. By passing the irradiation light through the slit 404, so-called noise such as various diffractions in the light emitting section 401 is reduced, and the uniformity of the irradiation light is improved. In other words, it can be said that the slit 404 forms a linear light source that enhances the uniformity of irradiation light.

(Coordinate Input Device 101: Contents of Light-Receiving Section 501) Next, the light-receiving section of the optical unit 202 will be described. FIG. 5 is a schematic configuration diagram showing the internal structure of the light receiving portion of the optical unit 202 from a direction perpendicular to the coordinate input surface 201. Here, for simplification, detection of reflected light in a two-dimensional plane parallel to the coordinate input surface 201 will be described.
The light receiving unit 501 includes a light receiving lens 502 that collects the reflected light reflected by the reflecting unit 203, and a line sensor 504 including a plurality of light receiving elements 503 that detect the light receiving intensity of a photosensor or the like. In the figure, the light emitting element 4
02 and a half mirror 405 that transmits reflected light are also shown. Since the light emitting element 402 is located above the half mirror 405 (the position of z> 0 in the coordinate system shown in the figure), it is indicated by a dot here.

The reflecting portion 203 is illuminated by the light emitting element 402.
The reflected light that has been reflected by, and has returned along the same path is condensed by the light receiving lens 502 and reaches different positions on the line sensor 504. Therefore, the coordinate input surface 2
When a finger or an input pen is inserted at a position A on 01 and the irradiation light is blocked, the line sensor 504 corresponding to that direction
The reflected light does not reach the upper point. When there is no light shield on the coordinate input surface 201, the received light intensity distribution on the line sensor 504 is substantially constant at the central portion symmetrical with respect to the optical axis of the light receiving lens 502. However, as shown in the figure, the coordinate input surface 2
When a finger that blocks light is inserted at position A on 01, the light passing therethrough is blocked, and at position D on line sensor 504.
At, a region where the received light intensity is weak (dark spot) occurs.

This position D has a one-to-one correspondence with the angle of the blocked light, that is, the detection angle θd measured from the optical axis of the position A, and if the position D of the dark spot on the line sensor 504 is known. It is possible to know θd. When the distance from the light receiving lens 502 to the line sensor 504 is f, θd is given by the equation (1) as a function of D. θd = arctan (D / f) (1)

Strictly speaking, tan (θd) = D / f does not hold due to the refraction of light by the light receiving lens 502, but the relationship between θd and D / f is uniquely determined. It is treated as if equation (1) holds.

FIG. 6 is an explanatory diagram for calculating the position of the coordinate point from the direction of the coordinate point detected by the optical unit 202 and the distance between the optical units 202. As shown in the figure, w
Is the distance between the optical units 202, θcR is the angle measured from the line connecting the optical units of the coordinates A detected by the right optical unit 202R (hereinafter referred to as the calculated angle), and θcL is the left optical unit 202L. The calculated angles detected by are respectively shown. Although the detailed calculation process is omitted, the coordinate A (x, y) is given by the equation (2). x = w · tan θcR / (tan θcL + tan θcR) y = w · tan θcL · tan θcR / (tan θcL + tan θcR) (2)

Therefore, if the position of the dark spot on the line sensor 504 is known, the detected angle θd can be known, and based on the detected angle θd, the calculated angle θ corresponding to this is one-to-one.
c can be calculated, and the coordinates input to the coordinate input surface 201 can be calculated by the equation (2). Although this calculation is performed by the control device 103 described later, the coordinate calculation may be performed by the coordinate input device 101 depending on the mode of use.

Next, the light receiving element 503 and the line sensor 50
The relationship with 4 will be described. As shown in FIG. 5, the line sensor 504 includes a plurality of light receiving elements 503, and each light receiving element 503 detects the intensity of light condensed by the light receiving lens 502. The light receiving element 503 is composed of, for example, a photodiode and generates a current according to the amount of light. Although light is efficiently collected by the light-receiving lens 502, light passing around the lens is affected by peripheral dimming and is generally dark. Therefore, it is desirable to set the detection threshold of each light receiving element 503 in order to improve the detection efficiency in the shielding direction.

The coordinate input device 101 described above is a type having an optical unit for irradiating light in a fan shape,
The present invention is not limited to this, and may have another configuration. FIG. 7 is a diagram showing an example of another configuration of the coordinate input unit. The coordinate input device 700 includes a coordinate input surface 201.
A plurality of light emitting elements 701 are provided on the right side and the upper side, and a plurality of light receiving elements 702 are provided on the left side and the lower side corresponding to each light emitting element 701. The light emitting element 701 is a light source that emits beam-like light that is difficult to diffuse, such as laser light. The light emitted from such a light emitting element 701 is received by one light receiving element 702 facing the light emitting element 701, whereby it is possible to easily grasp the input coordinate position and its movement.

In addition, a flat display type coordinate input device (coordinate input device 801) that projects the display content from the lower part of the screen and reflects it by a mirror to project an image from the back side of the display surface can be adopted. FIG. 8 is an explanatory diagram showing an external configuration of a flat display type coordinate input device. In FIG. 8, the optical unit 202
The reflection portion 203 is covered with the outer frame 802.

FIG. 9 is a sectional view of the coordinate input device 801 shown in FIG. As illustrated, the coordinate input device 801 projects the display content toward the mirror 904 by the light source 901, the liquid crystal panel 902, and the lens 903, and the enlarged display on the display surface 201 via the Fresnel lens 905. Project the contents. With such a configuration, the depth Dep can be shortened. As shown in the figure, it is preferable that the display surface 201 is made of a panel material that transmits as much light as possible if an image is illuminated from the back side. Further, it is desirable that the display surface 201 adopts a wide diffusion type imaging screen. The wide diffusion allows a wide viewing angle (160 °) to be secured, which makes it easy for the student to see the screen.

Besides, a touch panel type coordinate input device can also be used. Detailed explanation is omitted,
The pressed point can be detected by the change in the potential difference between the upper electrode sheet and the lower electrode sheet.

(Contents of Control Device 103) Next, the control device 103 will be described. FIG. 10 shows the control device 103.
3 is an explanatory diagram showing an example of the hardware configuration of FIG. As illustrated, the control device 103 is a general-purpose PC (Pers).
It is possible to adopt the same configuration as that of the (onal computer). The control device 103 includes a CPU 1001 and
ROM 1002, RAM 1003, hard disk 1005, graphics cards 1006 and 10
08 and coordinate input interface (I / F) 1007
And 1009, the timer 1010, and the keyboard 10
11 and a mouse 1012.

The CPU 1001 controls the entire display system 100 together with the OS described later, and also controls the processing of various software. Specifically, for example,
The CPU 1001 includes a hard disk 1005 and a ROM 1
According to the program stored in 002, based on the coordinate information input from the coordinate input I / F 1007 (1009), the processing of the function set at the position of the coordinate is executed. Further, the CPU 1001 uses a VRAM (image RAM) 1061 of the graphics card 1006.
Work data such as drawing control to the RAM 1 or reading data stored in the hard disk 1005 to the RAM 1
Control such as temporary storage in 003 is also performed.

The ROM 1002 stores a boot program and the like. Depending on the mode of use, the ROM 1002
A program for controlling the coordinate input device 101 (102) may be stored. RAM 1003 is the CPU 10
Used as a work area of 01. Specifically, various programs read from the hard disk 1005 are temporarily stored. In addition, the RAM 1003 is also used to temporarily store the coordinate information received by the coordinate input I / F 1007 and the coordinate input I / F 1009 and determine the relative coordinate position on the two display surfaces.

The hard disk 1005 stores various software programs (software) such as an operating system (OS), application programs, and drivers. The stored contents of the software on the hard disk 1005 will be described later.

Graphics card 1006 (100
8) sends an image signal to be output to the coordinate input device 101 (102). Graphics card 1006
VRAM 1061 (10 for storing image signals to be output)
81) and an image output I / F 1062 (1082) for outputting the processed image signal to the coordinate input device 101. As the operation, the image output I / F 1062 (108
2) outputs the RGB image data expanded in the VRAM 1061 (1081) to the coordinate input device 101.

A plurality of image output I / Fs may be provided on one graphics card. Although not shown, the graphics card 1006 (100
8) also has a graphics chip for processing the image signal to be output.

The coordinate input I / F 1007 (1009) is
Control for inputting the coordinate information input to the display surface 201 of the coordinate input device 101 (102) is performed. The coordinate input I / F 1007 (1009) is, for example, RS232.
A mode in which the coordinate input device 101 (102) is connected by C, USB or the like can be adopted. The coordinate input I
/ F1007 (1009) based on the coordinate information input from the CPU 1001 and the hard disk 1005
Various processes are executed through the OS and the corresponding application.

The timer 1010 periodically measures time and notifies the CPU 1001 of time-related information. By using the timer, it is possible to control the coordinate information from the coordinate input device 101 (102) and determine whether the coordinate input is a single click, a double click, or a drag. Also, the keyboard 10
Reference numeral 11 is for inputting characters, numerical values, various instructions, etc. when performing an operation from the control device 103 side. The mouse 1012 moves the cursor, selects a range, and the like when it is operated from the control device 103 side.
Although not shown, the control device 103 may be equipped with a floppy (registered trademark) disk drive device, a CD-ROM drive device, an MO drive device, or the like.

(Control device 103: hard disk 100
5 contents) Hard disk 1005 is OS1051
An electronic blackboard software 1052 that causes the coordinate input device 101 (102) to function as an electronic blackboard, a multi-monitor software 1053 that displays the display content from one coordinate input device on the display surface of the other coordinate input device, and a lecture lecture Various display software 1054 such as presentation software for displaying contents, word processing software, spreadsheet software, etc. are stored.

The OS 1051 is equipped with a multi-monitor control unit 1055 for constructing a multi-monitor environment. FIG. 11 is an explanatory diagram showing an example of coordinate setting of virtual coordinates in a multi-monitor environment. Here, for convenience of explanation, the virtually combined screen is referred to as a combined screen, and the area of the combined screen is (0, 0) to (65535, 65535).
Shall be managed in the virtual coordinate space of. In addition, a plurality of display surfaces 201 are displayed as monitor 1, monitor 2, ..., And each display surface 201 is 1024 × 76.
It is assumed that screen display of 8 pixels is possible.

FIG. 11A shows how the coordinates in the virtual coordinate space are taken. Note that FIG. 11A can be considered to show the correspondence between the display surface and the virtual coordinate position when the number of the display surface 201 is one. FIG. 11 (b)
[Fig. 6] is a diagram showing a correspondence between display surfaces and virtual coordinates when two display surfaces are arranged in the x-axis direction (horizontal direction). As shown, the virtual coordinate space is divided into two in the x-axis direction,
(0,0) to (32767,65535) and (3276
It is managed in two coordinate spaces of (8, 0) to (65535, 65535).

FIG. 12 is an explanatory diagram showing the correspondence between the number of pixels of the display device and the coordinate space. FIG. 12A shows the display surface 2
3 shows the correspondence between the coordinates of pixels on each display surface when three 01s (monitor 1, monitor 2, monitor 3) are arranged in the horizontal direction and the virtual coordinate space of the combined screen. As shown, (0,0) to (1023,767) of each monitor
The pixels have (0, 0) to (21844, 6553), respectively.
5), (21845, 0) to (43689, 6553)
5), (43690, 0) to (65535, 6553)
The virtual coordinate space of 5) is assigned. The display surface 2
01 may be connected and set not only in the horizontal expansion mode but also in the vertical expansion mode. 12
(B) shows an example in which the display surface 201 is arranged in 3 rows and 3 columns. In this case, the virtual coordinate space is managed by dividing it into 3 × 3 = 9.

FIG. 13 is an explanatory diagram for explaining coordinate conversion control between the display surface 201 and the virtual coordinate space. First, the coordinate input device 101 (102) outputs coordinate information, and this coordinate information is the coordinate input I / F 1007.
It is stored in the RAM 1003 via (1009). The multi-monitor control unit 1055 uses the coordinate information stored in the RAM 1003 based on the coordinate information stored in the RAM 1003.
Calculates a virtual coordinate space corresponding to the mouse I / F130
Pass that value to 1. The mouse I / F 1301 outputs coordinate information without distinguishing it from information from the mouse 1012 connected to the control device 103, and various applications perform corresponding processing based on the converted coordinate information without conflict. To execute.

The above description is an example of control.
If absolute coordinates (0, 0) to (1023, 767) detected by the coordinate input device 101 (102) are converted into corresponding virtual coordinates to emulate the same coordinates as the mouse coordinate input, that mode It doesn't matter. By controlling in this way, 2
It is possible to easily identify left clicks, right clicks, double clicks, drags, etc. without causing a malfunction such as inputting one coordinate, and to execute the corresponding application function. Note that specific processing contents of software other than the multi-monitor control unit 1055 will be described later together with the display contents on the display surface 201 and the functional block diagram.

As described above, the display system 100 outputs the coordinate information from the coordinate input device 101 (102) and the control device 103 calculates the relative position. However, the present invention is not limited to this. The position may be calculated by the device 101 or the coordinate input device 102, and then the control device 103 may perform control to convert the position into a relative coordinate position. Further, the configuration of the control device 103 may be provided in the coordinate input device.

Although FIG. 10 shows an example in which the control device 103 connects two display-integrated coordinate input devices, a graphics card and a coordinate input I / F are added to the control device 103 as necessary. As a result, a display-integrated coordinate input device can be further connected. It should be noted that if a display device such as a projector centering on display is connected without inputting coordinates, it is not necessary to add a coordinate input I / F. Even in this case, the application window displayed by the projector or the like can be operated via the mouse 1012. An example of the configuration of the display system using the projector will be described later.

(Functional Configuration of Display System 100) Next, the functional configuration of the display system 100 will be described. FIG. 14 is a functional block diagram showing an example of the main functional configuration of the display system 100. Display system 1
00 is, as its functional configuration, the coordinate information output unit 140.
1, a display unit 1402, and a software processing unit 1403
A capture instruction input unit 1404 and an erasure complement unit 14
05, a capture unit 1406, and an output destination instruction unit 140
7, a capture content output unit 1408, and a display unit 140
9, an erase destination instructing unit 1410, and a captured content erase complementing unit 1411.

(Functional Configuration of Display System 100: Coordinate Information Output Unit 1401) The coordinate information output unit 1401 outputs information regarding the coordinates input to the display-integrated coordinate input device 101 to the software processing unit 1403. The information regarding the coordinates is information for calculating the coordinate position on the combined screen, for example, the angles θR and θL detected by the optical unit 202, and the information indicating which coordinate input device the display surface 201 is. Number. Depending on the mode of use, the history regarding the detection time or the coordinates input immediately before may be included.

It should be noted that by also outputting the coordinates input immediately before, it is determined whether the operation related to the input of the coordinates is a single click, a double click, a drag or a right click. It becomes possible to do. The coordinate information output unit 1401 uses, for example, the display surface 201.
The function can be realized by the optical unit 202. Note that the coordinate output of the coordinate input device 101 (102) does not necessarily have to be performed by wire, and may be wirelessly (for example, infrared) communicated with the control device 103. In this case, the coordinate information output unit 1401 realizes its function by the control unit that performs wireless communication.

(Functional Configuration of Display System: Software Processing Unit 1403) The software processing unit 1403 executes various software processes corresponding to the position calculated based on the coordinate information output from the coordinate information output unit 1401. To do. The type of software is not particularly limited, but when giving a lecture / lecture, presentation software, word processing software, spreadsheet software, drawing software, viewer and the like can be mentioned. Note that the term software includes an OS and various drivers. Although each functional unit described later also includes one that is processed as software, the software processing unit 1403 here indicates software or a set of software for displaying the captured display content. The software processing unit 1403 is, for example, a CPU 1001, various software stored in the hard disk 1005, and a RAM.
The function can be realized by 1003.

(Functional Configuration of Display System 100: Display Unit 1402, Display Unit 1409) The display unit 1402 displays the execution results of various software by the software processing unit 1403. The display unit 1409, as described later,
The display content output by the capture content output unit 1408, that is, the display content captured by the capture unit 1406 is displayed. Display unit 1402 and display unit 1
409 is functionally the same, but is described here as a separate functional unit in order to distinguish the capture source and the output destination. The display unit 1409 has an output destination instruction unit 1407.
It can also be said to be a display section instructed by. Display 1
The function of 402 (1409) can be realized by the display surface 201.

(Functional Configuration of Display System 100: Capture Instruction Input Unit 1404) Capture Instruction Input Unit 14
04 inputs a capture instruction of the display content of any one of the plurality of display surfaces 201. That is, it specifies which monitor screen to capture.
Although the plurality of display surfaces 201 may be three or more, the number of display surfaces is two in the present embodiment. Although various modes of inputting the capture instruction can be considered, here, a case where a “multi-page toolbar” is displayed on one display surface 201 by the multi-monitor software 1053 and the capture instruction is issued from this toolbar will be described.

FIG. 15 is a diagram showing an example of a window structure on the display surface by the multi-monitor software 1053. As shown, the multi-monitor software 1053
A multi-page toolbar 1501 is displayed on the display surface 201. A capture button 1502 and a display destination instruction button 1503 are displayed on the multi-page toolbar 1501.
And a deletion destination instruction button 1504 are displayed, and the multi-monitor software 1053 causes the control device 103 to execute the functions assigned to these buttons.

Here, each function will be described. The capture button 1502 is a multi-page toolbar 150.
1 is displayed on the display surface 201 (coordinate input device 101
The display contents of the display screen, that is, the display contents of the monitor 1) shown in the figure are captured. The display destination instruction button 1503 indicates a monitor number to which the captured display content (screen) is pasted. An erase destination instruction button 1504 indicates a monitor number that erases the pasted screen and redraws the original background content.

The capture instruction input unit 1404 uses the input of the coordinates of the area portion in which the capture button 1502 is displayed as a capture instruction, and the erase complement unit 1 described later.
Output to 405. The capture instruction input unit 1404 is
For example, the optical unit 202, display surface 201, coordinate input I / F 1007, multi-monitor software 1053, CP
The function can be realized by U1001 or the like.

Depending on the mode of use, the capture button 1502 may be omitted and the function may be assigned to the display destination instruction button 1503. As a result, the display content of the monitor 1 can be displayed on the monitor 2 with a single operation. The capture instruction input unit 1404 may also input an instruction using a remote controller. During the presentation, the speaker is not always in the vicinity of the display system 100 and may move to a remote place. Lectures and lectures can be given without impairing the sense of presence by inputting capture instructions using the remote control.

(Functional Configuration of Display System 100: Erase Complement Unit 1405) When the capture instruction input unit 1404 receives a capture instruction, the erase complement unit 1405 stores the software related to the capture process displayed on the display surface. The display area is erased and the background is complemented. Figure 1
In the example shown in FIG. 5, since the multi-page toolbar 1501 which is the display portion of the software (multi-monitor software 1053) related to the capture process is displayed on the monitor 1, the erasure complementing unit 1405 erases the multi-page toolbar 1501. And complement the part that should be displayed in the background.

The part displayed on the background is the part drawn when the window is closed. For example, when word processing software is activated, it means a document screen or the like. The display system 100 can display the information portion to be displayed without excess or deficiency by the deletion complement of the deletion complement unit 1405. The erasure complement unit 1405, for example, multi-monitor software 1053, OS1051, C
The function can be realized by the PU 1001 and the display surface 201.

(Functional Configuration of Display System 100: Capture Unit 1406) The capture unit 1406 captures the display content of the display surface 201 after the erasure complementing unit 1405 complements it. The display surface 201 is the display surface 201 on which the multi-page toolbar 1501 was displayed.
(Monitor 1) is shown. The capture or the capture process is a process in which the display screen on the display surface 201 is directly captured as an image. The captured image data is stored in the RAM 1003 for later paste processing.

In the present embodiment, the capture unit 1
Reference numeral 406 denotes a full screen capture, but depending on the mode of use, the display software 1054 or the electronic blackboard software 1052 may be used.
In conjunction with the above, partial capture may be performed in which only the content portion (a portion not including the operation toolbar of the display software 1054) is displayed. Further, in the case of partial capture, a mode in which an area is designated may be used. The capture unit 1406 includes, for example, multi-monitor software 1053, OS 1051, CPU 1001, RA
The function can be realized by M.

(Functional Configuration of Display System 100: Output Destination Instructing Unit 1407) The output destination instructing unit 1407 inputs an instruction as to which display surface the output destination of the display content captured by the capturing unit 1406 is. . That is,
The output destination instruction unit 1407 inputs an instruction of any one display surface 201 other than the captured display surface. In the example shown in FIG. 15, it means the monitor 2. There are various possible methods for inputting this instruction, but here, the case where an instruction is given from the multi-page toolbar will be described.

As shown in FIG. 15, the instruction is given by inputting the coordinates of the area portion in which the display destination instruction button 1503 is displayed. The output destination instruction unit 1407 is, for example, the optical unit 202, the display surface 201, the coordinate input I / F 1007, the multi-monitor software 1053, the CPU.
The function can be realized by 1001 or the like. Depending on the mode of use, the instruction may be input using the remote controller as described above.

(Functional Configuration of Display System 100: Capture Content Output Unit 1408) Capture Content Output Unit 14
08 outputs the display content captured by the capture unit 1406 to the display surface instructed by the output destination instruction unit 1407. In the example shown in FIG. 11B, the capture content output unit 1408 is the display content of the monitor 1,
(0,0) to (32767,65535) on the combined screen
The captured contents of the part corresponded to the monitor 2 (0, 3
2768) to (65535, 65535).
The capture content output unit 1408 includes, for example, the multi-monitor software 1053 and the multi-monitor control unit 1055.
CPU 1001 and graphics card 1006
Can realize that function.

(Functional Configuration of Display System 100: Erase Destination Instructing Unit 1410) The erase destination instructing unit 1410 is the display unit 1.
An input is made as to which display surface of the display surfaces the display content of which is to be displayed is deleted by 409. When there are three or more display surfaces 201 and the capture screen is displayed on two or more display surfaces 201, the deletion destination instructing unit 1410 is provided to erase the display destination desired by the speaker. It becomes possible. There are various possible methods for inputting an instruction, but here, a case where an instruction is given from the multi-page toolbar will be described.

As shown in FIG. 15, the instruction is given by inputting the coordinates of the area portion in which the erase destination instruction button 1504 is displayed. The erase destination instructing unit 1410 is, for example, the optical unit 202, the display surface 201, the coordinate input I / F 1007, the multi-monitor software 1053, the CPU.
The function can be realized by 1001 or the like. Depending on the mode of use, the instruction may be input using the remote controller as described above.

(Functional Configuration of Display System 100: Capture Content Elimination Complementing Section 1411) The capture content erasing complementing section 1411 includes the capture content output section 1408 of the display content of the display surface designated by the erase destination instruction inputting section 1410. The display contents displayed by are erased and the background is complemented. In the normal usage mode, the image captured in full screen is pasted on the top surface in full screen, but if it is partially captured or not pasted in full screen (reduced smaller than the display surface 201 and pasted If it is specified), only the relevant part is erased and the background is complemented. The capture content deletion complementing unit 1411 is, for example, the multi-monitor software 1053, the OS 1051, the CPU 100.
1. The function can be realized by the display surface 201.

(Processing Flow of Display System 100) Next, the processing flow of the display system 100 will be described together with the screen transition. Similarly to FIG. 15, an example of this processing flow will be described in which the monitor 1 is captured, its screen is pasted on the monitor 2, and erased. FIG. 16 shows a display system 10.
It is explanatory drawing which showed an example of the processing flow of 0, and is the figure which showed the flow of the process which captures the monitor 1 and pastes the screen on the monitor 2. FIG.

FIG. 17 shows a display system 1 before capture.
It is the figure which showed an example of the screen structure of 00. As shown in the figure, the monitor 1 is a coordinate input device in which a speaker plays a central role in giving a lecture, and the presentation software, which is one of the display software 1054, and the multi-monitor software 105.
A multi-page toolbar 1501 of 3 is displayed. Further, the monitor 2 shows a function form by a viewer which is one of the display software 1054.

FIG. 18 is a diagram showing an example of the screen structure immediately before capture. As shown, in FIG.
In addition to the screen configuration of 7, electronic blackboard software 1052
The handwriting toolbar of is displayed, showing a state immediately after inputting handwritten characters in the content displayed by the presentation software. As shown in the drawing, a pen button 1801 that enables drawing of a handwritten line drawing and an eraser button 1802 that enables deletion of the handwritten line drawing are displayed on the handwriting toolbar. other than this,
The handwriting toolbar 1052 also includes an end button, a redo button, a redo button, a print button, and the like. In addition,
Although illustration is omitted, the electronic blackboard software 1052 is also provided with a graphic drawing function, and it is also possible to input a shaped geometrical figure (line diagram).

The reference numeral 1803 indicates the pen button 180.
The handwriting pen pointer by 1 being selected is shown. FIG. 18 shows a state in which the handwriting diagram (characters) “Constantly consider 5 aberrations” is input, and then the speaker finishes writing the circle surrounded by emphasis.

When the speaker inputs a capture instruction in this state (step S1601: see FIG. 19), the display system 100 causes the monitor 1 to display the multi-page toolbar 1
501 is erased (step S1602) and the background is complemented (step S1603: see FIG. 20). By this erasure complementing process, it is possible to erase the multi-page toolbar 1501 which is not originally necessary and to make the display contents of the monitor 1 to be just enough information.

The display system 100 is followed by the monitor 1
The display content of is captured (step S1604).
The captured content is temporarily stored in the RAM 1003. After capturing, the display system 100 displays the multi-page toolbar 1501 on the monitor 1 again (step S1605). The state of the display contents is the same as in FIG.

When the speaker inputs an instruction of the display destination (monitor 2 in this example) (step S1606: FIG. 2).
1), the display system 100 pastes the screen stored in the RAM 1003 on the designated display destination (the monitor 2 in this example) (step S1607). The state of the screen after pasting is as shown in FIG. If not pasted immediately, the display content of the monitor 1 will be changed depending on how to proceed with the display content. In addition, although the full-screen display is performed at the time of sticking, the necessary enlargement / reduction according to the size of the display surface and the resolution is appropriately performed at this time.

Next, the flow of erasing the pasted capture screen will be described. FIG. 23 is an explanatory diagram showing an example of the processing flow of the display system 100, and is a flowchart showing the processing flow of erasing the image pasted on the monitor 2. When the erase destination instruction is input (step S2301: see FIG. 24), the display system 100
Erases the pasted capture screen (step S2302) and draws and complements the background to be displayed by another application software or the like (step S230).
3: See FIG. 18). Although the example of erasing immediately after pasting is illustrated here, the monitor 1 may be changed depending on the progress of the speaker.
It goes without saying that the display contents of and the background screen of the monitor 2 are changed.

The multi-monitor software 1053 controls the monitor numbers displayed on the multi-page toolbar 1501 to be monitor numbers other than the monitor number on which the multi-page toolbar 1501 is displayed.

As described above, the display system 100
Can easily build multi-screen. In addition, the pasted capture screen is pasted as an image on the foreground until there is some instruction (new capture instruction or erase instruction) by the speaker, especially in lectures and lectures at educational sites. , Speakers can provide highly immersive lecture contents or lecture contents, and listeners can closely follow important points of the lecture contents. Further, even when the conversation progresses, it is possible to grasp both the important captured content pasted and the current display content.

Further, the display system 100 does not depend on the application used for creating the material of the lecture or lecture, and can display the content displayed by combining a plurality of independent applications as it is and display it separately. . As a result, the information of the display content to be displayed can be completely captured and displayed immediately on another display surface, so that a session with a realistic sensation can be constructed. Depending on the mode of use, the multi-monitor software 1053 may be incorporated in the electronic blackboard software 1052, or conversely, the electronic blackboard software 1052 may be incorporated in the multi-monitor software 1053. By doing so, for example, it is possible to capture a screen in the down state even for the handwriting toolbar.

Further, although the display system 100 has two display surfaces 201, the display surface is substantially tripled.
There are two display surfaces 201, and further, by the operation of the speaker,
This is because the capture screen can be pasted and erased.

In the above example, the case where the number of coordinate input devices is two and the number of display surfaces 201 is two has been described. Here, the relationship between the multi-page toolbar and the display surfaces when there are three display surfaces will be described. . FIG. 25 is a diagram for explaining the button selection state on the multi-page toolbar and the transition of the screen which is the selection result when there are three display surfaces. As shown in the figure, although the monitor numbers are up to the monitor 3, the button for displaying the monitor 2 is selected (see FIG. 25A) and the monitor 2 is displayed.
The state where the capture screen of the monitor 1 is displayed is shown in FIG. 25 (see FIG. 25B).

FIG. 26 is a diagram showing another example of screen transition when there are three display surfaces. As shown in the figure, the button for displaying the monitor 3 is selected (see FIG. 26A).
Then, the screen content of the monitor 1 is pasted on the monitor 3 (see FIG. 26B). Further, when the monitor 2 delete button is selected in this state, the pasting screen of the monitor 2 is deleted (see FIG. 26 (c)). If there are three or more monitors, the order of pasting may be determined in advance and the display contents of the monitor 2 → the monitor 3 and the display contents of the monitor 1 → the monitor 2 may be sequentially fed. By such control, the listener can easily grasp the order of past screens (history of screen transition).

The display system 100 does not necessarily need to use the display-integrated coordinate input device. FIG. 27 shows
It is a figure showing an example of composition of a display system using a projector. The display system 2700 includes one display-integrated coordinate input device 101, a screen 2701, and a projector 2702. Although the screen 2701 does not have a coordinate input function, a multi-monitor environment can be easily constructed even with such a display surface configuration. The window displayed on the screen 2701 can be separately operated by the mouse 1012 of the control device 103.

[0098]

As described above, the display system of the present invention (Claim 1) is a display system having a display-integrated coordinate input device, a display device, and a control device.
The display-integrated coordinate input device includes a display surface and coordinate information output means, the display surface displays execution results of various software output by the software processing means, and the coordinate information output means is input to the display surface. The information about the coordinate is output to the control device, and the control device includes software processing means, capture instruction input means, erasure complementing means, capture means, and capture content output means, and the software processing means outputs the coordinate information output means. When various software processes are executed based on the coordinate information obtained, the capture instruction input means inputs a capture instruction of the display content of the display surface, and the erasure complementing means receives a capture instruction by the capture instruction input means. Erase the display part of the software that performs the capture process displayed on the display surface. The capture means captures the display content on the display surface after the completion by the erasing complementation means, and the capture content output means outputs the display content captured by the capture means to the display device, and the display device. Since the display means displays the display content output by the capture content output means, the display of the software that performs the capture process can be erased, and the screen can be captured after that. It becomes possible to display the desired display contents on all other display screens while maintaining the sense of presence without depending on the application to be used.

The display system of the present invention (claim 2)
The display system according to claim 1, wherein the display device is a display-integrated coordinate input device, and the control device inputs a capture instruction of a display content of the display surface of the one display-integrated coordinate input device. In this case, the control is performed to display the display content according to the capture instruction on the display surface of another display-integrated coordinate input device, so that the speaker can improve the degree of freedom in selecting the screen to be used and construct an efficient display system. This makes it possible to display the desired display contents without any information without depending on the application to be used, and to display it on another display surface while maintaining a sense of reality.

A display system of the present invention (claim 3)
According to another aspect of the present invention, in the display system according to claim 2, the control device includes the display surface combining means, and the display surface combining means processes the plurality of display surfaces as one display surface. It is possible to display over the display surface, and the display screen can be increased in a superimposed manner. This makes it possible to capture the display content that you want to display without missing information regardless of the application used and maintain a sense of reality. Meanwhile, it can be displayed on another display surface.

A display system of the present invention (claim 4)
In the display system according to claim 2 or 3,
The control device includes output destination instruction input means, and the output destination instruction input means inputs an instruction as to which display surface the output destination by the capture content output means is, and the capture content output means uses the output destination instruction input means. Since the display content captured by the capture means is output to the display surface according to the input instruction, it is possible to display the display content desired to be displayed on a desired screen, which is particularly convenient when there are three or more display surfaces. Therefore, it is possible to capture the display content desired to be displayed without depending on the application to be used and to display it on another display surface while maintaining a sense of realism, regardless of the application used.

The display system of the present invention (claim 5).
In the display system according to claim 2, 3 or 4, the control device includes an erase destination instruction input means and a capture content erase complement means, and the erase destination instruction input means displays the display content by the display means. Inputting an instruction as to which display surface of the display surface is to be erased, the captured content erasing complementing means is displayed by the displaying means among the display contents of the displaying surface designated by the erasing destination instruction inputting means. Since the displayed content is erased and the background is complemented, the pasted capture screen can be erased, which allows you to capture the displayed content you want to display without depending on the application you are using and maintain a sense of realism. Meanwhile, it can be displayed on another display surface.

The display program of the present invention (claim 6) outputs to the control device a display surface for displaying the execution results of various software by the computer and information about the coordinates input to the display surface. A display program applied to a display system configured by a plurality of display-integrated coordinate input devices including coordinate information output means, and processing of various software on a computer based on the coordinate information output by the coordinate information output means. The software processing procedure for executing, the capture instruction input procedure for inputting the capture instruction of the display content of one of the plurality of display surfaces, and the one display when the capture instruction by the capture instruction input procedure is given. Erase to erase the display part of the software related to the capture process displayed on the surface and complement the background An output that inputs the completion procedure and the capture procedure that captures the display content of one display surface after the completion by the erase completion procedure, and the instruction to select the display surface to which the output content of the display content captured by the capture procedure is set. Since the first instruction procedure and the captured content output procedure that outputs the display content captured by the capture procedure to the display surface instructed by the output destination instruction procedure are executed, the display of the software that performs the capture process is erased, and then It is possible to capture the screen, and thereby, it is possible to capture the display content desired to be displayed without any information irrespective of the application used and to display it on another display surface while maintaining a sense of reality.

[Brief description of drawings]

FIG. 1 is an external configuration diagram of a display system of the present embodiment.

FIG. 2 is a schematic configuration diagram showing an example of a configuration of a coordinate input device.

FIG. 3 is a view showing a corner cube reflector.

FIG. 4 is a schematic configuration diagram showing an internal structure of a light emitting portion of the optical unit.

FIG. 5 is a schematic configuration diagram showing an internal structure of a light receiving portion of the optical unit from a direction perpendicular to a coordinate input surface.

FIG. 6 is an explanatory diagram for calculating the position of a coordinate point from the direction of the coordinate point detected by the optical unit and the distance between the optical units.

FIG. 7 is a diagram showing an example of another configuration of the coordinate input unit.

FIG. 8 is an explanatory diagram showing an external configuration of a flat display type coordinate input device.

9 is a sectional view of the coordinate input device shown in FIG.

FIG. 10 is an explanatory diagram showing an example of a hardware configuration of a control device.

FIG. 11 is an explanatory diagram showing a coordinate setting example of virtual coordinates in a multi-monitor environment.

FIG. 12 is an explanatory diagram showing the correspondence between the number of pixels of the display device and the coordinate space.

FIG. 13 is an explanatory diagram illustrating coordinate conversion control between a display surface and a virtual coordinate space.

FIG. 14 is a functional block diagram showing an example of a main functional configuration of the display system.

FIG. 15 is a diagram showing an example of a window configuration on a display surface by multi-monitor software.

16 is an explanatory diagram showing an example of the processing flow of the display system, and is a diagram showing the flow of processing of capturing the monitor 1 and pasting the screen to the monitor 2. FIG.

FIG. 17 is a diagram showing an example of a screen configuration of a display system before capture.

FIG. 18 is a diagram showing an example of a screen configuration immediately before capture.

FIG. 19 is a schematic configuration diagram of the display surface showing a state where a capture instruction is issued.

FIG. 20 is a schematic configuration diagram of the display surface showing a state in which the background is complemented.

FIG. 21 is a schematic configuration diagram of a display surface showing a state where a display destination is instructed.

FIG. 22 is a schematic configuration diagram of a display surface after pasting a captured screen.

FIG. 23 is an explanatory diagram showing an example of the processing flow of the display system, and is a flowchart showing the flow of processing for deleting the image pasted on the monitor 2.

FIG. 24 is a schematic configuration diagram of the display surface showing a state where an erase destination is designated.

FIG. 25 is a diagram illustrating a state of button selection on a multi-page toolbar and a transition of a screen which is a selection result when there are three display surfaces.

FIG. 26 is a diagram showing another screen transition example when there are three display surfaces.

FIG. 27 is a diagram showing a configuration example of a display system using a projector.

[Explanation of symbols]

100,2700 Display system 101,102 Display integrated coordinate input device (coordinate input device) 700,801 Coordinate input device 103 Control device 201 Display surface, coordinate input surface 202 Optical unit 203 Reflecting section 401 Light emitting section 402 Light emitting element 403a, 403b , 403c Cylindrical lens 404 Slit 405 Half mirror 501 Light receiving unit 502 Light receiving lens 503 Light receiving element 504 Line sensor 701 Light emitting element 702 Light receiving element 901 Light source 902 Liquid crystal panel 903 Lens 904 Mirror Fresnel lens 1001 CPU 1003 RAM 1005 Hard disk 1006 Graphics card 1012 mouse 1051 OS 1052 Electronic blackboard software 1053 Multi monitor software 1054 Display software 1055 Multi monitor control unit 1401 Coordinate information output unit 1402, 1409 Display unit 1403 Software processing unit 1404 Capture instruction input unit 1405 Erase complement unit 1406 Capture unit 1407 Output destination instruction unit 1408 Capture content output unit 1410 Erase destination instruction input unit 1410 Erase destination instruction unit 1411 Capture content erase Complement part 1501 Multi-page toolbar 1502 Capture button 1503 Display destination instruction button 1504 Erase destination instruction button 1801 Pen button 1802 Eraser rubber button 1803 Handwriting pen pointer 2701 Screen 2702 Projector 1007, 1009 Coordinate input I / F 1062 Image output I / F 1301 Mouse I / F

Continued front page    F-term (reference) 5B069 AA01 BA03 BB16 CA02 CA14                       CA15 JA02                 5B087 AA05 AA09 AE02 CC01 CC05                       CC26 DD10 DE03                 5C062 AA07 AB18 AB23 AB38 AC58                       BA04                 5E501 AA02 BA03 CA03 CB02 CB09                       EA14 FA06 FB34

Claims (6)

[Claims] 1. A display system having a display-integrated coordinate input device, a display device, and a control device, wherein the display-integrated coordinate input device displays execution results of various software output by software processing means. A display surface to be displayed; and coordinate information output means for outputting information regarding coordinates input to the display surface to the control device, wherein the control device has the coordinates output by the coordinate information output means. Software processing means for executing processing of various software based on information, capture instruction input means for inputting a capture instruction of the display content of the display surface, and the display surface when the capture instruction by the capture instruction input means is given. Deletion complementing means for erasing the display part of the software for performing the capture processing displayed above and complementing the background A capture unit configured to capture the display content of the display surface after being complemented by the erase completion unit, and a capture content output unit configured to output the display content captured by the capture unit to the display device, A display system, wherein the display device includes display means for displaying the display content output by the capture content output means. 2. The display device is a display-integrated type coordinate input device, and the control device is configured to, in response to an input of a capture instruction of a display content of a display surface of one display-integrated type coordinate input device, 2. The display system according to claim 1, wherein the display system of the display-integrated coordinate input device is controlled to display the display content according to the capture instruction. 3. The display system according to claim 2, wherein the control device includes display surface coupling means for processing the plurality of display surfaces as one display surface. 4. The control device includes output destination instruction input means for inputting an instruction as to which display surface the output destination of the capture content output means is, and the capture content output means includes the output destination instruction. The display system according to claim 2 or 3, wherein the display content captured by the capture means is output to a display surface according to an instruction input by the input means. 5. The erase destination instruction input means for inputting an instruction as to which display surface of the display surface on which the display content is displayed is to be erased, and the erase destination. The captured content deletion complementing unit that deletes the display content displayed by the display unit and complements the background among the display contents on the display surface instructed by the instruction inputting unit. The display system according to 3 or 4. 6. A plurality of display devices, comprising: a display surface for displaying execution results of various software by a computer; and coordinate information output means for outputting information regarding coordinates input to the display surface to the control device. A display program applied to a display system configured by the display-integrated coordinate input device, comprising: a software processing procedure for executing the processing of the various software on the computer based on the coordinate information output by the coordinate information output means; , A capture instruction input procedure for inputting a capture instruction of a display content of one display surface of the plurality of display surfaces, and a capture instruction according to the capture instruction input procedure is displayed on the one display surface. Erase complement procedure that erases the displayed part of the software related to the captured processing and complements the background , A capture procedure for capturing the display content of the one display surface after the completion by the erasure completion procedure, and an output for inputting an instruction as to which display surface the output destination of the display content captured by the capture procedure is A display program, comprising: a first instruction procedure; and a capture content output procedure that outputs the display content captured by the capture procedure to the display surface instructed by the output destination instruction procedure.