JP4549212B2 - Electronic board system - Google Patents

Description

  The present invention relates to a projection image display means in a rear projection type electronic board system, and more particularly to a process of displaying a duplicate image of a part of a display screen in a subwindow on a display unit of the electronic board.

In recent years, as a product called an electronic board, a rear projection type electronic board that displays an operation screen of a personal computer or the like on a rear projector or a thin plasma display and can be operated with a touch pen on the screen is known.
In the electronic board system, a part of the display screen may be hidden by the pen tip of the input pen that is generally operated by the operator. A method for shifting the display position of an input figure or the like with respect to the coordinates of the pen tip is known (for example, see Patent Document 1).

JP-A-6-131120

  However, the method described in Patent Document 1 considers input support on a touch panel or the like, and does not consider the display position for a listener other than the operator. In other words, the electronic board system may be used for explanations at lectures and conferences, but it is hidden by the operator and the electronic pen while the operator operates the board with the electronic pen. In particular, there is a problem in that drawing data and the like that are of primary interest cannot be shown to a listener at a lecture or the like.

  The present invention is to solve the above-described problems, and in a rear projection type electronic board, an electronic device provided with a projection image display means that allows an observer to always view drawing data being input by an operator. An object is to provide a board system.

In order to solve the above problem, in the electronic board system including display data generating means for displaying on the display means of the front projection type electronic board, the display data generating means includes position information of a pen tip of the input pen on the display means. And a replication range determination unit that determines a predetermined replication range including the coordinates indicated by the position information, a replication image generation unit that generates a replication image in the replication range, and a display at a predetermined position on the display unit Sub-window display means for displaying the duplicated image in the sub-window.
In addition, the duplication range determining means may be configured such that when a duplicate image is displayed in the sub-window, the coordinates indicated by the position information of the pen tip of the input pen deviate from the predetermined area set in the duplication range. And a means for enlarging the duplication range.
Further, the duplication range determination means includes means for reducing the duplication range when all of the input coordinates within a predetermined time are included in a predetermined area within the set duplication range. .
Further, the sub window display means divides the display means into a plurality of areas in advance, acquires the position information and the tilt information of the input pen, and based on the area including the position information and the tilt information of the input pen, A means for determining an area for displaying the sub-window is provided.

With the above configuration, in the present invention, based on the input coordinates on the electronic board, a certain range of image is duplicated, a sub-window is displayed at a location away from the vicinity of the coordinate of the pen tip, and a duplicate image is displayed therein. As a result, it is possible to allow a listener such as a lecture or a conference to view the data being input that is hidden by the shadow of the operator or the input pen.
In addition, when the input coordinates exceed the replication range, the replication range is expanded, and when the input coordinates within a certain time are within a part of the replication range, the replication range is reduced. It is possible to display a duplicate image in a wide range.
In addition, since the display position of the sub window is determined according to the tilt of the input pen together with the pen input position, the sub window can be displayed at an appropriate position according to the standing position of the operator. It becomes.

Hereinafter, an electronic board system according to an embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is a diagram showing a schematic configuration of an electronic board system according to one embodiment of the present invention.
The electronic board system according to the present embodiment includes a rear projection type electronic board 1 that displays a projection image, and a control computer 2 that performs a process corresponding to an input operation on the electronic board 1 and generates projection image data. Prepare.
The electronic board 1 includes a display unit 4 that displays a projected image, an input pen 5 for performing an input operation on the display unit 4, and a pen sensor 6 as a coordinate acquisition device for a pen tip of the input pen 5.
The control computer 2 includes an input data processing unit 7 that performs input data processing based on the pen tip position coordinates acquired by the pen sensor 6, and a display data generation unit that generates projection image data based on the processing result of the input data processing unit 7. 8.
In the present embodiment, as shown in FIG. 2, the control computer 2 performs a process of displaying a duplicate image in a partial region of the projection image in a subwindow at a predetermined position away from the input coordinates of the input pen 5. .
As shown in FIG. 2A, the sub-window is not displayed in the display data 200 before pen input. As shown in FIG. 2B, in the display data 210 after pen input, a duplicate image 213 in the duplication range 212 including the position coordinate (hereinafter referred to as “input coordinates”) 211 of the pen tip of the input pen 5 is displayed. Are displayed in the sub-window 214. In this case, an icon 215 indicating the position of the pen tip is displayed in the sub window 214 together with the duplicate image 213.

FIG. 3 is a diagram illustrating an example in which a subwindow is displayed on the display unit 4 of the electronic board 1.
As shown in FIG. 3, in the case of the rear projection type electronic board, a part of the image displayed on the display unit 4 is hidden by the operator S or the shadow Sa of the input pen 4 and cannot be seen by the observer G. The duplicate image is displayed in the sub-window 4a displayed at a predetermined position on the display unit 4.

Hereinafter, sub-window display control processing in the electronic board system according to the present embodiment will be described.
FIG. 4 is a flowchart showing a sub-window display control processing procedure performed by the electronic board system.
First, the input data processing unit 7 receives the input coordinates acquired by the pen sensor 6 and passes them to the display data generation unit 8 (step 401). In this case, the acquisition of the input coordinates is performed when the pen sensor 6 detects a state where the pen tip of the input pen 5 is pen-down on the display unit 4 or a state in which the pen point is close to the display unit 4.
The display data generation unit 8 performs a duplication range designation process described later (step 402), generates and stores a duplication image of the designated duplication range (step 403), and displays a subwindow for the duplication image (step 403). Step 404), the timer count is started (Step 405).
After the timer count, it is determined whether or not the input data processing unit 7 has received the input coordinates (step 406). If the input coordinates are received, the timer count is reset (step 407), and the replication range is designated again. Processing, sub-window generation and display are performed (steps 402 to 404), and timer counting is started (step 405).
Monitoring of input coordinates is continued for a certain period of time (step 407). If a time-out occurs (step 408), the timer count is stopped (step 409) and the sub-window is not displayed (step 410).
With the above processing, the sub-window is displayed only when necessary according to the pen input operation.

5 to 8 are image diagrams showing the duplication range determination process (step 402) performed by the display data generation unit 8. FIG.
As shown in FIG. 5, the input data processing unit 7 converts input coordinates (x, y) on the display unit 500 into coordinates (X, Y) on the projection image 510 and passes them to the display data generation unit 8. .
In the duplication range determination processing, as shown in FIG. 6, first, a duplication range 610 (X1 to Xb) having a predetermined size (vertical a, horizontal b) with the input coordinates 601 (X, Y) as the central coordinates (X0, Y0). X2, Y1 to Y2) are set.
As shown in FIG. 7, when the new input coordinate 701 (X ′, Y ′) is outside the range of the replication range 610, the replication range is expanded and a new replication range 710 (X1 ′) indicated by a one-dot chain line. To X2 ′, Y1 ′ to Y2 ′). In this example, an example in which the duplication range is expanded on the X1 side and the Y2 side is shown.
On the other hand, as shown in FIG. 8, all input coordinates 801 (X ″, Y ″), 802 (X ′ ″, Y ′ ″) within a certain period of time are included in the replication range (X1 ′ to X2 ′). , Y1 ′ to Y2 ′), the new replication range 810 (X1 ″ to X2 ″, Y1 ″ to Y2 ″) indicated by a two-dot chain line is reduced by reducing the replication range 710. Set.

FIG. 9 is a flowchart showing a processing procedure for determining a replication range as details of the replication range determination processing (step 402) performed by the display data generation unit 8. In this flowchart, it is determined whether or not the new input coordinates (X ′, Y ′) by the input pen are included in the replication range (X1 to X2, Y1 to Y2), and the replication range is changed according to the determination result. .
In the duplication range determination process, first, as shown in FIG. 9, it is determined whether or not the sub window is currently displayed (step 901). If the sub window is not being displayed, the input coordinates (X, Y) are centered. The range of the reference size (size: vertical a, horizontal b) is determined as a replication range (step 902).
If the sub-window is being displayed, it is determined whether or not the new input coordinate X ′ is outside the range of the duplication range X1 to X2 (step 903). If it is outside the range, the duplication range X1 to X2 is changed. (Step 904). Specifically, X1 ′ = X′−a / 2 when X ′ <X1, and X2 ′ = X + a / 2 when X ′> X2.
When the new input coordinate X ′ is within the replication range X1 to X2 or when the replication range X1 to X2 is changed, the new input coordinate Y ′ is similarly outside the replication range Y1 to Y2. Is determined (step 905), and if it is out of the range, the duplication range Y1 to Y2 is changed (step 906). Specifically, when Y ′ <Y1, Y1 ′ = Y′−b / 2, and when Y ′> Y2, Y2 ′ = Y ′ + b / 2.
After changing the replication range (X1 to X2, Y1 to Y2), it is determined whether or not the new replication range (X1 ′ to X2 ′, Y1 ′ to Y2 ′) is larger than a predetermined size (step 907). When the new replication range becomes larger than the predetermined size, the replication range reduction process shown in FIG. 9 is performed.
On the other hand, if the duplication range is within the predetermined size, the duplication range determination process is terminated as it is.

FIG. 10 is a flowchart showing the duplication range reduction processing procedure.
In the duplication range reduction processing, first, as shown in FIG. 10, an input point within a predetermined time is acquired, the x coordinate of the input point on the leftmost side is X ″, and the x coordinate of the input point on the rightmost side is X ''', The y coordinate of the uppermost input point is set to Y ″, and the y coordinate of the lowermost input point is set to Y ′ ″ (step 1001).
For the X coordinate of the replication range, X ″ and X1 + a are compared (step 1002). If X ″ is larger than X1 + a, X1 ″ = X ″ −a / 2 is set (step 1003), and the X coordinate is small. If so, leave it as is.
Next, X ′ ″ and X2-a are compared (step 1004). If X ′ is smaller than X2-a, X2 ″ = X ′ ″ + a / 2 is set (step 1005), which is smaller. If so, leave it as is.
The changed X2 ″ −X1 ″ and a are compared (step 1006). When X2 ″ −X1 ″ is smaller than a, X1 ′ ″ = X ′ ″ − a X2 ″ ′ = X ″ + a is set (step 1007).
Similarly, for the Y coordinate of the replication range, Y ″ and Y1 + b are compared (step 1008). If Y ″ is greater than Y1 + b, Y1 ″ = Y ″ −b / 2 is set (step 1009). ) If it is small, leave it as it is.
Next, Y ′ ″ and Y2-b are compared (step 1010). If Y ′ ″ is smaller than Y2-b, Y2 ″ = Y ′ ″ + b / 2 is set (step 1011). If it is small, leave it as it is.
The changed Y2 ″ −Y1 ″ and b are compared (step 1012). If Y2 ″ −Y1 ″ is smaller than a, Y1 ″ = Y ′ ″ − b, Y2 ′. '= Y ″ + b is set (step 1013).
By the above processes, the size of the duplication range is determined according to the relationship between the new input coordinates and the input coordinates within a certain time.

The duplication range determination process will be described based on a specific example.
11 and 12 show specific examples of changes in the duplication range and duplication image according to the input pen operation.
As shown in FIG. 11A, a change in the duplication range when a straight line is drawn in the lower right direction will be described.
As indicated by 1111 in FIG. 11B, first, a replication range having the input coordinates (X, Y) as the center coordinates is set, and the sub-window 1101 is displayed. Thereafter, when the operator draws a straight line from the input coordinates (X, Y) in the lower right direction, the new input coordinates (X ′, Y ′) exceed the currently set replication range as 1112 → 1113. Therefore, the drawing range is not displayed in the sub window 1101. For this reason, as shown at 1114, the duplication range is enlarged, and a sub-window 1102 whose display size is enlarged corresponding to the new duplication range is displayed.
Next, as shown in FIG. 12A, a change in the duplication range when a straight line is drawn in the lower right direction and then a triangle is drawn in the lower right position will be described.
As indicated by reference numeral 1211 in FIG. 12B, the operator draws a straight line in the lower right direction, thereby expanding the duplication range and displaying a subwindow 1201 corresponding to the duplication range. Thereafter, as indicated by 1212 → 1213, when the operator draws a triangle within a certain range at the lower right position of the duplication range, there is a duplication range that does not need to be displayed in 1201 in the sub-window. Therefore, as shown at 1214, based on the range including the input coordinates within a certain time including the new input coordinates, the duplication range is reduced, and the sub window 1202 with the display size reduced corresponding to the duplication range is displayed. . In this case, the reduced duplication range is prevented from becoming smaller than a predetermined reference size (vertical a, horizontal b).
A list of duplicate images generated and stored corresponding to each input coordinate may be displayed on the board. As a result, it is possible to display a toolbar operation procedure or the like in a list of duplicate images. In this case, the number of duplicate images displayed in a list is fixed, and when a new duplicate image is added, the duplicate images displayed in the list are sequentially updated. Further, it is assumed that the sub-windows of the duplicate images displayed as a list can be directly drawn by pen on the ones displayed in the sub-window as a separate layer. As a result, pen writing can be added later to the subwindows displayed in a list as necessary.

FIG. 13 is a diagram showing the arrangement of sub-windows on the display unit.
In this embodiment, normally, the display unit is divided into a plurality of areas in the horizontal direction, and sub-windows are arranged and displayed in areas other than the areas where the input coordinates exist. For example, when the display unit is divided into two areas at the horizontal center position and the input coordinates 1301 are included in the right area as shown in FIG. 13A, the operator's standing position is on the right side. Assume that a sub-window 1302 is displayed in the left area. On the other hand, as shown in FIG. 13B, even when the input coordinate 1303 is included in the left region, if the input pen tilt is smaller than a predetermined value, the operator's standing position is Assuming that it is the right side, a sub window 1304 is displayed in the left side area.
On the other hand, when the input coordinate is the left region, the reverse of these is performed.

FIG. 14 is a diagram illustrating an example of changing the display magnification of the duplicate image displayed in the sub-window.
As shown in FIG. 14, the display magnification of the duplicate image can be arbitrarily set in the setting field 1401 of the display magnification setting screen 1400, and the duplicate image displayed in the sub window 1402 is enlarged according to the set magnification. 1402A or reduced display 1402B is displayed.

As described above, in the electronic board system according to the present embodiment, based on the input coordinates on the display unit of the electronic board, an image of a certain range is duplicated and a subwindow is displayed at a location away from the vicinity of the coordinates of the pen tip. Since the duplicate image is displayed in the screen, it is possible to allow a listener such as a lecturer to view the data being input that is hidden by the shadow of the operator or the input pen.
Also, even when the input pen is close to the electronic board, the position coordinates are acquired and a nearby duplicated image is displayed on the sub-window so that browsing can be performed from the state immediately before the input with the input pen is actually performed. It becomes possible.
Also, the sub window is displayed only when the pen down or proximity of the pen on the electronic board is detected, and when the pen movement cannot be detected for a certain period of time, the sub window is automatically hidden to require the operator. It is possible to display the subwindow only when it is necessary, and the screen area can be used effectively.
In addition, since the display position of the sub window is determined according to the tilt of the input pen together with the pen input position, the sub window can be displayed at an appropriate position according to the standing position of the operator. It becomes.
In addition, when the input coordinates exceed the replication range, the replication range is expanded, and when the input coordinates within a certain time are within a part of the replication range, the replication range is reduced. It is possible to display a duplicate image in a wide range. In addition, since duplicate images are stored and a list can be displayed as necessary, it can be used for explanation of operation procedures.
Further, by displaying an icon at the current pen position in the duplicate image being displayed in the sub-window, it becomes easy to recognize which position in the vicinity of the image is displayed in the sub-window.

In the above-described embodiment, the duplication range is expanded when the input coordinates exceed the duplication range. However, the present invention is not limited to this, and the duplication range is obtained when an area arbitrarily set within the duplication range is exceeded. It is good also as expanding. In addition, the reference area for reducing the duplication range can be arbitrarily set.
In the above embodiment, the display unit is divided into two areas, left and right, and the display position of the sub window is determined. However, the number of divisions may be three or more.

1 is a diagram showing a schematic configuration of an entire electronic board system according to an embodiment of the present invention. It is a figure which shows the example which performed the subwindow display by the electronic board system which concerns on one embodiment of this invention. It is a figure which shows the example which performed the subwindow display by the electronic board system which concerns on one embodiment of this invention. It is a flowchart which shows a subwindow display processing procedure. It is a figure for demonstrating the relationship between the coordinate on an electronic board, and the coordinate on a projection image. It is a figure which shows an example of a replication range determination process It is a figure which shows an example of duplication range determination processing (enlargement). It is a figure which shows an example of a replication range determination process (reduction). It is a flowchart which shows the replication range determination processing procedure. It is a flowchart which shows the duplication range reduction process procedure. It is a figure which shows an example of the change (expansion) of a duplication range. It is a figure which shows an example of the change (reduction | reduction) of a duplication range. It is a figure which shows an example of arrangement | positioning of a subwindow. It is a figure which shows an example of the display magnification change of a duplicate image.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Electronic board, 2 Control computer, 3 Display data projection apparatus, 4 Display part, 5 Input pen, 6 Pen sensor, 7 Input data processing part, 8 Display data generation part, 200 Display data (before pen input), 210 Display data (After pen input), 211 input coordinates, 212 duplication range, 213 duplication image, 214 subwindow, 215 icon.

Claims (2)

In an electronic board system comprising display data generating means for displaying on the display means of the rear projection type electronic board,
The display data generating means
A duplication range determination unit that obtains position information of the pen tip of the input pen on the display unit and determines a predetermined duplication range including coordinates indicated by the position information, and a duplication image that generates a duplication image in the duplication range Generating means; and sub-window display means for displaying the duplicate image in a sub-window displayed at a predetermined position on the display means,
The duplication range determining means, when the duplication image is displayed in the sub-window, the coordinates shown in the position information of the pen tip of the input pen deviates from a predetermined area set in the duplication range And a means for expanding the duplication range and reducing the duplication range when all of the input coordinates within a predetermined time are included in a predetermined area within the set duplication range. Electronic board system. The sub window display means includes:
The display unit is divided into a plurality of areas in advance, the position information and the tilt information of the input pen are acquired, and the sub window is displayed based on the area including the position information and the tilt information of the input pen. The electronic board system according to claim 1, further comprising means for determining

Images