JP2012043251A - Electronic information board apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable handwritten input content and resident display content such as a toolbar displayed at the forefront of an electronic information board apparatus to be displayed without lowering their visibility, when a user performs handwritten input on the resident display content.SOLUTION: An electronic information board apparatus includes: display means for performing screen display; coordinate detection means for detecting a position touched by a pen or a finger on a screen of the display means; coordinate data processing means for successively connecting coordinates detected by the coordinate detection means to convert them into handwritten locus information; display management means for managing display content on the display means by handwritten input data and content management data; and display change means for detecting writing on resident display content displayed in front of handwritten input content during handwritten input, and changing display of one of the resident display content and the handwritten input content.

Description

  The present invention relates to a control technology for an electronic information board device used in a conference or the like.

  Equipped with a large display such as a liquid crystal panel or plasma display, a coordinate detection unit such as a touch panel for detecting the position (coordinates) where the pen or finger touched the screen, and an interface with a terminal device such as an external personal computer. Electronic information board devices have become commercially available (see, for example, Patent Document 1).

This kind of electronic information board device
・ Function to enlarge and display the screen of the connected terminal device ・ Function to operate the terminal device by the movement of a pen or finger ・ Equipped with a function to perform handwriting input like a whiteboard or blackboard by the movement of a pen or finger ing.

  Since the screen of the connected terminal device can be displayed in a large size and can be viewed by a plurality of people in a conference room or the like, it is often used for presentations in conferences and the like. Further, since the screen is bright, it is not necessary to darken the room like a projector that projects the screen onto the wall surface, and there is an advantage that it is possible to use the display of the material at hand and the screen display together with the screen display.

  In addition, it is possible to operate the terminal device that outputs the display contents by directly touching the projected screen instead of operating the mouse or keyboard of the terminal device. This makes it easy to perform presentations and operations by yourself near the display.

  The handwriting input is generally provided by dedicated application software provided together with the electronic information board device. The application software operates on a terminal device connected to the electronic information board device. However, a function for handwriting input may be provided by software operating on the electronic information board device.

This type of application software
(1) Provides a screen that acts as a whiteboard / blackboard, and draws handwritten characters etc. on it via a touch panel, etc. (2) Captures the screen of the terminal device and superimposes the contents of handwriting input on it Provide functions such as drawing.

  In general whiteboard / blackboard application software, the toolbar for switching modes such as pen, eraser, and mouse is normally displayed on the screen unless it is hidden by performing a special operation. . A window such as a palette for selecting a color and a pen size as required is also displayed. In addition, an agenda indicating a schedule of a conference, a clock, and the like are often resident in the display area.

  In the conventional electronic information board device, the display order of resident display contents such as a toolbar, a palette, an agenda, and a clock is generally set to the forefront. For this reason, there has been a problem that the contents input by handwriting are hidden under those resident display contents and are difficult to see.

  FIG. 1 is a diagram showing a display example in a conventional electronic information board device, and shows a state in which a handwritten I1 is input with a pen P superimposed on a toolbar C1 as resident display content. Here, the portion of the handwritten I1 that overlaps the tool bar C1 is hidden by the tool bar C1 displayed in the foreground, so the visibility of that part is deteriorated.

  FIG. 2 shows a state in which handwriting I2 to I4 are input in a state where the palette C2 and the agenda / clock C3 are displayed as resident display contents in addition to the toolbar C1. Also in this case, a part of the handwritten I2 in which “◯” is written and a part of the handwritten I4 in which the character “OK” is written are hidden, and the visibility of the part is deteriorated.

  Technically, it is not impossible to display the handwritten input content in the foreground, but in this case, there is a problem that it becomes difficult to see the resident display content.

  On the other hand, Patent Document 2 discloses that in a multi-window system, it is possible to set an overlap state of windows desired by an operator, so that a desired window is concealed by an active window against the operator's intention during work. Techniques for preventing this are disclosed. However, it does not consider handwritten input, and cannot solve the problem that the contents of handwritten input are hidden by the resident display content and are difficult to see.

  The present invention has been proposed in view of the above-described conventional problems, and the purpose of the present invention is when handwritten input is performed on the resident display content displayed on the forefront in the electronic information board device. It is to enable display of both handwritten input content and resident display content without reducing visibility.

  In order to solve the above-described problems, according to the present invention, as described in claim 1, display means for performing screen display, and coordinates for detecting a position where a pen or a finger touches the screen of the display means Detection means, coordinate data processing means for connecting the coordinates detected by the coordinate detection means in order, and converting the information into handwritten trajectory information, and display for managing display contents on the display means by handwritten input data and content management data The management means detects that writing is performed on the resident display content displayed in front of the handwritten input content during handwritten input, and changes the display of either the resident display content or the handwritten input content The gist of the present invention is an electronic information board device provided with display changing means.

  Further, as described in claim 2, in the electronic information board device according to claim 1, when the display changing unit changes the display of the resident display content, the position, size, Any of the transmittances can be changed.

  In addition, as described in claim 3, in the electronic information board device according to claim 1 or 2, wherein the display change unit changes the display of the handwritten input content, the handwriting The display order and transparency of the input content can be changed.

  In addition, as described in claim 4, in the electronic information board device according to any one of claims 1 to 3, the display changing means is a time when a predetermined time has elapsed from the time when the handwriting input is started. The display change that has already been made for the resident display content or the handwritten input content is restored by using either the time when the handwritten input is completed or the time when a predetermined time has elapsed from the time when the handwritten input is completed as a trigger. be able to.

  In the electronic information board device of the present invention, when handwritten input is performed on the resident display content displayed on the forefront of the electronic information board device, the visibility of both the handwritten input content and the resident display content is improved. It can be displayed without dropping. Accordingly, when handwritten input is performed on the electronic information board device, handwritten input can be performed without worrying about the resident display content displayed in front of the handwritten input content.

It is FIG. (1) which shows the example of a display in the conventional electronic information board apparatus. It is FIG. (2) which shows the example of a display in the conventional electronic information board apparatus. It is a figure which shows the structural example of the system concerning one Embodiment of this invention. It is a figure which shows the example of a data structure. It is a flowchart which shows the process example at the time of handwriting input. It is a figure which shows the example of a display in the state into which the detection coordinate at the time of handwriting input entered in the predetermined area | region surrounding a resident display content. FIG. 10 is a diagram (part 1) illustrating a display example when the display movement of the resident display content is performed. FIG. 10B is a diagram illustrating a display example when the display movement of the resident display content is performed (part 2); FIG. 11 is a diagram (part 1) illustrating a display example when the transmittance of the resident display content is changed. It is FIG. (2) which shows the example of a display when the transmittance | permeability change of resident display content is performed. It is FIG. (1) which shows the example of a display when the display change of handwritten input content is performed. It is FIG. (2) which shows the example of a display when the display change of handwritten input content is performed. It is a flowchart (the 1) which shows the example of a process of "change the display of resident display content or handwritten input content". It is a flowchart (the 2) which shows the example of a process of "change the display of resident display content or handwritten input content".

  Hereinafter, preferred embodiments of the present invention will be described.

<Configuration>
FIG. 3 is a diagram showing a configuration example of a system according to an embodiment of the present invention.

  In FIG. 3, a terminal device 2 such as a personal computer is connected to the electronic information board device 1. In addition, although the case where the electronic information board apparatus 1 has the main functions regarding handwriting input is demonstrated, you may give the main function regarding handwriting input on the terminal device 2 side.

  The electronic information board device 1 includes a display unit 11, a coordinate detection unit 12, a control unit 13, a storage unit 14, and a communication unit 15.

  The display unit 11 is configured by a large display such as a liquid crystal panel or a plasma display.

  The coordinate detection unit 12 is provided on the display unit 11 and includes a touch panel that detects a position (coordinates) where a pen or a finger touches the screen by sampling at regular intervals.

  The control part 13 is comprised by arithmetic units, such as CPU (Central Processing Unit).

  The storage unit 14 includes a storage medium such as a RAM (Random Access Memory), a flash memory, and an HDD (Hard Disk Drive).

  The communication unit 15 includes an interface such as a wired LAN (Local Area Network), a wireless LAN, a USB (Universal Serial Bus), IEEE 1394, or Bluetooth.

  The control unit 13 includes a coordinate data processing unit 131, a display management unit 132, and a display change unit 133 as functional units realized by a computer program. The display change unit 133 includes a resident display content display change unit 134 and a handwriting input display change unit 135.

  The storage unit 14 stores detected coordinate data 141, handwritten input data 142, and content management data 143.

  The coordinate data processing unit 131 recognizes the selection of buttons and items on the screen based on the detected coordinates of the coordinate detection unit 12, and converts the coordinate data sampled at a constant interval in order into handwritten input data representing a locus. Conversion is performed.

  The display management unit 132 manages display contents (screen data) on the display unit 11. The display contents on the display unit 11 include resident display contents (toolbar, palette, agenda, clock, etc. used for handwriting input), application screens input from the terminal device 2, and the like.

  The display change unit 133 detects that writing is performed on the resident display content displayed in front of the handwritten input content during handwritten input, and does not reduce the visibility of both the resident display content and the handwritten input content. As described above, the display of either the resident display content or the handwritten input content is changed.

  The resident display content display changing unit 134 changes any of the position, size, and transmittance of the resident display content immediately before the handwritten input content and the resident display content overlap.

  The handwritten input display changing unit 135 changes the display order and transmittance of the handwritten input content immediately before the handwritten input content and the resident display content overlap.

  On the other hand, the terminal device 2 includes an operation / display unit 21, a control unit 22, a storage unit 23, and a communication unit 24.

  The operation / display unit 21 includes an input device such as a mouse and a keyboard and an output device such as a monitor.

  The control unit 22 is configured by an arithmetic unit such as a CPU. In the control unit 22, an application 221 such as word processing software, spreadsheet software, or presentation software that provides a display screen for the electronic information board device 1 is operating.

  The storage unit 23 includes a storage medium such as a RAM, a flash memory, and an HDD.

  The communication unit 24 is configured by an interface such as a wired LAN, a wireless LAN, USB, and Bluetooth.

  When the terminal device 2 has a main function related to handwriting input, the detected coordinate data 141, handwritten input data 142, and content management data 143 in the storage unit 14 are held in the storage unit 23 of the terminal device 2, and the coordinate data processing unit Conversion to handwritten input data in 131, display of resident display content in the display management unit 132, and processing of the display change unit 133 are executed by the control unit 22 of the terminal device 2. In this case, the coordinate data processing unit 131 in the control unit 13 of the electronic information board device 1 relays the detected coordinates from the coordinate detection unit 12 to the terminal device 2, and the display management unit 132 is resident from the terminal device 2 side. The display content, handwritten input content, application screen, etc. are combined.

  4A and 4B are diagrams showing an example of the data structure. FIG. 4A shows an example of detected coordinate data 141, FIG. 4B shows an example of handwritten input data 142, and FIG. 4C shows an example of content management data 143.

  In FIG. 4A, detected coordinate data 141 includes coordinate data sampled this time and coordinate data sampled last time.

  In FIG. 4B, the handwritten input data 142 includes stroke data represented by continuous coordinate data, transmittance on display of handwritten input contents, and display order from the front of the screen.

  In FIG. 4C, the content management data 143 includes a content name for specifying display content, a display size of the content, a display position, a display transmittance, and a display order from the front of the screen. Including.

<Operation>
FIG. 5 is a flowchart showing a processing example at the time of handwriting input in the above embodiment.

  In FIG. 5, when the process is started at regular intervals (step S101), the coordinate data processing unit 131 determines whether or not the coordinate detection unit 12 has detected coordinates (step S102). That is, whether or not the coordinate detection unit 12 has detected a coordinate is determined by whether or not the currently sampled coordinate data in the detected coordinate data 141 (FIG. 4A) is a valid value.

  When it is determined that the coordinates have been detected (Yes in step S102), the coordinate data processing unit 131 determines whether or not the detected coordinates are within the handwritten region (step S103). Whether or not it is in the handwritten area is determined by comparing the data indicating the coordinate range of the handwritten area internally held in advance with the detected coordinate data.

  When it is determined that the detected coordinates are within the handwritten area (Yes in step S103), the coordinate data processing unit 131 performs a drawing process by handwriting input (step S104). That is, the stroke data of the handwritten input data 142 (FIG. 4B) is recorded based on the detected coordinate data (the transmittance is the initial value “0”, and the display order is a value after the display order of the resident display content). The display management unit 132 performs drawing based on the handwritten input data 142. In addition, as stroke data, if there is no previous detection coordinate, only the coordinate will be drawn, if there is a previous detection coordinate, and if it has changed, the detection coordinate will be continuous and a line connecting those coordinates It becomes drawing.

  Next, the coordinate data processing unit 131 determines whether or not the detected coordinates are within a predetermined area surrounding the resident display content (step S105). Whether or not the detected coordinates are within a predetermined area surrounding the resident display content is determined by comparing the range expanded by a predetermined size around the position of the content management data 143 (FIG. 4C) with the coordinate data. To do. FIG. 6 is a diagram illustrating a display example in a state where the detected coordinates at the time of handwriting input are within a predetermined area surrounding the resident display content, and the vicinity of the tool bar C1 is reached while the handwriting I1 is being input with the pen P. Thus, it is determined that the detected coordinates are within a predetermined area surrounding the resident display content.

  Returning to FIG. 5, when it is determined that the detected coordinates are within a predetermined area surrounding the resident display content (Yes in step S105), the display changing unit 133 changes the display of the resident display content or the handwritten input content (step S106). ).

  7 to 12 are diagrams showing examples of changing the display of the resident display content or the handwritten input content. FIGS. 7 and 8 show the case where the resident display content is moved, and FIGS. 9 and 10 show the resident display. When the content transmittance is changed, FIGS. 11 and 12 show examples when the display change of the handwritten input content is performed.

  In FIG. 7, the tool bar C1 is moved to the right margin part by reaching the vicinity of the tool bar C1 while the handwriting I1 is being input with the pen P. In FIG. 8, the palette C2 is moved to the left margin by handwriting I2, and the agenda / clock C3 is moved to the lower margin by handwriting I4.

  In FIG. 9, the tool bar C1 is in a semi-transparent state by reaching the vicinity of the tool bar C1 while the handwriting I1 is being input with the pen P. In FIG. 10, the palette C2 is made translucent by handwriting I2, and the agenda / clock C3 is made translucent by handwriting I4.

  In FIG. 11, the display order of the handwritten I1 is closer to the toolbar C1 by reaching the vicinity of the toolbar C1 while the handwritten I1 is being input with the pen P, and the portion of the handwritten I1 that overlaps the toolbar C1 Is translucent. In FIG. 12, the display order of the handwritten I2 is closer to the palette C2, the portion of the handwritten I2 that overlaps the palette C2 is translucent, and the handwritten I4 is closer to the display order than the agenda / clock C3. In the handwritten I4, a portion overlapping the agenda / clock C3 is translucent.

  Details of the processing for changing the display of the resident display content or the handwritten input content will be described later.

  Next, returning to FIG. 5, after changing the display of the resident display content or the handwritten input content (step S106), and when it is determined that the coordinates are not detected (No in step S102), the detected coordinates are within the handwritten region. If it is determined that the detected coordinates are not within the predetermined area surrounding the resident display content (No in step S105), the display changing unit 133 needs to restore the changed display. It is determined whether or not there is (step S107). Whether or not the changed display needs to be restored depends mainly on changing the transparency of the resident display content or changing the display order of the handwritten input content and the transparency of the overlapped part. For a case, a determination is made based on whether a predetermined time has elapsed since the start of handwriting input, whether the handwriting input has ended, or whether a predetermined time has elapsed from the end of handwriting input. When it is determined whether a predetermined time has elapsed from the start of handwriting input or whether a predetermined time has elapsed from the end of handwriting input, the handwriting input is started in the content management data 143 (FIG. 4C). An item of time or handwriting input end time is provided, and time data at that time is recorded when handwriting input starts or when handwriting input ends.

  When it is determined that the changed display needs to be restored (Yes in step S107), the display changing unit 133 restores the changed display (step S108) and ends the process (step S109). That is, when the transmittance of the resident display content is changed, the transmittance of the resident display content is returned to the original value. When the display order of the handwritten input content and the transparency of the overlapping portion are changed, the display order of the handwritten input content and the transparency of the overlapping portion are returned to the original values.

  If it is determined that there is no need to restore the changed display (No in step S107), the process ends (step S109).

  FIG. 13 is a flowchart showing a processing example of “change display of resident display content or handwritten input content” (step S106 in FIG. 5).

  In FIG. 13, when the process of changing the display of the resident display content or the handwritten input content is started (step S201), the display changing unit 133 executes the display change of the resident display content or the display change of the handwritten input content. Determination is made (step S202). For example, the priority of each of the display change of the resident display content and the display change of the handwritten input content is held as a separate table, and the change is made by comparing which priority is higher with reference to the table. Determine whether.

  When it is determined that the display change of the resident display content is to be performed, the resident display content display change unit 134 of the display change unit 133 determines whether to move the display of the resident display content or change the transmittance of the resident display content ( Step S203). For example, the priority order of the display movement of the resident display content and the change of the transmittance of the resident display content are separately stored as a table, and the change is made by comparing which priority is higher with reference to that table. Determine whether to do it.

  When it is determined that the display movement of the resident display content is to be performed, the resident display content display change unit 134 of the display change unit 133 refers to the position and size of the resident display content that prevents the display of the handwritten input content (FIG. 4C). Then, a blank area that does not overlap with the area of the resident display content and the handwritten input content that are displayed is searched to determine whether or not the blank area exists on the display screen (step S204). In the search for the blank area, the position of the parking display content is temporarily moved up, down, left, and right, and the handwritten input data 142 (FIG. 4B) and the other content management data 143 (FIG. 4) overlapping the area occupied by the size from the position. (C)) is performed by determining whether or not it exists.

  If it is determined that the blank area does not exist on the display screen, the resident display content display change unit 134 of the display change unit 133 reduces the size of the blank area to be searched (step S205), and the blank area exists on the display screen. It returns to determination (step S204) of whether to do.

  If it is determined that a blank area exists on the display screen, the resident display content that prevents display is moved to the position of the found blank area (step S206). In this case, if the size of the blank area to be searched is reduced, the resident display content is reduced to that size before moving. Then, the process ends (step S210).

  If it is determined to change the transmittance of the resident display content, the resident display content display change unit 134 of the display change unit 133 changes the transmittance of the resident display content that hinders the display to a predetermined value, and the display management unit The resident display content is redrawn by 132 (step S207). Then, the process ends (step S210).

  On the other hand, when it is determined that the display change of the handwritten input content is to be performed, the handwriting input display changing unit 135 of the display changing unit 133 sets the display order of the handwritten input content before the display order of the resident display content that prevents the display. The value is changed as follows (step S208).

  Next, the handwriting input display changing unit 135 of the display changing unit 133 changes the transmittance of the part included in the display area of the resident display content that prevents display from the handwritten input content to a predetermined value, and the display management unit 132 The handwritten input content is redrawn (step S209). Then, the process ends (step S210).

  FIG. 14 is a flowchart showing another process example of “change display of resident display content or handwritten input content”.

  In FIG. 14, when the process of changing the display of the resident display content or the handwritten input content is started (step S211), the display changing unit 133 executes the display change of the resident display content or the display change of the handwritten input content. Determination is made (step S212). For example, the priority of each of the display change of the resident display content and the display change of the handwritten input content is held as a separate table, and the change is made by comparing which priority is higher with reference to the table. Determine whether.

  When it is determined that the display change of the resident display content is to be performed, the resident display content display change unit 134 of the display change unit 133 determines whether to move the display of the resident display content or change the transmittance of the resident display content ( Step S213). For example, the priority order of the display movement of the resident display content and the change of the transmittance of the resident display content are separately stored as a table, and the change is made by comparing which priority is higher with reference to that table. Determine whether to do it.

  When it is determined that the display movement of the resident display content is to be performed, the resident display content display change unit 134 of the display change unit 133 is displayed with reference to the size of the resident display content that prevents the display (FIG. 4C). A blank area that does not overlap with the area of the resident display content and the handwritten input content is searched to determine whether or not the blank area exists on the display screen (step S214). In the search for the blank area, the position of the parking display content is temporarily moved up, down, left, and right, and the handwritten input data 142 (FIG. 4B) and the other content management data 143 (FIG. 4) overlapping the area occupied by the size from the position. (C)) is performed by determining whether or not it exists.

  If it is determined that a blank area exists on the display screen, the resident display content that prevents display is moved to the position of the found blank area (step S215). And a process is complete | finished (step S220).

  If it is determined that there is no blank area on the display screen, whether the resident display content display change unit 134 of the display change unit 133 executes the change of the transmittance of the resident display content or the display change of the handwritten input content. Determination is made (step S216). For example, the priority of each change in the transmittance of the resident display content and the display change of the handwritten input content is held as a separate table, and which change is made by referring to it and comparing which priority is higher Determine whether to do it.

  On the other hand, when it is determined to change the transmittance of the resident display content (including the case where it is determined after the determination that the blank area does not exist on the display screen), the resident display content display change unit of the display change unit 133 In the display of the resident display content that hinders the display, the transmittance of the portion that overlaps the display area of the handwritten input content is changed to a predetermined value, and the display management unit 132 redraws the resident display content (step S217). ). And a process is complete | finished (step S220).

  On the other hand, when it is determined to change the display of the handwritten input content (including the case where it is determined after the determination that the blank area does not exist on the display screen), the handwriting input display changing unit 135 of the display changing unit 133 is Then, the value is changed so that the display order of the handwritten input content comes before the display order of the resident display content that hinders the display (step S218).

  Next, the handwriting input display changing unit 135 of the display changing unit 133 changes the transmittance of the part included in the display area of the resident display content that prevents display from the handwritten input content to a predetermined value, and the display management unit 132 The handwritten input content is redrawn (step S219). And a process is complete | finished (step S220).

<Summary>
As described above, according to the present embodiment, when handwritten input is performed on the resident display content displayed on the forefront of the electronic information board device, the visibility of both the handwritten input content and the resident display content is visible. The display can be made without dropping. Accordingly, when handwritten input is performed on the electronic information board device, handwritten input can be performed without worrying about the resident display content displayed in front of the handwritten input content.

  The present invention has been described above by the preferred embodiments of the present invention. While the invention has been described with reference to specific embodiments, various modifications and changes may be made to the embodiments without departing from the broad spirit and scope of the invention as defined in the claims. Obviously you can. In other words, the present invention should not be construed as being limited by the details of the specific examples and the accompanying drawings.

DESCRIPTION OF SYMBOLS 1 Electronic information board apparatus 11 Display part 12 Coordinate detection part 13 Control part 131 Coordinate data processing part 132 Display management part 133 Display change part 134 Resident display content display change part 135 Handwritten input display change part 14 Memory | storage part 141 Detection coordinate data 142 Handwritten Input data 143 Content management data 15 Communication unit 2 Terminal device 21 Operation / display unit 22 Control unit 221 Application 23 Storage unit 24 Communication unit

JP 2000-43484 A Japanese Patent No. 3054120

Claims (4)

Display means for performing screen display;
Coordinate detection means for detecting a position where a pen or a finger touches the screen of the display means;
Coordinate data processing means for connecting the coordinates detected by the coordinate detection means in order and converting it into handwritten trajectory information;
Display management means for managing display contents on the display means by handwritten input data and content management data;
Display changing means for detecting that writing is performed on the resident display content displayed in front of the handwritten input content during handwriting input and changing the display of either the resident display content or the handwritten input content And an electronic information board device. The electronic information board device according to claim 1,
The electronic information board device according to claim 1, wherein when changing the display of the resident display content, the display changing means changes any of the position, size, and transmittance of the resident display content. In the electronic information board device according to any one of claims 1 and 2,
The display changing means, when changing the display of the handwritten input content, changes the display order and transmittance of the handwritten input content. In the electronic information board device according to any one of claims 1 to 3,
The display changing means uses the resident display as a trigger when a predetermined time elapses from the start of handwriting input, when the handwriting input ends, or when a predetermined time elapses from the end of handwriting input An electronic information board device that restores a display change that has already been made for the content or the handwritten input content.