JP6335024B2 - Display device, display method, display program, and electronic blackboard - Google Patents

Description

  The present invention relates to a display device for displaying an image on a screen, a display method, a display program, and an electronic blackboard including the display device, and in particular, a display device for displaying content drawn with a plurality of pens on a screen, The present invention relates to a display method, a display program, and an electronic blackboard including the display device.

  As a replacement for the conventional white board paired with a magic pen, a touch panel function is added to a large liquid crystal display device (hereinafter also referred to as “display”), and a touch pen for drawing (hereinafter simply referred to as “ The ones that come with pens) are becoming popular as electronic blackboards. In such an electronic blackboard, a display and a pen having a touch panel function can be used to display contents on the display as an image on the display according to a locus drawn by the pen on the display. Then, by changing the thickness, color, type, and the like of the lines assigned to the pens, it is possible to handle one pen as if it were many pens and create a richly expressed image.

JP 2011-145663 A JP 2013-175142 A

  Here, electronic blackboards are often used in school classrooms, workplace conference rooms, etc., and in such a usage environment, there are cases where multiple people draw on the electronic blackboard using their pens. is assumed. However, in the prior art, even if various colors, thicknesses, and types can be assigned to the pen, the pen is only one pen. When it is decided to use one pen, each user can set attributes such as color, thickness and type according to the time when the pen is assigned to the user. Draw on the touch panel with the pen after setting. Even if a plurality of pens are prepared, attributes such as different colors, thicknesses, and types are not necessarily assigned to different pens. The same attribute may be assigned to different pens. In such a case, not only the user but also the device identifies which drawing content displayed on the screen is drawn with which pen. Can not do it. Therefore, even if different pens are assigned to each user, if the same attribute is assigned to different pens, not only the user but also the device is displayed on the screen. It cannot be identified whether it is drawn. Therefore, the display and non-display of the drawing contents cannot be switched for each pen. If a different pen is assigned to each user, display and non-display of drawing contents cannot be switched for each user.

  In addition, the conventional electronic blackboard has the following problems.

  The first problem will be described with reference to FIG. FIG. 1A shows a state in which “Aiueo” is drawn by the pen 1, “Kakikukeko” is drawn by the pen 2, and “Sashisuseso” is drawn by the pen 3. Here, as shown in FIG. 1B, when the screen is wiped with an electronic eraser (for example, a pen having an eraser attribute) using the eraser function, the screen shown in FIG. As shown in the drawing, all the drawing contents in the portion approaching the locus wiped by the electronic eraser are erased. However, for example, there is a case where it is required to leave “Kakikakeko” drawn by the pen 2, and such a case cannot be dealt with.

  The second problem will be described with reference to FIG. FIG. 2A shows a state in which “Aiueo” is drawn by the pen 1, “Kakikukeko” is drawn by the pen 2, and “Sashisoseso” is drawn by the pen 3. Here, as shown in FIGS. 2 (b) and 2 (c), when the designated area of the screen is erased using the erase function for designating the area, it is in that area as shown in FIG. 2 (d). All drawing contents are erased. However, for example, there is a case where it is required to leave “Kakikakeko” drawn by the pen 2, and such a case cannot be dealt with.

  The third problem will be described with reference to FIG. FIG. 3A shows a state in which “Aiueo” is drawn by the pen 1, “Kakikukeko” is drawn by the pen 2, and “Sashisoseso” is drawn by the pen 3. Here, as shown in FIG. 3B, when the entire screen is erased by using the function for erasing all drawn contents, all the drawn contents in the whole screen are erased as shown in FIG. Is done. However, for example, there is a case where it is required to leave “Kakikakeko” drawn by the pen 2, and such a case cannot be dealt with.

  In Patent Document 1, in an electronic pen system using a plurality of electronic pens and a touch panel, the electronic pen includes attribute selection means for selecting an attribute by a user, and the attribute information selected by the attribute selection means and its own There is described an invention in which pen information to which identification information is added is transmitted to a control device, and the control device displays an image according to attribute information acquired from pen information received from an electronic pen on a display device. However, in the invention of Patent Document 1, although various attributes can be switched and assigned to one pen as described above, a plurality of identifiable pens cannot be used instead of using a pen for each attribute. .

  Patent Document 2 discloses that waves having different wavelengths are emitted from different pens so that writing can be simultaneously performed on the tablet using a plurality of pens, and these waves propagated through the tablet. Later, an invention is described in which detection is performed after passing through a filter having a band pass for each wave provided at the end of the tablet, and the coordinates of the pen are obtained for each pen. However, the invention of Patent Document 2 relates to an input interface for enabling drawing even when a plurality of pens are simultaneously used.

  Accordingly, the present invention displays a content drawn with a plurality of pens on a screen, and a display device, a display method, a display program, and a display program that can switch between displaying and hiding the drawn content for each pen. An object is to provide an electronic blackboard including a display device.

According to the present invention,
A display device for displaying content drawn with a plurality of pens on a screen based on drawing data corresponding to the content,
If drawing is performed using any one of the plurality of pens, drawing data generating means for generating the pen and drawing data corresponding to the drawing;
Storage means for storing the drawing data;
If drawing data corresponding to the pen is stored in the storage means during a period in which the display mode is set for any of the plurality of pens, the drawing data corresponding to the pen is used based on the drawing data. Drawing data corresponding to a pen is allowed to be displayed on the screen, and drawing data corresponding to the pen is displayed during a period in which a non-display mode is set for any of the plurality of pens. Display permission / prohibition control means for prohibiting display of the drawing content corresponding to the pen on the screen, even if stored in the storage means;
Display means for displaying the drawing content permitted to be displayed on the screen by the display permission / prohibition control means based on at least a part of the drawing data stored in the storage means. When,
If there is a drawing content corresponding to any one of the plurality of pens in the part on the screen to be erased by the erasing means, and the display mode is set for the pen, the memory is stored. Erasing control means for erasing the drawing data corresponding to the drawing contents from the means, and controlling not to erase the drawing data corresponding to the drawing contents from the storage means when the non-display mode is set,
A display device is provided.

  Moreover, according to this invention, an electronic blackboard provided with said display apparatus is provided.

Furthermore, according to the present invention,
A display method for displaying content drawn with a plurality of pens on a screen based on drawing data corresponding to the content,
If drawing has been performed using any one of the plurality of pens, a drawing data generation step for generating drawing data corresponding to the pen and the drawing;
A storage step of storing the drawing data in a storage means ;
If drawing data corresponding to the pen is stored in the storage means during a period in which the display mode is set for any of the plurality of pens, the drawing data corresponding to the pen is used based on the drawing data. Drawing data corresponding to a pen is allowed to be displayed on the screen, and drawing data corresponding to the pen is displayed during a period in which a non-display mode is set for any of the plurality of pens. A display permission / prohibition step for prohibiting the display of the drawing content corresponding to the pen on the screen, even if stored in the storage means;
A display step of displaying the drawing content permitted to be displayed on the screen by the display permission / inhibition step based on at least a part of the drawing data stored in the storage unit; ,
If there is a drawing content corresponding to any one of the plurality of pens in the part on the screen to be erased by the erasing means, and the display mode is set for the pen, the memory is stored. An erasure control step for erasing the drawing data corresponding to the drawing content from the means and controlling not to erase the drawing data corresponding to the drawing content from the storage means when the non-display mode is set;
There is provided a display method characterized by comprising:

  Furthermore, according to the present invention, there is provided a display program for causing a computer to function as the display device.

  According to the present invention, contents drawn with a plurality of pens can be displayed on the screen, and the display and non-display of the drawn contents can be switched for each pen.

It is a 1st figure for demonstrating a prior art example. It is a 2nd figure for demonstrating a prior art example. It is a 3rd figure for demonstrating a prior art example. It is a conceptual diagram which shows the whole structure of the electronic blackboard by embodiment of this invention. It is a block diagram which shows the detailed structure of the IWB function part shown in FIG. 4 shows an example of drawing data corresponding to one trajectory of a touch pen according to an embodiment of the present invention. It is a figure which shows an example of the locus | trajectory by a touch pen. It is a figure which shows the mode of the transition of the screen of an electronic blackboard in the operation example of Embodiment 1 of this invention. FIG. 6 is a flowchart for explaining an operation for making a drawing content with the pen 2 non-display state in the operation example of the first embodiment of the present invention. FIG. 6 is a flowchart for explaining an operation for setting a drawing content with the pen 2 to a display state in the operation example of the first embodiment of the present invention. It is a figure which shows the mode of the transition of the screen of an electronic blackboard in the operation example of Embodiment 2 of this invention. It is a flowchart for demonstrating the operation example of Embodiment 2 of this invention. It is a figure which shows the mode of the transition of the screen of an electronic blackboard in the operation example of Embodiment 3 of this invention. It is a flowchart for demonstrating the operation example of Embodiment 3 of this invention. It is a figure which shows the mode of the transition of the screen of an electronic blackboard in the operation example of Embodiment 4 of this invention. It is a block diagram which shows the detailed structural example of the part relevant to this invention of the electronic blackboard by embodiment of this invention.

  DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the drawings.

  FIG. 4 is a conceptual diagram showing the overall configuration of the electronic blackboard according to the embodiment of the present invention.

  Referring to FIG. 4, an electronic blackboard according to an embodiment of the present invention includes a screen 101, a touch panel processing unit 103, a plurality of touch pens 105, a touch pen signal receiver 107, and an interactive white board function unit (interactive white board function unit; , Also referred to as “IWB function unit”) 109. The display device of the present invention includes, for example, an IWB function unit 109.

  The screen 101 is, for example, a large liquid crystal panel, and generally displays an image according to an input video signal. In particular, the screen 101 displays contents drawn by the touch pen 105. The touch panel processing unit 103 detects contact, depression, or proximity of the touch pen 105 with a sensor provided therein, processes the detection signal with a built-in microcomputer or the like, and outputs a touch panel signal including position information of the touch pen 105 by wire or wirelessly. To output. Each touch pen 105 is used by a user for drawing, and touches, presses, or approaches the touch panel by a user operation. In addition, each touch pen 105 outputs the individual identification information and operation information of the touch pen (information indicating the operation content for the operation button mounted on the touch pen itself) by wire or wirelessly. The touch pen signal receiver 107 inputs the individual identification information and operation information of the touch pen from each touch pen 105 and outputs them to the IWB function unit 109 by wire or wirelessly. The IWB function unit 109 receives a touch panel signal from the touch panel processing unit 103, and inputs touch pen individual identification information and operation information from the touch pen signal receiver 107. Also, the IWB function unit 109 generates drawing data representing the drawing content of the touch pen based on the individual identification information and operation information of the touch pen and the touch panel signal, and outputs an image signal including the drawing data to the screen 101. The screen 101 displays a screen based on this image signal, and thereby the drawing content by each touch pen 105 is displayed on the screen 101.

  In FIG. 4, the number of touch pens 105 is two, but may be one or any number of three or more. Normally, the drawing content is drawn at a position on the screen 101 where the touch pen 105 touches. As a result, when an image other than the content drawn with the touch pen is displayed superimposed, it is possible to use the electronic blackboard as if writing directly to the image or deleting the written content with the touch pen. It becomes.

  FIG. 5 is a block diagram showing a detailed configuration of the IWB function unit 109 shown in FIG.

  Referring to FIG. 5, the IWB function unit 109 includes a control unit 109-1, a communication unit 109-3, a storage unit 109-5, and a RAM (Random Access Memory) 109-7. These are connected to each other by a bus 109-9. The RAM 109-7 includes a touch pen ID number management unit 121, a display state management unit 123 for each touch pen ID number, and a screen display data storage unit 125.

  The control unit 109-1 is constituted by, for example, a CPU (Central Processing Unit), and performs various controls by reading and executing a program stored in the storage unit 109-5. In particular, arithmetic processing for causing each hardware component shown in FIG. 5 to function as the IWB function unit 109 as a whole is performed.

  The communication unit 109-3 is a communication for inputting individual information and operation information of a pen in use from the touch pen signal receiver 107, a communication for inputting a touch panel signal from the touch panel processing unit 103, and an image on the screen 101. Perform communication to output signals.

  The storage unit 109-5 is, for example, a nonvolatile storage medium such as an HDD (Hard Disk Drive) or a CD-ROM (Compact Disc-Read Only Memory). A program for performing the above arithmetic processing is stored.

  The RAM 109-7 is a recording medium for temporarily storing data, stores a program read from the storage unit 109-5, and also stores various data generated by executing the program. To do. The control unit 109-1 described above performs arithmetic processing for control by reading and executing a program loaded into the RAM 109-7 after being read from the storage unit 109-5.

  The touch pen ID number management unit 121 includes, for each touch pen, individual identification information of the touch pen (for example, the MAC address (Media Access Control Address) of the touch pen) and an ID number that is a management number on a program executed by the control unit 109. (Hereinafter also referred to as “touch pen ID”) is included (see Table 1). This table included in the touch pen ID number management unit 121 is rewritable. For example, the user can change a touch pen ID associated with certain individual identification information to another touch pen ID, It is possible to change certain individual identification information associated with the touch pen ID to other individual identification information.

タッチペンＩＤ番号毎の表示状態管理部１２３は、タッチペン毎に、そのタッチペンの表示状態を管理するためのテーブル（表２参照）を含む。このテーブルは、タッチペンＩＤとそれに対応した表示状態とを関連付けて保持する。表示状態は、「表示中」と「非表示中」とを含む。

The display state management unit 123 for each touch pen ID number includes a table (see Table 2) for managing the display state of the touch pen for each touch pen. This table holds the touch pen ID and the display state corresponding to the touch pen ID in association with each other. The display state includes “displaying” and “not displaying”.

また、タッチペンＩＤ番号毎の表示状態管理部１２３は、タッチペン毎に、そのタッチペンの色を管理するためのテーブル（表３参照）を含む。このテーブルは、タッチペンＩＤとそれに対応した色の識別情報とを関連付けて保持する。

Further, the display state management unit 123 for each touch pen ID number includes a table (see Table 3) for managing the color of the touch pen for each touch pen. This table holds the touch pen ID and the corresponding color identification information in association with each other.

また、タッチペンＩＤ番号毎の表示状態管理部１２３は、タッチペン毎に、そのタッチペンの太さを管理するためのテーブル（表４参照）を含む。このテーブルは、タッチペンＩＤとそれに対応した太さの識別情報とを関連付けて保持する。

The display state management unit 123 for each touch pen ID number includes a table (see Table 4) for managing the thickness of the touch pen for each touch pen. This table holds the touch pen ID and identification information corresponding to the thickness associated with the touch pen ID.

画面上の機能ボタン領域には、例えば、黒ペンのアイコン、赤ペンのアイコン、青ペンのアイコンが表示されている。そして、例えば、タッチペンで赤ペンのアイコンを押下するとそのアイコンが選択状態になる。更に、タッチペンで赤ペンのアイコンを押下すると、そのアイコンに含まれるペンの太さを表す図形の太さが変化する。タッチペンが押下される度に、どの色のペンのアイコンが押下されたかという情報と、現在のペンの太さを示す情報をＩＷＢ機能部１０９は把握することができ、他方では、ペンアイコンをタッチしたタッチペンも所定の方法により把握しているので、タッチペンによりペンアイコンが押下された時に把握した色と太さを、そのタッチペンに割り当てることができる。そして、その割当てを保持しておいて、そのタッチペンを用いて描画が行われたならば、その描画の内容を表す描画データ（後述する。）に、タッチペンのＩＤ、色及び太さを含める。

In the function button area on the screen, for example, a black pen icon, a red pen icon, and a blue pen icon are displayed. For example, when a red pen icon is pressed with a touch pen, the icon is selected. Further, when the red pen icon is pressed with the touch pen, the thickness of the graphic representing the thickness of the pen included in the icon changes. Each time the touch pen is pressed, the IWB function unit 109 can grasp information indicating which color of the pen icon is pressed and information indicating the current pen thickness. On the other hand, the pen icon is touched. Since the touch pen is grasped by a predetermined method, the color and thickness grasped when the pen icon is pressed by the touch pen can be assigned to the touch pen. Then, if the assignment is held and drawing is performed using the touch pen, the drawing pen data (to be described later) including the touch pen ID includes the ID, color, and thickness of the touch pen.

  The screen display data storage unit 125 holds drawing data for displaying the contents drawn with the touch pen on the screen. This drawing data is associated with a touch pen ID corresponding to the touch pen used for drawing. FIG. 6 shows an example of drawing data corresponding to one locus of the touch pen. Here, one trajectory is a trajectory between SD1 and SU1, a trajectory between SD2 and SU2, or a trajectory between SD3 and SU3 as shown in FIG. In the example of FIG. 7, there are three trajectories. The first column of the drawing data shown in FIG. 6 is the drawing data number, the second column is the touch pen ID, the third column is the touch pen color, the fourth column is the touch pen thickness, and the fifth column is The number of drawing data is assigned. Here, one trajectory is represented by one or a plurality of data sets, and the number of drawing data in the fifth column corresponds to the number of data sets constituting one trajectory. The sixth and subsequent columns are assigned to one or more data sets. There are a plurality of types of data sets, for example, a data set with a straight line type and a data set with a curve type (cubic Bezier curve). Examples of these are shown in Table 5.

表５に示しているように、種別が直線のデータセットは、値が0x10のデータ種別ＩＤにより識別され、データ数は４であり、４つの座標を含む。また、種別が３次ベジェ曲線のデータセットは、値が0x11のデータ種別ＩＤにより識別され、データ数は８であり、８つの座標を含む。

As shown in Table 5, a data set whose type is a straight line is identified by a data type ID having a value of 0x10, the number of data is 4, and includes 4 coordinates. A data set having a cubic Bezier curve type is identified by a data type ID having a value of 0x11, the number of data is 8, and includes 8 coordinates.

  Therefore, the portion shown in the second and subsequent lines of the drawing data corresponding to one locus of the touch pen shown in FIG. 6 has a length depending on the number of data sets and the type of each data set. As will be described later, the drawing unit generates drawing pixel data based on the numerical drawing data represented by such numerical values.

  If the control unit 109-1 inputs the touch panel signal via the communication unit 109-3, the pen individual information is also input via the communication unit 109-3, and the touch pen ID corresponding to the pen individual identification information is input. Can be retrieved from the touch pen ID number management unit 121. Then, the searched touch pen ID can be included in the numerical drawing data generated based on the touch panel signal, as shown in FIG.

  Next, for each of the four operation examples, the transition of the screen on the electronic blackboard is described, and then the internal operation is described.

[Operation Example of Embodiment 1]
FIG. 8 is a diagram illustrating a transition of the screen of the electronic blackboard in the operation example of the first embodiment.

  FIG. 8A shows a state in which “Aiueo” is drawn by the pen 1, “Kakikukeko” is drawn by the pen 2, and “Sashisoseso” is drawn by the pen 3. Here, as shown in FIG. 8B, the operation button group includes a “Pen 1 non-display” button, a “Pen 2 non-display” button, and a “Pen 3 non-display” button. The “Pen 1 non-display” button is a button for switching the display state of the drawing content by the pen 1 to “Non-display”. Similarly, the “Pen 2 non-display” button is a button for switching the display state of the drawing content by the pen 2 to “Non-display”. The “Pen 3 non-display” button is a button for switching the display state of the drawing content by the pen 3 to “Non-display”. Here, as shown in FIG. 8B, when the “Pen 2 non-display” button is pressed with the touch pen, the label of this button toggles to “Pen 2 display”. Then, as shown in FIG. 8C, “Ai Ueo” which is the drawing content of the pen 1 and “Sashisuseso” which is the drawing content of the pen 3 are still displayed, but “Kakiki” which is the drawing content of the pen 2. Only “Kukeko” is hidden.

  When this button whose label is toggled to “Pen 2 display” is pressed again with the touch pen, the label toggles back to “Pen 2 non-display”. Then, as shown in FIG. 8D, the drawing content of the pen 2 that has been hidden is redisplayed.

  In this way, each time this button is pressed, the label of this button toggles between “Pen 2 non-display” and “Pen 2 display”. Toggle between the function for setting the display state to “not displaying” and the function for setting the display state of the drawing content by the pen 2 to “displaying”. Further, the display state of the drawing content by the pen 2 is switched between “displaying” and “not displaying”.

  The same applies to the pen 1 and the pen 3.

  Note that in order to switch between display and non-display for a touch pen, it is necessary to press a button corresponding to the pen, but the touch pen used for the press is a target for switching. The touch pen may be a touch pen other than that. Therefore, when the touch pen is different for each user, not only can the user switch between display and non-display for the drawing contents by a certain user, but other users can also display non-display. Since switching can be performed, convenience is improved.

  Moreover, it can also be set as the structure which prohibits the switching by another user. For this purpose, when a button is pressed, the touch pen ID is detected using the individual information of the touch pen that pressed the button and the touch pen ID number management unit 121.

  FIG. 9 is a flowchart for explaining an operation for setting the display state of the drawing content by a certain pen (pen 2 as an example) to “not displaying” in the operation example of the first embodiment. For all the drawing data (shown in FIG. 6) respectively corresponding to all the drawing contents, it is checked whether the drawing data is associated with the pen 2. Processing is performed to set the display state of the corresponding drawing content to “hidden”.

  More specifically, first, the first drawing data is searched (step S201). The drawing data here is for each locus. Next, it is determined whether or not all the drawing data search for each locus has been completed (step S203). If completed (YES in step S203), the operation is terminated.

  If not completed (NO in step S203), it is determined whether or not the drawing data corresponds to the drawing contents of the pen 2 by looking at the column of the touch pen ID shown in FIG. 6 (step S205). If it corresponds (YES in step S205), a non-display process corresponding to the drawing data is performed (step S207), and then the process proceeds to search for drawing data corresponding to the next locus (step S209). If not (NO in step S205), the process directly proceeds to search for drawing data corresponding to the next locus (step S209). From step S209, the process returns to step S203.

  FIG. 10 is a flowchart for explaining an operation for setting the display state of the drawing content by a certain pen (pen 2 as an example) to “displaying” in the operation example of the first embodiment. For all the drawing data (shown in FIG. 6) respectively corresponding to all the drawing contents, it is checked whether the drawing data is associated with the pen 2. Processing for changing the display state of the corresponding drawing content to “displaying” is performed.

  As is apparent from a comparison between FIG. 9 and FIG. 10, the only change in FIG. 10 with respect to FIG. 9 is that step S207 in the non-display process is changed to step S227 in the display process. In step S227, a non-display process corresponding to the drawing data is performed.

  Other steps are the same as those in FIG.

  Note that, as will be described later with reference to FIG. 16, drawing pixel data representing the drawing contents of each pen for each pen is drawn pixel data storage unit 315 corresponding to only the pen in screen display data storage unit 125. The drawing pixel data may be switched to be included in the combined drawing pixel data in accordance with whether or not the drawing content by the pen is displayed for each pen.

[Operation Example of Embodiment 2]
FIG. 11 is a diagram illustrating a transition of the screen of the electronic blackboard in the operation example of the second embodiment.

11 (a) is "ABCDE" is drawn by the pen 1, "Kakikukeko" is drawn with the pen 2, after "Sashisuseso" is drawn by the pen 3, a drawing content by the pen 1 "ABCDE ”And the display state of“ Sashisuseso ”which is the drawing content of the pen 3 remain“ displaying ”, but the display state of“ Kakikukeko ”which is the drawing content of the pen 2 is switched to“ not displaying ”. It shows how it is being done. Here, as shown in FIG. 11B, when the screen is wiped with an electronic eraser (for example, a pen having an eraser attribute) using the eraser function, the screen shown in FIG. As shown in the drawing, the drawing contents of the “displaying” pen 1 among the drawing contents in the portion approaching the locus wiped by the electronic eraser are drawn with the “displaying” pen 3 and the “displaying” pen 3. “Suseso” is erased, but “Kakikakeko”, which is the drawing content of the “not displaying” pen 2, is not erased. FIG. 11C shows a screen after the display state of the pen 2 is returned to “displaying” after the use of the eraser function. The drawing content of the pen 2 that is “not displayed” cannot be erased even if the eraser function is used, and after that, since it is returned to “displaying”, it is displayed on the screen of FIG. Yes.

  FIG. 12 is a flowchart for explaining the operation of the operation example of the second embodiment.

  First, drawing data that is a candidate for erasure is detected (step S241). In the case of erasing all screens, all drawing data are candidates for erasure. In the case of designating an area, drawing data included in the area is a candidate for erasure. In the case of using the eraser function, for example, the locus of the eraser is detected every predetermined period, and the drawing data approaching the locus becomes a candidate to be erased.

  Next, the processing between step S243S and step S243E is repeated for all the drawing data detected in step S241.

  In each repetition, first, a touch pen ID corresponding to drawing data that is a candidate for erasure selected in the current repetition is acquired (step S245).

  Next, it is determined whether “displaying” is set for the touch pen ID acquired in step S245 (step S247). If “displaying” is set (YES in step S247), a process of erasing the drawing data that is the candidate for erasure selected in the current repetition from the image display data storage unit 125 is performed (step S247). S249). If “not displayed” is set (NO in step S247), the drawing data that is the candidate for erasure selected in the current repetition is maintained in the image display data storage unit 125. To do.

[Operation Example of Embodiment 3]
FIG. 13 is a diagram illustrating a transition of the screen of the electronic blackboard in the operation example of the third embodiment.

  In FIG. 13A, “Aiueo” is drawn by the pen 1, “Kakikukeko” is drawn by the pen 2, “Sashisuseso” is drawn by the pen 3, and “Aiueo” which is the drawing content by the pen 1 is drawn. The display state of “Sashisuseso”, which is the drawing content of the pen 3, remains “displaying”, but the display state of “Kakikukeko”, which is the drawing content of the pen 2, is switched to “not displaying”. It shows how it is. Here, as shown in FIG. 13B, an attempt is made to start drawing using the touch pen 2. As a result, a message box for notifying that drawing with the touch pen 2 cannot be performed is displayed as shown in FIG. 13C because “not displayed” is currently set for the drawing content with the touch pen 2. Drawing using the touch pen 2 is prohibited.

  FIG. 14 is a flowchart for explaining the operation of the operation example of the third embodiment.

  Referring to FIG. 14, first, the process waits until pen-down is detected (step S261). If detected, the touch pen communicates with the touch pen signal receiver 107 (step S263).

  Next, the individual identification information of the touch pen is acquired from the communication result in step S263 (step S265).

  Next, it is confirmed whether or not the touch pen ID number corresponding to the individual identification information acquired in step S265 exists in the table in the touch pen ID number management unit 121 (step S267). If it does not exist (NO in step S267), an error message for notifying that the pen-down touch pen cannot be used because it is not registered is displayed (S269).

  If it exists (YES in step S267), the touch pen ID number retrieved from the table in the touch pen ID number management unit 121 in step S267 is determined to be that of the pen down touch pen (step S271).

  Next, it is confirmed whether or not the display state corresponding to the touch pen ID determined in step S271 is “displaying” (step S273). If it is “displaying” (YES in step S273), the process proceeds to a drawing process (step S275) with the pen-down touch pen. If it is “not displayed” (NO in step S273), an error message for notifying that the drawing content of the pen-down touch pen is currently “not displayed” cannot be used. It is displayed (S277).

  In the drawing process (step S275), drawing data as shown in FIG. 6 is generated based on the confirmed touch pen ID and the touch pen trajectory, stored in the screen display data storage unit 125, and the stored drawing data is further stored. An image signal including the reflected contents is generated and transmitted to the screen.

[Operation Example of Embodiment 4]
FIG. 15 is a diagram illustrating a transition of the screen of the electronic blackboard in the operation example of the fourth embodiment. The operation example of the fourth embodiment is a case where an electronic blackboard is used in an arithmetic class.

  FIG. 15A shows a state in which a problem for obtaining the volume of a solid figure is displayed on the screen. This screen is displayed, for example, by an application program executed on a personal computer connected to the electronic blackboard.

  FIG. 15B shows a state where the student A has written an answer using the touch pen 1.

  In FIG. 15C, the teacher confirms the answer written by the student A and then presses the “Pen 1 non-display” button to temporarily draw the drawing content of the touch pen 1, that is, the student A writes it. It shows a state in which the display state of the response content is “not displayed”.

  FIG. 15 (d) shows a state where student B has written an answer by another solution using the touch pen 2.

  Thereafter, when the teacher presses the “Pen 2 non-display” button and further presses the “Pen 1 display” button, the display state of the answer content written by the student B using the touch pen 2 is “non-display”. The answer content written by the student A using the touch pen 1 can be returned to “displaying”.

  The method described with reference to FIG. 9 is used when the display state of the answer content written by the student A is set to “hidden” or the display state of the answer content written by the student B is set to “hidden”. A similar method is performed.

  Further, when returning the answer content written by the student A to “displaying”, a method similar to the method described with reference to FIG. 10 is executed.

[Detailed configuration example]
FIG. 16 is a block diagram showing a detailed configuration example of a portion related to the present invention of the electronic blackboard according to the embodiment of the present invention. The configuration example corresponds to the case where the erase unit is image data for each trajectory. The display device of the present invention includes, for example, the blocks shown in FIG.

  Referring to FIG. 16, this configuration example includes an erasure area detection unit 301, a drawing pixel data synthesis unit 317, and a synthesis drawing pixel data storage unit 319 as configuration blocks corresponding to the entire touch pens 1 to 3.

  Further, in this configuration example, as a configuration block corresponding to the touch pen 1, a pen 1 erase numerical value drawing data detection unit 303-1 for each trajectory, a pen 1 numerical value drawing data erase prevention unit 305-1, and a pen 1 numerical value drawing for each trajectory. A data erasing unit 307-1, a pen 1 numerical drawing data generation unit 309-1, a pen 1 numerical drawing data storage unit 311-1, a pen 1 drawing unit 313-1, and a pen 1 drawing pixel data storage unit 315-1 are included.

  Further, in this configuration example, as a configuration block corresponding to the touch pen 2, a pen 2 erase numerical value drawing data detection unit 303-2 for each locus, a pen 2 numerical drawing data erase prevention unit 305-2, and a pen 2 numerical drawing for each locus. A data erasing unit 307-2, a pen 2 numerical drawing data generation unit 309-2, a pen 2 numerical drawing data storage unit 311-2, a pen 2 drawing unit 313-2, and a pen 2 drawing pixel data storage unit 315-2 are included.

  Further, in this configuration example, as a configuration block corresponding to the touch pen 3, a pen 3 erased numerical value drawing data detecting unit 303-3 for each locus, a pen 3 numerical value drawing data erasure preventing unit 305-3, and a pen 3 numerical value drawing data for each locus. It includes an erasing unit 307-3, a pen 3 numerical drawing data generation unit 309-3, a pen 3 numerical drawing data storage unit 311-3, a pen 3 drawing unit 313-3, and a pen 3 drawing pixel data storage unit 315-3.

  Each said memory | storage part is provided in the screen display data storage part 125, for example. Each unit other than the above-described storage units is realized, for example, by the control unit 109-1 reading and executing a program stored in the storage unit 109-5. In addition, at least a part of each unit other than each of the above-described storage units is constructed in the RAM 109-7 by, for example, reading and executing a program stored in the storage unit 109-5 by the control unit 109-1. Sometimes it is done.

  Next, the description related to each block will be described particularly in relation to the touch pen 1, but the description related to the touch pen 1 can also be applied to the touch pen 2 and the touch pen 3.

  The pen 1 numerical drawing data generation unit 309-1 generates pen 1 numerical drawing data based on the pen 1 locus data and the like.

  The pen 1 numerical drawing data storage unit 311-1 stores pen numerical drawing data. The erase area detection unit 301 detects an erase area. When erasing using the eraser function, for example, the erase region is detected based on the locus of the eraser for each predetermined period. When erasing is performed by designating an area, for example, the erasure area is detected based on the upper left coordinates and lower right coordinates of the area. In the case of erasing all data, the entire area is set as an erase area.

  The pen 1 erase numerical drawing data detection unit 303-1 for each locus is based on the erase area detected by the erase region detection unit 301 and the pen 1 numerical drawing data stored in the pen 1 numerical drawing data storage unit 311-1. Then, the pen 1 numerical drawing data corresponding to the locus included in the erasure area is detected as the numerical drawing data to be erased. Here, the numerical drawing data is as shown in FIG.

  The pen 1 numerical drawing data erasure prevention unit 305-1 inputs the display state of pen 1 display / non-display from Table 2, and when the display state is “displaying”, the pen 1 numerical value drawing for each locus is drawn. The drawing data number (see FIG. 6), which is identification information for designating the numerical drawing data to be erased output from the data detection unit 303-1, is output to the pen 1 numerical drawing data erasing unit 307-1 for each locus as it is. However, when the display state is “not displaying”, no drawing data number is output to the pen 1 numerical drawing data erasing unit 307-1 for each locus.

  The pen 1 numerical drawing data erasure unit 307-1 for each locus stores the numerical drawing data designated by the drawing data number input from the pen 1 numerical drawing data erasure prevention unit 305-1 as the pen 1 numerical drawing data storage unit 311-1. Erase from

  By doing so, it is possible to prevent the drawing data from the touch pen whose display state is “not displaying” from being erased.

  The pen 1 drawing unit 313-1 generates pen 1 drawing pixel data based on the pen 1 numerical drawing data stored in the pen 1 numerical drawing data storage unit 311-1.

  The pen 1 drawing pixel data storage unit 315-1 stores pen pixel drawing data.

  When the pen 1 display / non-display data input from Table 2 indicates “displaying”, the drawing pixel data composition unit 317 stores the pen 1 stored in the pen 1 drawing pixel data storage unit 315-1. The drawing pixel data is output to the combined drawing pixel data storage unit 319. Conversely, when the pen 1 display / non-display data input from Table 2 indicates “not displaying”, the pen 1 drawing pixel data stored in the pen 1 drawing pixel data storage unit 315-1 is stored. The data is not output to the composite drawing pixel data storage unit 319.

  Note that all the stored contents of the combined drawing pixel data storage unit 319 are erased every frame, and the drawing pixel data combining unit 317 is operated every frame. In other words, if the pen n display / non-display state is “displaying”, the contents of the pen n drawing pixel data storage unit 315-n are copied to the composite drawing pixel data storage unit 319, and the “n not displaying” state is displayed. If it does, copy it. However, only the pixel data to be switched from “displaying” to “not displaying” is deleted from the combined drawing pixel data storage unit 319 without deleting the storage contents of the combined drawing pixel data storage unit 319 every frame. It may be erased.

  Thus, when “displaying” is set as the display state for the touch pen whose pen pixel drawing data is stored in the pen 1 drawing pixel data storage unit 315-1, the drawing content of the touch pen is displayed. On the other hand, when “non-display” is set as the display state, the drawing content by the touch pen is not displayed.

  Accordingly, it is possible to display only the drawing content with the touch pen whose display state is “displaying”.

  As described above, the description related to the touch pen 1 can be applied to the touch pen 2 and the touch pen 3, and thus the same description related to the touch pen 2 and the touch pen 3 is omitted.

  In this configuration example, the erase unit is the numerical drawing data for each locus. In other words, the erasing unit is the entire drawing data shown in FIG. 6, but the erasing unit may be a data set unit included in the drawing data shown in FIG. 6 or a pixel unit.

  Further, by using the invention described in Patent Document 2, a function that allows a plurality of touch pens to draw simultaneously may be added and combined with the above embodiment.

  The display device and the electronic blackboard described above can be realized by hardware, software, or a combination thereof. The above display method can also be realized by hardware, software, or a combination thereof. Here, “realized by software” means realized by a computer reading and executing a program.

  The program may be stored using various types of non-transitory computer readable media and supplied to the computer. Non-transitory computer readable media include various types of tangible storage media. Examples of non-transitory computer readable media include magnetic recording media (for example, flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (for example, magneto-optical disks), CD-ROMs (Read Only Memory), CD- R, CD-R / W, semiconductor memory (for example, mask ROM (Read Only Memory), PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (random access memory)). The program may also be supplied to the computer by various types of transitory computer readable media. Examples of transitory computer readable media include electrical signals, optical signals, and electromagnetic waves. The temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.

  The present invention can be used for drawing on a screen provided with a touch panel using a plurality of touch pens.

101 Screen 103 Touch Panel Processing Unit 105 Touch Pen 107 Touch Pen Signal Receiver 109 IWB Function Unit 109-1 Control Unit 109-3 Communication Unit 109-5 Storage Unit 109-7 RAM
121 Touch pen ID number management unit 123 Display state management unit for each touch pen ID number 125 Screen display data storage unit

Claims (26)

A display device for displaying content drawn with a plurality of pens on a screen based on drawing data corresponding to the content,
If drawing is performed using any one of the plurality of pens, drawing data generating means for generating the pen and drawing data corresponding to the drawing;
Storage means for storing the drawing data;
If drawing data corresponding to the pen is stored in the storage means during a period in which the display mode is set for any of the plurality of pens, the drawing data corresponding to the pen is used based on the drawing data. Drawing data corresponding to a pen is allowed to be displayed on the screen, and drawing data corresponding to the pen is displayed during a period in which a non-display mode is set for any of the plurality of pens. Display permission / prohibition control means for prohibiting display of the drawing content corresponding to the pen on the screen, even if stored in the storage means;
Display means for displaying the drawing content permitted to be displayed on the screen by the display permission / prohibition control means based on at least a part of the drawing data stored in the storage means. When,
If there is a drawing content corresponding to any one of the plurality of pens in the part on the screen to be erased by the erasing means, and the display mode is set for the pen, the memory is stored. Erasing control means for erasing the drawing data corresponding to the drawing contents from the means, and controlling not to erase the drawing data corresponding to the drawing contents from the storage means when the non-display mode is set,
A display device comprising: The display device according to claim 1,
Drawing for maintaining the drawing data corresponding to the pen stored in the storage means unchanged during a period in which the non-display mode is set for any of the plurality of pens. A display device further comprising data maintaining means. The display device according to claim 2,
The drawing data maintaining means includes
Erasure preventing means for preventing drawing data corresponding to the pen from being erased from the storage means during a period in which the non-display mode is set for any of the plurality of pens. A display device comprising: The display device according to claim 3,
The erasure preventing unit is configured to display a non-display mode corresponding to the pen on a portion of the screen to be erased by the erasing unit during a period in which the non-display mode is set for any of the plurality of pens. A display device characterized by preventing drawing data corresponding to the drawing content from being erased from the storage means even if there is drawing content being displayed. The display device according to claim 2,
The drawing data maintaining means includes
A display device comprising drawing prohibiting means for prohibiting drawing using a pen during a period in which a non-display mode is set for any of the plurality of pens . The display device according to any one of claims 2 to 4,
After the non-display mode is set for any one of the plurality of pens, when “display” is set for the pen, immediately before the non-display mode is set, A display device further comprising a re-display unit for re-displaying a drawing content with a pen. A display device according to any one of claims 2 to 5,
A display device further comprising display / non-display setting means for setting display / non-display for each of at least some of the plurality of pens. The display device according to claim 7,
The display / non-display setting means includes:
Means for displaying an icon for each pen that can be set to display / hide on the screen;
When an operation on the icon is detected, a means for switching display / non-display corresponding to the icon,
A display device comprising: The display device according to claim 7 or 8,
The display / non-display setting means can be used for setting any of the pens to be set and the pen selected from at least one other pen. A display device characterized by being configured to be. A display device according to any one of claims 1 to 9,
It is possible to assign one or both of the assignment of any one of a plurality of different colors and the assignment of any one of a plurality of different thicknesses to the same pen. A display device further comprising an assigning unit for the purpose. A display device according to any one of claims 1 to 10,
At least a part of the plurality of pens individually corresponds to an individual user. The display device according to any one of claims 1 to 11,
A display device further comprising simultaneous drawing means for simultaneously drawing with at least two of the plurality of pens.   An electronic blackboard comprising the display device according to any one of claims 1 to 12. A display method for displaying content drawn with a plurality of pens on a screen based on drawing data corresponding to the content,
If drawing has been performed using any one of the plurality of pens, a drawing data generation step for generating drawing data corresponding to the pen and the drawing;
A storage step of storing the drawing data in a storage means ;
If drawing data corresponding to the pen is stored in the storage means during a period in which the display mode is set for any of the plurality of pens, the drawing data corresponding to the pen is used based on the drawing data. Drawing data corresponding to a pen is allowed to be displayed on the screen, and drawing data corresponding to the pen is displayed during a period in which a non-display mode is set for any of the plurality of pens. A display permission / prohibition step for prohibiting the display of the drawing content corresponding to the pen on the screen, even if stored in the storage means;
A display step of displaying the drawing content permitted to be displayed on the screen by the display permission / inhibition step based on at least a part of the drawing data stored in the storage unit; ,
If there is a drawing content corresponding to any one of the plurality of pens in the part on the screen to be erased by the erasing means, and the display mode is set for the pen, the memory is stored. An erasure control step for erasing the drawing data corresponding to the drawing content from the means and controlling not to erase the drawing data corresponding to the drawing content from the storage means when the non-display mode is set;
A display method characterized by comprising: The display method according to claim 14, comprising:
Drawing for maintaining the drawing data corresponding to the pen stored in the storage means unchanged during a period in which the non-display mode is set for any of the plurality of pens. A display method further comprising a data maintenance step. The display method according to claim 15, comprising:
The drawing data maintaining step prevents the drawing data corresponding to the pen from being erased from the storage means during a period in which the non-display mode is set for any of the plurality of pens. A display method comprising an erasure prevention step for The display method according to claim 16, comprising:
In the erasure prevention step, a non-display mode corresponding to the pen is applied to a portion on the screen to be erased by the erasure step during a period in which the non-display mode is set for any of the plurality of pens. A display method characterized by preventing drawing data corresponding to the drawing content from being erased from the storage means even if the drawing content being displayed is present. The display method according to claim 15, comprising:
The drawing data maintaining step includes:
A display method comprising: a drawing prohibiting step for prohibiting drawing using a pen during a period in which a non-display mode is set for any of the plurality of pens . A display method according to any one of claims 15 to 17,
After the non-display mode is set for any one of the plurality of pens, when “display” is set for the pen, immediately before the non-display mode is set, A display method, further comprising a redisplay step of redisplaying the drawing content with the pen. The display method according to any one of claims 15 to 18, comprising:
The display method further comprising a display / non-display setting step for setting display / non-display for each of at least some of the plurality of pens. The display method according to claim 20, comprising:
The display / non-display setting step includes:
Displaying an icon for each pen that can be set to display / hide on the screen;
Upon detecting an operation on the icon, a step of switching display / non-display corresponding to the icon,
A display method characterized by comprising: The display method according to claim 20 or 21,
The display / non-display setting step can be used for setting any of the pens to be set and the pen selected from at least one other pen. A display method characterized by being configured. The display method according to any one of claims 14 to 22,
It is possible to assign one or both of the assignment of any one of a plurality of different colors and the assignment of any one of a plurality of different thicknesses to the same pen. A display method further comprising an assigning step for: The display method according to any one of claims 14 to 23, wherein:
A display method, wherein at least some of the plurality of pens individually correspond to individual users. 25. The display method according to any one of claims 14 to 24, wherein:
The display method further comprising a simultaneous drawing step for simultaneously drawing with at least two of the plurality of pens. A display program for causing a computer to function as the display device according to any one of claims 1 to 12.

Images