JP5664164B2 - Electronic information board device, information display method, program - Google Patents

Description

  The present invention relates to an electronic information board device, and more particularly to an electronic information board device, an information display method, and a program capable of writing handwritten information on a captured screen.

  Electronic information boards, which are blackboards and whiteboards made into IT, have come to be used in school classes and conference presentations. The electronic information board is an input / output device that uses a board corresponding to a blackboard or white board as a user interface for information display and information input.

  There are various methods for realizing an electronic information board. For example, there are a method using a touch panel as an input device, a method for detecting the position of a pen-like member from a difference in arrival time between infrared rays and ultrasonic waves. As a display device, there are a method using a projector, a method using a flat panel display 50 such as liquid crystal or plasma, and the like. In any case, a computer-generated screen can be displayed on a large screen having a size of about 40 inches to 60 inches.

FIG. 1 is an example of a typical appearance of an electronic information board. In the electronic information board,
(1) A function for acquiring input such as handwritten characters and displaying the display device in real time,
(2) Capturing computer-generated screens and handwritten characters, and superimposing handwritten characters on screen data,
Etc. can be provided. The electronic information board 100 is used to display presentation materials on a display 50, for example, in a presentation at a conference, and the user writes characters, symbols, and the like there by handwriting.

  However, when handwriting characters or the like on the screen, there is a case where an appropriate place where the user can handwritten without overlapping the characters of the document on the screen may not be found. For example, there is a case where the visibility of a document on the screen is reduced when handwritten on a character displayed as a document.

  For such a problem, a technique of adding a blank space to the screen is conceivable (for example, see Patent Document 1). Patent Document 1 discloses an electronic information board that automatically adds a blank space when the end of the writing surface is reached during writing and the remaining space becomes insufficient.

  However, Patent Document 1 has a problem that a character or the like cannot be handwritten at an arbitrary place. When a user writes characters, symbols, or the like in a document, there are often cases where there is not enough margin in the portion to be written in the document. In this case, there is a problem that it is difficult for the user to read characters or the like by superimposing them on the text or diagram of the original document, making it difficult to read.

  FIG. 2 shows an example of a screen displayed on the electronic information board. This screen is, for example, a presentation material. The user writes on the screen of FIG. Before writing, the screen on which the presentation material is being displayed is captured (captured) on the electronic information board 100.

  As shown in FIG. 2B, when the user tries to add writing under the character “dog” in the pen tip, there is a blank space under the text to be written, so the user writes there. Can be added. However, since there is not always a margin in the vicinity of the object to be written, there is a problem that an appropriate place for writing cannot be found when there is no margin.

  In FIG. 2C, since the characters are densely placed at the place where the user wants to write, for example, even if the “?” Mark is handwritten, it must be superimposed on the original document. As a result, there has been a problem that it is difficult to read written characters and screen documents.

  In view of the above problems, an object of the present invention is to provide an electronic information board device, an information display method, and a program capable of adding a margin for writing to an arbitrary place of a document displayed on a screen by a simple operation. To do.

In view of the above problems, the present invention includes an image data storing means for storing the images data, and display means for displaying the image data, and the operation position detecting means for detecting the operation position of the operator on the display unit, when Stroke detection means for detecting a stroke from the locus of the operation position of the series, and when a stroke that matches a predetermined margin creation stroke is detected, image data with a blank space is generated by adding a blank area to the image data. a blank area creating means for, and blank there the image data storing means remembers the blank there image data, an image processing means for displaying the blank there image data on the display means, has, the margin creates stroke The blank area creating means adds the blank area according to the position and inclination of the linear stroke. Provides an electronic display board and wherein the.

  It is possible to provide an electronic information board device that can add a margin for writing in an arbitrary place of a document displayed on a screen by a simple operation.

It is a figure which shows an example of the typical external appearance of an electronic information board. It is a figure which shows an example of the screen which an electronic information board displays. It is an example of the figure explaining the schematic characteristic part of an electronic information board. It is an example of the hardware block diagram of an electronic information board. It is an example of the functional block diagram of an electronic information board. It is a figure which shows an example of the screen which application software displays on a display. It is a figure which shows an example of the screen which application software displays on a display. It is a figure which shows an example of the screen which application software displays on a display. It is an example of the figure which shows typically the screen data memorize | stored in a screen data storage part. It is an example of the figure explaining the procedure of creation of a margin. It is an example of the figure explaining operation which hides a margin. It is an example of the flowchart figure which shows the procedure in which an electronic information board produces a margin. It is an example of the flowchart figure which shows the procedure in which an electronic information board hides a margin. It is a figure which shows an example of the screen of the state which concealed the margin after creating a margin. It is an example of the figure which shows typically the example of a transition of the screen at the time of dividing | segmenting the screen of vertical writing into right and left. It is an example of the figure explaining determination of the division position which avoided the character.

Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings.
FIG. 3 is an example of a diagram illustrating a schematic feature of the electronic information board 100 of the present embodiment. The electronic information board 100 according to the present embodiment can add a margin to a portion where the user wants to add a margin.

  FIG. 3A shows an example of a document displayed on the display 50 of the electronic information board 100. Suppose that the user wants to create a blank area (hereinafter referred to as a margin) for handwriting in place A in this document. In this case, for example, the user can create a margin as shown in FIG. 3B by writing a horizontal line by hand at the location A and dragging the fingertip up and down across the line.

  If the margin is created, the user can perform desired writing. In the figure, underline and “?” Are handwritten under “the lazy dog”.

  As described above, the electronic information board 100 according to the present embodiment can realize an operation for adding a margin by a simple operation procedure of handwriting a line on a document and dragging in a vertical direction. You can make margins.

  In the present embodiment, an image displayed by the application software on the display 50 is referred to as a screen, and an electronic file that is the content of the image is simply referred to as a document. The document includes characters, symbols, numbers, figures, pictures, or information obtained by combining these. Further, even if the document includes a moving image, the one screen can be a handwritten object.

〔Constitution〕
FIG. 4 shows an example of a hardware configuration diagram of the electronic information board 100. The external appearance of the electronic information board 100 is assumed to be the same as in FIG. As shown in FIG. 1, the electronic information board 100 has a display 50 and a main body 60. The main body 60 is a computer built in the electronic information board 100. For this reason, the hardware configuration diagram is almost the same as that of the computer.

  The margin creation of this embodiment can be applied to the electronic information board 100 that uses a method of connecting a projector to the main body 60 and projecting a document onto a board having a position detection function instead of the mode shown in FIG.

  The electronic information board 100 includes a CPU 11, a ROM 12, a RAM 13, an external I / F 14, a communication device 15, an input device 16, a display control unit 17, and a storage device 18 that are mutually connected by a bus. The CPU 11 reads an OS (Operating System) 23 and a program 30 from the storage device 18 and executes them using the RAM 13 as a working memory.

  The program 30 provides functions of the electronic information board 100, such as a function of acquiring position information of a position where the user has operated the touch panel, a function of capturing a screen, and the like. The program 30 provides a characteristic function of the electronic information board 100 described later.

  Note that the program 30 can call a document created by the application software 24 and display the content of the document as a screen in the same manner as when the application software 24 displays the document. Also. By executing the program 30 and the application software 24 independently, the application 24 may display the contents of the document as a screen.

  The RAM 13 is a working memory (main storage memory) for temporarily storing necessary data, and the ROM 12 stores BIOS, initially set data, a startup program, and the like.

  The external I / F 14 is an interface for mounting a cable such as a USB cable or a portable storage medium 20. The storage medium 20 is a flash memory such as a USB memory, an optical storage medium such as a CD-ROM, or the like.

  The communication device 15 is called a LAN card or an Ethernet (registered trademark) card, and transmits data to a computer connected via a network according to an instruction from the CPU 11.

  The input device 16 is an input device such as a touch panel integrated with the display 50. Also included are a keyboard and a mouse (not shown) that receive various user operation instructions.

  The display control unit 17 is, for example, a graphic board, which analyzes screen information such as a predetermined resolution and the number of colors requested by the program 30 and application software 24 and outputs the screen information to the display 50.

  The storage device 18 has a nonvolatile memory such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive) as an entity, and stores an OS 23, a program 30, and the like. The program 30 is distributed in a state stored in the storage medium 20 or downloaded from a server (not shown).

  FIG. 5 shows an example of a functional block diagram of the electronic information board 100. The electronic information board 100 includes a display 50, a position detection unit 22, a control unit 25, and a screen data storage unit 32. The control unit 25 includes a screen capture unit 31, an operation determination unit 27, an image processing unit 26, a margin control unit 29, and a handwriting image processing unit 28. The function of the control unit 25 is realized mainly by the CPU 11 executing the program 30.

  The electronic information board 100 uses the function of the OS 23 in displaying the document 33 created by the application software 24, capturing the screen, and displaying the captured screen. For this reason, the OS 23 is illustrated.

  The position detection unit 22 detects a position on the display 50 where the user has touched (touched) with a finger, a stylus pen, or the like. As a method for detecting the position, a touch panel is mounted on the display 50, the position is detected based on changes in capacitance, pressure, and shape, and the pen is determined based on the difference in arrival time between infrared rays and ultrasonic waves emitted from the stylus pen. There are a method for detecting the position of the member, a method for optically detecting the irradiation position (which may be contacted or non-contacting) of light emitted from the pen tip instead of the contact position, and the like.

  When the position detection unit 22 detects the position at every predetermined cycle time, the locus of the tip of the finger or the stylus pen can be obtained. This position is, for example, X and Y coordinates in pixel units with the upper left corner of the display 50 as the origin. Note that the alignment is performed in advance so that the actual position in the screen matches the position information of the detected contact position.

  The control unit 25 controls the entire electronic information board 100. The operation determination unit 27 determines an operation performed by the user based on the position information. For example, when the position information is included in the display range of a button displayed on the screen, it is determined that an operation corresponding to the button has been performed. In addition, when the stroke obtained from the position information or the combination of strokes matches the predetermined stroke or the combination of strokes as described later, an operation associated with the predetermined stroke or the combination of strokes is performed. judge. The stroke refers to a single stroke from when a finger or the like touches until it leaves.

  When the operation determination unit 27 determines that the operation is not an operation, the handwriting image processing unit 28 generates a stroke trajectory image by connecting the position information detected by the position detection unit 22 in time series with a predetermined line width. Characters and figures are drawn by a set of strokes. Each stroke is stored in the screen data storage unit 32 in association with the screen data of the captured screen. The line width and line color can be selected by the user.

  The screen capture unit 31 makes a hard copy of the image of each screen of the document 33 and stores it in the screen data storage unit 32 by a user operation such as “open” the document 33 created by the application software 24. The document 33 created by the application software 24 is generally a special file format, but since a viewer is provided, the program 30 can open and display the document 33. The hard-copy screen data is called screen data.

  In order to take a hard copy, for example, the function of the OS 23 is used. Although the OS 23 supports data exchange between the application software 24 via the clipboard, the OS 23 can store a hard copy of the screen on the clipboard. The screen capture unit 31 requests the OS 23 to make a hard copy, thereby storing the screen data on the clipboard, acquires the screen data on the clipboard, and stores it in the screen data storage unit 32. The format of the screen data may be bitmap data or JPEG.

  The image processing unit 26 displays the screen on the display 50 by requesting the OS 23 to display the screen data stored in the screen data storage unit 32. Since the screen data of each page of the document 33 is stored in the screen data storage unit 32, the image processing unit 26 writes the screen data of the screen data storage unit 32 into the VRAM by a user operation such as page feed. The OS 23 displays the screen data written in the VRAM on the display 50. Thus, by capturing the screen, it is possible to save the screen and the handwritten information whose contents are the original document 33 without being handwritten directly to the original document 33.

  Further, the image processing unit 26 reads the stroke handwritten on the screen from the screen data storage unit 32 and displays the stroke superimposed on the screen margin or the screen. It is preferable that the user can operate whether or not to display a stroke on the screen.

  Although the margin control unit 29 will be described later, the margin control unit 29 performs a process of creating a margin in the captured screen data and erasing the margin.

[Screen transition example]
6 to 8 are examples of diagrams for explaining transitions of screens displayed on the display 50.
FIG. 6A shows an example of a screen on which the document 33 is displayed on the display 50. The document 33 is a document generated by, for example, application software 24 of presentation software. In FIG. 6A, the display 50 is divided into an application range 41 in which the screen of the document 33 is displayed and a control information range 42 in which operation buttons and messages generated by the control unit 25 are displayed. Yes.

  The application range 41 is a range where the screen of the document 33 of the application software 24 is displayed. The user can operate the electronic information board 100 by pressing the operation button in the control information range 42 with a finger or the like.

  Note that the application range 41 and the control information range 42 can be switched to a desired display mode such as only the application range 41 and only the control information range 42 by the user's operation of the electronic information board 100.

  FIG. 6B shows a display example in a state where a margin addition button 43 is displayed as an operation button in the control information range 42. The margin addition button 43 is a button for adding a margin to the screen of the application range 41. When the user wants to create a margin, the margin addition button 43 is pressed (touched) with a finger or the like. Since the position detection unit 22 notifies the operation determination unit 27 of the position information of the position pressed by the user, the operation determination unit 27 detects that the margin addition button 43 has been pressed based on the position information, and the margin control unit 29 Notify Thereby, the operation determination unit 27 determines that the user's handwriting with respect to the application range 41 is not a stroke writing on the screen but an operation for creating a margin.

  FIG. 9 is an example of a diagram schematically showing screen data stored in the screen data storage unit 32. The screen data storage unit 32 stores a screen ID, a screen data path, margin information, a margin screen data path, and a margin position / size. The screen ID is non-overlapping identification information for identifying the captured screen data. For example, numbers, characters, alphabets, and symbols are added. The screen data path indicates a folder in which the captured screen data is stored. The margin information is position information for creating a margin. The margin screen data path indicates a folder in which screen data in which a margin is created (hereinafter referred to as margin screen data) is stored. Thus, in this embodiment, the screen data and the margin screen data are stored separately and associated with each other by the screen ID.

  FIG. 7A is an example of a diagram schematically illustrating a user operation for creating a margin. After the user presses the margin addition button 43, the user draws a line (horizontal line 44 in the figure) on the screen of the application range 41 with a finger or the like. This line does not have to be a complete straight line, but the margin control unit 29 regards it as a straight line when it is curved to some extent. Alternatively, it can be forcibly regarded as a straight line by connecting the start point and the end point with a straight line.

  The operation determination unit 27 estimates the inclination based on the position of the start point and the end point in the position information of the line detected by the position detection unit 22 and specifies whether the line is a horizontal line or a perpendicular line. If the slope is greater than or equal to a predetermined value, it is a vertical line, and if it is less than the predetermined value, it is a horizontal line. Thereby, the direction in which the margin is created can be determined with higher accuracy. The operation determination unit 27 displays all the position information, or at least the position information of the start point and the end point, and the y coordinate of the horizontal line on the screen in the case of the horizontal line 44, and the x coordinate of the vertical line on the screen in the case of the vertical line. The margin information is stored in the storage unit 32. In FIG. 9, (xs, ys)... (Xe, ye) and y coordinates are stored in the margin information. (xs, ys) is the coordinate of the start point of the horizontal line 44, (xe, ye) is the coordinate of the end point of the horizontal line 44, and the y coordinate is the average value of ys to ye.

  FIG. 7B is an example of a diagram schematically illustrating a user operation for creating a margin. When creating a margin, the user presses the top and bottom of the horizontal line 44 with two fingers, and then moves the upper finger upward and the lower finger downward. Therefore, two strokes are obtained at the same time. It is known to the user that such an operation is necessary for creating margins.

The operation determination unit 27 determines whether the user operation is an operation for creating a margin based on the position information detected by the position detection unit 22. For example, the determination is made based on the following criteria from the position information.
・ Whether the horizontal line 44 is drawn within a certain period of time ・ While the position information is detected at the same time across the horizontal line 44 ・ Whether it has moved more than a predetermined value in the vertical direction (in the case of a horizontal line) The information is the position where the fingertips of the thumb and index finger are in contact. It is considered that this criterion is satisfied if the user moves the distance between the two fingers so as to increase. The operation determination unit 27 acquires a series of position information of each of two fingers, or position information of a start point and an end point. Preferably, the time information when the position information of the start point and the end point is detected is acquired. The movement speed of each of the user's fingers is obtained from the position information and time information of the start point and end point.

If the operation determination unit 27 determines that the operation is for creating a margin, the margin control unit 29 is requested to create a margin, so the margin control unit 29 creates a margin in the screen data.
FIG. 10 is an example of a diagram illustrating a procedure for creating a margin. First, the margin control unit 29 develops the screen data into a bitmap in the memory, and divides the original screen data based on the y coordinate of the horizontal line 44. The screen data below the divided screen data is moved by the margin. The size of the margin may be a fixed amount, or can be determined according to the amount of movement or movement speed of each of the user's fingers. For example, margin size = movement amount (difference between start point and end point) × k1 (adjustment parameter: about 1), margin size = movement amount × movement speed × k2 (adjustment parameter: 0 <k2 <2 ).

  The margin control unit 29 stores the margin position and size thus determined in the screen data storage unit 32. In FIG. 10, the y1 coordinate to y2 coordinate are the margin positions in the vertical direction of the screen, and L = y2−y1 is the margin size. Note that the y1 coordinate may coincide with the y coordinate of the horizontal line 44, but the y1 coordinate may differ from the y coordinate when the division position of the screen data is set to a line spacing as will be described later.

  Next, the margin control unit 29 replaces the color of the two-dimensional range (hatched portion in the figure) formed by moving the lower screen data with the same color as the background color of the background of the original screen data. The background of the original screen data is determined, for example, by creating a histogram of the RGB values of the original screen data and having the largest RGB value. When the background is not a single color, the pixel value may be always white (255, 255, 255) so that the user can easily draw characters and the like. The margin shown in the figure can be created by such a procedure. The user can also create a plurality of margins on one screen.

  FIG. 8A shows an example of a screen on which a margin is created. By creating a margin, the screen data becomes larger by the size of the margin. Therefore, it becomes difficult to display all the blank screen data in the application range 41 at a time. In such a case, the image processing unit 26 of the present embodiment displays the screen data in the application range 41 by two methods. One is a method of scrolling and displaying a portion that does not fit in the application range 41, and the other is a method of reducing and displaying the margin screen data so as to enter the application range 41. In FIG. 8A, it is assumed that the screen is displayed by scrolling, as indicated by the scroll bar on the right side of the application range 41.

  FIG. 8B shows an example of a screen in which the stroke 45 is handwritten in the margin. The margin control unit 29 notifies the image processing unit 27 when the margin creation is completed. The image processing unit 27 displays the margin screen data in the application range 41 and notifies the handwriting image processing unit 28.

  Thereby, the handwriting image processing unit 28 can generate a stroke from the subsequent position information. When the user performs handwriting on the margin screen data in the application range 41, the handwriting image processing unit 28 extends the stroke for each position information and requests the image processing unit 26 to draw in real time. The handwriting image processing unit 28 stores the stroke data in the screen data storage unit 32 for each stroke.

  In FIG. 8B, the dotted line and the “?” Stroke 45 are handwritten. In the case of a dotted line, one point may be a stroke, or the entire dotted line may be a stroke. Thus, by creating the margin, the user can write a character or the like by handwriting without being superimposed on the character of the original document 33.

  FIG. 9B is an example of a diagram schematically showing the stroke DB stored in the screen data storage unit 32. The stroke DB has registered items of stroke ID, position information, screen ID, color, and thickness. The stroke ID is stroke identification information that does not overlap within one screen or one document 33. For example, numbers, letters, alphabets, and symbols are added. The position information is position information of each coordinate constituting the locus of movement of the user's finger. The screen ID is the screen ID of the screen on which the stroke is handwritten. The screen on which the stroke is handwritten can be specified by the screen ID. The color indicates the stroke color, and the thickness indicates the thickness of the stroke. Therefore, once the handwriting image processing unit 28 stores the stroke, the image processing unit 26 can draw the stroke on the screen at any time.

  By the way, in the state of FIG.8 (b), it is also possible for a user to handwritten other than a blank. However, in this case, since the margin screen data is longer by L due to the margin, if the position information of the stroke is specified from the upper left of the margin screen data, the coordinates of the position information are shifted between when the margin is displayed and when not displayed. End up. Then, when the screen data is displayed instead of the margin screen data, the handwritten position is shifted downward. In order to prevent this, for example, handwriting may be recognized only in the margin while the margin screen data is being displayed.

  The margin stroke is also handwritten in the margin screen data that is long by L. However, since the margin stroke is displayed only together with the margin screen data, even if the stroke position information is specified from the upper left of the margin screen data, the margin stroke is specified. , Coordinates are not shifted.

[Hide margins]
FIG. 11A is an example of a diagram illustrating an operation for hiding margins. Since the user may want to restore the margin after creating the margin, the electronic information board 100 according to the present embodiment can return the screen to the original screen without the margin (the state without the margin).

  When hiding the margin, the user presses the horizontal line up and down with each of two fingers, and then moves the upper finger downward and the lower finger upward. It is known to the user that such an operation is necessary to hide the margin.

The operation determination unit 27 determines whether or not the user operation is an operation for hiding the margin based on the position information detected by the position detection unit 22. For example, the determination is made based on the following criteria from the position information.
・ Whether two pieces of positional information were detected at the same time across the horizontal line ・ Moved a predetermined value or more in the direction approaching the top and bottom (in the case of a horizontal line) or a button for hiding the margin is displayed in the control information range 42, By pressing the button, it may be detected that an operation for hiding margins has been performed.

  When the operation determination unit 27 determines that the operation is for hiding the margin, the operation determination unit 27 requests the image processing unit 26 to display screen data. The image processing unit 26 reads the screen data associated with the blank screen data being displayed from the screen data storage unit 32 and displays it on the display 50. By doing so, it is possible to display the original screen data with no margin.

  FIG. 11B shows an example of the original screen data. The image processing unit 26 displays a margin presence mark 46 when displaying the original screen data once the margin is created. Thereby, even if a margin is not displayed, the user can grasp at a glance that a margin has been created, or that a margin has been created and a handwritten stroke exists in the margin portion.

  The margin presence mark 46 is displayed at the y coordinate of the horizontal line 44 or the coordinate y1 that is the position of the margin. In the figure, there is a margin presence mark 46 at the same position as the horizontal line 44, but it may be displayed outside the screen. In FIG. 11B, a “scissors” icon and a line handwritten by the user to create a margin are displayed as a margin presence mark 46. The image processing unit 26 reads the margin information (y coordinate) or the margin position (y1 coordinate) from the screen data storage unit 32 and displays it together with the icon. In this way, the user can easily determine whether there is a margin.

  Further, the image processing unit 26 may change the margin presence mark 46 depending on whether only the margin is present or whether the margin and handwriting are hidden. By doing so, the user can easily determine whether or not to display the margin.

  The fact that the handwritten stroke 45 is hidden in the margin means that one or more y coordinates of the position information (xs, ys) to (xe, ye) of the stroke 45 are included in the margin positions y1 to y2. It can be determined by whether or not.

  If the user wants to display the margin again from the state of FIG. 11B, the same operation as that for creating the margin may be performed across the horizontal line. In this case, since the position of the horizontal line 44 is already stored, it is not necessary to press the margin addition button 43. In addition, the operation determination unit 27 can determine that the position information is not a handwritten stroke but an operation stroke since the position information of two locations is detected at the same time.

  When the operation determination unit 27 detects this operation, it requests the image processing unit 26 to display margin screen data. The image processing unit 26 reads the margin screen data instead of the screen data from the screen data storage unit 32, reads the strokes from the stroke DB, and displays them on the display 50, respectively.

[Operation procedure]
FIG. 12 is an example of a flowchart illustrating a procedure in which the electronic information board 100 according to the present embodiment creates a margin. The flowchart of FIG. 12 starts when the user presses the margin addition button 43. The screen capture unit 31 has already captured the screen data, and the screen data is stored in the screen data storage unit 32.

  The operation determination unit 27 determines whether or not the horizontal line 44 is detected (S10). When the horizontal line 44 is not detected (No in S10), the operation determination unit 27 waits, but when the horizontal line 44 is not detected for a predetermined time or longer, the pressing of the margin addition button 43 is canceled and the process of FIG. 12 ends.

  When the horizontal line 44 is detected (Yes in S10), the operation determination unit 27 determines whether an operation for creating a margin is detected (S20). When an operation for creating a margin is not detected (No in S20), the operation determination unit 27 waits for the above-described fixed time. If no operation is detected within the predetermined time, the pressing of the add margin button 43 is canceled, The process of 12 ends.

  When an operation for creating a margin is detected (Yes in S20), the margin control unit 29 records margin information in the screen data storage unit 32 (S30). That is, the position information and the y coordinate of the horizontal line 44 are recorded.

  Next, the margin control unit 29 creates a margin in the screen data (S40). The screen data storage unit 32 records the margin position and size.

  Further, the margin control unit 29 stores the margin screen data in which the margin is created in the screen data storage unit 32 (S50). Since the margin control unit 29 requests the image processing unit 26 to display the margin screen data, the image processing unit 26 displays the margin screen data on the display 50 (S60).

  Thereafter, the handwriting image processing unit 28 accepts handwritten stroke writing, so that the user can write handwritten information in the margin.

  FIG. 13 is an example of a flowchart illustrating a procedure for hiding the margin by the electronic information board 100 according to the present embodiment. The flowchart in FIG. 13 starts when the margin screen data is displayed.

  First, the operation determination unit 27 determines whether or not an operation for hiding margins has been detected (S110). The electronic information board 100 is considered to be capable of various other functional operations, but if it is not a specific operation, the handwriting image processing unit 28 creates and records a stroke from the handwritten position information.

  When an operation for hiding the margin is detected (S120). The image processing unit 26 reads the screen data from the screen data storage unit 32 and displays it (S130). As a result, the margin is deleted from the appearance of the screen.

  Then, the image processing unit 26 displays a margin presence mark 46 (S140). By doing so, the user can grasp that the margin and handwriting are hidden in the screen data.

[Modification]
Another Display Method of Margin Stroke FIG. 14 shows an example of a screen in which the margin is hidden after the margin is created. There are cases where the user wants to display a handwritten stroke in the margin while displaying the entire screen without displaying the margin. In such a case, the user double-clicks, for example, the margin presence mark 46 in the state shown in the left diagram of FIG. 14 (the same as in FIG. 11B).

  The operation determination unit 27 detects a double click at the position of the margin presence mark 46 and requests the image processing unit 26 to display a stroke. For example, the image processing unit 26 displays a stroke in a balloon 47 or the like. If necessary, the display may be reduced, or the entire display may be displayed by scrolling.

  Specifically, the image processing unit 26 specifies the margin information closest to the position of the margin presence mark 46 and reads the margin position. Then, the stroke included in the margin position (y1-y2 coordinates) is specified from the stroke DB, and displayed as, for example, a balloon 47. By doing so, it is possible to display a handwritten stroke in the margin without displaying the margin.

  Note that the balloon 47 on the right side of FIG. 14 is deleted, for example, when the user double-clicks the balloon 47, and the screen returns to the left side.

FIG. 15 is an example of a diagram schematically illustrating a screen transition example when a vertical writing screen is divided into left and right to create a margin. The user's operation is the same as the above example except that the horizontal line is a vertical line. Further, the criterion for determining whether or not the operation determination unit 27 is an operation for creating a margin is the same as the division in the horizontal direction except that the horizontal line is a vertical line.

As shown in FIG. 15A, the user handwrites the vertical line 48 and moves the fingertip in the direction in which the two fingers are separated across the vertical line 48. This creates a margin on the left side of the vertical line.
As shown in FIG. 15B, the user can write a handwritten stroke in the margin. In the figure, the explanation (spoken translation) of the original document 33 is handwritten in the created margin.

  When the user performs an operation of narrowing the distance between two fingers across the vertical line 48, the operation determination unit 27 determines that the operation is to hide the margin, and the image processing unit 26 displays the screen instead of the margin screen data. Data is displayed and a margin presence mark 46 is displayed. Therefore, even when the document 33 is vertically written, the user can create a margin and hide it by the same operation as in the case of horizontal writing.

-Creating a margin with a line boundary as the boundary In this embodiment, it is possible to create a margin at an arbitrary position. However, when a margin is created, if the character is divided into a part of the character, the readability of the character is impaired. . Therefore, when the user creates a margin in the character area, for example, even if the horizontal line (or vertical line) 44 overlaps with the character, it is preferable to create the margin by dividing the line.

  For this reason, when the horizontal line 44 is pressed in the character area, the margin control unit 29 divides the screen data between lines to create a margin. There are various methods for determining the character area. For example, the character area has many high level density pixels (black pixels) and low level density pixels (white pixels). The fact that pixels and white pixels are continuous is used. The margin control unit 29 performs vertical and horizontal edge processing, and can specify a character region from the fact that the black pixel region and the white pixel region are continuous across the edge.

  FIG. 16 is an example of a diagram for explaining determination of a division position avoiding characters. In the case of a character area, the margin control unit 29 determines in the horizontal direction from the left end of the screen whether there is a black pixel in the y coordinate in order from the y coordinate of the horizontal line 44. If there is a black pixel, it is not between lines, so a predetermined number of pixels are moved downward in the y coordinate of the horizontal line 44, and it is determined in the horizontal direction whether there is a black pixel at that y coordinate. By repeating this, it is possible to search for the line spacing closest to the y coordinate of the horizontal line 44. The margin control unit 44 divides the screen data from line to line to create a margin.

  In this way, even if the user draws the horizontal line 44 relatively roughly, a part of the character is not divided and the readability of the original document 33 is not impaired. Further, since the user does not need to select the line spacing and handwrite the horizontal line 44, the operability is improved. Further, even if the characters are dense and it is difficult for the user to draw a line between the lines, it is possible to create a margin by avoiding dividing the characters.

  As described above, the electronic information board 100 according to the present embodiment performs an operation for adding a margin to the screen displayed on the display 50 by handwriting a horizontal line or a vertical line and two fingers in the vertical direction. It can be realized by a simple operation procedure of dragging each. For this reason, the user can intuitively create a margin. In addition, since a margin is created, handwriting can be performed even if characters and the like are dense. Since the screen data and the margin screen data are stored, the margin once created can be hidden or the margin can be displayed again.

20 Storage Medium 22 Position Detection Unit 23 OS
24 application software 25 control unit 26 image processing unit 27 operation determination unit 28 handwriting image processing unit 29 margin control unit 30 program 31 screen capture unit 32 screen data storage unit 33 document 41 application range 42 control information range 43 margin addition button 44 horizontal line 45 Stroke 46 Margin presence mark 50 Display 60 Main body 100 Electronic information board

JP 2001-306210 A

Claims (11)

Image data storage means for storing image data;
Display means for displaying the image data;
Operation position detecting means for detecting an operation position of the operator in the display means;
Stroke detecting means for detecting a stroke from the locus of the operation position in time series;
When a stroke that matches a predetermined margin creation stroke is detected, a blank area creating means for creating blank image data in which a blank area is added to the image data;
And blank there the image data storing means remembers the blank there image data,
Image processing means for displaying the blank image data on the display means ,
The margin creation stroke includes a linear stroke, and the blank area creation means adds the blank area according to the position and inclination of the linear stroke.
An electronic information board device. The margin creation stroke is
The linear first stroke;
Two points sandwiching the first stroke are the second and third strokes in the direction away from the first stroke, respectively.
The electronic information board device according to claim 1. The stroke detection means detects the stroke of the blank area from the locus of the operation position of the operator on the display means on which the image data with blank is displayed, and stores the operation position constituting the stroke in the stroke data storage means. To
The electronic information board device according to claim 2. The image processing means, when a stroke that coincides with the predetermined margin creation stroke is detected, before the blank area associated with the image data with blank being displayed on the display means is added. Displaying the image data on the display means,
The electronic information board device according to claim 2 or 3, The image data storage means stores the position information of the first stroke in association with the image data,
The image processing means displays a margin presence mark at the position of the first stroke of the image data when displaying the image data on the display means.
The electronic information board device according to claim 4. Wherein the image processing means, wherein the stroke of the blank area in the reduced display to be displayed on said display means together with the image data, the electronic information board apparatus according to claim 4 or 5, wherein the. The blank area creating means, when the position of the linear stroke is included in the character area of the image data, separates the image data into two from the space between the character and the character line, and adds the blank area. The electronic information board device according to any one of claims 1 to 6 .   The electronic information board device according to claim 1, wherein the blank area creating unit adds the blank area having the same color as a background color of the image data. The blank area creating means determines that the slope of the linear stroke is a vertical line if it is greater than or equal to a predetermined value, and a horizontal line if it is less than a predetermined value,
The blank area creating means divides the image data in a direction perpendicular to the linear stroke, and creates the blank image data by adding the blank area between the divided image data. The electronic information board device according to claim 1 . A display means for displaying the image data stored in the image data storage means ;
An operation position detecting means for detecting an operation position of an operator on the display means;
A step of detecting a stroke from a trajectory of the operation position in time series;
When a stroke that matches a predetermined margin creation stroke is detected, the blank region creation means adds a blank region corresponding to the position and inclination of the linear stroke included in the margin creation stroke to the image data. Generating image data with blank space,
Storing said blank there image data into blank there image data storage means,
And an image processing means for displaying the blank image data on the display means. On the computer,
A display step of displaying the image data stored in the image data storage means on the display means;
An operation position detecting step for detecting an operation position of an operator on the display means;
A stroke detection step for detecting a stroke from the locus of the operation position in time series;
When a stroke that matches a predetermined margin creation stroke is detected, blank image data in which a blank area corresponding to the position and inclination of the linear stroke included in the margin creation stroke is added to the image data is obtained. A blank area creation step to be generated;
A storing step of storing said blank there image data into blank there image data storage means,
An image processing step of displaying the blank image data on the display means;
A program that executes

Images