JP5109613B2 - Display device and program - Google Patents

Description

  The present invention relates to a technique for displaying content drawn by an operator on an image displayed in a display area in the display area.

There is known a technique for an operator to input information by handwriting on a displayed document or the like such as a touch panel display. The operator can draw a desired character or figure by tracing the display surface with a stylus pen or the like. In this case, it is desirable that the drawing by the operator be performed on a blank portion of the image or the like so as not to disturb the visual recognition of the image such as the document that is originally displayed. For example, Patent Document 1 discloses a technique for reducing an electronic sticky note by omitting a part of the inputted character when displaying an electronic sticky note in which handwritten input characters are written. Since the size of the electronic sticky note is thus reduced, the electronic sticky note does not get in the way when the display image that was originally displayed is visually recognized.
JP 2006-53741 A

By the way, when the operator draws some information in the margin portion of the image, the drawing position may protrude from the margin portion and overlap with the originally displayed image. In this way, if the operator's drawing content overlaps with the originally displayed image, the drawn content is buried in the image, and it is difficult to see not only the image but also the drawn content. turn into. In particular, when the display is monochrome display, it is more difficult to distinguish between the two.
The present invention has been made in view of such a background, and an object thereof is to make it easy to visually recognize an image displayed on a display unit and contents drawn on the display unit by an operator. To do.

In order to solve the above problems, the present invention includes a display unit that displays an image in a display area, an input unit that receives an operation in which an operator inputs drawing content to the display area in which the image is displayed, A plurality of overlapping states representing a state in which the region where the image is displayed in the display region and the region where the drawing content is input overlap, and a plurality of display modes when the drawing content is displayed in the display region Are stored in association with each other, determination means for determining the overlapping state in the display area where the drawing content is input by the operator, and the storage means in association with the overlapping state determined by the determination means A display control means for specifying a display form stored in the display means and displaying the drawing content on the display means in the specified display form. To provide.
Thereby, it is possible to make it easy to visually recognize the image displayed on the display means and the content drawn by the operator on the display means.

In a preferred aspect of the present invention, the determination unit includes a region circumscribing the drawing content, including a drawing position where the drawing content is input in the display region, and a blank region where the image is not displayed in the display region. Alternatively, the overlapping state may be determined based on the size of the area where the image region where the image is displayed overlaps.
Thus, in a display form corresponding to the size of the area where the area circumscribing the drawing content input by the operator and the blank area where the image is not displayed or the image area where the image is displayed overlap in the display area , The input drawing content can be displayed.

In a preferred aspect of the present invention, the determination means determines whether the overlap is based on the number of matches between the drawing position where the drawing content is input in the display area and the display position where the image is displayed in the display area. The state may be determined.
As a result, the input drawing content is displayed in a display form corresponding to the number of matches between the drawing position where the drawing content is input in the display area and the display position where the image is displayed in the display area. be able to.

In a preferred aspect of the present invention, the determination unit includes a region circumscribing the drawing content, including a drawing position where the drawing content is input in the display region, and a blank region where the image is not displayed in the display region. Or the width of the area where the image area where the image is displayed overlaps, the drawing position where the drawing content is input in the display area, and the display position where the image is displayed in the display area The overlap state may be determined based on the number of matching numbers.
As a result, the area that circumscribes the drawing content input by the operator and the margin area where the image is not displayed in the display area or the area where the image is displayed overlap, and the display area The input drawing content can be displayed in a display form corresponding to the number of matches between the drawing position where the drawing content is input and the display position where the image is displayed in the display area.

In a preferred aspect of the present invention, when the operator inputs a plurality of drawing contents, the determination means ends the input of the first drawing contents included in the plurality of drawing contents, and then the second drawing contents. When the time measured for each of the plurality of drawing contents falls within a predetermined time, the region in which the plurality of drawing contents are input and the image are displayed. You may determine the overlap state with the area.
Thereby, even when the operator continuously inputs a plurality of drawing contents, they can be displayed in the same display form.

In a preferred aspect of the present invention, the storage means stores, as the overlapping state, the first overlapping state, the second overlapping state, and the third overlapping state in descending order of the overlapping degree, As a display form corresponding to the first overlapping state, a first display form for displaying the inputted drawing content at the drawn position is stored, and input as a display form corresponding to the second overlapping state. In addition, a second display form for displaying the drawing content in a display form selected by the operator is stored, and the input drawing content is reduced or drawn as a display form corresponding to the third overlapping state. You may memorize | store the 3rd display form moved and displayed from a position.
As a result, when there is a large degree of overlap between the area where the image is displayed and the area where the drawing content is input in the display area, the input drawing content is displayed at the drawn position, and the degree When is small, the input drawing content can be reduced or moved from the drawn position and displayed.

In a preferred aspect of the present invention, the display control unit displays the plurality of drawing contents at the drawn positions until the determination unit determines the plurality of drawing contents, and the plurality of drawing contents are displayed. When the determination by the determination unit is made, the display form stored in the storage unit in association with the overlap state determined by the determination unit is specified, and the plurality of drawing contents may be displayed in the specified display form. Good.
Thereby, when the operator continuously inputs a plurality of drawing contents, the operator can visually recognize the drawing contents being input before the plurality of drawing contents are completely input.

According to another aspect of the present invention, there is provided a computer including a display unit that displays an image in a display area and a storage unit. A plurality of overlapping states representing a state in which the area where the image is displayed in the display area and the area where the drawing content is input overlap, and a plurality of times when the drawing content is displayed in the display area Storage control means for associating the display forms with each other and storing them in the storage means, determination means for determining the overlap state in the display area, and the storage means in association with the overlap state determined by the determination means A program for specifying a stored display form and for functioning as a display control means for displaying the drawing content on the display means in the specified display form To provide a beam.
Thereby, it is possible to make it easy to visually recognize the image displayed on the display means and the content drawn by the operator on the display means.

[Constitution]
FIG. 1 is a diagram illustrating an appearance of a display device 1 according to the present embodiment. The display device 1 is a so-called electronic paper configured to be small and light, and has a function of displaying contents drawn by an operator in addition to a function of displaying an image based on image data. Therefore, the operator of the display device 1 can draw a desired character, figure, or the like in the display area F by tracing the surface of the display area F on which a document or the like is displayed with the stylus pen 2.

  FIG. 2 is a diagram showing a configuration of the display device 1 shown in FIG. As shown in the figure, the display device 1 includes a power supply unit 10, a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, and a memory display 14. , A display control unit 15, a touch panel 16, and a touch panel control unit 17.

  The power supply unit 10 includes, for example, a rechargeable battery and a power control circuit, and supplies power necessary for the operation of the display device 1 to each unit of the display device 1 surrounded by a one-dot chain line in the drawing. The CPU 11 executes the program stored in the ROM 12 to control the overall operation of the display device 1 and perform various processes. The ROM 12 is a read-only memory, and stores a program executed by the CPU 11 and various data handled by the program. The ROM 12 stores a display form specifying table T for specifying the display form of the drawing content input by the operation of the operator. The RAM 13 is used as a work area for the CPU 11 when the CPU 11 executes the program.

  The memory display 14 is a display means using cholesteric liquid crystal, electrophoresis, or the like, and displays various images in its display area under the instruction of the CPU 11. The memory display 14 has a memory property and can continue to display an image even when power supply is stopped. In the following description, an image displayed on the memory display 14 is referred to as a “display image”. An area in which no image is displayed in the display area is referred to as a “margin area”. The display control unit 15 controls the memory display 14 to display an image based on the supplied image data. The display control unit 15 includes a VRAM 150 in which image data for one frame of an image displayed on the memory display 14 is stored.

  The touch panel 16 is a transparent panel provided on the surface of the memory display 14 described above, and senses the presence or absence of an object contact for each predetermined minute area. This minute area is associated with a predetermined number of pixels (for example, 1 × 1 pixel or 3 × 3 pixel) in the memory display 14. When the touch panel 16 outputs a sensing signal indicating that the object is in contact with each minute region, the touch panel control unit 17 generates contact position information representing the detected position based on the sensing signal and sends it to the CPU 11. Supply. At this time, the touch panel control unit 17 generates contact position information representing each position according to an xy coordinate system in which the upper left corner point of the display area of the memory-type display body 14 is the origin 0. Contact position information continuously supplied from the touch panel control unit 17 to the CPU 11 is recorded in the RAM 13 as drawing data. That is, the touch panel 16 and the touch panel control unit 17 operate in cooperation to function as an input unit that accepts an operation in which the operator inputs drawing content to the display area of the memory display body 14.

  Here, the display form specification table T stored in the ROM 12 will be described. This display form specifying table T represents a state in which an area in which drawing contents are input by an operation of an operator and an area in which a display image is displayed are overlapped. FIG. 11 is a table showing a correspondence relationship with a display form when displaying drawing contents in each overlapping state. The area where the drawing content is input is an area including at least a position designated as a drawing position of the drawing content by the stylus pen 2 and is hereinafter referred to as a drawing area. Here, the minimum rectangular area (circumscribed rectangular area) circumscribing the input drawing content is set as the drawing area.

FIG. 3 is a diagram showing an example of the display form specifying table T. As shown in FIG. As shown in the figure, in this display form specifying table T, “margin area overlap rate”, “display image overlap rate”, and “display form information” are associated.
The “margin area overlap rate” is a value indicating how much the drawing area of the drawing content input by the operation of the operator overlaps with the margin area of the memory display 14. If this “blank area overlap rate” is high, it means that most of the drawing contents are drawn in the blank area. In this case, it can be said that there is a high possibility that the operator has erroneously drawn the portion where the drawing content and the display image overlap. On the other hand, if the “margin area overlap ratio” is low, it means that most of the input drawing contents are drawn on the display image. In this case, it can be said that there is a high possibility that the operator intentionally draws the portion where the drawing content and the display image overlap. In the example of FIG. 3, three types are assumed as the width of the area where the drawing area and the blank area overlap. Specifically, when the margin area overlap rate is 80% or more, the overlap degree is determined as “high”, and when it is 50% or more and less than 80%, the overlap degree is determined as “medium”. , The degree of overlap is determined to be “low”.

  The “display image overlap rate” is a value indicating how much the drawing content input by the operation of the operator overlaps with the image displayed in the display area of the memory display 14. Here, a plurality of overlapping states are distinguished by the size of the number at which the drawing position where the drawing content is input matches the display position of the display image. If this “display image overlap ratio” is high, it means that the degree of overlap between the input drawing content and the display image is large. On the other hand, if the “display image overlap ratio” is low, it means that the degree of overlap between the input drawing content and the display image is small. In the example of FIG. 3, when the image overlap rate of the drawing area is 50% or more, the degree of overlap is determined as “high”, and when it is 20% or more and less than 50%, the degree of overlap is “medium”. If it is less than 20%, the degree of overlap is determined to be “low”.

  “Display form information” is information for specifying a display form when displaying the drawing content input by the operation of the operator. The “first display form” in the figure is information for specifying a display form in which the input drawing content is displayed as it is at the drawn position. The “second display form” is information that specifies a display form in which the input drawing content is displayed in the display form selected by the operator. The “third display form” is information for specifying a display form in which the input drawing content is reduced and displayed at a predetermined reduction rate. In FIG. 3, for example, when the blank area overlap rate is “high” and the display image overlap rate is “high”, the “second display mode”, that is, the display mode selected by the operator is displayed as the display mode of the drawing content. The display form for displaying the drawing content is specified.

[Operation]
Next, FIG. 4 is a flowchart showing a procedure executed by the CPU 11. The operation of the display device 1 will be described with reference to FIG.
First, the operator uses the stylus pen 2 to perform an operation for displaying an image such as a document in the display area of the memory display 14. In response to this operation, the CPU 11 reads out image data from an auxiliary storage device (not shown) and the like, supplies it to the display control unit 15, and displays an image corresponding to the image data in the display area of the memory display 14. It is displayed (step S100).

  FIG. 5 is a diagram showing a state in which the image P (display image) is displayed in the display area F of the memory display 14 at this time. The image P represents a horizontally written document and is displayed near the center of the display area F as a whole.

  Next, the CPU 11 creates a margin position list representing the position of the margin area of the memory display 14 (step S110 in FIG. 4). Here, a method for creating the margin position list will be specifically described. First, the CPU 11 first specifies a character string of each line constituting the document by using a character recognition technique such as OCR (Optical Character Reader), and generates a circumscribed rectangle of each character string. As a result, circumscribed rectangles P1, P2, P3,... Px shown in FIG. All the areas other than the circumscribed rectangles P1, P2, P3,... Px are blank areas. Next, the CPU 11 divides the blank area so that each of the blank areas is rectangular, and specifies the position coordinates of the four corners of each divided blank area. In the example shown in FIG. 5, the blank area where the image P is not displayed in the display area F is divided into the blank areas S1, S2, S3, S4, and S5, and the position coordinates of the four corners of the blank areas S1 to S5 are the same. Identified. The blank area S5 is a generic name for a plurality of blank areas between character strings. Next, the CPU 11 creates a margin position list in which margin identification information representing each margin area and the position coordinates of the four corners of the margin area are associated with each other and stored in the RAM 13.

  FIG. 6 is a diagram showing the margin position list L created in this way. As shown in the figure, the margin position list L includes “sp01” which is the margin identification information for identifying the margin area S1 shown in FIG. 5 and the position coordinates of the top left vertex A of the margin area S1. (X0, y0) ”,“ (x1, y0) ”which is the position coordinate of the upper right vertex B,“ (x0, y1) ”which is the position coordinate of the lower left vertex C, and the lower right vertex D The position coordinates “(x1, y1)” are stored in association with each other. In the margin position list L, the margin identification information “sp02” to “sp05” and the position coordinates of the four corners of the margin area are associated with the margin areas S2 to S5 in the same manner as described above. It is remembered. Since the blank area S5 is a generic name of a plurality of blank areas, blank identification information after “sp05” is attached, but is omitted in the figure.

  Next, the CPU 11 determines whether or not the stylus pen 2 has been pen-downed by the operator (step S120 in FIG. 4). This pen down means that the operator brings the stylus pen 2 into contact with the surface of the touch panel 16. If the stylus pen 2 is not pen-down by the operator (step S120: NO), the CPU 11 waits until the pen-down is performed. On the other hand, when the stylus pen 2 is pen-downed by the operator (step S120: YES), the CPU 11 inputs the contact position information sequentially supplied from the touch panel control unit 17 in time series, thereby inputting by the stylus pen 2. Drawing data representing the drawn contents is recorded in the RAM 13 (step S130). Next, the CPU 11 determines whether or not the input of the drawing content in a predetermined unit by the stylus pen 2 has been completed (step S140). Here, when the stylus pen 2 is separated from the surface of the touch panel 16 and a few seconds have passed, it is determined that the input of the drawing content in a predetermined unit has been completed. When it is determined that the drawing content input has not ended (step S140: NO), the CPU 11 returns to the process of step S120. Therefore, while the operator draws the drawing contents one after another without leaving a time interval, it is determined that the input of the drawing contents is not completed, and the contents drawn by the operator are a group of drawing contents. Will be treated as.

  On the other hand, if it is determined that the input of the drawing content has been completed (step S140: YES), the CPU 11 determines the margin area overlap rate and the display image overlap rate based on the margin position list and the drawing data stored in the RAM 13. Is calculated (step S150). Here, these calculation methods will be specifically described.

  First, the “margin area overlap ratio” can be calculated using the formula “area where the drawing area and the margin area overlap / drawing area”. As described above, the drawing area is an area inside the circumscribed rectangle of the drawn image, and is obtained based on the drawing data recorded in the RAM 13. Also, the margin area is obtained based on the position coordinates extracted from the margin position list L. Hereinafter, a region where the drawing region and the blank region overlap is referred to as a “product rectangular region”.

  Here, FIG. 7 is a diagram illustrating a state in which the operator draws a double underline below the character string “company A” in the display image “company A ...”, for example. . In the drawing, the drawing area is an area A1 surrounded by a dotted line, and the product rectangular area is a shaded area A2 in the drawing area A1. Therefore, the blank area overlap ratio is the area of the area A2 / the area of the area A1.

  Next, the “display image overlap rate” can be calculated by using an expression “number of pixels of drawing data at a position overlapping the display image / total number of pixels of drawing data”. This pixel is the smallest unit that can be expressed by the memory-type display 14 when displaying an image. As a method of counting the number of pixels of the drawing data, for example, using the position coordinates of each pixel in the drawing data recorded in the RAM 13, the number of pixels located in the blank area and the number of pixels located on the display image are calculated. There is a way to count. In this case, the number of pixels located on the display image is “the number of pixels of the drawing data at the position overlapping the display image”, and the number of pixels located in the blank area and the number of pixels located on the display image are The sum of the pixels is the total number of pixels in the drawing data. In the example of FIG. 7, the number of double underline pixels is, for example, 80 pixels. If the number of pixels overlapping each character is 4, the display image overlap rate is 4/80 = 5%.

  Next, the CPU 11 refers to the display form specifying table T stored in the ROM 12, and in the display form specifying table T, displays the display form information associated with the calculated blank area overlap rate and display image overlap rate. It is specified (step S160 in FIG. 4). In the example shown in FIG. 3, when the “margin area overlap ratio” is “low”, and when the “margin area overlap ratio” is “medium” and the “display image overlap ratio” is “high”. The “first display form” is specified. This means that the “first display form” is specified when the degree of overlap between the display image and the region where the drawing content is input is large. In addition, when the “margin area overlap ratio” is “medium” and the “display image overlap ratio” is “medium”, the “margin area overlap ratio” is “high” and the “display image overlap ratio” is “ In the case of “medium” or “high”, the “second display form” is specified. This means that the “second display form” is specified when the degree of overlap between the display image and the region where the drawing content is input is medium. Further, when the “margin area overlap rate” is “medium” or “high” and the “display image overlap rate” is “low”, the “third display mode” is specified. This means that the “third display mode” is specified when the degree of overlap between the display image and the area where the drawing content is input is small.

  When the display form is specified, the CPU 11 reads the drawing data recorded in the RAM 13 into the VRAM 150 of the display control unit 15. Subsequently, the CPU 11 uses the display control unit 15 to display the drawing content represented by the drawing data in the display area of the memory display body 14 in the display form represented by the specified display form information (step S170 in FIG. 4). ). That is, the CPU 11 determines a state of overlapping indicating a state in which an area where an image is displayed overlaps an area where the drawing content is input in a display area where the drawing content is input by the operator, and The display mode stored in association with the overlap state determined by the determination unit is specified, and functions as a display control unit that displays the drawing content input in the specified display mode. Thereby, the drawing content input by the operator using the stylus pen 2 is displayed in the display area of the memory-type display body 14 in a display form corresponding to the overlapping state of the area where the drawing content is input and the display image. Is done.

Next, the above operation will be described with a more specific example.
(When there is a large degree of overlap between the area where the drawing content is input and the display image area)
For example, in a state where the image P shown in FIG. 5 is displayed in the display area F of the memory-type display body 14, the operator pens down the stylus pen 2 and starts drawing a frame image around the image P. Is assumed.

  FIG. 8A is a diagram illustrating a state in which a frame image is input to the touch panel 16. A locus R1 in the figure represents a locus obtained by tracing the surface of the touch panel 16 with the stylus pen 2 in order for the operator to input a frame image. The locus R1 is not actually displayed on the memory display 14. In this case, in step S120 of FIG. 5 described above, it is determined that the stylus pen 2 has been lowered (step S120: YES), and in step S130, drawing data corresponding to the locus R1 shown in FIG. To be recorded. In subsequent step S140, while the operator is inputting the frame image, it is determined that the input of the drawing content in a predetermined unit is not completed (step S140: NO). Thereafter, when the operator finishes inputting the frame image and releases the stylus pen 2 from the touch panel 16, it is determined that the input of the drawing content in a predetermined unit is completed after a few seconds have elapsed (step S140: YES).

  Subsequently, in step S150, the margin area overlap rate and the display image overlap rate are calculated based on the drawing data of the frame image stored in the RAM 13 and the margin position list. At this time, since the drawing area of the frame image is a circumscribed rectangle, the drawing area a1 shown in FIG. 8A is used. In this example, the margin area overlap ratio is calculated by “the product rectangular area / drawing area a1 of the drawing area a1 and the margin areas S1 to S5”. Further, the display image overlap ratio is calculated by “the number of pixels of the drawing data corresponding to the locus R1 located on the image P / the total number of pixels of the drawing data corresponding to the locus R1”. In the example of the figure, the drawing area a1 and the margin areas S1 to S4 of the input frame image overlap each other little by little, and the locus R1 and the image P do not overlap. In this case, the blank area overlap rate is low and the display image overlap rate is also low. Here, it is assumed that “19%” is calculated as the blank area overlap rate and “0%” is calculated as the display image overlap rate.

  Subsequently, in step S160, display form information associated with the calculated blank area overlap rate “19%” and display image overlap rate “0%” is specified in the display form specifying table T shown in FIG. Is done. In this example, the “margin area overlap rate” is “low (less than 20%)” and the “display image overlap rate” is “low (less than 20%)”. "Display form" is specified. Subsequently, in step S170, first, drawing data recorded in the RAM 13, that is, drawing data representing the input frame image is read out to the VRAM 150. The frame image represented by the drawing data is displayed in the display form specified by the “first display form”, that is, the display form in which the inputted drawing content is displayed as it is at the drawn position. Displayed in the display area.

FIG. 8B is a diagram showing a frame image R10 displayed on the memory display 14 at this time. As shown in the figure, the frame image R10 has the same shape as the trajectory R1 shown in FIG. 8A, and is further displayed at the same position as the trajectory R1. As described above, the operator has drawn a frame image around the image P. From this, the operator's intention of drawing is to make the drawing area a1 of the frame image and the image P overlap. It is presumed that the frame image is drawn. Therefore, even if the drawing area a1 of the frame image and the image P are displayed while being overlapped, the display content is not contrary to the operator's intention.
When the process of step S170 is completed in this way, the CPU 11 returns to the process of step S120 again and waits until the operator pens down again.

(When the degree of overlap between the area where drawing content is input and the display image area is small)
Next, in a state where the image P shown in FIG. 5 is displayed in the display area F of the memory-type display body 14, the operator pens down the stylus pen 2, and the character “☆ point” is displayed below the image P. Suppose you start drawing an image.

  FIG. 9A is a diagram illustrating a state in which a character image “☆ point” is input to the touch panel 16. A locus R2 in the drawing represents a locus when the operator traces the surface of the touch panel 16 with the stylus pen 2 in order to input the character image. As described above, the locus R2 is not actually displayed on the memory display 14. In this case, it is determined in step S120 described above that the stylus pen 2 has been pen-down (step S120: YES), and in step S130, drawing data corresponding to the locus R2 shown in FIG. . In subsequent step S140, while the operator is inputting this character image, it is determined that the input of the drawing content in a predetermined unit has not been completed (step S140: NO). Thereafter, when the operator finishes inputting the character image and releases the stylus pen 2 from the touch panel 16, it is determined that the input of the drawing content in a predetermined unit is completed after a few seconds have elapsed (step S140: YES).

  Subsequently, in step S150, the margin area overlap rate and the display image overlap rate are calculated based on the drawing data of the character image stored in the RAM 13 and the margin position list. At this time, a drawing area a2 shown in FIG. 9A is used as the drawing area of the character image. In this example, the margin area overlap ratio is calculated by “the product rectangular area / drawing area a2 of the drawing area a2 and the margin areas S2 to S4”. Further, the display image overlap ratio is calculated by “the number of pixels of drawing data corresponding to the locus R2 located on the image P / the total number of pixels of drawing data corresponding to the locus R2”. In the example of the figure, the drawing area a2 and the margin areas S2 to S4 of the input character image almost overlap each other, and the locus R2 and the image P slightly overlap each other. In this case, the blank area overlap rate is high and the display image overlap rate is low. Here, it is assumed that “90%” is calculated as the blank area overlap rate and “10%” is calculated as the display image overlap rate.

  Subsequently, in step S160, the display form information associated with the calculated blank area overlap rate “90%” and the display image overlap rate “10%” is specified in the display form specifying table T shown in FIG. Is done. In this example, the “margin area overlap rate” is “high (80% or more)” and the “display image overlap rate” is “low (less than 20%)”. "Display form" is specified. Subsequently, in step S <b> 170, first, the drawing data recorded in the RAM 13, that is, the drawing data representing the inputted character image “☆ point” is read out to the VRAM 150. The character image represented by the drawing data is displayed in a display form specified by the “third display form”, that is, in a display form in which the inputted drawing content is reduced and displayed at a predetermined reduction ratio. 14 display areas.

FIG. 9B shows a character image R20 displayed on the memory display 14 at this time. As shown in the figure, the character image R20 is displayed by reducing the character image “☆ point” represented by the locus R2 shown in FIG. 9A at a predetermined reduction ratio. As a result, in the locus R2, a part of the character “PO” is applied to the image P. However, in the character image R20 shown in FIG. 9B, no part of the character image is applied to the image P. It fits in the margin area. As described above, the operator has drawn the character image “☆ point” below the image P. From this, the operator's intention of drawing is not to overlap the character image and the display image. It is presumed that the character image is drawn. Therefore, the display device 1 can perform image display in accordance with the operator's intention by correcting and displaying the character image R20 and the image P so that they do not overlap.
When the process of step S170 is completed in this way, the CPU 11 returns to the process of step S120 again and waits until the operator pens down again.

(If the area where the drawing content is input and the area of the display image overlap moderately)
Next, in a state where the image P shown in FIG. 5 is displayed in the display area F of the memory-type display body 14, the operator causes the stylus pen 2 to pen-down so that the image P is applied as “point →”. Assume that a character image has started to be drawn.

  FIG. 10A is a diagram illustrating a state in which a character image “point →” is input to the touch panel 16. A locus R3 in the figure represents a locus when the operator traces the surface of the touch panel 16 with the stylus pen 2 in order to input the character image. As described above, the locus R3 is not actually displayed on the memory display 14. In this case, it is determined in step S120 described above that the stylus pen 2 is pen-down (step S120: YES), and in step S130, drawing data corresponding to the locus R3 shown in FIG. . In subsequent step S140, while the operator is inputting this character image, it is determined that the input of the drawing content in a predetermined unit has not been completed (step S140: NO). Thereafter, when the operator finishes inputting the character image and releases the stylus pen 2 from the touch panel 16, it is determined that the input of the drawing content in a predetermined unit is completed after a few seconds have elapsed (step S140: YES).

  Subsequently, in step S150, the margin area overlap rate and the display image overlap rate are calculated based on the drawing data of the character image stored in the RAM 13 and the margin position list. At this time, a drawing area a3 shown in FIG. 10A is used as the drawing area of the character image. In this example, the margin area overlap ratio is calculated by “the product rectangular area / drawing area a3 of the drawing area a3 and the margin area S4”. Further, the display image overlap ratio is calculated by “the number of pixels of the drawing data corresponding to the locus R3 located on the image P / the total number of pixels of the drawing data corresponding to the locus R1”. In the example of the figure, the drawing area a3 and the margin area S4 of the input character image overlap by more than half, and the locus R3 and the image P overlap by a little less than half. In this case, the blank area overlap rate is slightly high, and the display image overlap rate is also slightly high. Here, it is assumed that “60%” is calculated as the blank area overlap rate and “30%” is calculated as the display image overlap rate.

  Subsequently, in step S160, display form information associated with the calculated blank area overlap rate “60%” and display image overlap rate “30%” is specified in the display form specifying table T shown in FIG. Is done. In this example, the “margin area overlap rate” is “medium (50% or more and less than 80%)” and the “display image overlap rate” is “medium (20% or more and less than 50%)”. The attached “second display form” is specified. Subsequently, in step S <b> 170, first, the drawing data recorded in the RAM 13, that is, the drawing data representing the inputted character image “point →” is read out to the VRAM 150. The character image represented by the drawing data is displayed on the memory display 14 in a display form specified by the “second display form”, that is, a display form in which the drawing contents are displayed in the display form selected by the operator. Displayed in the area. In this case, the CPU 11 first displays a warning message indicating that the input drawing content and the image overlap with each other and an image for prompting the selection of the display form in the display area of the memory display 14. When the operator selects one of the display forms according to this, the CPU 11 displays the drawing contents in the selected display form.

FIG. 10B is a diagram showing a message image M including a warning message and an image for prompting selection of a display form displayed on the memory display 14 at this time. As shown in the figure, in the message image M, a warning message “Drawing contents overlaps with the display image” and a button b1 for selecting a display form (first display form) for displaying the drawn contents as they are. And a button b2 for selecting a display form (third display form) for displaying the drawn content in a reduced size. For example, when the operator presses the button b1 using the stylus pen 2, the character image “point →” corresponding to the locus R3 shown in FIG. Displayed in the area. On the other hand, when the operator presses the button b2 using the stylus pen 2, the character image “point →” corresponding to the locus R3 shown in FIG. 10A is reduced at a predetermined reduction rate. Is displayed. In this way, the operator is prompted to select the display mode of the input drawing content when the overlap between the region where the drawing content is input and the image is medium. This is because it cannot be determined whether it has been drawn or whether it has been intentionally overlaid. By displaying the input drawing content in the display form selected by the operator, it is possible to display an image in accordance with the operator's intention.
When the process of step S170 is completed in this way, the CPU 11 returns to the process of step S120 again and waits until the operator pens down again.

  According to the embodiment described above, even when the operator draws drawing contents such as characters and figures on the touch panel 16, even if the drawing contents protrude from the blank area and overlap the display image, the display image It is corrected and displayed so as not to overlap. As a result, the operator does not have to draw the input drawing content so as to fit in the blank area. When the display area F of the display device 1 is small or the operator is a child, it is difficult to draw the input drawing contents so as to fit in the blank area, which is further useful. Furthermore, since the rendering content input by the operator and the display image are corrected and displayed so as not to overlap with each other, the content rendered by the operator and the image displayed on the memory display 14 are visually recognized. It becomes easy to do.

[Modification]
The above is the description of the embodiment, but the contents of this embodiment can be modified as follows. Further, the following modifications may be combined as appropriate.
(Modification 1)
In the above-described embodiment, when the “third display form” is specified, the input drawing content is reduced and displayed at a predetermined reduction ratio, but the present invention is not limited to this. The display form specified by the “third display form” may be a display form in which the input drawing content does not overlap the display image. For example, when the “third display form” is specified, the input drawing content may be moved to the nearest blank area and displayed. More specifically, referring to the example shown in FIG. 9, the CPU 11 displays the character image “☆ point” corresponding to the locus R2 shown in FIG. 9A from the position of the locus R2 in the same size. Is moved downward, that is, moved to a position that fits in the blank area S4. At this time, the CPU 11 compares the position of the drawing content “☆ point” and the size of the drawing area with the position and size of the margin area in the margin position list, and is larger than the size of the drawing area and placed in the drawing area. A margin area at a close position is selected, and the drawing content is displayed in the margin area. Even in this configuration, the content drawn by the operator and the image displayed on the memory display 14 can be easily visually recognized, as in the above-described embodiment.

(Modification 2)
In the above-described embodiment, when the “third display form” is specified, the input drawing content is reduced and displayed at a predetermined reduction ratio. On the other hand, the CPU 11 may calculate the maximum reduction ratio (highest reduction ratio) to fit the input drawing content in the blank area, and display the drawing content reduced at the calculated reduction ratio. Good. This reduction ratio can be calculated based on the size of the drawing content represented by the drawing data recorded in the RAM 13 and the size of the margin area calculated from the position coordinates of the margin area described in the margin position list. . As a result, when the “third display form” is specified, the drawing content can be displayed in the blank area regardless of the size of the input drawing content. However, if the calculated reduction ratio is too low, the input drawing content is displayed very small. In particular, when a character image as shown in FIG. 9 or FIG. 10 is input, it is difficult to visually recognize the character when the reduction ratio is low. Therefore, when the calculated reduction ratio is lower than a predetermined threshold, the CPU 11 may display the input drawing content as it is without reducing it.

(Modification 3)
In the above-described embodiment, the CPU 11 returns to the process of step S120 after the process of step S170 is completed. On the other hand, when the process of step S170 ends, the CPU 11 may return to the process of step S110 and update the margin position list. In this case, in the margin position list, the position coordinates of the margin area excluding the area where the drawing content is input in step S170 are described. According to this configuration, for example, after a certain operator inputs drawing content, even if another operator draws another drawing content on top of the drawing content, the “third display form” is specified. It becomes like this. Thereby, it is possible to make it easy to visually recognize the drawing content already input and the drawing content input thereafter.

(Modification 4)
In the embodiment described above, the drawing content is displayed after it is determined that the input of the drawing content has been completed. On the other hand, until it is determined that the input of the drawing content is completed, the content being drawn may be displayed as it is, for example, at the position drawn in pixel units. In this case, if it is determined that the input of the drawing content has been completed, the processing after step S150 is performed in the same manner as in the above-described embodiment. According to this configuration, the operator can visually recognize the contents being drawn.

(Modification 5)
In the above-described embodiment, the CPU 11 determines that the input of the drawing content in a predetermined unit has been completed when several seconds have passed after the stylus pen 2 is separated from the surface of the touch panel 16. That is, when the operator inputs a plurality of drawing contents, the CPU 11 determines the time from the end of the input of a certain drawing content included in the plurality of drawing contents to the start of the input of the next drawing contents. When the time measured and measured for each of a plurality of drawing contents falls within a predetermined period, the plurality of drawing contents are handled as a group of drawing contents. On the other hand, the CPU 11 may determine whether or not the input of the drawing content of a predetermined unit has been completed based on other conditions. For example, when the stylus pen 2 is separated from the surface of the touch panel 16, the CPU 11 may determine that the input of drawing content in a predetermined unit has been completed. Alternatively, the CPU 11 determines that the input of the drawing content in a predetermined unit has been completed, for example, when the drawing button provided in the display device 1 is turned off while being designated by the operation of the operator. Also good.

(Modification 6)
In the above-described embodiment, the display form specifying table T illustrated in FIG. 3 has been described as an example of the display form specifying table T stored in the ROM 12, but the present invention is not limited thereto. The contents of the display form specifying table T may be determined as appropriate. When the display device 1 includes a readable / writable non-volatile storage unit such as a flash memory, the display form specifying table T may be stored in the non-volatile storage unit. In this case, the operator can rewrite the contents of the display form specifying table T using the stylus pen 2 or the like. Alternatively, the display form specifying table may be described in the program stored in the ROM 12, and the display form specifying table may be written and used by the CPU 11 in the non-volatile storage unit when the program is executed.

(Modification 7)
In the above-described embodiment, the display form information is specified based on the blank area overlap rate and the display image overlap rate. On the other hand, the display form information may be specified based on either the blank area overlap rate or the display image overlap rate.
First, an example in the case of specifying display form information based on the display image overlap rate will be given. For example, the “first display mode” may be specified when the display image overlap ratio is “90% or more”, and the “third display mode” may be specified when “less than 10%”. In this case, in the display form specifying table, the display image overlap rate “90% or more” and “first display form” are associated with the display image overlap rate “less than 10%” and “third display form”. Thus, if the degree of overlap between the drawing contents and the display image is large, the drawing contents are displayed in the “first display form”, and if the degree of overlap between the drawing contents and the display image is small, the drawing contents are displayed in the “third display form”. Can be displayed.

Next, an example in the case of specifying display form information based on the blank area overlap rate will be described. For example, “third display mode” is specified when the margin area overlap rate is “80% or more”, “second display mode” is specified when “50% or more and less than 80%”, and “less than 50%” ”May be a configuration in which the“ first display form ”is specified. In this case, in the display form specifying table, the blank area overlap ratio “80% or more” and “third display form”, the blank area overlap ratio “50% or more and less than 80%” and “second display form”, and the blank area overlap. The rate “less than 50%” is associated with the “first display form”. Thus, if the degree of overlap between the drawing area of the drawing contents and the margin area is large, the drawing contents are displayed in the “third display mode”, and the degree of overlap between the drawing area of the drawing contents and the margin area is moderate. For example, the drawing contents can be displayed in the “second display form”, and the drawing contents can be displayed in the “first display form” if the degree of overlap between the drawing area and the margin area is small.
However, when specifying the display form information based only on the margin area overlap rate, for example, as shown in FIG. 7, the display image is tilted so as to slightly overlap the display image below the display image “from company A”. When the double underline is drawn, the “margin area overlap ratio” is lowered even though the double underline and the display image are slightly overlapped. In this case, the “first display form” in which the input drawing content is displayed as it is is specified, and the input drawing content is displayed while being overlapped with the display image without being reduced. In order to avoid such a situation, a configuration for specifying display form information based on the blank area overlap rate and the display image overlap rate as in the above-described embodiment is useful.

(Modification 8)
In the embodiment described above, the display form information of the input drawing content is specified based on the “margin area overlap rate”, but the present invention is not limited to this. For example, based on a “drawing area display image overlap ratio” indicating how much the drawing area of the drawing content input by the operation of the operator overlaps with the image area where the image is displayed on the memory display 14. The display form may be specified. In this case, if this “drawing area display image overlap ratio” is high, the display form information specified when the “margin area overlap ratio” is low is specified, and the “drawing area display image overlap ratio” is If it is low, the display form information specified when the “margin area overlap ratio” is high is specified. According to this configuration, since it is sufficient to know only the position of the display image, it is not necessary to create a margin position list.
That is, if the CPU 11 determines the overlapping state based on the size of the area where the drawing content input by the operator's operation and the blank area where the image is not displayed or the image area where the image is displayed overlap. Good.

(Modification 9)
In the embodiment described above, the CPU 11 performs the process shown in FIG. 4, but this process may be performed by the display control unit 15 instead of the CPU 11. In the embodiment described above, the program executed by the CPU 11 of the display device 1 is a magnetic tape, a magnetic disk, a flexible disk, an optical recording medium, a magneto-optical recording medium, a CD (Compact Disk), a DVD (Digital Versatile Disk), It can be provided in a state of being recorded on a recording medium such as a RAM. It is also possible to download to the display device 1 via a network such as the Internet. That is, the present invention can be realized as a program.

It is a figure which shows the external appearance of the display apparatus which concerns on this embodiment. It is a figure which shows the structure of the display apparatus. It is a figure which shows an example of a display form specific table. It is a flowchart which shows the procedure which CPU of the same display apparatus performs. It is a figure which shows a mode that the image was displayed on the display area of the display apparatus. It is a figure which shows a margin position list. It is a figure which shows a mode when a double underline is drawn by the same display apparatus. It is a figure which shows a mode that a frame image is input into the display apparatus. It is a figure which shows a mode that a character image is input into the display apparatus. It is a figure which shows a mode that another character image is input into the display apparatus.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Display apparatus, 2 ... Stylus pen, 10 ... Power supply part, 11 ... CPU, 12 ... ROM, 13 ... RAM, 14 ... Memory | storage display body, 15 ... Display control part, 150 ... VRAM, 16 ... Touch panel, 17 ... Touch panel control unit

Claims (8)

Display means for displaying an image in the display area;
An input means for accepting an operation for an operator to input drawing content to the display area in which an image is displayed ;
Determining means for determining an overlapping degree between an area where the image is displayed in the display area and an area where the drawing content is input ;
If the degree of overlap determined by the determination means is equal to or greater than a first threshold, the input drawing content is displayed on the display means at the drawn position, and the degree of overlap is the first degree. Display control means for reducing the input drawing content at a predetermined reduction rate or moving it in a predetermined direction and displaying it on the display means when it is less than a second threshold value smaller than the threshold value. A display device characterized by that. The determination means includes a region circumscribing the drawing content, including a drawing position where the drawing content is input in the display region, and a blank region or the image in which the image is not displayed in the display region. The display device according to claim 1, wherein the degree of overlap is determined based on a width of an area overlapping with an image area. The determination means determines the degree of overlap based on the number of matches between a drawing position where the drawing content is input in the display area and a display position where an image is displayed in the display area. The display device according to claim 1. The determination means includes a region circumscribing the drawing content, including a drawing position where the drawing content is input in the display region, and a blank region or the image in which the image is not displayed in the display region. Depending on the size of the area where the image area overlaps, and the size of the drawing position where the drawing content is input in the display area and the display position where the image is displayed in the display area match, The display device according to claim 1, wherein the degree of overlap is determined. When the operator inputs a plurality of drawing contents, the determination unit ends input of the first drawing contents included in the plurality of drawing contents and starts input of the second drawing contents. When the time is measured and the time measured for each of the plurality of drawing contents falls within a predetermined time, the degree of overlap between the area where the plurality of drawing contents are input and the area where the image is displayed The display device according to claim 1, wherein the display device is determined. The display control means includes
Until the determination by the determination means for the plurality of drawing contents, the plurality of drawing contents are displayed at the drawn positions,
6. The display device according to claim 5, wherein when the determination unit determines the plurality of drawing contents, the plurality of drawing contents are displayed in a display form corresponding to the overlapping degree determined by the determination unit. . The display control means displays the inputted drawing content at the drawn position when the overlapping degree determined by the determining means is not less than the second threshold value and less than the first threshold value. Of the display forms and the display forms that are displayed at the predetermined reduction ratio or are moved in a predetermined direction and displayed, the display unit displays the display form selected by the operator.
The display device according to claim 1, wherein the display device is a display device. A computer comprising a display means to display an image on the display area,
An input means for accepting an operation for an operator to input drawing content to the display area in which an image is displayed ;
Determining means for determining an overlapping degree between an area where the image is displayed in the display area and an area where the drawing content is input ;
If the degree of overlap determined by the determination means is equal to or greater than a first threshold, the input drawing content is displayed on the display means at the drawn position, and the degree of overlap is the first degree. If the input drawing content is reduced at a predetermined reduction ratio or moved in a predetermined direction and displayed on the display means when it is less than a second threshold that is smaller than the threshold, A program to make it work.

Images