JP2012073809A - Display terminal and control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display terminal and a control program which can easily perform enlarged display suitable for writing input.SOLUTION: When a writing start position on a touch panel is detected (S10:YES), based on the position as a starting point, a display terminal searches display data (S12). The display terminal calculates lengths L1 to L4 from the writing start position to the display data (S13). An enlarged area is determined by taking the L1 to L4, in principle, for respective dimensions M1 to M4 of the enlarged area (S16 to S27). In the enlarged area, the display data around the writing start position is included, so that positional relation of the writing position in entire image information becomes clear.

Description

  The present invention relates to a display terminal having a display unit and a control program.

  2. Description of the Related Art Conventionally, display terminals that can display image information such as text and documents on a display screen and are portable are known. In such a display terminal, for example, handwritten data such as characters handwritten by a user on a touch panel of the display screen is confirmed as a block, and the data of the block is reduced by a predetermined ratio before being displayed on the display screen. A portable electronic device is known (for example, see Patent Document 1).

  Furthermore, recently, a display terminal that allows a user to perform handwritten input in the margin of the display screen is also known. However, when handwritten input is performed on a terminal having a small display screen area or where the margin is small, there is a problem in that it is necessary to write in small characters suitable for the area, and writing cannot be performed well. In view of this, for example, a display terminal is known in which a part of the display screen is enlarged and displayed so that handwriting can be input to the margin and the enlargement can be restored after writing and displayed on the display screen.

JP 2008-84136 A

  However, in the terminal that can display a part of the display screen as described above, when writing characters etc. in the margin, depending on the location of the enlarged area, the image may be displayed when the enlargement is restored after writing. There was a problem that it was difficult and characters could not be written well in the margin.

  The present invention has been made to solve the above-described problems, and an object thereof is to provide a display terminal and a control program capable of easily performing enlarged display suitable for writing input.

  The display terminal according to the first aspect of the present invention is a display terminal capable of writing image information displayed on a display unit, and detects a write start position detected by a user in the display unit. And display data which is data of characters, figures or symbols around the writing start position detected by the writing start position detecting means and which is data other than a margin among the image information Distance for calculating the shortest distance from the display start position detected by the display data detection means and the write start position detection means to the area of the display data and the margin detected by the display data detection means A calculation means, an area from the writing start position to the shortest distance calculated by the distance calculation means, and the display data detected by the display data detection means An enlarged area determining means for determining an area including a predetermined area including at least a part as an enlarged area for displaying the enlarged area on the display unit, and the enlarged area determined by the enlarged area determining means Display control means for enlarging the image information at a predetermined magnification and displaying it on the display unit.

  In the display terminal according to the first aspect, the enlarged area determining unit includes an area from the writing start position to the shortest distance calculated by the distance calculating unit and at least a part of the display data detected by the display data detecting unit. An area including the predetermined area is determined as an enlargement area to be enlarged and displayed on the display unit. Therefore, the enlarged area includes at least a part of the display data. Therefore, the user can easily recognize which part of the image information displayed on the display unit the enlarged area, so that it is easy to create an image when the enlargement is restored after writing, Easy writing with appropriate size.

  Further, in the first aspect, it comprises unit data recognizing means for recognizing unit data which is a group of data constituting characters, figures or symbols among the display data detected by the display data detecting means. The determining means may determine the enlarged area so as to include a part or all of the unit data recognized by the unit data recognizing means in addition to the region up to the shortest distance. The enlarged area determining means determines the enlarged area so as to include a part or all of the unit data recognized by the unit data recognizing means in addition to the area up to the shortest distance, so the unit data displayed in the enlarged area Can be recognized more specifically. Thus, the user can more easily recognize which part of the image information displayed on the display unit the enlarged area is.

  In the first aspect, the display data detection means detects the display data around the write start position in two or more directions around the write start position, and the distance calculation means includes: Each of the shortest distances from the writing start position to the display data detected by the display data detecting means in the two or more directions is detected, and the enlarged area determining means is configured to detect the two or more distances from the writing start position. The enlargement area may be determined so as to include all the areas up to the shortest distance calculated by the distance calculation means in the direction. By detecting the shortest distances in two or more directions around the writing start position, an enlarged area suitable for writing input can be determined.

  In the first aspect, the expansion area determination unit includes a first determination unit that determines whether the shortest distance in each of the two or more directions calculated by the distance calculation unit is equal to or greater than a first predetermined length. In the direction determined to be greater than the first predetermined length when the shortest distance is determined to be greater than the first predetermined length in any one of the two or more directions by the first determination means. The enlargement area may be determined by setting the shortest distance to the first predetermined length. Since display data is not detected in the direction centered on the writing start position, it is possible to prevent a part of the enlarged area from becoming extremely long. Thereby, an expansion area can be always hold | maintained at a suitable magnitude | size.

  In the first aspect, the apparatus further comprises first determination means for determining whether the shortest distance in each of the two or more directions calculated by the distance calculation means is greater than a first predetermined length. When it is determined by the means that the shortest distance is greater than the first predetermined length in all the two or more directions, the display control means displays the image information in the enlarged area on the display unit without enlarging. May be. If it is determined that the shortest distance is greater than the first predetermined length in all two or more directions, there is no display data around the writing start position, and the margin is a considerable size. poor. In this case, unnecessary processing can be omitted by not enlarging the image information in the enlarged area.

  In the first aspect, the apparatus further comprises second determining means for determining whether or not the shortest distance calculated by the distance calculating means is less than a second predetermined length, and the enlarged area determining means is determined by the second determining means. If it is determined that the shortest distance is less than the second predetermined length, the enlargement area is determined by setting the shortest distance determined to be less than the second predetermined length to the second predetermined length. Good. Since display data is detected most recently in a direction centered on the writing start position, it is possible to prevent a part of the enlarged area from becoming extremely short. Thereby, an expansion area can be always hold | maintained at a suitable magnitude | size.

  In the first aspect, the enlarged area determining means may determine the enlarged area with the write start position as a center. As a result, the user can easily recognize the size of the surrounding margin where the writing start position is stopped, so that the user can write in an appropriate size according to the surrounding area.

  In the first aspect, the image processing apparatus further comprises a writing end detecting unit that detects the end of writing to the image information. When the writing end detecting unit detects the writing end, the display control unit displays the display. Write display control means for reducing writing information, which is information written in the enlarged area displayed on the part, at the predetermined magnification together with the image information, and displaying the information on the display part so as to overlap the image information You may prepare. Thereby, the writing information can be displayed on the display unit in a state in which the writing information is reflected in the image information.

  A control program according to a second aspect of the present invention is a display terminal control program capable of writing image information displayed on a display unit, and the computer detects a writing start position by a user in the display unit. A writing start position detecting step, and data of characters, figures, or symbols around the writing start position detected in the writing start position detecting step, and data other than blanks in the image information A display data detecting step for detecting certain display data; and from the writing start position detected in the writing start position detecting step to an area between the display data and the margin detected in the display data detecting step. A distance calculating step for calculating the shortest distance; and the shortest distance calculated in the distance calculating step from the writing start position. And an enlarged area determining step for determining an area including a predetermined area including at least a part of the display data detected in the display data detecting step as an enlarged area for enlarging and displaying on the display unit And a display control step of enlarging the image information of the enlarged area determined in the enlarged area determining step at a predetermined magnification and displaying the enlarged image information on the display unit.

  In the control program according to the second aspect, the enlargement area determination step includes at least part of the display data detected in the display data detection step and the region from the writing start position to the shortest distance calculated in the distance calculation step. An area including the predetermined area is determined as an enlargement area to be enlarged and displayed on the display unit. Therefore, the enlarged area includes at least a part of the display data. Therefore, the user can easily recognize which part of the image information displayed on the display unit the enlarged area, so that it is easy to create an image when the enlargement is restored after writing, Easy writing with appropriate size.

3 is a perspective view of the display terminal 1. FIG. 3 is a block diagram showing an electrical configuration of the display terminal 1. FIG. It is a figure which shows distance L1-L4 from the writing start position P to display data K1-K4. It is a flowchart of the writing control process by CPU21. 5 is a flowchart showing a continuation of FIG. It is a flowchart of a display data search process. It is a figure which shows each search path | route of the display data centering on writing start position P and P '. It is a figure which shows the positional relationship of writing start position P1, P2 and each display data. It is a figure which shows the positional relationship of the writing start position P3 and each display data. It is a figure which shows the expansion areas T1, T2, and T3 determined based on the write start positions P1, P2, and P3. It is a figure which shows the expansion area T4 determined based on the writing start position P4. It is a figure which shows the state by which the enlarged area T4 was enlargedly displayed on the display panel 22. FIG. It is a figure which shows the 1st, 2nd modification of a display data search method. It is a figure which shows the expansion areas T5 and T6. It is a flowchart of an expansion area determination process. It is a figure which shows the expansion area T7. It is the 1st modification which expanded and displayed expansion area T8 on display panel 22. FIG. It is the 2nd modification which expanded and displayed expansion area T8 on display panel 22. FIG. 10 is a flowchart of a modification of the writing control process by the CPU 21. It is a figure which shows the state by which the enlarged area T6 was enlargedly displayed on the display panel 22. FIG. It is a figure which shows the image information 50 containing the table 91, the figure 92, and the figure 93. FIG. 10 is a flowchart of a modification of the writing control process by the CPU 21.

  Hereinafter, a display terminal 1 which is an embodiment of a display terminal according to the present invention will be described with reference to the drawings. The drawings to be referred to are used for explaining technical features that can be adopted by the present invention. The configuration of the apparatus, the flowcharts of various processes, and the like described in the drawings are not intended to be limited to these, but are merely illustrative examples.

  First, the configuration of the display terminal 1 will be described with reference to FIG. The display terminal 1 includes a rectangular housing 2 that is vertically long when viewed from the front. A rectangular display panel 22 is provided on the front surface of the housing 2. The display panel 22 has a nonvolatile display element. As the non-volatile display element, for example, a microcapsule type or electrophoretic type display element can be used. A non-volatile display element requires power only when rewriting an image being displayed. Even when the power supply is cut off, the displayed image can be retained. The display panel 22 may be a general liquid crystal panel.

  A touch panel 27 is provided on the display panel 22. The user can directly write characters, figures, and the like on the image information displayed on the display panel 22 with the touch pen 7 as an accessory. The touch panel 27 detects the pressure at the tip of the touch pen 7. In the present embodiment, the area including the periphery of the writing start position by the touch pen 7 is enlarged and displayed (for example, see FIG. 12). Writing with the touch pen 7 can be performed in the enlarged display area. When the writing is completed, the writing information written in the image information is reduced and displayed on the display panel 22 so as to overlap the image information that is the original image.

  On the left side of the display panel 22, an operation unit 5 having three operation buttons arranged in a line in the vertical direction is provided. The operation unit 5 performs various settings, operations, and the like of the display terminal 1. Such a display terminal 1 operates using a battery 31 (see FIG. 2) provided therein as a power source. As the battery 31, for example, a lithium ion battery, a nickel metal hydride battery, or the like can be used.

  Next, the electrical configuration of the display terminal 1 will be described with reference to FIG. The display terminal 1 includes a CPU 21. A ROM 24, a RAM 25, and an EEPROM 26 are electrically connected to the CPU 21. The CPU 21 performs overall control of the operation of the display terminal 1. The ROM 24 includes at least a program storage area 241. The program storage area 241 stores a main program related to the control of the display panel 22, the “write control program” of the present invention, and the like.

  The RAM 25 includes at least an image information storage area 251, a write information storage area 252, a write start position storage area 253, an RGB value storage area 254, a display data position storage area 255, and the like. The image information storage area 251 temporarily stores image information to be displayed on the display panel 22. The write information storage area 252 temporarily stores the write information written on the display panel 22. The writing start position storage area 253 stores the touch position (coordinates) of the touch pen 7. The RGB value storage area 254 stores the RGB value of the writing start position. The display data position storage area 255 stores the position of each display data detected around the writing start position or the end position of the image information 50.

  The CPU 21 is further electrically connected to a memory card slot 26, a charging control unit 30, an operation unit 5, a touch panel I / F 28, and a display control unit 23. A memory card 35 is inserted into the memory card slot 26. The memory card 35 includes at least an image information storage area 351. The image information storage area 351 stores image information 50 to be displayed on the display panel 22. The CPU 21 can access the storage area of the memory card 35 via the memory card slot 26.

  A battery 31 is connected to the charging control unit 30. Power is supplied from the battery 31 to the CPU 21 via the charge control unit 30. The charging control unit 30 further includes a USB interface (I / F) 32 for connecting a USB connector for external communication and an adapter interface (I / F) 33 for connecting an adapter of an external communication cable. It is connected. The charging control unit 30 charges the battery 31 with current supplied from a USB interface 32, a connector connected to the adapter interface 33, or an adapter.

  A touch panel 27 is connected to the touch panel I / F 28. A display panel 22 is connected to the display control unit 23. The display control unit 23 performs drive control of the display panel 22. The CPU 21 can display a desired image on the display panel 22 via the display control unit 23.

  Next, the positional relationship between the writing start position P by the touch pen 7 and the display data K1 to K4 around it will be described with reference to FIG. For example, the user presses a write start button (not shown) in order to write in the margin of the image information 50 displayed on the display panel 22. Thereafter, the position where the user has brought the pen tip of the touch pen 7 into contact with the touch panel 27 is detected as the writing start position P. In addition, the writing start position P may be detected as a contact for starting writing by measuring the time during which the pen tip of the touch pen 7 is in contact with the touch panel 27. When the writing start position P is detected, display data such as characters and figures are searched in the vertical and horizontal directions starting from the writing start position P. As shown in FIG. 3, for example, there are display data K1, K2, K3, and K4 on the top, bottom, left and right of the writing start position P.

Therefore, in the positional relationship between the writing start position P and the display data K1 to K4, the distance Ln from the writing start position P to the display data K1 to K4 is defined as follows.
L1: Distance from the writing start position P to the display data K1 in the upward direction L2: Distance from the writing start position P to the display data K2 in the downward direction L3: From the writing start position P to the left Distance to certain display data K3 L4: Distance from display start position P to display data K4 in the right direction Lmax: Maximum value Lmin: Minimum value * In the following description, when L1 to L4 are collectively referred to, or When it demonstrates without specifying L1-L4, it demonstrates as "Ln".

  L1 to L4 are the shortest distances from the writing start position P of the blank area to the boundary of the region including the display data in each search direction (see FIG. 3). For example, when the display data is a character, it is the distance from the writing start position P to the boundary of the region including the character. This is to include up to the character in the enlarged area T determined as an area to be enlarged and displayed.

  If there is no display data even if searching in one direction from the writing start position P, the Ln in that direction is the upper end 55A, the lower end 55B, and the left end 55C constituting the peripheral edge of the image information 50 from the writing start position P. Or the distance to the right end 55D (hereinafter collectively referred to as ends 55A to 55D). Lmax and Lmin are for adjusting the size of the enlarged area T according to the values of L1 to L4. In this embodiment, Lmax is set to 20 and Lmin is set to 10, but can be changed as appropriate.

  Next, the enlarged area T will be described with reference to FIG. The enlarged area T is an area that is enlarged and displayed on the display panel 22 at a predetermined magnification in the image information 50. The shape and size of the enlarged area T are determined based on L1 to L4 from the writing start position P to the display data K1 to K4.

Therefore, each dimension around the writing start position P of the enlarged area T is defined as follows.
M1: Distance from the write start position P to the upper end of the enlarged area T M2: Distance from the write start position P to the lower end of the enlarged area T M3: From the write start position P to the left end of the enlarged area T Distance M4: Distance from the writing start position P to the right end of the enlarged area T

  In principle, M1 to M4 in the enlarged area T are in principle L1 to L4. Therefore, as shown in FIG. 3, the enlarged area T is a quadrangle. If Ln is larger (longer) than Lmax, Mn is set to Lmax. When Ln is smaller (shorter) than Lmin, Mn is Lmin. Since the shape of the enlarged area T is determined by the lengths of M1 to M4, it is possible to prevent the enlarged area T from becoming extremely long or short by defining Lmax and Lmin. That is, the shape of the enlarged area that is easy for the user to see can be maintained. As shown in FIG. 3, display data K1 to K4 around the writing start position P are included in the enlarged area T determined in this way. As a result, the positional relationship between the writing start position P and the display data K1 to K4 is clarified, so that the margin position to be written by the user is clarified.

  Next, the writing control process by the CPU 21 will be described with reference to the flowcharts of FIGS. 4, 5, and 6. In this process, for example, when a “write mode” in which image information displayed on the display panel 22 can be written is set by the operation of the operation unit 5 (see FIG. 1), the ROM 24 (see FIG. 2). ) Is called from the program storage area 241 and executed.

  First, it is determined whether or not a touch with the touch pen 7 is detected on the touch panel 27 (S10). Until a touch is detected (S10: NO), the process returns to S10 and the presence or absence of a touch with the touch pen 7 is monitored. When a touch is detected (S10: YES), the coordinates of the touch position are stored as a “write start position” in the write start position storage area 253 (see FIG. 2) of the RAM 25 (S11). Next, the display data search process is executed starting from the writing start position P (S12).

  Next, the display data search process will be described with reference to the flowchart of FIG. In the present embodiment, the display data area is searched based on the RGB values of the writing start position P. First, the RGB value at the writing start position P is measured and stored in the RGB value storage area 254 (see FIG. 2) of the RAM 25 (S41). For example, as shown in FIG. 7, since the RGB value at the writing start position P is a blank, (R, G, B) = (0, 0, 0) is measured. Then, RGB values are measured from the writing start position P in the vertical and horizontal directions (S42).

  Next, it is determined whether or not the measured RGB value has changed by a predetermined amount or more (S43). If there is no change greater than the predetermined amount (S43: NO), it is determined whether or not the ends 55A to 55D (see FIG. 3) of the image information 50 have been detected (S48). Until the ends 55A to 55D of the image information 50 are detected (S48: NO), the process returns to S42 and the measurement of the RGB values is continued. If there is a change of a predetermined amount or more (S43: YES), there is a high possibility that the display data is a character or a graphic. Therefore, in order to detect the area of the display data, the measurement of RGB values is continued as it is (S44). Subsequently, it is determined whether or not the RGB value is the same as the RGB value at the writing start position P (S45). If they are not the same (S45: NO), the display data still continues, so the process returns to S44 and the measurement of RGB values is continued.

  When the RGB value becomes the same as the RGB value at the writing start position P (S45: YES), the position is the boundary of the display data area. Therefore, the position is stored as the display data position in the display data position storage area 255 (see FIG. 2) of the RAM 25 (S46). At the writing start position P slightly below the center in FIG. 7, display data K1, K2, and K3 of alphabetic characters are respectively detected above, below, and to the left. In the present embodiment, the display data K1, K2, and K3 are recognized as unit data that is a group of data, and the enlarged area T is determined so as to include all of the display data K1, K2, and K3. Not limited to this example, the enlarged area T may be determined so as to include a part of the display data K1, K2, and K3.

  However, there is no display data to the right of the write start position P. In this case, the RGB value does not change more than a predetermined amount on the right side from the writing start position P. Therefore, it is determined whether or not the end of the image information 50 has been detected (S48). When the right end 55D is detected (S48: YES), the position of the right end 55D is stored in the display data position storage area 255 of the RAM 25 (S49).

  In this way, it is determined whether or not the search for the display data has been completed in all directions from the writing start position P in the vertical and horizontal directions (S47). If there is a direction that has not been searched yet (S47: NO), the process returns to S41 and is repeated. When the search is finished in all directions (S47: YES), the display data search process is finished, and the process proceeds to S13 in FIG.

  In the present embodiment, as shown in FIG. 7, the display data is searched for on the straight line indicated by the dotted line in FIG. 7 starting from the writing start position P and extending in the vertical and horizontal directions. As shown by the solid line in FIG. 5, the straight line extending in the vertical and horizontal directions from the write start position P ′ has a width (width length = H), and the search width can be widened to increase the display data detection sensitivity. . For example, when the space between characters in the left-right direction is large, the search path for display data may pass through the space. With the method shown by the solid line in FIG. 7, at least any display data sandwiching the space can be detected.

  Returning to the flow of FIG. 4, since the display data search process of S12 is completed, L1 to L4 are respectively calculated based on the positions of the display data K1 to K4 stored in the display data position storage area 255 of the RAM 25 ( S13). For Ln in the direction in which the display data is not detected and the edge of the image information 50 is detected, Ln = infinity (∞).

  Next, the smallest value among L1 to L4 is set as “Li” indicating the distance from the writing start position P to the nearest display data (S14). Then, it is determined whether the Li is not infinite (∞) (S15). When Li is infinite (S15: NO), since all of L1 to L4 are infinite, there is no display data around the writing start position P. In such a case, it is not necessary to enlarge and display the periphery of the writing start position P. Therefore, as shown in FIG.

  On the other hand, when Li is not infinite (S15: YES), in order to sequentially determine the dimensions M1 to M4 of the enlarged area T based on L1 to L4, first, 1 is substituted into the parameter n of Ln (S16). . And the process for determining M1 using the L1 is performed below.

  First, it is determined whether or not L1 is Li (S17). When L1 is Li (S17: YES), it is determined whether or not L1 is larger than Lmin (S18). When L1 is larger than Lmin (S18: YES), M1 of the enlarged area T is determined to be L1 (S21). When L1 is equal to or less than Lmin (S18: NO), M1 is determined to be Lmin (S21). Since Li is the distance from the writing start position P to the nearest display data, Mn is determined by comparison with Lmin.

  On the other hand, when L1 is not Li (S17: NO), it is determined whether or not L1 is larger than Lmax (S19). When L1 is larger than Lmax (S19: YES), M1 of the enlarged area T is determined to be Lmax (S23). That is, since L1 is not Li, display data is detected in at least another direction other than above the writing start position P. Therefore, there is no problem even if M1 is set to Lmax. On the other hand, when L1 is less than or equal to Lmax (S19: NO), it is subsequently determined whether or not L1 is smaller than Lmin (S20). When L1 is smaller than Lmin (S20: YES), M1 is determined to be Lmin (S24). If L1 is greater than or equal to Lmin (S20: NO), M1 is determined to be L1 as it is (S25).

  Next, it is determined whether or not n = 4 (S26). If n = 4 is not satisfied (S26: NO), 1 is added to n (S27), the process returns to S17, and the same processing is repeated for L2, L3, and L4 (S17 to S25). When n = 4 (S26: YES), since all of M1, M2, M3, and M4 have been determined, the enlarged area T is determined.

  Here, the procedure for determining the enlarged areas T1 to T3 based on the writing start positions P1 to P3 will be described with three examples. The three examples given here are the results of processing according to the processing from S17 to S26 described above.

  The first example is an example in which the enlarged area T1 shown in FIG. 10 is determined based on the writing start position P1 shown in FIG. The second example is an example in which the enlarged area T2 shown in FIG. 10 is determined based on the writing start position P2 shown in FIG. The third example is an example in which the enlarged area T3 shown in FIG. 10 is determined based on the writing start position P3 shown in FIG. Note that Lmax = 20 and Lmin = 10.

<First example>
As shown in FIG. 8, the writing start position P <b> 1 is detected around the upper right corner of the image information 50. Display data is searched in the vertical and horizontal directions from the writing start position P1. In this case, the display data K2 is detected in the downward direction, the display data K3 is detected in the left direction, and the upper end 55A and the right end 55D of the image information 50 are detected in the upper and right directions, respectively. As a result, (L1, L2, L3, L4) = (∞, 35, 30, ∞).

  Here, Li is L3 (= 30) and is larger than Lmin. Therefore, L3 becomes M3. Furthermore, display data is not detected in L1 and L4. Therefore, L1 and L4 are Lmax. Therefore, as shown in FIG. 10, it is determined that (M1, M2, M3, M4) = (20, 20, 30, 20), and the enlarged area T1 is determined. Since the enlarged area T1 includes the display data K3, the position of the writing start position P1 becomes clear according to the positional relationship with the display data K3.

<Second example>
As shown in FIG. 8, the writing start position P <b> 2 is detected slightly below the center of the image information 50. Display data is searched in the vertical and horizontal directions from the writing start position P2. In this case, the display data K1 is detected in the upward direction, the display data K2 is detected in the downward direction, the display data K3 is detected in the left direction, and the right end 55D is detected in the right direction. As a result, (L1, L2, L3, L4) = (5, 20, 30, ∞).

  Here, Li is L1 (= 5) and is smaller than Lmin. Therefore, Lmin (= 10) becomes M1. Further, L3 is longer than Lmax, and no display data is detected in L4. Therefore, L3 and L4 are Lmax. Therefore, as shown in FIG. 10, it is determined that (M1, M2, M3, M4) = (10, 20, 20, 20), and the enlarged area T2 is determined. Since the display area K1 and K2 are included in the enlarged area T2, the position of the writing start position P2 becomes clear according to the positional relationship with the display data K1 and K2.

<Third example>
As shown in FIG. 9, the writing start position P <b> 3 is detected at the lower right corner of the image information 50. Display data is searched in the vertical and horizontal directions from the writing start position P3. In this case, the display data K1 is detected upward, the lower end 55B is detected downward, the display data K3 is detected leftward, and the right end 55D is detected rightward. As a result, (L1, L2, L3, L4) = (80, ∞, 45, ∞).

  Here, Li is L3 and is larger than Lmin. Therefore, L3 becomes M3. Furthermore, L1 is longer than Lmax, and display data is not detected in L2 and L4. Therefore, L1, L2, and L4 are Lmax. Therefore, as shown in FIG. 10, it is determined that (M1, M2, M3, M4) = (20, 20, 45, 20), and the enlarged area T3 is determined. Since the display area K3 is included in the enlarged area T3, the position of the writing start position P3 becomes clear according to the positional relationship with the display data K3. In the enlarged area T3, the portion that protrudes from the image information 50 is displayed in gray when enlarged on the display panel 22.

  Thus, when the enlargement area T is determined, it is next necessary to determine the enlargement magnification of the enlargement area T. Therefore, as shown in FIG. 11, for example, the horizontal distance of the image information 50 is X, and the vertical distance is Y. Then, it is determined whether or not X / (M3 + M4) is larger than Y / (M1 + M2) in order to fit the enlarged area T4 after enlargement into the vertical and horizontal sizes of the image information 50 (S30). When X / (M3 + M4) is larger than Y / (M1 + M2) (S30: YES), the enlarged area T4 is multiplied by {Y / (M1 + M2)} and enlarged and displayed on the display panel 22 (S31). On the other hand, when X / (M3 + M4) is equal to or less than Y / (M1 + M2) (S30: NO), the enlarged area T4 is multiplied by {X / (M3 + M4)} and is enlarged and displayed on the display panel 22 (S32).

  For example, in the enlarged area T4 shown in FIG. 11, since X / (M3 + M4) is smaller than Y / (M1 + M2), the enlarged area T4 is multiplied by {X / (M3 + M4)}. As a result, as shown in FIG. 12, the enlarged area T4 is enlarged and displayed in a state of being accommodated on the display panel 22. A portion of the image information 50 in the enlarged area T4 that protrudes from the right end 55D is displayed in gray. By displaying in gray, it becomes clear that the writing start position P4 is in the vicinity of the right end 55D.

  Furthermore, as shown in FIG. 12, display data detected by the display data search process is displayed in the enlarged display area T4. Since the position of the writing start position P4 (see FIG. 11) is clarified by the positional relationship with these display data, the user can easily have an image when the enlarged display is returned. Therefore, since writing can be performed in consideration of the balance with the surroundings, writing can be performed with an appropriate size according to the surroundings, and the appearance when the enlarged display is restored is also beautiful.

  The user writes a character or the like in the margin in the enlarged area T4 enlarged and displayed on the display panel 22. On the touch panel 27, the pressure of the pen tip of the touch pen 7 is detected, and the written character or the like is recognized by the CPU 21. The recognized information is temporarily stored as write information in the write information storage area 252 (see FIG. 2) of the RAM 25 and displayed on the display panel 22 (S33).

  Next, it is determined whether or not the writing end is detected (S34). The user operates the operation unit 5 to finish writing in the enlarged display area T4. Until the end of writing is detected (S34: NO), the process returns to S33, and writing in the enlarged area T4 displayed in an enlarged manner is subsequently accepted. When the writing is completed (S34: YES), the enlarged area T4 that has been enlarged and displayed is reduced at the same magnification as the enlarged magnification, and the writing of the RAM 25 is performed on the image information 50 that is the original image. The write information stored in the information storage area 252 is displayed in an overlapping manner (S35). Thus, the writing control process by the CPU 21 is completed.

  The image information 50 displayed on the display panel 22 can be stored as new image information 50 in the image information storage area 251 of the RAM 25. The old image information 50 stored in the image information storage area 251 of the RAM 25 may be updated to a new one.

  As described above, in the display terminal 1 of the present embodiment, the writing start position by the touch pen 7 is detected on the touch panel 27. The display data in the vertical and horizontal directions are searched from the writing start position. Distances L1 to L4 from the writing start position to the display data detected by the search are calculated. By setting these L1 to L4 as M1 to M4 which are the dimensions of the enlarged area T, the shape and size of the enlarged area T are determined. As a result, display data around the writing start position can be included in the enlarged area T, and the position of the margin around the writing start position becomes clear from the positional relationship with the display data. And it becomes easy for the user to attach an image when the enlarged display is returned to the original size. Therefore, since the writing considering the balance with the surroundings can be performed at the writing start position, the appearance when the enlarged display is returned is also beautiful.

  In addition, this invention is not limited to the said embodiment, A various deformation | transformation is possible. For example, in the method for searching for display data, in the above-described embodiment, the search is performed in the vertical and horizontal directions from the writing start position P as shown in FIG. For example, as shown in FIG. 13, a rectangular search area 51 centered on the writing start position P5 is provided, and the display data K is increased while the search area 51 is gradually enlarged vertically and horizontally by a predetermined length A. You may search.

  Further, as shown in FIG. 13, a search circle 52 centered on the writing start position P6 is provided, and the display data K is searched while gradually increasing the radius R of the search circle 52 by a predetermined length B. Good. That is, as shown in FIG. 13, the display data K around the writing start positions P5 and P6 can be reliably detected by searching the display data K in the area.

  As shown in FIG. 13, when the display data K is searched with the search circle 52, the search circle 52 with the radius R when the display data K is detected is directly used as the enlarged area T5 as shown in FIG. Also good. Since the search circle 52 can be directly used as the enlarged area T5, the processing amount of the CPU 21 can be reduced. In addition to this, as shown in FIG. 14, a quadrangle whose inscribed circle is the search circle 52 having the radius R when the display data K is detected may be used as the enlarged area T6.

  Moreover, about the determination method of the expansion area T, in the said embodiment, the expansion area T is determined by making L1-L4 into M1-M4 of the expansion area T. For example, an enlarged area around the writing start position P may be determined.

  Thus, an enlarged area determination process for determining an enlarged area centered on the writing start position will be described with reference to the flowchart of FIG. 15 and FIG. The effect of this process can be achieved by replacing the process from S16 to S27 in the flowchart of FIG. In this process, the aspect ratio of the enlarged area T is fixed to (A: B). The vertical direction is the Y direction and the horizontal direction is the X direction. Further, Ln, Li, Lmax, and Lmin are the same parameters as in the above embodiment. In this embodiment, length (length in the Y direction): width (length in the X direction) = 3: 4 and Lmin = 35.

First, it is determined whether Li is L1 or L2 (S61). When Li is L1 or L2 (S61: YES), each dimension of the enlarged area T is
(M1, M2, M3, M4) = (Li, Li, Li * B / A, Li * B / A)
(S62).

On the other hand, when Li is neither L1 nor L2 (S61: NO), each dimension of the enlarged area T is
(M1, M2, M3, M4) = (Li * A / B, Li * A / B, Li, Li)
(S63).

  Next, it is determined whether Li is smaller than Lmin (S65). When Li is smaller than Lmin (S65: YES), Li becomes Lmin (S66). If Li is greater than or equal to Lmin (S65: NO), nothing is performed, the enlarged area determination process is terminated, and the flow returns to the flow of FIG.

By such an enlarged area determination process, for example, as shown in FIG. 16, an enlarged area is determined for the writing start position P7. When the display data search process is performed in the vertical and horizontal directions starting from the writing start position P7, (L1, L2, L3, L4) = (50, ∞, 35, ∞). Li = L3. Further, since L3 = 35, M1 to M4 are calculated as follows.
・ M1, M2 = Li * (A / B) = 35 * (3/4) = 26.25 (rounded off after the decimal point)
・ M3, M4 = 35

  Therefore, (M1, M2, M3, M4) = (26, 26, 35, 35). In this way, an enlarged area T7 centered on the writing start position P7 can be created. Since the center of the enlarged area T7 is the writing start position P7, the periphery around the position where writing is to be made can be displayed. Furthermore, with this method, display data can be included in the enlarged area T7, so that the same effect as in the above embodiment can be obtained.

  In the above-described embodiment, for example, as shown in FIG. 12, when the enlarged area T4 is enlarged and displayed, the image information 50 is displayed so as to overlap with the center. For example, as shown in FIG. 17, an enlarged display area 61 that is an area for enlarged display is provided at a desired position in the image information 50, and the enlarged area T8 is enlarged and displayed so as to be within the enlarged display area 61. May be. Further, as shown in FIG. 18, the enlarged display area 62 may overlap the entire image information 50. In this case, the enlarged area T8 can be enlarged and displayed on the entire display panel 22.

  Next, a modification of the writing control process by the CPU 21 will be described with reference to the flowchart of FIG. 19 and FIG. In this modified example, as shown in FIG. 13, the display data search centered on the writing start position P6 is performed by the search circle 52, and a quadrangle having the search circle 52 as an inscribed circle is expanded area T6 (FIG. 14). Reference).

  First, as shown in FIG. 19, it is determined whether or not a touch with the touch pen 7 is detected on the touch panel 27 (S70). Until a touch is detected (S70: NO), the process returns to S70 and the presence or absence of a touch with the touch pen 7 is monitored. When a touch is detected (S70: YES), the coordinates of the touch position are stored as the “write start position” in the write start position storage area 253 (see FIG. 2) of the RAM 25 (S71). Next, as shown in FIG. 13, in the search circle 52 having a radius R centered on the writing start position P6, first, a predetermined length B is input to the radius R (S72).

  Subsequently, it is determined whether or not there is display data in the search circle 52 (S73). When there is no display data in the search circle 52 (S73: YES), the predetermined length B is further added to the radius R (S74), and the search circle 52 is expanded. Further, returning to S73, it is determined whether or not there is display data in the enlarged search circle 52.

  When it is determined that the display data K (see FIG. 13) is present in the search circle 52 (S73: YES), it is determined whether the radius R of the search circle 52 is larger than Lmin (S75). ). When the radius R is equal to or less than Lmin (S75: NO), the radius R is set to Lmin (S76). On the other hand, when the radius R is larger than Lmin (S75: YES), it is subsequently determined whether or not the radius R is smaller than Lmax (S77). When the radius R is equal to or greater than Lmax (S77: NO), display data cannot be found even if the search circle 52 is enlarged to a predetermined size, and therefore it is not necessary to enlarge and display the periphery of the writing start position P6. Therefore, in this case, the process is terminated without displaying the enlarged image.

  On the other hand, when the radius R is smaller than Lmax (S77: YES), as shown in FIG. 14, a quadrangle whose inscribed circle is the search circle 52 (see FIG. 13) in which the display data K is detected is determined as the enlarged area T6. (S78).

  For example, as shown in FIG. 20, the horizontal distance of the enlarged display area 63 is set to X in order to display the enlarged area T6 in the enlarged display area 63 provided on the lower side of the display panel 22. Here, since the enlarged area T6 is a quadrangle having the search circle 52 as an inscribed circle, the length in the horizontal direction is 2R. In this case, the enlarged area T6 is multiplied by (X / 2R) and enlarged and displayed in the enlarged display area 63 (S79). Thereby, the enlarged area T6 is enlarged and displayed without protruding from the enlarged display area 63.

  As shown in FIG. 20, the display data K detected by the display data search process is displayed in the enlarged area T6 that has been enlarged and displayed. Since the position of the writing start position P6 (see FIG. 14) is clarified by the positional relationship with the display data K, the user can easily have an image when the enlargement is restored. Therefore, since writing in consideration of the balance with the surroundings can be performed at the writing start position P6, the appearance when the enlarged display is returned is also beautiful.

  Then, the user writes characters or the like in the margin in the enlarged area T6 enlarged and displayed on the display panel 22. On the touch panel 27, the pressure of the pen tip of the touch pen 7 is detected, and the written character or the like is recognized by the CPU 21. The recognized information is temporarily stored as write information in the write information storage area 252 of the RAM 25 and displayed on the display panel 22 (S80).

  Next, it is determined whether or not the end of writing is detected (S81). The user operates the operation unit 5 to finish writing in the enlarged display area T6. Until the end of writing is detected (S81: NO), the process returns to S80, and writing into the enlarged area T6 displayed in an enlarged manner is subsequently accepted. When the end of writing is detected (S81: YES), as shown in FIG. 20, the enlarged area T6 that has been enlarged and displayed is reduced at the same magnification as that of the enlarged image, and the image information 50 that is the original image is displayed. Above, the write information stored in the write information storage area 252 of the RAM 25 is displayed in an overlapping manner (S82). The image information 50 on which the writing information is overlaid is stored in the writing information storage area 252 of the RAM 25. Thus, the write control process by the CPU 21 which is a modified example is completed. The same effects as those in the above embodiment can be obtained by such processing.

  Further, in the above embodiment, in the display data search process of FIG. 6, the region of unit data such as characters and graphics in the display data is recognized by comparison with the RGB value at the writing start position P. In addition to this, for example, when an object such as a table or a figure is detected by searching from the writing start position P in the vertical and horizontal directions, the entire object may be included in the enlarged area T. Therefore, for example, in the image information 50 stored in the memory card 35, an object such as a table or a figure can be easily recognized by storing an object such as a table or a figure as one object data.

  As shown in FIG. 21, the image information 50 includes a table 91, a rhombus 92, and an arrow 93 having arrowheads on both sides in the horizontal direction. For example, when the writing start position P8 is detected in the margin of the inner column of the table 91, the object of the table 91 is recognized at the writing start position P8. Then, end portions 91A to 91D of Table 91 are detected in the vertical and horizontal directions from the writing start position P8, and the distance Ln in each direction is calculated. L1 is set to Lmin because the upper end 91A of Table 91 is too close to the writing start position P8. L2 is the distance to the lower end 91B of Table 91. L3 is the distance to the left end 91C of Table 91. L4 is set to Lmin because the right end 91D of Table 91 is too close to the writing start position P8. Therefore, (M1, M2, M3, M4) = (Lmin, distance to the lower end 91B of Table 91, distance to the left end 91C of Table 91, Lmin). Thereby, the expansion area T9 including the whole table 91 can be determined.

  In addition, when the writing start position P9 is detected at a position considerably away from the rhombic figure 92 and to the right of the arrow figure 93, the writing start position P9 is vertically and horizontally oriented. Display data is searched. Then, the figure 92 is detected above the writing start position P9, and the figure 93 is detected on the left side. Since the figure 92 is located at a position far from the writing start position P9 and L1 is larger than Lmax, it is set to Lmax. In order to include the entire figure 93 in the enlarged area T10, the distance to the left end of the figure 93 is L3. Furthermore, since the distance from the writing start position P9 to the right end and the lower end is larger than Lmax, it is set to Lmax. Therefore, (M1, M2, M3, M4) = (Lmax, Lmax, L3, Lmax). Thereby, the expansion area T10 including the whole figure 93 can be determined.

  In the above embodiment, if Li is infinite (∞) in S15 of the write control process flow shown in FIG. 4 (S15: NO), display data is displayed around the write start position P. Since there is no need to enlarge and display the periphery of the writing start position P, the processing is terminated as it is. In addition to this, for example, when there is no display data in a predetermined area around the writing start position P, it is not necessary to enlarge and display the periphery of the writing start position P. Therefore, as a modification of the writing control process shown in FIG. 4, when Li, which is the distance from the writing start position P to the nearest display data, is Lmax or more, the enlarged display can be omitted. . Such a modification will be described with reference to the flowchart of FIG.

  In the process of this modification, the processes from S10 to S14 of the write control process shown in FIG. 4 are the same, and the subsequent processes of S90 to S96 are characterized. Note that Lmax = 20 and Lmin = 10. First, it is determined whether Li is smaller than Lmax (S90). When Li is greater than or equal to Lmax (S90: NO), there is no display data in a predetermined area around the writing start position P. Since the margin around the write start position P is sufficient, it is not necessary to enlarge and display the periphery of the write start position P. Therefore, as shown in FIG. 5, in this case, the process is terminated without performing the enlarged display.

  On the other hand, when Li is smaller than Lmax (S90: YES), in order to sequentially determine the dimensions M1 to M4 of the enlarged area T based on L1 to L4, first, 1 is substituted into the parameter n of Ln. (S91). And the process for determining M1 using the L1 is performed below.

  First, it is determined whether L1 is larger than Lmax (S92). When L1 is larger than Lmax (S92: YES), M1 of the enlarged area T is determined to be Lmax (S94). When L1 is equal to or less than Lmax (S92: NO), it is subsequently determined whether L1 is smaller than Lmin (S93). When L1 is smaller than Lmin (S93: YES), M1 is determined to be Lmin (S95). When L1 is equal to or greater than Lmin (S93: NO), M1 is determined to be L1 as it is (S96).

  Next, it is determined whether or not n = 4 (S26). If n = 4 is not satisfied (S26: NO), 1 is added to n (S27), the process returns to S92, and the same processing is repeated for L2, L3, and L4 (S92 to S96). When n = 4 (S26: YES), since all of M1, M2, M3, and M4 have been determined, the enlarged area T is determined. The subsequent processing is the same as in the above embodiment. By executing such processing, the processing can be terminated as it is without performing enlarged display when there is little need for enlarged display around the writing start position P.

  In the above embodiment, the display data is searched in the vertical and horizontal directions from the writing start position. However, the search direction is not limited to this as long as the writing start position is the starting point.

  In the above description, the display panel 22 shown in FIG. 1 corresponds to the “display unit” of the present invention. The CPU 21 that executes the process of S10 in FIG. 4 corresponds to the “write start position detecting means” of the present invention, the CPU 21 that executes the process of S12 corresponds to the “display data detecting means” of the present invention, and the process of S13 The CPU 21 that executes the process corresponds to the “distance calculation means” of the present invention, the CPU 21 that executes the processes of S14 to S27 corresponds to the “enlarged area determination means” of the present invention, and the CPU 21 that executes the process of S35 of FIG. Corresponds to the “display control means” of the present invention, the CPU 21 that executes the processes of S41 to S46 in FIG. 6 corresponds to the “unit data recognition means” of the present invention, and the CPU 21 that executes the process of S19 of FIG. The CPU 21 that executes the process of S20 of FIG. 4 corresponds to the “first determination means” of the invention according to claim 4, and corresponds to the “second determination means” of the invention according to claim 6. The CPU 21 that executes the process of S90 of FIG. 22 corresponds to the “first determination means” according to the fifth aspect of the present invention. The CPU that executes the process of S34 in FIG. 7 corresponds to the “write end detection unit” according to the eighth aspect of the present invention.

1 Display terminal 21 CPU
22 Display panel 24 ROM
25 RAM
27 Touch panel

Claims (9)

A display terminal capable of writing image information displayed on a display unit,
A writing start position detecting means for detecting a writing start position by a user in the display unit;
Display data detection for detecting display data which is data of characters, figures or symbols around the writing start position detected by the writing start position detecting means and which is data other than a margin among the image information Means,
Distance calculating means for calculating a shortest distance from the writing start position detected by the writing start position detecting means to an area between the display data detected by the display data detecting means and the margin;
An area including a predetermined area including at least a part of the display data detected by the display data detection unit and an area from the writing start position to the shortest distance calculated by the distance calculation unit; An enlargement area determining means for determining an enlargement area to be displayed in an enlarged manner,
A display terminal comprising: display control means for magnifying the image information of the enlarged area determined by the enlarged area determining means at a predetermined magnification and displaying the enlarged image information on the display unit. Unit data recognition means for recognizing unit data which is a group of data constituting characters, figures or symbols among the display data detected by the display data detection means,
The enlarged area determining means includes
2. The display terminal according to claim 1, wherein the enlarged area is determined so as to include a part or all of the unit data recognized by the unit data recognition unit in addition to the region up to the shortest distance. . The display data detecting means includes
Detecting each of the display data around the writing start position in two or more directions around the writing start position;
The distance calculating means includes
Detecting the shortest distance from the writing start position to the display data respectively detected by the display data detecting means in the two or more directions;
The enlarged area determining means includes
3. The enlargement area is determined so as to include all the areas from the writing start position to the shortest distance calculated by the distance calculation means in the two or more directions. Display terminal according to. First determination means for determining whether or not the shortest distance in each of the two or more directions calculated by the distance calculation means is equal to or greater than a first predetermined length;
The enlarged area determining means includes
When the first determination means determines that the shortest distance is greater than the first predetermined length in any one of the two or more directions, the shortest of the directions determined to be greater than the first predetermined length The display terminal according to claim 3, wherein the enlargement area is determined by setting a distance to the first predetermined length. First determination means for determining whether or not the shortest distance in each of the two or more directions calculated by the distance calculation means is greater than a first predetermined length;
When it is determined by the first determination means that the shortest distance is greater than the first predetermined length in all the two or more directions,
The display terminal according to claim 3, wherein the display control unit displays the image information in the enlarged area on the display unit without enlarging the image information. Second determination means for determining whether or not the shortest distance calculated by the distance calculation means is less than a second predetermined length;
The enlarged area determining means includes
When the second determining means determines that the shortest distance is less than the second predetermined length, the shortest distance determined to be less than the second predetermined length is set to the second predetermined length, and the enlarged area is set. The display terminal according to claim 1, wherein the display terminal is determined. The enlarged area determining means includes
The display terminal according to claim 1, wherein the enlargement area is determined around the writing start position. Write end detection means for detecting the end of writing to the image information,
When the end of writing is detected by the writing end detecting means, the writing information, which is information written in the enlarged area enlarged and displayed on the display unit by the display control means, together with the image information 8. The display terminal according to claim 1, further comprising writing display control means for reducing the image at a predetermined magnification and displaying the image information on the display unit in an overlapping manner. A display terminal control program capable of writing image information displayed on a display unit,
On the computer,
A writing start position detecting step of detecting a writing start position by a user in the display unit;
Display data detection for detecting display data which is data of characters, figures or symbols around the writing start position detected in the writing start position detecting step and which is data other than a margin among the image information Steps,
A distance calculating step for calculating a shortest distance from the writing start position detected in the writing start position detecting step to an area between the display data detected in the display data detecting step and the margin;
A region including a region from the writing start position to the shortest distance calculated in the distance calculating step and a predetermined region including at least a part of the display data detected in the display data detecting step; An enlargement area determination step for determining an enlargement area to be displayed in an enlarged manner,
A control program for executing a display control step of enlarging the image information of the enlargement area determined in the enlargement area determination step at a predetermined magnification and displaying the enlarged image information on the display unit.