JP6475883B2 - Touch input display device, display control method, and program - Google Patents

Description

  The present invention relates to a touch input display device, a display control method, and a program that perform menu display while performing a touch operation, select an operation item and perform input in a drawing mode.

  In recent years, touch operation input devices capable of touch operation such as tablet terminals and electronic blackboards have appeared. In the input operation of such a touch operation input device, an operation menu is displayed so that the user can intuitively operate. There is a type that always displays this menu at the end of the touch operation input device, or a type that is called only when the user wants to use the menu in order to use a wide display screen. For example, Patent Document 1 discloses an apparatus that displays a menu when a long press with a pen is performed.

JP-A-8-286829

When the menu is always displayed at the end of the display screen, it is easy to grasp the currently set state, but on the large screen, the user moves to the end of the display screen where the menu is displayed, and the position In this case, there is a problem that the operability is poor because the menu operation or the operation of moving the menu to the input position is involved. When displaying a menu corresponding to a plurality of pens, the data display area is limited.
Also, if you press and hold to call up the menu only when you want to use it, you cannot immediately grasp the currently set status.

The present invention is intended to provide a touch input display device, a display control method, and a program capable of improving the operability of menu operation at the time of touch operation input .

  The present invention relates to a touch operation input device that enables input by a touch operation on a display screen, a touch operation detection unit that detects a touch operation, and an operation content that is determined based on a detection result of the touch operation detection unit. An operation processing unit that performs a menu display process and a menu item process according to a determination result of the operation processing unit, and an image process that performs a process of generating a drawing image in a touch part in the drawing mode. And a display control unit that performs control to display on the display screen, and when the operation processing unit determines that the touch operation is a menu processing operation, the image processing unit is in a drawing mode, A process of erasing the drawn image by the touch operation is performed.

  Here, the operation processing unit determines that the operation is a menu processing operation when the touch is in a long-pressed state for a predetermined time or more and less than a predetermined distance.

  The image processing unit may erase the drawn image when the touch operation detecting unit detects a touch-up in which the touch is released.

According to the present invention, in a touch operation input method that enables input by a touch operation on the display screen, a touch operation detection step for detecting a touch operation and an operation content is determined by a detection result of the touch operation detection step. An operation processing step for performing processing, a menu processing step for performing menu display processing and menu item processing based on a determination result of the operation processing step, and processing for generating a drawing image in the touch portion in the drawing mode. An image processing step and a display control step for performing control to display on the display screen, and when the touch operation is determined to be a menu processing operation in the operation processing step, the image processing step is a drawing mode. Also, a process of erasing the drawn image by the touch operation is performed.

  Moreover, this invention is a program for making a computer perform each step of the said touch operation input method.

  According to the present invention, in the case of menu processing even in the drawing mode, the drawing image of the touched part by the menu processing operation is not displayed, so that the drawing image remains and the menu becomes difficult to see or the user erases the drawing image. There is no need to process.

1 is an external view of a touch operation input device according to the present invention. It is a block diagram which shows an example of a touch operation input device. It is a flowchart which shows the process of the drawing mode in 1st Embodiment of the operation input apparatus which concerns on this invention. It is a flowchart which shows the menu process in 1st Embodiment of the operation input apparatus which concerns on this invention. It is a figure which shows the stroke drawing in 1st Embodiment of the operation input apparatus which concerns on this invention. It is explanatory drawing which shows the movement of the indicator menu by long press in 1st Embodiment of the operation input device which concerns on this invention. It is explanatory drawing which shows the display of the indicator menu and stroke drawing by long press in 1st Embodiment of the operation input device which concerns on this invention. It is explanatory drawing which shows the display of the square menu and stroke drawing by long press in 1st Embodiment of the operation input device which concerns on this invention. It is explanatory drawing which shows the display of the indicator menu in 1st Embodiment of the operation input apparatus which concerns on this invention. It is explanatory drawing which shows the display of the square menu in 1st Embodiment of the operation input apparatus which concerns on this invention. It is explanatory drawing which shows the display of the indicator menu and stroke drawing by long press in 2nd Embodiment of the operation input device which concerns on this invention. It is explanatory drawing which shows the display of the indicator menu in 2nd Embodiment of the operation input apparatus which concerns on this invention.

  Embodiments of the present invention will be described below with reference to the accompanying drawings.

FIG. 1 is an external view of a touch operation input device according to the present invention.
As illustrated in FIG. 1, the touch operation input device 10 includes a display unit 11 and a touch operation detection unit 12. The display unit 11 constitutes a display screen using liquid crystal, organic EL, or the like. The display unit 11 has a large screen used for presence, video conference, and the like. In addition, the thing of the size in which touch operation like a tablet terminal is possible may be sufficient.

The touch operation detection unit 12 is mounted on the surface of the display unit 11 and has a function of detecting the position of the user's touch. The display unit 11 and the touch operation detection unit 12 are integrated to form a touch panel, and input is enabled by touching the screen display. This touch panel has various methods such as an infrared method and a capacitance method, but any method can be used as long as the touch position can be detected. Further, in this embodiment, the input is made with the touch pen 15, but it may be the user's hand.

  When the touch operation input device of FIG. 1 is set to the drawing mode, a line is drawn on the touch stroke by the touch pen 15. As shown in the figure, a point 18 is displayed if it remains in one place. Since the display unit 11 is a large screen, when the operation menu is displayed at the left end, for example, the pen menu must be brought to that position, so the indicator menu 16 is always displayed. The indicator menu 16 moves to the place when the touch pen 15 is pressed for a certain period of time. When the touch pen 15 is touched down into the indicator menu 16, the square menu 17 opens. In the square menu 17, icons indicating each operation item are arranged on the inner periphery of the rectangle, and the user can select a desired operation item.

FIG. 2 is a block diagram illustrating an example of the touch operation input device.
The touch operation input device 10 includes a display unit 11, a touch operation detection unit 12, and a control unit 13. The touch operation input device 10 has various functions. FIG. 2 illustrates functional blocks of a part related to menu processing. The control unit 13 includes an operation processing unit 21, a menu processing unit 22, an image processing unit 23, and a display control unit 24.

  The display unit 11 and the touch operation detection unit 12 are as described above.

  The operation processing unit 21 processes the input signal of the touch operation detecting unit 12, calculates the input position, input moving direction, input time, etc., determines the input content, and outputs an operation instruction signal to each unit.

  The menu processing unit 22 performs menu display processing in accordance with an operation instruction from the operation processing unit 21. Performs processing related to indicator menu and square menu display. Also, processing related to items displayed as menus is performed.

  The image processing unit 23 performs processing for generating a drawing image in the drawing mode in accordance with an operation instruction from the operation processing unit 21. That is, a drawing image of the touch stroke by the touch pen 15 is generated.

  The display control unit 24 controls the display unit 11 to display the image based on the processing data from the menu processing unit 22 and the image processing unit 23.

[First Embodiment]
FIG. 3 is a flowchart showing a drawing mode process in the first embodiment of the touch operation input device according to the present invention. FIG. 4 is a flowchart showing menu processing.

In the drawing mode, a line image is formed according to the stroke of the touch operation. However, even when the menu display operation is performed, if the drawing is performed along the stroke, it is a portion that is not desired to be rendered originally, and therefore processing for deleting this portion is performed.
1st Embodiment shows the case where it applies to the case where the touch pen 15 is one.

  In the drawing mode, the operation processing unit 21 lowers the touch pen 15 and confirms whether the touch operation detection unit 12 has detected it (step S1). Next, the touch operation input device 10 performs menu processing (step S2).

As shown in FIG. 4, the operation processing unit 21 sets a flag C to 0 (step S21).
. Next, the menu processing unit 22 confirms whether the square menu 17 has been displayed (step S22). If not displayed, the operation processing unit 21 confirms whether the pen-down position is in the indicator menu 16 (step S23). If the pen-down position is outside the indicator menu 16, the menu processing unit 22 sets the flag C to 1 (step S24).

  If the pen-down position is within the indicator menu 16, the menu processing unit 22 changes the indicator menu 16 to the square menu 17 and displays it on the display unit 11 via the display control unit 24 (step S25).

  For example, when the touch pen 15 touches the indicator menu 16 as shown in FIG. 5, the indicator menu 16 changes to a square menu 17 as shown in FIG.

  If the square menu 17 has been displayed, the operation processing unit 21 confirms whether the pen-down position is within the square menu 17 (step S26). If the pen down position is within the square menu, the operation processing unit 21 confirms whether the menu item is at the pen down position (step S27). If it is a menu item, the menu processing unit 22 processes the menu item (step S28).

  If the pen-down position is outside the square menu, the menu processing unit 22 deletes the square menu 17 (step S29). The menu processing unit 22 sets the flag C to 1 (step S30).

  After the menu process is finished, the operation processing unit 21 checks whether the flag C is 1 (step S3). If the flag is 1, the process proceeds to step S4. If the flag C is not 1, the process is terminated. Here, if the flag C is 1, it means that there is the next process, and if the flag C is zero, it means that there is no next process.

  If the touch pen 15 is touched down on the display unit 11, the flag A and the flag B are set to 0 (step S4). In the drawing mode, the image processing unit 23 generates an image for drawing the stroke in accordance with the movement of the touch pen 15 touching the display unit 11. Then, the display control unit 24 displays the generated image on the display unit 11 (step S5).

  If the touch pen 15 does not move and enters a long press state, the stroke is drawn as point 18 as shown in FIG. 1, and if the touch pen 15 moves while touching the display unit 11, it is shown in FIG. , Will be drawn as line 19

  The operation processing unit 21 continues to detect the touch position from the detection result of the touch operation detection unit 12, and determines whether the distance δ or more from the pen-down position (step S6). If the distance is not less than δ, the flag A is set to 1 (step S7). If the distance from the pen-down position is less than δ, the flag A remains zero. This distance δ is for detecting a long press by the touch pen 15, and is, for example, about 1 to 2 mm.

  Next, the operation processing unit 21 determines whether the time from the pen-down has elapsed t or more (step S8). If the time t has elapsed, the flag B is set to 1 (step S9). If it is less than the time t, the flag B remains 0. This time t is also for detecting a long press by the touch pen 15 and is, for example, about 2 to 5 seconds. The user may be able to set the distance δ and the time t in advance.

  Next, the operation processing unit 21 determines whether the touch operation is a long press. That is, it is determined whether the flag A is 0 and the flag B is 1 (step S10). If the flags A and B satisfy the above condition, it means that the touch pen 15 is pressed long. Therefore, the operation processing unit 21 determines that the operation is a menu processing operation (menu movement operation), and the menu processing unit 22 moves the indicator menu 16 to the pen-down position (step S11).

  Assume that the indicator menu 16 is displayed in the lower right corner of the display unit 11 as shown in FIG. When the touch pen 15 is touched on the screen and pressed for a long time, the drawing mode is set, so that the point 18 is displayed as a stroke and the indicator menu 16 moves to the pen down position of the touch pen 15. Then, as shown in FIG. 9, the indicator menu 16 and the point 18 are displayed at the pen down position of the touch pen 15.

  Next, the operation processing unit 21 determines whether the touch pen 15 is pen-up (step S12). If the pen is up, it is determined whether the flag A is 0 and the flag B is 1 (long press with a pen) (step S13). If the flags A and B satisfy the requirements, as shown in FIG. 10, the image processing unit 23 erases the drawing stroke (point 18) that is an image formed by the touch operation indicating the menu processing (step 18). S14). If the flags A and B do not satisfy the requirement, the image processing unit 23 determines the drawing stroke (step S15).

  In this way, when it is a menu moving process by long press at the time of pen-up, the drawing stroke (dot image) is not displayed, so the drawing stroke remains and the menu becomes difficult to see, or the user erases the drawing stroke. There is no need to Further, until the pen is pushed up, even if a drawing stroke remains, even if a drawing stroke remains, since it is a display of a portion hidden by touching the touch pen, there is no particular problem even if it is displayed.

  In the case of a long press, for example, it may not be possible to determine whether the process is a drawing process or a menu process until a certain time has elapsed. In that case, when drawing processing is performed for the time being, and it is determined that menu processing has elapsed after a certain period of time, drawing is performed for the time being, and the drawing image is erased when pen-up is performed.

  In the above embodiment, the menu movement process is performed by the touch operation of “long press”, and the drawn stroke is deleted. However, the present invention is not limited to this, and the menu process such as the menu movement process is performed by another touch operation. You may go. In this embodiment, the drawn image is erased when the pen is up, but the drawn image may be erased when it is determined that the menu processing is performed.

[Second Embodiment]
11 and 12 are explanatory diagrams showing menu operation processing in the second embodiment of the touch operation input device according to the present invention.
This is because a plurality of pens exist for each user, and each of them can be operated differently at the same time. In this case, there are three pens corresponding to three users, and there is an indicator menu 16 for each.

  Although not shown, there are square menus corresponding to the indicator menus 16 respectively. Each square menu can be displayed and each square menu can be deleted. The menu items of the square menu may be the same or different.

  As for the operation related to the menu, each touch pen performs processing according to the flowcharts shown in FIGS. 3 and 4.

  For example, as shown in FIG. 11, when each touch pen 15 performs a long press, the indicator menu 16 corresponding to each touch pen 15 moves to the pen down position of the touch pen 15. Therefore, if the pen is up, the drawing stroke is erased and only the indicator menu 16 is displayed as shown in FIG.

  In this way, even if a plurality of touch pens are used, processing is performed in the same way as with a single touch pen, and even if a long press in the drawing mode is performed, if the pen is raised, the drawing stroke is erased. It is not necessary to make the menu difficult to see and the user does not need to erase the drawing stroke.

The program that operates on the touch operation input device according to the present invention may be a program that controls a CPU (Central Processing Unit) or the like (a program that causes a computer to function) so as to realize the functions of the above-described embodiments related to the present invention. good. Information handled by these devices is temporarily stored in RAM (Random Access Memory) during the processing,
After that, it is stored in various ROMs such as Flash ROM (Read Only Memory) or HDD (Hard Disk Drive), and is read out and corrected / written by the CPU as necessary. In addition, a program for realizing the function of each component may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read into a computer system and executed to perform processing of each unit. Good. Here, the “computer system” includes an OS and hardware such as peripheral devices.

  The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

  Although the present invention has been described in detail above, the specific configuration is not limited to the embodiment, and the design and the like within the scope not departing from the gist of the present invention are also included in the claims.

10: Touch operation input device 11: Display unit 12: Touch operation detection unit 13: Control unit 15: Touch pen 16: Indicator menu 17: Square menu 18: Stroke (point)
19: Stroke (line)
21: Operation processing unit 22: Menu processing unit 23: Image processing unit 24: Display control unit

Claims (6)

In a touch input display device that enables input by a touch operation on a display screen,
A touch detection unit for detecting a touch operation;
A determination processing unit that performs processing by determining the operation content detected by the touch detection unit;
A display control unit for controlling display of a drawn image and menu display by the touch operation ;
With
The display controller, the determination processing unit when the touch operation is determined that the operation of the menu processing, the display means displays the menu that was displayed previously on the display screen to move based on the position of the touch operation Touch input display device.   2. The determination processing unit according to claim 1, wherein the determination processing unit determines that the operation is a menu process when the touch is in a long press state where the touch is longer than a predetermined time and the moving distance of the touch is less than a predetermined distance. Touch input display device. The touch input display device further includes an image processing unit that generates a drawing image at the position of the touch operation,
2. The touch input display device according to claim 1, wherein the display control unit erases the drawn image generated by the touch operation when a touch-up in which the touch is released is detected by the touch detection unit.   The touch input display device according to claim 1, wherein the menu is an operation menu that can display a plurality of operation items and is used for a user to select a desired operation item. . In a display control method of a touch input display device that enables input by a touch operation on a display screen,
A touch operation detection step for detecting a touch operation;
A determination processing step for determining an operation content based on a detection result of the touch operation detection step and performing processing;
A display control step for controlling display of a drawn image and menu display by the touch operation ;
Including
The display control step moves and displays a menu previously displayed on the display screen based on the position of the touch operation when the touch operation is determined to be a menu processing operation in the determination processing step. Display control method. The program for making a computer perform each step of the display control method of Claim 5 .

Images