JP2015108901A - Portable touch panel terminal, display control method therefor, and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a portable touch panel terminal which does not require tap manipulation and allows a user to stably hold the terminal with two hands while making manipulation, without complicating a configuration thereof.SOLUTION: A portable touch panel terminal (tablet PC 1) having a touch panel 10 for displaying images and receiving input manipulation includes; a drag manipulation detection unit 40 which detects first two hand finger-drag manipulation made by a user by dragging a finger of each hand toward the center of the touch panel 10 while keeping the fingers pressed against the touch panel 10, and second two finger-drag manipulation made by dragging both fingers toward separate edges of the touch panel; and a display control unit 42 for controlling an image to be displayed on the touch panel 10 in response to the first two hand finger-drag manipulation or second two hand finger-drag manipulation.

Description

  The present invention relates to a touch panel portable terminal, a display control method thereof, and a computer program, and in particular, operates in a stable state while holding a tablet personal computer (hereinafter referred to as a tablet PC) having a larger screen than a smartphone with both hands. The present invention relates to a touch panel type portable terminal, a display control method thereof, and a computer program.

  When using a tablet PC with a larger screen than a smartphone as a computer for controlling the measuring machine, “operation while holding with one hand”, which increases the risk of operation mistakes and dropping, is a barrier. A typical operation of the tablet PC is a touch panel operation called a tap corresponding to a mouse click operation.

  In the case of a tablet PC 1 with a large display (touch panel 10 in the figure) as shown in FIG. 1, it is the most stable way to hold it with both hands 2 and 4, but an image or movie file embedded in the display screen is displayed. In the case of reproduction, the image icon or the moving image reproduction button 16 must be tapped with a finger as shown in FIG. 2, and the operation is difficult unless one hand (the right hand 2 in the example of FIG. 2) is released from the tablet PC 1. .

  In a tablet PC with a large display (touch panel), it is difficult to hold for a long time with one hand, and even when performing a tap operation, the touch panel is unstablely fixed, and an operation error is likely to occur. In addition, when held with one hand, the risk of dropping the tablet PC always increases.

  Since the tablet PC is most stably held with both hands, if these operations can be performed without removing the hand from the tablet PC, not only the stability is increased, but also an accident such as dropping the tablet PC can be reduced.

  Although it is not possible to operate with both hands as in the present invention, the operability when touch input with the other hand while holding a portable terminal with a small screen size with one hand is not possible. As a technique to enhance, Patent Document 1 detects the position where the (parent) finger is in contact with the touch panel when holding the mobile terminal with one hand, and changes the position of the user interface to a position close to the contact position. It is described to display.

  Similarly to Patent Document 1, Patent Documents 2 and 3 also describe techniques for facilitating operations performed while being held with one hand.

  On the other hand, in Patent Document 4, a three-dimensional distance sensor that outputs a three-dimensional position from a shift due to parallax of images obtained from left and right imaging elements is provided in a portable terminal in order to facilitate an input operation with both hands. It is described that the operation target is moved and displayed at a position where it can be easily operated on the portable terminal by using the three-dimensional position information of the face and hand obtained from the three-dimensional distance sensor.

JP 2013-125471 A JP 2002-73249 A JP 2010-79442 A JP 2012-155480 A

  However, when the user interface is displayed near the thumb with the technique described in Patent Document 1, it is easy to operate when the back of the mobile terminal is supported by the other four fingers and the thumb can be moved freely. It is assumed that the mobile terminal has a small screen size. Similarly, Patent Documents 2 and 3 do not enable operation with both hands as in the present invention, and Patent Document 4 requires a three-dimensional distance sensor, which is complicated in structure and cost. It had the problem of becoming high.

  The present invention has been made to solve the above-described conventional problems, and it is possible to operate in a stable state while holding the portable terminal with both hands without complicating the configuration and making the tap operation unnecessary. And

  The present invention provides a first two-finger drag that is dragged toward the center of the touch panel while the operator's two fingers are pressed against the touch panel in a touch panel portable terminal configured to perform display and input operations using the touch panel. A drag operation detection unit that detects an operation and a second two-handed finger drag operation that is dragged toward an end of the touch panel; and the touch panel according to the first two-handed finger drag operation or the second two-handed finger drag operation. And a display control unit for controlling an image to be displayed on the screen.

  Here, when the first or second two-handed finger drag operation is detected, the display control unit displays a non-displayed image embedded in the screen or an image displayed in a reduced state. Alternatively, when the second or first two-handed finger drag operation is detected, the displayed or enlarged display image can be set to a non-display or reduced display state.

  Further, the display and enlargement of the image can be performed in stages.

  In addition, the image can be hidden or reduced at once.

  When a plurality of images are embedded, the previous and next images can be enlarged or reduced by scroll operation.

  In addition, when the first or second two-finger dragging operation is detected, the display control unit starts the reproduction of the moving image or enlarges the moving image being reproduced, and the second or first When the two-hand finger drag operation is detected, the reproduction of the moving image can be stopped or the moving image being reproduced can be reduced.

  In addition, the touch panel type portable terminal can be connected to a measuring apparatus so as to be able to communicate.

  The present invention also relates to a display control method for a touch panel type portable terminal configured to perform display and input operations using a touch panel, and drags the operator's hands with both fingers pressed toward the center of the touch panel. A first two-handed finger drag operation and a second two-fingered finger drag operation that is dragged toward the edge of the touch panel are detected, and the first two-handed finger drag operation or the second two-handed finger drag operation is detected. The above-mentioned problem is similarly solved by a display control method for a touch-panel mobile terminal, which controls an image to be displayed on the touch panel.

  Here, when the first or second two-hand finger drag operation is detected, the non-displayed image embedded in the screen or the image displayed in the reduced state is displayed or enlarged, When the second or first two-hand finger drag operation is detected, the displayed or enlarged image can be hidden or reduced.

  In addition, when the first or second two-handed finger drag operation is detected, the reproduction of the moving image is started, or the moving image being reproduced is enlarged, and the second or first two-fingered drag operation is performed. When detected, the reproduction of the moving image can be stopped or the moving image being reproduced can be reduced.

The present invention also provides a computer program for controlling the display of a touch panel portable terminal configured to perform display and input operations using a touch panel.
A process of detecting a first two-finger drag operation for dragging toward the center of the touch panel and a second two-finger drag operation for dragging toward the end of the touch panel while pressing both fingers of the operator against the touch panel; ,
What solved the said subject similarly by the computer program which performs the process which controls the image displayed on the said touch panel according to said 1st both-hands finger drag operation or 2nd both-hands finger drag operation It is.

  Here, when the first or second two-finger drag operation is detected, the process for controlling the image is a non-displayed image embedded in the screen or an image displayed in a reduced state. Is displayed or enlarged, and when the second or first two-handed finger drag operation is detected, the displayed or enlarged display image can be hidden or reduced.

  Also, the processing for controlling the image may be performed when the first or second two-handed finger drag operation is detected, starting the reproduction of the moving image, or enlarging the moving image being reproduced, When the first two-finger finger drag operation is detected, the reproduction of the moving image can be stopped or the moving image being reproduced can be reduced.

  According to the present invention, it becomes possible to operate the selection of an image, the reproduction of a moving image, and the like in a stable state without removing both hands from the portable terminal, so the following effects can be expected.

(1) Improved Usability The touch panel user interface of the present invention eliminates the need for tap operations for image selection and video playback, improving browsing operability, reducing operational errors, and tablet The operability and convenience of the PC can be improved.

(2) Improvement of safety By reducing the number of operations that need to release both hands holding the tablet PC, it is possible to reduce accidents such as dropping the tablet PC. This point is effective not only for the industry but also for general users. For example, when a child or an elderly person with a small holding force operates, it becomes very unstable by holding with one hand, and the risk of falling increases. In addition, when operating while lying in a bed in a hospital room, it is difficult for an adult to hold one hand, so it is important in terms of safety to reduce the frequency of one-hand holding operation of the tap operation.

Front view showing a state in which a tablet PC is held with both hands for explaining a conventional problem Front view showing the state where the tap operation is also performed Front view of an embodiment of the present invention Block diagram showing the same hardware configuration Block diagram showing functional configuration The front view which similarly shows the operation state of 1st Embodiment Flow chart showing the processing procedure The front view which similarly shows the operation state of 2nd Embodiment Flow chart showing the processing procedure

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, this invention is not limited by the content described in the following embodiment and an Example. In addition, the constituent elements in the embodiments and examples described below include those that can be easily assumed by those skilled in the art, those that are substantially the same, and those in the so-called equivalent range. Furthermore, the constituent elements disclosed in the embodiments and examples described below may be appropriately combined or may be appropriately selected and used.

  In the embodiment of the present invention, the present invention is applied to a tablet PC 1 whose outer shape is substantially rectangular as illustrated in FIG. As shown in FIG. 3, a so-called frame portion surrounding the touch panel 10 is narrow, and most of the front surface is occupied by the touch panel 10.

  The tablet PC 1 is provided with a contact sensor 20 (not shown in FIG. 3; see FIGS. 4 and 5) for detecting the contact of an object with its peripheral portion. The contact sensor 20 can detect the contact position and the number of the contact positions with a resolution sufficient to determine whether it is held by both hands or one hand.

  Although not shown, various interfaces and mechanism elements such as a power switch, a volume operation unit, a camera lens window, a ventilation unit for audio output by a speaker, a connector, and a jack are provided on the outer surface of the tablet PC 1. Is arranged.

  The tablet PC 1 is connected to a measuring device 100 such as an image measuring device wirelessly or by wire, and is used for inputting a measurement instruction, displaying a measurement result, and the like.

  As shown in FIG. 4, in addition to the touch panel 10 and the contact sensor 20 described above, the tablet PC 1 includes a communication circuit 22, a storage 24, a control circuit 30, and other components not shown. The communication circuit 22 is used for wireless communication and wired communication between the tablet PC 1 and an external device. The storage 24 is a hard disk drive (HDD) or a solid state drive (SSD), and is used for storing and temporarily storing various data. The control circuit 30 includes a CPU (Central Processing Unit) 32 as a computer for executing a control program and various applications, a RAM (Random Access Memory) 34 as a work area for program execution, and a non-volatile storage for storing setting values for control. A memory 36 is provided.

  A functional configuration related to display control in such a tablet PC 1 is shown in FIG. As illustrated in FIG. 5, the tablet PC 1 includes a drag operation detection unit 40 and a display control unit 42. These components are realized by the CPU 32 of the control circuit 30 executing a control program.

  The drag operation detection unit 40 is a first two-finger drag operation that drags toward the center of the touch panel 10 while pressing both fingers of the operator against the touch panel 10 and a second drag that drags toward the end of the touch panel 10. Detects two-hand finger drag operation.

  The display control unit 42 controls display according to the drag operation detected by the drag operation detection unit 40.

  Hereinafter, display control in the tablet PC 1 will be described with a specific example of display.

  In the first embodiment of the present invention, the present invention is applied to an operation during image display. In the case of an image, the image is usually embedded in the screen, only icons are displayed, the image itself is not displayed, or it is displayed in a reduced display state, and only the user wants to see is selected In many cases, the entire screen is previewed by tapping.

  Therefore, as illustrated in FIG. 6A, an image embedded in the screen can be enlarged without a tap operation by the first two-handed finger drag operation according to the present invention. The expansion may be a gradual expansion or a continuous expansion. Further, the image is reduced by the second two-handed finger drag operation shown in FIG. The reduction may be stepwise or continuous as in the case of enlargement, but may be restored to the original size by a single reduction operation. When a plurality of images are embedded, the previous and next images may be enlarged and displayed by a scroll operation. The assignment to the first two-handed finger drag operation and the second two-handed finger drag operation may be reversed.

  Hereinafter, an example of a specific processing procedure of the first embodiment will be described with reference to FIG.

  First, in step 100, it is determined whether or not a first two-handed finger drag operation has been performed. When the determination result is positive, the process proceeds to step 110, and an image is displayed as illustrated in FIG.

  Next, the routine proceeds to step 120, where it is determined whether or not the first two-hand finger drag operation has been performed again. If the determination result is positive, the process proceeds to step 130 and the image is enlarged and displayed.

  Next, the routine proceeds to step 140, where it is determined whether or not a second two-hand finger drag operation has been performed. If the determination result is positive, the process proceeds to step 150 and the image is reduced and displayed.

  After step 150 ends or when the determination result in step 140 is NO, the process returns to step 120.

  On the other hand, if the determination result in step 120 is NO, the process proceeds to step 160 to determine whether or not a second two-handed finger drag operation has been performed. If the determination result is positive, the process proceeds to step 170, and an image is embedded as illustrated in FIG.

  After step 170 ends or when the determination result in step 160 is NO, the process returns to step 100.

  Next, a second embodiment of the present invention applied to the operation during moving image reproduction will be described. In the case of a video, a tap operation must be performed for playback. In order to display the full screen, the full screen button must be tapped. These two operations are realized by a two-finger drag operation according to the present invention, as illustrated in FIG.

  First, as shown in FIG. 8A, the first first finger drag operation of the first time starts the reproduction of the moving image, and the second first finger finger drag operation of the second time shows a broken line in FIG. 8A. As shown in FIG. Alternatively, the start of the reproduction of the moving image and the full screen display may be performed at the same time by the first first-hand finger drag operation. Alternatively, the video playback may start simultaneously with the start of the first two-handed finger drag operation, and the video window may be displayed in an enlarged manner. If the enlargement ratio exceeds a certain level, a full screen display is displayed. good.

  The moving image is stopped by the operation shown in FIG. 8B. First, the original display size may be restored from the full screen, or may be stopped if the operation shown in FIG. 8B is continued. Moreover, the original size may be restored and the moving image may be stopped simultaneously. During the reproduction of the moving image, the pause and the reproduction may be switched by performing the second two-finger drag operation in FIG. 8B and the first two-finger drag operation in FIG. 8A. The assignment to the first two-handed finger drag operation and the second two-handed finger drag operation may be reversed.

  FIG. 9 shows an example of a specific processing procedure of the second embodiment.

  First, in step 200, it is determined whether or not a first two-handed finger drag operation has been performed. If the determination result is positive, the process proceeds to step 210, and the moving image reproduction is started as illustrated in FIG.

  Next, the process proceeds to step 220, and it is determined whether or not the first two-handed finger drag operation has been performed again during the reproduction of the moving image. If the determination result is positive, the process proceeds to step 230 and a full screen display is performed.

  Next, the process proceeds to step 240, and it is determined whether or not a second two-handed finger drag operation has been performed during full screen display. If the determination result is positive, the process proceeds to step 250 where the moving image window is resized and returned to its original size.

  After step 250 or when the determination result in step 240 is NO, the process returns to step 220.

  On the other hand, when it is determined in step 220 that the first two-handed finger drag operation has not been performed, the process proceeds to step 260 to determine whether or not the second two-handed finger drag operation has been performed. If the determination result is positive, the process proceeds to step 270, where the video playback is paused.

  Next, the process proceeds to step 280, where it is determined whether or not the second two-hand finger drag operation has been continuously performed. If the determination result is positive, the process proceeds to step 290 to stop moving image playback.

  After step 290 is completed, or when the determination results in steps 260 and 280 are NO, the process returns to step 200.

  According to the said embodiment, there exist the following effects.

(I) Browsing while standing With a tablet PC placed on a desk or sitting and placing a tablet PC on a knee, one hand can be used freely, so there is stability and operation without worrying about dropping There are many cases where this is possible. However, when using it on a mobile device, you must also consider operating while standing. For example, in Internet browsing, image display, video playback, and enlargement display operations are performed at a frequency next to scrolling and hyperlink taps. However, at present, these operations are always performed with a single finger. It is necessary to perform a touch operation, and during that time, the tablet PC must be held with one hand. In the case of a tablet PC with a large display, if it is difficult to operate with one hand because of its weight, it may be necessary to operate the tablet PC only by placing it on one open hand. This state is very unstable and easily causes an operation error, and the risk of dropping the tablet PC during the operation is high. According to the present invention, most browsing operations can be performed while holding the tablet PC with both hands, safety and stability are increased, and usability can be greatly improved.

(Ii) Browsing while sleeping When browsing while lying on its back, it is only possible to hold the tablet PC with both hands, and the operation of releasing one hand becomes almost impossible. Even if the tablet PC is placed on the chest, the more the operation of releasing one hand, the longer the operation cannot be performed. When sleeping sideways with the dominant arm down, tapping is difficult, and when sleeping sideways with the dominant arm up, the time for holding with one hand cannot be lengthened. In order to operate a tablet PC while sleeping like an inpatient, it is important to increase the number of operations while holding the tablet PC with both hands, and the present invention can greatly improve the usability of the tablet PC. is there.

(Iii) Browsing in a swaying vehicle When operating a tablet PC in a swaying vehicle such as a train or car, it is very difficult to operate with one hand released. According to the present invention, it is possible to increase the number of operations with both hands, and it is possible to perform stable browsing even in a swaying vehicle.

(Iv) Browsing while walking For example, when walking toward a destination while holding a tablet PC with both hands and looking at a map or the like, it is almost impossible to release one hand. However, there are cases where you want to check the surrounding situation by scaling. At present, the only way to do this is to sit somewhere to ensure stability and release one hand, reducing convenience. According to the present invention, an enlargement / reduction operation can be performed while holding the tablet PC with both hands, so that it can be easily operated while walking.

(V) Browsing photos and videos taken with the rear camera Many tablet PCs have a high-resolution camera on the back, and many users use digital cameras and video cameras instead. However, in order to confirm the result on the spot where it was taken, a tap operation is required for selecting an image to be previewed or playing a moving image. You just have to sit somewhere and put your tablet PC on your lap and tap it. The present invention enables image enlargement and video playback while holding the tablet PC with both hands, so that it can be immediately confirmed on a digital camera, a video camera, or a large-screen display that is not comparable to a smartphone LCD screen. Thus, the usage scene can be greatly expanded.

  In addition, in the said embodiment, although the case where this invention was connected to the measuring apparatus was illustrated, the touchscreen type portable terminal which concerns on this invention is not limited to such illustration, Generally the portable terminal containing touchscreen type PC The same applies.

  As a result, the following effects can be expected.

(I) Expansion of users It is possible to provide tablet PCs, which were apt to be avoided by children and elderly people with small grip strength, as terminals that can be used by a wide range of users.

(II) Expansion of tablet PC usage scenes In the following usage scenes in which the advantages of a large screen cannot be utilized due to the difficulty of holding one hand, it can be expected to expand usage in a wide range of age groups.
・ Announcing with a tablet PC in hand at an elementary school, etc. Reference, observation records, survey of authors and works of exhibits using tablet PCs at museums, etc., confirmation of map information and sightseeing spots (using GPS etc.) with tablet PCs, etc.

1 ... Tablet PC
2, 4 ... Hand 10 ... Touch panel 20 ... Contact sensor 22 ... Communication circuit 24 ... Storage 30 ... Control circuit 32 ... CPU
34 ... RAM
36 ... Nonvolatile memory 40 ... Drag operation detection unit 42 ... Display control unit 100 ... Measuring device

Claims (13)

In a touch panel type mobile terminal adapted to perform display and input operations using a touch panel,
A drag operation for detecting a first two-finger drag operation for dragging toward the center of the touch panel and a second two-finger drag operation for dragging toward the edge of the touch panel while pressing both fingers of the operator against the touch panel A detection unit;
A display control unit for controlling an image to be displayed on the touch panel in response to the first two-handed finger drag operation or the second two-handed finger drag operation;
A touch panel type portable terminal comprising:   When the first or second two-finger drag operation is detected, the display control unit displays or enlarges an image displayed in a non-display state or an image displayed in a reduced state embedded in the screen. When the second or first two-hand finger drag operation is detected, the displayed or enlarged display image is set to a non-displayed or reduced display state. The touch panel type portable terminal according to 1.   The touch panel portable terminal according to claim 2, wherein display and enlargement of the image are performed in stages.   The touch panel portable terminal according to claim 2, wherein the non-display or reduction of the image is performed at once.   5. The touch panel mobile terminal according to claim 2, wherein when a plurality of images are embedded, the preceding and following images are enlarged or reduced by scroll operation.   When the first or second two-handed finger drag operation is detected, the display control unit starts reproduction of the moving image or enlarges the moving image and reproduces the second or first both hands. The touch-panel portable terminal according to claim 1, wherein when a finger drag operation is detected, the reproduction of the moving image is stopped or the moving image being reproduced is reduced.   The touch panel mobile terminal according to claim 1, wherein the touch panel mobile terminal is connected to a measurement device so as to be able to communicate. In a display control method of a touch panel type mobile terminal configured to perform display and input operations using a touch panel,
Detecting a first two-finger drag operation for dragging toward the center of the touch panel and a second two-finger drag operation for dragging toward the edge of the touch panel while the operator's two fingers are pressed against the touch panel;
A display control method for a touch panel portable terminal, wherein an image to be displayed on the touch panel is controlled in accordance with the first two-handed finger drag operation or the second two-handed finger drag operation.   When the first or second two-handed finger drag operation is detected, the non-displayed image embedded in the screen or the image displayed in the reduced state is displayed or enlarged, and the second or 9. The display control method for a touch panel portable terminal according to claim 8, wherein when the first two-finger drag operation is detected, the displayed or enlarged image is not displayed or reduced. .   When the first or second two-handed finger drag operation is detected, the reproduction of the moving image is started, or the moving image being reproduced is enlarged, and the second or first two-handed finger drag operation is detected. 9. The display control method for a touch-panel mobile terminal according to claim 8, wherein the reproduction of the moving image is stopped or the moving image being reproduced is reduced. In a computer program for controlling the display of a touch panel type portable terminal that is configured to perform display and input operations using a touch panel,
A process of detecting a first two-finger drag operation for dragging toward the center of the touch panel and a second two-finger drag operation for dragging toward the end of the touch panel while pressing both fingers of the operator against the touch panel; ,
A computer program for executing processing for controlling an image to be displayed on the touch panel in response to the first two-finger finger drag operation or the second two-finger drag operation.   When the first or second two-finger drag operation is detected, the process for controlling the image displays a non-displayed image embedded in the screen or an image displayed in a reduced state. 12. The process according to claim 11, wherein when the second or first two-finger drag operation is detected in an enlarged display, the displayed or enlarged image is hidden or reduced. The computer program described.   In the process of controlling the image, when the first or second two-handed finger drag operation is detected, the reproduction of the moving image is started, or the moving image being reproduced is enlarged, and the second or first The computer program according to claim 11, wherein when the two-hand finger drag operation is detected, the reproduction of the moving image is stopped or the moving image being reproduced is reduced.