WO2018167865A1 - Touch gesture determination device, touch gesture determination method, touch gesture determination program, and touch panel input device - Google Patents
Touch gesture determination device, touch gesture determination method, touch gesture determination program, and touch panel input device Download PDFInfo
- Publication number
- WO2018167865A1 WO2018167865A1 PCT/JP2017/010345 JP2017010345W WO2018167865A1 WO 2018167865 A1 WO2018167865 A1 WO 2018167865A1 JP 2017010345 W JP2017010345 W JP 2017010345W WO 2018167865 A1 WO2018167865 A1 WO 2018167865A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- gesture
- mode
- touch
- determination
- input
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
- G06F3/04166—Details of scanning methods, e.g. sampling time, grouping of sub areas or time sharing with display driving
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
- G06F3/0418—Control or interface arrangements specially adapted for digitisers for error correction or compensation, e.g. based on parallax, calibration or alignment
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
- G06F2203/04104—Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04808—Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
Definitions
- the present invention relates to a touch gesture determination device, a touch gesture determination method, a touch gesture determination program, and a touch gesture operation for inputting operation information corresponding to a touch gesture operation and outputting a signal based on the input operation information. And a touch panel input device that outputs a signal based on a touch gesture operation.
- Patent Document 1 a gesture performed in a three-dimensional space is used to determine whether the gesture operation has been switched to the next gesture operation based on the relative movement from the timing at which the gesture operation has been switched, using the past gesture operation history. A method is disclosed.
- Patent Document 1 the state when the mode is switched to a certain mode is set as an initial state, and the rotation angle and movement amount from the state are determined. However, changing the threshold value from the initial state is described. Absent. For this reason, there is a problem that a gesture in another mode is erroneously recognized as a gesture in another mode during a gesture operation in a certain mode.
- the present invention has been made to solve the above-described problems, and prevents erroneous recognition as a gesture in another mode during a gesture operation in a certain mode, thereby facilitating an input operation in the gesture.
- the purpose is to do.
- a touch gesture determination apparatus receives an operation image from a touch panel that displays an operation image on a screen, receives a user's touch gesture operation, and outputs operation information corresponding to the touch gesture operation.
- a touch gesture determination device that generates output information based on the operation information, the touch gesture determination device including an operation determination unit that generates output information for display on the touch panel based on the operation information;
- a display control unit that receives the output information and causes the touch panel to display an image corresponding to the output information as the operation image, and the operation determination unit performs a touch performed on the entire screen of the touch panel.
- a whole screen input determination unit that determines the output information from operation information corresponding to a gesture operation, wherein the whole screen input determination unit determines whether the gesture mode of the touch gesture operation is a first gesture mode or a second gesture mode.
- a gesture mode determination unit that determines whether the mode is a gesture mode; a first parameter related to the first gesture mode; and a second parameter that is different from the first parameter regarding the second gesture mode.
- the gesture mode determination unit determines that the gesture mode of the touch gesture operation is the first gesture mode
- the gesture mode determination unit determines a deviation from the first gesture mode using the first parameter. Mode deviation determination is performed, and the gesture mode of the touch gesture operation is the second If it is determined that the gesture mode and performs the determined mode deviation determination deviation from the second gesture mode using the second parameters.
- the touch gesture determination method displays an operation image on a screen, accepts a user's touch gesture operation, and outputs the operation information from a touch panel that outputs operation information corresponding to the touch gesture operation.
- a touch gesture determination method for receiving and generating output information based on the operation information the touch gesture determination method including an operation determination step for generating output information for display on the touch panel based on the operation information;
- the operation determination step is performed on the entire screen of the touch panel.
- the entire screen input determining step for determining the output information from the operation information corresponding to the touch gesture operation performed in the touch gesture operation, wherein the gesture input mode of the touch gesture operation is a first gesture mode.
- a gesture mode determination step for determining whether the gesture mode is a second gesture mode, wherein the gesture mode determination step relates to a first parameter related to the first gesture mode and the second gesture mode, If it is determined from the second parameter that is different from the first parameter that the gesture mode of the touch gesture operation is the first gesture mode, the first gesture mode is used by using the first parameter.
- Mode deviation judgment is performed to judge deviation from When it is determined that the gesture mode of the gesture operation is the second gesture mode, mode deviation determination is performed using the second parameter to determine deviation from the second gesture mode. To do.
- a touch panel input device displays an operation image on a screen, receives a touch gesture operation of a user, outputs operation information corresponding to the touch gesture operation, and receives the operation information.
- a touch gesture determination apparatus that controls display of the touch panel based on the operation information, wherein the touch gesture determination apparatus selects for display of the touch panel based on the operation information.
- An operation determination unit that generates a value; and a display control unit that receives the selection value and causes the touch panel to display an image corresponding to the selection value as the operation image.
- the operation determination unit includes the touch panel Touch gesture operation performed on the display component displayed as the operation image
- An operation mode switching determination unit that switches between a display component input mode that identifies input content based on and a whole screen input mode that identifies input content based on a touch gesture operation performed on the entire screen of the touch panel;
- a display component input determination unit that determines the selection value from the operation information in the display component input mode; and a whole screen input determination unit that determines the selection value from the operation information in the entire screen input mode.
- the entire screen input determination unit relates to a gesture mode determination unit that determines whether the type of the gesture mode of the touch gesture operation is the first gesture mode or the second gesture mode, and the first gesture mode.
- the present invention during a gesture operation in a certain mode, it can be prevented from being mistakenly recognized as a gesture in another mode, and the input operation with the gesture can be facilitated.
- the touch panel input device includes a touch panel having a touch operation screen (operation screen) and a touch gesture determination device that receives operation information on the touch panel.
- the touch panel input device is mounted on the target device or connected to be communicable with the target device, the operation screen of the electric device as the target device, the operation screen of the camera as the target device, and the target device
- the present invention can be applied to an operation screen of factory equipment, an operation screen mounted on a car, a ship, an aircraft, or the like as a target device, an operation screen of a portable information terminal such as a smartphone or a tablet terminal as a target device.
- the touch panel input device uses a signal (for example, a selection value) based on operation information input by a touch gesture operation (also referred to as “touch operation”) from the operation screen of the touch panel as a target device equipped with the touch panel input device, or a touch panel. This can be provided to a target device that can communicate with the input device.
- a touch gesture operation also referred to as “touch operation”
- the touch panel is a touch gesture input unit that accepts a touch gesture operation performed by the user.
- the touch gesture operation is an information input operation by a specific movement such as the user's finger (or the user's palm, or the user's finger and palm).
- Touch gesture operation is tapping, which is an operation of tapping the operation screen of the touch panel with a finger, flicking, which is an operation of flicking the operation screen of the touch panel with a finger, and a swipe which is an operation of sliding the operation screen of the touch panel with a finger (sliding the finger).
- tapping which is an operation of tapping the operation screen of the touch panel with a finger
- flicking which is an operation of flicking the operation screen of the touch panel with a finger
- a swipe which is an operation of sliding the operation screen of the touch panel with a finger (sliding the finger).
- Touch gesture operations include dragging, which is an operation of dragging a display component on the touch panel with a finger, pinch-in, which is an operation of narrowing the interval between fingers while pinching with multiple fingers on the operation screen of the touch panel, and multiple touch gestures on the operation screen of the touch panel. It can include pinch out, which is an operation to increase the interval between fingers.
- the touch gesture operation can include a dial gesture that operates to rotate the dial by touching two or more points, a slider gesture that moves the finger to slide while keeping the finger in contact with the touch panel.
- the touch gesture operation can include an operation using a touch pen which is a pen-type input auxiliary tool.
- FIG. 1 is a functional block diagram showing a schematic configuration of a touch panel input device 100 according to an embodiment of the present invention.
- FIG. 2 is a functional block diagram illustrating a schematic configuration of the entire screen input determination unit 12b according to the embodiment.
- the touch panel input device 100 includes a touch gesture determination device 110 and a touch panel 120.
- the touch gesture determination device 110 is a device that can execute the touch gesture determination method according to the embodiment and the touch gesture determination program according to the embodiment.
- the touch panel 120 receives a touch gesture operation performed by a user and outputs operation information (also referred to as “touch information”) A0 corresponding to the touch gesture operation, and an operation panel.
- the display panel unit 121 is arranged so as to overlap the unit 122 and can display an operation image such as a GUI (Graphical User Interface) screen.
- the display panel unit 121 is, for example, a liquid crystal display.
- the touch gesture determination device 110 includes an operation information input unit 11, an operation determination unit 12, and a display control unit 14.
- the touch gesture determination device 110 may include a notification unit 13.
- the operation information input unit 11 receives operation information (operation signal) A0 output from the operation panel unit 122.
- the operation information input unit 11 outputs input information A1 corresponding to the received operation information A0 to the operation determination unit 12.
- the input information A1 is information corresponding to the operation information A0, and may be the same information as the operation information A0.
- the operation determination unit 12 receives the input information A1 from the operation information input unit 11, and outputs a selection value A2 as output information to the notification unit 13 and the display control unit 14.
- the selection value A2 output from the operation determination unit 12 is a selection value determined by the operation determination unit 12 based on the input information A1, and an application program for a device in which the touch panel input device 100 is mounted based on the selection value A2. Etc. perform device control and the like.
- the operation determination unit 12 determines the type and content of the touch gesture operation by the user from the received input information A1. As shown in FIG. 1, the operation determination unit 12 includes a display component input determination unit 12a, a whole screen input determination unit 12b, and an operation mode switching determination unit 12c.
- the operation mode switching determination unit 12c determines from the input information A1 received from the operation information input unit 11 whether the input information A1 includes information related to switching of the operation mode of the screen.
- the screen operation modes include a display component operation mode in which display components to be operated are displayed in the screen, and an entire screen operation mode in which the entire screen is set as an input range. These operation modes can be switched. .
- the operation mode switching determination unit 12c switches the operation mode from the determination result regarding the switching of the operation mode.
- the operation mode switching determination unit 12c switches the operation mode, the display content of the operation screen, the input method, and the notification method are switched.
- the entire screen input determination unit 12b identifies input contents from touch information for the entire screen, and is responsible for accepting operations and determining a selection value A2. As illustrated in FIG. 2, the entire screen input determination unit 12 b includes a parameter 111 during mode, a parameter 112 other than during mode, a gesture mode determination unit 113, and a gesture input information determination unit 114.
- the input content of touch information for the entire screen is identified by the parameter 111 during mode, the parameter 112 other than during mode, and the gesture mode determination unit 113.
- the mode parameter 111 stores parameters such as a movement amount and a touch time used during a certain mode.
- the mode parameter 111 a parameter related to the gesture mode is stored for each type of gesture mode.
- the parameter 111 during mode stores, for example, a parameter 111 a for the slider mode and a parameter 111 b for the dial mode.
- the slider mode parameter 111a and the dial mode parameter 111b may be any one or a combination of two or more of a movement amount, a touch gesture operation speed, a curvature, and a touch time in a predetermined time of the touch gesture operation. It is a parameter determined based on this.
- the parameter stored in the parameter 111 during the mode is not limited to the example shown in FIG.
- the parameters 112 other than in the mode store parameters such as a movement amount and a touch time used when not in any mode such as the first operation.
- the gesture mode determination unit 113 refers to the in-mode parameter 111 and the non-mode parameter 112 to identify the gesture mode of the input touch information.
- the gesture input information determination unit 114 determines the selection value A2 according to the value setting method in the gesture mode specified by the gesture mode determination unit 113.
- the display component input determination unit 12a identifies the input content from the touch information for the display component displayed on the screen, and is responsible for accepting the operation and determining the selection value A2.
- the notification unit 13 switches the operation screen notification method according to the determination result of the operation mode switching determination unit 12c, and receives the information of the selected value A2 determined by the operation determination unit 12, and notifies the operation status.
- the notification unit 13 issues a notification of notification contents according to the selection value A2 or outputs a notification signal.
- the notification unit 13 notifies the status of the user's touch gesture operation by, for example, sound, screen display, vibration by a vibrator, or lamp lighting.
- the notification unit 13 When the notification by the notification unit 13 is a notification by sound, the notification unit 13 outputs a notification signal to a speaker as an audio output unit.
- the speaker is shown in FIG.
- the notification unit 13 When the notification by the notification unit 13 is an image display, the notification unit 13 sends notification information A3 to the display control unit 14, and the display control unit 14 transmits an image signal A4 based on the notification information A3 to the display panel unit 121 of the touch panel 120. Send to.
- the display control unit 14 switches the display content of the operation screen according to the determination result of the operation mode switching determination unit 12c, receives the information of the selection value A2 determined by the operation determination unit 12, and reflects the operation result on the screen. As shown in FIG. 1, the display control unit 14 outputs an image signal A4 of an operation image displayed on the display panel unit 121 of the touch panel 120 to the display panel unit 121.
- FIG. 3 is a diagram illustrating an example of a hardware (H / W) configuration of the touch panel input device 100 according to the embodiment.
- the touch panel input device 100 includes a touch panel 120, a processor 301, a memory 302, and a speaker 303.
- a touch gesture determination device 110 shown in FIG. 1 includes a memory 302 as a storage device that stores a touch gesture determination program as software, and a processor 301 as an information processing unit that executes the touch gesture determination program stored in the memory 302. (For example, by a computer).
- the components 11 to 14 in FIG. 1 correspond to the processor 301 that executes the touch gesture determination program in FIG.
- a part of the touch gesture determination device 110 shown in FIG. 1 can also be realized by the memory 302 shown in FIG. 2 and the processor 301 that executes the touch gesture determination program.
- the touch panel 120 detects contact of a plurality of fingers and transmits touch information (identification number, coordinates, contact state of each finger) to the processor 301.
- the processor 301 stores the touch information acquired from the touch panel 120 in the memory 302, and switches the operation screen, the input method, and the notification method based on the touch history information accumulated in the memory 302.
- the processor 301 determines from the touch information stored in the memory 302 whether the operation is for the entire screen or an operation for the display component, and determines a selection value in each operation mode.
- the speaker 303 is a sound output unit used when, for example, a touch gesture operation status is notified by sound such as an announcement.
- the touch panel input device 100 may include an additional device such as a vibrator, a lamp, and a transmission device for wirelessly transmitting a notification signal instead of the speaker 303 or as an additional configuration.
- FIG. 4A and 4B are diagrams illustrating examples of the screen of the touch panel 120 and the touch gesture operation in the touch panel input device 100 according to the embodiment.
- FIG. 4A shows a screen example 401 displayed in the display component operation mode. As shown in FIG. 4A, the screen example 401 displays various parts to be operated, such as a button 402 for directly selecting a selection value. By touch-inputting the area where the display component is displayed, the target component can be operated.
- FIG. 4B shows an example screen 403 displayed in the entire screen operation mode.
- the screen example 403 shows a display 404 of the currently selected value, a display prompting an operation instruction for switching the screen (for example, a cancel area 405 described later), and the like. It is.
- information is input by the number of tap operations, a gesture that rotates the dial with two or more touches, and the like.
- FIG. 5 is a flowchart illustrating the operation (touch gesture determination method) of the touch gesture determination device 110 in the touch panel input device 100 according to the embodiment.
- the user activates the system in the display component operation mode and initializes each processing unit.
- the operation mode switching determination unit 12c determines switching input to the entire screen operation mode based on the touch information input from the operation information input unit 11.
- the operation mode is changed, and the display contents, input method, and notification method in the entire screen operation mode are switched.
- the gesture input information determination unit 114 identifies information related to the gesture input from the touch information input by the user, and thereby determines the selection value A2. For example, the user inputs information using a gesture (dial gesture) that rotates the dial with two or more touches.
- a gesture dial gesture
- An object of the touch gesture determination method is to prevent erroneous recognition as another gesture operation when a certain gesture operation is performed as described above.
- step ST405 by passing the selection value A2 determined in step ST404 to the operation screen display unit 109, the display content is switched and a screen reflecting the operation content is displayed.
- step ST406 the selection value A2 determined in step ST404 is passed to the notification unit 13, so that the notification content is switched, the notification of the situation after the operation result, and the announcement for prompting the operation are performed.
- the operation mode switching determination unit 12c determines a switching input to the display component operation mode from the touch information input from the operation information input unit 11 and the touch history information.
- the display component operation mode is entered, and the operation screen for the display component displayed at the initial activation is entered. If there is no switching input to the display component operation mode, touch input to the operation panel unit 122 is accepted until the switching input is accepted, and the display content and notification content are switched accordingly.
- step ST402 In the input determination regarding the screen switching in step ST402, if the input content is not switching to the entire screen operation mode (NO in ST402), input determination for the display component is performed in the next step ST709.
- ⁇ ⁇ Input input to the display component in the display component operation mode is determined based on whether touch input coordinates are included in the display component operation range.
- the selection value A2 is determined in the next step ST410.
- the touch input is accepted again in step ST402.
- the display component input determination unit 12a determines the selection value A2 based on the touch information input from the operation information input unit 11. As an example of selection, as shown in the display screen of each display component in FIG. 3, a display component assigned with a specific selection value such as a button is arranged, and the selection value is input by touch input to the display component. decide.
- step ST411 by passing the selection value A2 determined in step ST410 to the display control unit 14, the display content of the display panel unit 121 is switched, and a screen corresponding to the operation content is displayed.
- step ST412 by passing the selection value A2 determined in step ST410 to the notification unit 13, the notification content is switched, the notification of the situation after the operation result, and the announcement for prompting the operation are performed.
- FIG. 6 is a flowchart showing the gesture mode deviation determination operation by the gesture mode determination unit 113 in the embodiment.
- the gesture mode determination unit 113 determines whether or not it is in the gesture mode.
- the gesture mode determination unit 113 determines that the gesture mode is not in effect immediately after the gesture input information determination unit 114 determines the selection value A2, for example.
- the gesture mode determination unit 113 determines that the user is in the gesture mode, for example, when the user is scrolling on the touch panel or in the dial mode.
- step ST501 If it is determined in step ST501 that it is in the gesture mode (YES in ST501), in next step ST502, the gesture mode determination unit 113 performs the slider mode as the first gesture mode and the dial as the second gesture mode. It is determined which of the gesture mode or the touch gesture mode is being performed.
- step ST502 If it is determined in step ST502 that it is a slider gesture, the process proceeds to step ST503 to acquire a slider mode parameter as a first parameter. If it is determined in step ST502 that it is a dial gesture, the process proceeds to step ST504 to acquire a dial mode parameter as a second parameter. If it is determined in step ST502 that the gesture is a touch gesture, the process proceeds to step ST505, and a touch mode parameter corresponding to the touch gesture is acquired.
- the slider mode parameter, the dial mode parameter, and the touch mode parameter are any one or more of a movement amount at a predetermined time of the touch gesture operation, a speed of the touch gesture operation, a curvature, or a touch time. It is determined based on the combination.
- step ST506 After acquiring parameters corresponding to each gesture mode in steps ST503 to ST505, the process proceeds to the next step ST506, and it is determined whether a predetermined time has elapsed since the type of the gesture mode is determined in step ST502. If the predetermined time has elapsed (YES in step ST506), the process proceeds to the next step ST507, and using the acquired parameters in the gesture mode, mode deviation determination is performed to determine whether or not the gesture has deviated.
- step ST501 If it is determined in step ST501 that the gesture mode is not being performed (NO in ST501), the process proceeds to step ST508, and a parameter 112 other than the mode is acquired as a third parameter, and mode deviation determination is performed in the next step ST509. Do.
- the gesture mode determination unit 113 determines the type of the gesture mode being executed, and the parameter according to the determined gesture mode type. And mode deviation determination is performed using the acquired parameters. Accordingly, it is possible to prevent erroneous recognition as another mode during an operation in a certain mode, an input operation with a gesture is facilitated, and a user operability is improved.
- the mode is maintained for a predetermined time or more, and then the mode deviation is determined. Thereby, it can prevent deviating from the mode unintentionally during operation in a certain mode.
- Operation information input unit 12 Operation determination unit, 12a Display part input determination unit, 12b Whole screen input determination unit, 13 Notification unit, 14 Display control unit, 100 Touch panel input device, 110 Touch gesture determination device, Parameters in 111 mode , 111a slider mode parameter, 111b dial mode parameter, parameter other than 112 mode, 113 gesture mode determination unit, 114 gesture input information determination unit, 120 touch panel, 121 display panel unit, 122 operation panel unit, 301 processor, 302 Memory, 303 speaker, A0 operation information, 401,403 screen examples, 405 cancel area, A1 input information, A2 selected value, 3 notification information, A4 operation determination information.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
Description
《1》構成
図1は、本発明の実施の形態に係るタッチパネル入力装置100の概略構成を示す機能ブロック図である。図2は、実施の形態における画面全体入力判定部12bの概略構成を示す機能ブロック図である。図1に示されるように、実施の形態に係るタッチパネル入力装置100は、タッチジェスチャ判定装置110と、タッチパネル120とを有している。タッチジェスチャ判定装置110は、実施の形態に係るタッチジェスチャ判定方法及び実施の形態に係るタッチジェスチャ判定プログラムを実行することができる装置である。 Embodiment.
<< 1 >> Configuration FIG. 1 is a functional block diagram showing a schematic configuration of a touch
以上のように、実施の形態に係るタッチパネル入力装置100によれば、ジェスチャモード判定部113により実行中のジェスチャモードの種類を判定し、判定されたジェスチャモードの種類に応じたパラメータを取得し、取得したパラメータを用いてモード逸脱判定を行う。これにより、あるモードでの操作中に、他のモードと誤認識されることを防ぐことができ、ジェスチャでの入力操作が容易になり、ユーザの操作性が向上する。 << 2 >> Effect As described above, according to the touch
Claims (11)
- 画面に操作用画像を表示し、ユーザのタッチジェスチャ操作を受け付け、前記タッチジェスチャ操作に対応する操作情報を出力するタッチパネルから、前記操作情報を受け取り、前記操作情報に基づく出力情報を生成するタッチジェスチャ判定装置であって、
前記タッチジェスチャ判定装置は、
前記操作情報に基づいて、前記タッチパネルの表示のための出力情報を生成する操作判定部と、
前記出力情報を受け取り、前記タッチパネルに前記操作用画像として前記出力情報に応じた画像を表示させる表示制御部と、を有し、
前記操作判定部は、
前記タッチパネルの画面全体に対して行われたタッチジェスチャ操作に基づいて入力内容を識別する画面全体入力モードにおいて行われたタッチジェスチャ操作に対応する操作情報から前記出力情報を決定する画面全体入力判定部を有し、
前記画面全体入力判定部は、
前記タッチジェスチャ操作のジェスチャモードが第1のジェスチャモードであるか第2のジェスチャモードであるかを判定するジェスチャモード判定部と、
前記第1のジェスチャモードに関する第1のパラメータと、
前記第2のジェスチャモードに関し、前記第1のパラメータと異なる第2のパラメータと、を有し、
前記ジェスチャモード判定部は、
前記タッチジェスチャ操作のジェスチャモードが前記第1のジェスチャモードであると判定した場合には前記第1のパラメータを用いて前記第1のジェスチャモードからの逸脱を判定するモード逸脱判定を行い、前記タッチジェスチャ操作のジェスチャモードが前記第2のジェスチャモードであると判定した場合には前記第2のパラメータを用いて前記第2のジェスチャモードからの逸脱を判定するモード逸脱判定を行う
ことを特徴とするタッチジェスチャ判定装置。 A touch gesture that displays an operation image on a screen, receives a touch gesture operation of a user, receives the operation information from a touch panel that outputs operation information corresponding to the touch gesture operation, and generates output information based on the operation information. A determination device,
The touch gesture determination device includes:
An operation determination unit that generates output information for display on the touch panel based on the operation information;
A display control unit that receives the output information and causes the touch panel to display an image corresponding to the output information as the operation image;
The operation determination unit is
Whole screen input determination unit for determining the output information from operation information corresponding to the touch gesture operation performed in the entire screen input mode for identifying input contents based on the touch gesture operation performed on the entire screen of the touch panel Have
The entire screen input determination unit
A gesture mode determination unit that determines whether the gesture mode of the touch gesture operation is the first gesture mode or the second gesture mode;
A first parameter relating to the first gesture mode;
A second parameter different from the first parameter for the second gesture mode;
The gesture mode determination unit
When it is determined that the gesture mode of the touch gesture operation is the first gesture mode, a mode deviation determination is performed using the first parameter to determine a deviation from the first gesture mode, and the touch When it is determined that the gesture mode of the gesture operation is the second gesture mode, mode deviation determination is performed using the second parameter to determine deviation from the second gesture mode. Touch gesture determination device. - 前記モード逸脱判定は、前記タッチジェスチャ操作のジェスチャモードの前記判定から予め定められた時間が経過した後に行われる
ことを特徴とする請求項1に記載のタッチジェスチャ判定装置。 The touch gesture determination device according to claim 1, wherein the mode deviation determination is performed after a predetermined time has elapsed since the determination of the gesture mode of the touch gesture operation. - 前記画面全体入力判定部は、ジェスチャモード以外の操作に関するパラメータである第3のパラメータをさらに有し、
前記ジェスチャモード判定部は、
前記ユーザがジェスチャモード中であるか否かの判定を行い、前記ユーザがジェスチャモード中ではないと判定した場合には、前記第3のパラメータを用いてモード逸脱判定を行う
ことを特徴とする請求項1又は2に記載のタッチジェスチャ判定装置。 The entire screen input determination unit further includes a third parameter that is a parameter related to an operation other than the gesture mode,
The gesture mode determination unit
It is determined whether or not the user is in a gesture mode, and when it is determined that the user is not in a gesture mode, a mode deviation determination is performed using the third parameter. Item 3. The touch gesture determination device according to Item 1 or 2. - 前記第1から第3のパラメータは、
前記タッチジェスチャ操作の予め定められた時間における移動量、前記タッチジェスチャ操作の速度、曲率、又はタッチ時間
のいずれか1つ又は2つ以上の組み合わせに基づいて定められる
ことを特徴とする請求項3に記載のタッチジェスチャ判定装置。 The first to third parameters are:
4. The moving amount of the touch gesture operation in a predetermined time, the speed of the touch gesture operation, the curvature, or the touch time is determined based on one or a combination of two or more. The touch gesture determination device according to claim 1. - 前記操作判定部は、
前記タッチパネルに前記操作用画像として表示された表示部品に対して行われたタッチジェスチャ操作に基づいて入力内容を識別する表示部品入力モードにおいて行われたタッチジェスチャ操作に対応する操作情報から前記出力情報を決定する表示部品入力判定部と、
前記表示部品入力モードと前記画面全体入力モードとを切り替える操作モード切り替え部と、をさらに有する
ことを特徴とする請求項1から4のいずれか1項に記載のタッチジェスチャ判定装置。 The operation determination unit is
The output information from the operation information corresponding to the touch gesture operation performed in the display component input mode for identifying the input content based on the touch gesture operation performed on the display component displayed as the operation image on the touch panel. A display component input determination unit for determining
The touch gesture determination device according to claim 1, further comprising: an operation mode switching unit that switches between the display component input mode and the entire screen input mode. - 前記タッチパネルから出力された前記操作情報を受け取り、受け取った前記操作情報に対応する入力情報を前記操作判定部に出力する操作情報入力部を更に有する
ことを特徴とする請求項1から5のいずれか1項に記載のタッチジェスチャ判定装置。 The operation information input unit that receives the operation information output from the touch panel and outputs input information corresponding to the received operation information to the operation determination unit. The touch gesture determination device according to claim 1. - 前記出力情報に従う通知内容の通知を発し、又は前記出力情報に従う通知内容の通知信号を出力する通知部を更に有する
ことを特徴とする請求項1から6のいずれか1項に記載のタッチジェスチャ判定装置。 The touch gesture determination according to any one of claims 1 to 6, further comprising: a notification unit that issues a notification content according to the output information or outputs a notification signal according to the output information. apparatus. - 画面に操作用画像を表示し、ユーザのタッチジェスチャ操作を受け付け、前記タッチジェスチャ操作に対応する操作情報を出力するタッチパネルから、前記操作情報を受け取り、前記操作情報に基づく出力情報を生成するタッチジェスチャ判定方法であって、
前記タッチジェスチャ判定方法は、
前記操作情報に基づいて、前記タッチパネルの表示のための出力情報を生成する操作判定ステップと、
前記出力情報を受け取り、前記タッチパネルに前記操作用画像として前記出力情報に応じた画像を表示させる表示制御ステップと、を有し、
前記操作判定ステップは、
前記タッチパネルの画面全体に対して行われたタッチジェスチャ操作に基づいて入力内容を識別する画面全体入力モードにおいて行われたタッチジェスチャ操作に対応する操作情報から前記出力情報を決定する画面全体入力判定ステップを有し、
前記画面全体入力判定ステップは、
前記タッチジェスチャ操作のジェスチャモードが第1のジェスチャモードであるか第2のジェスチャモードであるかを判定するジェスチャモード判定ステップを有し、
前記ジェスチャモード判定ステップは、
前記第1のジェスチャモードに関する第1のパラメータと、
前記第2のジェスチャモードに関し、前記第1のパラメータと異なる第2のパラメータとから、
前記タッチジェスチャ操作のジェスチャモードが前記第1のジェスチャモードであると判定した場合には前記第1のパラメータを用いて前記第1のジェスチャモードからの逸脱を判定するモード逸脱判定を行い、前記タッチジェスチャ操作のジェスチャモードが前記第2のジェスチャモードであると判定した場合には前記第2のパラメータを用いて前記第2のジェスチャモードからの逸脱を判定するモード逸脱判定を行う
ことを特徴とするタッチジェスチャ判定方法。 A touch gesture that displays an operation image on a screen, receives a touch gesture operation of a user, receives the operation information from a touch panel that outputs operation information corresponding to the touch gesture operation, and generates output information based on the operation information. A determination method comprising:
The touch gesture determination method includes:
An operation determination step for generating output information for display on the touch panel based on the operation information;
A display control step of receiving the output information and causing the touch panel to display an image according to the output information as the operation image;
The operation determination step includes
Whole screen input determination step for determining the output information from operation information corresponding to the touch gesture operation performed in the entire screen input mode for identifying the input content based on the touch gesture operation performed on the entire screen of the touch panel. Have
The entire screen input determining step includes:
A gesture mode determination step for determining whether a gesture mode of the touch gesture operation is a first gesture mode or a second gesture mode;
The gesture mode determination step includes:
A first parameter relating to the first gesture mode;
With respect to the second gesture mode, from a second parameter different from the first parameter,
When it is determined that the gesture mode of the touch gesture operation is the first gesture mode, a mode deviation determination is performed using the first parameter to determine a deviation from the first gesture mode, and the touch When it is determined that the gesture mode of the gesture operation is the second gesture mode, mode deviation determination is performed using the second parameter to determine deviation from the second gesture mode. Touch gesture determination method. - コンピュータに、
画面に操作用画像を表示し、ユーザのタッチジェスチャ操作を受け付け、前記タッチジェスチャ操作に対応する操作情報を出力するタッチパネルから、前記操作情報を受け取り、前記操作情報に基づく出力情報を生成するために、
前記操作情報に基づいて、前記タッチパネルの表示のための出力情報を生成する操作判定処理と、
前記出力情報を受け取り、前記タッチパネルに前記操作用画像として前記出力情報に応じた画像を表示させる表示制御処理と、を実行させ、
前記操作判定処理は、
前記タッチパネルの画面全体に対して行われたタッチジェスチャ操作に基づいて入力内容を識別する画面全体入力モードにおいて行われたタッチジェスチャ操作に対応する操作情報から前記出力情報を決定する画面全体入力判定処理を有し、
前記画面全体入力判定処理は、
前記タッチジェスチャ操作のジェスチャモードが第1のジェスチャモードであるか第2のジェスチャモードであるかを判定するジェスチャモード判定処理を有し、
前記ジェスチャモード判定処理は、
前記第1のジェスチャモードに関する第1のパラメータと、
前記第2のジェスチャモードに関し、前記第1のパラメータと異なる第2のパラメータとから、
前記タッチジェスチャ操作のジェスチャモードが前記第1のジェスチャモードであると判定した場合には前記第1のパラメータを用いて前記第1のジェスチャモードからの逸脱を判定するモード逸脱判定処理と、前記タッチジェスチャ操作のジェスチャモードが前記第2のジェスチャモードであると判定した場合には前記第2のパラメータを用いて前記第2のジェスチャモードからの逸脱を判定するモード逸脱判定処理とを行う
ことを特徴とするタッチジェスチャ判定プログラム。 On the computer,
To display an operation image on the screen, accept a user's touch gesture operation, receive operation information from a touch panel that outputs operation information corresponding to the touch gesture operation, and generate output information based on the operation information ,
An operation determination process for generating output information for display on the touch panel based on the operation information;
Receiving the output information, and causing the touch panel to display an image according to the output information as the operation image,
The operation determination process includes
Whole screen input determination processing for determining the output information from operation information corresponding to the touch gesture operation performed in the whole screen input mode for identifying the input content based on the touch gesture operation performed on the entire screen of the touch panel Have
The entire screen input determination process includes:
A gesture mode determination process for determining whether a gesture mode of the touch gesture operation is a first gesture mode or a second gesture mode;
The gesture mode determination process includes:
A first parameter relating to the first gesture mode;
With respect to the second gesture mode, from a second parameter different from the first parameter,
When it is determined that the gesture mode of the touch gesture operation is the first gesture mode, a mode deviation determination process for determining deviation from the first gesture mode using the first parameter; and the touch When it is determined that the gesture mode of the gesture operation is the second gesture mode, a mode deviation determination process for determining deviation from the second gesture mode is performed using the second parameter. Touch gesture determination program. - 画面に操作用画像を表示し、ユーザのタッチジェスチャ操作を受け付け、前記タッチジェスチャ操作に対応する操作情報を出力するタッチパネルと、
前記操作情報を受け取り、前記操作情報に基づいて前記タッチパネルの表示を制御するタッチジェスチャ判定装置と
を有するタッチパネル入力装置であって、
前記タッチジェスチャ判定装置は、
前記操作情報に基づいて、前記タッチパネルの表示のための出力情報を生成する操作判定部と、
前記出力情報を受け取り、前記タッチパネルに前記操作用画像として前記出力情報に応じた画像を表示させる表示制御部と、を有し、
前記操作判定部は、
前記タッチパネルの画面全体に対して行われたタッチジェスチャ操作に基づいて入力内容を識別する画面全体入力モードにおいて行われたタッチジェスチャ操作に対応する操作情報から前記出力情報を決定する画面全体入力判定部を有し、
前記画面全体入力判定部は、
前記タッチジェスチャ操作のジェスチャモードが第1のジェスチャモードであるか第2のジェスチャモードであるかを判定するジェスチャモード判定部と、
前記第1のジェスチャモードに関する第1のパラメータと、
前記第2のジェスチャモードに関し、前記第1のパラメータと異なる第2のパラメータと、を有し、
前記ジェスチャモード判定部は、
前記タッチジェスチャ操作のジェスチャモードが前記第1のジェスチャモードであると判定した場合には前記第1のパラメータを用いて前記第1のジェスチャモードからの逸脱を判定するモード逸脱判定を行い、前記タッチジェスチャ操作のジェスチャモードが前記第2のジェスチャモードであると判定した場合には前記第2のパラメータを用いて前記第2のジェスチャモードからの逸脱を判定するモード逸脱判定を行う
ことを特徴とするタッチパネル入力装置。 A touch panel that displays an operation image on a screen, accepts a user's touch gesture operation, and outputs operation information corresponding to the touch gesture operation;
A touch gesture determination apparatus that receives the operation information and controls a display of the touch panel based on the operation information;
The touch gesture determination device includes:
An operation determination unit that generates output information for display on the touch panel based on the operation information;
A display control unit that receives the output information and causes the touch panel to display an image corresponding to the output information as the operation image;
The operation determination unit is
Whole screen input determination unit for determining the output information from operation information corresponding to the touch gesture operation performed in the entire screen input mode for identifying input contents based on the touch gesture operation performed on the entire screen of the touch panel Have
The entire screen input determination unit
A gesture mode determination unit that determines whether the gesture mode of the touch gesture operation is the first gesture mode or the second gesture mode;
A first parameter relating to the first gesture mode;
A second parameter different from the first parameter for the second gesture mode;
The gesture mode determination unit
When it is determined that the gesture mode of the touch gesture operation is the first gesture mode, a mode deviation determination is performed using the first parameter to determine a deviation from the first gesture mode, and the touch When it is determined that the gesture mode of the gesture operation is the second gesture mode, mode deviation determination is performed using the second parameter to determine deviation from the second gesture mode. Touch panel input device. - 前記タッチパネルは、
前記タッチジェスチャ操作を受け付け、前記タッチジェスチャ操作に対応する前記操作情報を出力する操作パネル部と、前記操作パネル部と重ねて配置され、前記画面に前記操作用画像を表示する表示パネル部とを有する
ことを特徴とする請求項10に記載のタッチパネル入力装置。 The touch panel
An operation panel unit that receives the touch gesture operation and outputs the operation information corresponding to the touch gesture operation, and a display panel unit that is arranged to overlap the operation panel unit and displays the operation image on the screen. The touch panel input device according to claim 10.
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2017/010345 WO2018167865A1 (en) | 2017-03-15 | 2017-03-15 | Touch gesture determination device, touch gesture determination method, touch gesture determination program, and touch panel input device |
DE112017006949.1T DE112017006949T5 (en) | 2017-03-15 | 2017-03-15 | A touch gesture judging device, a touch gesture judging method, a touch gesture judging program, and a touch panel input device |
JP2017540659A JP6227213B1 (en) | 2017-03-15 | 2017-03-15 | Touch gesture determination device, touch gesture determination method, touch gesture determination program, and touch panel input device |
KR1020197026428A KR102136526B1 (en) | 2017-03-15 | 2017-03-15 | Touch gesture judgment device, touch gesture judgment method, touch gesture judgment program, and touch panel input device |
CN201780088102.5A CN110402427B (en) | 2017-03-15 | 2017-03-15 | Touch gesture determination device, touch gesture determination method, recording medium containing touch gesture determination program, and touch panel input device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2017/010345 WO2018167865A1 (en) | 2017-03-15 | 2017-03-15 | Touch gesture determination device, touch gesture determination method, touch gesture determination program, and touch panel input device |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2018167865A1 true WO2018167865A1 (en) | 2018-09-20 |
Family
ID=60265772
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2017/010345 WO2018167865A1 (en) | 2017-03-15 | 2017-03-15 | Touch gesture determination device, touch gesture determination method, touch gesture determination program, and touch panel input device |
Country Status (5)
Country | Link |
---|---|
JP (1) | JP6227213B1 (en) |
KR (1) | KR102136526B1 (en) |
CN (1) | CN110402427B (en) |
DE (1) | DE112017006949T5 (en) |
WO (1) | WO2018167865A1 (en) |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2008070968A (en) * | 2006-09-12 | 2008-03-27 | Funai Electric Co Ltd | Display processor |
JP2016515741A (en) * | 2013-04-15 | 2016-05-30 | マイクロソフト テクノロジー ライセンシング,エルエルシー | Pan and scaling detection during multi-finger touch interaction |
JP2016164702A (en) * | 2015-03-06 | 2016-09-08 | 京セラドキュメントソリューションズ株式会社 | Display input device, image formation apparatus having the same, control method and program of display input device |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8106856B2 (en) * | 2006-09-06 | 2012-01-31 | Apple Inc. | Portable electronic device for photo management |
WO2010067537A1 (en) * | 2008-12-08 | 2010-06-17 | シャープ株式会社 | Manual control action input device and computer program |
US8427440B2 (en) * | 2009-05-05 | 2013-04-23 | Microsoft Corporation | Contact grouping and gesture recognition for surface computing |
JP5782431B2 (en) | 2009-05-27 | 2015-09-24 | オブロング・インダストリーズ・インコーポレーテッド | Spatial multi-mode control device for use with spatial motion systems |
WO2011158475A1 (en) * | 2010-06-16 | 2011-12-22 | パナソニック株式会社 | Information input device, information input method and programme |
CN102694942B (en) * | 2011-03-23 | 2015-07-15 | 株式会社东芝 | Image processing apparatus, method for displaying operation manner, and method for displaying screen |
JP6032420B2 (en) * | 2012-04-02 | 2016-11-30 | カシオ計算機株式会社 | Print information output apparatus, print information output method, program, and portable electronic device |
JP5852514B2 (en) * | 2012-06-13 | 2016-02-03 | 株式会社東海理化電機製作所 | Touch sensor |
JP5772773B2 (en) * | 2012-09-19 | 2015-09-02 | コニカミノルタ株式会社 | Image processing apparatus, operation standardization method, and operation standardization program |
CN102890616B (en) * | 2012-09-26 | 2016-03-30 | 杨生虎 | The shortcut input method of touch-screen and system |
JP5700020B2 (en) * | 2012-10-10 | 2015-04-15 | コニカミノルタ株式会社 | Image processing apparatus, program, and operation event determination method |
JP5862587B2 (en) * | 2013-03-25 | 2016-02-16 | コニカミノルタ株式会社 | Gesture discrimination device, gesture discrimination method, and computer program |
CN106095307B (en) * | 2016-06-01 | 2019-05-31 | 努比亚技术有限公司 | Rotate gesture identifying device and method |
-
2017
- 2017-03-15 WO PCT/JP2017/010345 patent/WO2018167865A1/en active Application Filing
- 2017-03-15 DE DE112017006949.1T patent/DE112017006949T5/en not_active Ceased
- 2017-03-15 KR KR1020197026428A patent/KR102136526B1/en active IP Right Grant
- 2017-03-15 CN CN201780088102.5A patent/CN110402427B/en active Active
- 2017-03-15 JP JP2017540659A patent/JP6227213B1/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2008070968A (en) * | 2006-09-12 | 2008-03-27 | Funai Electric Co Ltd | Display processor |
JP2016515741A (en) * | 2013-04-15 | 2016-05-30 | マイクロソフト テクノロジー ライセンシング,エルエルシー | Pan and scaling detection during multi-finger touch interaction |
JP2016164702A (en) * | 2015-03-06 | 2016-09-08 | 京セラドキュメントソリューションズ株式会社 | Display input device, image formation apparatus having the same, control method and program of display input device |
Also Published As
Publication number | Publication date |
---|---|
DE112017006949T5 (en) | 2019-10-31 |
KR102136526B1 (en) | 2020-07-22 |
KR20190109551A (en) | 2019-09-25 |
JP6227213B1 (en) | 2017-11-08 |
JPWO2018167865A1 (en) | 2019-03-22 |
CN110402427B (en) | 2022-05-31 |
CN110402427A (en) | 2019-11-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9612736B2 (en) | User interface method and apparatus using successive touches | |
US8271908B2 (en) | Touch gestures for remote control operations | |
US20140223299A1 (en) | Gesture-based user interface method and apparatus | |
US20150199125A1 (en) | Displaying an application image on two or more displays | |
US10430071B2 (en) | Operation of a computing device functionality based on a determination of input means | |
JP5522755B2 (en) | INPUT DISPLAY CONTROL DEVICE, THIN CLIENT SYSTEM, INPUT DISPLAY CONTROL METHOD, AND PROGRAM | |
JPWO2013099042A1 (en) | Information terminal, information terminal control method, and program | |
WO2014034369A1 (en) | Display control device, thin-client system, display control method, and recording medium | |
JP6253861B1 (en) | Touch gesture determination device, touch gesture determination method, touch gesture determination program, and touch panel input device | |
JP6227213B1 (en) | Touch gesture determination device, touch gesture determination method, touch gesture determination program, and touch panel input device | |
JP6737239B2 (en) | Display device and display control program | |
JP2019070990A (en) | Display control device | |
JP6327834B2 (en) | Operation display device, operation display method and program | |
KR20150010553A (en) | User interface method and apparatus using successive touches | |
JP6971573B2 (en) | Electronic devices, their control methods and programs | |
JP2012159981A (en) | Display controller and control method therefor | |
JP2016038619A (en) | Mobile terminal device and operation method thereof | |
JP2015158759A (en) | function selection execution device, function selection execution method and function selection execution program | |
JP2020077181A (en) | Display control device, and control method and program for display control device | |
KR100966848B1 (en) | Method and apparatus for displaying rolling cube menu bar | |
KR101397907B1 (en) | System, control method, and recording media for recognizing multi-touch | |
US20150241982A1 (en) | Apparatus and method for processing user input | |
KR101136327B1 (en) | A touch and cursor control method for portable terminal and portable terminal using the same | |
WO2013099042A1 (en) | Information terminal, method of controlling information terminal, and program | |
JP2015200979A (en) | Information processing unit and computer program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 2017540659 Country of ref document: JP Kind code of ref document: A |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17901311 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 20197026428 Country of ref document: KR Kind code of ref document: A |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17901311 Country of ref document: EP Kind code of ref document: A1 |