TW202042047A - Multiple-point trigger command system and method - Google Patents

Abstract

A multiple-point triggering command system and method for a human-machine interface command input type of a folding touch mobile phone, comprising: a Multiple-point trigger Command Editor (MCE), providing user definition and editing command attributes, including: upper layer command, command type, button type, command bar type, lower layer command bar, etc.; Command Da-taBase (CDB), database contents include system definition and user-defined command attributes, command upper and lower layers, command button type, button icons, etc. The application (APP) can select the defined command, button type, and button icon when developing. Multiple-point Command Execution module (MCX), the application (APP) calls this module when it is executed, and the multiple-point trigger command can be at the same time, specify the upper directory and the lower specific commands; can be used for the selection of the touch screen related device commands, both hands control the upper directory and specific commands, especially suitable for folding mobile devices.

Description

Multi-point trigger instruction system and method

The field of the invention relates to a touch screen man-machine interface command input operation method. The traditional input method in which a finger touches the touch screen. The screen has a command bar area. The traditional command bar has a fixed number of commands. If it is not enough, it can be subdivided. For example, the level is subdivided into: system level, functional level, and sub-functional level. For example, applications (APP) such as Amazon, Instagram, Line or Facebook use this method, but mobile devices such as mobile phones have a small touch screen area. This multi-layered command If the number of commands is large, it is difficult to arrange, and the screen switching between sub-functions is very complicated. However, after the application of foldable touch screens becomes more popular, how to plan the command bar with the feature of seeing and triggering on the screen, so that the front and back hands are at the same time The simultaneous use of commands is an important development trend in the current human-machine interface field, so that the left and right hands can simultaneously and effectively control the folding mobile device.

Traditionally, there are many types of input devices that can be used to perform input operations in computing systems, such as buttons, keys, mice, trackballs, joysticks, touch sensor panels, touch screens, and similar devices. Among them, touch screens It has the characteristics of seeing, clicking and issuing commands. Because of its ease of operation, versatility, and declining prices, touch screen applications have become increasingly popular. Its friendly command input is very important, generally traditional graphics The interface (GUI) uses command bar input, such as: Microsoft File, Google's Web Chrome, when the command can be divided into two layers and divided into categories, such as Microsoft Words, PowerPoint uses this method, but it is complicated The command bar is difficult to fit into the small touch screen of a mobile phone. All touch screens adopt single-point touch, and the switching of directories and commands is complicated. Another foldable touch screen allows both hands to synchronize the touch screen. The feature of how to effectively use both hands to control the screen at multiple points will be foldable An important issue for the friendliness of mobile devices.

Touch screens include: touch sensor panels, transparent panels with touch-sensitive surfaces, liquid crystal displays (LCD) display devices. The touch screen allows users to use fingers, stylus,... . And other tools, click on a specific command in the command bar to execute a specific command. The traditional touch screen single-touch is more convenient. The foldable touch screen can be operated simultaneously with both hands. Use two-handed and two-point touch operations to select directories and Instructions will make the operation of the mobile device more efficient and friendly.

With the maturity of smart electronic products, interactive touch screens such as various mobile devices, car computers, interactive screens, and smart phones are very diverse and popular. The conventional touch screen devices perform application functions through applications (App) When the application program (App) executes the command selection of the command bar, how to accommodate more commands in a small area is an important issue. The conventional touch screen device adopts a single-point operation method that is complicated and unfriendly. The more important patent cases of screen control command operation are as follows:

The patent published on December 23, 2008 with the publication number US7469381, "List scrolling and document translation, scaling, and rotation on a touch-screen display", discloses a method of moving electronic files in combination with a touch screen, In this method, the movement of the file on the touch screen is detected, and the electronic document displayed on the touch screen is shifted in the first direction. If it reaches the edge of the electronic document, the area beyond the edge of the document is displayed. If the object is no longer detected Then the document is translated in the second direction until the area beyond the edge of the document is no longer displayed.

The publication number US7844915(B2) published on November 30, 2010, "Application programming interfaces for scrolling operations", discloses a The application programming interface (API) scroll rebound method, set the maximum and minimum rebound values, and the set rebound scroll area is visible, resulting in a scroll rebound in the opposite direction.

The patent published on January 4, 2011 with the publication number US7864163(B2), "Portable electronic device, method, and graphical user interface for dis-playing structured electronic documents", discloses a structured electronic device with a touch screen display The document method detects the first gesture of the display part of the structured electronic document, determines the first frame of the first gesture and is enlarged and centered.

The patent of US8448084, "User in-terface mechanics", published on May 21, 2013, discloses a scrollable list of content items. The scroll command input can display the scroll refresh trigger, and then the scroll command determines that the trigger has been A method to refresh the scrolling list of content items when triggered and rebound.

The patent published on April 11, 2017 with the publication number US9619132, "Device, method and graphic user interface for zooming in on a touch-screen dis-play", reveals a computer-implemented method with touch-screen combined use , The magnification rate displays the electronic document, and the touch screen is used to magnify the gesture corresponding to the command specified by the user, and in response to the detection of the gesture, the reduced part of the electronic document is displayed at an increasing magnification rate.

The patent, “Tech-niques For Paging Through Digital Content On Touch Screen Devices”, published on July 26, 2016, with the publication number US9,400,601, reveals the technology for providing page flipping modes in electronic touch devices. Users can use Perform gestures for page turning mode, which can display page content in a single stack or side-by-side layout.

The patent published on October 7, 2014 with the publication number of US8,856,678B1, "Using touch input to select, shrink, and fold displayed content", discloses a display device and its control method according to an embodiment. If the display device Not enough display area The space to display the entire content involves a display device that only provides the content area that the user wants to see. By folding a part of the entire content and its control method, it provides users with an easy-to-use scrolling environment.

The patent published on June 12, 2018 with the publication number US9,996,245, "Graph-ical user interface control for scrolling content", discloses a solution for managing the graphical user interface of the panel area, which can provide for the panel area Graphical user interface scrolling control. The graphical user scrolling control allows the user to manipulate the graphical user interface scrolling control in the first direction to adjust the content displayed in the panel area.

The conventional touch screen system only considers the type of operation with a single finger, for example: Amazon's application (App), including homepage, my order, wishlist, my account, products, settings, customer service, search, and process , Photo, shopping cart, quick link, my order, Spark, limited time offer,... and other commands. Generally larger mobile apps (App) have many menu bars and command bars and other option buttons, basically only Considering the type of single-handed control, using the frequency button to switch to the target option button. As the technology of foldable mobile phones matures, the effective arrangement of the human-machine interface in the dual-screen or front and back screen environment will be an important issue. Therefore, the present invention addresses the above needs With painstaking research and the application of academic theory, he proposed a system and method that can be triggered simultaneously by both hands and two points, especially the invention of the system and method that uses the folding touch screen as the basic command operation.

In view of the above-mentioned situation, the present invention relates to a multi-point trigger command system and method, which is used in the foldable touch mobile phone man-machine interface command input type, which includes: a multi-point trigger command editor (MCE), Provide user-defined and edit command attributes, including: directory bar type, command bar type, button type, command type, etc.; command database (CDB), database content includes system-defined and user-defined command attributes, command upper and lower levels Relations, command button styles, button icons, etc., defined commands, button styles, and button icons can be selected when the application (APP) is written; multi-point command bar execution module (MCX), call when the application (APP) is executed This module, multi-touch commands can be At the same time specify the upper and lower directories and specific commands; it can be used for the command selection purposes of touch screen related devices. Both hands control the directories and specific commands at the same time, which is especially suitable for folding mobile devices.

100‧‧‧Fold the screen after unfolding

101a‧‧‧First level directory

101b‧‧‧First level command bar

102a‧‧‧Second level directory

102b‧‧‧The second level command bar

103a‧‧‧third level directory

103b‧‧‧Level 3 command bar

104‧‧‧First trigger point

105‧‧‧Second trigger point

106‧‧‧triggered menu button

107‧‧‧Command button triggered

200‧‧‧Folded touch screen

201‧‧‧Right hand touch

202‧‧‧Left hand touch

203‧‧‧First level directory, command bar

204‧‧‧Second level directory, command bar

205‧‧‧Third level directory, command bar

206‧‧‧Back screen touch point (first trigger point)

207‧‧‧Front screen touch point (second trigger point)

301‧‧‧Icon Editor

302‧‧‧Level

303‧‧‧Button type

304‧‧‧Command bar type

305‧‧‧Multi-point trigger database (CDB)

306‧‧‧Hidden button

307‧‧‧Eject button

403‧‧‧First level directory, command button

404‧‧‧Second level directory, command button

405‧‧‧Third level directory, command buttons

501‧‧‧Confirm the first touch point

502‧‧‧Confirm the second touch point

503‧‧‧Trigger command

In order to describe the embodiments of the present invention in detail, reference will now be made to all the drawings as follows: Figure 1: Schematic diagram of multi-point trigger instruction expansion, Figure 2: Schematic diagram of multi-point trigger instruction collapse, Figure 3: Multi-point trigger instruction editor (MCE), Figure 4: Schematic diagram of the first three levels of directories and command buttons, Figure 5: Multi-point trigger module (MCX) flowchart.

A multi-point trigger command system and method are used for the command input type of the man-machine interface of a foldable touch mobile phone. For example, Figure 1 shows an expanded schematic diagram of the foldable touch screen, including the first level of directory bar 101a and the first level Command bar 101b, second-level directory bar 102a, second-level command bar 102b, third-level directory bar 103a, third-level command bar 103b, left-hand trigger point 104, right-hand trigger point 105, triggered list button 106, triggered Command button 107, for example, Figure 2 is a schematic diagram of a touch screen 200 after folding. The user holds the screen 202 (ie 104) with his left hand. The middle finger is on the back screen to trigger the menu button 206 (ie 106), and the right hand 201 (ie 105) The middle finger triggers the command button 207 (i.e.) 107, both hands can simultaneously trigger to click on specific directories and command buttons, that is, hold the touch screen with the left hand and point the first trigger point 206 with the right hand and the second trigger point 207, or the right hand Pointing at the first trigger point 206 in the middle of the control screen and pointing at the second trigger point 207 in the left hand can be used for the command bar of touch-screen related devices. It is especially suitable for general folding mobile devices. The main technical features of this system are as follows:

Multi-point trigger command editor (MCE): Provide user-defined directory and command tool As shown in Figure 3, define or select: button icon editing 301, button level 302, button style 303, command bar style 304, multi-point trigger database (CDB) 305, etc. The button style of this system is shown in Figure 4. , Button types include: hidden button 401, pop-up button 402, first-level list button, first-level command button 403; second-level list button, second-level command button 404; third-level list button, third-level command button 405. Figure 4 shows that the first three levels of users can extend and store the directory and command relevance in the multi-point trigger command database (CDB) 305.

Multi-point trigger database (CBD): The contents of the database 305, including: system-defined button icons, directory and command relationships, hierarchical relationship diagrams, user-defined icons and relationship diagrams, as shown in Figure 3, application (APP) When writing, you can select the command icon library defined in the database 305,

Multi-point trigger execution module (MCX): Call this module when the application (APP) is running. The process is shown in Figure 5, including: confirming the first touch point 501 confirming the triggering of the menu button, confirming the second touch point 502 confirms the triggering of the catalog button and the application command 503. In each procedure, the system confirms that the system has stored data in the multi-point trigger command database (CBD) 305.

The present invention has a system built-in directory and command relationships and icons, and can also use the multi-point trigger command database (CDB) 305 to store self-built directories and command relationships and icons, and use the built-in and self-built directories and command relationships and icons. Icon, build a complete multi-point trigger command database (CDB) 305, and then when the application (App) inputs command icons in multi-point synchronization on the touch screen, the multi-point trigger execution module (MCX) will trigger the corresponding command , There is no need to frequently switch application screens to cause unfriendly problems.

200‧‧‧Foldable touch screen

201‧‧‧Right hand touch

202‧‧‧Left hand touch

203‧‧‧First level command bar

204‧‧‧The second level command bar

205‧‧‧Level 3 command bar

206‧‧‧Back screen triggered menu button

207‧‧‧Front screen triggered command button

Claims (10)

A multi-point trigger command system, which is used for the command input type of the man-machine interface of the touch screen device. It includes: the multi-point trigger command editor (MCE), which provides the user to define and edit command attributes, including: directory bar type, command Bar type, button type, command type, button icon, upper and lower command bar, etc.; Command database (CDB), the content of the database includes system-defined and user-defined command attributes, command upper and lower levels, command button types, button icons Etc., when the application program (APP) is written, you can select the defined commands, button types, and button icons; multi-point command bar execution module (MCX), call this module when the application program (APP) is executed, and multi-point touch commands You can specify directories and specific commands at the same time; it can be used for command selection of touch-screen related devices. Both hands control the upper directory and specific commands at the same time, which is especially suitable for folding mobile devices. For example, if the feature value of the multi-point trigger command editor (MCE) of the request item 1, the selected system library already exists or the user edits include: button icon, button hierarchy, button hierarchical relationship, button type, button icon can be built or used by the system User-defined, upper-lower relationship can also be established by the system or user-defined. For example, the button hierarchical relationship of request 2, which includes various levels of directory bars, various levels of command bars, various icons, various directories, commands, and diagrams between icons, which can be constructed by the system or users can customize various icons and diagrams. For example, the catalog bar and command bar of claim 3, where the types of buttons include hidden buttons, pop-up buttons, first-type finger buttons, second-type finger buttons, third-type finger buttons, or a deeper relationship created by the user. The database has various levels of built-in button icons to choose from, and users can customize the icons and relationship diagrams with the multi-point trigger command editor (MCE). For example, the multi-point trigger database (CBD) of request 1, in which the database storage includes: system predetermined or user-defined directory bar, command bar, icons of each layer, relationship between icons, multi-point trigger command editor (MCE) When editing, you can call the existing directory bar, command bar, and icon in the database, Or the directory bar, command bar, and icon edited by the user. For example, the multi-point trigger execution module (MCX) of request item 1 provides triggers for application call mapping instructions. First determine the first control point and then determine the second control point. The system can define two or even more points Trigger, use multi-point trigger to reduce the action of instruction selection to turn pages and increase the friendliness of operation. For example, the icon of the button of request item 4, the system has an existing icon library for selection, and the user can also use the button icon editor in the multi-point trigger editor (MCE) to edit the icon and the relationship between the upper and lower layers of the icon, and save it to the multi-point trigger The database (CBD) is for subsequent use. A multi-point trigger command method is used for the input type of the man-machine interface command of the touch screen device. The steps include: constructing a multi-point trigger command editor (MCE) to provide user definition and editing command attributes, including: directory bar Types, command bar types, button types, command types, button icons, lower-level command bars, etc.; build a command database (CDB), the database content includes system-defined and user-defined command attributes, command upper and lower levels, command button types , Button icons, etc. When writing an application program (APP), you can select the defined commands, button types, and button icons; construct a multi-point command bar execution module (MCX), and call this module when the application (APP) is executed. Multi-point touch commands can specify upper-level directories and lower-level specific commands at the same time; it can be used for command selection of touch screen related devices. Both hands can control upper-level directories and specific commands at the same time, which is especially suitable for folding mobile devices. For example, request item 8 to construct a multi-point trigger command editor (MCE), select the system library already exists or the user edits it, including: button icon, button hierarchy, button hierarchy relationship, button type, button icon can be built or used by the system User-defined, upper-lower relationship can also be established by the system or user-defined. A computer-readable, storable, and touchable multi-point trigger command program, which is used for the input type of man-machine interface commands related to touch screen devices, including: multi-point trigger command editor (MCE), provides user-defined and edit command attributes, including: directory bar type, command bar type, button type, command type, button icon, command bar, etc.; command database (CDB), the database content includes system definition and User-defined command attributes, command upper and lower levels, command button styles, button icons, etc. The defined commands, button styles, and button icons can be selected when the application (APP) is written; the multi-point command bar execution module (MCX ), this module is called when the application (APP) is running. Multi-touch commands can specify the directory and specific commands at the same time; it can be used for the command selection purpose of touch screen related devices. Both hands control the directory and specific commands at the same time, especially suitable for applications For foldable mobile devices.

Images