EP2843521A1 - Operation control conversion method for virtual icon touchscreen application program, and touchscreen terminal - Google Patents

Operation control conversion method for virtual icon touchscreen application program, and touchscreen terminal Download PDF

Info

Publication number
EP2843521A1
EP2843521A1 EP12875636.8A EP12875636A EP2843521A1 EP 2843521 A1 EP2843521 A1 EP 2843521A1 EP 12875636 A EP12875636 A EP 12875636A EP 2843521 A1 EP2843521 A1 EP 2843521A1
Authority
EP
European Patent Office
Prior art keywords
touch screen
input device
physical input
mapping
configuration file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP12875636.8A
Other languages
German (de)
French (fr)
Other versions
EP2843521A4 (en
Inventor
Jian Qiu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Snail Digital Technology Co Ltd
Original Assignee
SHENZHEN IREADYGO INFORMATION TECHNOLOGY Co Ltd
SHENZHEN IREADYGO INFORMATION TECHNOLOGY CO Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SHENZHEN IREADYGO INFORMATION TECHNOLOGY Co Ltd, SHENZHEN IREADYGO INFORMATION TECHNOLOGY CO Ltd filed Critical SHENZHEN IREADYGO INFORMATION TECHNOLOGY Co Ltd
Publication of EP2843521A1 publication Critical patent/EP2843521A1/en
Publication of EP2843521A4 publication Critical patent/EP2843521A4/en
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416—Control or interface arrangements specially adapted for digitisers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/451—Execution arrangements for user interfaces

Definitions

  • the present invention relates to the field of electronics, and specifically to a touch screen terminal control field.
  • a touch screen is also known as a "touch screen” or a “touch panel”, and is an inductive liquid crystal display device capable of receiving input signals such as contacts, when a graphic button on the screen is touched, tactile feedback on the screen can drive various link devices according to a pre-programmed program, which can be used to replace a mechanical button panel and creates vivid audio and video effects through a liquid crystal display screen.
  • the touch screen as a latest computer input device, is more widely used due to its simple, convenient, natural human-machine interaction manner, and meanwhile, there are more and more applications compatible with the touch screen device.
  • a touch operation means that a user using a finger or a stylus to click on the touch screen, and such an operation makes operation easier and more intuitive due to good interactivity.
  • the touch screen operation also has the following disadvantages: firstly, the touch screen operation has no real feel of operation, and cannot have force feedback reaction for a pressing action like a real keyboard, which has poor user operation experience for some touch screen applications; secondly, the operation is imprecise, a region where the user actually touch by using the finger or the stylus may be deviated from the touch region that the user thinks or there is a deviation in the touch screen, resulting in that the user's operation of touching a sensitive region has no response and the user experience is poor.
  • an embodiment of the present invention provides a virtual icon touch screen application manipulation conversion method, including:
  • the method further includes:
  • the acquiring a manipulation instruction of the physical input device, and parsing the manipulation instruction according to the mapping rule information in the mapping configuration file, so as to convert the manipulation instruction into a touch screen event includes:
  • the physical input device includes: a key and/or a joystick.
  • mapping rule information between a touch screen event and a physical input device includes:
  • an embodiment of the present invention further provides a touch screen terminal, including:
  • the touch screen terminal further includes:
  • the acquisition and conversion module includes:
  • the physical input device includes: a key and/or a joystick.
  • a user can use a physical input device to manipulate a touch screen application, which overcomes the disadvantages that touch screen manipulation has no feel of operation and operation precision is poor.
  • FIG. 1 is a flow chart of a first embodiment of a virtual icon touch screen application manipulation conversion method according to the present invention. The method includes the following steps.
  • mapping configuration file corresponding to the touch screen application, the mapping configuration file including mapping rule information between a touch screen event and a physical input device.
  • a system calls a mapping configuration file matching the touch screen application.
  • a touch screen terminal has a touch screen application A, a touch screen application B and a touch screen application C installed therein, which are respectively corresponding to mapping configuration files 1, 2 and 3, when a user starts and runs the touch screen application A, the system will call the mapping file 1 corresponding thereto, parse a mapping relationship between a physical input device and a touch screen event at a virtual icon of the touch screen application in the mapping configuration file, and load the mapping relationship into a system memory.
  • S103 Acquire a manipulation instruction of the physical input device, and parse the manipulation instruction according to the mapping rule information in the mapping configuration file, so as to convert the manipulation instruction into a touch screen event.
  • a touch screen terminal acquires a manipulation instruction of the physical input device
  • the system converts, according to the mapping relationship between a physical input device and a touch screen event at a virtual icon of the touch screen application, the manipulation instruction of the physical input device into a touch screen event capable of triggering the touch screen application to execute a corresponding action.
  • the touch screen terminal obtains manipulation instructions of more than one physical input device at the same time
  • the system converts current multiple manipulation instructions into the same number of touch screen events according to the mapping rule information.
  • S104 Manipulate the touch screen application according to the converted touch screen event.
  • the system distributes the touch screen event to a focus window of the touch screen application, so as to execute corresponding operation.
  • the touch screen application in the present invention refers to a touch screen application having a virtual icon on a program interface, the virtual icon is located at a fixed position of the touch screen, the user can execute a predetermined operation by touching a predetermined virtual icon, and for a touch screen application which has no virtual icon displayed on the touch screen and whose predetermined operation can be executed in a touch screen fixed region, the fixed region is also a virtual icon with a transparent background color.
  • the embodiments of the present invention transfers the touch screen operation onto the physical input device through mapping of an external input device and a touch screen event, thereby achieving more precise control and increasing the user's feel of operation.
  • FIG. 2 is a flow chart of another embodiment of a virtual icon touch screen application manipulation conversion method according to the present invention. The method includes the following steps.
  • S201 Pre-configure a mapping configuration file corresponding to the touch screen application, and save the mapping configuration file.
  • mapping relationship information is saved to a mapping configuration file.
  • mapping configuration file corresponding to the touch screen application, the mapping configuration file including mapping rule information between a touch screen event and a physical input device.
  • a system calls a mapping configuration file matching the touch screen application.
  • a touch screen terminal has a touch screen application A, a touch screen application B and a touch screen application C installed therein, which are respectively corresponding to mapping configuration files 1, 2 and 3, when a user starts and runs the touch screen application A, the system will call the mapping file 1 corresponding thereto, parse a mapping relationship between a physical input device and a touch screen event at a virtual icon of the touch screen application in the mapping configuration file, and load the mapping relationship into a system memory.
  • S204 Acquire a manipulation instruction of the physical input device, and parse the manipulation instruction according to the mapping rule information in the mapping configuration file, so as to convert the manipulation instruction into a touch screen event.
  • a touch screen terminal acquires a manipulation instruction of the physical input device
  • the system converts, according to the mapping relationship between a physical input device and a touch screen event at a virtual icon of the touch screen application, the manipulation instruction of the physical input device into a touch screen event capable of triggering the touch screen application to execute a corresponding action.
  • the touch screen terminal obtains manipulation instructions of more than one physical input device at the same time
  • the system converts current multiple manipulation instructions into the same number of touch screen events according to the mapping rule information.
  • FIG. 3 is a specific flow chart of step S204 in FIG. 2 , which includes the following steps.
  • S2041 Acquire a hardware number corresponding to the physical input device when detecting an action of the physical input device.
  • the system may immediately query and acquire a hardware number corresponding to the hardware. If the system detects swing of a joystick, the system may immediately query and acquire that a hardware number of the joystick is 11, and then execute next step.
  • S2042 Query corresponding touch screen geometrical parameter information in the configuration file according to the hardware number.
  • the mapping relationship in the mapping configuration file is a mapping relationship between geometrical parameter information of the touch screen event at the virtual icon and a hardware number of the physical input device, and geometrical parameter information of the touch screen event, queried by the system by using the obtained hardware number 11 of the joystick, mapped with the hardware number 11 is: center point coordinates (77, 450) and a maximum offset of 50 pixels.
  • the physical joystick is an analog input device, capable of inputting displacement information in horizontal and vertical directions, and in order to achieve conversion between a joystick and a virtual joystick touch screen event, it is necessary to match analog input of the physical joystick with pixel movement of the virtual joystick.
  • a maximum offset of the physical joystick is 65535 scales
  • a maximum offset of the virtual joystick is 50 pixels
  • the two offset parameters are proportional, it can be achieved that physical joystick input is converted into virtual joystick pixel output, so as to determine coordinates of a center point of the virtual joystick, and when the physical joystick swings to left by a half of a full scale, the corresponding virtual joystick touch screen event is a touch screen event that a finger holds the coordinates (77, 450) of the touch screen to offset 25 pixels to the left.
  • S205 Manipulate the touch screen application according to the converted touch screen event.
  • the embodiment of the present invention does not need to use an application interface, but can transfer a touch screen operation onto a physical input device by only setting a mapping relationship between the physical input device and the touch screen, thereby achieving more precise control and increasing the user's feel of operation.
  • FIG. 4 is a structural view of a first implementation of a touch screen terminal according to the present invention, and the touch screen terminal includes the following modules.
  • a starting and running module 41 is used for running a touch screen application.
  • a loading and parsing module 42 is used for loading a mapping configuration file corresponding to the touch screen application, the mapping configuration file including mapping rule information between a touch screen event and a physical input device.
  • mapping configuration file matching the touch screen application.
  • a touch screen terminal has a touch screen application A, a touch screen application B and a touch screen application C installed therein, which are respectively corresponding to mapping configuration files 1, 2 and 3, when the starting and running module 41 runs the touch screen application A, the loading and parsing module 42 will call the mapping file 1 corresponding thereto, parse a mapping relationship between a physical input device and a touch screen event at a virtual icon of the touch screen application in the mapping configuration file, and load the mapping relationship into a system memory.
  • An acquisition and conversion module 43 is used for acquiring a manipulation instruction of the physical input device, and parsing the manipulation instruction according to the mapping rule information in the mapping configuration file, so as to convert the manipulation instruction into a touch screen event.
  • the acquisition and conversion module 43 converts, according to the mapping relationship between a physical input device and a touch screen event at a virtual icon of the touch screen application, the manipulation instruction of the physical input device into a touch screen event capable of triggering the touch screen application to execute a corresponding action.
  • the acquisition and conversion module 43 converts current multiple manipulation instructions into the same number of touch screen events according to the mapping rule information.
  • An event execution module 44 is used for manipulating the touch screen application according to the converted touch screen event.
  • the event execution module 44 distributes the touch screen event to a focus window of the touch screen application, so as to execute corresponding operation.
  • the touch screen application in the present invention refers to a touch screen application having a virtual icon on a program interface, the virtual icon is located at a fixed position of the touch screen, the user can execute a predetermined operation by touching a predetermined virtual icon, and for a touch screen application which has no virtual icon displayed on the touch screen and whose predetermined operation can be executed in a touch screen fixed region, the fixed region is also a virtual icon with a transparent background color.
  • the embodiment of the present invention transfers the touch screen operation onto the physical input device through mapping of an external input device and a touch screen event, thereby achieving more precise control and increasing the user's feel of operation.
  • FIG. 5 is a structural view of a second implementation of a touch screen terminal according to the present invention. It can be seen from FIG. 5 that, this embodiment also includes a starting and running module 41, a loading and parsing module 42, an acquisition and conversion module 43 and an event execution module 44, and in addition, further includes:
  • the pre-configuring and saving module 45 sets different physical input devices forming mapping with touch screen events. If the virtual icon is a joystick, the pre-configuring and saving module 45 sets a physical joystick forming mapping with the virtual icon; if the virtual icon is a button, the pre-configuring and saving module 45 sets a key forming mapping with the virtual icon; if the virtual icon is a slider, the pre-configuring and saving module 45 sets a pressure sensor key forming mapping with the virtual icon. Upon completion of setting, the pre-configuring and saving module 45 saves mapping relationship information to a mapping configuration file.
  • the acquisition and conversion module 43 includes:
  • a racing game controlled by a key is used for description.
  • a rectangular region 61 is a game brake control region, and a car can be braked immediately when any point in the region is clicked.
  • a rectangular region 62 is a game display region
  • a rectangular region 63 is a game acceleration/deceleration control region, clicking pixel points in the rectangular regions sequentially from top to bottom can control the speed of the car from slow to fast
  • 64 indicates a physical key A
  • 65 indicates a pressure sensor key B
  • the physical key A is mapped with a touch screen event at the rectangular region 61
  • the pressure sensor key B is mapped with a touch screen event at the rectangular region 63.
  • the acceleration/deceleration control region controls a continuously changing process
  • a key with a sensor is used for mapping, and because the sensor is generally used for detecting an analog signal, that is, a continuously changing signal, a continuously changing signal actually input externally can be converted into a continuously changing process of pixels on the touch screen.
  • the pressure sensor key B is used to map the touch screen event of the acceleration/deceleration control region, and a common key A is used to map the brake control region.
  • the system When the key A is pressed, the system generates an interruption, the number acquisition unit 431 acquires a key value 14 corresponding to the key A, the query unit 432 finds corresponding touch screen geometrical parameter information in the mapping configuration file according to the key value 14, where the touch screen geometrical parameter information is: center point coordinates (28, 228) and a maximum offset of 0 pixel, the conversion unit 433 converts the pressing action of the key A into a single-click event at the touch screen (28, 228), and the center point coordinates are coordinate values of any point in the brake control region.
  • the system When the key B is pressed, the system generates an interruption, the number acquisition unit 431 acquires a key value 15 corresponding to the key B, the query unit 432 finds corresponding touch screen geometrical parameter information in the mapping configuration file according to the key value 15, where the touch screen geometrical parameter information is: center point coordinates (763, 2), a maximum offset of -470 pixels, and an offset angle of -270 degrees, the conversion unit 433 converts the pressing action of the key B into a touch screen event along a ⁇ -axis negative direction taking the touch screen coordinates (763, 2) as a starting point.
  • the touch screen geometrical parameter information is: center point coordinates (763, 2), a maximum offset of -470 pixels, and an offset angle of -270 degrees
  • the conversion unit 433 converts the pressing action of the key B into a touch screen event along a ⁇ -axis negative direction taking the touch screen coordinates (763, 2) as a starting point.
  • the maximum scale value of a pressure sensor is M
  • the maximum offset pixel in a ⁇ -axis negative direction of the acceleration/deceleration control region is N
  • the embodiment of the present invention does not need to use an application interface, but can transfer a touch screen operation onto a physical input device by only setting a mapping relationship between the physical input device and the touch screen, thereby achieving more precise control and increasing the user's feel of operation.
  • the program may be stored in a computer readable storage medium.
  • the storage medium may be a magnetic disk, an optical disc, a read-only memory (ROM) or a random access memory (RAM).

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)

Abstract

Disclosed is an operation control conversion method for a virtual icon touchscreen application program, which comprises: operating a touchscreen application program; loading a mapping configuration file corresponding to the touchscreen application program, the mapping configuration file comprising mapping rule information between a touchscreen event and a physical input device; obtaining an operation control instruction of the physical input device, and resolving the operation control instruction according to the mapping rule information in the mapping configuration file, so as to convert the operation control instruction to a touchscreen event; and according to the converted touchscreen event, performing operation control on the touchscreen application program. By implementing the embodiments of the present invention, a user can obtain a real operation hand feeling by selecting a physical input device or a touch control manner to perform operation control on a touchscreen application program, thereby improving the operation accuracy and the operation experience.

Description

    BACKGROUND OF THE INVENTION Field of the Invention
  • The present invention relates to the field of electronics, and specifically to a touch screen terminal control field.
    • Related Art
  • A touch screen is also known as a "touch screen" or a "touch panel", and is an inductive liquid crystal display device capable of receiving input signals such as contacts, when a graphic button on the screen is touched, tactile feedback on the screen can drive various link devices according to a pre-programmed program, which can be used to replace a mechanical button panel and creates vivid audio and video effects through a liquid crystal display screen. The touch screen, as a latest computer input device, is more widely used due to its simple, convenient, natural human-machine interaction manner, and meanwhile, there are more and more applications compatible with the touch screen device.
  • A touch operation means that a user using a finger or a stylus to click on the touch screen, and such an operation makes operation easier and more intuitive due to good interactivity. As a human-machine interaction interface, the touch screen operation also has the following disadvantages: firstly, the touch screen operation has no real feel of operation, and cannot have force feedback reaction for a pressing action like a real keyboard, which has poor user operation experience for some touch screen applications; secondly, the operation is imprecise, a region where the user actually touch by using the finger or the stylus may be deviated from the touch region that the user thinks or there is a deviation in the touch screen, resulting in that the user's operation of touching a sensitive region has no response and the user experience is poor.
    • SUMMARY OF THE INVENTION
  • The technical problem to be solved by embodiments of the present invention lies in providing a virtual icon touch screen application manipulation conversion method and a touch screen terminal, which can avoid the defect that a virtual icon touch screen application has no feel of operation and cannot be precisely positioned and the problem that user experience is poor in the prior art. To solve the technical problem, an embodiment of the present invention provides a virtual icon touch screen application manipulation conversion method, including:
    • running a touch screen application;
    • loading a mapping configuration file corresponding to the touch screen application, the mapping configuration file including mapping rule information between a touch screen event and a physical input device;
    • acquiring a manipulation instruction of the physical input device, and parsing the manipulation instruction according to the mapping rule information in the mapping configuration file, so as to convert the manipulation instruction into a touch screen event; and
    • manipulating the touch screen application according to the converted touch screen event.
  • Before the running a touch screen application, the method further includes:
    • pre-configuring a mapping configuration file corresponding to the touch screen application, and saving the mapping configuration file.
  • The acquiring a manipulation instruction of the physical input device, and parsing the manipulation instruction according to the mapping rule information in the mapping configuration file, so as to convert the manipulation instruction into a touch screen event includes:
    • acquiring a hardware number corresponding to the physical input device when detecting an action of the physical input device;
    • querying corresponding touch screen geometrical parameter information in the configuration file according to the hardware number; and
    • converting the action of the physical input device into a touch screen event.
  • The physical input device includes: a key and/or a joystick.
  • The mapping rule information between a touch screen event and a physical input device includes:
    • mapping rule information between a touch screen event, at a position of a virtual icon in the touch screen application, and the key; and/or
    • mapping rule information between a touch screen event, at a position of a virtual icon in the touch screen application, and the joystick.
  • Correspondingly, an embodiment of the present invention further provides a touch screen terminal, including:
    • a starting and running module, for running a touch screen application;
    • a loading and parsing module, for loading a mapping configuration file corresponding to the touch screen application, the mapping configuration file including mapping rule information between a touch screen event and a physical input device;
    • an acquisition and conversion module, for acquiring a manipulation instruction of the physical input device, and parsing the manipulation instruction according to the mapping rule information in the mapping configuration file, so as to convert the manipulation instruction into a touch screen event; and
    • an event execution module, for manipulating the touch screen application according to the converted touch screen event.
  • The touch screen terminal further includes:
    • a pre-configuring and saving module, for pre-configuring a mapping configuration file corresponding to the touch screen application, and saving the mapping configuration file.
  • The acquisition and conversion module includes:
    • a number acquisition unit, for acquiring a hardware number corresponding to the physical input device when detecting an action of the physical input device;
    • a query unit, for querying corresponding touch screen geometrical parameter information in the configuration file according to the hardware number; and
    • a conversion unit, for converting the action of the physical input device into a touch screen event.
  • The physical input device includes: a key and/or a joystick.
    • the mapping rule information between a touch screen event and a physical input device includes:
    • mapping rule information between a touch screen event, at a position of a virtual icon in the touch screen application, and the key; and/or
    • mapping rule information between a touch screen event, at a position of a virtual icon in the touch screen application, and the joystick.
  • The embodiments of the present invention have the following beneficial effects: a user can use a physical input device to manipulate a touch screen application, which overcomes the disadvantages that touch screen manipulation has no feel of operation and operation precision is poor.
    • BRIEF DESCRIPTION OF THE DRAWINGS
  • To illustrate the technical solutions according to the embodiments of the present invention or in the prior art more clearly, the accompanying figures for describing the embodiments or the prior art are introduced briefly in the following. Apparently, the accompanying drawings in the following description are only some embodiments of the present invention; persons of ordinary skill in the art can obtain other drawings according to the accompanying drawings without paying any creative efforts.
    • FIG. 1 is a flow chart of a first embodiment of a virtual icon touch screen application manipulation conversion method according to the present invention;
    • FIG. 2 is a flow chart of another embodiment of the virtual icon touch screen application manipulation conversion method according to the present invention;
    • FIG. 3 is a specific flow chart of step S204 in FIG. 2 according to the present invention;
    • FIG. 4 is a structural view of a first implementation of a touch screen terminal according to the present invention;
    • FIG. 5 is a structural view of a second implementation of a touch screen terminal according to the present invention; and
    • FIG. 6 is a schematic interface view of a touch screen application according to the present invention.
    DETAILED DESCRIPTION OF THE EMBODIMENTS
  • The technical solution of the present invention will be clearly and fully described below with reference to the accompanying drawings. It is obvious that the embodiments to be described are only a part rather than all of the embodiments of the present invention. All other embodiments derived by a person of ordinary skill in the art based on the embodiments of the present invention without carrying out creative activities should fall within the scope of the present invention.
  • FIG. 1 is a flow chart of a first embodiment of a virtual icon touch screen application manipulation conversion method according to the present invention. The method includes the following steps.
  • S101: Run a touch screen application.
  • S102: Load a mapping configuration file corresponding to the touch screen application, the mapping configuration file including mapping rule information between a touch screen event and a physical input device.
  • Specifically, because different touch screen applications correspond to different mapping configuration files, after a touch screen application is started and run, it is required that a system calls a mapping configuration file matching the touch screen application. Suppose a touch screen terminal has a touch screen application A, a touch screen application B and a touch screen application C installed therein, which are respectively corresponding to mapping configuration files 1, 2 and 3, when a user starts and runs the touch screen application A, the system will call the mapping file 1 corresponding thereto, parse a mapping relationship between a physical input device and a touch screen event at a virtual icon of the touch screen application in the mapping configuration file, and load the mapping relationship into a system memory.
  • S103: Acquire a manipulation instruction of the physical input device, and parse the manipulation instruction according to the mapping rule information in the mapping configuration file, so as to convert the manipulation instruction into a touch screen event.
  • Specifically, when a touch screen terminal acquires a manipulation instruction of the physical input device, the system converts, according to the mapping relationship between a physical input device and a touch screen event at a virtual icon of the touch screen application, the manipulation instruction of the physical input device into a touch screen event capable of triggering the touch screen application to execute a corresponding action. When the touch screen terminal obtains manipulation instructions of more than one physical input device at the same time, the system converts current multiple manipulation instructions into the same number of touch screen events according to the mapping rule information.
  • S104: Manipulate the touch screen application according to the converted touch screen event.
  • Specifically, the system distributes the touch screen event to a focus window of the touch screen application, so as to execute corresponding operation.
  • It should be noted that, the touch screen application in the present invention refers to a touch screen application having a virtual icon on a program interface, the virtual icon is located at a fixed position of the touch screen, the user can execute a predetermined operation by touching a predetermined virtual icon, and for a touch screen application which has no virtual icon displayed on the touch screen and whose predetermined operation can be executed in a touch screen fixed region, the fixed region is also a virtual icon with a transparent background color.
  • The embodiments of the present invention transfers the touch screen operation onto the physical input device through mapping of an external input device and a touch screen event, thereby achieving more precise control and increasing the user's feel of operation.
  • FIG. 2 is a flow chart of another embodiment of a virtual icon touch screen application manipulation conversion method according to the present invention. The method includes the following steps.
  • S201: Pre-configure a mapping configuration file corresponding to the touch screen application, and save the mapping configuration file.
  • Specifically, with respect to characteristics of virtual icons on a touch screen application operation interface, different physical input devices forming mapping with touch screen events are set. If the virtual icon is a joystick, a physical joystick forming mapping with the virtual icon is set; if the virtual icon is a button, a key forming mapping with the virtual icon is set; if the virtual icon is a slider, a pressure sensor key forming mapping with the virtual icon is set. Upon completion of setting, mapping relationship information is saved to a mapping configuration file.
  • S202: Run a touch screen application.
  • S203: Load a mapping configuration file corresponding to the touch screen application, the mapping configuration file including mapping rule information between a touch screen event and a physical input device.
  • Specifically, because different touch screen applications correspond to different mapping configuration files, after a touch screen application is started and run, it is required that a system calls a mapping configuration file matching the touch screen application. Suppose a touch screen terminal has a touch screen application A, a touch screen application B and a touch screen application C installed therein, which are respectively corresponding to mapping configuration files 1, 2 and 3, when a user starts and runs the touch screen application A, the system will call the mapping file 1 corresponding thereto, parse a mapping relationship between a physical input device and a touch screen event at a virtual icon of the touch screen application in the mapping configuration file, and load the mapping relationship into a system memory.
  • S204: Acquire a manipulation instruction of the physical input device, and parse the manipulation instruction according to the mapping rule information in the mapping configuration file, so as to convert the manipulation instruction into a touch screen event.
  • Specifically, when a touch screen terminal acquires a manipulation instruction of the physical input device, the system converts, according to the mapping relationship between a physical input device and a touch screen event at a virtual icon of the touch screen application, the manipulation instruction of the physical input device into a touch screen event capable of triggering the touch screen application to execute a corresponding action. When the touch screen terminal obtains manipulation instructions of more than one physical input device at the same time, the system converts current multiple manipulation instructions into the same number of touch screen events according to the mapping rule information.
  • FIG. 3 is a specific flow chart of step S204 in FIG. 2, which includes the following steps.
  • S2041: Acquire a hardware number corresponding to the physical input device when detecting an action of the physical input device.
  • Specifically, when a system detects an action of the physical input device, the system may immediately query and acquire a hardware number corresponding to the hardware. If the system detects swing of a joystick, the system may immediately query and acquire that a hardware number of the joystick is 11, and then execute next step.
  • S2042: Query corresponding touch screen geometrical parameter information in the configuration file according to the hardware number.
  • Specifically, the mapping relationship in the mapping configuration file is a mapping relationship between geometrical parameter information of the touch screen event at the virtual icon and a hardware number of the physical input device, and geometrical parameter information of the touch screen event, queried by the system by using the obtained hardware number 11 of the joystick, mapped with the hardware number 11 is: center point coordinates (77, 450) and a maximum offset of 50 pixels.
  • S2043: Convert the action of the physical input device into a touch screen event.
  • Specifically, the physical joystick is an analog input device, capable of inputting displacement information in horizontal and vertical directions, and in order to achieve conversion between a joystick and a virtual joystick touch screen event, it is necessary to match analog input of the physical joystick with pixel movement of the virtual joystick. For example, a maximum offset of the physical joystick is 65535 scales, a maximum offset of the virtual joystick is 50 pixels, and if the two offset parameters are proportional, it can be achieved that physical joystick input is converted into virtual joystick pixel output, so as to determine coordinates of a center point of the virtual joystick, and when the physical joystick swings to left by a half of a full scale, the corresponding virtual joystick touch screen event is a touch screen event that a finger holds the coordinates (77, 450) of the touch screen to offset 25 pixels to the left.
  • S205: Manipulate the touch screen application according to the converted touch screen event.
  • The embodiment of the present invention does not need to use an application interface, but can transfer a touch screen operation onto a physical input device by only setting a mapping relationship between the physical input device and the touch screen, thereby achieving more precise control and increasing the user's feel of operation.
  • FIG. 4 is a structural view of a first implementation of a touch screen terminal according to the present invention, and the touch screen terminal includes the following modules.
  • A starting and running module 41 is used for running a touch screen application.
  • A loading and parsing module 42 is used for loading a mapping configuration file corresponding to the touch screen application, the mapping configuration file including mapping rule information between a touch screen event and a physical input device.
  • Specifically, because different touch screen applications correspond to different mapping configuration files, after the starting and running module 41 runs a touch screen application, it is required that a system calls a mapping configuration file matching the touch screen application. Suppose a touch screen terminal has a touch screen application A, a touch screen application B and a touch screen application C installed therein, which are respectively corresponding to mapping configuration files 1, 2 and 3, when the starting and running module 41 runs the touch screen application A, the loading and parsing module 42 will call the mapping file 1 corresponding thereto, parse a mapping relationship between a physical input device and a touch screen event at a virtual icon of the touch screen application in the mapping configuration file, and load the mapping relationship into a system memory.
  • An acquisition and conversion module 43 is used for acquiring a manipulation instruction of the physical input device, and parsing the manipulation instruction according to the mapping rule information in the mapping configuration file, so as to convert the manipulation instruction into a touch screen event.
  • Specifically, when the touch screen terminal acquires a manipulation instruction of the physical input device, the acquisition and conversion module 43 converts, according to the mapping relationship between a physical input device and a touch screen event at a virtual icon of the touch screen application, the manipulation instruction of the physical input device into a touch screen event capable of triggering the touch screen application to execute a corresponding action. When the touch screen terminal obtains manipulation instructions of more than one physical input device at the same time, the acquisition and conversion module 43 converts current multiple manipulation instructions into the same number of touch screen events according to the mapping rule information.
  • An event execution module 44 is used for manipulating the touch screen application according to the converted touch screen event.
  • Specifically, the event execution module 44 distributes the touch screen event to a focus window of the touch screen application, so as to execute corresponding operation.
  • It should be noted that, the touch screen application in the present invention refers to a touch screen application having a virtual icon on a program interface, the virtual icon is located at a fixed position of the touch screen, the user can execute a predetermined operation by touching a predetermined virtual icon, and for a touch screen application which has no virtual icon displayed on the touch screen and whose predetermined operation can be executed in a touch screen fixed region, the fixed region is also a virtual icon with a transparent background color.
  • The embodiment of the present invention transfers the touch screen operation onto the physical input device through mapping of an external input device and a touch screen event, thereby achieving more precise control and increasing the user's feel of operation.
  • FIG. 5 is a structural view of a second implementation of a touch screen terminal according to the present invention. It can be seen from FIG. 5 that, this embodiment also includes a starting and running module 41, a loading and parsing module 42, an acquisition and conversion module 43 and an event execution module 44, and in addition, further includes:
    • a pre-configuring and saving module 45, for pre-configuring a mapping configuration file corresponding to the touch screen application, and saving the mapping configuration file.
  • Specifically, with respect to characteristics of virtual icons on a touch screen application operation interface, the pre-configuring and saving module 45 sets different physical input devices forming mapping with touch screen events. If the virtual icon is a joystick, the pre-configuring and saving module 45 sets a physical joystick forming mapping with the virtual icon; if the virtual icon is a button, the pre-configuring and saving module 45 sets a key forming mapping with the virtual icon; if the virtual icon is a slider, the pre-configuring and saving module 45 sets a pressure sensor key forming mapping with the virtual icon. Upon completion of setting, the pre-configuring and saving module 45 saves mapping relationship information to a mapping configuration file.
  • The acquisition and conversion module 43 includes:
    • a number acquisition unit 431, for acquiring a hardware number corresponding to the physical input device when detecting an action of the physical input device;
    • a query unit 432, for querying corresponding touch screen geometrical parameter information in the configuration file according to the hardware number; and
    • a conversion unit 433, for converting the action of the physical input device into a touch screen event.
  • Specifically, a racing game controlled by a key is used for description. Referring to FIG. 6, a rectangular region 61 is a game brake control region, and a car can be braked immediately when any point in the region is clicked. A rectangular region 62 is a game display region, a rectangular region 63 is a game acceleration/deceleration control region, clicking pixel points in the rectangular regions sequentially from top to bottom can control the speed of the car from slow to fast, 64 indicates a physical key A, 65 indicates a pressure sensor key B, the physical key A is mapped with a touch screen event at the rectangular region 61, and the pressure sensor key B is mapped with a touch screen event at the rectangular region 63.
  • The acceleration/deceleration control region controls a continuously changing process, at this time, a key with a sensor is used for mapping, and because the sensor is generally used for detecting an analog signal, that is, a continuously changing signal, a continuously changing signal actually input externally can be converted into a continuously changing process of pixels on the touch screen. The pressure sensor key B is used to map the touch screen event of the acceleration/deceleration control region, and a common key A is used to map the brake control region.
  • When the key A is pressed, the system generates an interruption, the number acquisition unit 431 acquires a key value 14 corresponding to the key A, the query unit 432 finds corresponding touch screen geometrical parameter information in the mapping configuration file according to the key value 14, where the touch screen geometrical parameter information is: center point coordinates (28, 228) and a maximum offset of 0 pixel, the conversion unit 433 converts the pressing action of the key A into a single-click event at the touch screen (28, 228), and the center point coordinates are coordinate values of any point in the brake control region.
  • When the key B is pressed, the system generates an interruption, the number acquisition unit 431 acquires a key value 15 corresponding to the key B, the query unit 432 finds corresponding touch screen geometrical parameter information in the mapping configuration file according to the key value 15, where the touch screen geometrical parameter information is: center point coordinates (763, 2), a maximum offset of -470 pixels, and an offset angle of -270 degrees, the conversion unit 433 converts the pressing action of the key B into a touch screen event along a γ-axis negative direction taking the touch screen coordinates (763, 2) as a starting point. The maximum scale value of a pressure sensor is M, the maximum offset pixel in a γ-axis negative direction of the acceleration/deceleration control region is N, a proportional coefficient is k=N/M, suppose an analog input by the pressure button is P, the corresponding pixel offset on the touch screen is k·P pixels, where M, N, P are integers, and at this time, the conversion unit 433 converts the pressing action of the key B into a touch action at touch screen coordinates (763, 2+k·P).
  • The embodiment of the present invention does not need to use an application interface, but can transfer a touch screen operation onto a physical input device by only setting a mapping relationship between the physical input device and the touch screen, thereby achieving more precise control and increasing the user's feel of operation.
  • Persons of ordinary skill in the art should understand that that all of or a part of processes in the method according to the embodiments may be implemented by a computer program instructing relevant hardware. The program may be stored in a computer readable storage medium. When the program is executed, the processes of the method according to the embodiments of the present invention are performed. The storage medium may be a magnetic disk, an optical disc, a read-only memory (ROM) or a random access memory (RAM).
  • The above is merely a preferred embodiment of the present invention, and certainly cannot be used to limit the scope of the present invention. Persons of ordinary skill in the art should understand that equivalent variations implementing all or a part of the processes of the embodiment according to the claims of the present invention shall fall within the scope of the present invention.

Claims (10)

  1. A virtual icon touch screen application manipulation conversion method, comprising:
    running a touch screen application;
    loading a mapping configuration file corresponding to the touch screen application, the mapping configuration file comprising mapping rule information between a touch screen event and a physical input device;
    acquiring a manipulation instruction of the physical input device, and parsing the manipulation instruction according to the mapping rule information in the mapping configuration file, so as to convert the manipulation instruction into a touch screen event; and
    manipulating the touch screen application according to the converted touch screen event.
  2. The method according to claim 1, before the running a touch screen application, further comprising:
    pre-configuring a mapping configuration file corresponding to the touch screen application, and saving the mapping configuration file.
  3. The method according to claim 2, wherein, the acquiring a manipulation instruction of the physical input device, and parsing the manipulation instruction according to the mapping rule information in the mapping configuration file, so as to convert the manipulation instruction into a touch screen event comprises:
    acquiring a hardware number corresponding to the physical input device when detecting an action of the physical input device;
    querying corresponding touch screen geometrical parameter information in the configuration file according to the hardware number; and
    converting the action of the physical input device into a touch screen event.
  4. The method according to any one of claims 1 to 3, wherein, the physical input device comprises: a key and/or a joystick.
  5. The method according to claim 4, wherein, the mapping rule information between a touch screen event and a physical input device comprises:
    mapping rule information between a touch screen event, at a position of a virtual icon in the touch screen application, and the key; and/or
    mapping rule information between a touch screen event, at a position of a virtual icon in the touch screen application, and the joystick.
  6. A touch screen terminal, comprising:
    a starting and running module, for running a touch screen application;
    a loading and parsing module, for loading a mapping configuration file corresponding to the touch screen application, the mapping configuration file comprising mapping rule information between a touch screen event and a physical input device;
    an acquisition and conversion module, for acquiring a manipulation instruction of the physical input device, and parsing the manipulation instruction according to the mapping rule information in the mapping configuration file, so as to convert the manipulation instruction into a touch screen event; and
    an event execution module, for manipulating the touch screen application according to the converted touch screen event.
  7. The touch screen terminal according to claim 6, further comprising:
    a pre-configuring and saving module, for pre-configuring a mapping configuration file corresponding to the touch screen application, and saving the mapping configuration file.
  8. The touch screen terminal according to claim 7, wherein, the acquisition and conversion module comprises:
    a number acquisition unit, for acquiring a hardware number corresponding to the physical input device when detecting an action of the physical input device;
    a query unit, for querying corresponding touch screen geometrical parameter information in the configuration file according to the hardware number; and
    a conversion unit, for converting the action of the physical input device into a touch screen event.
  9. The touch screen terminal according to any one of claims 6 to 8, wherein, the physical input device comprises: a key and/or a joystick.
  10. The touch screen terminal according to claim 9, wherein, the mapping rule information between a touch screen event and a physical input device comprises:
    mapping rule information between a touch screen event, at a position of a virtual icon in the touch screen application, and the key; and/or
    mapping rule information between a touch screen event, at a position of a virtual icon in the touch screen application, and the joystick.
EP12875636.8A 2012-04-27 2012-11-29 Operation control conversion method for virtual icon touchscreen application program, and touchscreen terminal Withdrawn EP2843521A4 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN2012101268723A CN102707882A (en) 2012-04-27 2012-04-27 Method for converting control modes of application program of touch screen with virtual icons and touch screen terminal
PCT/CN2012/085568 WO2013159521A1 (en) 2012-04-27 2012-11-29 Operation control conversion method for virtual icon touchscreen application program, and touchscreen terminal

Publications (2)

Publication Number Publication Date
EP2843521A1 true EP2843521A1 (en) 2015-03-04
EP2843521A4 EP2843521A4 (en) 2016-01-20

Family

ID=46900727

Family Applications (1)

Application Number Title Priority Date Filing Date
EP12875636.8A Withdrawn EP2843521A4 (en) 2012-04-27 2012-11-29 Operation control conversion method for virtual icon touchscreen application program, and touchscreen terminal

Country Status (7)

Country Link
US (1) US20140137014A1 (en)
EP (1) EP2843521A4 (en)
JP (1) JP5881824B2 (en)
KR (1) KR20140148492A (en)
CN (1) CN102707882A (en)
EA (1) EA201491853A1 (en)
WO (1) WO2013159521A1 (en)

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102707882A (en) * 2012-04-27 2012-10-03 深圳瑞高信息技术有限公司 Method for converting control modes of application program of touch screen with virtual icons and touch screen terminal
CN104423818A (en) * 2013-08-26 2015-03-18 联想(北京)有限公司 Information processing method, information processing device and electronic device
KR20150051663A (en) * 2013-11-05 2015-05-13 삼성전자주식회사 Method for executing function in response to touch input and electronic device implementing the same
CN103729065B (en) * 2013-12-17 2018-01-30 深圳市慧为智能科技股份有限公司 Touch control operation is mapped to the system and method for physical button
US9227141B2 (en) * 2013-12-31 2016-01-05 Microsoft Technology Licensing, Llc Touch screen game controller
US20150202533A1 (en) * 2014-01-21 2015-07-23 Nvidia Corporation Mapping touchscreen gestures to ergonomic controls across application scenes
CN103914305B (en) * 2014-04-10 2019-02-12 Oppo广东移动通信有限公司 The method and system of application are freely controlled on a kind of mobile terminal
CN104166480B (en) * 2014-08-15 2018-09-04 小米科技有限责任公司 Use the method and device of physical button operation control terminal
JP6017734B1 (en) * 2015-01-16 2016-11-02 シャープ株式会社 Terminal device and program for controlling terminal device
US20170024086A1 (en) * 2015-06-23 2017-01-26 Jamdeo Canada Ltd. System and methods for detection and handling of focus elements
KR101637165B1 (en) * 2015-10-30 2016-07-07 주식회사 온매칭 Multi-function controller
KR101637161B1 (en) * 2015-10-30 2016-07-07 주식회사 온매칭 Multi-function control system
CN105320297A (en) * 2015-11-16 2016-02-10 海信集团有限公司 Terminal device control method and apparatus
CN107493450A (en) * 2016-06-12 2017-12-19 中兴通讯股份有限公司 Video call business button management method and business platform, terminal
US10235809B2 (en) * 2016-06-30 2019-03-19 Microsoft Technology Licensing, Llc Reality to virtual reality portal for dual presence of devices
US11054894B2 (en) 2017-05-05 2021-07-06 Microsoft Technology Licensing, Llc Integrated mixed-input system
CN107908467A (en) * 2017-10-30 2018-04-13 广东小天才科技有限公司 A kind of application programe switch-over method, device and smart machine
ES2947297T3 (en) 2017-11-07 2023-08-04 Huawei Tech Co Ltd Touch control method and device
CN108008992B (en) * 2017-11-24 2020-08-18 南昌黑鲨科技有限公司 Input operation processing method, processing device and computer readable storage medium
CN108762746A (en) * 2018-05-28 2018-11-06 北京酷我科技有限公司 A kind of mobile gesture optimization method
CN108897457B (en) * 2018-08-16 2024-03-01 上海飞智电子科技有限公司 Touch device assembly and touch system
CN108992924A (en) * 2018-08-21 2018-12-14 苏州蜗牛数字科技股份有限公司 A method of triggering orderly touch screen operation event
CN112394860B (en) * 2019-08-14 2023-07-14 比亚迪股份有限公司 Game touch control method based on vehicle and vehicle
CN112328356B (en) * 2020-10-21 2023-09-29 成都安易迅科技有限公司 Intercommunication method and device for Android and Windows, storage medium and computer equipment
CN113467654A (en) * 2021-03-23 2021-10-01 中科创达软件股份有限公司 Application program control method and device, electronic equipment and storage medium

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2939392B2 (en) * 1992-06-09 1999-08-25 株式会社フジクラ emulator
US20070061126A1 (en) * 2005-09-01 2007-03-15 Anthony Russo System for and method of emulating electronic input devices
US20090079702A1 (en) * 2007-09-25 2009-03-26 Nokia Corporation Method, Apparatus and Computer Program Product for Providing an Adaptive Keypad on Touch Display Devices
CN101498973B (en) * 2008-01-30 2013-04-10 义隆电子股份有限公司 Touch control interpretation structure and method for executing touch control application program by multi-finger gesture
US20090213083A1 (en) * 2008-02-26 2009-08-27 Apple Inc. Simulation of multi-point gestures with a single pointing device
US20090273569A1 (en) * 2008-05-01 2009-11-05 Microsoft Corporation Multiple touch input simulation using single input peripherals
WO2010026587A1 (en) * 2008-09-04 2010-03-11 Extreme Reality Ltd. Method system and software for providing image sensor based human machine interfacing
US8527894B2 (en) * 2008-12-29 2013-09-03 International Business Machines Corporation Keyboard based graphical user interface navigation
CN201489455U (en) * 2009-08-05 2010-05-26 梁立人 Keyboard with display touch screen
US20110157015A1 (en) * 2009-12-25 2011-06-30 Cywee Group Limited Method of generating multi-touch signal, dongle for generating multi-touch signal, and related control system
JP5513266B2 (en) * 2010-06-09 2014-06-04 富士通コンポーネント株式会社 Conversion device and program
CN202004841U (en) * 2010-12-17 2011-10-05 北京文和时代科技有限公司 Terminal communication equipment capable of conveniently controlling game
US20120212422A1 (en) * 2011-02-21 2012-08-23 Iasolution Inc. Software Aided Physical Keyboard for a Touch-Screen
CN102209146B (en) * 2011-05-20 2014-05-28 惠州Tcl移动通信有限公司 System and method for simulating joystick of panel computer on smart mobile phone
US9513799B2 (en) * 2011-06-05 2016-12-06 Apple Inc. Devices, methods, and graphical user interfaces for providing control of a touch-based user interface absent physical touch capabilities
CN102331822A (en) * 2011-10-31 2012-01-25 靖江喜悦科技咨询有限公司 Flat computer leather sheath with keyboard function
CN102436308A (en) * 2011-11-11 2012-05-02 陈文博 Materialized mapping method of touch screen virtual key and touch screen game mobile phone using same
US20130162519A1 (en) * 2011-12-23 2013-06-27 Sap Ag Cross-platform human input customization
CN102707882A (en) * 2012-04-27 2012-10-03 深圳瑞高信息技术有限公司 Method for converting control modes of application program of touch screen with virtual icons and touch screen terminal

Also Published As

Publication number Publication date
JP5881824B2 (en) 2016-03-09
US20140137014A1 (en) 2014-05-15
WO2013159521A8 (en) 2014-01-30
EA201491853A1 (en) 2015-04-30
EP2843521A4 (en) 2016-01-20
JP2014516185A (en) 2014-07-07
CN102707882A (en) 2012-10-03
WO2013159521A1 (en) 2013-10-31
KR20140148492A (en) 2014-12-31

Similar Documents

Publication Publication Date Title
EP2843521A1 (en) Operation control conversion method for virtual icon touchscreen application program, and touchscreen terminal
US11573696B2 (en) Application display method and terminal
KR101930225B1 (en) Method and apparatus for controlling touch screen operation mode
KR20140038568A (en) Multi-touch uses, gestures, and implementation
US20120297336A1 (en) Computer system with touch screen and associated window resizing method
JP5713180B2 (en) Touch panel device that operates as if the detection area is smaller than the display area of the display.
EP1990707A1 (en) Dual function touch screen module for portable device and operating method therefor
US20240077948A1 (en) Gesture-based display interface control method and apparatus, device and storage medium
CN102081500A (en) Display control method, device and system
JP2012003404A (en) Information display device
WO2014032239A1 (en) Method for terminal device to acquire instruction and terminal device
CN103914305B (en) The method and system of application are freely controlled on a kind of mobile terminal
KR20160019762A (en) Method for controlling touch screen with one hand
US20150009136A1 (en) Operation input device and input operation processing method
JPH1124841A (en) Information processing device and method, and storage medium
WO2015184682A1 (en) Method for controlling terminal screen, and terminal
JP6210055B2 (en) Information processing system, information processing apparatus, and information processing method
CN213780803U (en) Intelligent wearable device with touch display screen
US20210157479A1 (en) Extended control device and image control method
JP4611388B2 (en) Input support computer program and input support computer system
JP2010079772A (en) Coordinate indicating device and information processing device using the same
JP6083908B1 (en) Information processing apparatus, information processing method, and program
GB2597055A (en) Dynamic context-specific input device and method
CN104569529A (en) Digital oscillographic signal display device
CN113407042A (en) Information adjusting method and electronic equipment

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20141119

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: SUZHOU SNAIL TECHNOLOGY DIGITAL CO., LTD.

DAX Request for extension of the european patent (deleted)
RA4 Supplementary search report drawn up and despatched (corrected)

Effective date: 20151217

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 9/44 20060101ALI20151211BHEP

Ipc: G06F 3/048 20060101AFI20151211BHEP

17Q First examination report despatched

Effective date: 20161129

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN

18W Application withdrawn

Effective date: 20170406